2024-09-21T06:14:54.075 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T06:14:54.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:14:54.204 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913542' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi049.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHagvDGVAsTIb/6LgRIEfH2pwbfoJopvHWIq935gNNI7EU8NFRJrSO8C1S3YdcBYleD56Dq7HD0moIzOTP1owEU= smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJewvpBPw/ZgtXfAcHiu8zdJ6OSTJfvrfvEyVPZOFXaxCuveuyPenh/E3fNqPwxqorCNEixpdRsG/z5Zohgi3gE= smithi098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJVUqskiYpCAJzkZ03dZpT3C2YZ3gNDls3Hw2sUhVUMKF7MY7526MjdeLdtIaQiM+OeOSUuqknqwGYCE3DBdfXY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T06:14:54.204 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T06:14:54.205 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T06:14:54.205 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T06:14:54.207 INFO:teuthology.task.internal:Checking packages... 2024-09-21T06:14:54.226 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T06:14:54.227 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T06:14:54.227 INFO:teuthology.packaging:ref: None 2024-09-21T06:14:54.227 INFO:teuthology.packaging:tag: None 2024-09-21T06:14:54.227 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:14:54.227 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:14:54.227 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:14:54.372 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T06:14:54.374 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T06:14:54.390 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T06:14:54.390 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T06:14:54.403 INFO:teuthology.task.internal:Saving configuration 2024-09-21T06:14:54.424 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T06:14:54.440 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T06:14:54.465 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:08:19.577795', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHagvDGVAsTIb/6LgRIEfH2pwbfoJopvHWIq935gNNI7EU8NFRJrSO8C1S3YdcBYleD56Dq7HD0moIzOTP1owEU='} 2024-09-21T06:14:54.489 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:08:19.576982', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJewvpBPw/ZgtXfAcHiu8zdJ6OSTJfvrfvEyVPZOFXaxCuveuyPenh/E3fNqPwxqorCNEixpdRsG/z5Zohgi3gE='} 2024-09-21T06:14:54.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:08:19.575580', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJVUqskiYpCAJzkZ03dZpT3C2YZ3gNDls3Hw2sUhVUMKF7MY7526MjdeLdtIaQiM+OeOSUuqknqwGYCE3DBdfXY='} 2024-09-21T06:14:54.509 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T06:14:54.517 INFO:teuthology.task.internal:roles: ubuntu@smithi049.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T06:14:54.517 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T06:14:54.517 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T06:14:54.518 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T06:14:54.605 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff8670735b0>, signals=[15]) 2024-09-21T06:14:54.605 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T06:14:54.614 INFO:teuthology.task.internal:Opening connections... 2024-09-21T06:14:54.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:14:54.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:14:54.690 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T06:14:54.691 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:14:54.763 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi098.front.sepia.ceph.com 2024-09-21T06:14:54.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:14:54.835 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T06:14:54.844 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-09-21T06:14:54.863 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-09-21T06:14:54.863 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-09-21T06:14:54.921 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2024-09-21T06:14:54.921 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="9" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="9" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:14:54.922 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:14:54.923 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-09-21T06:14:54.947 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-09-21T06:14:54.966 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-09-21T06:14:54.966 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-09-21T06:14:55.023 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2024-09-21T06:14:55.023 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="9" 2024-09-21T06:14:55.023 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2024-09-21T06:14:55.023 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="9" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:14:55.024 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:14:55.024 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-09-21T06:14:55.046 DEBUG:teuthology.orchestra.run.smithi098:> uname -m 2024-09-21T06:14:55.064 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2024-09-21T06:14:55.065 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release 2024-09-21T06:14:55.122 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="9" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="9" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:14:55.123 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:14:55.124 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2024-09-21T06:14:55.146 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T06:14:55.160 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T06:14:55.171 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T06:14:55.171 DEBUG:teuthology.orchestra.run.smithi049:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:14:55.173 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:14:55.176 DEBUG:teuthology.orchestra.run.smithi098:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:14:55.193 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T06:14:55.213 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T06:14:55.213 DEBUG:teuthology.orchestra.run.smithi049:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:14:55.231 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:14:55.233 DEBUG:teuthology.orchestra.run.smithi098:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:14:55.343 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T06:14:55.411 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T06:14:55.425 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T06:14:55.425 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T06:14:55.425 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T06:14:55.425 DEBUG:teuthology.orchestra.run.smithi049:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:14:55.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:14:55.443 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-09-21T06:14:55.502 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:14:55.502 INFO:teuthology.task.kernel:Running kernel on smithi049: 5.14.0-503.el9.x86_64 2024-09-21T06:14:55.502 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum install -y kernel 2024-09-21T06:15:38.687 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 204 kB/s | 8.3 MB 00:41 2024-09-21T06:15:40.455 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-21T06:15:44.881 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-21T06:15:46.498 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 19 kB 00:00 2024-09-21T06:15:47.602 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-21T06:15:53.374 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-21T06:15:55.339 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:15:55.339 INFO:teuthology.orchestra.run.smithi049.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:15:55.437 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout: Package Architecture Version Repository Size 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout:================================================================================ 2024-09-21T06:15:55.447 INFO:teuthology.orchestra.run.smithi049.stdout:Install 4 Packages 2024-09-21T06:15:55.448 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:15:55.448 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 79 M 2024-09-21T06:15:55.448 INFO:teuthology.orchestra.run.smithi049.stdout:Installed size: 126 M 2024-09-21T06:15:55.448 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-21T06:15:55.543 INFO:teuthology.orchestra.run.smithi049.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 488 kB/s | 36 kB 00:00 2024-09-21T06:15:55.993 INFO:teuthology.orchestra.run.smithi049.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-09-21T06:15:56.501 INFO:teuthology.orchestra.run.smithi049.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 30 MB/s | 29 MB 00:00 2024-09-21T06:15:56.985 INFO:teuthology.orchestra.run.smithi049.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 23 MB/s | 35 MB 00:01 2024-09-21T06:15:56.985 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:15:56.985 INFO:teuthology.orchestra.run.smithi049.stdout:Total 51 MB/s | 79 MB 00:01 2024-09-21T06:15:57.692 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-21T06:15:58.099 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-21T06:15:58.099 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-21T06:15:59.084 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-21T06:15:59.085 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-21T06:16:01.672 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-21T06:16:02.339 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:16:02.427 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:16:05.316 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:16:05.456 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:16:10.745 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:16:10.790 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:16.023 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:55.762 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:55.804 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:56.161 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:56.161 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:16:56.161 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:16:56.161 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:16:56.988 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:56.988 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:16:56.988 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-21T06:16:56.988 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:16:56.988 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:16:56.988 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:16:56.988 INFO:teuthology.orchestra.run.smithi049.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:16:56.988 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:16:56.988 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-21T06:16:57.360 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:16:57.443 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:16:57.443 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:16:57.443 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:16:57.443 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:16:57.443 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:16:57.443 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T06:16:57.444 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi049.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:16:57.444 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:16:57.505 INFO:teuthology.orchestra.run.smithi049.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:16:57.505 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:16:57.505 DEBUG:teuthology.orchestra.run.smithi049:> sudo rpm -qi grub2-tools 2024-09-21T06:16:57.538 INFO:teuthology.orchestra.run.smithi049.stdout:Name : grub2-tools 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Epoch : 1 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Version : 2.06 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Release : 82.el9 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Architecture: x86_64 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Group : Unspecified 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Size : 8274670 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:License : GPLv3+ 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Packager : builder@centos.org 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:Vendor : CentOS 2024-09-21T06:16:57.539 INFO:teuthology.orchestra.run.smithi049.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:16:57.540 INFO:teuthology.orchestra.run.smithi049.stdout:Summary : Support tools for GRUB. 2024-09-21T06:16:57.540 INFO:teuthology.orchestra.run.smithi049.stdout:Description : 2024-09-21T06:16:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:16:57.540 INFO:teuthology.orchestra.run.smithi049.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:16:57.540 INFO:teuthology.orchestra.run.smithi049.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:16:57.540 INFO:teuthology.orchestra.run.smithi049.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:16:57.540 INFO:teuthology.orchestra.run.smithi049.stdout:hardware devices. 2024-09-21T06:16:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:16:57.540 INFO:teuthology.orchestra.run.smithi049.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:16:57.541 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:16:57.541 INFO:teuthology.task.kernel:Updating grub on smithi049 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:16:57.541 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:16:58.335 INFO:teuthology.orchestra.run.smithi049.stderr:Generating grub configuration file ... 2024-09-21T06:16:59.689 INFO:teuthology.orchestra.run.smithi049.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:16:59.719 INFO:teuthology.orchestra.run.smithi049.stderr:done 2024-09-21T06:16:59.721 DEBUG:teuthology.orchestra.run.smithi049:> mktemp 2024-09-21T06:16:59.737 INFO:teuthology.orchestra.run.smithi049.stdout:/tmp/tmp.DWdDW7CKP2 2024-09-21T06:16:59.737 DEBUG:teuthology.orchestra.run.smithi049:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DWdDW7CKP2 2024-09-21T06:16:59.805 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0666 /tmp/tmp.DWdDW7CKP2 2024-09-21T06:16:59.940 DEBUG:teuthology.orchestra.remote:smithi049:/tmp/tmp.DWdDW7CKP2 is 6KB 2024-09-21T06:16:59.960 DEBUG:teuthology.orchestra.run.smithi049:> rm -fr /tmp/tmp.DWdDW7CKP2 2024-09-21T06:16:59.975 DEBUG:teuthology.orchestra.run.smithi049:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:17:00.039 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:17:00.039 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:17:00.039 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:17:00.039 INFO:teuthology.orchestra.run.smithi049.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:17:00.040 DEBUG:teuthology.orchestra.run.smithi049:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:17:00.207 DEBUG:teuthology.orchestra.run.smithi049:> sudo shutdown -r now 2024-09-21T06:17:30.209 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T06:17:30.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T06:17:30.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:17:48.527 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-21T06:17:57.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T06:17:57.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:18:00.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-21T06:18:12.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T06:18:12.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:18:15.663 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-21T06:18:30.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T06:18:30.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:18:33.743 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-21T06:18:51.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T06:18:51.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:19:10.191 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-09-21T06:19:31.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T06:19:31.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:19:31.726 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-09-21T06:19:32.470 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T06:19:32.471 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:19:32.471 DEBUG:teuthology.orchestra.run.smithi049:> uname -r 2024-09-21T06:19:32.486 INFO:teuthology.orchestra.run.smithi049.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:19:32.486 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:19:32.486 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:19:32.486 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:19:33.487 DEBUG:teuthology.parallel:result is None 2024-09-21T06:19:33.487 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T06:19:33.494 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T06:19:33.495 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:19:33.497 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:19:33.499 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:19:33.518 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T06:19:33.525 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T06:19:33.535 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T06:19:33.535 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:19:33.555 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:19:33.559 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:19:33.690 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T06:19:33.698 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T06:19:33.699 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:19:33.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:19:33.716 DEBUG:teuthology.orchestra.run.smithi098:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:19:33.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:19:33.733 DEBUG:teuthology.orchestra.run.smithi049:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:19:33.736 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:19:33.759 DEBUG:teuthology.orchestra.run.smithi098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:19:33.801 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:19:33.817 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:19:33.822 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:19:33.831 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:19:33.851 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:19:33.865 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:19:33.867 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T06:19:33.876 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T06:19:33.876 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:19:33.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:19:33.881 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:19:33.909 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T06:19:33.965 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T06:19:33.965 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:19:33.968 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:19:33.970 DEBUG:teuthology.orchestra.run.smithi098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:19:33.987 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:19:34.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:19:34.125 DEBUG:teuthology.orchestra.run.smithi049:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:19:34.205 DEBUG:teuthology.orchestra.run.smithi049:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:19:34.251 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:19:34.251 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:19:34.318 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:19:34.362 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:19:34.429 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:19:34.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:19:34.513 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:19:34.514 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:19:34.578 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:19:34.623 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:19:34.686 DEBUG:teuthology.orchestra.run.smithi098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:19:34.730 DEBUG:teuthology.orchestra.run.smithi098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:19:34.774 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:19:34.774 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:19:34.841 DEBUG:teuthology.orchestra.run.smithi049:> sudo service rsyslog restart 2024-09-21T06:19:34.844 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-09-21T06:19:34.847 DEBUG:teuthology.orchestra.run.smithi098:> sudo service rsyslog restart 2024-09-21T06:19:34.883 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:19:34.888 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:19:34.924 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:19:35.355 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T06:19:35.369 INFO:teuthology.task.internal:Starting timer... 2024-09-21T06:19:35.369 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T06:19:35.385 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T06:19:35.394 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T06:19:35.394 DEBUG:teuthology.orchestra.run.smithi049:> sudo service auditd rotate 2024-09-21T06:19:35.459 INFO:teuthology.orchestra.run.smithi049.stdout:Rotating logs: 2024-09-21T06:19:35.461 DEBUG:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2024-09-21T06:19:35.513 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: 2024-09-21T06:19:35.515 DEBUG:teuthology.orchestra.run.smithi098:> sudo service auditd rotate 2024-09-21T06:19:35.584 INFO:teuthology.orchestra.run.smithi098.stdout:Rotating logs: 2024-09-21T06:19:35.587 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T06:19:35.587 DEBUG:teuthology.orchestra.run.smithi049:> /usr/sbin/getenforce 2024-09-21T06:19:35.609 INFO:teuthology.orchestra.run.smithi049.stdout:Permissive 2024-09-21T06:19:35.609 DEBUG:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2024-09-21T06:19:35.633 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2024-09-21T06:19:35.633 DEBUG:teuthology.orchestra.run.smithi098:> /usr/sbin/getenforce 2024-09-21T06:19:35.655 INFO:teuthology.orchestra.run.smithi098.stdout:Permissive 2024-09-21T06:19:35.655 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi049.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi098.front.sepia.ceph.com': 'permissive'} 2024-09-21T06:19:35.655 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:19:35.685 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:19:35.685 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:19:35.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:19:35.714 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:19:35.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:19:35.741 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T06:19:35.741 DEBUG:teuthology.orchestra.run.smithi049:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:19:35.773 DEBUG:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:19:35.809 DEBUG:teuthology.orchestra.run.smithi098:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:19:35.840 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T06:19:35.848 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T06:19:35.859 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T06:19:35.860 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi049.front.sepia.ceph.com,smithi079.front.sepia.ceph.com,smithi098.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:23:40.963 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi049.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi098.front.sepia.ceph.com')] 2024-09-21T06:23:40.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T06:23:40.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:23:41.040 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-09-21T06:23:41.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-09-21T06:23:41.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T06:23:41.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:23:41.201 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-21T06:23:41.282 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-21T06:23:41.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-21T06:23:41.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:23:41.358 DEBUG:teuthology.orchestra.run.smithi098:> true 2024-09-21T06:23:41.435 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com' 2024-09-21T06:23:41.436 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:23:41.446 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:23:41.447 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:23:41.447 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:23:41.450 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:23:41.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:23:41.452 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:23:41.452 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:23:41.480 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:23:41.481 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:23:41.495 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:23:41.497 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:23:41.507 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:23:41.519 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: ntpd: command not found 2024-09-21T06:23:41.523 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:23:41.524 INFO:teuthology.orchestra.run.smithi049.stderr:sudo: ntpd: command not found 2024-09-21T06:23:41.530 INFO:teuthology.orchestra.run.smithi079.stdout:506 Cannot talk to daemon 2024-09-21T06:23:41.537 INFO:teuthology.orchestra.run.smithi049.stdout:506 Cannot talk to daemon 2024-09-21T06:23:41.544 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:23:41.550 INFO:teuthology.orchestra.run.smithi098.stderr:sudo: ntpd: command not found 2024-09-21T06:23:41.553 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:23:41.558 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:23:41.562 INFO:teuthology.orchestra.run.smithi098.stdout:506 Cannot talk to daemon 2024-09-21T06:23:41.568 INFO:teuthology.orchestra.run.smithi049.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:23:41.577 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:23:41.591 INFO:teuthology.orchestra.run.smithi098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:23:41.613 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:23:41.617 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:23:41.617 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-09-21T06:23:41.617 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.618 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.618 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.618 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.626 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:23:41.630 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:23:41.630 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-09-21T06:23:41.630 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.630 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.630 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.630 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.650 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:23:41.655 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:23:41.655 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-21T06:23:41.655 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.655 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.655 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.655 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:23:41.655 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:23:41.663 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:23:41.664 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:23:41.664 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:23:41.664 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:23:41.669 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:23:41.669 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:23:41.669 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:23:41.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:23:41.671 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:23:41.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:23:41.672 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:23:41.673 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:23:41.822 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:23:41.822 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:23:41.834 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:23:41.834 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:23:41.841 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:23:41.841 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:23:41.930 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:23:41.931 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:23:41.931 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:23:41.938 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:23:41.938 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:23:41.938 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:23:41.949 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:23:41.949 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:23:41.949 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:23:41.958 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:23:41.958 DEBUG:teuthology.orchestra.run.smithi049:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:23:41.964 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:23:41.964 DEBUG:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:23:41.975 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:23:41.975 DEBUG:teuthology.orchestra.run.smithi098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:23:42.026 DEBUG:teuthology.orchestra.run.smithi049:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:23:42.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:23:42.041 DEBUG:teuthology.orchestra.run.smithi098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:23:42.103 DEBUG:teuthology.orchestra.run.smithi049:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:23:42.105 DEBUG:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:23:42.116 DEBUG:teuthology.orchestra.run.smithi098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:23:42.168 INFO:teuthology.orchestra.run.smithi049.stdout:check_obsoletes = 1 2024-09-21T06:23:42.170 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum clean all 2024-09-21T06:23:42.171 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2024-09-21T06:23:42.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum clean all 2024-09-21T06:23:42.181 INFO:teuthology.orchestra.run.smithi098.stdout:check_obsoletes = 1 2024-09-21T06:23:42.182 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum clean all 2024-09-21T06:23:42.396 INFO:teuthology.orchestra.run.smithi079.stdout:45 files removed 2024-09-21T06:23:42.405 INFO:teuthology.orchestra.run.smithi098.stdout:45 files removed 2024-09-21T06:23:42.408 INFO:teuthology.orchestra.run.smithi049.stdout:45 files removed 2024-09-21T06:23:42.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:23:42.432 DEBUG:teuthology.orchestra.run.smithi098:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:23:42.435 DEBUG:teuthology.orchestra.run.smithi049:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:23:42.969 INFO:teuthology.orchestra.run.smithi079.stdout:ceph packages for x86_64 309 kB/s | 84 kB 00:00 2024-09-21T06:23:42.978 INFO:teuthology.orchestra.run.smithi098.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-21T06:23:43.002 INFO:teuthology.orchestra.run.smithi049.stdout:ceph packages for x86_64 317 kB/s | 84 kB 00:00 2024-09-21T06:23:43.278 INFO:teuthology.orchestra.run.smithi079.stdout:ceph noarch packages 90 kB/s | 24 kB 00:00 2024-09-21T06:23:43.278 INFO:teuthology.orchestra.run.smithi098.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-21T06:23:43.285 INFO:teuthology.orchestra.run.smithi049.stdout:ceph noarch packages 102 kB/s | 24 kB 00:00 2024-09-21T06:23:43.546 INFO:teuthology.orchestra.run.smithi098.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T06:23:43.553 INFO:teuthology.orchestra.run.smithi079.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-21T06:23:43.561 INFO:teuthology.orchestra.run.smithi049.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-21T06:23:44.020 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-21T06:23:46.079 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.3 MB 00:02 2024-09-21T06:23:46.344 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-21T06:23:47.205 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-21T06:23:48.089 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-21T06:23:51.354 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 20 MB 00:03 2024-09-21T06:23:51.481 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T06:23:52.956 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-21T06:23:53.861 INFO:teuthology.orchestra.run.smithi079.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T06:23:54.182 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.5 MB 00:02 2024-09-21T06:23:55.974 INFO:teuthology.orchestra.run.smithi098.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-21T06:23:56.745 INFO:teuthology.orchestra.run.smithi098.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-21T06:23:57.029 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-21T06:23:58.529 INFO:teuthology.orchestra.run.smithi049.stdout:CentOS Stream 9 - Extras packages 96 kB/s | 19 kB 00:00 2024-09-21T06:23:59.217 INFO:teuthology.orchestra.run.smithi079.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-21T06:23:59.292 INFO:teuthology.orchestra.run.smithi049.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-21T06:24:01.355 INFO:teuthology.orchestra.run.smithi079.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:24:01.355 INFO:teuthology.orchestra.run.smithi079.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:24:01.370 INFO:teuthology.orchestra.run.smithi079.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:24:01.371 INFO:teuthology.orchestra.run.smithi079.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:24:01.372 INFO:teuthology.orchestra.run.smithi079.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:24:01.373 INFO:teuthology.orchestra.run.smithi079.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:24:01.375 INFO:teuthology.orchestra.run.smithi079.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:24:01.378 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:24:01.379 INFO:teuthology.orchestra.run.smithi079.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:24:01.444 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies resolved. 2024-09-21T06:24:01.464 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-09-21T06:24:01.464 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2024-09-21T06:24:01.464 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:24:01.465 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:24:01.466 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:24:01.467 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrading: 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:24:01.468 INFO:teuthology.orchestra.run.smithi079.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:24:01.469 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:24:01.469 INFO:teuthology.orchestra.run.smithi079.stdout:Installing dependencies: 2024-09-21T06:24:01.469 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:24:01.469 INFO:teuthology.orchestra.run.smithi079.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:24:01.469 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:24:01.469 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:24:01.470 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:24:01.470 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:24:01.470 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:24:01.470 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:24:01.470 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:24:01.471 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:24:01.471 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:24:01.471 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:24:01.472 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:24:01.472 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:24:01.472 INFO:teuthology.orchestra.run.smithi079.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:24:01.472 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:24:01.473 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:24:01.473 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:24:01.473 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:24:01.473 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:24:01.473 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:24:01.473 INFO:teuthology.orchestra.run.smithi079.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:24:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:24:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:24:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:24:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:24:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:24:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:24:01.474 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:24:01.475 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:24:01.475 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:24:01.475 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:24:01.475 INFO:teuthology.orchestra.run.smithi079.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:24:01.475 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:24:01.475 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:24:01.476 INFO:teuthology.orchestra.run.smithi079.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:24:01.476 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:24:01.476 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:24:01.477 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:24:01.477 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:24:01.478 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:24:01.478 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:24:01.478 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:24:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:24:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:24:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:24:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:24:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:24:01.479 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:24:01.480 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:24:01.481 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:24:01.482 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:24:01.483 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:24:01.484 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:24:01.485 INFO:teuthology.orchestra.run.smithi079.stdout:Installing weak dependencies: 2024-09-21T06:24:01.485 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:24:01.485 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:24:01.485 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2024-09-21T06:24:01.485 INFO:teuthology.orchestra.run.smithi079.stdout:======================================================================================= 2024-09-21T06:24:01.485 INFO:teuthology.orchestra.run.smithi079.stdout:Install 149 Packages 2024-09-21T06:24:01.485 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade 8 Packages 2024-09-21T06:24:01.485 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:24:01.486 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 228 M 2024-09-21T06:24:01.486 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading Packages: 2024-09-21T06:24:02.134 INFO:teuthology.orchestra.run.smithi079.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 52 kB/s | 6.6 kB 00:00 2024-09-21T06:24:02.184 INFO:teuthology.orchestra.run.smithi098.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-21T06:24:02.426 INFO:teuthology.orchestra.run.smithi079.stdout:(2/157): ceph-base-19.3.0-5120.g18432218.el9.x8 13 MB/s | 5.5 MB 00:00 2024-09-21T06:24:02.460 INFO:teuthology.orchestra.run.smithi079.stdout:(3/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.6 MB/s | 873 kB 00:00 2024-09-21T06:24:02.485 INFO:teuthology.orchestra.run.smithi079.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 2.5 MB/s | 148 kB 00:00 2024-09-21T06:24:02.569 INFO:teuthology.orchestra.run.smithi079.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-21T06:24:02.869 INFO:teuthology.orchestra.run.smithi079.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 17 MB/s | 5.0 MB 00:00 2024-09-21T06:24:02.928 INFO:teuthology.orchestra.run.smithi079.stdout:(7/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.9 MB/s | 2.3 MB 00:00 2024-09-21T06:24:03.120 INFO:teuthology.orchestra.run.smithi079.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 18 MB/s | 20 MB 00:01 2024-09-21T06:24:03.161 INFO:teuthology.orchestra.run.smithi079.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 608 kB/s | 25 kB 00:00 2024-09-21T06:24:04.305 INFO:teuthology.orchestra.run.smithi098.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:24:04.306 INFO:teuthology.orchestra.run.smithi098.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:24:04.319 INFO:teuthology.orchestra.run.smithi098.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:24:04.320 INFO:teuthology.orchestra.run.smithi098.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:24:04.321 INFO:teuthology.orchestra.run.smithi098.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:24:04.322 INFO:teuthology.orchestra.run.smithi098.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:24:04.324 INFO:teuthology.orchestra.run.smithi098.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:24:04.327 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:24:04.328 INFO:teuthology.orchestra.run.smithi098.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:24:04.390 INFO:teuthology.orchestra.run.smithi098.stdout:Dependencies resolved. 2024-09-21T06:24:04.411 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-21T06:24:04.411 INFO:teuthology.orchestra.run.smithi098.stdout: Package Arch Version Repository Size 2024-09-21T06:24:04.411 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-21T06:24:04.411 INFO:teuthology.orchestra.run.smithi098.stdout:Installing: 2024-09-21T06:24:04.411 INFO:teuthology.orchestra.run.smithi098.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:24:04.412 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:24:04.413 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrading: 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:24:04.414 INFO:teuthology.orchestra.run.smithi098.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout:Installing dependencies: 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:24:04.415 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:24:04.416 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:24:04.417 INFO:teuthology.orchestra.run.smithi098.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:24:04.418 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:24:04.419 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:24:04.420 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:24:04.421 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:24:04.422 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout:Installing weak dependencies: 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction Summary 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout:======================================================================================= 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout:Install 149 Packages 2024-09-21T06:24:04.423 INFO:teuthology.orchestra.run.smithi098.stdout:Upgrade 8 Packages 2024-09-21T06:24:04.424 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:24:04.424 INFO:teuthology.orchestra.run.smithi098.stdout:Total download size: 228 M 2024-09-21T06:24:04.424 INFO:teuthology.orchestra.run.smithi098.stdout:Downloading Packages: 2024-09-21T06:24:04.922 INFO:teuthology.orchestra.run.smithi049.stdout:lab-extras 49 kB/s | 1.7 kB 00:00 2024-09-21T06:24:04.928 INFO:teuthology.orchestra.run.smithi079.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 5.2 MB/s | 10 MB 00:02 2024-09-21T06:24:05.086 INFO:teuthology.orchestra.run.smithi098.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 37 kB/s | 6.6 kB 00:00 2024-09-21T06:24:05.261 INFO:teuthology.orchestra.run.smithi098.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.9 MB/s | 873 kB 00:00 2024-09-21T06:24:05.278 INFO:teuthology.orchestra.run.smithi079.stdout:(11/157): ceph-test-19.3.0-5120.g18432218.el9.x 19 MB/s | 40 MB 00:02 2024-09-21T06:24:05.304 INFO:teuthology.orchestra.run.smithi079.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 602 kB/s | 226 kB 00:00 2024-09-21T06:24:05.345 INFO:teuthology.orchestra.run.smithi098.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T06:24:05.362 INFO:teuthology.orchestra.run.smithi079.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 324 kB/s | 27 kB 00:00 2024-09-21T06:24:05.388 INFO:teuthology.orchestra.run.smithi079.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 380 kB/s | 32 kB 00:00 2024-09-21T06:24:05.454 INFO:teuthology.orchestra.run.smithi098.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T06:24:05.488 INFO:teuthology.orchestra.run.smithi079.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 6.0 MB/s | 766 kB 00:00 2024-09-21T06:24:05.514 INFO:teuthology.orchestra.run.smithi079.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.2 MB/s | 158 kB 00:00 2024-09-21T06:24:05.546 INFO:teuthology.orchestra.run.smithi098.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-21T06:24:05.581 INFO:teuthology.orchestra.run.smithi079.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.3 MB/s | 127 kB 00:00 2024-09-21T06:24:05.596 INFO:teuthology.orchestra.run.smithi098.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.1 MB/s | 2.3 MB 00:00 2024-09-21T06:24:05.606 INFO:teuthology.orchestra.run.smithi079.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 5.4 MB/s | 507 kB 00:00 2024-09-21T06:24:05.855 INFO:teuthology.orchestra.run.smithi098.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 16 MB/s | 5.0 MB 00:00 2024-09-21T06:24:06.058 INFO:teuthology.orchestra.run.smithi079.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 100 kB/s | 45 kB 00:00 2024-09-21T06:24:06.157 INFO:teuthology.orchestra.run.smithi079.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.5 MB/s | 148 kB 00:00 2024-09-21T06:24:06.232 INFO:teuthology.orchestra.run.smithi079.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.1 MB/s | 161 kB 00:00 2024-09-21T06:24:06.290 INFO:teuthology.orchestra.run.smithi079.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T06:24:06.296 INFO:teuthology.orchestra.run.smithi098.stdout:(8/157): ceph-common-19.3.0-5120.g18432218.el9. 14 MB/s | 20 MB 00:01 2024-09-21T06:24:06.341 INFO:teuthology.orchestra.run.smithi079.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T06:24:06.355 INFO:teuthology.orchestra.run.smithi098.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 433 kB/s | 25 kB 00:00 2024-09-21T06:24:06.408 INFO:teuthology.orchestra.run.smithi079.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.5 MB/s | 99 kB 00:00 2024-09-21T06:24:06.500 INFO:teuthology.orchestra.run.smithi079.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 942 kB/s | 86 kB 00:00 2024-09-21T06:24:06.609 INFO:teuthology.orchestra.run.smithi079.stdout:(26/157): librgw2-19.3.0-5120.g18432218.el9.x86 5.1 MB/s | 5.3 MB 00:01 2024-09-21T06:24:06.639 INFO:teuthology.orchestra.run.smithi098.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 13 MB/s | 10 MB 00:00 2024-09-21T06:24:06.659 INFO:teuthology.orchestra.run.smithi079.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T06:24:06.734 INFO:teuthology.orchestra.run.smithi079.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 13 MB/s | 3.1 MB 00:00 2024-09-21T06:24:06.751 INFO:teuthology.orchestra.run.smithi079.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 372 kB/s | 34 kB 00:00 2024-09-21T06:24:06.785 INFO:teuthology.orchestra.run.smithi079.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:24:06.839 INFO:teuthology.orchestra.run.smithi098.stdout:(11/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 14 MB/s | 18 MB 00:01 2024-09-21T06:24:06.864 INFO:teuthology.orchestra.run.smithi098.stdout:(12/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.0 MB/s | 226 kB 00:00 2024-09-21T06:24:06.889 INFO:teuthology.orchestra.run.smithi098.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 539 kB/s | 27 kB 00:00 2024-09-21T06:24:06.915 INFO:teuthology.orchestra.run.smithi098.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 629 kB/s | 32 kB 00:00 2024-09-21T06:24:07.023 INFO:teuthology.orchestra.run.smithi098.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 1.4 MB/s | 158 kB 00:00 2024-09-21T06:24:07.027 INFO:teuthology.orchestra.run.smithi079.stdout:(31/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 4.3 MB/s | 18 MB 00:04 2024-09-21T06:24:07.057 INFO:teuthology.orchestra.run.smithi098.stdout:(16/157): libcephfs2-19.3.0-5120.g18432218.el9. 4.5 MB/s | 766 kB 00:00 2024-09-21T06:24:07.107 INFO:teuthology.orchestra.run.smithi098.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 1.5 MB/s | 127 kB 00:00 2024-09-21T06:24:07.286 INFO:teuthology.orchestra.run.smithi079.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 1.1 MB/s | 292 kB 00:00 2024-09-21T06:24:07.342 INFO:teuthology.orchestra.run.smithi049.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:24:07.343 INFO:teuthology.orchestra.run.smithi049.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:24:07.355 INFO:teuthology.orchestra.run.smithi049.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:24:07.355 INFO:teuthology.orchestra.run.smithi049.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:24:07.356 INFO:teuthology.orchestra.run.smithi049.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:24:07.357 INFO:teuthology.orchestra.run.smithi049.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:24:07.359 INFO:teuthology.orchestra.run.smithi049.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:24:07.361 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:24:07.362 INFO:teuthology.orchestra.run.smithi049.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:24:07.411 INFO:teuthology.orchestra.run.smithi079.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 395 kB/s | 49 kB 00:00 2024-09-21T06:24:07.429 INFO:teuthology.orchestra.run.smithi049.stdout:Dependencies resolved. 2024-09-21T06:24:07.451 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-09-21T06:24:07.451 INFO:teuthology.orchestra.run.smithi049.stdout: Package Arch Version Repository Size 2024-09-21T06:24:07.451 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-09-21T06:24:07.451 INFO:teuthology.orchestra.run.smithi049.stdout:Installing: 2024-09-21T06:24:07.451 INFO:teuthology.orchestra.run.smithi049.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:24:07.452 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:24:07.453 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrading: 2024-09-21T06:24:07.454 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout:Installing dependencies: 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:24:07.455 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:24:07.456 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:24:07.457 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:24:07.458 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:24:07.459 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:24:07.460 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:24:07.461 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:24:07.462 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout:Installing weak dependencies: 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction Summary 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout:======================================================================================= 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout:Install 149 Packages 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout:Upgrade 8 Packages 2024-09-21T06:24:07.463 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:24:07.464 INFO:teuthology.orchestra.run.smithi049.stdout:Total download size: 228 M 2024-09-21T06:24:07.464 INFO:teuthology.orchestra.run.smithi049.stdout:Downloading Packages: 2024-09-21T06:24:07.511 INFO:teuthology.orchestra.run.smithi079.stdout:(34/157): ceph-mgr-diskprediction-local-19.3.0- 10 MB/s | 7.4 MB 00:00 2024-09-21T06:24:07.536 INFO:teuthology.orchestra.run.smithi079.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 131 kB/s | 16 kB 00:00 2024-09-21T06:24:07.587 INFO:teuthology.orchestra.run.smithi079.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 3.7 MB/s | 285 kB 00:00 2024-09-21T06:24:07.654 INFO:teuthology.orchestra.run.smithi079.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 275 kB/s | 18 kB 00:00 2024-09-21T06:24:07.674 INFO:teuthology.orchestra.run.smithi098.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 9.3 MB/s | 5.3 MB 00:00 2024-09-21T06:24:07.708 INFO:teuthology.orchestra.run.smithi098.stdout:(19/157): libradosstriper1-19.3.0-5120.g1843221 779 kB/s | 507 kB 00:00 2024-09-21T06:24:07.741 INFO:teuthology.orchestra.run.smithi098.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 677 kB/s | 45 kB 00:00 2024-09-21T06:24:07.775 INFO:teuthology.orchestra.run.smithi098.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T06:24:07.787 INFO:teuthology.orchestra.run.smithi079.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 599 kB/s | 80 kB 00:00 2024-09-21T06:24:07.800 INFO:teuthology.orchestra.run.smithi098.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T06:24:07.821 INFO:teuthology.orchestra.run.smithi079.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 2.7 MB/s | 784 kB 00:00 2024-09-21T06:24:07.842 INFO:teuthology.orchestra.run.smithi098.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T06:24:07.867 INFO:teuthology.orchestra.run.smithi098.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T06:24:07.893 INFO:teuthology.orchestra.run.smithi098.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:24:07.926 INFO:teuthology.orchestra.run.smithi098.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.4 MB/s | 86 kB 00:00 2024-09-21T06:24:07.929 INFO:teuthology.orchestra.run.smithi079.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 5.5 MB/s | 801 kB 00:00 2024-09-21T06:24:07.966 INFO:teuthology.orchestra.run.smithi049.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 42 kB/s | 6.6 kB 00:00 2024-09-21T06:24:07.980 INFO:teuthology.orchestra.run.smithi079.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-21T06:24:07.985 INFO:teuthology.orchestra.run.smithi098.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-21T06:24:08.014 INFO:teuthology.orchestra.run.smithi079.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 994 kB/s | 191 kB 00:00 2024-09-21T06:24:08.052 INFO:teuthology.orchestra.run.smithi098.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 513 kB/s | 34 kB 00:00 2024-09-21T06:24:08.081 INFO:teuthology.orchestra.run.smithi079.stdout:(43/157): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-21T06:24:08.106 INFO:teuthology.orchestra.run.smithi079.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-21T06:24:08.111 INFO:teuthology.orchestra.run.smithi098.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 14 MB/s | 3.1 MB 00:00 2024-09-21T06:24:08.128 INFO:teuthology.orchestra.run.smithi098.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.0 MB/s | 154 kB 00:00 2024-09-21T06:24:08.149 INFO:teuthology.orchestra.run.smithi049.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.6 MB/s | 873 kB 00:00 2024-09-21T06:24:08.165 INFO:teuthology.orchestra.run.smithi079.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-21T06:24:08.190 INFO:teuthology.orchestra.run.smithi079.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-21T06:24:08.241 INFO:teuthology.orchestra.run.smithi049.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T06:24:08.248 INFO:teuthology.orchestra.run.smithi079.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-21T06:24:08.324 INFO:teuthology.orchestra.run.smithi079.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 5.0 MB/s | 689 kB 00:00 2024-09-21T06:24:08.400 INFO:teuthology.orchestra.run.smithi079.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-21T06:24:08.442 INFO:teuthology.orchestra.run.smithi079.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-09-21T06:24:08.484 INFO:teuthology.orchestra.run.smithi079.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 259 kB/s | 22 kB 00:00 2024-09-21T06:24:08.517 INFO:teuthology.orchestra.run.smithi079.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 4.1 MB/s | 313 kB 00:00 2024-09-21T06:24:08.543 INFO:teuthology.orchestra.run.smithi079.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-09-21T06:24:08.566 INFO:teuthology.orchestra.run.smithi049.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 7.0 MB/s | 2.3 MB 00:00 2024-09-21T06:24:08.601 INFO:teuthology.orchestra.run.smithi079.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-09-21T06:24:08.676 INFO:teuthology.orchestra.run.smithi079.stdout:(55/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-21T06:24:08.693 INFO:teuthology.orchestra.run.smithi079.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-09-21T06:24:08.752 INFO:teuthology.orchestra.run.smithi079.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-21T06:24:08.758 INFO:teuthology.orchestra.run.smithi049.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 7.9 MB/s | 1.5 MB 00:00 2024-09-21T06:24:08.777 INFO:teuthology.orchestra.run.smithi079.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-21T06:24:08.811 INFO:teuthology.orchestra.run.smithi079.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-09-21T06:24:08.845 INFO:teuthology.orchestra.run.smithi079.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-21T06:24:08.886 INFO:teuthology.orchestra.run.smithi079.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-09-21T06:24:08.912 INFO:teuthology.orchestra.run.smithi079.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-21T06:24:08.954 INFO:teuthology.orchestra.run.smithi079.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 708 kB/s | 47 kB 00:00 2024-09-21T06:24:08.973 INFO:teuthology.orchestra.run.smithi098.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 8.7 MB/s | 7.4 MB 00:00 2024-09-21T06:24:08.979 INFO:teuthology.orchestra.run.smithi079.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-21T06:24:09.013 INFO:teuthology.orchestra.run.smithi079.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-21T06:24:09.017 INFO:teuthology.orchestra.run.smithi049.stdout:(6/157): ceph-base-19.3.0-5120.g18432218.el9.x8 4.6 MB/s | 5.5 MB 00:01 2024-09-21T06:24:09.046 INFO:teuthology.orchestra.run.smithi079.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 573 kB/s | 38 kB 00:00 2024-09-21T06:24:09.065 INFO:teuthology.orchestra.run.smithi098.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.1 MB/s | 292 kB 00:00 2024-09-21T06:24:09.149 INFO:teuthology.orchestra.run.smithi098.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 593 kB/s | 49 kB 00:00 2024-09-21T06:24:09.230 INFO:teuthology.orchestra.run.smithi079.stdout:(67/157): ceph-mgr-dashboard-19.3.0-5120.g18432 5.7 MB/s | 14 MB 00:02 2024-09-21T06:24:09.249 INFO:teuthology.orchestra.run.smithi098.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 164 kB/s | 16 kB 00:00 2024-09-21T06:24:09.276 INFO:teuthology.orchestra.run.smithi049.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 9.6 MB/s | 5.0 MB 00:00 2024-09-21T06:24:09.299 INFO:teuthology.orchestra.run.smithi098.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T06:24:09.314 INFO:teuthology.orchestra.run.smithi079.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 16 MB/s | 4.9 MB 00:00 2024-09-21T06:24:09.398 INFO:teuthology.orchestra.run.smithi079.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-21T06:24:09.432 INFO:teuthology.orchestra.run.smithi079.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-21T06:24:09.465 INFO:teuthology.orchestra.run.smithi079.stdout:(71/157): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-21T06:24:09.490 INFO:teuthology.orchestra.run.smithi079.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T06:24:09.491 INFO:teuthology.orchestra.run.smithi098.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 10 MB/s | 14 MB 00:01 2024-09-21T06:24:09.525 INFO:teuthology.orchestra.run.smithi098.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 3.4 MB/s | 784 kB 00:00 2024-09-21T06:24:09.558 INFO:teuthology.orchestra.run.smithi098.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 276 kB/s | 18 kB 00:00 2024-09-21T06:24:09.591 INFO:teuthology.orchestra.run.smithi079.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 36 MB/s | 5.8 MB 00:00 2024-09-21T06:24:09.616 INFO:teuthology.orchestra.run.smithi079.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 698 kB/s | 87 kB 00:00 2024-09-21T06:24:09.650 INFO:teuthology.orchestra.run.smithi079.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-09-21T06:24:09.675 INFO:teuthology.orchestra.run.smithi079.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T06:24:09.767 INFO:teuthology.orchestra.run.smithi079.stdout:(77/157): python3-babel-2.9.1-2.el9.noarch.rpm 34 MB/s | 6.0 MB 00:00 2024-09-21T06:24:09.792 INFO:teuthology.orchestra.run.smithi079.stdout:(78/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-21T06:24:09.817 INFO:teuthology.orchestra.run.smithi079.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-21T06:24:09.843 INFO:teuthology.orchestra.run.smithi079.stdout:(80/157): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-09-21T06:24:09.876 INFO:teuthology.orchestra.run.smithi079.stdout:(81/157): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-21T06:24:09.902 INFO:teuthology.orchestra.run.smithi079.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.0 MB/s | 172 kB 00:00 2024-09-21T06:24:09.927 INFO:teuthology.orchestra.run.smithi079.stdout:(83/157): python3-markupsafe-1.1.1-12.el9.x86_6 414 kB/s | 35 kB 00:00 2024-09-21T06:24:09.951 INFO:teuthology.orchestra.run.smithi098.stdout:(39/157): ceph-test-19.3.0-5120.g18432218.el9.x 11 MB/s | 40 MB 00:03 2024-09-21T06:24:09.969 INFO:teuthology.orchestra.run.smithi079.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-09-21T06:24:09.976 INFO:teuthology.orchestra.run.smithi098.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 177 kB/s | 80 kB 00:00 2024-09-21T06:24:09.984 INFO:teuthology.orchestra.run.smithi049.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 15 MB/s | 10 MB 00:00 2024-09-21T06:24:09.994 INFO:teuthology.orchestra.run.smithi079.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-21T06:24:10.026 INFO:teuthology.orchestra.run.smithi049.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 605 kB/s | 25 kB 00:00 2024-09-21T06:24:10.036 INFO:teuthology.orchestra.run.smithi079.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-21T06:24:10.051 INFO:teuthology.orchestra.run.smithi098.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-21T06:24:10.053 INFO:teuthology.orchestra.run.smithi079.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 719 kB/s | 42 kB 00:00 2024-09-21T06:24:10.085 INFO:teuthology.orchestra.run.smithi098.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 801 kB 00:00 2024-09-21T06:24:10.110 INFO:teuthology.orchestra.run.smithi098.stdout:(43/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-21T06:24:10.120 INFO:teuthology.orchestra.run.smithi079.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-09-21T06:24:10.135 INFO:teuthology.orchestra.run.smithi098.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T06:24:10.137 INFO:teuthology.orchestra.run.smithi079.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-21T06:24:10.160 INFO:teuthology.orchestra.run.smithi098.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T06:24:10.162 INFO:teuthology.orchestra.run.smithi079.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-21T06:24:10.177 INFO:teuthology.orchestra.run.smithi098.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-21T06:24:10.196 INFO:teuthology.orchestra.run.smithi079.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-21T06:24:10.203 INFO:teuthology.orchestra.run.smithi098.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-21T06:24:10.221 INFO:teuthology.orchestra.run.smithi079.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-21T06:24:10.247 INFO:teuthology.orchestra.run.smithi079.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 639 kB/s | 54 kB 00:00 2024-09-21T06:24:10.253 INFO:teuthology.orchestra.run.smithi098.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-21T06:24:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-09-21T06:24:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 660 kB/s | 44 kB 00:00 2024-09-21T06:24:10.339 INFO:teuthology.orchestra.run.smithi079.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-21T06:24:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 475 kB/s | 36 kB 00:00 2024-09-21T06:24:10.395 INFO:teuthology.orchestra.run.smithi098.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 756 kB/s | 107 kB 00:00 2024-09-21T06:24:10.415 INFO:teuthology.orchestra.run.smithi079.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 627 kB/s | 47 kB 00:00 2024-09-21T06:24:10.420 INFO:teuthology.orchestra.run.smithi098.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-21T06:24:10.446 INFO:teuthology.orchestra.run.smithi098.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-09-21T06:24:10.465 INFO:teuthology.orchestra.run.smithi079.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-21T06:24:10.471 INFO:teuthology.orchestra.run.smithi098.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-21T06:24:10.491 INFO:teuthology.orchestra.run.smithi079.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 767 kB/s | 58 kB 00:00 2024-09-21T06:24:10.496 INFO:teuthology.orchestra.run.smithi098.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 647 kB/s | 33 kB 00:00 2024-09-21T06:24:10.522 INFO:teuthology.orchestra.run.smithi098.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2024-09-21T06:24:10.524 INFO:teuthology.orchestra.run.smithi079.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T06:24:10.547 INFO:teuthology.orchestra.run.smithi098.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-21T06:24:10.572 INFO:teuthology.orchestra.run.smithi098.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T06:24:10.597 INFO:teuthology.orchestra.run.smithi098.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T06:24:10.601 INFO:teuthology.orchestra.run.smithi049.stdout:(10/157): ceph-common-19.3.0-5120.g18432218.el9 7.1 MB/s | 20 MB 00:02 2024-09-21T06:24:10.639 INFO:teuthology.orchestra.run.smithi098.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T06:24:10.651 INFO:teuthology.orchestra.run.smithi049.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T06:24:10.665 INFO:teuthology.orchestra.run.smithi098.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-21T06:24:10.700 INFO:teuthology.orchestra.run.smithi079.stdout:(102/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-21T06:24:10.710 INFO:teuthology.orchestra.run.smithi049.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 464 kB/s | 27 kB 00:00 2024-09-21T06:24:10.715 INFO:teuthology.orchestra.run.smithi098.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-21T06:24:10.725 INFO:teuthology.orchestra.run.smithi079.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 224 kB/s | 45 kB 00:00 2024-09-21T06:24:10.740 INFO:teuthology.orchestra.run.smithi098.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 662 kB 00:00 2024-09-21T06:24:10.750 INFO:teuthology.orchestra.run.smithi079.stdout:(104/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 246 kB/s | 64 kB 00:00 2024-09-21T06:24:10.766 INFO:teuthology.orchestra.run.smithi098.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-21T06:24:10.791 INFO:teuthology.orchestra.run.smithi098.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T06:24:10.809 INFO:teuthology.orchestra.run.smithi079.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T06:24:10.816 INFO:teuthology.orchestra.run.smithi098.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 3.8 MB/s | 581 kB 00:00 2024-09-21T06:24:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-09-21T06:24:10.841 INFO:teuthology.orchestra.run.smithi098.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-21T06:24:10.867 INFO:teuthology.orchestra.run.smithi098.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 770 kB/s | 38 kB 00:00 2024-09-21T06:24:10.868 INFO:teuthology.orchestra.run.smithi079.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 5.1 MB/s | 308 kB 00:00 2024-09-21T06:24:10.892 INFO:teuthology.orchestra.run.smithi098.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-21T06:24:10.893 INFO:teuthology.orchestra.run.smithi079.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-21T06:24:10.918 INFO:teuthology.orchestra.run.smithi079.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:24:10.919 INFO:teuthology.orchestra.run.smithi049.stdout:(13/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 9.4 MB/s | 18 MB 00:01 2024-09-21T06:24:10.944 INFO:teuthology.orchestra.run.smithi049.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 136 kB/s | 32 kB 00:00 2024-09-21T06:24:10.944 INFO:teuthology.orchestra.run.smithi079.stdout:(110/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-09-21T06:24:10.977 INFO:teuthology.orchestra.run.smithi079.stdout:(111/157): liboath-2.6.7-2.el9.x86_64.rpm 828 kB/s | 49 kB 00:00 2024-09-21T06:24:10.984 INFO:teuthology.orchestra.run.smithi098.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-09-21T06:24:11.002 INFO:teuthology.orchestra.run.smithi049.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.0 MB/s | 766 kB 00:00 2024-09-21T06:24:11.003 INFO:teuthology.orchestra.run.smithi079.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-21T06:24:11.028 INFO:teuthology.orchestra.run.smithi049.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.9 MB/s | 158 kB 00:00 2024-09-21T06:24:11.028 INFO:teuthology.orchestra.run.smithi079.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T06:24:11.053 INFO:teuthology.orchestra.run.smithi049.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T06:24:11.059 INFO:teuthology.orchestra.run.smithi098.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 23 MB/s | 4.9 MB 00:00 2024-09-21T06:24:11.086 INFO:teuthology.orchestra.run.smithi049.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T06:24:11.087 INFO:teuthology.orchestra.run.smithi079.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-21T06:24:11.120 INFO:teuthology.orchestra.run.smithi079.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-21T06:24:11.126 INFO:teuthology.orchestra.run.smithi098.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-21T06:24:11.145 INFO:teuthology.orchestra.run.smithi049.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 773 kB/s | 45 kB 00:00 2024-09-21T06:24:11.152 INFO:teuthology.orchestra.run.smithi098.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T06:24:11.154 INFO:teuthology.orchestra.run.smithi079.stdout:(116/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-21T06:24:11.179 INFO:teuthology.orchestra.run.smithi079.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 548 kB/s | 32 kB 00:00 2024-09-21T06:24:11.185 INFO:teuthology.orchestra.run.smithi098.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.4 MB/s | 910 kB 00:00 2024-09-21T06:24:11.195 INFO:teuthology.orchestra.run.smithi049.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.9 MB/s | 148 kB 00:00 2024-09-21T06:24:11.205 INFO:teuthology.orchestra.run.smithi079.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 279 kB/s | 14 kB 00:00 2024-09-21T06:24:11.227 INFO:teuthology.orchestra.run.smithi098.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-21T06:24:11.230 INFO:teuthology.orchestra.run.smithi079.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T06:24:11.252 INFO:teuthology.orchestra.run.smithi098.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-21T06:24:11.254 INFO:teuthology.orchestra.run.smithi049.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 2.7 MB/s | 161 kB 00:00 2024-09-21T06:24:11.297 INFO:teuthology.orchestra.run.smithi079.stdout:(120/157): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-21T06:24:11.313 INFO:teuthology.orchestra.run.smithi049.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T06:24:11.322 INFO:teuthology.orchestra.run.smithi079.stdout:(121/157): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-21T06:24:11.336 INFO:teuthology.orchestra.run.smithi098.stdout:(75/157): postgresql-server-13.16-1.el9.x86_64. 28 MB/s | 5.8 MB 00:00 2024-09-21T06:24:11.356 INFO:teuthology.orchestra.run.smithi079.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-09-21T06:24:11.361 INFO:teuthology.orchestra.run.smithi098.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 564 kB/s | 61 kB 00:00 2024-09-21T06:24:11.380 INFO:teuthology.orchestra.run.smithi049.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 4.5 MB/s | 307 kB 00:00 2024-09-21T06:24:11.381 INFO:teuthology.orchestra.run.smithi079.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-21T06:24:11.386 INFO:teuthology.orchestra.run.smithi098.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-21T06:24:11.407 INFO:teuthology.orchestra.run.smithi079.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-21T06:24:11.412 INFO:teuthology.orchestra.run.smithi098.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T06:24:11.424 INFO:teuthology.orchestra.run.smithi079.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-21T06:24:11.437 INFO:teuthology.orchestra.run.smithi098.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-21T06:24:11.449 INFO:teuthology.orchestra.run.smithi079.stdout:(126/157): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-09-21T06:24:11.462 INFO:teuthology.orchestra.run.smithi098.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-21T06:24:11.474 INFO:teuthology.orchestra.run.smithi079.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-21T06:24:11.480 INFO:teuthology.orchestra.run.smithi049.stdout:(24/157): librgw2-19.3.0-5120.g18432218.el9.x86 12 MB/s | 5.3 MB 00:00 2024-09-21T06:24:11.488 INFO:teuthology.orchestra.run.smithi098.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T06:24:11.500 INFO:teuthology.orchestra.run.smithi079.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T06:24:11.505 INFO:teuthology.orchestra.run.smithi049.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 794 kB/s | 99 kB 00:00 2024-09-21T06:24:11.513 INFO:teuthology.orchestra.run.smithi098.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 688 kB/s | 35 kB 00:00 2024-09-21T06:24:11.525 INFO:teuthology.orchestra.run.smithi079.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-21T06:24:11.530 INFO:teuthology.orchestra.run.smithi049.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:24:11.550 INFO:teuthology.orchestra.run.smithi079.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:24:11.563 INFO:teuthology.orchestra.run.smithi098.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-21T06:24:11.576 INFO:teuthology.orchestra.run.smithi079.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:24:11.581 INFO:teuthology.orchestra.run.smithi049.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T06:24:11.601 INFO:teuthology.orchestra.run.smithi079.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:24:11.634 INFO:teuthology.orchestra.run.smithi079.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T06:24:11.639 INFO:teuthology.orchestra.run.smithi098.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T06:24:11.660 INFO:teuthology.orchestra.run.smithi079.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T06:24:11.664 INFO:teuthology.orchestra.run.smithi098.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-21T06:24:11.664 INFO:teuthology.orchestra.run.smithi049.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 20 MB/s | 3.1 MB 00:00 2024-09-21T06:24:11.689 INFO:teuthology.orchestra.run.smithi049.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 316 kB/s | 34 kB 00:00 2024-09-21T06:24:11.690 INFO:teuthology.orchestra.run.smithi098.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-21T06:24:11.693 INFO:teuthology.orchestra.run.smithi079.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-21T06:24:11.706 INFO:teuthology.orchestra.run.smithi098.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-21T06:24:11.718 INFO:teuthology.orchestra.run.smithi079.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-21T06:24:11.740 INFO:teuthology.orchestra.run.smithi049.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:24:11.744 INFO:teuthology.orchestra.run.smithi079.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T06:24:11.769 INFO:teuthology.orchestra.run.smithi079.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-21T06:24:11.781 INFO:teuthology.orchestra.run.smithi098.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-21T06:24:11.803 INFO:teuthology.orchestra.run.smithi079.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-21T06:24:11.807 INFO:teuthology.orchestra.run.smithi098.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-21T06:24:11.820 INFO:teuthology.orchestra.run.smithi079.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T06:24:11.840 INFO:teuthology.orchestra.run.smithi098.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-21T06:24:11.845 INFO:teuthology.orchestra.run.smithi079.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 855 kB/s | 36 kB 00:00 2024-09-21T06:24:11.862 INFO:teuthology.orchestra.run.smithi079.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-21T06:24:11.865 INFO:teuthology.orchestra.run.smithi098.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-21T06:24:11.888 INFO:teuthology.orchestra.run.smithi079.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T06:24:11.891 INFO:teuthology.orchestra.run.smithi098.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:24:11.913 INFO:teuthology.orchestra.run.smithi079.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-09-21T06:24:11.916 INFO:teuthology.orchestra.run.smithi098.stdout:(93/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-21T06:24:11.942 INFO:teuthology.orchestra.run.smithi098.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-21T06:24:11.963 INFO:teuthology.orchestra.run.smithi079.stdout:(145/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.2 MB/s | 2.0 MB 00:00 2024-09-21T06:24:11.967 INFO:teuthology.orchestra.run.smithi098.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 879 kB/s | 44 kB 00:00 2024-09-21T06:24:11.990 INFO:teuthology.orchestra.run.smithi079.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-09-21T06:24:12.000 INFO:teuthology.orchestra.run.smithi098.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T06:24:12.014 INFO:teuthology.orchestra.run.smithi079.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:24:12.026 INFO:teuthology.orchestra.run.smithi098.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-21T06:24:12.065 INFO:teuthology.orchestra.run.smithi079.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-09-21T06:24:12.099 INFO:teuthology.orchestra.run.smithi098.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 481 kB/s | 47 kB 00:00 2024-09-21T06:24:12.115 INFO:teuthology.orchestra.run.smithi079.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-21T06:24:12.135 INFO:teuthology.orchestra.run.smithi098.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-21T06:24:12.160 INFO:teuthology.orchestra.run.smithi098.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 960 kB/s | 58 kB 00:00 2024-09-21T06:24:12.185 INFO:teuthology.orchestra.run.smithi098.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T06:24:12.211 INFO:teuthology.orchestra.run.smithi098.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T06:24:12.236 INFO:teuthology.orchestra.run.smithi098.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-21T06:24:12.303 INFO:teuthology.orchestra.run.smithi098.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-21T06:24:12.361 INFO:teuthology.orchestra.run.smithi098.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T06:24:12.403 INFO:teuthology.orchestra.run.smithi098.stdout:(106/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.0 MB/s | 863 kB 00:00 2024-09-21T06:24:12.424 INFO:teuthology.orchestra.run.smithi079.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 8.3 MB/s | 3.4 MB 00:00 2024-09-21T06:24:12.437 INFO:teuthology.orchestra.run.smithi098.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 4.0 MB/s | 308 kB 00:00 2024-09-21T06:24:12.462 INFO:teuthology.orchestra.run.smithi098.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-21T06:24:12.488 INFO:teuthology.orchestra.run.smithi098.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:24:12.490 INFO:teuthology.orchestra.run.smithi049.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 16 MB/s | 40 MB 00:02 2024-09-21T06:24:12.513 INFO:teuthology.orchestra.run.smithi098.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:24:12.538 INFO:teuthology.orchestra.run.smithi098.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:24:12.564 INFO:teuthology.orchestra.run.smithi098.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:24:12.640 INFO:teuthology.orchestra.run.smithi049.stdout:(32/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T06:24:12.666 INFO:teuthology.orchestra.run.smithi049.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 1.6 MB/s | 292 kB 00:00 2024-09-21T06:24:12.691 INFO:teuthology.orchestra.run.smithi079.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 5.1 MB/s | 3.2 MB 00:00 2024-09-21T06:24:12.691 INFO:teuthology.orchestra.run.smithi049.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 990 kB/s | 49 kB 00:00 2024-09-21T06:24:12.716 INFO:teuthology.orchestra.run.smithi049.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T06:24:12.739 INFO:teuthology.orchestra.run.smithi098.stdout:(113/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-21T06:24:12.743 INFO:teuthology.orchestra.run.smithi049.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.3 MB/s | 285 kB 00:00 2024-09-21T06:24:12.781 INFO:teuthology.orchestra.run.smithi098.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-09-21T06:24:12.806 INFO:teuthology.orchestra.run.smithi098.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2024-09-21T06:24:12.832 INFO:teuthology.orchestra.run.smithi098.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:24:12.852 INFO:teuthology.orchestra.run.smithi049.stdout:(37/157): ceph-mgr-diskprediction-local-19.3.0- 6.6 MB/s | 7.4 MB 00:01 2024-09-21T06:24:12.857 INFO:teuthology.orchestra.run.smithi098.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-21T06:24:12.877 INFO:teuthology.orchestra.run.smithi049.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 138 kB/s | 18 kB 00:00 2024-09-21T06:24:12.902 INFO:teuthology.orchestra.run.smithi049.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 4.1 MB/s | 784 kB 00:00 2024-09-21T06:24:12.907 INFO:teuthology.orchestra.run.smithi098.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-21T06:24:12.941 INFO:teuthology.orchestra.run.smithi098.stdout:(119/157): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-09-21T06:24:12.975 INFO:teuthology.orchestra.run.smithi098.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-21T06:24:13.000 INFO:teuthology.orchestra.run.smithi098.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T06:24:13.034 INFO:teuthology.orchestra.run.smithi098.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T06:24:13.059 INFO:teuthology.orchestra.run.smithi098.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T06:24:13.101 INFO:teuthology.orchestra.run.smithi098.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2024-09-21T06:24:13.118 INFO:teuthology.orchestra.run.smithi098.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-21T06:24:13.135 INFO:teuthology.orchestra.run.smithi098.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T06:24:13.194 INFO:teuthology.orchestra.run.smithi098.stdout:(127/157): libarrow-9.0.0-11.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-09-21T06:24:13.199 INFO:teuthology.orchestra.run.smithi079.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 80 kB/s | 41 kB 00:00 2024-09-21T06:24:13.210 INFO:teuthology.orchestra.run.smithi098.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 259 kB/s | 19 kB 00:00 2024-09-21T06:24:13.227 INFO:teuthology.orchestra.run.smithi098.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-21T06:24:13.252 INFO:teuthology.orchestra.run.smithi098.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:24:13.253 INFO:teuthology.orchestra.run.smithi049.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 199 kB/s | 80 kB 00:00 2024-09-21T06:24:13.277 INFO:teuthology.orchestra.run.smithi098.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:24:13.303 INFO:teuthology.orchestra.run.smithi098.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:24:13.337 INFO:teuthology.orchestra.run.smithi098.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-09-21T06:24:13.362 INFO:teuthology.orchestra.run.smithi098.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 666 kB/s | 16 kB 00:00 2024-09-21T06:24:13.387 INFO:teuthology.orchestra.run.smithi098.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-21T06:24:13.412 INFO:teuthology.orchestra.run.smithi098.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-21T06:24:13.438 INFO:teuthology.orchestra.run.smithi098.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-21T06:24:13.445 INFO:teuthology.orchestra.run.smithi049.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 353 kB/s | 191 kB 00:00 2024-09-21T06:24:13.480 INFO:teuthology.orchestra.run.smithi098.stdout:(138/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.2 MB/s | 2.0 MB 00:00 2024-09-21T06:24:13.505 INFO:teuthology.orchestra.run.smithi098.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 332 kB/s | 31 kB 00:00 2024-09-21T06:24:13.531 INFO:teuthology.orchestra.run.smithi098.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-21T06:24:13.541 INFO:teuthology.orchestra.run.smithi079.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 729 kB/s | 249 kB 00:00 2024-09-21T06:24:13.556 INFO:teuthology.orchestra.run.smithi098.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-21T06:24:13.581 INFO:teuthology.orchestra.run.smithi098.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T06:24:13.607 INFO:teuthology.orchestra.run.smithi098.stdout:(143/157): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-21T06:24:13.628 INFO:teuthology.orchestra.run.smithi049.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 675 kB/s | 253 kB 00:00 2024-09-21T06:24:13.632 INFO:teuthology.orchestra.run.smithi098.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-21T06:24:13.665 INFO:teuthology.orchestra.run.smithi098.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-21T06:24:13.666 INFO:teuthology.orchestra.run.smithi079.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-21T06:24:13.690 INFO:teuthology.orchestra.run.smithi098.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-21T06:24:13.695 INFO:teuthology.orchestra.run.smithi049.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 980 kB/s | 801 kB 00:00 2024-09-21T06:24:13.716 INFO:teuthology.orchestra.run.smithi098.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:24:13.737 INFO:teuthology.orchestra.run.smithi049.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 980 kB/s | 106 kB 00:00 2024-09-21T06:24:13.741 INFO:teuthology.orchestra.run.smithi098.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-21T06:24:13.791 INFO:teuthology.orchestra.run.smithi098.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T06:24:13.804 INFO:teuthology.orchestra.run.smithi049.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-09-21T06:24:13.838 INFO:teuthology.orchestra.run.smithi049.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.2 MB/s | 125 kB 00:00 2024-09-21T06:24:13.875 INFO:teuthology.orchestra.run.smithi079.stdout:(155/157): NetworkManager-1.51.0-1.el9.x86_64.r 1.3 MB/s | 2.3 MB 00:01 2024-09-21T06:24:13.930 INFO:teuthology.orchestra.run.smithi049.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 2.5 MB/s | 1.2 MB 00:00 2024-09-21T06:24:13.955 INFO:teuthology.orchestra.run.smithi049.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-09-21T06:24:13.967 INFO:teuthology.orchestra.run.smithi098.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-09-21T06:24:14.030 INFO:teuthology.orchestra.run.smithi049.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-09-21T06:24:14.042 INFO:teuthology.orchestra.run.smithi098.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 24 MB/s | 1.8 MB 00:00 2024-09-21T06:24:14.072 INFO:teuthology.orchestra.run.smithi049.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 521 kB/s | 22 kB 00:00 2024-09-21T06:24:14.083 INFO:teuthology.orchestra.run.smithi079.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.1 MB/s | 1.8 MB 00:01 2024-09-21T06:24:14.084 INFO:teuthology.orchestra.run.smithi098.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 990 kB/s | 41 kB 00:00 2024-09-21T06:24:14.097 INFO:teuthology.orchestra.run.smithi049.stdout:(51/157): boost-program-options-1.75.0-8.el9.x8 752 kB/s | 107 kB 00:00 2024-09-21T06:24:14.123 INFO:teuthology.orchestra.run.smithi049.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-09-21T06:24:14.134 INFO:teuthology.orchestra.run.smithi098.stdout:(153/157): librados2-19.3.0-5120.g18432218.el9. 8.1 MB/s | 3.4 MB 00:00 2024-09-21T06:24:14.148 INFO:teuthology.orchestra.run.smithi049.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 651 kB/s | 33 kB 00:00 2024-09-21T06:24:14.159 INFO:teuthology.orchestra.run.smithi098.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 3.2 MB/s | 249 kB 00:00 2024-09-21T06:24:14.190 INFO:teuthology.orchestra.run.smithi049.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 438 kB/s | 18 kB 00:00 2024-09-21T06:24:14.232 INFO:teuthology.orchestra.run.smithi049.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-09-21T06:24:14.243 INFO:teuthology.orchestra.run.smithi098.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-21T06:24:14.282 INFO:teuthology.orchestra.run.smithi049.stdout:(56/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 19 MB/s | 3.0 MB 00:00 2024-09-21T06:24:14.307 INFO:teuthology.orchestra.run.smithi049.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-09-21T06:24:14.332 INFO:teuthology.orchestra.run.smithi049.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T06:24:14.358 INFO:teuthology.orchestra.run.smithi049.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-21T06:24:14.391 INFO:teuthology.orchestra.run.smithi049.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-21T06:24:14.441 INFO:teuthology.orchestra.run.smithi049.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 6.8 MB/s | 581 kB 00:00 2024-09-21T06:24:14.443 INFO:teuthology.orchestra.run.smithi098.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.4 MB/s | 1.4 MB 00:00 2024-09-21T06:24:14.467 INFO:teuthology.orchestra.run.smithi049.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-21T06:24:14.492 INFO:teuthology.orchestra.run.smithi049.stdout:(63/157): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 943 kB 00:00 2024-09-21T06:24:14.517 INFO:teuthology.orchestra.run.smithi049.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-21T06:24:14.542 INFO:teuthology.orchestra.run.smithi049.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-21T06:24:14.559 INFO:teuthology.orchestra.run.smithi049.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 926 kB/s | 38 kB 00:00 2024-09-21T06:24:14.577 INFO:teuthology.orchestra.run.smithi098.stdout:(157/157): librbd1-19.3.0-5120.g18432218.el9.x8 3.8 MB/s | 3.2 MB 00:00 2024-09-21T06:24:14.584 INFO:teuthology.orchestra.run.smithi098.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:24:14.584 INFO:teuthology.orchestra.run.smithi098.stdout:Total 22 MB/s | 228 MB 00:10 2024-09-21T06:24:14.668 INFO:teuthology.orchestra.run.smithi049.stdout:(67/157): openblas-openmp-0.3.26-2.el9.x86_64.r 39 MB/s | 4.9 MB 00:00 2024-09-21T06:24:14.693 INFO:teuthology.orchestra.run.smithi049.stdout:(68/157): lua-5.4.4-4.el9.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-09-21T06:24:14.735 INFO:teuthology.orchestra.run.smithi049.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-21T06:24:14.777 INFO:teuthology.orchestra.run.smithi049.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 3.2 MB/s | 137 kB 00:00 2024-09-21T06:24:14.928 INFO:teuthology.orchestra.run.smithi049.stdout:(71/157): postgresql-server-13.16-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-09-21T06:24:14.986 INFO:teuthology.orchestra.run.smithi049.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-21T06:24:15.061 INFO:teuthology.orchestra.run.smithi049.stdout:(73/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-09-21T06:24:15.087 INFO:teuthology.orchestra.run.smithi049.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 871 kB/s | 87 kB 00:00 2024-09-21T06:24:15.129 INFO:teuthology.orchestra.run.smithi049.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T06:24:15.170 INFO:teuthology.orchestra.run.smithi049.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 5.8 MB/s | 245 kB 00:00 2024-09-21T06:24:15.196 INFO:teuthology.orchestra.run.smithi049.stdout:(77/157): postgresql-contrib-13.16-1.el9.x86_64 1.8 MB/s | 910 kB 00:00 2024-09-21T06:24:15.221 INFO:teuthology.orchestra.run.smithi049.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-21T06:24:15.247 INFO:teuthology.orchestra.run.smithi049.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-21T06:24:15.272 INFO:teuthology.orchestra.run.smithi049.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-21T06:24:15.313 INFO:teuthology.orchestra.run.smithi049.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 838 kB/s | 35 kB 00:00 2024-09-21T06:24:15.355 INFO:teuthology.orchestra.run.smithi049.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-21T06:24:15.472 INFO:teuthology.orchestra.run.smithi049.stdout:(83/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-21T06:24:15.515 INFO:teuthology.orchestra.run.smithi049.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-21T06:24:15.540 INFO:teuthology.orchestra.run.smithi049.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-21T06:24:15.581 INFO:teuthology.orchestra.run.smithi049.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-21T06:24:15.607 INFO:teuthology.orchestra.run.smithi049.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-09-21T06:24:15.682 INFO:teuthology.orchestra.run.smithi049.stdout:(88/157): python3-babel-2.9.1-2.el9.noarch.rpm 9.6 MB/s | 6.0 MB 00:00 2024-09-21T06:24:15.707 INFO:teuthology.orchestra.run.smithi049.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-21T06:24:15.733 INFO:teuthology.orchestra.run.smithi049.stdout:(90/157): python3-protobuf-3.14.0-13.el9.noarch 1.7 MB/s | 269 kB 00:00 2024-09-21T06:24:15.758 INFO:teuthology.orchestra.run.smithi049.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T06:24:15.783 INFO:teuthology.orchestra.run.smithi049.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:24:15.809 INFO:teuthology.orchestra.run.smithi049.stdout:(93/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-21T06:24:15.813 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction check 2024-09-21T06:24:15.834 INFO:teuthology.orchestra.run.smithi049.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 826 kB/s | 42 kB 00:00 2024-09-21T06:24:15.859 INFO:teuthology.orchestra.run.smithi049.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-21T06:24:15.901 INFO:teuthology.orchestra.run.smithi049.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 863 kB/s | 36 kB 00:00 2024-09-21T06:24:15.908 INFO:teuthology.orchestra.run.smithi079.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.1 MB/s | 2.4 MB 00:02 2024-09-21T06:24:15.915 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:24:15.915 INFO:teuthology.orchestra.run.smithi079.stdout:Total 16 MB/s | 228 MB 00:14 2024-09-21T06:24:15.926 INFO:teuthology.orchestra.run.smithi049.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-21T06:24:15.952 INFO:teuthology.orchestra.run.smithi049.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 938 kB/s | 47 kB 00:00 2024-09-21T06:24:15.965 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction check succeeded. 2024-09-21T06:24:15.965 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction test 2024-09-21T06:24:15.994 INFO:teuthology.orchestra.run.smithi049.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-21T06:24:16.036 INFO:teuthology.orchestra.run.smithi049.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.3 MB/s | 96 kB 00:00 2024-09-21T06:24:16.061 INFO:teuthology.orchestra.run.smithi049.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.2 MB/s | 304 kB 00:00 2024-09-21T06:24:16.086 INFO:teuthology.orchestra.run.smithi049.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T06:24:16.111 INFO:teuthology.orchestra.run.smithi049.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-21T06:24:16.137 INFO:teuthology.orchestra.run.smithi049.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-09-21T06:24:16.312 INFO:teuthology.orchestra.run.smithi049.stdout:(105/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-21T06:24:16.354 INFO:teuthology.orchestra.run.smithi049.stdout:(106/157): abseil-cpp-20211102.0-3.el9.x86_64.r 2.5 MB/s | 548 kB 00:00 2024-09-21T06:24:16.379 INFO:teuthology.orchestra.run.smithi049.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 848 kB/s | 19 kB 00:00 2024-09-21T06:24:16.413 INFO:teuthology.orchestra.run.smithi049.stdout:(108/157): gperftools-libs-2.9.1-3.el9.x86_64.r 3.1 MB/s | 308 kB 00:00 2024-09-21T06:24:16.447 INFO:teuthology.orchestra.run.smithi049.stdout:(109/157): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-21T06:24:16.471 INFO:teuthology.orchestra.run.smithi049.stdout:(110/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-09-21T06:24:16.505 INFO:teuthology.orchestra.run.smithi049.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-09-21T06:24:16.547 INFO:teuthology.orchestra.run.smithi049.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 3.7 MB/s | 151 kB 00:00 2024-09-21T06:24:16.572 INFO:teuthology.orchestra.run.smithi049.stdout:(113/157): liboath-2.6.7-2.el9.x86_64.rpm 386 kB/s | 49 kB 00:00 2024-09-21T06:24:16.623 INFO:teuthology.orchestra.run.smithi049.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-21T06:24:16.648 INFO:teuthology.orchestra.run.smithi049.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:24:16.673 INFO:teuthology.orchestra.run.smithi049.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:24:16.698 INFO:teuthology.orchestra.run.smithi049.stdout:(117/157): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-21T06:24:16.723 INFO:teuthology.orchestra.run.smithi049.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-21T06:24:16.749 INFO:teuthology.orchestra.run.smithi049.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-21T06:24:16.774 INFO:teuthology.orchestra.run.smithi049.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T06:24:16.808 INFO:teuthology.orchestra.run.smithi049.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-21T06:24:16.833 INFO:teuthology.orchestra.run.smithi049.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T06:24:16.858 INFO:teuthology.orchestra.run.smithi049.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T06:24:16.875 INFO:teuthology.orchestra.run.smithi049.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 649 kB/s | 11 kB 00:00 2024-09-21T06:24:16.892 INFO:teuthology.orchestra.run.smithi049.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-21T06:24:16.909 INFO:teuthology.orchestra.run.smithi049.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T06:24:16.926 INFO:teuthology.orchestra.run.smithi049.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T06:24:16.993 INFO:teuthology.orchestra.run.smithi049.stdout:(128/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2024-09-21T06:24:17.018 INFO:teuthology.orchestra.run.smithi049.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-09-21T06:24:17.044 INFO:teuthology.orchestra.run.smithi049.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:24:17.069 INFO:teuthology.orchestra.run.smithi049.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:24:17.094 INFO:teuthology.orchestra.run.smithi049.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:24:17.128 INFO:teuthology.orchestra.run.smithi049.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T06:24:17.135 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2024-09-21T06:24:17.153 INFO:teuthology.orchestra.run.smithi049.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-09-21T06:24:17.195 INFO:teuthology.orchestra.run.smithi049.stdout:(135/157): python3-grpcio-1.46.7-10.el9.x86_64. 5.3 MB/s | 2.0 MB 00:00 2024-09-21T06:24:17.229 INFO:teuthology.orchestra.run.smithi049.stdout:(136/157): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-09-21T06:24:17.254 INFO:teuthology.orchestra.run.smithi049.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 897 kB/s | 90 kB 00:00 2024-09-21T06:24:17.279 INFO:teuthology.orchestra.run.smithi049.stdout:(138/157): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-09-21T06:24:17.285 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction check succeeded. 2024-09-21T06:24:17.285 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2024-09-21T06:24:17.304 INFO:teuthology.orchestra.run.smithi049.stdout:(139/157): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2024-09-21T06:24:17.329 INFO:teuthology.orchestra.run.smithi049.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-21T06:24:17.355 INFO:teuthology.orchestra.run.smithi049.stdout:(141/157): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-21T06:24:17.380 INFO:teuthology.orchestra.run.smithi049.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-21T06:24:17.405 INFO:teuthology.orchestra.run.smithi049.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-21T06:24:17.431 INFO:teuthology.orchestra.run.smithi049.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T06:24:17.456 INFO:teuthology.orchestra.run.smithi049.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T06:24:17.481 INFO:teuthology.orchestra.run.smithi049.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-21T06:24:17.506 INFO:teuthology.orchestra.run.smithi049.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:24:17.531 INFO:teuthology.orchestra.run.smithi049.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-21T06:24:17.582 INFO:teuthology.orchestra.run.smithi049.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T06:24:17.774 INFO:teuthology.orchestra.run.smithi049.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 13 MB/s | 3.4 MB 00:00 2024-09-21T06:24:17.790 INFO:teuthology.orchestra.run.smithi098.stdout:Transaction test succeeded. 2024-09-21T06:24:17.790 INFO:teuthology.orchestra.run.smithi098.stdout:Running transaction 2024-09-21T06:24:17.923 INFO:teuthology.orchestra.run.smithi049.stdout:(151/157): librbd1-19.3.0-5120.g18432218.el9.x8 8.1 MB/s | 3.2 MB 00:00 2024-09-21T06:24:18.216 INFO:teuthology.orchestra.run.smithi049.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 139 kB/s | 41 kB 00:00 2024-09-21T06:24:18.500 INFO:teuthology.orchestra.run.smithi049.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 879 kB/s | 249 kB 00:00 2024-09-21T06:24:18.591 INFO:teuthology.orchestra.run.smithi049.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:01 2024-09-21T06:24:18.733 INFO:teuthology.orchestra.run.smithi049.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.9 MB/s | 1.8 MB 00:00 2024-09-21T06:24:18.875 INFO:teuthology.orchestra.run.smithi049.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 8.4 MB/s | 2.4 MB 00:00 2024-09-21T06:24:18.917 INFO:teuthology.orchestra.run.smithi049.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 3.2 MB/s | 1.4 MB 00:00 2024-09-21T06:24:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:24:18.923 INFO:teuthology.orchestra.run.smithi049.stdout:Total 20 MB/s | 228 MB 00:11 2024-09-21T06:24:19.124 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded. 2024-09-21T06:24:19.125 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2024-09-21T06:24:20.210 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction check 2024-09-21T06:24:20.385 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction check succeeded. 2024-09-21T06:24:20.386 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction test 2024-09-21T06:24:22.758 INFO:teuthology.orchestra.run.smithi049.stdout:Transaction test succeeded. 2024-09-21T06:24:22.758 INFO:teuthology.orchestra.run.smithi049.stdout:Running transaction 2024-09-21T06:24:24.163 INFO:teuthology.orchestra.run.smithi098.stdout: Preparing : 1/1 2024-09-21T06:24:24.297 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:24:24.428 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:24:24.583 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:24:24.624 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:24:24.649 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:24:24.701 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:24:25.040 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:24:25.150 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:24:25.276 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:24:25.301 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:24:25.384 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:24:25.414 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:24:25.443 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:24:25.454 INFO:teuthology.orchestra.run.smithi079.stdout: Preparing : 1/1 2024-09-21T06:24:25.594 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:24:25.595 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:24:25.653 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:24:25.673 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:24:25.716 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:24:25.779 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:24:25.807 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:24:25.870 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:24:25.892 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:24:25.912 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:24:25.922 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:24:25.963 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:24:25.988 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:24:26.041 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:24:26.110 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:24:26.245 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:24:26.381 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:24:26.390 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:24:26.488 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:24:26.506 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:24:26.584 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:24:26.624 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:24:26.658 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:24:26.733 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:24:26.762 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:24:26.791 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:24:26.820 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:24:26.942 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:24:26.948 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:24:26.980 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:24:26.994 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:24:27.015 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:24:27.022 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:24:27.093 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:24:27.112 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:24:27.136 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:24:27.140 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:24:27.177 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:24:27.186 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:24:27.208 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:24:27.220 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:24:27.232 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:24:27.261 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:24:27.289 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:24:27.358 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:24:27.401 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:24:27.411 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:24:27.441 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:24:27.486 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:24:27.527 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:24:27.567 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:24:27.596 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:24:27.639 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:24:27.668 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:24:27.673 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:24:27.740 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:24:27.772 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:24:27.783 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:24:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:24:27.866 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:24:28.007 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:24:28.060 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:24:28.067 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:24:28.170 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:24:28.196 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:24:28.231 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:24:28.295 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:24:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:24:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:24:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:24:28.457 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:24:28.486 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:24:28.553 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:24:28.576 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:24:28.608 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:24:28.643 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:24:28.674 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:24:28.678 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:24:28.702 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:24:28.745 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:24:28.769 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:24:28.783 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:24:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:24:28.825 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:24:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:24:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:24:28.972 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:24:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:24:29.019 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:24:29.042 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:24:29.095 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:24:29.133 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:24:29.190 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:24:29.229 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:24:29.263 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:24:29.289 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:24:29.302 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:24:29.338 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:24:29.379 INFO:teuthology.orchestra.run.smithi049.stdout: Preparing : 1/1 2024-09-21T06:24:29.384 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:24:29.421 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:24:29.464 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:24:29.505 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:24:29.506 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:24:29.544 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:24:29.606 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:24:29.642 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:24:29.647 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:24:29.672 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:24:29.683 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:24:29.733 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:24:29.824 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:24:29.830 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:24:29.836 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:24:29.867 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:24:29.907 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:24:29.917 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:24:29.932 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:24:29.954 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:24:29.958 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:24:30.014 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:24:30.052 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:24:30.094 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:24:30.257 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:24:30.269 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:24:30.287 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:24:30.323 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:24:30.356 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:24:30.392 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:24:30.415 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:24:30.431 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:24:30.460 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:24:30.486 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:24:30.487 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:24:30.533 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:24:30.560 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:24:30.576 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:24:30.592 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:24:30.609 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:24:30.628 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:24:30.638 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:24:30.676 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:24:30.676 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:24:30.713 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:24:30.756 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:24:30.798 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:24:30.812 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:24:30.858 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:24:30.911 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:24:30.929 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:24:30.934 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:24:30.948 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:24:30.978 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:24:30.984 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:24:31.012 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:24:31.037 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:24:31.046 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:24:31.064 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:24:31.087 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:24:31.130 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:24:31.130 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:24:31.157 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:24:31.186 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:24:31.217 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:24:31.227 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:24:31.260 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:24:31.292 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:24:31.331 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:24:31.367 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:24:31.383 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:24:31.395 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:24:31.407 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:24:31.433 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:24:31.451 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:24:31.458 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:24:31.532 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:24:31.565 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:24:31.660 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:24:31.688 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:24:31.716 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:24:31.744 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:24:31.778 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:24:31.797 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:24:31.817 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:24:31.849 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:24:31.873 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:24:31.879 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:24:31.914 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:24:31.947 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:24:31.989 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:24:32.024 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:24:32.095 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:24:32.110 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:24:32.162 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:24:32.168 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:24:32.194 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:24:32.218 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:24:32.223 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:24:32.244 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:24:32.266 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:24:32.280 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:24:32.297 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:24:32.344 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:24:32.355 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:24:32.363 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:24:32.420 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:24:32.424 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:24:32.465 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:24:32.471 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:24:32.514 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:24:32.547 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:24:32.553 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:24:32.574 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:24:32.585 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:24:32.646 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:24:32.697 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:24:32.735 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:24:32.769 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:24:32.779 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:24:32.799 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:24:32.862 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:24:32.879 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:24:32.898 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:24:32.942 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:24:32.970 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:24:33.043 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:24:33.066 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:24:33.085 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:24:33.118 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:24:33.152 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:24:33.162 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:24:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:24:33.299 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:24:33.317 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:24:33.343 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:24:33.371 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:24:33.430 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:24:33.472 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:24:33.524 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:24:33.639 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:24:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:24:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:24:33.746 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:24:33.930 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:24:34.010 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:24:34.055 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:24:34.097 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:24:34.134 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:24:34.177 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:24:34.354 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:24:34.387 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:24:34.404 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:24:34.493 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:24:34.500 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:24:34.561 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:24:34.636 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:24:34.672 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:24:34.708 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:24:34.756 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:24:34.799 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:24:34.843 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:24:34.856 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:24:34.885 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:24:34.938 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:24:34.965 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:24:34.998 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:24:35.029 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:24:35.070 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:24:35.111 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:24:35.218 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:24:35.256 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:24:35.324 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:24:35.378 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:35.452 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:35.483 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:24:35.484 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:24:35.519 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:24:35.569 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:24:35.593 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:24:35.695 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:24:35.710 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:24:35.793 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:24:35.821 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:24:35.829 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:24:35.854 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:24:35.867 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:24:35.887 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:24:35.920 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:24:35.960 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:24:36.000 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:24:36.020 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:24:36.030 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:24:36.048 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:36.064 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:24:36.097 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:24:36.720 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:36.720 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:24:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:24:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:24:36.721 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:24:36.721 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:24:36.721 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:24:36.721 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:24:36.722 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:24:36.722 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:24:36.722 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:24:36.722 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:24:36.885 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:24:36.914 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:36.966 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:36.989 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:24:37.293 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:24:37.425 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:24:37.637 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:24:37.868 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:24:37.927 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:24:37.980 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:24:38.071 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:24:38.106 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:24:38.291 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:24:38.320 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:24:38.400 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:24:38.415 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:38.446 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:39.017 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:39.058 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:39.108 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:24:39.142 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:39.142 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:24:39.142 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:24:39.142 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:24:39.176 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:39.248 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:39.257 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:24:39.494 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:40.072 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:40.106 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:40.186 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:40.186 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:24:40.186 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:24:40.186 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:24:40.234 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:40.596 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:24:40.683 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:24:40.711 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:24:40.744 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:24:41.087 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:24:41.131 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:41.226 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:41.253 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:24:41.290 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:24:41.816 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:24:41.851 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:41.922 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:41.952 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:24:44.351 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:44.399 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:45.001 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:45.131 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:45.131 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:24:45.131 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:24:45.131 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:24:45.170 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:51.297 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:51.298 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /sys 2024-09-21T06:24:51.298 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /proc 2024-09-21T06:24:51.298 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /mnt 2024-09-21T06:24:51.298 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /var/tmp 2024-09-21T06:24:51.298 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /home 2024-09-21T06:24:51.298 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /root 2024-09-21T06:24:51.298 INFO:teuthology.orchestra.run.smithi098.stdout:skipping the directory /tmp 2024-09-21T06:24:51.298 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:24:51.474 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:51.490 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:51.490 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:51.490 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:24:51.491 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:24:52.054 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:52.054 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /sys 2024-09-21T06:24:52.054 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /proc 2024-09-21T06:24:52.054 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /mnt 2024-09-21T06:24:52.055 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /var/tmp 2024-09-21T06:24:52.055 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /home 2024-09-21T06:24:52.055 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /root 2024-09-21T06:24:52.055 INFO:teuthology.orchestra.run.smithi079.stdout:skipping the directory /tmp 2024-09-21T06:24:52.055 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:24:52.225 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:52.241 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:52.241 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:52.242 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:24:52.242 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:24:53.077 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:53.103 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:53.104 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:53.104 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:24:53.104 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:53.104 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:53.104 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:24:53.327 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:53.351 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:53.351 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:24:53.351 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:53.351 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:53.351 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:24:53.828 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:53.845 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:53.852 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:53.852 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:53.852 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:24:53.852 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:53.852 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:53.852 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:24:53.872 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:53.872 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:53.872 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:24:53.872 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:53.872 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:53.872 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:24:53.950 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:24:54.007 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:24:54.070 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:24:54.096 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:54.119 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:54.119 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:54.120 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:24:54.120 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:54.120 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:54.120 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:24:54.254 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:24:54.296 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:24:54.365 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:24:54.453 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:24:54.589 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:54.591 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:24:54.612 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:54.612 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:54.613 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:24:54.613 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:54.613 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:54.613 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:24:54.637 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:24:54.670 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:24:54.697 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:24:54.711 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:24:54.767 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:24:54.823 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:24:55.010 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:24:55.072 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:24:55.142 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:55.151 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:24:55.180 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:55.212 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:24:55.240 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:24:55.287 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:24:55.311 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:24:55.416 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:24:55.448 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:24:55.476 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:24:55.902 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:55.933 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:55.965 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:24:56.041 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:24:56.073 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:57.485 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /sys 2024-09-21T06:24:57.485 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /proc 2024-09-21T06:24:57.485 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /mnt 2024-09-21T06:24:57.485 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /var/tmp 2024-09-21T06:24:57.485 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /home 2024-09-21T06:24:57.485 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /root 2024-09-21T06:24:57.485 INFO:teuthology.orchestra.run.smithi049.stdout:skipping the directory /tmp 2024-09-21T06:24:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:24:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:57.692 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:57.692 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:24:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:24:58.503 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:58.576 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:24:59.267 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:59.330 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:24:59.352 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:59.380 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:59.380 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:59.380 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:24:59.381 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:59.381 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:59.381 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:24:59.544 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:24:59.576 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:24:59.619 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:59.644 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:59.644 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:59.644 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:24:59.645 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:59.645 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:59.645 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:24:59.690 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:24:59.861 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:24:59.895 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:24:59.919 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:24:59.920 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:59.920 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:24:59.920 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:24:59.920 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:24:59.920 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:24:59.979 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:24:59.991 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:25:00.089 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:25:00.136 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:25:00.136 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:25:00.161 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:25:00.161 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:00.161 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:25:00.162 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:25:00.162 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:25:00.162 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:25:00.267 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:25:00.296 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:25:00.322 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:25:00.326 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:25:00.390 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:25:00.435 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:25:00.586 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:25:00.599 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:25:00.625 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:25:00.638 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:25:00.649 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:25:00.649 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:00.649 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:25:00.649 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:25:00.649 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:25:00.649 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:25:00.700 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:25:00.712 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:25:00.719 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:25:00.812 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:25:00.816 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:25:00.865 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:25:00.959 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:25:01.004 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:25:01.038 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:25:01.064 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:25:01.104 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:25:01.140 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:25:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:25:01.164 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:01.164 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:25:01.164 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:25:01.164 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:25:01.164 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:25:01.207 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:25:01.230 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:25:01.230 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:01.230 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:25:01.231 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:25:01.283 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:25:01.306 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:25:01.306 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:01.307 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:25:01.307 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:25:01.307 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:25:01.307 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:25:01.466 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:25:01.504 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:25:01.545 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:25:01.615 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:25:01.642 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:25:01.643 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:25:01.666 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:25:01.666 INFO:teuthology.orchestra.run.smithi098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:01.666 INFO:teuthology.orchestra.run.smithi098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:25:01.666 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:25:01.666 INFO:teuthology.orchestra.run.smithi098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:25:01.666 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:25:01.836 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:25:01.870 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:25:01.893 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:25:01.893 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:01.894 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:25:01.894 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:25:01.894 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:25:01.894 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:25:01.937 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:25:01.960 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:25:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:01.960 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:25:01.960 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:25:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:25:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:25:02.027 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:02.027 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:25:02.028 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:25:02.028 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:25:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:25:02.347 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:25:02.371 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:25:02.371 INFO:teuthology.orchestra.run.smithi079.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:02.371 INFO:teuthology.orchestra.run.smithi079.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:25:02.371 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:25:02.371 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:25:02.371 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:25:05.042 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:25:05.100 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:25:05.755 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:25:05.805 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:25:05.845 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:25:05.877 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:25:05.905 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:25:06.096 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:25:06.118 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:25:06.142 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:25:06.143 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:25:06.174 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:25:06.203 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:25:06.250 INFO:teuthology.orchestra.run.smithi098.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:25:06.265 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:25:06.369 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:25:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:25:06.442 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:25:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:25:06.469 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:25:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:25:06.495 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:25:06.495 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:06.495 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:25:06.495 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:25:06.495 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:25:06.495 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:25:06.518 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:25:06.544 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:25:06.557 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:25:06.659 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:25:06.691 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:25:06.716 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:25:06.741 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:25:06.772 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:25:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:25:06.917 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:25:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:25:06.919 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:25:06.940 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:25:07.458 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:25:07.497 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:25:07.517 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:25:07.739 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:25:07.754 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:25:07.773 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:25:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:25:07.797 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:07.797 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:25:07.797 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:25:07.797 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:25:07.797 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:25:07.837 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:25:07.839 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:25:07.863 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:25:07.863 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:07.864 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:25:07.864 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:25:07.878 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:25:07.923 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:25:07.948 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:25:07.948 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:07.948 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:25:07.948 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:25:07.948 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:25:07.948 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:25:07.966 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:25:08.015 INFO:teuthology.orchestra.run.smithi098.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:25:08.066 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:25:08.100 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:25:08.100 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:25:08.176 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:25:08.176 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:25:08.260 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:25:08.285 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:25:08.290 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:25:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:25:08.291 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:25:08.316 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:25:08.316 INFO:teuthology.orchestra.run.smithi049.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:25:08.316 INFO:teuthology.orchestra.run.smithi049.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:25:08.316 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:25:08.316 INFO:teuthology.orchestra.run.smithi049.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:25:08.316 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:25:08.341 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:25:08.412 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:25:08.452 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:25:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:25:08.470 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:25:08.535 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:25:08.554 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:25:08.565 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:25:08.591 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:25:08.618 INFO:teuthology.orchestra.run.smithi098.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:25:08.625 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:25:08.625 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:25:08.709 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:25:08.709 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:25:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:25:08.810 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:25:08.815 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:25:08.815 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:25:09.004 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:25:09.004 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:25:09.088 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:25:09.159 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:25:12.587 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:25:12.637 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:25:12.678 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:25:12.709 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:25:12.736 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:25:12.956 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:25:12.999 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:25:13.029 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:25:13.059 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:25:13.114 INFO:teuthology.orchestra.run.smithi049.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:25:13.728 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:25:13.769 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:25:13.790 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:25:14.711 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:25:14.816 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:25:14.862 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:25:14.962 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:25:14.994 INFO:teuthology.orchestra.run.smithi049.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:25:15.019 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:25:15.045 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:25:15.045 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:25:15.112 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:25:15.112 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:25:15.204 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:25:15.230 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:25:15.235 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:25:15.235 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:25:15.285 INFO:teuthology.orchestra.run.smithi098.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:25:15.286 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:25:15.287 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:25:15.288 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:25:15.289 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:25:15.290 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:25:15.291 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:25:15.292 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:25:15.293 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:25:15.294 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:25:15.295 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:25:15.296 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:25:15.423 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:25:15.423 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:25:15.507 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:25:15.576 INFO:teuthology.orchestra.run.smithi049.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:25:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:25:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:25:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:25:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:25:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:25:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:25:15.684 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:25:15.685 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:25:15.686 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:25:15.687 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:25:15.688 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:25:15.689 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:25:15.690 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:25:15.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:25:15.692 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:25:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:25:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:25:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:25:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:25:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:25:15.693 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:25:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:25:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:25:17.772 INFO:teuthology.orchestra.run.smithi098.stdout:Upgraded: 2024-09-21T06:25:17.772 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout:Installed: 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.773 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.774 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:25:17.775 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.776 INFO:teuthology.orchestra.run.smithi098.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:25:17.777 INFO:teuthology.orchestra.run.smithi098.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:25:17.778 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:25:17.779 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:25:17.780 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:25:17.781 INFO:teuthology.orchestra.run.smithi098.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:25:17.782 INFO:teuthology.orchestra.run.smithi098.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:25:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:25:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:25:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:25:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:25:17.783 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:25:17.783 INFO:teuthology.orchestra.run.smithi098.stdout:Complete! 2024-09-21T06:25:18.184 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:25:18.184 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:25:18.184 INFO:teuthology.orchestra.run.smithi079.stdout:Upgraded: 2024-09-21T06:25:18.185 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:18.185 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:18.185 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:18.185 INFO:teuthology.orchestra.run.smithi079.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:18.185 INFO:teuthology.orchestra.run.smithi079.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.185 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.186 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.187 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:25:18.188 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:25:18.189 INFO:teuthology.orchestra.run.smithi079.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:25:18.190 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:25:18.191 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:25:18.192 INFO:teuthology.orchestra.run.smithi079.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:25:18.193 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:25:18.194 INFO:teuthology.orchestra.run.smithi079.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:25:18.195 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:25:18.196 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:25:18.196 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:25:18.196 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2024-09-21T06:25:18.225 DEBUG:teuthology.parallel:result is None 2024-09-21T06:25:18.647 DEBUG:teuthology.parallel:result is None 2024-09-21T06:25:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:25:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:25:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:25:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:25:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:25:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:25:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:25:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:25:21.787 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:25:21.788 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:25:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:25:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:25:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:25:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:25:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:25:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:25:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:25:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:25:21.789 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:25:21.802 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:25:21.802 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:25:21.802 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:25:21.802 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:25:21.802 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:25:21.803 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:25:21.804 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:25:21.805 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:25:21.806 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:25:21.807 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:25:21.808 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:25:21.809 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:25:21.810 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:25:21.811 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:25:21.812 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:25:21.813 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:25:21.813 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:25:21.813 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:25:21.813 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:25:24.401 INFO:teuthology.orchestra.run.smithi049.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout:Upgraded: 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:25:24.402 INFO:teuthology.orchestra.run.smithi049.stdout:Installed: 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.403 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:25:24.404 INFO:teuthology.orchestra.run.smithi049.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.405 INFO:teuthology.orchestra.run.smithi049.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:25:24.406 INFO:teuthology.orchestra.run.smithi049.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:25:24.407 INFO:teuthology.orchestra.run.smithi049.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:25:24.408 INFO:teuthology.orchestra.run.smithi049.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:25:24.409 INFO:teuthology.orchestra.run.smithi049.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:25:24.410 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:25:24.411 INFO:teuthology.orchestra.run.smithi049.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:25:24.412 INFO:teuthology.orchestra.run.smithi049.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:25:24.413 INFO:teuthology.orchestra.run.smithi049.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:25:24.413 INFO:teuthology.orchestra.run.smithi049.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:25:24.413 INFO:teuthology.orchestra.run.smithi049.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:25:24.413 INFO:teuthology.orchestra.run.smithi049.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:25:24.413 INFO:teuthology.orchestra.run.smithi049.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:25:24.413 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:25:24.413 INFO:teuthology.orchestra.run.smithi049.stdout:Complete! 2024-09-21T06:25:24.816 DEBUG:teuthology.parallel:result is None 2024-09-21T06:25:24.817 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:25:24.969 DEBUG:teuthology.orchestra.run.smithi049:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:25:24.992 INFO:teuthology.orchestra.run.smithi049.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:25:24.993 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:25:24.993 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:25:24.994 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:25:25.136 DEBUG:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:25:25.162 INFO:teuthology.orchestra.run.smithi079.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:25:25.163 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:25:25.163 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:25:25.165 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:25:25.304 DEBUG:teuthology.orchestra.run.smithi098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:25:25.331 INFO:teuthology.orchestra.run.smithi098.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:25:25.331 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:25:25.331 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:25:25.332 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:25:25.332 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:25:25.332 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:25:25.362 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:25:25.362 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:25:25.394 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:25:25.395 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:25:25.426 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:25:25.427 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:25:25.427 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:25:25.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:25:25.521 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:25:25.521 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:25:25.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:25:25.621 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:25:25.621 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:25:25.650 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:25:25.718 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:25:25.718 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:25:25.718 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:25:25.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:25:25.813 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:25:25.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:25:25.842 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:25:25.912 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:25:25.912 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:25:25.941 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:25:26.008 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:25:26.008 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:25:26.009 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:25:26.035 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:25:26.102 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:25:26.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:25:26.131 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:25:26.200 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:25:26.200 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:25:26.227 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:25:26.294 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T06:25:26.378 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2}} 2024-09-21T06:25:26.378 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:25:26.378 INFO:tasks.cephadm:Cluster fsid is 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:25:26.378 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T06:25:26.378 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.49', 'mon.b': '172.21.15.79', 'mon.c': '172.21.15.98'} 2024-09-21T06:25:26.379 INFO:tasks.cephadm:First mon is mon.a on smithi049 2024-09-21T06:25:26.379 INFO:tasks.cephadm:First mgr is x 2024-09-21T06:25:26.379 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T06:25:26.379 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname $(hostname -s) 2024-09-21T06:25:26.407 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname $(hostname -s) 2024-09-21T06:25:26.437 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname $(hostname -s) 2024-09-21T06:25:26.465 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T06:25:26.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:25:26.608 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T06:25:26.752 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:25:26.753 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:25:26.753 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:25:26.754 DEBUG:teuthology.orchestra.run.smithi049:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:25:27.353 INFO:teuthology.orchestra.run.smithi049.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:25 /home/ubuntu/cephtest/cephadm 2024-09-21T06:25:27.354 DEBUG:teuthology.orchestra.run.smithi079:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:25:27.935 INFO:teuthology.orchestra.run.smithi079.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:25 /home/ubuntu/cephtest/cephadm 2024-09-21T06:25:27.936 DEBUG:teuthology.orchestra.run.smithi098:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:25:28.520 INFO:teuthology.orchestra.run.smithi098.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:25 /home/ubuntu/cephtest/cephadm 2024-09-21T06:25:28.520 DEBUG:teuthology.orchestra.run.smithi049:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:25:28.541 DEBUG:teuthology.orchestra.run.smithi079:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:25:28.560 DEBUG:teuthology.orchestra.run.smithi098:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:25:28.593 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T06:25:28.594 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:25:28.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:25:28.603 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:25:30.066 INFO:teuthology.orchestra.run.smithi079.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:25:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:25:30.287 INFO:teuthology.orchestra.run.smithi098.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:26:01.705 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:26:01.705 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:26:01.705 INFO:teuthology.orchestra.run.smithi049.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:26:01.705 INFO:teuthology.orchestra.run.smithi049.stdout: "repo_digests": [ 2024-09-21T06:26:01.706 INFO:teuthology.orchestra.run.smithi049.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:26:01.706 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:26:01.706 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:26:07.841 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T06:26:07.841 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:26:07.841 INFO:teuthology.orchestra.run.smithi079.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:26:07.841 INFO:teuthology.orchestra.run.smithi079.stdout: "repo_digests": [ 2024-09-21T06:26:07.841 INFO:teuthology.orchestra.run.smithi079.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:26:07.841 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-21T06:26:07.841 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T06:26:09.702 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-21T06:26:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:26:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:26:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: "repo_digests": [ 2024-09-21T06:26:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:26:09.702 INFO:teuthology.orchestra.run.smithi098.stdout: ] 2024-09-21T06:26:09.703 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-21T06:26:09.727 DEBUG:teuthology.orchestra.run.smithi049:> sudo mkdir -p /etc/ceph 2024-09-21T06:26:09.761 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph 2024-09-21T06:26:09.794 DEBUG:teuthology.orchestra.run.smithi098:> sudo mkdir -p /etc/ceph 2024-09-21T06:26:09.821 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 777 /etc/ceph 2024-09-21T06:26:09.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /etc/ceph 2024-09-21T06:26:09.881 DEBUG:teuthology.orchestra.run.smithi098:> sudo chmod 777 /etc/ceph 2024-09-21T06:26:09.905 INFO:tasks.cephadm:Writing seed config... 2024-09-21T06:26:09.906 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T06:26:09.906 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T06:26:09.906 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T06:26:09.906 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T06:26:09.906 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T06:26:09.906 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T06:26:09.906 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T06:26:09.907 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T06:26:09.908 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T06:26:09.908 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T06:26:09.908 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T06:26:09.908 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:26:09.908 DEBUG:teuthology.orchestra.run.smithi049:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T06:26:09.930 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4a3fd104-77e2-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T06:26:09.931 DEBUG:teuthology.orchestra.run.smithi049:mon.a> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T06:26:09.970 DEBUG:teuthology.orchestra.run.smithi049:mgr.x> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T06:26:10.015 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T06:26:10.015 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.49 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:26:10.232 INFO:teuthology.orchestra.run.smithi049.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:26:10.233 INFO:teuthology.orchestra.run.smithi049.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.49', '--skip-admin-label'] 2024-09-21T06:26:10.233 INFO:teuthology.orchestra.run.smithi049.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T06:26:10.233 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying podman|docker is present... 2024-09-21T06:26:10.280 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:26:10.280 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying lvm2 is present... 2024-09-21T06:26:10.280 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying time synchronization is in place... 2024-09-21T06:26:10.288 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:26:10.288 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:26:10.295 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:26:10.295 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-21T06:26:10.301 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2024-09-21T06:26:10.308 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2024-09-21T06:26:10.308 INFO:teuthology.orchestra.run.smithi049.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:26:10.308 INFO:teuthology.orchestra.run.smithi049.stdout:Repeating the final host check... 2024-09-21T06:26:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:26:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T06:26:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl is present 2024-09-21T06:26:10.332 INFO:teuthology.orchestra.run.smithi049.stdout:lvcreate is present 2024-09-21T06:26:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:26:10.339 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:26:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:26:10.345 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-21T06:26:10.352 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout enabled 2024-09-21T06:26:10.359 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout active 2024-09-21T06:26:10.359 INFO:teuthology.orchestra.run.smithi049.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:26:10.359 INFO:teuthology.orchestra.run.smithi049.stdout:Host looks OK 2024-09-21T06:26:10.359 INFO:teuthology.orchestra.run.smithi049.stdout:Cluster fsid: 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:10.359 INFO:teuthology.orchestra.run.smithi049.stdout:Acquiring lock 140225450946176 on /run/cephadm/4a3fd104-77e2-11ef-baf5-efdc52797490.lock 2024-09-21T06:26:10.359 INFO:teuthology.orchestra.run.smithi049.stdout:Lock 140225450946176 acquired on /run/cephadm/4a3fd104-77e2-11ef-baf5-efdc52797490.lock 2024-09-21T06:26:10.360 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying IP 172.21.15.49 port 3300 ... 2024-09-21T06:26:10.360 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying IP 172.21.15.49 port 6789 ... 2024-09-21T06:26:10.360 INFO:teuthology.orchestra.run.smithi049.stdout:Base mon IP(s) is [172.21.15.49:3300, 172.21.15.49:6789], mon addrv is [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2024-09-21T06:26:10.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.49 metric 100 2024-09-21T06:26:10.363 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.49 metric 100 2024-09-21T06:26:10.366 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T06:26:10.366 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T06:26:10.366 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1752sec hoplimit 64 pref medium 2024-09-21T06:26:10.368 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T06:26:10.368 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T06:26:10.368 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:26:10.369 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T06:26:10.369 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-09-21T06:26:10.369 INFO:teuthology.orchestra.run.smithi049.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:26:10.369 INFO:teuthology.orchestra.run.smithi049.stdout:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2024-09-21T06:26:10.369 INFO:teuthology.orchestra.run.smithi049.stdout:Mon IP `172.21.15.49` is in CIDR network `172.21.0.0/20` 2024-09-21T06:26:10.369 INFO:teuthology.orchestra.run.smithi049.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T06:26:10.370 INFO:teuthology.orchestra.run.smithi049.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T06:26:10.370 INFO:teuthology.orchestra.run.smithi049.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:26:10.851 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:26:10.851 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:26:10.851 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T06:26:10.851 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T06:26:10.851 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T06:26:10.851 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:26:10.851 INFO:teuthology.orchestra.run.smithi049.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T06:26:11.815 INFO:teuthology.orchestra.run.smithi049.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:26:11.815 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:26:11.815 INFO:teuthology.orchestra.run.smithi049.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T06:26:12.803 INFO:teuthology.orchestra.run.smithi049.stdout:stat: stdout 167 167 2024-09-21T06:26:12.804 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial keys... 2024-09-21T06:26:13.601 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQAFZ+5mnhVTBxAASMtXDr7yAweN/Gycv6g8vg== 2024-09-21T06:26:14.515 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQAFZ+5mBO8DOhAADTuIJsA2ZozoIOn5Q50zSQ== 2024-09-21T06:26:18.867 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph-authtool: stdout AQAGZ+5mVqvtMRAA9w6t/cmzrCqwDoCShYwADw== 2024-09-21T06:26:18.868 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial monmap... 2024-09-21T06:26:21.055 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:26:21.055 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T06:26:21.055 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:21.055 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:26:21.055 INFO:teuthology.orchestra.run.smithi049.stdout:monmaptool for a [v2:172.21.15.49:3300,v1:172.21.15.49:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:26:21.055 INFO:teuthology.orchestra.run.smithi049.stdout:setting min_mon_release = quincy 2024-09-21T06:26:21.056 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: set fsid to 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:21.056 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:26:21.056 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:26:21.056 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mon... 2024-09-21T06:26:21.986 INFO:teuthology.orchestra.run.smithi049.stdout:create mon.a on 2024-09-21T06:26:22.202 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T06:26:22.350 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T06:26:22.531 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490.target. 2024-09-21T06:26:22.531 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490.target. 2024-09-21T06:26:22.751 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:26:22.751 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T06:26:22.915 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490.target.wants/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@.service. 2024-09-21T06:26:23.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:23 smithi049 podman[30789]: 2024-09-21 06:26:23.064733145 +0000 UTC m=+0.016383066 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:26:23.485 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:26:23.485 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-09-21T06:26:23.492 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:26:23.492 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-21T06:26:23.492 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-09-21T06:26:23.492 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:26:23.493 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon to start... 2024-09-21T06:26:23.493 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mon... 2024-09-21T06:26:23.616 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:23 smithi049 podman[30789]: 2024-09-21 06:26:23.386245108 +0000 UTC m=+0.337895028 container init d6d8b22b6bbab1ccef54275db4378cdcb42c407bdf1ae8fa4dfe95733dc84037 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T06:26:23.616 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:23 smithi049 podman[30789]: 2024-09-21 06:26:23.389509067 +0000 UTC m=+0.341158978 container start d6d8b22b6bbab1ccef54275db4378cdcb42c407bdf1ae8fa4dfe95733dc84037 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:26:23.616 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:23 smithi049 ceph-mon[30807]: mkfs 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:23.616 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:23 smithi049 ceph-mon[30807]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:26:23.616 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:23 smithi049 bash[30789]: d6d8b22b6bbab1ccef54275db4378cdcb42c407bdf1ae8fa4dfe95733dc84037 2024-09-21T06:26:23.616 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:23 smithi049 systemd[1]: Started Ceph mon.a for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:26:24.602 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:26:24.602 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: monmap epoch 1 2024-09-21T06:26:24.602 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:24.603 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: last_changed 2024-09-21T06:26:20.474496+0000 2024-09-21T06:26:24.603 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: created 2024-09-21T06:26:20.474496+0000 2024-09-21T06:26:24.603 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: min_mon_release 19 (squid) 2024-09-21T06:26:24.603 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: election_strategy: 1 2024-09-21T06:26:24.603 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-09-21T06:26:24.603 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: fsmap 2024-09-21T06:26:24.603 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:26:24.603 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: mgrmap e1: no daemons active 2024-09-21T06:26:24.603 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:24 smithi049 ceph-mon[30807]: from='client.? 172.21.15.49:0/1176614405' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T06:26:24.605 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout id: 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout services: 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.539966s) 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout data: 2024-09-21T06:26:24.607 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T06:26:24.608 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T06:26:24.608 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T06:26:24.608 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T06:26:24.608 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:24.608 INFO:teuthology.orchestra.run.smithi049.stdout:mon is available 2024-09-21T06:26:24.608 INFO:teuthology.orchestra.run.smithi049.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T06:26:25.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:25 smithi049 ceph-mon[30807]: from='client.? 172.21.15.49:0/1725645671' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:26:25.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:25 smithi049 ceph-mon[30807]: from='client.? 172.21.15.49:0/1725645671' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T06:26:25.797 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:25.797 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:26:25.797 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:25.797 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T06:26:25.798 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:26:25.799 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:26:25.799 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:26:25.799 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:26:25.799 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:26:25.799 INFO:teuthology.orchestra.run.smithi049.stdout:Generating new minimal ceph.conf... 2024-09-21T06:26:26.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:26 smithi049 ceph-mon[30807]: from='client.? 172.21.15.49:0/3070622506' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:26.826 INFO:teuthology.orchestra.run.smithi049.stdout:Restarting the monitor... 2024-09-21T06:26:27.119 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:26 smithi049 systemd[1]: Stopping Ceph mon.a for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:26:27.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:27 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a[30803]: 2024-09-21T06:26:27.115+0000 7f57f4f29640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:26:27.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:27 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a[30803]: 2024-09-21T06:26:27.115+0000 7f57f4f29640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T06:26:27.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:27 smithi049 podman[31048]: 2024-09-21 06:26:27.311155193 +0000 UTC m=+0.307321576 container died d6d8b22b6bbab1ccef54275db4378cdcb42c407bdf1ae8fa4dfe95733dc84037 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T06:26:27.818 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:27 smithi049 podman[31048]: 2024-09-21 06:26:27.591335276 +0000 UTC m=+0.587501659 container cleanup d6d8b22b6bbab1ccef54275db4378cdcb42c407bdf1ae8fa4dfe95733dc84037 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T06:26:27.818 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:27 smithi049 bash[31048]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:26:28.158 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:27 smithi049 podman[31060]: 2024-09-21 06:26:27.817060463 +0000 UTC m=+0.502845718 container remove d6d8b22b6bbab1ccef54275db4378cdcb42c407bdf1ae8fa4dfe95733dc84037 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T06:26:28.158 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:27 smithi049 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T06:26:28.158 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:27 smithi049 systemd[1]: Stopped Ceph mon.a for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:26:28.158 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:27 smithi049 systemd[1]: Starting Ceph mon.a for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:26:28.439 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 podman[31158]: 2024-09-21 06:26:28.059174074 +0000 UTC m=+0.016072251 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:26:28.439 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 podman[31158]: 2024-09-21 06:26:28.159621952 +0000 UTC m=+0.116520103 container create df426c7319b6a9bb20c85dd01d75176914c3dbeed7b65e164a909b4eb706e71c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T06:26:28.439 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 podman[31158]: 2024-09-21 06:26:28.353943402 +0000 UTC m=+0.310841573 container init df426c7319b6a9bb20c85dd01d75176914c3dbeed7b65e164a909b4eb706e71c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T06:26:28.439 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 podman[31158]: 2024-09-21 06:26:28.357222703 +0000 UTC m=+0.314120855 container start df426c7319b6a9bb20c85dd01d75176914c3dbeed7b65e164a909b4eb706e71c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T06:26:28.439 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:26:28.439 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:26:28.439 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: pidfile_write: ignore empty --pid-file 2024-09-21T06:26:28.439 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: load: jerasure load: lrc 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Git sha 0 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: DB SUMMARY 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: DB Session ID: VM1QZWSJMBIBA6YZMX1I 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T06:26:28.440 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94602 ; 2024-09-21T06:26:28.441 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:26:28.441 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:26:28.441 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:26:28.441 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:26:28.441 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.env: 0x55e9a9058d60 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.info_log: 0x55e9ae61b360 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.statistics: (nil) 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.use_fsync: 0 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:26:28.442 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.db_log_dir: 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.wal_dir: 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:26:28.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.write_buffer_manager: 0x55e9ae61fd60 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.unordered_write: 0 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:26:28.444 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.row_cache: None 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.wal_filter: None 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.wal_compression: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:26:28.445 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_open_files: -1 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:26:28.446 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Compression algorithms supported: 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: kZSTD supported: 0 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T06:26:28.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.merge_operator: 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_filter: None 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e9ae61afa0) 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout: index_type: 0 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout: data_block_index_type: 0 2024-09-21T06:26:28.448 INFO:journalctl@ceph.mon.a.smithi049.stdout: index_shortening: 1 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: checksum: 4 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: no_block_cache: 0 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_cache: 0x55e9aa5df610 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_cache_options: 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: capacity : 536870912 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: num_shard_bits : 4 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: strict_capacity_limit : 0 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_cache_compressed: (nil) 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: persistent_cache: (nil) 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_size: 4096 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_size_deviation: 10 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_restart_interval: 16 2024-09-21T06:26:28.449 INFO:journalctl@ceph.mon.a.smithi049.stdout: index_block_restart_interval: 1 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: metadata_block_size: 4096 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: partition_filters: 0 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: use_delta_encoding: 1 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: filter_policy: bloomfilter 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: whole_key_filtering: 1 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: verify_compression: 0 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: format_version: 5 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: enable_index_compression: 1 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: block_align: 0 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: max_auto_readahead_size: 262144 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: prepopulate_block_cache: 0 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:26:28.450 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression: NoCompression 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.num_levels: 7 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:26:28.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:26:28.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:26:28.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:26:28.454 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:26:28.455 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.ttl: 2592000 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:26:28.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cfe3bbfc-b70e-44ca-a7f4-3140f59d8a2a 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899988394389, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899988395555, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90828, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 283, "table_properties": {"data_size": 88869, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11567, "raw_average_key_size": 47, "raw_value_size": 82332, "raw_average_value_size": 340, "num_data_blocks": 12, "num_entries": 242, "num_filter_entries": 242, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726899988, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cfe3bbfc-b70e-44ca-a7f4-3140f59d8a2a", "db_session_id": "VM1QZWSJMBIBA6YZMX1I", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899988395653, "job": 1, "event": "recovery_finished"} 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T06:26:28.457 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e9ae63ea80 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: DB pointer 0x55e9af3e4000 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout: ** DB Stats ** 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:26:28.458 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: ** Compaction Stats [default] ** 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: L0 2/0 90.56 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: Sum 2/0 90.56 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 123.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: ** Compaction Stats [default] ** 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 123.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:26:28.459 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: Cumulative compaction: 0.00 GB write, 25.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: Interval compaction: 0.00 GB write, 25.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: Block cache BinnedLRUCache@0x55e9aa5df610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:26:28.460 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: starting mon.a rank 0 at public addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] at bind addrs [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mon.a@-1(???) e1 preinit fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mon.a@-1(???).mds e1 new map 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mon.a@-1(???).mds e1 print_map 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout: e1 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout: btime 2024-09-21T06:26:23:438315+0000 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout: legacy client fscid: -1 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout: 2024-09-21T06:26:28.461 INFO:journalctl@ceph.mon.a.smithi049.stdout: No filesystems configured 2024-09-21T06:26:28.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:26:28.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:26:28.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:26:28.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:26:28.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T06:26:28.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 bash[31158]: df426c7319b6a9bb20c85dd01d75176914c3dbeed7b65e164a909b4eb706e71c 2024-09-21T06:26:28.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 systemd[1]: Started Ceph mon.a for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:26:28.462 INFO:teuthology.orchestra.run.smithi049.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T06:26:28.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: monmap epoch 1 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: last_changed 2024-09-21T06:26:20.474496+0000 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: created 2024-09-21T06:26:20.474496+0000 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: min_mon_release 19 (squid) 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: election_strategy: 1 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: fsmap 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:26:28.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:28 smithi049 ceph-mon[31177]: mgrmap e1: no daemons active 2024-09-21T06:26:29.380 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T06:26:29.402 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:26:29.402 INFO:teuthology.orchestra.run.smithi049.stdout:Creating mgr... 2024-09-21T06:26:29.402 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T06:26:29.403 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T06:26:29.654 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:26:29.654 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T06:26:29.809 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490.target.wants/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@.service. 2024-09-21T06:26:30.140 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:29 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/226096484' entity='client.admin' 2024-09-21T06:26:30.349 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:26:30.349 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-09-21T06:26:30.358 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:26:30.358 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-21T06:26:30.358 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-09-21T06:26:30.358 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:26:30.369 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:26:30.369 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-09-21T06:26:30.378 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:26:30.378 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-21T06:26:30.378 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-09-21T06:26:30.378 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T06:26:30.378 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr to start... 2024-09-21T06:26:30.378 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr... 2024-09-21T06:26:30.508 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:30 smithi049 systemd[1]: Started Ceph mgr.x for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:26:31.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:31 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4185301256' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "4a3fd104-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:26:31.627 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:26:31.628 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:26:31.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:26:31.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:26:31.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:26:31.629 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:26:31.632 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:31.633 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:26:23:438315+0000", 2024-09-21T06:26:31.634 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:31.635 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:26:23.439111+0000", 2024-09-21T06:26:31.636 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:31.636 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:31.636 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:26:31.636 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:31.636 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (1/15)... 2024-09-21T06:26:34.395 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:34 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2791153961' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "4a3fd104-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:26:34.678 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:34.679 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:26:34.680 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:26:23:438315+0000", 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:26:34.681 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:26:23.439111+0000", 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:34.682 INFO:teuthology.orchestra.run.smithi049.stdout:mgr not available, waiting (2/15)... 2024-09-21T06:26:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: Activating manager daemon x 2024-09-21T06:26:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: mgrmap e2: x(active, starting, since 0.00396421s) 2024-09-21T06:26:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:26:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:26:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:26:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:26:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:26:35.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: Manager daemon x is now available 2024-09-21T06:26:35.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:26:35.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:26:35.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' 2024-09-21T06:26:35.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' 2024-09-21T06:26:35.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:35 smithi049 ceph-mon[31177]: from='mgr.14100 172.21.15.49:0/2510321904' entity='mgr.x' 2024-09-21T06:26:37.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:37 smithi049 ceph-mon[31177]: mgrmap e3: x(active, since 1.00861s) 2024-09-21T06:26:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:37 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1873973634' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:26:37.931 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:37.931 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:37.931 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsid": "4a3fd104-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:26:37.931 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:26:37.931 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:26:37.931 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:26:37.931 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:26:37.931 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:26:37.932 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:37.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:26:37.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:26:37.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:26:37.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:26:37.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:26:37.933 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:26:37.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:37.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:26:37.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:26:37.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:26:37.937 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:26:37.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:26:37.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:26:37.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:26:37.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:26:37.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:26:37.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:37.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:26:37.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:37.938 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:26:23:438315+0000", 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:37.939 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:37.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:37.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:26:37.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:37.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:26:23.439111+0000", 2024-09-21T06:26:37.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:37.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:37.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:26:37.940 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:37.940 INFO:teuthology.orchestra.run.smithi049.stdout:mgr is available 2024-09-21T06:26:38.849 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:38 smithi049 ceph-mon[31177]: mgrmap e4: x(active, since 2s) 2024-09-21T06:26:38.849 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:38 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1591490027' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout fsid = 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.49:3300,v1:172.21.15.49:6789] 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:26:39.104 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:26:39.105 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling cephadm module... 2024-09-21T06:26:40.080 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:39 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3417277268' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T06:26:40.080 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:39 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: ignoring --setuser ceph since I am not root 2024-09-21T06:26:40.081 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:39 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: ignoring --setgroup ceph since I am not root 2024-09-21T06:26:40.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:40 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3417277268' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T06:26:40.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:40 smithi049 ceph-mon[31177]: mgrmap e5: x(active, since 4s) 2024-09-21T06:26:41.490 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:41.490 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T06:26:41.490 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:26:41.490 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:26:41.490 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:26:41.491 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:41.491 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2024-09-21T06:26:41.491 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 5... 2024-09-21T06:26:42.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:41 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1502840988' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:26:45.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: Active manager daemon x restarted 2024-09-21T06:26:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: Activating manager daemon x 2024-09-21T06:26:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T06:26:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: mgrmap e6: x(active, starting, since 0.00369835s) 2024-09-21T06:26:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:26:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:26:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:26:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:26:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:26:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:45 smithi049 ceph-mon[31177]: Manager daemon x is now available 2024-09-21T06:26:46.570 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:46.570 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T06:26:46.570 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:26:46.570 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:46.570 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 5 is available 2024-09-21T06:26:46.570 INFO:teuthology.orchestra.run.smithi049.stdout:Verifying orchestrator module is enabled... 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: mgrmap e7: x(active, since 1.00538s) 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:26:47.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:47 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:26:48.164 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:48 smithi049 ceph-mon[31177]: Found migration_current of "None". Setting to last migration. 2024-09-21T06:26:48.165 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:48 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2540272475' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T06:26:48.165 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:48 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2540272475' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T06:26:48.165 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:48 smithi049 ceph-mon[31177]: mgrmap e8: x(active, since 2s) 2024-09-21T06:26:48.410 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T06:26:48.410 INFO:teuthology.orchestra.run.smithi049.stdout:Setting orchestrator backend to cephadm... 2024-09-21T06:26:50.082 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:50 smithi049 ceph-mon[31177]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:50 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:50 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:50 smithi049 ceph-mon[31177]: [21/Sep/2024:06:26:49] ENGINE Bus STARTING 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:50 smithi049 ceph-mon[31177]: [21/Sep/2024:06:26:49] ENGINE Serving on http://172.21.15.49:8765 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:50 smithi049 ceph-mon[31177]: [21/Sep/2024:06:26:49] ENGINE Serving on https://172.21.15.49:7150 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:50 smithi049 ceph-mon[31177]: [21/Sep/2024:06:26:49] ENGINE Bus STARTED 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:50 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:50 smithi049 ceph-mon[31177]: [21/Sep/2024:06:26:49] ENGINE Error in HTTPServer.serve 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout: Traceback (most recent call last): 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:26:50.083 INFO:journalctl@ceph.mon.a.smithi049.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: self._run(expiration_interval) 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: s = self.context.wrap_socket( 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: return self.sslsocket_class._create( 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: self.do_handshake() 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:26:50.084 INFO:journalctl@ceph.mon.a.smithi049.stdout: self._sslobj.do_handshake() 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mon.a.smithi049.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:26:49.823+0000 7f41bafa3640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:26:49] ENGINE Error in HTTPServer.serve 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: Traceback (most recent call last): 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self._connections.run(self.expiration_interval) 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self._run(expiration_interval) 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:26:50.085 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:26:50.086 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: s = self.context.wrap_socket( 2024-09-21T06:26:50.086 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:26:50.086 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: return self.sslsocket_class._create( 2024-09-21T06:26:50.086 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:26:50.086 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self.do_handshake() 2024-09-21T06:26:50.086 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:26:50.086 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self._sslobj.do_handshake() 2024-09-21T06:26:50.086 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:26:50.086 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:26:50.772 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T06:26:50.772 INFO:teuthology.orchestra.run.smithi049.stdout:Generating ssh key... 2024-09-21T06:26:51.155 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:51 smithi049 ceph-mon[31177]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:52.309 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-mon[31177]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:52.309 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-mon[31177]: Generating ssh key... 2024-09-21T06:26:52.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: Generating public/private rsa key pair. 2024-09-21T06:26:52.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: Your identification has been saved in /tmp/tmpq1orsunp/key 2024-09-21T06:26:52.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: Your public key has been saved in /tmp/tmpq1orsunp/key.pub 2024-09-21T06:26:52.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: The key fingerprint is: 2024-09-21T06:26:52.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: SHA256:dbA5bFRL8M7zMz+Hhwf5C63++54pQuHQeRicFLm/Ow0 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:52.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: The key's randomart image is: 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: +---[RSA 3072]----+ 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: | *=* | 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: | o @ . | 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: | O O | 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: | + @ . | 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: | S o B . | 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: | o E+ | 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: | . .B* | 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: | . +=*B| 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: | o+=XX| 2024-09-21T06:26:52.724 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:26:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: +----[SHA256]-----+ 2024-09-21T06:26:53.371 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:53 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:26:53.371 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:53 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:26:53.901 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQAqnFq8aGE0X8p5UDzyWptcrsgKog5zHuNel/AArM2aGFKGHcORsSZYPKplABjz0SNj700qChKveWFwKd0v3chNEDtut4yEiTp3RC+ePtkwz2+zH2xL2+1eKaJmhl/8+8IXQmnGBZEreJjnxN8PcU9x0fbn+deva4Xd0uauy+j6q7vi8Vr+gsypTUHchpJjb1hsiOK77WEjf+Fg/sR0JOlZtOjFqq5rE+xkjoXncbAMnd3pJXLK8Ey5OPgq7oFOKd9HjrzufJjaaHT/aaJdJhQbpPydJwjBAfkBEz/nUuzDYWBPkKmvULdngA3HCdtalQGwU9Fe2PkpDodsQs1jelazBXbu3INOZ6DI++SWTQwV12dSIUTWKyTkVLKxvJLzFPEnSicZb7RK5NoxKLDXvRX1kd9MQSno4n/tpz+Y6x1U+GCPf3BvX7Il6guv4I3/pPbvuvbuxWJvOnlmDBCki3r0JNfHMlOqHXzRJYQQfyT53NyrS9gS/JtVCwnJe9TCk= ceph-4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:53.901 INFO:teuthology.orchestra.run.smithi049.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:26:53.901 INFO:teuthology.orchestra.run.smithi049.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T06:26:53.912 INFO:teuthology.orchestra.run.smithi049.stdout:Adding host smithi049... 2024-09-21T06:26:54.708 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:54 smithi049 ceph-mon[31177]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:55.505 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:55 smithi049 ceph-mon[31177]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi049", "addr": "172.21.15.49", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:56.642 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:56 smithi049 ceph-mon[31177]: Deploying cephadm binary to smithi049 2024-09-21T06:26:58.842 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Added host 'smithi049' with addr '172.21.15.49' 2024-09-21T06:26:58.842 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying unmanaged mon service... 2024-09-21T06:26:59.559 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:59 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:26:59.559 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:59 smithi049 ceph-mon[31177]: Added host smithi049 2024-09-21T06:26:59.559 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:26:59 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:00.161 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T06:27:00.161 INFO:teuthology.orchestra.run.smithi049.stdout:Deploying unmanaged mgr service... 2024-09-21T06:27:00.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:00 smithi049 ceph-mon[31177]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:00.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:00 smithi049 ceph-mon[31177]: Saving service mon spec with placement count:5 2024-09-21T06:27:00.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:00 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:27:01.611 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T06:27:02.021 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:01 smithi049 ceph-mon[31177]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:02.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:01 smithi049 ceph-mon[31177]: Saving service mgr spec with placement count:2 2024-09-21T06:27:02.022 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:01 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:27:03.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:03 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1640018340' entity='client.admin' 2024-09-21T06:27:03.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:03 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:27:03.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:03 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:27:04.548 INFO:teuthology.orchestra.run.smithi049.stdout:Enabling the dashboard module... 2024-09-21T06:27:05.149 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:04 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/605416317' entity='client.admin' 2024-09-21T06:27:06.705 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:06 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: ignoring --setuser ceph since I am not root 2024-09-21T06:27:06.705 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:06 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: ignoring --setgroup ceph since I am not root 2024-09-21T06:27:06.705 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:06 smithi049 ceph-mon[31177]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:06.705 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:06 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:27:06.705 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:06 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3472113885' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T06:27:06.705 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:06 smithi049 ceph-mon[31177]: from='mgr.14118 172.21.15.49:0/3900035001' entity='mgr.x' 2024-09-21T06:27:07.385 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:07 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3472113885' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T06:27:07.385 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:07 smithi049 ceph-mon[31177]: mgrmap e9: x(active, since 21s) 2024-09-21T06:27:08.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:08 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1863027492' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:27:08.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:27:08.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T06:27:08.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:27:08.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:27:08.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:27:08.855 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:27:08.855 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for the mgr to restart... 2024-09-21T06:27:08.855 INFO:teuthology.orchestra.run.smithi049.stdout:Waiting for mgr epoch 9... 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: Active manager daemon x restarted 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: Activating manager daemon x 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: mgrmap e10: x(active, starting, since 0.0039537s) 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:27:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:11 smithi049 ceph-mon[31177]: Manager daemon x is now available 2024-09-21T06:27:12.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:12 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:12.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:12 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:27:12.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:12 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:27:12.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:12 smithi049 ceph-mon[31177]: mgrmap e11: x(active, since 1.00755s) 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi049.stdout:mgr epoch 9 is available 2024-09-21T06:27:13.110 INFO:teuthology.orchestra.run.smithi049.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T06:27:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:13 smithi049 ceph-mon[31177]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T06:27:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:13 smithi049 ceph-mon[31177]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T06:27:14.698 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-mon[31177]: mgrmap e12: x(active, since 2s) 2024-09-21T06:27:14.698 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:14.698 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-mon[31177]: [21/Sep/2024:06:27:14] ENGINE Bus STARTING 2024-09-21T06:27:14.698 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:27:14.421+0000 7f88c0b79640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:27:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:27:14.698 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: Traceback (most recent call last): 2024-09-21T06:27:14.698 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:27:14.698 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self._connections.run(self.expiration_interval) 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self._run(expiration_interval) 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: s = self.context.wrap_socket( 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: return self.sslsocket_class._create( 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self.do_handshake() 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:27:14.699 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self._sslobj.do_handshake() 2024-09-21T06:27:14.700 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:27:14.700 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:27:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:27:15.237 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUX4qM4TsFOQ5S7to4EtBEjZPhSR8wDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA2MjcxNFoXDTM0\nMDkyMjA2MjcxNFowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjQ5MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEApv369FSlFKrumKrX4AOVLIpHsMIh//LMuC1r\nLkC+wPadgKnbdNn0a81q7xhSORPS1ycumay8o5bWoQUtmOumliBVZlTribZyaGrz\ngReTNccehNV3T3s+VjGWWOb3be0gYCtwPt4gHapkCz24c8ugH0OLyF3OVcuKhvo4\nPT0D41obQMGTQITIMRFWSfCSNLO/rb+Rh+0qxpvXvqYKLrLmsulOB6CF6/Q/2Lig\n6lzml97E6zdmO5OkgmM2/Mxbc+wrfHwG5C/vx8LQsCwEmkB4g99lfjKUcR0Rkm5Q\nFIqwHqALujta4DO2oVor20fuwqytHIuN1GY17D6kBOhgwyttJV2nVd6Ab/0WmrnD\nxy1l8H8+lWCAw2V3bPdrEwqRRP3inUbf0PbJ9cLoPZYhH1KDs+soah5F3MXBB7AK\ntJsOl1yQLgrJ/8aYTUHvwwOTWpseA9HWwy0RMLVnc2dTgN8fvjbNZjWb+JbK0a28\nolcCuOdt/fpfM9rtEB/MDUhXxKqIipV4/a7/yhY78Et1K2Zlr/9IhpCJpLeUQv6q\nWBP35hgAeoDrcwpTc/K/6vCciSSwfnmAgppgj3NglSWaESaU7X0v1FJzaUupoY9x\nxnAyPUPH23JH6kfiaUEfY3kvy4IqzCtr96cELpSpv79SRh53GIcIJSlz1GGiYwGI\nNdaCLukCAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDQ5ghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPMTAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAs\n2q2NYht+SO8oR+V2tPhrSjYTNG5gbDD+SjrFWHv9Z4INw6SiEAFlSXvs4FVccSsZ\n5JEegojWUUw6OZ1CNdtdGt+KdaASgH+LJLwrvwTmUoL7E/oiKbt2DKRwBTizpEBs\n2GOD7ZRFX5kFxDv8K3XcguqiiGj5uxhfcPNvc9+JSc7JGhv5+io5chdlOAqCFiS/\nOWFwQE3mVKNFEE10tJLQCMhBvwmJC5OPbUJ5+GlbpnWmViQMSonmlaULjYB7N5lD\nZgkM7NJUm0wTA+ZZ3lUpsxeSBbfJNkD/1UOnJRpMLKd60EBlCYtlNAew0mEvw0kz\nwUwfoxJFNM/82SAA6zpGKNQpURdMznnD5jHIWmAi1wWY6tM2fAhC76bBwDgJNUll\nqnaCNBwtO9JuaFwEdW5wG46PqzAQCd3y3CMlyWv/zRQA+6soWF5I2tfbVvLwGcBY\nrpaXlNwb7n/ehh2NckYNTbgrSO8CCEcQwWKbL+OM50r8LtYr61K9nWkrRKsn9/DG\nblCZ456a0z2qmr2k4nvJCTxCBPtbibo8CC7ytlJcXunN8Xnf/EvfIIUxfX5q1xou\nKiS6F7bbpeaZgdeWIziSfD11+Cy8MXISNAnNEz5R3G2LCWpa3KPBfkOMAiPErWog\ndLT4v+gRTsU9DGhWxCjKZ0UZhi4fm/+1f3iuUkK/Cw==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEApv369FSlFKrumKrX4AOVLIpHsMIh//LMuC1rLkC+wPadgKnb\ndNn0a81q7xhSORPS1ycumay8o5bWoQUtmOumliBVZlTribZyaGrzgReTNccehNV3\nT3s+VjGWWOb3be0gYCtwPt4gHapkCz24c8ugH0OLyF3OVcuKhvo4PT0D41obQMGT\nQITIMRFWSfCSNLO/rb+Rh+0qxpvXvqYKLrLmsulOB6CF6/Q/2Lig6lzml97E6zdm\nO5OkgmM2/Mxbc+wrfHwG5C/vx8LQsCwEmkB4g99lfjKUcR0Rkm5QFIqwHqALujta\n4DO2oVor20fuwqytHIuN1GY17D6kBOhgwyttJV2nVd6Ab/0WmrnDxy1l8H8+lWCA\nw2V3bPdrEwqRRP3inUbf0PbJ9cLoPZYhH1KDs+soah5F3MXBB7AKtJsOl1yQLgrJ\n/8aYTUHvwwOTWpseA9HWwy0RMLVnc2dTgN8fvjbNZjWb+JbK0a28olcCuOdt/fpf\nM9rtEB/MDUhXxKqIipV4/a7/yhY78Et1K2Zlr/9IhpCJpLeUQv6qWBP35hgAeoDr\ncwpTc/K/6vCciSSwfnmAgppgj3NglSWaESaU7X0v1FJzaUupoY9xxnAyPUPH23JH\n6kfiaUEfY3kvy4IqzCtr96cELpSpv79SRh53GIcIJSlz1GGiYwGINdaCLukCAwEA\nAQKCAgAJ85G8dLzfte4BEBFMSrpdjKIIERGYoJ39jctY1sfnVOr+62BmHsT3laa9\nN9xShXFnm/ClfMtDDm6c6uOUPNrREH02W3Ir40D/Ivx+4WpG5qZVcSkqheQpm8vj\nYWQ2W062HHCUdoVAb1KF7vgqgmR46HwQhTKSH06Si5/FWnj8V/bOzZpaWm9ZqThU\nsK7t0BZoosVn7cTCUDAzrs5liQjBebDKOJEyhfw2DI6eWMnvG/ntMIB5pWtEz+fL\nedwrVNQkl3mLqKWn6F6qWP0vOg9UgIAaXKZG9V4CNWu1RayILq50OyxHtx03kVmS\nuD8sv8CTNmfN1Ad7nCIHHtgBWXmoCzk9HJ57DtGHRK0JTgllmz5yLFudViYAUBCU\nIFPRqW8MLofXqh97aM5jp5bZOuJs7eehcYFv3VniQOgrFjHAdILSRrjgkXnhJCot\ndkJP7q0gPSwkqlRiSHyEDpVmagipAYK4hyPdlOo55evTfseRCsYweWGu45FnXyNZ\npPd7hwwcpBT2EccytfgcimSc5DaeqC8qs2ckZ6AAk8zdXQJfG6GI7h1zWH809F9i\ndJQGlbYAP5fvC4ref2LBwzsYgKJA2F2chcuicLXShnuXnCXZnbxvwbz5sw5Aq9Mp\nUfSs5zkFmMsRmivDMYqJvX60H6+X3r0mhv1AZ6VYrHu5K/TwAQKCAQEA2EGQdreF\nDQZBS1dogtwyHqekLzWUjqr5Qlct7p+WYNXbVQMCmfIRe+LR1Ve7ZG8DV2W4e5x1\nSUP4SYdiPGMs6NtHpobI6wKS5Au6mpU4Tpx8mYnt30unItllH8jVfJIQx24rTcxc\nRwf7IwicS2xlSZkF6iIoeNiy+6KxJBXA2Gum1qDnMwpnEluGXRRZqaoZxHsy7+7T\nuVI7pt0KBm18a9yLs0MyMoQbsFCBzc43hZPUDesBj9knNRz13AhZWRMTwvEY228u\nVOCIP/UwTbThjpoZBn11qO2ozbptyx1kKzJoOSg0GLttF8wKzay+6u2P/TNE4MN7\nqAOfsBKs8vHkAQKCAQEAxa6jn9sHwm+3g1A3yoM2Um189Hp/DaQC1A55hG6eTt6S\nMABBTevhxIbyjh4O5fFOQ/OBOAWjvURakMwD+5IaseTlPd+xR4OYmzksEp1OYYsS\nMjY6xlhTeHrQfk9yS+bJxguOB714zHJ0eLIHpO8ftmW/4jaJlJkrUlN01SpJZgv/\nn6tGhADkKuwldyKgt+GlcycR+dOgeD/7wPp9a4Weu9zXZIZuy8dAsIja1RltRHxF\nXvQ2csoiDocxbcLlmy6SiLFzGvnbswYb8flRwHbiZ4hyRsYAmQ9RHIVMZJ//c696\nvJHOa9CEDIAmiZeGlfocAD5kUokfaNkMJ2I4cvGq6QKCAQEAlgKdCIzzQX6mSnH+\nsE+4gKU/cfQT8gdN0qQQ26deNBwFAmqNImbVk/9aGUi7V8beJYENQMneXg1FLRQ5\no7QUEg8SG8UBmGv3ozMzpUl/fqB0mjkghbW/4Z+10x+IX9oew4h7h4MMO8WggsPV\nT0iI1k3M2YYKVxHSzlUj1ek1FatPVzDUUAaWSxisEuMr81Jof3AKfH9J5RLTCEPq\nUV0fYt7hFV+2cW5Mmrit4ip7PzC1d1Yehj9XQDOvpIsyF2TxX1fJK2ZrWDtMqDkX\n4b9oe3gPhf3/YUhCwTriMHRZ6NEVlRh7UvCok0pZ8CQ1Z1eVe0lWLSfNHlYtLoE1\n8Wy0AQKCAQBAim0nouZcqAbdW5Jrjv1sWgzi8R+MP5Eg1Pz9rPQIwggunda0byAN\n/xUwK0Yn8unfq5/zv3ufLrL29XUTbLdEf3wNAHyr4Z4wh7EI/sz5ceNl+2ijG3Fd\nM5PguWWSvG4COAGOK2FGNtQqF84BHoVXEs9cNvwiRQPs5AyQEDdYlvBFnDDwpi3Y\nibMNu4OHpadT+lyXGW4Z9KHodp/+O+kAYvD8BBwmcg5/1J7F1oBjTMOFZexk+/O0\nlJUhxfEbAlCbSnxPQWZmg8cZ8JGtaeMvdFADJWBKmMKdsjOn4skPZyqGaIBhmPmT\n7z8lyxAI5VjBB53PiK91lu+t6BaQCLEJAoIBAAvC3KNkoYfq/omBCI+Qw8g6mBOD\n+6eN1ytliBfyG12N806YfnFQL6B/K4VDuPSX7aKo17fUxVV9AlTLTOe97zOE5Q6r\nVFybll3MBRT/VD8JiMlo/s8wYeYifdI6RBN3O6DgEWieM8f7W1Oy/Bpx713zzTe3\nMBcvcyCDyChc9VY04TnEsWyV1m78YRcF9ILQOj9XARzWNh67/9/6pKyaLQItc0e0\nCkUYpof2U6HkChagh8QTZ8F1NpbWx5UgzzmuQ9Ss2nGbXfk7GtP5BnlhCb+vr6gU\n/wtip0MX52u1Ww7Glw4nRW+koA+oDOD//uMjPR8uKdtfyPLV819rzA6ug9w=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T06:27:15.912 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:15 smithi049 ceph-mon[31177]: [21/Sep/2024:06:27:14] ENGINE Serving on https://172.21.15.49:7150 2024-09-21T06:27:15.912 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:15 smithi049 ceph-mon[31177]: [21/Sep/2024:06:27:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:27:15.912 INFO:journalctl@ceph.mon.a.smithi049.stdout: Traceback (most recent call last): 2024-09-21T06:27:15.912 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:27:15.912 INFO:journalctl@ceph.mon.a.smithi049.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:27:15.912 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:27:15.912 INFO:journalctl@ceph.mon.a.smithi049.stdout: self._run(expiration_interval) 2024-09-21T06:27:15.912 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: s = self.context.wrap_socket( 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: return self.sslsocket_class._create( 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: self.do_handshake() 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: self._sslobj.do_handshake() 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:15 smithi049 ceph-mon[31177]: [21/Sep/2024:06:27:14] ENGINE Serving on http://172.21.15.49:8765 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:15 smithi049 ceph-mon[31177]: [21/Sep/2024:06:27:14] ENGINE Bus STARTED 2024-09-21T06:27:15.913 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:15 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:16.455 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T06:27:17.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:16 smithi049 ceph-mon[31177]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:17.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:16 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:18.102 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T06:27:18.102 INFO:teuthology.orchestra.run.smithi049.stdout:Creating initial admin user... 2024-09-21T06:27:18.206 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:18 smithi049 ceph-mon[31177]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:18.206 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:18 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:19.497 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$q9cPjs5DZL60GfidoF7mY.K1pcK9vQoTwrSrq.PJYGWd6.S6gqMwS", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726900038, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T06:27:19.497 INFO:teuthology.orchestra.run.smithi049.stdout:Fetching dashboard port number... 2024-09-21T06:27:20.093 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:19 smithi049 ceph-mon[31177]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:20.093 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:19 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:20.654 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T06:27:20.664 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:27:20.664 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout disabled 2024-09-21T06:27:20.671 INFO:teuthology.orchestra.run.smithi049.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:27:20.671 INFO:teuthology.orchestra.run.smithi049.stdout:systemctl: stdout inactive 2024-09-21T06:27:20.671 INFO:teuthology.orchestra.run.smithi049.stdout:firewalld.service is not enabled 2024-09-21T06:27:20.671 INFO:teuthology.orchestra.run.smithi049.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T06:27:20.673 INFO:teuthology.orchestra.run.smithi049.stdout:Ceph Dashboard is now available at: 2024-09-21T06:27:20.673 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:20.673 INFO:teuthology.orchestra.run.smithi049.stdout: URL: https://smithi049.front.sepia.ceph.com:8443/ 2024-09-21T06:27:20.673 INFO:teuthology.orchestra.run.smithi049.stdout: User: admin 2024-09-21T06:27:20.673 INFO:teuthology.orchestra.run.smithi049.stdout: Password: endbdkyb6k 2024-09-21T06:27:20.673 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:20.674 INFO:teuthology.orchestra.run.smithi049.stdout:Saving cluster configuration to /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config directory 2024-09-21T06:27:21.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:20 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1635931104' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T06:27:21.944 INFO:teuthology.orchestra.run.smithi049.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T06:27:21.944 INFO:teuthology.orchestra.run.smithi049.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: ceph telemetry on 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout:For more information see: 2024-09-21T06:27:21.945 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T06:27:21.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:21.946 INFO:teuthology.orchestra.run.smithi049.stdout:Bootstrap complete. 2024-09-21T06:27:21.992 INFO:tasks.cephadm:Fetching config... 2024-09-21T06:27:21.992 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:27:21.992 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T06:27:22.008 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T06:27:22.009 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:27:22.009 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T06:27:22.064 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T06:27:22.065 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:27:22.065 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T06:27:22.129 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T06:27:22.129 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:27:22.129 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T06:27:22.185 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T06:27:22.185 DEBUG:teuthology.orchestra.run.smithi049:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQAqnFq8aGE0X8p5UDzyWptcrsgKog5zHuNel/AArM2aGFKGHcORsSZYPKplABjz0SNj700qChKveWFwKd0v3chNEDtut4yEiTp3RC+ePtkwz2+zH2xL2+1eKaJmhl/8+8IXQmnGBZEreJjnxN8PcU9x0fbn+deva4Xd0uauy+j6q7vi8Vr+gsypTUHchpJjb1hsiOK77WEjf+Fg/sR0JOlZtOjFqq5rE+xkjoXncbAMnd3pJXLK8Ey5OPgq7oFOKd9HjrzufJjaaHT/aaJdJhQbpPydJwjBAfkBEz/nUuzDYWBPkKmvULdngA3HCdtalQGwU9Fe2PkpDodsQs1jelazBXbu3INOZ6DI++SWTQwV12dSIUTWKyTkVLKxvJLzFPEnSicZb7RK5NoxKLDXvRX1kd9MQSno4n/tpz+Y6x1U+GCPf3BvX7Il6guv4I3/pPbvuvbuxWJvOnlmDBCki3r0JNfHMlOqHXzRJYQQfyT53NyrS9gS/JtVCwnJe9TCk= ceph-4a3fd104-77e2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:27:22.260 INFO:teuthology.orchestra.run.smithi049.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQAqnFq8aGE0X8p5UDzyWptcrsgKog5zHuNel/AArM2aGFKGHcORsSZYPKplABjz0SNj700qChKveWFwKd0v3chNEDtut4yEiTp3RC+ePtkwz2+zH2xL2+1eKaJmhl/8+8IXQmnGBZEreJjnxN8PcU9x0fbn+deva4Xd0uauy+j6q7vi8Vr+gsypTUHchpJjb1hsiOK77WEjf+Fg/sR0JOlZtOjFqq5rE+xkjoXncbAMnd3pJXLK8Ey5OPgq7oFOKd9HjrzufJjaaHT/aaJdJhQbpPydJwjBAfkBEz/nUuzDYWBPkKmvULdngA3HCdtalQGwU9Fe2PkpDodsQs1jelazBXbu3INOZ6DI++SWTQwV12dSIUTWKyTkVLKxvJLzFPEnSicZb7RK5NoxKLDXvRX1kd9MQSno4n/tpz+Y6x1U+GCPf3BvX7Il6guv4I3/pPbvuvbuxWJvOnlmDBCki3r0JNfHMlOqHXzRJYQQfyT53NyrS9gS/JtVCwnJe9TCk= ceph-4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:22.274 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQAqnFq8aGE0X8p5UDzyWptcrsgKog5zHuNel/AArM2aGFKGHcORsSZYPKplABjz0SNj700qChKveWFwKd0v3chNEDtut4yEiTp3RC+ePtkwz2+zH2xL2+1eKaJmhl/8+8IXQmnGBZEreJjnxN8PcU9x0fbn+deva4Xd0uauy+j6q7vi8Vr+gsypTUHchpJjb1hsiOK77WEjf+Fg/sR0JOlZtOjFqq5rE+xkjoXncbAMnd3pJXLK8Ey5OPgq7oFOKd9HjrzufJjaaHT/aaJdJhQbpPydJwjBAfkBEz/nUuzDYWBPkKmvULdngA3HCdtalQGwU9Fe2PkpDodsQs1jelazBXbu3INOZ6DI++SWTQwV12dSIUTWKyTkVLKxvJLzFPEnSicZb7RK5NoxKLDXvRX1kd9MQSno4n/tpz+Y6x1U+GCPf3BvX7Il6guv4I3/pPbvuvbuxWJvOnlmDBCki3r0JNfHMlOqHXzRJYQQfyT53NyrS9gS/JtVCwnJe9TCk= ceph-4a3fd104-77e2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:27:22.323 INFO:teuthology.orchestra.run.smithi079.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQAqnFq8aGE0X8p5UDzyWptcrsgKog5zHuNel/AArM2aGFKGHcORsSZYPKplABjz0SNj700qChKveWFwKd0v3chNEDtut4yEiTp3RC+ePtkwz2+zH2xL2+1eKaJmhl/8+8IXQmnGBZEreJjnxN8PcU9x0fbn+deva4Xd0uauy+j6q7vi8Vr+gsypTUHchpJjb1hsiOK77WEjf+Fg/sR0JOlZtOjFqq5rE+xkjoXncbAMnd3pJXLK8Ey5OPgq7oFOKd9HjrzufJjaaHT/aaJdJhQbpPydJwjBAfkBEz/nUuzDYWBPkKmvULdngA3HCdtalQGwU9Fe2PkpDodsQs1jelazBXbu3INOZ6DI++SWTQwV12dSIUTWKyTkVLKxvJLzFPEnSicZb7RK5NoxKLDXvRX1kd9MQSno4n/tpz+Y6x1U+GCPf3BvX7Il6guv4I3/pPbvuvbuxWJvOnlmDBCki3r0JNfHMlOqHXzRJYQQfyT53NyrS9gS/JtVCwnJe9TCk= ceph-4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:22.337 DEBUG:teuthology.orchestra.run.smithi098:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQAqnFq8aGE0X8p5UDzyWptcrsgKog5zHuNel/AArM2aGFKGHcORsSZYPKplABjz0SNj700qChKveWFwKd0v3chNEDtut4yEiTp3RC+ePtkwz2+zH2xL2+1eKaJmhl/8+8IXQmnGBZEreJjnxN8PcU9x0fbn+deva4Xd0uauy+j6q7vi8Vr+gsypTUHchpJjb1hsiOK77WEjf+Fg/sR0JOlZtOjFqq5rE+xkjoXncbAMnd3pJXLK8Ey5OPgq7oFOKd9HjrzufJjaaHT/aaJdJhQbpPydJwjBAfkBEz/nUuzDYWBPkKmvULdngA3HCdtalQGwU9Fe2PkpDodsQs1jelazBXbu3INOZ6DI++SWTQwV12dSIUTWKyTkVLKxvJLzFPEnSicZb7RK5NoxKLDXvRX1kd9MQSno4n/tpz+Y6x1U+GCPf3BvX7Il6guv4I3/pPbvuvbuxWJvOnlmDBCki3r0JNfHMlOqHXzRJYQQfyT53NyrS9gS/JtVCwnJe9TCk= ceph-4a3fd104-77e2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:27:22.379 INFO:teuthology.orchestra.run.smithi098.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQAqnFq8aGE0X8p5UDzyWptcrsgKog5zHuNel/AArM2aGFKGHcORsSZYPKplABjz0SNj700qChKveWFwKd0v3chNEDtut4yEiTp3RC+ePtkwz2+zH2xL2+1eKaJmhl/8+8IXQmnGBZEreJjnxN8PcU9x0fbn+deva4Xd0uauy+j6q7vi8Vr+gsypTUHchpJjb1hsiOK77WEjf+Fg/sR0JOlZtOjFqq5rE+xkjoXncbAMnd3pJXLK8Ey5OPgq7oFOKd9HjrzufJjaaHT/aaJdJhQbpPydJwjBAfkBEz/nUuzDYWBPkKmvULdngA3HCdtalQGwU9Fe2PkpDodsQs1jelazBXbu3INOZ6DI++SWTQwV12dSIUTWKyTkVLKxvJLzFPEnSicZb7RK5NoxKLDXvRX1kd9MQSno4n/tpz+Y6x1U+GCPf3BvX7Il6guv4I3/pPbvuvbuxWJvOnlmDBCki3r0JNfHMlOqHXzRJYQQfyT53NyrS9gS/JtVCwnJe9TCk= ceph-4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:22.392 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T06:27:22.665 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:22.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:22 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/33304509' entity='client.admin' 2024-09-21T06:27:23.948 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T06:27:23.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T06:27:24.390 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:24.575 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:24 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1464383076' entity='client.admin' 2024-09-21T06:27:25.419 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:25 smithi049 ceph-mon[31177]: mgrmap e13: x(active, since 12s) 2024-09-21T06:27:25.972 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi079 2024-09-21T06:27:25.972 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:27:25.972 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:27:25.992 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:27:25.992 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:26.050 INFO:tasks.cephadm:Adding host smithi079 to orchestrator... 2024-09-21T06:27:26.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch host add smithi079 2024-09-21T06:27:26.687 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:26 smithi049 ceph-mon[31177]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:26.687 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:26 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:26.838 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:28.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:28.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:28.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:28.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:28.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:28.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:27 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:29.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:28 smithi049 ceph-mon[31177]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi079", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:30.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:29 smithi049 ceph-mon[31177]: Deploying cephadm binary to smithi079 2024-09-21T06:27:31.253 INFO:teuthology.orchestra.run.smithi049.stdout:Added host 'smithi079' with addr '172.21.15.79' 2024-09-21T06:27:31.893 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:27:32.145 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:32.601 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:32 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:32.601 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:32 smithi049 ceph-mon[31177]: Added host smithi079 2024-09-21T06:27:32.601 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:32 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:32.601 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:32 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:32.601 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:32 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:32.773 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:32.773 INFO:teuthology.orchestra.run.smithi049.stdout:[{"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}] 2024-09-21T06:27:33.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:33 smithi049 ceph-mon[31177]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:33.456 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:33 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:33.457 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi098 2024-09-21T06:27:33.458 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:27:33.458 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:27:33.478 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:27:33.479 DEBUG:teuthology.orchestra.run.smithi098:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:33.536 INFO:tasks.cephadm:Adding host smithi098 to orchestrator... 2024-09-21T06:27:33.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch host add smithi098 2024-09-21T06:27:33.789 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:34.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:34 smithi049 ceph-mon[31177]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:35.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:35 smithi049 ceph-mon[31177]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:36.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:36.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:36 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:37 smithi049 ceph-mon[31177]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-21T06:27:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:37 smithi049 ceph-mon[31177]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:37 smithi049 ceph-mon[31177]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:37 smithi049 ceph-mon[31177]: Deploying cephadm binary to smithi098 2024-09-21T06:27:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:37 smithi049 ceph-mon[31177]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:37 smithi049 ceph-mon[31177]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:38.307 INFO:teuthology.orchestra.run.smithi049.stdout:Added host 'smithi098' with addr '172.21.15.98' 2024-09-21T06:27:38.925 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:27:39.178 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:39.564 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:39 smithi049 ceph-mon[31177]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:39.564 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:39 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:39.564 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:39 smithi049 ceph-mon[31177]: Added host smithi098 2024-09-21T06:27:39.564 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:39 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:39.564 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:39 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:39.564 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:39 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:39.857 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:27:39.857 INFO:teuthology.orchestra.run.smithi049.stdout:[{"addr": "172.21.15.49", "hostname": "smithi049", "labels": [], "status": ""}, {"addr": "172.21.15.79", "hostname": "smithi079", "labels": [], "status": ""}, {"addr": "172.21.15.98", "hostname": "smithi098", "labels": [], "status": ""}] 2024-09-21T06:27:40.370 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T06:27:40.370 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T06:27:40.617 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:40.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:40 smithi049 ceph-mon[31177]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:40.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:40 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:40.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:40 smithi049 ceph-mon[31177]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:41.618 INFO:teuthology.orchestra.run.smithi049.stderr:adjusted tunables profile to default 2024-09-21T06:27:41.915 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:41 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/586371373' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:27:42.204 INFO:tasks.cephadm:Adding mon.a on smithi049 2024-09-21T06:27:42.204 INFO:tasks.cephadm:Adding mon.b on smithi079 2024-09-21T06:27:42.204 INFO:tasks.cephadm:Adding mon.c on smithi098 2024-09-21T06:27:42.204 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi049:172.21.15.49=a;smithi079:172.21.15.79=b;smithi098:172.21.15.98=c' 2024-09-21T06:27:42.503 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:42.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:42.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/586371373' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:27:42.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:42.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:42.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:42.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:42.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:42.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:42.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:42.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:42.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:42 smithi049 ceph-mon[31177]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T06:27:43.224 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mon update... 2024-09-21T06:27:43.811 DEBUG:teuthology.orchestra.run.smithi079:mon.b> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T06:27:43.814 DEBUG:teuthology.orchestra.run.smithi098:mon.c> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T06:27:43.816 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:27:43.816 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:27:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi049:172.21.15.49=a;smithi079:172.21.15.79=b;smithi098:172.21.15.98=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: Saving service mon spec with placement smithi049:172.21.15.49=a;smithi079:172.21.15.79=b;smithi098:172.21.15.98=c;count:3 2024-09-21T06:27:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:43.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:43.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:43.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:43.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:43.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:43.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:43.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:43 smithi049 ceph-mon[31177]: Deploying daemon mon.c on smithi098 2024-09-21T06:27:44.884 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:45.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:45 smithi049 ceph-mon[31177]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:45.732 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:27:45.732 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","modified":"2024-09-21T06:26:20.474496Z","created":"2024-09-21T06:26:20.474496Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T06:27:45.732 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-21T06:27:46.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:46 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/1055413986' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:47.377 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:27:47.377 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:27:47.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:47 smithi049 ceph-mon[31177]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:47.727 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:27:48.412 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:27:48.412 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":1,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","modified":"2024-09-21T06:26:20.474496Z","created":"2024-09-21T06:26:20.474496Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T06:27:48.413 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 1 2024-09-21T06:27:48.512 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 podman[34653]: 2024-09-21 06:27:48.478821937 +0000 UTC m=+0.344737508 container start 5193bec175e8cb4af24cfd05333e21f68a597a2851a948eb9527fac4748b21b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-c, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:27:48.512 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:27:48.512 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:27:48.512 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: pidfile_write: ignore empty --pid-file 2024-09-21T06:27:48.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: load: jerasure load: lrc 2024-09-21T06:27:48.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:27:48.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Git sha 0 2024-09-21T06:27:48.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:27:48.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: DB SUMMARY 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: DB Session ID: 6VHMDXD5ARYYHDCGX411 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:27:48.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.env: 0x559061c9bd60 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.info_log: 0x55906693d360 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.statistics: (nil) 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.use_fsync: 0 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:27:48.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.db_log_dir: 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.wal_dir: 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:27:48.799 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.write_buffer_manager: 0x559066941d60 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.unordered_write: 0 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.row_cache: None 2024-09-21T06:27:48.800 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.wal_filter: None 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.wal_compression: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:27:48.801 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:27:48.802 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:27:48.802 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:27:48.802 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:27:48.802 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:27:48.802 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:27:48.803 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:27:48.803 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:27:48.803 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:27:48.803 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_open_files: -1 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Compression algorithms supported: 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: kZSTD supported: 0 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:27:48.804 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.merge_operator: 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_filter: None 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:27:48.805 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55906693cfa0) 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: index_type: 0 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: data_block_index_type: 0 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: index_shortening: 1 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: checksum: 4 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: no_block_cache: 0 2024-09-21T06:27:48.806 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_cache: 0x559062901610 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_cache_options: 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: capacity : 536870912 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: num_shard_bits : 4 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: strict_capacity_limit : 0 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_cache_compressed: (nil) 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: persistent_cache: (nil) 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_size: 4096 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_size_deviation: 10 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_restart_interval: 16 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: index_block_restart_interval: 1 2024-09-21T06:27:48.807 INFO:journalctl@ceph.mon.c.smithi098.stdout: metadata_block_size: 4096 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: partition_filters: 0 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: use_delta_encoding: 1 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: filter_policy: bloomfilter 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: whole_key_filtering: 1 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: verify_compression: 0 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: format_version: 5 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: enable_index_compression: 1 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: block_align: 0 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: max_auto_readahead_size: 262144 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: prepopulate_block_cache: 0 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:27:48.808 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression: NoCompression 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.num_levels: 7 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:27:48.809 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:27:48.810 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:27:48.811 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:27:48.812 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:27:48.813 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.ttl: 2592000 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:27:48.814 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 194053e7-af2f-4953-b2a4-07c0c88ac869 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726900068516403, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726900068516993, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726900068, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "194053e7-af2f-4953-b2a4-07c0c88ac869", "db_session_id": "6VHMDXD5ARYYHDCGX411", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726900068517119, "job": 1, "event": "recovery_finished"} 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559066960a80 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: DB pointer 0x559067706000 2024-09-21T06:27:48.815 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: ** DB Stats ** 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:27:48.816 INFO:journalctl@ceph.mon.c.smithi098.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: ** Compaction Stats [default] ** 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:27:48.817 INFO:journalctl@ceph.mon.c.smithi098.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout: Cumulative compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout: Interval compaction: 0.00 GB write, 0.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout: Block cache BinnedLRUCache@0x559062901610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: using public_addr v2:172.21.15.98:0/0 -> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: starting mon.c rank -1 at public addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] at bind addrs [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:48.818 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(???) e0 preinit fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout: e1 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout: btime 2024-09-21T06:26:23:438315+0000 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout: legacy client fscid: -1 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout: 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout: No filesystems configured 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T06:27:48.819 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi098", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:48.820 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Deploying cephadm binary to smithi098 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Added host smithi098 2024-09-21T06:27:48.821 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/586371373' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/586371373' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:48.822 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi049:172.21.15.49=a;smithi079:172.21.15.79=b;smithi098:172.21.15.98=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Saving service mon spec with placement smithi049:172.21.15.49=a;smithi079:172.21.15.79=b;smithi098:172.21.15.98=c;count:3 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:48.823 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:48.824 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:48.824 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:48.824 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:48.824 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:48.824 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: Deploying daemon mon.c on smithi098 2024-09-21T06:27:48.824 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:48.824 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/1055413986' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:48.824 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:48.824 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 ceph-mon[34704]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T06:27:49.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 bash[34653]: 5193bec175e8cb4af24cfd05333e21f68a597a2851a948eb9527fac4748b21b6 2024-09-21T06:27:49.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:48 smithi098 systemd[1]: Started Ceph mon.c for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:27:50.355 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:27:50.356 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:27:50.622 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:27:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: mon.a calling monitor election 2024-09-21T06:27:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: mon.c calling monitor election 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: monmap epoch 2 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: last_changed 2024-09-21T06:27:48.546360+0000 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: created 2024-09-21T06:26:20.474496+0000 2024-09-21T06:27:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: min_mon_release 19 (squid) 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: election_strategy: 1 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: fsmap 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: mgrmap e13: x(active, since 42s) 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: overall HEALTH_OK 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:53.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:53 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:53.999 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:53.999 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:53.999 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: mon.a calling monitor election 2024-09-21T06:27:53.999 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: mon.c calling monitor election 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: monmap epoch 2 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: last_changed 2024-09-21T06:27:48.546360+0000 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: created 2024-09-21T06:26:20.474496+0000 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: min_mon_release 19 (squid) 2024-09-21T06:27:54.000 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: election_strategy: 1 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: fsmap 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: mgrmap e13: x(active, since 42s) 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: overall HEALTH_OK 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:54.001 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:53 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:54.315 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:27:54.315 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":2,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","modified":"2024-09-21T06:27:48.546360Z","created":"2024-09-21T06:26:20.474496Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:27:54.315 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 2 2024-09-21T06:27:54.904 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:54 smithi098 ceph-mon[34704]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:54.904 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:54 smithi098 ceph-mon[34704]: Deploying daemon mon.b on smithi079 2024-09-21T06:27:54.904 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:54 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/1941275422' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:54.904 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:54 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:54.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:54 smithi049 ceph-mon[31177]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:54.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:54 smithi049 ceph-mon[31177]: Deploying daemon mon.b on smithi079 2024-09-21T06:27:54.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:54 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/1941275422' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:54.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:54 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:55.931 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:27:55.932 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:27:56.189 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:27:56.847 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:27:56.847 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":2,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","modified":"2024-09-21T06:27:48.546360Z","created":"2024-09-21T06:26:20.474496Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:27:56.847 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 2 2024-09-21T06:27:56.848 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:27:56 smithi098 ceph-mon[34704]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:56.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:27:56 smithi049 ceph-mon[31177]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:57.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:27:57 smithi079 systemd[1]: Started Ceph mon.b for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:27:58.444 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:27:58.444 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:27:58.696 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:28:02.670 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:28:02.671 INFO:teuthology.orchestra.run.smithi098.stdout:{"epoch":3,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","modified":"2024-09-21T06:27:57.312718Z","created":"2024-09-21T06:26:20.474496Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:3300","nonce":0},{"type":"v1","addr":"172.21.15.49:6789","nonce":0}]},"addr":"172.21.15.49:6789/0","public_addr":"172.21.15.49:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:3300","nonce":0},{"type":"v1","addr":"172.21.15.98:6789","nonce":0}]},"addr":"172.21.15.98:6789/0","public_addr":"172.21.15.98:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:3300","nonce":0},{"type":"v1","addr":"172.21.15.79:6789","nonce":0}]},"addr":"172.21.15.79:6789/0","public_addr":"172.21.15.79:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T06:28:02.671 INFO:teuthology.orchestra.run.smithi098.stderr:dumped monmap epoch 3 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: mon.a calling monitor election 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: mon.c calling monitor election 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: mon.b calling monitor election 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:02.672 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: monmap epoch 3 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: last_changed 2024-09-21T06:27:57.312718+0000 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: created 2024-09-21T06:26:20.474496+0000 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: min_mon_release 19 (squid) 2024-09-21T06:28:02.673 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: election_strategy: 1 2024-09-21T06:28:02.674 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-09-21T06:28:02.674 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-21T06:28:02.674 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: 2: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-09-21T06:28:02.674 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: fsmap 2024-09-21T06:28:02.674 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:28:02.674 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: mgrmap e13: x(active, since 50s) 2024-09-21T06:28:02.674 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: overall HEALTH_OK 2024-09-21T06:28:02.674 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.675 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.675 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.675 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:02 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:28:02.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: mon.a calling monitor election 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: mon.c calling monitor election 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: mon.b calling monitor election 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: monmap epoch 3 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: last_changed 2024-09-21T06:27:57.312718+0000 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: created 2024-09-21T06:26:20.474496+0000 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: min_mon_release 19 (squid) 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: election_strategy: 1 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: 2: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: fsmap 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: mgrmap e13: x(active, since 50s) 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: overall HEALTH_OK 2024-09-21T06:28:02.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.726 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.726 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.726 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:02 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: mon.a calling monitor election 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: mon.c calling monitor election 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: mon.b calling monitor election 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: monmap epoch 3 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: last_changed 2024-09-21T06:27:57.312718+0000 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: created 2024-09-21T06:26:20.474496+0000 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: min_mon_release 19 (squid) 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: election_strategy: 1 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: 0: [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] mon.a 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: 1: [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] mon.c 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: 2: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.b 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: fsmap 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: mgrmap e13: x(active, since 50s) 2024-09-21T06:28:02.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: overall HEALTH_OK 2024-09-21T06:28:02.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:02.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:02 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:03.155 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T06:28:03.155 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T06:28:03.426 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:03.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:03 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:03.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:03 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/3336250055' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:28:03.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:03 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:03.662 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:03 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:03.663 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:03 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/3336250055' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:28:03.663 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:03 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:03.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:03 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:03.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:03 smithi079 ceph-mon[34346]: from='client.? 172.21.15.98:0/3336250055' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:28:03.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:03 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:04.124 INFO:teuthology.orchestra.run.smithi049.stdout:# minimal ceph.conf for 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:28:04.124 INFO:teuthology.orchestra.run.smithi049.stdout:[global] 2024-09-21T06:28:04.124 INFO:teuthology.orchestra.run.smithi049.stdout: fsid = 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:28:04.124 INFO:teuthology.orchestra.run.smithi049.stdout: mon_host = [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] 2024-09-21T06:28:04.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:04.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:04.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3089287582' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:28:04.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:04.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:04.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:04.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:04 smithi098 ceph-mon[34704]: Reconfiguring daemon mon.a on smithi049 2024-09-21T06:28:04.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:04.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3089287582' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:04.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:04 smithi049 ceph-mon[31177]: Reconfiguring daemon mon.a on smithi049 2024-09-21T06:28:04.775 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T06:28:04.775 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:28:04.775 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:28:04.804 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:28:04.804 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T06:28:04.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3089287582' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:04.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T06:28:04.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:04.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:04.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:04.821 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:04 smithi079 ceph-mon[34346]: Reconfiguring daemon mon.a on smithi049 2024-09-21T06:28:04.870 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:28:04.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:28:04.898 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:28:04.898 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:04.963 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:28:04.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:28:04.990 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:28:04.990 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:05.055 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T06:28:05.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T06:28:05.839 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:07.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:06 smithi098 ceph-mon[34704]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:07.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:06 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:07.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:06 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:07.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:06 smithi098 ceph-mon[34704]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:28:07.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:06 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:07.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:06 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:07.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:06 smithi098 ceph-mon[34704]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:07.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:06 smithi098 ceph-mon[34704]: Reconfiguring daemon mon.b on smithi079 2024-09-21T06:28:07.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:06 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3903332136' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:28:07.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:06 smithi079 ceph-mon[34346]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:07.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:06 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:07.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:06 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:07.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:06 smithi079 ceph-mon[34346]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:28:07.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:06 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:07.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:06 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:07.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:06 smithi079 ceph-mon[34346]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:07.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:06 smithi079 ceph-mon[34346]: Reconfiguring daemon mon.b on smithi079 2024-09-21T06:28:07.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:06 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3903332136' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: ignoring --setuser ceph since I am not root 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: ignoring --setgroup ceph since I am not root 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-mon[31177]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-mon[31177]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-mon[31177]: from='mgr.14152 172.21.15.49:0/3664185797' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-mon[31177]: Reconfiguring daemon mon.b on smithi079 2024-09-21T06:28:07.077 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:06 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3903332136' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:28:07.366 INFO:tasks.cephadm:Adding mgr.x on smithi049 2024-09-21T06:28:07.366 INFO:tasks.cephadm:Adding mgr.y on smithi079 2024-09-21T06:28:07.366 INFO:tasks.cephadm:Adding mgr.z on smithi098 2024-09-21T06:28:07.366 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi049=x;smithi079=y;smithi098=z' 2024-09-21T06:28:07.604 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:28:08.017 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:07 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3903332136' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:28:08.017 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:07 smithi098 ceph-mon[34704]: mgrmap e14: x(active, since 55s) 2024-09-21T06:28:08.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:07 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3903332136' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:28:08.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:07 smithi079 ceph-mon[34346]: mgrmap e14: x(active, since 55s) 2024-09-21T06:28:08.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:07 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3903332136' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:28:08.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:07 smithi049 ceph-mon[31177]: mgrmap e14: x(active, since 55s) 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: Active manager daemon x restarted 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: Activating manager daemon x 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: mgrmap e15: x(active, starting, since 0.00497927s) 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:28:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:28:12.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:12 smithi049 ceph-mon[31177]: Manager daemon x is now available 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: Active manager daemon x restarted 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: Activating manager daemon x 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: mgrmap e15: x(active, starting, since 0.00497927s) 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:28:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:28:12.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:28:12.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:12 smithi098 ceph-mon[34704]: Manager daemon x is now available 2024-09-21T06:28:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: Active manager daemon x restarted 2024-09-21T06:28:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: Activating manager daemon x 2024-09-21T06:28:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:28:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: mgrmap e15: x(active, starting, since 0.00497927s) 2024-09-21T06:28:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:28:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:28:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:28:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:28:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:28:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:28:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:28:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:12 smithi079 ceph-mon[34346]: Manager daemon x is now available 2024-09-21T06:28:13.062 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mgr update... 2024-09-21T06:28:13.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:13.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:28:13.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:28:13.351 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:13 smithi079 ceph-mon[34346]: mgrmap e16: x(active, since 1.01059s) 2024-09-21T06:28:13.352 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:13.373 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:13.373 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:28:13.373 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:28:13.374 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:13 smithi049 ceph-mon[31177]: mgrmap e16: x(active, since 1.01059s) 2024-09-21T06:28:13.374 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:13.395 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:13.395 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:28:13.395 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:28:13.395 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:13 smithi098 ceph-mon[34704]: mgrmap e16: x(active, since 1.01059s) 2024-09-21T06:28:13.395 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.052 DEBUG:teuthology.orchestra.run.smithi079:mgr.y> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T06:28:14.054 DEBUG:teuthology.orchestra.run.smithi098:mgr.z> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T06:28:14.056 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T06:28:14.056 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T06:28:14.059 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T06:28:14.059 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T06:28:14.101 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T06:28:14.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T06:28:14.144 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T06:28:14.144 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T06:28:14.188 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T06:28:14.188 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T06:28:14.232 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T06:28:14.232 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T06:28:14.289 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T06:28:14.289 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T06:28:14.343 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T06:28:14.343 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T06:28:14.398 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T06:28:14.398 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T06:28:14.454 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T06:28:14.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T06:28:14.498 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T06:28:14.498 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T06:28:14.506 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:14.519 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T06:28:14.519 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T06:28:14.566 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T06:28:14.566 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T06:28:14.619 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T06:28:14.619 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T06:28:14.675 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T06:28:14.675 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T06:28:14.722 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T06:28:14.723 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T06:28:14.723 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:14.783 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T06:28:14.783 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T06:28:14.847 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T06:28:14.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T06:28:14.873 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: Saving service mgr spec with placement smithi049=x;smithi079=y;smithi098=z;count:3 2024-09-21T06:28:14.873 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.873 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.873 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.873 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.873 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:14.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:14.874 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:14.894 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T06:28:14.894 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T06:28:14.895 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:28:14.579+0000 7f397ba09640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:28:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:28:14.895 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: Traceback (most recent call last): 2024-09-21T06:28:14.895 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:28:14.895 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self._connections.run(self.expiration_interval) 2024-09-21T06:28:14.895 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:28:14.895 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self._run(expiration_interval) 2024-09-21T06:28:14.895 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:28:14.895 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:28:14.895 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: s = self.context.wrap_socket( 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: return self.sslsocket_class._create( 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self.do_handshake() 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: self._sslobj.do_handshake() 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:28:14.896 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:28:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:28:14.948 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T06:28:14.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T06:28:15.008 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T06:28:15.008 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T06:28:15.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: Saving service mgr spec with placement smithi049=x;smithi079=y;smithi098=z;count:3 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:15.059 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T06:28:15.059 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T06:28:15.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: Saving service mgr spec with placement smithi049=x;smithi079=y;smithi098=z;count:3 2024-09-21T06:28:15.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi079", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi098", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:15.102 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T06:28:15.103 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T06:28:15.160 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T06:28:15.160 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T06:28:15.212 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T06:28:15.213 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T06:28:15.262 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T06:28:15.262 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T06:28:15.313 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T06:28:15.313 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T06:28:15.360 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T06:28:15.360 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T06:28:15.408 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T06:28:15.408 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T06:28:15.454 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T06:28:15.454 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T06:28:15.508 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T06:28:15.508 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi049') 2024-09-21T06:28:15.509 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:15.689 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: [21/Sep/2024:06:28:14] ENGINE Bus STARTING 2024-09-21T06:28:15.689 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: [21/Sep/2024:06:28:14] ENGINE Serving on http://172.21.15.49:8765 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: [21/Sep/2024:06:28:14] ENGINE Serving on https://172.21.15.49:7150 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: [21/Sep/2024:06:28:14] ENGINE Bus STARTED 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: [21/Sep/2024:06:28:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: Traceback (most recent call last): 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: self._run(expiration_interval) 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: s = self.context.wrap_socket( 2024-09-21T06:28:15.690 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout: return self.sslsocket_class._create( 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout: self.do_handshake() 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout: self._sslobj.do_handshake() 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: mgrmap e17: x(active, since 2s) 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:15.691 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: [21/Sep/2024:06:28:14] ENGINE Bus STARTING 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: [21/Sep/2024:06:28:14] ENGINE Serving on http://172.21.15.49:8765 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: [21/Sep/2024:06:28:14] ENGINE Serving on https://172.21.15.49:7150 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: [21/Sep/2024:06:28:14] ENGINE Bus STARTED 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: [21/Sep/2024:06:28:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout: Traceback (most recent call last): 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:28:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout: self._run(expiration_interval) 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: s = self.context.wrap_socket( 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: return self.sslsocket_class._create( 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: self.do_handshake() 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: self._sslobj.do_handshake() 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.048 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:16.048 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:16.048 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:16.048 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: mgrmap e17: x(active, since 2s) 2024-09-21T06:28:16.048 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.048 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: [21/Sep/2024:06:28:14] ENGINE Bus STARTING 2024-09-21T06:28:16.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: [21/Sep/2024:06:28:14] ENGINE Serving on http://172.21.15.49:8765 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: [21/Sep/2024:06:28:14] ENGINE Serving on https://172.21.15.49:7150 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: [21/Sep/2024:06:28:14] ENGINE Bus STARTED 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: [21/Sep/2024:06:28:14] ENGINE Error in HTTPServer.serve 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: Traceback (most recent call last): 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: self._run(expiration_interval) 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: s = self.context.wrap_socket( 2024-09-21T06:28:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout: return self.sslsocket_class._create( 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout: self.do_handshake() 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout: self._sslobj.do_handshake() 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi049", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: mgrmap e17: x(active, since 2s) 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-21T06:28:16.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-21T06:28:16.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T06:28:16.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='client.? ' entity='client.admin' 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3168678748' entity='client.admin' 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:28:16.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:28:16.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:28:16.725 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:28:16.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='client.? ' entity='client.admin' 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3168678748' entity='client.admin' 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:28:16.919 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:17.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: Updating smithi049:/etc/ceph/ceph.conf 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: Updating smithi079:/etc/ceph/ceph.conf 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: Updating smithi098:/etc/ceph/ceph.conf 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: Updating smithi098:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: Updating smithi079:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: Updating smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: Updating smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='client.? ' entity='client.admin' 2024-09-21T06:28:17.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3168678748' entity='client.admin' 2024-09-21T06:28:17.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:17.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:17.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:17.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:28:17.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:28:17.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:28:17.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 -- 172.21.15.49:0/1283676949 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd63003fb70 msgr2=0x7fd630042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 --2- 172.21.15.49:0/1283676949 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd63003fb70 0x7fd630042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd644107ff0 tx=0x7fd62c005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 -- 172.21.15.49:0/1283676949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd644103b80 msgr2=0x7fd64419a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 --2- 172.21.15.49:0/1283676949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd644103b80 0x7fd64419a1f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd63400ebc0 tx=0x7fd63400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 -- 172.21.15.49:0/1283676949 shutdown_connections 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 --2- 172.21.15.49:0/1283676949 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd63003fb70 0x7fd630042080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 --2- 172.21.15.49:0/1283676949 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd644109e10 0x7fd64419fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 --2- 172.21.15.49:0/1283676949 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd6441094c0 0x7fd64419a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 --2- 172.21.15.49:0/1283676949 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd644103b80 0x7fd64419a1f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:17.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 -- 172.21.15.49:0/1283676949 >> 172.21.15.49:0/1283676949 conn(0x7fd6440ff610 msgr2=0x7fd644101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:17.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 -- 172.21.15.49:0/1283676949 shutdown_connections 2024-09-21T06:28:17.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:17.317+0000 7fd649bf8640 1 -- 172.21.15.49:0/1283676949 wait complete. 2024-09-21T06:28:17.881 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:17 smithi049 ceph-mon[31177]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:17.881 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:17 smithi049 ceph-mon[31177]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:17.882 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:17 smithi049 ceph-mon[31177]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:28:17.882 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:17 smithi049 ceph-mon[31177]: Deploying daemon mgr.z on smithi098 2024-09-21T06:28:17.882 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:17 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1283676949' entity='client.admin' 2024-09-21T06:28:17.988 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:17 smithi098 ceph-mon[34704]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:17.988 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:17 smithi098 ceph-mon[34704]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:17.988 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:17 smithi098 ceph-mon[34704]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:28:17.988 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:17 smithi098 ceph-mon[34704]: Deploying daemon mgr.z on smithi098 2024-09-21T06:28:17.988 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:17 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1283676949' entity='client.admin' 2024-09-21T06:28:18.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:17 smithi079 ceph-mon[34346]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:28:18.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:17 smithi079 ceph-mon[34346]: Updating smithi049:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:28:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:17 smithi079 ceph-mon[34346]: Updating smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:28:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:17 smithi079 ceph-mon[34346]: Deploying daemon mgr.z on smithi098 2024-09-21T06:28:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:17 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1283676949' entity='client.admin' 2024-09-21T06:28:18.184 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi049') 2024-09-21T06:28:18.185 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi049') 2024-09-21T06:28:18.209 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:18.295 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:28:18 smithi098 systemd[1]: Starting Ceph mgr.z for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:28:18.557 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi049') 2024-09-21T06:28:18.671 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:18.674 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:28:18 smithi098 podman[36559]: 2024-09-21 06:28:18.407490969 +0000 UTC m=+0.110431079 container create 50c71a99bb5461907f9f39c33abba9a7df203a1965350365b5a457b8fc3d3a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:28:18.674 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:28:18 smithi098 podman[36559]: 2024-09-21 06:28:18.313442036 +0000 UTC m=+0.016382161 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:28:18.674 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:28:18 smithi098 podman[36559]: 2024-09-21 06:28:18.635083461 +0000 UTC m=+0.338023576 container init 50c71a99bb5461907f9f39c33abba9a7df203a1965350365b5a457b8fc3d3a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T06:28:18.674 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:28:18 smithi098 podman[36559]: 2024-09-21 06:28:18.638009946 +0000 UTC m=+0.340950067 container start 50c71a99bb5461907f9f39c33abba9a7df203a1965350365b5a457b8fc3d3a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-z, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:28:18.675 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:28:18 smithi098 ceph-mgr[36578]: -- 172.21.15.98:0/1215179626 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562e18a950e0 con 0x562e18ab3a80 2024-09-21T06:28:18.728 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.045 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:28:18 smithi098 bash[36559]: 50c71a99bb5461907f9f39c33abba9a7df203a1965350365b5a457b8fc3d3a99 2024-09-21T06:28:19.046 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:28:18 smithi098 systemd[1]: Started Ceph mgr.z for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:28:19.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.154+0000 7f75d411b640 1 -- 172.21.15.49:0/3228376166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc1083a0 msgr2=0x7f75cc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.154+0000 7f75d411b640 1 --2- 172.21.15.49:0/3228376166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc1083a0 0x7f75cc1087b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009900 tx=0x7f75c002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.154+0000 7f75d411b640 1 -- 172.21.15.49:0/3228376166 shutdown_connections 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.154+0000 7f75d411b640 1 --2- 172.21.15.49:0/3228376166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75cc108cf0 0x7f75cc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.154+0000 7f75d411b640 1 --2- 172.21.15.49:0/3228376166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc1083a0 0x7f75cc1087b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.154+0000 7f75d411b640 1 --2- 172.21.15.49:0/3228376166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75cc102a60 0x7f75cc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.154+0000 7f75d411b640 1 -- 172.21.15.49:0/3228376166 >> 172.21.15.49:0/3228376166 conn(0x7f75cc079730 msgr2=0x7f75cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.154+0000 7f75d411b640 1 -- 172.21.15.49:0/3228376166 shutdown_connections 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.154+0000 7f75d411b640 1 -- 172.21.15.49:0/3228376166 wait complete. 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.155+0000 7f75d411b640 1 Processor -- start 2024-09-21T06:28:19.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.155+0000 7f75d411b640 1 -- start start 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.155+0000 7f75d411b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc102a60 0x7f75cc10ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.155+0000 7f75d411b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75cc1083a0 0x7f75cc1104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.155+0000 7f75d411b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75cc108cf0 0x7f75cc110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.155+0000 7f75d411b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc113840 con 0x7f75cc102a60 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.155+0000 7f75d411b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc1136c0 con 0x7f75cc108cf0 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.155+0000 7f75d411b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f75cc1139c0 con 0x7f75cc1083a0 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d1eb7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc102a60 0x7f75cc10ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d1eb7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc102a60 0x7f75cc10ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48734/0 (socket says 172.21.15.49:48734) 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d1eb7640 1 -- 172.21.15.49:0/4268147208 learned_addr learned my addr 172.21.15.49:0/4268147208 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d26b8640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75cc108cf0 0x7f75cc110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d16b6640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75cc1083a0 0x7f75cc1104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d1eb7640 1 -- 172.21.15.49:0/4268147208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75cc1083a0 msgr2=0x7f75cc1104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d1eb7640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75cc1083a0 0x7f75cc1104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d1eb7640 1 -- 172.21.15.49:0/4268147208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75cc108cf0 msgr2=0x7f75cc110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d1eb7640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75cc108cf0 0x7f75cc110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d1eb7640 1 -- 172.21.15.49:0/4268147208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75cc1a8610 con 0x7f75cc102a60 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d1eb7640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc102a60 0x7f75cc10ffb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00ebc0 tx=0x7f75bc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75caffd640 1 -- 172.21.15.49:0/4268147208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc010630 con 0x7f75cc102a60 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75caffd640 1 -- 172.21.15.49:0/4268147208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f75bc010c40 con 0x7f75cc102a60 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75cc1a8900 con 0x7f75cc102a60 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75caffd640 1 -- 172.21.15.49:0/4268147208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0189b0 con 0x7f75cc102a60 2024-09-21T06:28:19.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.156+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75cc1a8e10 con 0x7f75cc102a60 2024-09-21T06:28:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.157+0000 7f75caffd640 1 -- 172.21.15.49:0/4268147208 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f75bc0107d0 con 0x7f75cc102a60 2024-09-21T06:28:19.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.157+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75cc102e70 con 0x7f75cc102a60 2024-09-21T06:28:19.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.158+0000 7f75caffd640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75b403fb70 0x7f75b4042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.158+0000 7f75caffd640 1 -- 172.21.15.49:0/4268147208 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f75bc054d20 con 0x7f75cc102a60 2024-09-21T06:28:19.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.158+0000 7f75d16b6640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75b403fb70 0x7f75b4042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.158+0000 7f75d16b6640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75b403fb70 0x7f75b4042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75c0000c00 tx=0x7f75c0031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:19.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.163+0000 7f75caffd640 1 -- 172.21.15.49:0/4268147208 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75bc00fe10 con 0x7f75cc102a60 2024-09-21T06:28:19.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.355+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f75cc10aae0 con 0x7f75cc102a60 2024-09-21T06:28:19.363 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.367 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.369 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.372 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.372+0000 7f75caffd640 1 -- 172.21.15.49:0/4268147208 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f75bc0178f0 con 0x7f75cc102a60 2024-09-21T06:28:19.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.372+0000 7f75caffd640 1 -- 172.21.15.49:0/4268147208 <== mon.0 v2:172.21.15.49:3300/0 8 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f75bc058030 con 0x7f75cc102a60 2024-09-21T06:28:19.376 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.383 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.380+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75b403fb70 msgr2=0x7f75b4042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.380+0000 7f75d411b640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75b403fb70 0x7f75b4042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f75c0000c00 tx=0x7f75c0031400 comp rx=0 tx=0).stop 2024-09-21T06:28:19.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.380+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc102a60 msgr2=0x7f75cc10ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.380+0000 7f75d411b640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc102a60 0x7f75cc10ffb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00ebc0 tx=0x7f75bc00c6a0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.384+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 shutdown_connections 2024-09-21T06:28:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.384+0000 7f75d411b640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75b403fb70 0x7f75b4042080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.384+0000 7f75d411b640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75cc108cf0 0x7f75cc110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.384+0000 7f75d411b640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75cc1083a0 0x7f75cc1104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.384+0000 7f75d411b640 1 --2- 172.21.15.49:0/4268147208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75cc102a60 0x7f75cc10ffb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.384+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 >> 172.21.15.49:0/4268147208 conn(0x7f75cc079730 msgr2=0x7f75cc104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:19.388 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.390+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 shutdown_connections 2024-09-21T06:28:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.390+0000 7f75d411b640 1 -- 172.21.15.49:0/4268147208 wait complete. 2024-09-21T06:28:19.713 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:19.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.582+0000 7f6ec6444640 1 -- 172.21.15.49:0/3324413591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 msgr2=0x7f6ec0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.582+0000 7f6ec6444640 1 --2- 172.21.15.49:0/3324413591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 0x7f6ec0110620 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009ca0 tx=0x7f6eb802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.582+0000 7f6ec6444640 1 -- 172.21.15.49:0/3324413591 shutdown_connections 2024-09-21T06:28:19.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.582+0000 7f6ec6444640 1 --2- 172.21.15.49:0/3324413591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 0x7f6ec0110620 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.582+0000 7f6ec6444640 1 --2- 172.21.15.49:0/3324413591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ec01094a0 0x7f6ec01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.582+0000 7f6ec6444640 1 --2- 172.21.15.49:0/3324413591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ec0103b60 0x7f6ec0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.583+0000 7f6ec6444640 1 -- 172.21.15.49:0/3324413591 >> 172.21.15.49:0/3324413591 conn(0x7f6ec007b850 msgr2=0x7f6ec007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:19.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.583+0000 7f6ec6444640 1 -- 172.21.15.49:0/3324413591 shutdown_connections 2024-09-21T06:28:19.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.583+0000 7f6ec6444640 1 -- 172.21.15.49:0/3324413591 wait complete. 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.583+0000 7f6ec6444640 1 Processor -- start 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.583+0000 7f6ec6444640 1 -- start start 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec6444640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ec0103b60 0x7f6ec019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec6444640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ec01094a0 0x7f6ec019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec6444640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 0x7f6ec019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec6444640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec0113990 con 0x7f6ec0109df0 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec6444640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec0113810 con 0x7f6ec0103b60 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec6444640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec0113b10 con 0x7f6ec01094a0 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec49e1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 0x7f6ec019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ebffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ec0103b60 0x7f6ec019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec49e1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 0x7f6ec019fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48748/0 (socket says 172.21.15.49:48748) 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec49e1640 1 -- 172.21.15.49:0/435987676 learned_addr learned my addr 172.21.15.49:0/435987676 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:19.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ebf7fe640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ec01094a0 0x7f6ec019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec49e1640 1 -- 172.21.15.49:0/435987676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ec01094a0 msgr2=0x7f6ec019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec49e1640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ec01094a0 0x7f6ec019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec49e1640 1 -- 172.21.15.49:0/435987676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ec0103b60 msgr2=0x7f6ec019a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec49e1640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ec0103b60 0x7f6ec019a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec49e1640 1 -- 172.21.15.49:0/435987676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec01a02d0 con 0x7f6ec0109df0 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ebf7fe640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ec01094a0 0x7f6ec019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ebffff640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ec0103b60 0x7f6ec019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ec49e1640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 0x7f6ec019fba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8006010 tx=0x7f6eb80093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.584+0000 7f6ebd7fa640 1 -- 172.21.15.49:0/435987676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8003b70 con 0x7f6ec0109df0 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.585+0000 7f6ebd7fa640 1 -- 172.21.15.49:0/435987676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6eb8003d10 con 0x7f6ec0109df0 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.585+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec01a0560 con 0x7f6ec0109df0 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.585+0000 7f6ebd7fa640 1 -- 172.21.15.49:0/435987676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8004600 con 0x7f6ec0109df0 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.585+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec01a6d20 con 0x7f6ec0109df0 2024-09-21T06:28:19.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.586+0000 7f6ebd7fa640 1 -- 172.21.15.49:0/435987676 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f6eb804d440 con 0x7f6ec0109df0 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.586+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec0103f70 con 0x7f6ec0109df0 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.586+0000 7f6ebd7fa640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eac03fb70 0x7f6eac042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.586+0000 7f6ebd7fa640 1 -- 172.21.15.49:0/435987676 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6eb8075590 con 0x7f6ec0109df0 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.586+0000 7f6ebffff640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eac03fb70 0x7f6eac042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.587+0000 7f6ebffff640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eac03fb70 0x7f6eac042080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009fc0 tx=0x7f6eb0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.591+0000 7f6ebd7fa640 1 -- 172.21.15.49:0/435987676 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6eb8039560 con 0x7f6ec0109df0 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.790+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f6ec010bbe0 con 0x7f6ec0109df0 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.792+0000 7f6ebd7fa640 1 -- 172.21.15.49:0/435987676 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v14)=0 v14) ==== 119+0+0 (secure 0 0 0) 0x7f6eb8030ba0 con 0x7f6ec0109df0 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eac03fb70 msgr2=0x7f6eac042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eac03fb70 0x7f6eac042080 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0009fc0 tx=0x7f6eb0005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 msgr2=0x7f6ec019fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 0x7f6ec019fba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8006010 tx=0x7f6eb80093d0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 shutdown_connections 2024-09-21T06:28:19.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eac03fb70 0x7f6eac042080 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ec0109df0 0x7f6ec019fba0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ec01094a0 0x7f6ec019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 --2- 172.21.15.49:0/435987676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ec0103b60 0x7f6ec019a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:19.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 >> 172.21.15.49:0/435987676 conn(0x7f6ec007b850 msgr2=0x7f6ec0107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:19.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 shutdown_connections 2024-09-21T06:28:19.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:19.795+0000 7f6ec6444640 1 -- 172.21.15.49:0/435987676 wait complete. 2024-09-21T06:28:19.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:28:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:28:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:28:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:19 smithi049 ceph-mon[31177]: Deploying daemon mgr.y on smithi079 2024-09-21T06:28:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:19 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4268147208' entity='client.admin' 2024-09-21T06:28:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:28:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:28:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:28:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:19 smithi098 ceph-mon[34704]: Deploying daemon mgr.y on smithi079 2024-09-21T06:28:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:19 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4268147208' entity='client.admin' 2024-09-21T06:28:20.052 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:20.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:20.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:20.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:28:20.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:28:20.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:28:20.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:20.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:19 smithi079 ceph-mon[34346]: Deploying daemon mgr.y on smithi079 2024-09-21T06:28:20.053 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:19 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4268147208' entity='client.admin' 2024-09-21T06:28:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.220+0000 7fafd82bf640 1 -- 172.21.15.49:0/4117068525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0102a60 msgr2=0x7fafd0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.220+0000 7fafd82bf640 1 --2- 172.21.15.49:0/4117068525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0102a60 0x7fafd0102e70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fafcc009900 tx=0x7fafcc02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.220+0000 7fafd82bf640 1 -- 172.21.15.49:0/4117068525 shutdown_connections 2024-09-21T06:28:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.220+0000 7fafd82bf640 1 --2- 172.21.15.49:0/4117068525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafd0108cf0 0x7fafd010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.220+0000 7fafd82bf640 1 --2- 172.21.15.49:0/4117068525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd01083a0 0x7fafd01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.220+0000 7fafd82bf640 1 --2- 172.21.15.49:0/4117068525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0102a60 0x7fafd0102e70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.220+0000 7fafd82bf640 1 -- 172.21.15.49:0/4117068525 >> 172.21.15.49:0/4117068525 conn(0x7fafd0079730 msgr2=0x7fafd0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.220+0000 7fafd82bf640 1 -- 172.21.15.49:0/4117068525 shutdown_connections 2024-09-21T06:28:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.220+0000 7fafd82bf640 1 -- 172.21.15.49:0/4117068525 wait complete. 2024-09-21T06:28:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd82bf640 1 Processor -- start 2024-09-21T06:28:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd82bf640 1 -- start start 2024-09-21T06:28:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd82bf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd0102a60 0x7fafd019a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd82bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafd01083a0 0x7fafd019a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd82bf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0108cf0 0x7fafd019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd82bf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0113990 con 0x7fafd0108cf0 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd82bf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0113810 con 0x7fafd01083a0 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd82bf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0113b10 con 0x7fafd0102a60 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd685c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0108cf0 0x7fafd019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd605b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd0102a60 0x7fafd019a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd685c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0108cf0 0x7fafd019fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48772/0 (socket says 172.21.15.49:48772) 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd685c640 1 -- 172.21.15.49:0/3909374952 learned_addr learned my addr 172.21.15.49:0/3909374952 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.221+0000 7fafd585a640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafd01083a0 0x7fafd019a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafd605b640 1 -- 172.21.15.49:0/3909374952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafd01083a0 msgr2=0x7fafd019a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafd605b640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafd01083a0 0x7fafd019a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafd605b640 1 -- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0108cf0 msgr2=0x7fafd019fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafd605b640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0108cf0 0x7fafd019fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafd605b640 1 -- 172.21.15.49:0/3909374952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd01a02d0 con 0x7fafd0102a60 2024-09-21T06:28:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafd685c640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0108cf0 0x7fafd019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafd605b640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd0102a60 0x7fafd019a360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fafcc02a930 tx=0x7fafcc003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafc77fe640 1 -- 172.21.15.49:0/3909374952 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc03f070 con 0x7fafd0102a60 2024-09-21T06:28:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafc77fe640 1 -- 172.21.15.49:0/3909374952 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fafcc03baf0 con 0x7fafd0102a60 2024-09-21T06:28:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd01a0560 con 0x7fafd0102a60 2024-09-21T06:28:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafc77fe640 1 -- 172.21.15.49:0/3909374952 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafcc035030 con 0x7fafd0102a60 2024-09-21T06:28:20.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.222+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd01a6d20 con 0x7fafd0102a60 2024-09-21T06:28:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.223+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd0102e70 con 0x7fafd0102a60 2024-09-21T06:28:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.223+0000 7fafc77fe640 1 -- 172.21.15.49:0/3909374952 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7fafcc042070 con 0x7fafd0102a60 2024-09-21T06:28:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.223+0000 7fafc77fe640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafbc03fb70 0x7fafbc042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.223+0000 7fafc77fe640 1 -- 172.21.15.49:0/3909374952 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fafcc074d40 con 0x7fafd0102a60 2024-09-21T06:28:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.224+0000 7fafd585a640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafbc03fb70 0x7fafbc042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:20.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.224+0000 7fafd585a640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafbc03fb70 0x7fafbc042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fafd0100cc0 tx=0x7fafc0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.229+0000 7fafc77fe640 1 -- 172.21.15.49:0/3909374952 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fafcc045d70 con 0x7fafd0102a60 2024-09-21T06:28:20.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.420+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fafd010aac0 con 0x7fafd0102a60 2024-09-21T06:28:20.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.425+0000 7fafc77fe640 1 -- 172.21.15.49:0/3909374952 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v15)=0 v15) ==== 108+0+0 (secure 0 0 0) 0x7fafcc031400 con 0x7fafd0102a60 2024-09-21T06:28:20.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafbc03fb70 msgr2=0x7fafbc042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafbc03fb70 0x7fafbc042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fafd0100cc0 tx=0x7fafc0005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:20.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd0102a60 msgr2=0x7fafd019a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:20.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd0102a60 0x7fafd019a360 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fafcc02a930 tx=0x7fafcc003b90 comp rx=0 tx=0).stop 2024-09-21T06:28:20.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 shutdown_connections 2024-09-21T06:28:20.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafbc03fb70 0x7fafbc042080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fafd0108cf0 0x7fafd019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fafd01083a0 0x7fafd019a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 --2- 172.21.15.49:0/3909374952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fafd0102a60 0x7fafd019a360 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:20.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 >> 172.21.15.49:0/3909374952 conn(0x7fafd0079730 msgr2=0x7fafd01013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:20.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 shutdown_connections 2024-09-21T06:28:20.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:20.428+0000 7fafd82bf640 1 -- 172.21.15.49:0/3909374952 wait complete. 2024-09-21T06:28:20.568 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:28:20 smithi079 systemd[1]: Starting Ceph mgr.y for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:28:20.948 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:20 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/435987676' entity='client.admin' 2024-09-21T06:28:20.949 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:20 smithi079 ceph-mon[34346]: from='client.? ' entity='client.admin' 2024-09-21T06:28:20.949 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:28:20 smithi079 podman[35851]: 2024-09-21 06:28:20.687018967 +0000 UTC m=+0.110184427 container create 6a90bda024ddf396efd7665f94890019e881598ad0a887070c42a1c507f14920 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T06:28:20.949 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:28:20 smithi079 podman[35851]: 2024-09-21 06:28:20.592158678 +0000 UTC m=+0.015324137 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:28:20.949 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:28:20 smithi079 podman[35851]: 2024-09-21 06:28:20.881027032 +0000 UTC m=+0.304192500 container init 6a90bda024ddf396efd7665f94890019e881598ad0a887070c42a1c507f14920 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-y, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T06:28:20.949 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:28:20 smithi079 podman[35851]: 2024-09-21 06:28:20.883832492 +0000 UTC m=+0.306997953 container start 6a90bda024ddf396efd7665f94890019e881598ad0a887070c42a1c507f14920 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-y, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T06:28:20.949 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:28:20 smithi079 ceph-mgr[35870]: -- 172.21.15.79:0/1146959169 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa1e0a70e0 con 0x55fa22e4a000 2024-09-21T06:28:20.949 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:28:20 smithi079 bash[35851]: 6a90bda024ddf396efd7665f94890019e881598ad0a887070c42a1c507f14920 2024-09-21T06:28:21.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:20 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/435987676' entity='client.admin' 2024-09-21T06:28:21.062 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:20 smithi098 ceph-mon[34704]: from='client.? ' entity='client.admin' 2024-09-21T06:28:21.135 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:20 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/435987676' entity='client.admin' 2024-09-21T06:28:21.135 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:20 smithi049 ceph-mon[31177]: from='client.? ' entity='client.admin' 2024-09-21T06:28:21.165 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:21.183 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:21.318 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:28:20 smithi079 systemd[1]: Started Ceph mgr.y for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:28:22.098 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.098 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.098 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.098 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.099 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:22.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:22.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:22.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.876+0000 7f450d59a640 1 -- 172.21.15.49:0/1352442741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 msgr2=0x7f4508103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.876+0000 7f450d59a640 1 --2- 172.21.15.49:0/1352442741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 0x7f4508103fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009900 tx=0x7f44f802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.876+0000 7f450d59a640 1 -- 172.21.15.49:0/1352442741 shutdown_connections 2024-09-21T06:28:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.876+0000 7f450d59a640 1 --2- 172.21.15.49:0/1352442741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4508109e20 0x7f4508110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.876+0000 7f450d59a640 1 --2- 172.21.15.49:0/1352442741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45081094d0 0x7f45081098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.876+0000 7f450d59a640 1 --2- 172.21.15.49:0/1352442741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 0x7f4508103fa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.876+0000 7f450d59a640 1 -- 172.21.15.49:0/1352442741 >> 172.21.15.49:0/1352442741 conn(0x7f45080ff5e0 msgr2=0x7f4508101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.876+0000 7f450d59a640 1 -- 172.21.15.49:0/1352442741 shutdown_connections 2024-09-21T06:28:22.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.876+0000 7f450d59a640 1 -- 172.21.15.49:0/1352442741 wait complete. 2024-09-21T06:28:22.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.877+0000 7f450d59a640 1 Processor -- start 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.877+0000 7f450d59a640 1 -- start start 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.877+0000 7f450d59a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 0x7f450819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.877+0000 7f450d59a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45081094d0 0x7f450819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.877+0000 7f450d59a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4508109e20 0x7f450819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.877+0000 7f450d59a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f45081139c0 con 0x7f4508103b90 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.877+0000 7f450d59a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4508113840 con 0x7f4508109e20 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.877+0000 7f450d59a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4508113b40 con 0x7f45081094d0 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f4506ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 0x7f450819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f4506ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 0x7f450819a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48856/0 (socket says 172.21.15.49:48856) 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f4506ffd640 1 -- 172.21.15.49:0/2712681967 learned_addr learned my addr 172.21.15.49:0/2712681967 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:22.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f45067fc640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45081094d0 0x7f450819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f45077fe640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4508109e20 0x7f450819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f4506ffd640 1 -- 172.21.15.49:0/2712681967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45081094d0 msgr2=0x7f450819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f4506ffd640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45081094d0 0x7f450819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f4506ffd640 1 -- 172.21.15.49:0/2712681967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4508109e20 msgr2=0x7f450819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f4506ffd640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4508109e20 0x7f450819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f4506ffd640 1 -- 172.21.15.49:0/2712681967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45081a0360 con 0x7f4508103b90 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f4506ffd640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 0x7f450819a3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f44f8006010 tx=0x7f44f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f44effff640 1 -- 172.21.15.49:0/2712681967 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f803f030 con 0x7f4508103b90 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f44effff640 1 -- 172.21.15.49:0/2712681967 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f44f8003c90 con 0x7f4508103b90 2024-09-21T06:28:22.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45081a05f0 con 0x7f4508103b90 2024-09-21T06:28:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f44effff640 1 -- 172.21.15.49:0/2712681967 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44f8035070 con 0x7f4508103b90 2024-09-21T06:28:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.878+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45080755f0 con 0x7f4508103b90 2024-09-21T06:28:22.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.879+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4508104e10 con 0x7f4508103b90 2024-09-21T06:28:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.879+0000 7f44effff640 1 -- 172.21.15.49:0/2712681967 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f44f8042030 con 0x7f4508103b90 2024-09-21T06:28:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.880+0000 7f44effff640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f44f003fb70 0x7f44f0042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.880+0000 7f44effff640 1 -- 172.21.15.49:0/2712681967 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f44f8074e50 con 0x7f4508103b90 2024-09-21T06:28:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.880+0000 7f45067fc640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f44f003fb70 0x7f44f0042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:22.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.880+0000 7f45067fc640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f44f003fb70 0x7f44f0042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45081090b0 tx=0x7f44fc00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:22.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.885+0000 7f44effff640 1 -- 172.21.15.49:0/2712681967 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f44f80303a0 con 0x7f4508103b90 2024-09-21T06:28:23.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.077+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f450810bba0 con 0x7f4508103b90 2024-09-21T06:28:23.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.077+0000 7f44effff640 1 -- 172.21.15.49:0/2712681967 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v18)=0 v18) ==== 106+0+0 (secure 0 0 0) 0x7f44f803b460 con 0x7f4508103b90 2024-09-21T06:28:23.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f44f003fb70 msgr2=0x7f44f0042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f44f003fb70 0x7f44f0042080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f45081090b0 tx=0x7f44fc00b390 comp rx=0 tx=0).stop 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 msgr2=0x7f450819a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 0x7f450819a3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f44f8006010 tx=0x7f44f80042f0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 shutdown_connections 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f44f003fb70 0x7f44f0042080 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4508109e20 0x7f450819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f45081094d0 0x7f450819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 --2- 172.21.15.49:0/2712681967 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4508103b90 0x7f450819a3f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 >> 172.21.15.49:0/2712681967 conn(0x7f45080ff5e0 msgr2=0x7f4508101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 shutdown_connections 2024-09-21T06:28:23.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:23.080+0000 7f450d59a640 1 -- 172.21.15.49:0/2712681967 wait complete. 2024-09-21T06:28:23.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.096+0000 7fc66c537640 1 -- 172.21.15.49:0/3496108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 msgr2=0x7fc66410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.096+0000 7fc66c537640 1 --2- 172.21.15.49:0/3496108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 0x7fc66410f540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009900 tx=0x7fc65c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:23.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.096+0000 7fc66c537640 1 -- 172.21.15.49:0/3496108442 shutdown_connections 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.096+0000 7fc66c537640 1 --2- 172.21.15.49:0/3496108442 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 0x7fc66410f540 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.096+0000 7fc66c537640 1 --2- 172.21.15.49:0/3496108442 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc6641083c0 0x7fc6641087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.096+0000 7fc66c537640 1 --2- 172.21.15.49:0/3496108442 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc664102a80 0x7fc664102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.096+0000 7fc66c537640 1 -- 172.21.15.49:0/3496108442 >> 172.21.15.49:0/3496108442 conn(0x7fc664079740 msgr2=0x7fc664079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.096+0000 7fc66c537640 1 -- 172.21.15.49:0/3496108442 shutdown_connections 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.096+0000 7fc66c537640 1 -- 172.21.15.49:0/3496108442 wait complete. 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66c537640 1 Processor -- start 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66c537640 1 -- start start 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66c537640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc664102a80 0x7fc66410ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66c537640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6641083c0 0x7fc664110510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66c537640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 0x7fc664110a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66c537640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc664113980 con 0x7fc664108d10 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66c537640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc664113800 con 0x7fc6641083c0 2024-09-21T06:28:23.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66c537640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc664113b00 con 0x7fc664102a80 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66aad4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 0x7fc664110a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66aad4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 0x7fc664110a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48800/0 (socket says 172.21.15.49:48800) 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66aad4640 1 -- 172.21.15.49:0/2507640552 learned_addr learned my addr 172.21.15.49:0/2507640552 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc669ad2640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6641083c0 0x7fc664110510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.097+0000 7fc66a2d3640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc664102a80 0x7fc66410ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc66aad4640 1 -- 172.21.15.49:0/2507640552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc664102a80 msgr2=0x7fc66410ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc66aad4640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc664102a80 0x7fc66410ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc66aad4640 1 -- 172.21.15.49:0/2507640552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6641083c0 msgr2=0x7fc664110510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc66aad4640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6641083c0 0x7fc664110510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc66aad4640 1 -- 172.21.15.49:0/2507640552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6641a8690 con 0x7fc664108d10 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc66aad4640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 0x7fc664110a50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc65c005ab0 tx=0x7fc65c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc6637fe640 1 -- 172.21.15.49:0/2507640552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c03f030 con 0x7fc664108d10 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6641a8920 con 0x7fc664108d10 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc6637fe640 1 -- 172.21.15.49:0/2507640552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fc65c003a80 con 0x7fc664108d10 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc6637fe640 1 -- 172.21.15.49:0/2507640552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65c035070 con 0x7fc664108d10 2024-09-21T06:28:23.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.098+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6641a8e00 con 0x7fc664108d10 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.099+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc664103d00 con 0x7fc664108d10 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.099+0000 7fc6637fe640 1 -- 172.21.15.49:0/2507640552 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7fc65c042030 con 0x7fc664108d10 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.100+0000 7fc6637fe640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc64c03fb70 0x7fc64c042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.100+0000 7fc6637fe640 1 -- 172.21.15.49:0/2507640552 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fc65c074d70 con 0x7fc664108d10 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.100+0000 7fc66a2d3640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc64c03fb70 0x7fc64c042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.100+0000 7fc66a2d3640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc64c03fb70 0x7fc64c042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc664111a20 tx=0x7fc654009760 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.107+0000 7fc6637fe640 1 -- 172.21.15.49:0/2507640552 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc65c0303a0 con 0x7fc664108d10 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.384+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fc66410ab00 con 0x7fc664108d10 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.389+0000 7fc6637fe640 1 -- 172.21.15.49:0/2507640552 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v16)=0 v16) ==== 138+0+0 (secure 0 0 0) 0x7fc65c003ca0 con 0x7fc664108d10 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc64c03fb70 msgr2=0x7fc64c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc64c03fb70 0x7fc64c042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc664111a20 tx=0x7fc654009760 comp rx=0 tx=0).stop 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 msgr2=0x7fc664110a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 0x7fc664110a50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc65c005ab0 tx=0x7fc65c004270 comp rx=0 tx=0).stop 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 shutdown_connections 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc64c03fb70 0x7fc64c042080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc664108d10 0x7fc664110a50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc6641083c0 0x7fc664110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 --2- 172.21.15.49:0/2507640552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc664102a80 0x7fc66410ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 >> 172.21.15.49:0/2507640552 conn(0x7fc664079740 msgr2=0x7fc664105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 shutdown_connections 2024-09-21T06:28:23.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.392+0000 7fc66c537640 1 -- 172.21.15.49:0/2507640552 wait complete. 2024-09-21T06:28:23.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.200+0000 7fe641528640 1 -- 172.21.15.49:0/3272440416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe63c105340 msgr2=0x7fe63c10d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.200+0000 7fe641528640 1 --2- 172.21.15.49:0/3272440416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe63c105340 0x7fe63c10d890 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe630009900 tx=0x7fe63002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:23.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.200+0000 7fe641528640 1 -- 172.21.15.49:0/3272440416 shutdown_connections 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.200+0000 7fe641528640 1 --2- 172.21.15.49:0/3272440416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe63c10de50 0x7fe63c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.201+0000 7fe641528640 1 --2- 172.21.15.49:0/3272440416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe63c105340 0x7fe63c10d890 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.201+0000 7fe641528640 1 --2- 172.21.15.49:0/3272440416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63c1049f0 0x7fe63c104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.201+0000 7fe641528640 1 -- 172.21.15.49:0/3272440416 >> 172.21.15.49:0/3272440416 conn(0x7fe63c0797e0 msgr2=0x7fe63c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.201+0000 7fe641528640 1 -- 172.21.15.49:0/3272440416 shutdown_connections 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.201+0000 7fe641528640 1 -- 172.21.15.49:0/3272440416 wait complete. 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.201+0000 7fe641528640 1 Processor -- start 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe641528640 1 -- start start 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe641528640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe63c1049f0 0x7fe63c102730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe641528640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe63c105340 0x7fe63c102c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe641528640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63c10de50 0x7fe63c1031b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe641528640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113990 con 0x7fe63c1049f0 2024-09-21T06:28:23.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe641528640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113810 con 0x7fe63c10de50 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe641528640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c113b10 con 0x7fe63c105340 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe63c1049f0 0x7fe63c102730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63a7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe63c105340 0x7fe63c102c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63a7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe63c105340 0x7fe63c102c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:48018/0 (socket says 172.21.15.49:48018) 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63a7fc640 1 -- 172.21.15.49:0/3401764472 learned_addr learned my addr 172.21.15.49:0/3401764472 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63b7fe640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63c10de50 0x7fe63c1031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63affd640 1 -- 172.21.15.49:0/3401764472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe63c105340 msgr2=0x7fe63c102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63affd640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe63c105340 0x7fe63c102c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63affd640 1 -- 172.21.15.49:0/3401764472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63c10de50 msgr2=0x7fe63c1031b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63affd640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63c10de50 0x7fe63c1031b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.202+0000 7fe63affd640 1 -- 172.21.15.49:0/3401764472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c1a8680 con 0x7fe63c1049f0 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.203+0000 7fe63a7fc640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe63c105340 0x7fe63c102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.203+0000 7fe63b7fe640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63c10de50 0x7fe63c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:23.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.203+0000 7fe63affd640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe63c1049f0 0x7fe63c102730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00e9c0 tx=0x7fe62c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.203+0000 7fe623fff640 1 -- 172.21.15.49:0/3401764472 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c00cd80 con 0x7fe63c1049f0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.203+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63c1a8970 con 0x7fe63c1049f0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.203+0000 7fe623fff640 1 -- 172.21.15.49:0/3401764472 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe62c0108c0 con 0x7fe63c1049f0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.203+0000 7fe623fff640 1 -- 172.21.15.49:0/3401764472 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe62c0187b0 con 0x7fe63c1049f0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.203+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63c1a8f00 con 0x7fe63c1049f0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.204+0000 7fe623fff640 1 -- 172.21.15.49:0/3401764472 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7fe62c01f020 con 0x7fe63c1049f0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.204+0000 7fe623fff640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe62403fb70 0x7fe624042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.204+0000 7fe623fff640 1 -- 172.21.15.49:0/3401764472 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe62c0553f0 con 0x7fe63c1049f0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.204+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63c104e00 con 0x7fe63c1049f0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.205+0000 7fe63a7fc640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe62403fb70 0x7fe624042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.205+0000 7fe63a7fc640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe62403fb70 0x7fe624042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe63c102470 tx=0x7fe6300058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.210+0000 7fe623fff640 1 -- 172.21.15.49:0/3401764472 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe62c010d90 con 0x7fe63c1049f0 2024-09-21T06:28:23.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.473+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fe63c108f50 con 0x7fe63c1049f0 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.476+0000 7fe623fff640 1 -- 172.21.15.49:0/3401764472 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) ==== 106+0+0 (secure 0 0 0) 0x7fe62c010a70 con 0x7fe63c1049f0 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe62403fb70 msgr2=0x7fe624042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe62403fb70 0x7fe624042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe63c102470 tx=0x7fe6300058d0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe63c1049f0 msgr2=0x7fe63c102730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe63c1049f0 0x7fe63c102730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe62c00e9c0 tx=0x7fe62c00ee80 comp rx=0 tx=0).stop 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 shutdown_connections 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe62403fb70 0x7fe624042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe63c10de50 0x7fe63c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe63c105340 0x7fe63c102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 --2- 172.21.15.49:0/3401764472 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe63c1049f0 0x7fe63c102730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 >> 172.21.15.49:0/3401764472 conn(0x7fe63c0797e0 msgr2=0x7fe63c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 shutdown_connections 2024-09-21T06:28:23.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.479+0000 7fe641528640 1 -- 172.21.15.49:0/3401764472 wait complete. 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:28:23.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:28:23.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:23.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: Reconfiguring daemon mgr.x on smithi049 2024-09-21T06:28:23.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2507640552' entity='client.admin' 2024-09-21T06:28:23.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3401764472' entity='client.admin' 2024-09-21T06:28:23.452 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:23 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3100359091' entity='client.admin' 2024-09-21T06:28:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:28:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:28:23.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:28:23.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:23.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: Reconfiguring daemon mgr.x on smithi049 2024-09-21T06:28:23.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2507640552' entity='client.admin' 2024-09-21T06:28:23.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3401764472' entity='client.admin' 2024-09-21T06:28:23.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:23 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3100359091' entity='client.admin' 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:28:23.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:23.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: Reconfiguring daemon mgr.x on smithi049 2024-09-21T06:28:23.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2507640552' entity='client.admin' 2024-09-21T06:28:23.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:23.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3401764472' entity='client.admin' 2024-09-21T06:28:23.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:23 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3100359091' entity='client.admin' 2024-09-21T06:28:23.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.333+0000 7f8075e86640 1 -- 172.21.15.49:0/3646859320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8070105300 msgr2=0x7f807010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.333+0000 7f8075e86640 1 --2- 172.21.15.49:0/3646859320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8070105300 0x7f807010d850 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8064009900 tx=0x7f806402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:23.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.333+0000 7f8075e86640 1 -- 172.21.15.49:0/3646859320 shutdown_connections 2024-09-21T06:28:23.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.333+0000 7f8075e86640 1 --2- 172.21.15.49:0/3646859320 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f807010de10 0x7f8070110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.333+0000 7f8075e86640 1 --2- 172.21.15.49:0/3646859320 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8070105300 0x7f807010d850 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.333+0000 7f8075e86640 1 --2- 172.21.15.49:0/3646859320 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80701049b0 0x7f8070104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.333+0000 7f8075e86640 1 -- 172.21.15.49:0/3646859320 >> 172.21.15.49:0/3646859320 conn(0x7f8070079730 msgr2=0x7f8070079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.333+0000 7f8075e86640 1 -- 172.21.15.49:0/3646859320 shutdown_connections 2024-09-21T06:28:23.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.333+0000 7f8075e86640 1 -- 172.21.15.49:0/3646859320 wait complete. 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.334+0000 7f8075e86640 1 Processor -- start 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.334+0000 7f8075e86640 1 -- start start 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f8075e86640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80701049b0 0x7f807019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f8075e86640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8070105300 0x7f807019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f8075e86640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807010de10 0x7f807019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f8075e86640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f80701139a0 con 0x7f8070105300 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f8075e86640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8070113820 con 0x7f80701049b0 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f8075e86640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8070113b20 con 0x7f807010de10 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8070105300 0x7f807019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8070105300 0x7f807019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48836/0 (socket says 172.21.15.49:48836) 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806effd640 1 -- 172.21.15.49:0/3100359091 learned_addr learned my addr 172.21.15.49:0/3100359091 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806ffff640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807010de10 0x7f807019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806f7fe640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80701049b0 0x7f807019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806effd640 1 -- 172.21.15.49:0/3100359091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807010de10 msgr2=0x7f807019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806effd640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807010de10 0x7f807019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806effd640 1 -- 172.21.15.49:0/3100359091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80701049b0 msgr2=0x7f807019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806effd640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80701049b0 0x7f807019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806effd640 1 -- 172.21.15.49:0/3100359091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80701a03c0 con 0x7f8070105300 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.335+0000 7f806ffff640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807010de10 0x7f807019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.336+0000 7f806effd640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8070105300 0x7f807019a9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f806402a930 tx=0x7f8064003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.336+0000 7f806cff9640 1 -- 172.21.15.49:0/3100359091 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806403f070 con 0x7f8070105300 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.336+0000 7f806cff9640 1 -- 172.21.15.49:0/3100359091 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f806403baf0 con 0x7f8070105300 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.336+0000 7f806cff9640 1 -- 172.21.15.49:0/3100359091 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8064035030 con 0x7f8070105300 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.336+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80701a0650 con 0x7f8070105300 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.336+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80701a6e10 con 0x7f8070105300 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.338+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807006b560 con 0x7f8070105300 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.338+0000 7f806cff9640 1 -- 172.21.15.49:0/3100359091 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 17) ==== 51915+0+0 (secure 0 0 0) 0x7f8064042070 con 0x7f8070105300 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.338+0000 7f806cff9640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f805803fb70 0x7f8058042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:23.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.338+0000 7f806cff9640 1 -- 172.21.15.49:0/3100359091 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8064074d80 con 0x7f8070105300 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.338+0000 7f806f7fe640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f805803fb70 0x7f8058042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.339+0000 7f806f7fe640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f805803fb70 0x7f8058042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8060005fd0 tx=0x7f806000b5b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.343+0000 7f806cff9640 1 -- 172.21.15.49:0/3100359091 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f80640433b0 con 0x7f8070105300 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.569+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f8070108f10 con 0x7f8070105300 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.572+0000 7f806cff9640 1 -- 172.21.15.49:0/3100359091 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f806403bca0 con 0x7f8070105300 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.575+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f805803fb70 msgr2=0x7f8058042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.575+0000 7f8075e86640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f805803fb70 0x7f8058042080 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8060005fd0 tx=0x7f806000b5b0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.575+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8070105300 msgr2=0x7f807019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.575+0000 7f8075e86640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8070105300 0x7f807019a9f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f806402a930 tx=0x7f8064003b90 comp rx=0 tx=0).stop 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.576+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 shutdown_connections 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.576+0000 7f8075e86640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f805803fb70 0x7f8058042080 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.576+0000 7f8075e86640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f807010de10 0x7f807019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.576+0000 7f8075e86640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8070105300 0x7f807019a9f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.576+0000 7f8075e86640 1 --2- 172.21.15.49:0/3100359091 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f80701049b0 0x7f807019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:23.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.576+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 >> 172.21.15.49:0/3100359091 conn(0x7f8070079730 msgr2=0x7f80700ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:23.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.576+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 shutdown_connections 2024-09-21T06:28:23.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:22.576+0000 7f8075e86640 1 -- 172.21.15.49:0/3100359091 wait complete. 2024-09-21T06:28:24.431 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:24 smithi049 ceph-mon[31177]: Standby manager daemon z started 2024-09-21T06:28:24.431 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:24 smithi049 ceph-mon[31177]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:28:24.431 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:24 smithi049 ceph-mon[31177]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:28:24.431 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:24 smithi049 ceph-mon[31177]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:28:24.431 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:24 smithi049 ceph-mon[31177]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:28:24.469 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:24 smithi079 ceph-mon[34346]: Standby manager daemon z started 2024-09-21T06:28:24.470 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:24 smithi079 ceph-mon[34346]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:28:24.470 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:24 smithi079 ceph-mon[34346]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:28:24.470 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:24 smithi079 ceph-mon[34346]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:28:24.470 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:24 smithi079 ceph-mon[34346]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:28:24.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:24 smithi098 ceph-mon[34704]: Standby manager daemon z started 2024-09-21T06:28:24.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:24 smithi098 ceph-mon[34704]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:28:24.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:24 smithi098 ceph-mon[34704]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:28:24.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:24 smithi098 ceph-mon[34704]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:28:24.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:24 smithi098 ceph-mon[34704]: from='mgr.? 172.21.15.98:0/1061909497' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:28:24.803 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:24.803 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:24.808 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:24.808 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:24.808 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:24.812 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:24.816 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.824+0000 7f48bf6cc640 1 -- 172.21.15.49:0/3864047319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b8112dc0 msgr2=0x7f48b81151e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.824+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/3864047319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b8112dc0 0x7f48b81151e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009860 tx=0x7f48a802a380 comp rx=0 tx=0).stop 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.824+0000 7f48bf6cc640 1 -- 172.21.15.49:0/3864047319 shutdown_connections 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.824+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/3864047319 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8115720 0x7f48b8117b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.824+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/3864047319 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b8112dc0 0x7f48b81151e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.824+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/3864047319 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48b810bff0 0x7f48b810c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.824+0000 7f48bf6cc640 1 -- 172.21.15.49:0/3864047319 >> 172.21.15.49:0/3864047319 conn(0x7f48b8070ec0 msgr2=0x7f48b80712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.825+0000 7f48bf6cc640 1 -- 172.21.15.49:0/3864047319 shutdown_connections 2024-09-21T06:28:24.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.825+0000 7f48bf6cc640 1 -- 172.21.15.49:0/3864047319 wait complete. 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.826+0000 7f48bf6cc640 1 Processor -- start 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.826+0000 7f48bf6cc640 1 -- start start 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.826+0000 7f48bf6cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b810bff0 0x7f48b81a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.826+0000 7f48bf6cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8112dc0 0x7f48b81a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.826+0000 7f48bd468640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b810bff0 0x7f48b81a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bd468640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b810bff0 0x7f48b81a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:52620/0 (socket says 172.21.15.49:52620) 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bd468640 1 -- 172.21.15.49:0/1919412547 learned_addr learned my addr 172.21.15.49:0/1919412547 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48b8115720 0x7f48b81a7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f48b811b090 con 0x7f48b8112dc0 2024-09-21T06:28:24.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48b811af10 con 0x7f48b810bff0 2024-09-21T06:28:24.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48b811b210 con 0x7f48b8115720 2024-09-21T06:28:24.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bcc67640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8112dc0 0x7f48b81a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bdc69640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48b8115720 0x7f48b81a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bcc67640 1 -- 172.21.15.49:0/1919412547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48b8115720 msgr2=0x7f48b81a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bcc67640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48b8115720 0x7f48b81a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bcc67640 1 -- 172.21.15.49:0/1919412547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b810bff0 msgr2=0x7f48b81a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bcc67640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b810bff0 0x7f48b81a19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.827+0000 7f48bcc67640 1 -- 172.21.15.49:0/1919412547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b81a7930 con 0x7f48b8112dc0 2024-09-21T06:28:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.828+0000 7f48bcc67640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8112dc0 0x7f48b81a1f60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009780 tx=0x7f48a8033cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.828+0000 7f48bd468640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b810bff0 0x7f48b81a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.828+0000 7f48ae7fc640 1 -- 172.21.15.49:0/1919412547 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8037040 con 0x7f48b8112dc0 2024-09-21T06:28:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.828+0000 7f48ae7fc640 1 -- 172.21.15.49:0/1919412547 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f48a8033e30 con 0x7f48b8112dc0 2024-09-21T06:28:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.828+0000 7f48ae7fc640 1 -- 172.21.15.49:0/1919412547 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8003a00 con 0x7f48b8112dc0 2024-09-21T06:28:24.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.829+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b81a7bc0 con 0x7f48b8112dc0 2024-09-21T06:28:24.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.832+0000 7f48ae7fc640 1 -- 172.21.15.49:0/1919412547 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 18) ==== 103194+0+0 (secure 0 0 0) 0x7f48a8044030 con 0x7f48b8112dc0 2024-09-21T06:28:24.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.833+0000 7f48ae7fc640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48a407f4d0 0x7f48a40819e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.833+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b81a7f60 con 0x7f48b8112dc0 2024-09-21T06:28:24.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.835+0000 7f48ae7fc640 1 -- 172.21.15.49:0/1919412547 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f48a8080bb0 con 0x7f48b8112dc0 2024-09-21T06:28:24.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.836+0000 7f48bd468640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48a407f4d0 0x7f48a40819e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.837+0000 7f48bd468640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48a407f4d0 0x7f48a40819e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009c10 tx=0x7f48b4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.837+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b81a2af0 con 0x7f48b8112dc0 2024-09-21T06:28:24.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:24.846+0000 7f48ae7fc640 1 -- 172.21.15.49:0/1919412547 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48a8085040 con 0x7f48b8112dc0 2024-09-21T06:28:25.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.036+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f48b810b0a0 con 0x7f48b8112dc0 2024-09-21T06:28:25.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.040+0000 7f48ae7fc640 1 -- 172.21.15.49:0/1919412547 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7f48a8089420 con 0x7f48b8112dc0 2024-09-21T06:28:25.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48a407f4d0 msgr2=0x7f48a40819e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:25.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48a407f4d0 0x7f48a40819e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f48b4009c10 tx=0x7f48b4005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:25.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8112dc0 msgr2=0x7f48b81a1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:25.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8112dc0 0x7f48b81a1f60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009780 tx=0x7f48a8033cc0 comp rx=0 tx=0).stop 2024-09-21T06:28:25.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 shutdown_connections 2024-09-21T06:28:25.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48a407f4d0 0x7f48a40819e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:25.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48b8115720 0x7f48b81a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:25.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48b8112dc0 0x7f48b81a1f60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:25.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 --2- 172.21.15.49:0/1919412547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48b810bff0 0x7f48b81a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:25.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 >> 172.21.15.49:0/1919412547 conn(0x7f48b8070ec0 msgr2=0x7f48b81164f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:25.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 shutdown_connections 2024-09-21T06:28:25.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:25.042+0000 7f48bf6cc640 1 -- 172.21.15.49:0/1919412547 wait complete. 2024-09-21T06:28:25.378 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:25 smithi049 ceph-mon[31177]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-21T06:28:25.378 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:28:25.378 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:25 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1919412547' entity='client.admin' 2024-09-21T06:28:25.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:25 smithi098 ceph-mon[34704]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-21T06:28:25.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:28:25.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:25 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1919412547' entity='client.admin' 2024-09-21T06:28:25.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:25 smithi079 ceph-mon[34346]: mgrmap e18: x(active, since 12s), standbys: z 2024-09-21T06:28:25.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:28:25.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:25 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1919412547' entity='client.admin' 2024-09-21T06:28:26.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.211+0000 7f2350630640 1 -- 172.21.15.49:0/520318197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348105380 msgr2=0x7f234810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.211+0000 7f2350630640 1 --2- 172.21.15.49:0/520318197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348105380 0x7f234810d8d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2338009860 tx=0x7f233802a340 comp rx=0 tx=0).stop 2024-09-21T06:28:26.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:26 smithi049 ceph-mon[31177]: Standby manager daemon y started 2024-09-21T06:28:26.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:26 smithi049 ceph-mon[31177]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:28:26.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:26 smithi049 ceph-mon[31177]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:28:26.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:26 smithi049 ceph-mon[31177]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:28:26.213 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:26 smithi049 ceph-mon[31177]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.211+0000 7f2350630640 1 -- 172.21.15.49:0/520318197 shutdown_connections 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.211+0000 7f2350630640 1 --2- 172.21.15.49:0/520318197 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f234810de60 0x7f2348110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.211+0000 7f2350630640 1 --2- 172.21.15.49:0/520318197 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348105380 0x7f234810d8d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.211+0000 7f2350630640 1 --2- 172.21.15.49:0/520318197 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2348104a30 0x7f2348104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.211+0000 7f2350630640 1 -- 172.21.15.49:0/520318197 >> 172.21.15.49:0/520318197 conn(0x7f2348079760 msgr2=0x7f2348079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.211+0000 7f2350630640 1 -- 172.21.15.49:0/520318197 shutdown_connections 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.211+0000 7f2350630640 1 -- 172.21.15.49:0/520318197 wait complete. 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.212+0000 7f2350630640 1 Processor -- start 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.212+0000 7f2350630640 1 -- start start 2024-09-21T06:28:26.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.212+0000 7f2350630640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348104a30 0x7f234819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f2350630640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2348105380 0x7f234819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f2350630640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234810de60 0x7f234819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f2350630640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2348113980 con 0x7f234810de60 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f2350630640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2348113800 con 0x7f2348104a30 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f2350630640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2348113b00 con 0x7f2348105380 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234e3cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348104a30 0x7f234819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234ebcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234810de60 0x7f234819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234ebcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234810de60 0x7f234819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50036/0 (socket says 172.21.15.49:50036) 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234ebcd640 1 -- 172.21.15.49:0/2287616803 learned_addr learned my addr 172.21.15.49:0/2287616803 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234e3cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348104a30 0x7f234819a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:60856/0 (socket says 172.21.15.49:60856) 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234dbcb640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2348105380 0x7f234819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234e3cc640 1 -- 172.21.15.49:0/2287616803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2348105380 msgr2=0x7f234819a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234e3cc640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2348105380 0x7f234819a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234e3cc640 1 -- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234810de60 msgr2=0x7f234819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234e3cc640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234810de60 0x7f234819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234e3cc640 1 -- 172.21.15.49:0/2287616803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23481a0340 con 0x7f2348104a30 2024-09-21T06:28:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234ebcd640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234810de60 0x7f234819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.213+0000 7f234e3cc640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348104a30 0x7f234819a3d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f234806c8f0 tx=0x7f234400ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.214+0000 7f233f7fe640 1 -- 172.21.15.49:0/2287616803 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344004440 con 0x7f2348104a30 2024-09-21T06:28:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.214+0000 7f233f7fe640 1 -- 172.21.15.49:0/2287616803 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f234400cd50 con 0x7f2348104a30 2024-09-21T06:28:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.214+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23481a0630 con 0x7f2348104a30 2024-09-21T06:28:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.214+0000 7f233f7fe640 1 -- 172.21.15.49:0/2287616803 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2344019480 con 0x7f2348104a30 2024-09-21T06:28:26.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.214+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23481a6d90 con 0x7f2348104a30 2024-09-21T06:28:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.215+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f234806c1f0 con 0x7f2348104a30 2024-09-21T06:28:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.216+0000 7f233f7fe640 1 -- 172.21.15.49:0/2287616803 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f234400c8c0 con 0x7f2348104a30 2024-09-21T06:28:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.217+0000 7f233f7fe640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f23340b6550 0x7f23340b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.217+0000 7f234dbcb640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f23340b6550 0x7f23340b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:26.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.218+0000 7f233f7fe640 1 -- 172.21.15.49:0/2287616803 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f23440e5ba0 con 0x7f2348104a30 2024-09-21T06:28:26.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.218+0000 7f234dbcb640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f23340b6550 0x7f23340b8a60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2338009830 tx=0x7f2338005c90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:26.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.221+0000 7f233f7fe640 1 -- 172.21.15.49:0/2287616803 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2344009510 con 0x7f2348104a30 2024-09-21T06:28:26.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.420+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f2348108f70 con 0x7f2348104a30 2024-09-21T06:28:26.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.431+0000 7f233f7fe640 1 -- 172.21.15.49:0/2287616803 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v20)=0 v20) ==== 111+0+0 (secure 0 0 0) 0x7f23440adf90 con 0x7f2348104a30 2024-09-21T06:28:26.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f23340b6550 msgr2=0x7f23340b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f23340b6550 0x7f23340b8a60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2338009830 tx=0x7f2338005c90 comp rx=0 tx=0).stop 2024-09-21T06:28:26.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348104a30 msgr2=0x7f234819a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348104a30 0x7f234819a3d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f234806c8f0 tx=0x7f234400ee50 comp rx=0 tx=0).stop 2024-09-21T06:28:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 shutdown_connections 2024-09-21T06:28:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f23340b6550 0x7f23340b8a60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f234810de60 0x7f234819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2348105380 0x7f234819a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 --2- 172.21.15.49:0/2287616803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2348104a30 0x7f234819a3d0 secure :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f234806c8f0 tx=0x7f234400ee50 comp rx=0 tx=0).stop 2024-09-21T06:28:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 >> 172.21.15.49:0/2287616803 conn(0x7f2348079760 msgr2=0x7f23481008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.434+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 shutdown_connections 2024-09-21T06:28:26.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.435+0000 7f2350630640 1 -- 172.21.15.49:0/2287616803 wait complete. 2024-09-21T06:28:26.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:26 smithi098 ceph-mon[34704]: Standby manager daemon y started 2024-09-21T06:28:26.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:26 smithi098 ceph-mon[34704]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:28:26.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:26 smithi098 ceph-mon[34704]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:28:26.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:26 smithi098 ceph-mon[34704]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:28:26.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:26 smithi098 ceph-mon[34704]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:28:26.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:26 smithi079 ceph-mon[34346]: Standby manager daemon y started 2024-09-21T06:28:26.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:26 smithi079 ceph-mon[34346]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:28:26.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:26 smithi079 ceph-mon[34346]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:28:26.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:26 smithi079 ceph-mon[34346]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:28:26.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:26 smithi079 ceph-mon[34346]: from='mgr.? 172.21.15.79:0/2464356274' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:28:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.618+0000 7f86c18e5640 1 -- 172.21.15.49:0/1559948769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc105300 msgr2=0x7f86bc10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.618+0000 7f86c18e5640 1 --2- 172.21.15.49:0/1559948769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc105300 0x7f86bc10d850 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009900 tx=0x7f86b002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.618+0000 7f86c18e5640 1 -- 172.21.15.49:0/1559948769 shutdown_connections 2024-09-21T06:28:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.618+0000 7f86c18e5640 1 --2- 172.21.15.49:0/1559948769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86bc10de10 0x7f86bc110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.618+0000 7f86c18e5640 1 --2- 172.21.15.49:0/1559948769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc105300 0x7f86bc10d850 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.618+0000 7f86c18e5640 1 --2- 172.21.15.49:0/1559948769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86bc1049b0 0x7f86bc104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.618+0000 7f86c18e5640 1 -- 172.21.15.49:0/1559948769 >> 172.21.15.49:0/1559948769 conn(0x7f86bc079730 msgr2=0x7f86bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.618+0000 7f86c18e5640 1 -- 172.21.15.49:0/1559948769 shutdown_connections 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.618+0000 7f86c18e5640 1 -- 172.21.15.49:0/1559948769 wait complete. 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86c18e5640 1 Processor -- start 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86c18e5640 1 -- start start 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86c18e5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86bc1049b0 0x7f86bc19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86c18e5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86bc105300 0x7f86bc19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86c18e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc10de10 0x7f86bc19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86c18e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc113950 con 0x7f86bc10de10 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86c18e5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc1137d0 con 0x7f86bc105300 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86c18e5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc113ad0 con 0x7f86bc1049b0 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86bb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc10de10 0x7f86bc19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86bb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc10de10 0x7f86bc19fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50058/0 (socket says 172.21.15.49:50058) 2024-09-21T06:28:26.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86bb7fe640 1 -- 172.21.15.49:0/2021156837 learned_addr learned my addr 172.21.15.49:0/2021156837 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.619+0000 7f86ba7fc640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86bc105300 0x7f86bc19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86baffd640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86bc1049b0 0x7f86bc19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86bb7fe640 1 -- 172.21.15.49:0/2021156837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86bc1049b0 msgr2=0x7f86bc19a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86bb7fe640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86bc1049b0 0x7f86bc19a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86bb7fe640 1 -- 172.21.15.49:0/2021156837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86bc105300 msgr2=0x7f86bc19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86bb7fe640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86bc105300 0x7f86bc19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86bb7fe640 1 -- 172.21.15.49:0/2021156837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc1a0370 con 0x7f86bc10de10 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86bb7fe640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc10de10 0x7f86bc19fc40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86b400eb10 tx=0x7f86b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86c08e3640 1 -- 172.21.15.49:0/2021156837 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4004b20 con 0x7f86bc10de10 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86c08e3640 1 -- 172.21.15.49:0/2021156837 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f86b4004cc0 con 0x7f86bc10de10 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86bc1a0660 con 0x7f86bc10de10 2024-09-21T06:28:26.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86c08e3640 1 -- 172.21.15.49:0/2021156837 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b4010690 con 0x7f86bc10de10 2024-09-21T06:28:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.620+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86bc1a6dc0 con 0x7f86bc10de10 2024-09-21T06:28:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.621+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86bc104dc0 con 0x7f86bc10de10 2024-09-21T06:28:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.623+0000 7f86c08e3640 1 -- 172.21.15.49:0/2021156837 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f86b4005000 con 0x7f86bc10de10 2024-09-21T06:28:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.624+0000 7f86c08e3640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f86a40b6550 0x7f86a40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.624+0000 7f86baffd640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f86a40b6550 0x7f86a40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.624+0000 7f86c08e3640 1 -- 172.21.15.49:0/2021156837 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f86b40e5f00 con 0x7f86bc10de10 2024-09-21T06:28:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.624+0000 7f86baffd640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f86a40b6550 0x7f86a40b8a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f86bc06bc60 tx=0x7f86ac005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:26.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.627+0000 7f86c08e3640 1 -- 172.21.15.49:0/2021156837 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86b4056710 con 0x7f86bc10de10 2024-09-21T06:28:26.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.822+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f86bc19b530 con 0x7f86bc10de10 2024-09-21T06:28:26.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.826+0000 7f86c08e3640 1 -- 172.21.15.49:0/2021156837 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v22)=0 v22) ==== 127+0+0 (secure 0 0 0) 0x7f86bc19b530 con 0x7f86bc10de10 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f86a40b6550 msgr2=0x7f86a40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f86a40b6550 0x7f86a40b8a60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f86bc06bc60 tx=0x7f86ac005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc10de10 msgr2=0x7f86bc19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc10de10 0x7f86bc19fc40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86b400eb10 tx=0x7f86b400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 shutdown_connections 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f86a40b6550 0x7f86a40b8a60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f86bc10de10 0x7f86bc19fc40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f86bc105300 0x7f86bc19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 --2- 172.21.15.49:0/2021156837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f86bc1049b0 0x7f86bc19a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 >> 172.21.15.49:0/2021156837 conn(0x7f86bc079730 msgr2=0x7f86bc100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:26.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 shutdown_connections 2024-09-21T06:28:26.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.829+0000 7f86c18e5640 1 -- 172.21.15.49:0/2021156837 wait complete. 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.417+0000 7f9741852640 1 -- 172.21.15.49:0/4091159408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c104a30 msgr2=0x7f973c104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.417+0000 7f9741852640 1 --2- 172.21.15.49:0/4091159408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c104a30 0x7f973c104e40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f972c009900 tx=0x7f972c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.417+0000 7f9741852640 1 -- 172.21.15.49:0/4091159408 shutdown_connections 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.417+0000 7f9741852640 1 --2- 172.21.15.49:0/4091159408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973c10de60 0x7f973c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.417+0000 7f9741852640 1 --2- 172.21.15.49:0/4091159408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f973c105380 0x7f973c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.417+0000 7f9741852640 1 --2- 172.21.15.49:0/4091159408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c104a30 0x7f973c104e40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.417+0000 7f9741852640 1 -- 172.21.15.49:0/4091159408 >> 172.21.15.49:0/4091159408 conn(0x7f973c0797b0 msgr2=0x7f973c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.417+0000 7f9741852640 1 -- 172.21.15.49:0/4091159408 shutdown_connections 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.417+0000 7f9741852640 1 -- 172.21.15.49:0/4091159408 wait complete. 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9741852640 1 Processor -- start 2024-09-21T06:28:27.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9741852640 1 -- start start 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9741852640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f973c104a30 0x7f973c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9741852640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c105380 0x7f973c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9741852640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973c10de60 0x7f973c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9741852640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f973c113980 con 0x7f973c105380 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9741852640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f973c113800 con 0x7f973c10de60 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9741852640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f973c113b00 con 0x7f973c104a30 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9733fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c105380 0x7f973c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9733fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c105380 0x7f973c102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50040/0 (socket says 172.21.15.49:50040) 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9733fff640 1 -- 172.21.15.49:0/753396925 learned_addr learned my addr 172.21.15.49:0/753396925 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:27.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f973affd640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f973c104a30 0x7f973c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f973b7fe640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973c10de60 0x7f973c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9733fff640 1 -- 172.21.15.49:0/753396925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f973c104a30 msgr2=0x7f973c102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9733fff640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f973c104a30 0x7f973c102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9733fff640 1 -- 172.21.15.49:0/753396925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973c10de60 msgr2=0x7f973c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9733fff640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973c10de60 0x7f973c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.418+0000 7f9733fff640 1 -- 172.21.15.49:0/753396925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f973c1a8730 con 0x7f973c105380 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.419+0000 7f9733fff640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c105380 0x7f973c102cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f972400d750 tx=0x7f972400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.419+0000 7f9740850640 1 -- 172.21.15.49:0/753396925 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724017070 con 0x7f973c105380 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.419+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f973c1a8a20 con 0x7f973c105380 2024-09-21T06:28:27.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.419+0000 7f9740850640 1 -- 172.21.15.49:0/753396925 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f97240054b0 con 0x7f973c105380 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.419+0000 7f9740850640 1 -- 172.21.15.49:0/753396925 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724004bd0 con 0x7f973c105380 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.419+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973c1a8f60 con 0x7f973c105380 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.420+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f973c104e40 con 0x7f973c105380 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.422+0000 7f9740850640 1 -- 172.21.15.49:0/753396925 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f9724009c30 con 0x7f973c105380 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.423+0000 7f9740850640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97280b64d0 0x7f97280b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.423+0000 7f973affd640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97280b64d0 0x7f97280b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.423+0000 7f9740850640 1 -- 172.21.15.49:0/753396925 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f97240e5530 con 0x7f973c105380 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.424+0000 7f973affd640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97280b64d0 0x7f97280b89e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f973c1041c0 tx=0x7f972c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.426+0000 7f9740850640 1 -- 172.21.15.49:0/753396925 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97240ad9c0 con 0x7f973c105380 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.629+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f973c108f40 con 0x7f973c105380 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.633+0000 7f9740850640 1 -- 172.21.15.49:0/753396925 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v21)=0 v21) ==== 129+0+0 (secure 0 0 0) 0x7f97240b1da0 con 0x7f973c105380 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97280b64d0 msgr2=0x7f97280b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97280b64d0 0x7f97280b89e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f973c1041c0 tx=0x7f972c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c105380 msgr2=0x7f973c102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:27.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c105380 0x7f973c102cb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f972400d750 tx=0x7f972400dc10 comp rx=0 tx=0).stop 2024-09-21T06:28:27.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 shutdown_connections 2024-09-21T06:28:27.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97280b64d0 0x7f97280b89e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f973c10de60 0x7f973c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f973c105380 0x7f973c102cb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 --2- 172.21.15.49:0/753396925 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f973c104a30 0x7f973c102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:27.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 >> 172.21.15.49:0/753396925 conn(0x7f973c0797b0 msgr2=0x7f973c0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:27.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 shutdown_connections 2024-09-21T06:28:27.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:26.636+0000 7f9741852640 1 -- 172.21.15.49:0/753396925 wait complete. 2024-09-21T06:28:27.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:27 smithi049 ceph-mon[31177]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-21T06:28:27.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:28:27.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:27 smithi049 ceph-mon[31177]: from='client.? ' entity='client.admin' 2024-09-21T06:28:27.435 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:27 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/753396925' entity='client.admin' 2024-09-21T06:28:27.436 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:27 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2021156837' entity='client.admin' 2024-09-21T06:28:27.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:27 smithi098 ceph-mon[34704]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-21T06:28:27.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:28:27.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:27 smithi098 ceph-mon[34704]: from='client.? ' entity='client.admin' 2024-09-21T06:28:27.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:27 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/753396925' entity='client.admin' 2024-09-21T06:28:27.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:27 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2021156837' entity='client.admin' 2024-09-21T06:28:27.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:27 smithi079 ceph-mon[34346]: mgrmap e19: x(active, since 14s), standbys: z, y 2024-09-21T06:28:27.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:28:27.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:27 smithi079 ceph-mon[34346]: from='client.? ' entity='client.admin' 2024-09-21T06:28:27.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:27 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/753396925' entity='client.admin' 2024-09-21T06:28:27.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:27 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2021156837' entity='client.admin' 2024-09-21T06:28:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.172+0000 7f3203f2a640 1 -- 172.21.15.49:0/4062995718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc109e10 msgr2=0x7f31fc110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.172+0000 7f3203f2a640 1 --2- 172.21.15.49:0/4062995718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc109e10 0x7f31fc110640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009ca0 tx=0x7f31f402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.172+0000 7f3203f2a640 1 -- 172.21.15.49:0/4062995718 shutdown_connections 2024-09-21T06:28:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.172+0000 7f3203f2a640 1 --2- 172.21.15.49:0/4062995718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc109e10 0x7f31fc110640 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.172+0000 7f3203f2a640 1 --2- 172.21.15.49:0/4062995718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31fc1094c0 0x7f31fc1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.172+0000 7f3203f2a640 1 --2- 172.21.15.49:0/4062995718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31fc103b80 0x7f31fc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.172+0000 7f3203f2a640 1 -- 172.21.15.49:0/4062995718 >> 172.21.15.49:0/4062995718 conn(0x7f31fc0ff610 msgr2=0x7f31fc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.172+0000 7f3203f2a640 1 -- 172.21.15.49:0/4062995718 shutdown_connections 2024-09-21T06:28:28.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.172+0000 7f3203f2a640 1 -- 172.21.15.49:0/4062995718 wait complete. 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.173+0000 7f3203f2a640 1 Processor -- start 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.173+0000 7f3203f2a640 1 -- start start 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3203f2a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc103b80 0x7f31fc19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3203f2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31fc1094c0 0x7f31fc19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3203f2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31fc109e10 0x7f31fc19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3203f2a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc1139b0 con 0x7f31fc103b80 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3203f2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc113830 con 0x7f31fc109e10 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3203f2a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc113b30 con 0x7f31fc1094c0 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3201cc6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc103b80 0x7f31fc19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3201cc6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc103b80 0x7f31fc19a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50084/0 (socket says 172.21.15.49:50084) 2024-09-21T06:28:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3201cc6640 1 -- 172.21.15.49:0/2220916962 learned_addr learned my addr 172.21.15.49:0/2220916962 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f32024c7640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31fc109e10 0x7f31fc19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f32014c5640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31fc1094c0 0x7f31fc19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3201cc6640 1 -- 172.21.15.49:0/2220916962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31fc1094c0 msgr2=0x7f31fc19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3201cc6640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31fc1094c0 0x7f31fc19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3201cc6640 1 -- 172.21.15.49:0/2220916962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31fc109e10 msgr2=0x7f31fc19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3201cc6640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31fc109e10 0x7f31fc19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.174+0000 7f3201cc6640 1 -- 172.21.15.49:0/2220916962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc1a02f0 con 0x7f31fc103b80 2024-09-21T06:28:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.175+0000 7f3201cc6640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc103b80 0x7f31fc19a380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31f800e9f0 tx=0x7f31f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.175+0000 7f31f2ffd640 1 -- 172.21.15.49:0/2220916962 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f800cd80 con 0x7f31fc103b80 2024-09-21T06:28:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.175+0000 7f31f2ffd640 1 -- 172.21.15.49:0/2220916962 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f31f80108c0 con 0x7f31fc103b80 2024-09-21T06:28:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.175+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31fc1a05e0 con 0x7f31fc103b80 2024-09-21T06:28:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.175+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31fc1a6d40 con 0x7f31fc103b80 2024-09-21T06:28:28.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.175+0000 7f31f2ffd640 1 -- 172.21.15.49:0/2220916962 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f80187d0 con 0x7f31fc103b80 2024-09-21T06:28:28.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.176+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e00050b0 con 0x7f31fc103b80 2024-09-21T06:28:28.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.178+0000 7f31f2ffd640 1 -- 172.21.15.49:0/2220916962 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f31f8010430 con 0x7f31fc103b80 2024-09-21T06:28:28.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.178+0000 7f31f2ffd640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31e80b64d0 0x7f31e80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:28.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.178+0000 7f32014c5640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31e80b64d0 0x7f31e80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:28.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.179+0000 7f31f2ffd640 1 -- 172.21.15.49:0/2220916962 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f31f80e5a00 con 0x7f31fc103b80 2024-09-21T06:28:28.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.179+0000 7f32014c5640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31e80b64d0 0x7f31e80b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31fc108fa0 tx=0x7f31ec00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:28.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.183+0000 7f31f2ffd640 1 -- 172.21.15.49:0/2220916962 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31f80e7e20 con 0x7f31fc103b80 2024-09-21T06:28:28.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.377+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f31e00053a0 con 0x7f31fc103b80 2024-09-21T06:28:28.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.381+0000 7f31f2ffd640 1 -- 172.21.15.49:0/2220916962 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f31f80b2270 con 0x7f31fc103b80 2024-09-21T06:28:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31e80b64d0 msgr2=0x7f31e80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31e80b64d0 0x7f31e80b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f31fc108fa0 tx=0x7f31ec00b390 comp rx=0 tx=0).stop 2024-09-21T06:28:28.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc103b80 msgr2=0x7f31fc19a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:28.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc103b80 0x7f31fc19a380 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f31f800e9f0 tx=0x7f31f800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 shutdown_connections 2024-09-21T06:28:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31e80b64d0 0x7f31e80b89e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31fc109e10 0x7f31fc19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f31fc1094c0 0x7f31fc19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 --2- 172.21.15.49:0/2220916962 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31fc103b80 0x7f31fc19a380 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 >> 172.21.15.49:0/2220916962 conn(0x7f31fc0ff610 msgr2=0x7f31fc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 shutdown_connections 2024-09-21T06:28:28.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:28.384+0000 7f3203f2a640 1 -- 172.21.15.49:0/2220916962 wait complete. 2024-09-21T06:28:29.651 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:29 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2220916962' entity='client.admin' 2024-09-21T06:28:29.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:29 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2220916962' entity='client.admin' 2024-09-21T06:28:29.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:29 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2220916962' entity='client.admin' 2024-09-21T06:28:30.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.189+0000 7f1c1762b640 1 -- 172.21.15.49:0/3929724998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10102000 msgr2=0x7f1c10102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.189+0000 7f1c1762b640 1 --2- 172.21.15.49:0/3929724998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10102000 0x7f1c10102410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009900 tx=0x7f1c0c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.189+0000 7f1c1762b640 1 -- 172.21.15.49:0/3929724998 shutdown_connections 2024-09-21T06:28:30.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.189+0000 7f1c1762b640 1 --2- 172.21.15.49:0/3929724998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c10106c30 0x7f1c10110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.189+0000 7f1c1762b640 1 --2- 172.21.15.49:0/3929724998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c101062e0 0x7f1c101066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.189+0000 7f1c1762b640 1 --2- 172.21.15.49:0/3929724998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10102000 0x7f1c10102410 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.189+0000 7f1c1762b640 1 -- 172.21.15.49:0/3929724998 >> 172.21.15.49:0/3929724998 conn(0x7f1c10079e40 msgr2=0x7f1c1007a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.190+0000 7f1c1762b640 1 -- 172.21.15.49:0/3929724998 shutdown_connections 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.190+0000 7f1c1762b640 1 -- 172.21.15.49:0/3929724998 wait complete. 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.190+0000 7f1c1762b640 1 Processor -- start 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.190+0000 7f1c1762b640 1 -- start start 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c1762b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c10102000 0x7f1c1019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c1762b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c101062e0 0x7f1c1019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c1762b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10106c30 0x7f1c1019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c1762b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1c101139b0 con 0x7f1c10106c30 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c1762b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10113830 con 0x7f1c10102000 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c1762b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1c10113b30 con 0x7f1c101062e0 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c15bc8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10106c30 0x7f1c1019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c15bc8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10106c30 0x7f1c1019fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50100/0 (socket says 172.21.15.49:50100) 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c15bc8640 1 -- 172.21.15.49:0/63992343 learned_addr learned my addr 172.21.15.49:0/63992343 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c153c7640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c10102000 0x7f1c1019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c14bc6640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c101062e0 0x7f1c1019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c15bc8640 1 -- 172.21.15.49:0/63992343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c101062e0 msgr2=0x7f1c1019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c15bc8640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c101062e0 0x7f1c1019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c15bc8640 1 -- 172.21.15.49:0/63992343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c10102000 msgr2=0x7f1c1019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c15bc8640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c10102000 0x7f1c1019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c15bc8640 1 -- 172.21.15.49:0/63992343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c101a0250 con 0x7f1c10106c30 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c15bc8640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10106c30 0x7f1c1019fbe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800cce0 tx=0x7f1c0800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c067fc640 1 -- 172.21.15.49:0/63992343 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800f450 con 0x7f1c10106c30 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c067fc640 1 -- 172.21.15.49:0/63992343 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1c0800fa80 con 0x7f1c10106c30 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.191+0000 7f1c067fc640 1 -- 172.21.15.49:0/63992343 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c08018ae0 con 0x7f1c10106c30 2024-09-21T06:28:30.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.192+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c101a0540 con 0x7f1c10106c30 2024-09-21T06:28:30.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.192+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c101a6d60 con 0x7f1c10106c30 2024-09-21T06:28:30.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.192+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c1019b4d0 con 0x7f1c10106c30 2024-09-21T06:28:30.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.195+0000 7f1c067fc640 1 -- 172.21.15.49:0/63992343 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f1c0800f5f0 con 0x7f1c10106c30 2024-09-21T06:28:30.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.196+0000 7f1c067fc640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1bfc0b6580 0x7f1bfc0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.196+0000 7f1c153c7640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1bfc0b6580 0x7f1bfc0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.196+0000 7f1c067fc640 1 -- 172.21.15.49:0/63992343 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f1c080e5e90 con 0x7f1c10106c30 2024-09-21T06:28:30.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.196+0000 7f1c153c7640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1bfc0b6580 0x7f1bfc0b8a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009230 tx=0x7f1c0c0058d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:30.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.199+0000 7f1c067fc640 1 -- 172.21.15.49:0/63992343 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c08014030 con 0x7f1c10106c30 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.373+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/2151952957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68102a60 msgr2=0x7f9b68102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.373+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/2151952957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68102a60 0x7f9b68102e70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9b58009900 tx=0x7f9b5802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.373+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/2151952957 shutdown_connections 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.373+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/2151952957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b68108cf0 0x7f9b6810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.373+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/2151952957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b681083a0 0x7f9b681087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.373+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/2151952957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68102a60 0x7f9b68102e70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.373+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/2151952957 >> 172.21.15.49:0/2151952957 conn(0x7f9b68079730 msgr2=0x7f9b68079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:30.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.373+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/2151952957 shutdown_connections 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.373+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/2151952957 wait complete. 2024-09-21T06:28:30.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b6e0f7640 1 Processor -- start 2024-09-21T06:28:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b6e0f7640 1 -- start start 2024-09-21T06:28:30.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b6e0f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b68102a60 0x7f9b6819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b6e0f7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b681083a0 0x7f9b6819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b6e0f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68108cf0 0x7f9b6819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b6e0f7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9b68113990 con 0x7f9b68108cf0 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b6e0f7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b68113810 con 0x7f9b68102a60 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b6e0f7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9b68113b10 con 0x7f9b681083a0 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b67fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68108cf0 0x7f9b6819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b67fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68108cf0 0x7f9b6819fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50112/0 (socket says 172.21.15.49:50112) 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b67fff640 1 -- 172.21.15.49:0/1812615741 learned_addr learned my addr 172.21.15.49:0/1812615741 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b66ffd640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b681083a0 0x7f9b6819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.374+0000 7f9b677fe640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b68102a60 0x7f9b6819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b67fff640 1 -- 172.21.15.49:0/1812615741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b681083a0 msgr2=0x7f9b6819a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b67fff640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b681083a0 0x7f9b6819a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b67fff640 1 -- 172.21.15.49:0/1812615741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b68102a60 msgr2=0x7f9b6819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b67fff640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b68102a60 0x7f9b6819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b67fff640 1 -- 172.21.15.49:0/1812615741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b681a02d0 con 0x7f9b68108cf0 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b67fff640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68108cf0 0x7f9b6819fba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009fd0 tx=0x7f9b6000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b64ff9640 1 -- 172.21.15.49:0/1812615741 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60017070 con 0x7f9b68108cf0 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b64ff9640 1 -- 172.21.15.49:0/1812615741 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f9b60003e00 con 0x7f9b68108cf0 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b681a05c0 con 0x7f9b68108cf0 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b64ff9640 1 -- 172.21.15.49:0/1812615741 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60010460 con 0x7f9b68108cf0 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.375+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b681a6d20 con 0x7f9b68108cf0 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.376+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b68102e70 con 0x7f9b68108cf0 2024-09-21T06:28:30.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.378+0000 7f9b64ff9640 1 -- 172.21.15.49:0/1812615741 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f9b60003970 con 0x7f9b68108cf0 2024-09-21T06:28:30.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.379+0000 7f9b64ff9640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b500b6550 0x7f9b500b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.379+0000 7f9b677fe640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b500b6550 0x7f9b500b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.379+0000 7f9b64ff9640 1 -- 172.21.15.49:0/1812615741 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9b600e57b0 con 0x7f9b68108cf0 2024-09-21T06:28:30.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.379+0000 7f9b677fe640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b500b6550 0x7f9b500b8a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b58000c00 tx=0x7f9b58005e80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:30.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.382+0000 7f9b64ff9640 1 -- 172.21.15.49:0/1812615741 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9b600b20a0 con 0x7f9b68108cf0 2024-09-21T06:28:30.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.390+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f1c1010bbb0 con 0x7f1c10106c30 2024-09-21T06:28:30.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.395+0000 7f1c067fc640 1 -- 172.21.15.49:0/63992343 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v24)=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f1c1010bbb0 con 0x7f1c10106c30 2024-09-21T06:28:30.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1bfc0b6580 msgr2=0x7f1bfc0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1bfc0b6580 0x7f1bfc0b8a90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009230 tx=0x7f1c0c0058d0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10106c30 msgr2=0x7f1c1019fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10106c30 0x7f1c1019fbe0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800cce0 tx=0x7f1c0800a620 comp rx=0 tx=0).stop 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 shutdown_connections 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1bfc0b6580 0x7f1bfc0b8a90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c10106c30 0x7f1c1019fbe0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c101062e0 0x7f1c1019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 --2- 172.21.15.49:0/63992343 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c10102000 0x7f1c1019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 >> 172.21.15.49:0/63992343 conn(0x7f1c10079e40 msgr2=0x7f1c101080a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 shutdown_connections 2024-09-21T06:28:30.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.398+0000 7f1c1762b640 1 -- 172.21.15.49:0/63992343 wait complete. 2024-09-21T06:28:30.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.548+0000 7f115dbea640 1 -- 172.21.15.49:0/1240841622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f115810de10 msgr2=0x7f1158110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.548+0000 7f115dbea640 1 --2- 172.21.15.49:0/1240841622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f115810de10 0x7f1158110300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1150009ca0 tx=0x7f115002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.548+0000 7f115dbea640 1 -- 172.21.15.49:0/1240841622 shutdown_connections 2024-09-21T06:28:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.548+0000 7f115dbea640 1 --2- 172.21.15.49:0/1240841622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f115810de10 0x7f1158110300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.549+0000 7f115dbea640 1 --2- 172.21.15.49:0/1240841622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1158105300 0x7f115810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.549+0000 7f115dbea640 1 --2- 172.21.15.49:0/1240841622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f11581049b0 0x7f1158104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.549+0000 7f115dbea640 1 -- 172.21.15.49:0/1240841622 >> 172.21.15.49:0/1240841622 conn(0x7f1158079730 msgr2=0x7f1158079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.549+0000 7f115dbea640 1 -- 172.21.15.49:0/1240841622 shutdown_connections 2024-09-21T06:28:30.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.549+0000 7f115dbea640 1 -- 172.21.15.49:0/1240841622 wait complete. 2024-09-21T06:28:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.549+0000 7f115dbea640 1 Processor -- start 2024-09-21T06:28:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.549+0000 7f115dbea640 1 -- start start 2024-09-21T06:28:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f115dbea640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11581049b0 0x7f115819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f115dbea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1158105300 0x7f115819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f115dbea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115810de10 0x7f115819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f115dbea640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1158113950 con 0x7f1158105300 2024-09-21T06:28:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f115dbea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f11581137d0 con 0x7f115810de10 2024-09-21T06:28:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f115dbea640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1158113ad0 con 0x7f11581049b0 2024-09-21T06:28:30.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1156ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1158105300 0x7f115819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1156ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1158105300 0x7f115819a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50128/0 (socket says 172.21.15.49:50128) 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1156ffd640 1 -- 172.21.15.49:0/2160031665 learned_addr learned my addr 172.21.15.49:0/2160031665 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f11577fe640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11581049b0 0x7f115819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1157fff640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115810de10 0x7f115819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1156ffd640 1 -- 172.21.15.49:0/2160031665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11581049b0 msgr2=0x7f115819a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1156ffd640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11581049b0 0x7f115819a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1156ffd640 1 -- 172.21.15.49:0/2160031665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115810de10 msgr2=0x7f115819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1156ffd640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115810de10 0x7f115819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1156ffd640 1 -- 172.21.15.49:0/2160031665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11581a0290 con 0x7f1158105300 2024-09-21T06:28:30.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.550+0000 7f1157fff640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115810de10 0x7f115819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:30.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.551+0000 7f1156ffd640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1158105300 0x7f115819a8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f114000d950 tx=0x7f114000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:30.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.551+0000 7f1154ff9640 1 -- 172.21.15.49:0/2160031665 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140017070 con 0x7f1158105300 2024-09-21T06:28:30.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.551+0000 7f1154ff9640 1 -- 172.21.15.49:0/2160031665 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f1140009c30 con 0x7f1158105300 2024-09-21T06:28:30.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.551+0000 7f1154ff9640 1 -- 172.21.15.49:0/2160031665 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11400047a0 con 0x7f1158105300 2024-09-21T06:28:30.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.551+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11581a0580 con 0x7f1158105300 2024-09-21T06:28:30.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.551+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11581a6ce0 con 0x7f1158105300 2024-09-21T06:28:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.552+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1158104dc0 con 0x7f1158105300 2024-09-21T06:28:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.554+0000 7f1154ff9640 1 -- 172.21.15.49:0/2160031665 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f1140004020 con 0x7f1158105300 2024-09-21T06:28:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.555+0000 7f1154ff9640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f11440b6550 0x7f11440b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.555+0000 7f11577fe640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f11440b6550 0x7f11440b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:30.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.555+0000 7f1154ff9640 1 -- 172.21.15.49:0/2160031665 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f11400e57b0 con 0x7f1158105300 2024-09-21T06:28:30.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.555+0000 7f11577fe640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f11440b6550 0x7f11440b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f115806bc60 tx=0x7f114800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:30.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.558+0000 7f1154ff9640 1 -- 172.21.15.49:0/2160031665 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1140020020 con 0x7f1158105300 2024-09-21T06:28:30.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.586+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f9b6810aac0 con 0x7f9b68108cf0 2024-09-21T06:28:30.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.590+0000 7f9b64ff9640 1 -- 172.21.15.49:0/1812615741 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) ==== 123+0+0 (secure 0 0 0) 0x7f9b600b6fe0 con 0x7f9b68108cf0 2024-09-21T06:28:30.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.592+0000 7f9b64ff9640 1 -- 172.21.15.49:0/1812615741 <== mon.0 v2:172.21.15.49:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b600ad180 con 0x7f9b68108cf0 2024-09-21T06:28:30.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.592+0000 7f1154ff9640 1 -- 172.21.15.49:0/2160031665 <== mon.0 v2:172.21.15.49:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1140005690 con 0x7f1158105300 2024-09-21T06:28:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b500b6550 msgr2=0x7f9b500b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b500b6550 0x7f9b500b8a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b58000c00 tx=0x7f9b58005e80 comp rx=0 tx=0).stop 2024-09-21T06:28:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68108cf0 msgr2=0x7f9b6819fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68108cf0 0x7f9b6819fba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b60009fd0 tx=0x7f9b6000b260 comp rx=0 tx=0).stop 2024-09-21T06:28:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 shutdown_connections 2024-09-21T06:28:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b500b6550 0x7f9b500b8a60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b68108cf0 0x7f9b6819fba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b681083a0 0x7f9b6819a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 --2- 172.21.15.49:0/1812615741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b68102a60 0x7f9b6819a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 >> 172.21.15.49:0/1812615741 conn(0x7f9b68079730 msgr2=0x7f9b68101460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:30.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 shutdown_connections 2024-09-21T06:28:30.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.593+0000 7f9b6e0f7640 1 -- 172.21.15.49:0/1812615741 wait complete. 2024-09-21T06:28:30.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.754+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f115819b450 con 0x7f1158105300 2024-09-21T06:28:30.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.758+0000 7f1154ff9640 1 -- 172.21.15.49:0/2160031665 <== mon.0 v2:172.21.15.49:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v26)=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7f115819b450 con 0x7f1158105300 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f11440b6550 msgr2=0x7f11440b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f11440b6550 0x7f11440b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f115806bc60 tx=0x7f114800b390 comp rx=0 tx=0).stop 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1158105300 msgr2=0x7f115819a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1158105300 0x7f115819a8c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f114000d950 tx=0x7f114000de10 comp rx=0 tx=0).stop 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 shutdown_connections 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f11440b6550 0x7f11440b8a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f115810de10 0x7f115819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1158105300 0x7f115819a8c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 --2- 172.21.15.49:0/2160031665 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f11581049b0 0x7f115819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 >> 172.21.15.49:0/2160031665 conn(0x7f1158079730 msgr2=0x7f1158100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 shutdown_connections 2024-09-21T06:28:30.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:30.760+0000 7f115dbea640 1 -- 172.21.15.49:0/2160031665 wait complete. 2024-09-21T06:28:31.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 -- 172.21.15.49:0/2283081272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 msgr2=0x7f71fc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 --2- 172.21.15.49:0/2283081272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 0x7f71fc1087b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f71f0009900 tx=0x7f71f002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 -- 172.21.15.49:0/2283081272 shutdown_connections 2024-09-21T06:28:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 --2- 172.21.15.49:0/2283081272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc108cf0 0x7f71fc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 --2- 172.21.15.49:0/2283081272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 0x7f71fc1087b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 --2- 172.21.15.49:0/2283081272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71fc102a60 0x7f71fc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 -- 172.21.15.49:0/2283081272 >> 172.21.15.49:0/2283081272 conn(0x7f71fc079730 msgr2=0x7f71fc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 -- 172.21.15.49:0/2283081272 shutdown_connections 2024-09-21T06:28:31.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 -- 172.21.15.49:0/2283081272 wait complete. 2024-09-21T06:28:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.506+0000 7f7201963640 1 Processor -- start 2024-09-21T06:28:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f7201963640 1 -- start start 2024-09-21T06:28:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f7201963640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71fc102a60 0x7f71fc19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f7201963640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 0x7f71fc19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f7201963640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc108cf0 0x7f71fc19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f7201963640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc113ab0 con 0x7f71fc1083a0 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f7201963640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc113930 con 0x7f71fc108cf0 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f7201963640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc113c30 con 0x7f71fc102a60 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f71fa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 0x7f71fc19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f71fa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 0x7f71fc19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50148/0 (socket says 172.21.15.49:50148) 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f71fa7fc640 1 -- 172.21.15.49:0/3850280264 learned_addr learned my addr 172.21.15.49:0/3850280264 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f71faffd640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71fc102a60 0x7f71fc19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.507+0000 7f71fb7fe640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc108cf0 0x7f71fc19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f71fa7fc640 1 -- 172.21.15.49:0/3850280264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71fc102a60 msgr2=0x7f71fc19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f71fa7fc640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71fc102a60 0x7f71fc19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f71fa7fc640 1 -- 172.21.15.49:0/3850280264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc108cf0 msgr2=0x7f71fc19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f71fa7fc640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc108cf0 0x7f71fc19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f71fa7fc640 1 -- 172.21.15.49:0/3850280264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc1a0410 con 0x7f71fc1083a0 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f71faffd640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71fc102a60 0x7f71fc19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:31.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f71fa7fc640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 0x7f71fc19aa40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71f0005ab0 tx=0x7f71f0003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f7200961640 1 -- 172.21.15.49:0/3850280264 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f003f070 con 0x7f71fc1083a0 2024-09-21T06:28:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f7200961640 1 -- 172.21.15.49:0/3850280264 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71f0031d60 con 0x7f71fc1083a0 2024-09-21T06:28:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc1a06a0 con 0x7f71fc1083a0 2024-09-21T06:28:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f7200961640 1 -- 172.21.15.49:0/3850280264 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71f0035030 con 0x7f71fc1083a0 2024-09-21T06:28:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.508+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc1a6e60 con 0x7f71fc1083a0 2024-09-21T06:28:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.509+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc102e70 con 0x7f71fc1083a0 2024-09-21T06:28:31.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.511+0000 7f7200961640 1 -- 172.21.15.49:0/3850280264 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f71f0042070 con 0x7f71fc1083a0 2024-09-21T06:28:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.511+0000 7f7200961640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f71e40b6550 0x7f71e40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.512+0000 7f71faffd640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f71e40b6550 0x7f71e40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.512+0000 7f7200961640 1 -- 172.21.15.49:0/3850280264 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f71f01065a0 con 0x7f71fc1083a0 2024-09-21T06:28:31.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.512+0000 7f71faffd640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f71e40b6550 0x7f71e40b8a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009fd0 tx=0x7f71ec009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:31.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.515+0000 7f7200961640 1 -- 172.21.15.49:0/3850280264 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71f00cea30 con 0x7f71fc1083a0 2024-09-21T06:28:31.588 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:31 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/63992343' entity='client.admin' 2024-09-21T06:28:31.588 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:31 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1812615741' entity='client.admin' 2024-09-21T06:28:31.588 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:31 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2160031665' entity='client.admin' 2024-09-21T06:28:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.683+0000 7fe7e8826640 1 -- 172.21.15.49:0/3655506436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e41049b0 msgr2=0x7fe7e4104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.683+0000 7fe7e8826640 1 --2- 172.21.15.49:0/3655506436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e41049b0 0x7fe7e4104dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4009900 tx=0x7fe7d402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.683+0000 7fe7e8826640 1 -- 172.21.15.49:0/3655506436 shutdown_connections 2024-09-21T06:28:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.683+0000 7fe7e8826640 1 --2- 172.21.15.49:0/3655506436 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e410de10 0x7fe7e4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.683+0000 7fe7e8826640 1 --2- 172.21.15.49:0/3655506436 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e4105300 0x7fe7e410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.683+0000 7fe7e8826640 1 --2- 172.21.15.49:0/3655506436 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e41049b0 0x7fe7e4104dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.683+0000 7fe7e8826640 1 -- 172.21.15.49:0/3655506436 >> 172.21.15.49:0/3655506436 conn(0x7fe7e4079730 msgr2=0x7fe7e4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.683+0000 7fe7e8826640 1 -- 172.21.15.49:0/3655506436 shutdown_connections 2024-09-21T06:28:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.683+0000 7fe7e8826640 1 -- 172.21.15.49:0/3655506436 wait complete. 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.684+0000 7fe7e8826640 1 Processor -- start 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.684+0000 7fe7e8826640 1 -- start start 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.684+0000 7fe7e8826640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e41049b0 0x7fe7e419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.684+0000 7fe7e8826640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e4105300 0x7fe7e419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e8826640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e410de10 0x7fe7e419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e8826640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e4113a90 con 0x7fe7e410de10 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e8826640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e4113910 con 0x7fe7e41049b0 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e8826640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e4113c10 con 0x7fe7e4105300 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e410de10 0x7fe7e419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e410de10 0x7fe7e419fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50158/0 (socket says 172.21.15.49:50158) 2024-09-21T06:28:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e2d9d640 1 -- 172.21.15.49:0/2202712153 learned_addr learned my addr 172.21.15.49:0/2202712153 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e1d9b640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e4105300 0x7fe7e419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e259c640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e41049b0 0x7fe7e419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e2d9d640 1 -- 172.21.15.49:0/2202712153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e4105300 msgr2=0x7fe7e419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e2d9d640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e4105300 0x7fe7e419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e2d9d640 1 -- 172.21.15.49:0/2202712153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e41049b0 msgr2=0x7fe7e419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e2d9d640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e41049b0 0x7fe7e419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e2d9d640 1 -- 172.21.15.49:0/2202712153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e41a04d0 con 0x7fe7e410de10 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e1d9b640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e4105300 0x7fe7e419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7e2d9d640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e410de10 0x7fe7e419fda0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00eaa0 tx=0x7fe7dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.685+0000 7fe7d37fe640 1 -- 172.21.15.49:0/2202712153 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc00cdb0 con 0x7fe7e410de10 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.686+0000 7fe7d37fe640 1 -- 172.21.15.49:0/2202712153 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7dc005020 con 0x7fe7e410de10 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.686+0000 7fe7d37fe640 1 -- 172.21.15.49:0/2202712153 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc0116d0 con 0x7fe7e410de10 2024-09-21T06:28:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.686+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e41a07c0 con 0x7fe7e410de10 2024-09-21T06:28:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.686+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e41a6f20 con 0x7fe7e410de10 2024-09-21T06:28:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.687+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e4104dc0 con 0x7fe7e410de10 2024-09-21T06:28:31.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.688+0000 7fe7d37fe640 1 -- 172.21.15.49:0/2202712153 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fe7dc0051d0 con 0x7fe7e410de10 2024-09-21T06:28:31.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.689+0000 7fe7d37fe640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7cc0b6550 0x7fe7cc0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:31.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.690+0000 7fe7e259c640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7cc0b6550 0x7fe7cc0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:31.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.690+0000 7fe7d37fe640 1 -- 172.21.15.49:0/2202712153 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe7dc0e5780 con 0x7fe7e410de10 2024-09-21T06:28:31.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.690+0000 7fe7e259c640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7cc0b6550 0x7fe7cc0b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4000c00 tx=0x7fe7d4031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:31.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.694+0000 7fe7d37fe640 1 -- 172.21.15.49:0/2202712153 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7dc016030 con 0x7fe7e410de10 2024-09-21T06:28:31.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.711+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f71fc10ab20 con 0x7f71fc1083a0 2024-09-21T06:28:31.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.715+0000 7f7200961640 1 -- 172.21.15.49:0/3850280264 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v27)=0 v27) ==== 125+0+0 (secure 0 0 0) 0x7f71f00d2e10 con 0x7f71fc1083a0 2024-09-21T06:28:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f71e40b6550 msgr2=0x7f71e40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f71e40b6550 0x7f71e40b8a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009fd0 tx=0x7f71ec009680 comp rx=0 tx=0).stop 2024-09-21T06:28:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 msgr2=0x7f71fc19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 0x7f71fc19aa40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f71f0005ab0 tx=0x7f71f0003cd0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 shutdown_connections 2024-09-21T06:28:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f71e40b6550 0x7f71e40b8a60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f71fc108cf0 0x7f71fc19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f71fc1083a0 0x7f71fc19aa40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 --2- 172.21.15.49:0/3850280264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f71fc102a60 0x7f71fc19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 >> 172.21.15.49:0/3850280264 conn(0x7f71fc079730 msgr2=0x7f71fc104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:31.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.717+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 shutdown_connections 2024-09-21T06:28:31.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.718+0000 7f7201963640 1 -- 172.21.15.49:0/3850280264 wait complete. 2024-09-21T06:28:31.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:31 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/63992343' entity='client.admin' 2024-09-21T06:28:31.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:31 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1812615741' entity='client.admin' 2024-09-21T06:28:31.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:31 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2160031665' entity='client.admin' 2024-09-21T06:28:31.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:31 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/63992343' entity='client.admin' 2024-09-21T06:28:31.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:31 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1812615741' entity='client.admin' 2024-09-21T06:28:31.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:31 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2160031665' entity='client.admin' 2024-09-21T06:28:31.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.894+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fe7e402e640 con 0x7fe7e410de10 2024-09-21T06:28:31.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.894+0000 7fe7d37fe640 1 -- 172.21.15.49:0/2202712153 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v27)=0 v27) ==== 108+0+0 (secure 0 0 0) 0x7fe7dc0b1fd0 con 0x7fe7e410de10 2024-09-21T06:28:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7cc0b6550 msgr2=0x7fe7cc0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7cc0b6550 0x7fe7cc0b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe7d4000c00 tx=0x7fe7d4031400 comp rx=0 tx=0).stop 2024-09-21T06:28:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e410de10 msgr2=0x7fe7e419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e410de10 0x7fe7e419fda0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00eaa0 tx=0x7fe7dc00ef60 comp rx=0 tx=0).stop 2024-09-21T06:28:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 shutdown_connections 2024-09-21T06:28:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7cc0b6550 0x7fe7cc0b8a60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7e410de10 0x7fe7e419fda0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7e4105300 0x7fe7e419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 --2- 172.21.15.49:0/2202712153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7e41049b0 0x7fe7e419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:31.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 >> 172.21.15.49:0/2202712153 conn(0x7fe7e4079730 msgr2=0x7fe7e40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:31.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 shutdown_connections 2024-09-21T06:28:31.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:31.897+0000 7fe7e8826640 1 -- 172.21.15.49:0/2202712153 wait complete. 2024-09-21T06:28:32.844 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:32 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3850280264' entity='client.admin' 2024-09-21T06:28:33.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:32 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3850280264' entity='client.admin' 2024-09-21T06:28:33.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:32 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3850280264' entity='client.admin' 2024-09-21T06:28:33.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.639+0000 7f8b030cf640 1 -- 172.21.15.49:0/3751240617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc102ae0 msgr2=0x7f8afc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.639+0000 7f8b030cf640 1 --2- 172.21.15.49:0/3751240617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc102ae0 0x7f8afc102ef0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009900 tx=0x7f8af002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.639+0000 7f8b030cf640 1 -- 172.21.15.49:0/3751240617 shutdown_connections 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.639+0000 7f8b030cf640 1 --2- 172.21.15.49:0/3751240617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc108d20 0x7f8afc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.639+0000 7f8b030cf640 1 --2- 172.21.15.49:0/3751240617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8afc1083d0 0x7f8afc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.639+0000 7f8b030cf640 1 --2- 172.21.15.49:0/3751240617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc102ae0 0x7f8afc102ef0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.639+0000 7f8b030cf640 1 -- 172.21.15.49:0/3751240617 >> 172.21.15.49:0/3751240617 conn(0x7f8afc079760 msgr2=0x7f8afc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.639+0000 7f8b030cf640 1 -- 172.21.15.49:0/3751240617 shutdown_connections 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.639+0000 7f8b030cf640 1 -- 172.21.15.49:0/3751240617 wait complete. 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b030cf640 1 Processor -- start 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b030cf640 1 -- start start 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b030cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8afc102ae0 0x7f8afc19b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b030cf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc1083d0 0x7f8afc19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b030cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc108d20 0x7f8afc19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b030cf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc112990 con 0x7f8afc108d20 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b030cf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc112810 con 0x7f8afc102ae0 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b030cf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8afc112b10 con 0x7f8afc1083d0 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b0166c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc108d20 0x7f8afc19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b0166c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc108d20 0x7f8afc19bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50182/0 (socket says 172.21.15.49:50182) 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.640+0000 7f8b0166c640 1 -- 172.21.15.49:0/2183902714 learned_addr learned my addr 172.21.15.49:0/2183902714 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8afbfff640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc1083d0 0x7f8afc19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8b00e6b640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8afc102ae0 0x7f8afc19b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8b0166c640 1 -- 172.21.15.49:0/2183902714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc1083d0 msgr2=0x7f8afc19b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8b0166c640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc1083d0 0x7f8afc19b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8b0166c640 1 -- 172.21.15.49:0/2183902714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8afc102ae0 msgr2=0x7f8afc19b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8b0166c640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8afc102ae0 0x7f8afc19b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8b0166c640 1 -- 172.21.15.49:0/2183902714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8afc1a6590 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8afbfff640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc1083d0 0x7f8afc19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8b0166c640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc108d20 0x7f8afc19bd80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8af400eaa0 tx=0x7f8af400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8af9ffb640 1 -- 172.21.15.49:0/2183902714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af400cdb0 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8af9ffb640 1 -- 172.21.15.49:0/2183902714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8af4005020 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8afc1a6880 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8af9ffb640 1 -- 172.21.15.49:0/2183902714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af40116d0 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.641+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8afc1a6e10 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.643+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8afc103d10 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.644+0000 7f8af9ffb640 1 -- 172.21.15.49:0/2183902714 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f8af40051d0 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.644+0000 7f8af9ffb640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8aec0b6580 0x7f8aec0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.645+0000 7f8b00e6b640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8aec0b6580 0x7f8aec0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.645+0000 7f8af9ffb640 1 -- 172.21.15.49:0/2183902714 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8af40e5890 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.645+0000 7f8b00e6b640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8aec0b6580 0x7f8aec0b8a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8af0000c00 tx=0x7f8af0031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.649+0000 7f8af9ffb640 1 -- 172.21.15.49:0/2183902714 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8af4016030 con 0x7f8afc108d20 2024-09-21T06:28:33.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.842+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f8afc02e640 con 0x7f8afc108d20 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.847+0000 7f8af9ffb640 1 -- 172.21.15.49:0/2183902714 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v28)=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f8af40add20 con 0x7f8afc108d20 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8aec0b6580 msgr2=0x7f8aec0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8aec0b6580 0x7f8aec0b8a90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8af0000c00 tx=0x7f8af0031400 comp rx=0 tx=0).stop 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc108d20 msgr2=0x7f8afc19bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc108d20 0x7f8afc19bd80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8af400eaa0 tx=0x7f8af400ef60 comp rx=0 tx=0).stop 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 shutdown_connections 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8aec0b6580 0x7f8aec0b8a90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8afc108d20 0x7f8afc19bd80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8afc1083d0 0x7f8afc19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 --2- 172.21.15.49:0/2183902714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8afc102ae0 0x7f8afc19b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 >> 172.21.15.49:0/2183902714 conn(0x7f8afc079760 msgr2=0x7f8afc101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 shutdown_connections 2024-09-21T06:28:33.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:32.850+0000 7f8b030cf640 1 -- 172.21.15.49:0/2183902714 wait complete. 2024-09-21T06:28:33.885 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:33.906 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:33.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:33 smithi049 ceph-mon[31177]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:33.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:33 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2183902714' entity='client.admin' 2024-09-21T06:28:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:33 smithi098 ceph-mon[34704]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:34.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:33 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2183902714' entity='client.admin' 2024-09-21T06:28:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:33 smithi079 ceph-mon[34346]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:33 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2183902714' entity='client.admin' 2024-09-21T06:28:34.327 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi049') 2024-09-21T06:28:35.927 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:35 smithi049 ceph-mon[31177]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:35.927 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:35.927 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:35.927 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:35 smithi049 ceph-mon[31177]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:28:35.928 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:35.928 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:35.928 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:35.928 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:35 smithi049 ceph-mon[31177]: Reconfiguring daemon mon.b on smithi079 2024-09-21T06:28:36.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.028+0000 7fb9158f7640 1 -- 172.21.15.49:0/2994572959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9101094a0 msgr2=0x7fb9101098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:36.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.028+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2994572959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9101094a0 0x7fb9101098b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb904009900 tx=0x7fb90402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:36.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.028+0000 7fb9158f7640 1 -- 172.21.15.49:0/2994572959 shutdown_connections 2024-09-21T06:28:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.028+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2994572959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb910109df0 0x7fb910110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.028+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2994572959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9101094a0 0x7fb9101098b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.028+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2994572959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb910103b60 0x7fb910103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.028+0000 7fb9158f7640 1 -- 172.21.15.49:0/2994572959 >> 172.21.15.49:0/2994572959 conn(0x7fb91007b850 msgr2=0x7fb91007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.028+0000 7fb9158f7640 1 -- 172.21.15.49:0/2994572959 shutdown_connections 2024-09-21T06:28:36.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.028+0000 7fb9158f7640 1 -- 172.21.15.49:0/2994572959 wait complete. 2024-09-21T06:28:36.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.029+0000 7fb9158f7640 1 Processor -- start 2024-09-21T06:28:36.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.029+0000 7fb9158f7640 1 -- start start 2024-09-21T06:28:36.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb9158f7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb910103b60 0x7fb910075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb9158f7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9101094a0 0x7fb910075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb9158f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb910109df0 0x7fb910076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb9158f7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb910113ab0 con 0x7fb910109df0 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb9158f7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb910113930 con 0x7fb9101094a0 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb9158f7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb910113c30 con 0x7fb910103b60 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb910109df0 0x7fb910076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb910109df0 0x7fb910076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50190/0 (socket says 172.21.15.49:50190) 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90f7fe640 1 -- 172.21.15.49:0/2073773005 learned_addr learned my addr 172.21.15.49:0/2073773005 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90e7fc640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9101094a0 0x7fb910075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90effd640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb910103b60 0x7fb910075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90f7fe640 1 -- 172.21.15.49:0/2073773005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb910103b60 msgr2=0x7fb910075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:36.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90f7fe640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb910103b60 0x7fb910075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90f7fe640 1 -- 172.21.15.49:0/2073773005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9101094a0 msgr2=0x7fb910075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90f7fe640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9101094a0 0x7fb910075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90f7fe640 1 -- 172.21.15.49:0/2073773005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9101a8780 con 0x7fb910109df0 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90e7fc640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9101094a0 0x7fb910075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.030+0000 7fb90f7fe640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb910109df0 0x7fb910076190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb90800eaa0 tx=0x7fb90800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.031+0000 7fb9148f5640 1 -- 172.21.15.49:0/2073773005 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90800cdb0 con 0x7fb910109df0 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.031+0000 7fb9148f5640 1 -- 172.21.15.49:0/2073773005 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb908005020 con 0x7fb910109df0 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.031+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9101a8a70 con 0x7fb910109df0 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.031+0000 7fb9148f5640 1 -- 172.21.15.49:0/2073773005 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9080116d0 con 0x7fb910109df0 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.031+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9101a8f30 con 0x7fb910109df0 2024-09-21T06:28:36.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.032+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb910103f70 con 0x7fb910109df0 2024-09-21T06:28:36.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.033+0000 7fb9148f5640 1 -- 172.21.15.49:0/2073773005 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fb9080051d0 con 0x7fb910109df0 2024-09-21T06:28:36.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.034+0000 7fb9148f5640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8f80b64d0 0x7fb8f80b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.034+0000 7fb90effd640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8f80b64d0 0x7fb8f80b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.034+0000 7fb9148f5640 1 -- 172.21.15.49:0/2073773005 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb9080e5bf0 con 0x7fb910109df0 2024-09-21T06:28:36.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.035+0000 7fb90effd640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8f80b64d0 0x7fb8f80b89e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb910077160 tx=0x7fb90000b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:36.039 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:35 smithi079 ceph-mon[34346]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:36.039 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:36.039 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:36.039 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:35 smithi079 ceph-mon[34346]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:28:36.039 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:36.039 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:36.039 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:36.040 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:35 smithi079 ceph-mon[34346]: Reconfiguring daemon mon.b on smithi079 2024-09-21T06:28:36.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.037+0000 7fb9148f5640 1 -- 172.21.15.49:0/2073773005 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb908016030 con 0x7fb910109df0 2024-09-21T06:28:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:35 smithi098 ceph-mon[34704]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:35 smithi098 ceph-mon[34704]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:28:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:35 smithi098 ceph-mon[34704]: Reconfiguring daemon mon.b on smithi079 2024-09-21T06:28:36.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.230+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fb91002e640 con 0x7fb910109df0 2024-09-21T06:28:36.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.234+0000 7fb9148f5640 1 -- 172.21.15.49:0/2073773005 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v29)=0 v29) ==== 121+0+0 (secure 0 0 0) 0x7fb9080b2460 con 0x7fb910109df0 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8f80b64d0 msgr2=0x7fb8f80b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8f80b64d0 0x7fb8f80b89e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb910077160 tx=0x7fb90000b410 comp rx=0 tx=0).stop 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb910109df0 msgr2=0x7fb910076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb910109df0 0x7fb910076190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb90800eaa0 tx=0x7fb90800ef60 comp rx=0 tx=0).stop 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 shutdown_connections 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8f80b64d0 0x7fb8f80b89e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb910109df0 0x7fb910076190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9101094a0 0x7fb910075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 --2- 172.21.15.49:0/2073773005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb910103b60 0x7fb910075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:36.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.236+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 >> 172.21.15.49:0/2073773005 conn(0x7fb91007b850 msgr2=0x7fb910107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.237+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 shutdown_connections 2024-09-21T06:28:36.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:36.237+0000 7fb9158f7640 1 -- 172.21.15.49:0/2073773005 wait complete. 2024-09-21T06:28:36.425 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi049') 2024-09-21T06:28:36.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi049') 2024-09-21T06:28:36.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi049') 2024-09-21T06:28:36.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi049') 2024-09-21T06:28:36.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi049') 2024-09-21T06:28:36.426 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi049') 2024-09-21T06:28:37.354 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:37 smithi098 ceph-mon[34704]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:37.397 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:37.397 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:37.397 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:37 smithi098 ceph-mon[34704]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:28:37.397 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:37.398 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:37.398 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:37.398 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:37 smithi098 ceph-mon[34704]: Reconfiguring daemon mon.c on smithi098 2024-09-21T06:28:37.398 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:37 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2073773005' entity='client.admin' 2024-09-21T06:28:37.411 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:37 smithi049 ceph-mon[31177]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:37.412 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:37.412 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:37.412 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:37 smithi049 ceph-mon[31177]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:28:37.412 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:37.412 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:37.412 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:37.412 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:37 smithi049 ceph-mon[31177]: Reconfiguring daemon mon.c on smithi098 2024-09-21T06:28:37.412 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:37 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2073773005' entity='client.admin' 2024-09-21T06:28:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.417+0000 7f7719fa4640 1 -- 172.21.15.49:0/4035756727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714108d20 msgr2=0x7f771410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.417+0000 7f7719fa4640 1 --2- 172.21.15.49:0/4035756727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714108d20 0x7f771410f550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f770c009ca0 tx=0x7f770c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.417+0000 7f7719fa4640 1 -- 172.21.15.49:0/4035756727 shutdown_connections 2024-09-21T06:28:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.417+0000 7f7719fa4640 1 --2- 172.21.15.49:0/4035756727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714108d20 0x7f771410f550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.417+0000 7f7719fa4640 1 --2- 172.21.15.49:0/4035756727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77141083d0 0x7f77141087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.417+0000 7f7719fa4640 1 --2- 172.21.15.49:0/4035756727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7714102ae0 0x7f7714102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.417+0000 7f7719fa4640 1 -- 172.21.15.49:0/4035756727 >> 172.21.15.49:0/4035756727 conn(0x7f7714079790 msgr2=0x7f7714079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:37.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.417+0000 7f7719fa4640 1 -- 172.21.15.49:0/4035756727 shutdown_connections 2024-09-21T06:28:37.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.417+0000 7f7719fa4640 1 -- 172.21.15.49:0/4035756727 wait complete. 2024-09-21T06:28:37.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f7719fa4640 1 Processor -- start 2024-09-21T06:28:37.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f7719fa4640 1 -- start start 2024-09-21T06:28:37.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f7719fa4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714102ae0 0x7f771419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f7719fa4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77141083d0 0x7f771419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f7719fa4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7714108d20 0x7f771419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f7719fa4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7714113b90 con 0x7f7714102ae0 2024-09-21T06:28:37.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f7719fa4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7714113a10 con 0x7f7714108d20 2024-09-21T06:28:37.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f7719fa4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7714113d10 con 0x7f77141083d0 2024-09-21T06:28:37.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f77137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714102ae0 0x7f771419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f77137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714102ae0 0x7f771419a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40216/0 (socket says 172.21.15.49:40216) 2024-09-21T06:28:37.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f77137fe640 1 -- 172.21.15.49:0/1442095240 learned_addr learned my addr 172.21.15.49:0/1442095240 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:37.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f7713fff640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7714108d20 0x7f771419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.418+0000 7f770bfff640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77141083d0 0x7f771419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.419+0000 7f77137fe640 1 -- 172.21.15.49:0/1442095240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77141083d0 msgr2=0x7f771419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.419+0000 7f77137fe640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77141083d0 0x7f771419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.419+0000 7f77137fe640 1 -- 172.21.15.49:0/1442095240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7714108d20 msgr2=0x7f771419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.419+0000 7f77137fe640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7714108d20 0x7f771419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.419+0000 7f77137fe640 1 -- 172.21.15.49:0/1442095240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77141a04d0 con 0x7f7714102ae0 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.419+0000 7f770bfff640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77141083d0 0x7f771419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.419+0000 7f7713fff640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7714108d20 0x7f771419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.419+0000 7f77137fe640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714102ae0 0x7f771419a560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f770400b4a0 tx=0x7f770400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.420+0000 7f77117fa640 1 -- 172.21.15.49:0/1442095240 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704014070 con 0x7f7714102ae0 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.420+0000 7f77117fa640 1 -- 172.21.15.49:0/1442095240 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7704010ac0 con 0x7f7714102ae0 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.420+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77141a07c0 con 0x7f7714102ae0 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.420+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77141a6f20 con 0x7f7714102ae0 2024-09-21T06:28:37.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.420+0000 7f77117fa640 1 -- 172.21.15.49:0/1442095240 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704017c30 con 0x7f7714102ae0 2024-09-21T06:28:37.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.421+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7714102ef0 con 0x7f7714102ae0 2024-09-21T06:28:37.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.423+0000 7f77117fa640 1 -- 172.21.15.49:0/1442095240 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f7704017070 con 0x7f7714102ae0 2024-09-21T06:28:37.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.423+0000 7f77117fa640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77000b64d0 0x7f77000b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.423+0000 7f770bfff640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77000b64d0 0x7f77000b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.424+0000 7f77117fa640 1 -- 172.21.15.49:0/1442095240 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f77040e4dc0 con 0x7f7714102ae0 2024-09-21T06:28:37.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.424+0000 7f770bfff640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77000b64d0 0x7f77000b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7714107ea0 tx=0x7f76fc005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.427+0000 7f77117fa640 1 -- 172.21.15.49:0/1442095240 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f77040b1630 con 0x7f7714102ae0 2024-09-21T06:28:37.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:37 smithi079 ceph-mon[34346]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:37.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:37.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:37.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:37 smithi079 ceph-mon[34346]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:28:37.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:28:37.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:28:37.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:37.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:37 smithi079 ceph-mon[34346]: Reconfiguring daemon mon.c on smithi098 2024-09-21T06:28:37.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:37 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2073773005' entity='client.admin' 2024-09-21T06:28:37.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.617+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f771419b690 con 0x7f7714102ae0 2024-09-21T06:28:37.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.621+0000 7f77117fa640 1 -- 172.21.15.49:0/1442095240 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7f771419b690 con 0x7f7714102ae0 2024-09-21T06:28:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.623+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77000b64d0 msgr2=0x7f77000b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.623+0000 7f7719fa4640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77000b64d0 0x7f77000b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7714107ea0 tx=0x7f76fc005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:37.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.623+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714102ae0 msgr2=0x7f771419a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.623+0000 7f7719fa4640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714102ae0 0x7f771419a560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f770400b4a0 tx=0x7f770400b960 comp rx=0 tx=0).stop 2024-09-21T06:28:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.624+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 shutdown_connections 2024-09-21T06:28:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.624+0000 7f7719fa4640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77000b64d0 0x7f77000b89e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.624+0000 7f7719fa4640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7714108d20 0x7f771419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.624+0000 7f7719fa4640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77141083d0 0x7f771419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.624+0000 7f7719fa4640 1 --2- 172.21.15.49:0/1442095240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7714102ae0 0x7f771419a560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.624+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 >> 172.21.15.49:0/1442095240 conn(0x7f7714079790 msgr2=0x7f7714106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.624+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 shutdown_connections 2024-09-21T06:28:37.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.624+0000 7f7719fa4640 1 -- 172.21.15.49:0/1442095240 wait complete. 2024-09-21T06:28:37.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 -- 172.21.15.49:0/2472294126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 msgr2=0x7f9474110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 --2- 172.21.15.49:0/2472294126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 0x7f9474110620 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f946c009ca0 tx=0x7f946c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 -- 172.21.15.49:0/2472294126 shutdown_connections 2024-09-21T06:28:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 --2- 172.21.15.49:0/2472294126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 0x7f9474110620 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 --2- 172.21.15.49:0/2472294126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f94741094a0 0x7f94741098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 --2- 172.21.15.49:0/2472294126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9474103b60 0x7f9474103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 -- 172.21.15.49:0/2472294126 >> 172.21.15.49:0/2472294126 conn(0x7f947407b850 msgr2=0x7f947407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 -- 172.21.15.49:0/2472294126 shutdown_connections 2024-09-21T06:28:37.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 -- 172.21.15.49:0/2472294126 wait complete. 2024-09-21T06:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 Processor -- start 2024-09-21T06:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.931+0000 7f947a319640 1 -- start start 2024-09-21T06:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f947a319640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9474103b60 0x7f9474075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f947a319640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94741094a0 0x7f9474075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f947a319640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 0x7f9474076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f947a319640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9474113ab0 con 0x7f9474109df0 2024-09-21T06:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f947a319640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9474113930 con 0x7f94741094a0 2024-09-21T06:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f947a319640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9474113c30 con 0x7f9474103b60 2024-09-21T06:28:37.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f94788b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 0x7f9474076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f9473fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9474103b60 0x7f9474075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f9473fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9474103b60 0x7f9474075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:43388/0 (socket says 172.21.15.49:43388) 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f9473fff640 1 -- 172.21.15.49:0/2942701373 learned_addr learned my addr 172.21.15.49:0/2942701373 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f94788b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 0x7f9474076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40236/0 (socket says 172.21.15.49:40236) 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f94737fe640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94741094a0 0x7f9474075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f94788b6640 1 -- 172.21.15.49:0/2942701373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9474103b60 msgr2=0x7f9474075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f94788b6640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9474103b60 0x7f9474075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f94788b6640 1 -- 172.21.15.49:0/2942701373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94741094a0 msgr2=0x7f9474075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f94788b6640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94741094a0 0x7f9474075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f94788b6640 1 -- 172.21.15.49:0/2942701373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94741a8610 con 0x7f9474109df0 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.932+0000 7f9473fff640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9474103b60 0x7f9474075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.933+0000 7f94788b6640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 0x7f9474076190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f946c02ade0 tx=0x7f946c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.933+0000 7f94717fa640 1 -- 172.21.15.49:0/2942701373 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c003bf0 con 0x7f9474109df0 2024-09-21T06:28:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.933+0000 7f94717fa640 1 -- 172.21.15.49:0/2942701373 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f946c003d90 con 0x7f9474109df0 2024-09-21T06:28:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.933+0000 7f94717fa640 1 -- 172.21.15.49:0/2942701373 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c02fbd0 con 0x7f9474109df0 2024-09-21T06:28:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.933+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94741a88a0 con 0x7f9474109df0 2024-09-21T06:28:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.933+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94741a8e30 con 0x7f9474109df0 2024-09-21T06:28:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.934+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9474103f70 con 0x7f9474109df0 2024-09-21T06:28:37.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.936+0000 7f94717fa640 1 -- 172.21.15.49:0/2942701373 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f946c02fd70 con 0x7f9474109df0 2024-09-21T06:28:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.937+0000 7f94717fa640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f945c0b6550 0x7f945c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:37.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.937+0000 7f9473fff640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f945c0b6550 0x7f945c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.937+0000 7f94717fa640 1 -- 172.21.15.49:0/2942701373 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f946c106ae0 con 0x7f9474109df0 2024-09-21T06:28:37.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.937+0000 7f9473fff640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f945c0b6550 0x7f945c0b8a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9474077160 tx=0x7f946400a380 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:37.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:37.940+0000 7f94717fa640 1 -- 172.21.15.49:0/2942701373 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f946c0cef70 con 0x7f9474109df0 2024-09-21T06:28:38.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.129+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f9474076a10 con 0x7f9474109df0 2024-09-21T06:28:38.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.133+0000 7f94717fa640 1 -- 172.21.15.49:0/2942701373 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v31)=0 v31) ==== 118+0+0 (secure 0 0 0) 0x7f9474076a10 con 0x7f9474109df0 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f945c0b6550 msgr2=0x7f945c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f945c0b6550 0x7f945c0b8a60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9474077160 tx=0x7f946400a380 comp rx=0 tx=0).stop 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 msgr2=0x7f9474076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 0x7f9474076190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f946c02ade0 tx=0x7f946c0319f0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 shutdown_connections 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f945c0b6550 0x7f945c0b8a60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9474109df0 0x7f9474076190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f94741094a0 0x7f9474075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 --2- 172.21.15.49:0/2942701373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9474103b60 0x7f9474075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 >> 172.21.15.49:0/2942701373 conn(0x7f947407b850 msgr2=0x7f9474107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 shutdown_connections 2024-09-21T06:28:38.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:38.136+0000 7f947a319640 1 -- 172.21.15.49:0/2942701373 wait complete. 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1442095240' entity='client.admin' 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:38 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2942701373' entity='client.admin' 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1442095240' entity='client.admin' 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:38.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.797 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:38 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2942701373' entity='client.admin' 2024-09-21T06:28:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1442095240' entity='client.admin' 2024-09-21T06:28:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:38.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:38.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:38.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:38.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:38 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2942701373' entity='client.admin' 2024-09-21T06:28:39.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:39 smithi049 ceph-mon[31177]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:39.776 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:39 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3113536579' entity='client.admin' 2024-09-21T06:28:39.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.869+0000 7f4cbfe52640 1 -- 172.21.15.49:0/2463754627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb8105300 msgr2=0x7f4cb810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:39.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.869+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/2463754627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb8105300 0x7f4cb810d850 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009900 tx=0x7f4ca802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:39.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.869+0000 7f4cbfe52640 1 -- 172.21.15.49:0/2463754627 shutdown_connections 2024-09-21T06:28:39.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.869+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/2463754627 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cb810de10 0x7f4cb8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:39.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.869+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/2463754627 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb8105300 0x7f4cb810d850 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:39.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.869+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/2463754627 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cb81049b0 0x7f4cb8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:39.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.869+0000 7f4cbfe52640 1 -- 172.21.15.49:0/2463754627 >> 172.21.15.49:0/2463754627 conn(0x7f4cb8079730 msgr2=0x7f4cb8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:39.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.869+0000 7f4cbfe52640 1 -- 172.21.15.49:0/2463754627 shutdown_connections 2024-09-21T06:28:39.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.869+0000 7f4cbfe52640 1 -- 172.21.15.49:0/2463754627 wait complete. 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.870+0000 7f4cbfe52640 1 Processor -- start 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.870+0000 7f4cbfe52640 1 -- start start 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.870+0000 7f4cbfe52640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb81049b0 0x7f4cb819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.870+0000 7f4cbfe52640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cb8105300 0x7f4cb819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.870+0000 7f4cbfe52640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cb810de10 0x7f4cb819fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbfe52640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8113a70 con 0x7f4cb81049b0 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbfe52640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81138f0 con 0x7f4cb8105300 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbfe52640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8113bf0 con 0x7f4cb810de10 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbdbee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb81049b0 0x7f4cb819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbdbee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb81049b0 0x7f4cb819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40282/0 (socket says 172.21.15.49:40282) 2024-09-21T06:28:39.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbdbee640 1 -- 172.21.15.49:0/3075583926 learned_addr learned my addr 172.21.15.49:0/3075583926 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbd3ed640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cb8105300 0x7f4cb819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbe3ef640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cb810de10 0x7f4cb819fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbdbee640 1 -- 172.21.15.49:0/3075583926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cb810de10 msgr2=0x7f4cb819fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbdbee640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cb810de10 0x7f4cb819fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbdbee640 1 -- 172.21.15.49:0/3075583926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cb8105300 msgr2=0x7f4cb819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbdbee640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cb8105300 0x7f4cb819aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbdbee640 1 -- 172.21.15.49:0/3075583926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb81a0410 con 0x7f4cb81049b0 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbe3ef640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cb810de10 0x7f4cb819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbd3ed640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cb8105300 0x7f4cb819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbdbee640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb81049b0 0x7f4cb819a4a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c970 tx=0x7f4cb400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4caeffd640 1 -- 172.21.15.49:0/3075583926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004220 con 0x7f4cb81049b0 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4caeffd640 1 -- 172.21.15.49:0/3075583926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb40043c0 con 0x7f4cb81049b0 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb81a0700 con 0x7f4cb81049b0 2024-09-21T06:28:39.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4caeffd640 1 -- 172.21.15.49:0/3075583926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004a00 con 0x7f4cb81049b0 2024-09-21T06:28:39.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.871+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb81a6e60 con 0x7f4cb81049b0 2024-09-21T06:28:39.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.873+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb806b560 con 0x7f4cb81049b0 2024-09-21T06:28:39.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.874+0000 7f4caeffd640 1 -- 172.21.15.49:0/3075583926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f4cb40079b0 con 0x7f4cb81049b0 2024-09-21T06:28:39.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.875+0000 7f4caeffd640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4ca40b64d0 0x7f4ca40b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:39.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.875+0000 7f4cbd3ed640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4ca40b64d0 0x7f4ca40b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:39.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.875+0000 7f4caeffd640 1 -- 172.21.15.49:0/3075583926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4cb40e5570 con 0x7f4cb81049b0 2024-09-21T06:28:39.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.875+0000 7f4cbd3ed640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4ca40b64d0 0x7f4ca40b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009230 tx=0x7f4ca8000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:39.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.879+0000 7f4caeffd640 1 -- 172.21.15.49:0/3075583926 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4cb4014030 con 0x7f4cb81049b0 2024-09-21T06:28:40.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:39 smithi098 ceph-mon[34704]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:40.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:39 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3113536579' entity='client.admin' 2024-09-21T06:28:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:39 smithi079 ceph-mon[34346]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:39 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3113536579' entity='client.admin' 2024-09-21T06:28:40.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.068+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f4cb819b680 con 0x7f4cb81049b0 2024-09-21T06:28:40.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.073+0000 7f4caeffd640 1 -- 172.21.15.49:0/3075583926 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f4cb40ada00 con 0x7f4cb81049b0 2024-09-21T06:28:40.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4ca40b64d0 msgr2=0x7f4ca40b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:40.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4ca40b64d0 0x7f4ca40b89e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009230 tx=0x7f4ca8000bc0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb81049b0 msgr2=0x7f4cb819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:40.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb81049b0 0x7f4cb819a4a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4cb400c970 tx=0x7f4cb400ce30 comp rx=0 tx=0).stop 2024-09-21T06:28:40.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 shutdown_connections 2024-09-21T06:28:40.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4ca40b64d0 0x7f4ca40b89e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4cb810de10 0x7f4cb819fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4cb8105300 0x7f4cb819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 --2- 172.21.15.49:0/3075583926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4cb81049b0 0x7f4cb819a4a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:40.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 >> 172.21.15.49:0/3075583926 conn(0x7f4cb8079730 msgr2=0x7f4cb80ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:40.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 shutdown_connections 2024-09-21T06:28:40.078 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:40.075+0000 7f4cbfe52640 1 -- 172.21.15.49:0/3075583926 wait complete. 2024-09-21T06:28:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.290+0000 7fe1c3aca640 1 -- 172.21.15.49:0/2936288391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 msgr2=0x7fe1bc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.290+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/2936288391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 0x7fe1bc102e90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009900 tx=0x7fe1b402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.290+0000 7fe1c3aca640 1 -- 172.21.15.49:0/2936288391 shutdown_connections 2024-09-21T06:28:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.290+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/2936288391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1bc108d10 0x7fe1bc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.290+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/2936288391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1bc1083c0 0x7fe1bc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.290+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/2936288391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 0x7fe1bc102e90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.290+0000 7fe1c3aca640 1 -- 172.21.15.49:0/2936288391 >> 172.21.15.49:0/2936288391 conn(0x7fe1bc079740 msgr2=0x7fe1bc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.291+0000 7fe1c3aca640 1 -- 172.21.15.49:0/2936288391 shutdown_connections 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.291+0000 7fe1c3aca640 1 -- 172.21.15.49:0/2936288391 wait complete. 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.291+0000 7fe1c3aca640 1 Processor -- start 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.291+0000 7fe1c3aca640 1 -- start start 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c3aca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 0x7fe1bc10ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c3aca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1bc1083c0 0x7fe1bc110510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c3aca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1bc108d10 0x7fe1bc110a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c3aca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc113aa0 con 0x7fe1bc102a80 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c3aca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc113920 con 0x7fe1bc1083c0 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c3aca640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe1bc113c20 con 0x7fe1bc108d10 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1866640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 0x7fe1bc10ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1866640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 0x7fe1bc10ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40256/0 (socket says 172.21.15.49:40256) 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1866640 1 -- 172.21.15.49:0/3113536579 learned_addr learned my addr 172.21.15.49:0/3113536579 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:41.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1065640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1bc1083c0 0x7fe1bc110510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c2067640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1bc108d10 0x7fe1bc110a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1866640 1 -- 172.21.15.49:0/3113536579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1bc108d10 msgr2=0x7fe1bc110a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1866640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1bc108d10 0x7fe1bc110a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1866640 1 -- 172.21.15.49:0/3113536579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1bc1083c0 msgr2=0x7fe1bc110510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1866640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1bc1083c0 0x7fe1bc110510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1866640 1 -- 172.21.15.49:0/3113536579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1bc1a8710 con 0x7fe1bc102a80 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1c1866640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 0x7fe1bc10ffd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4005940 tx=0x7fe1b40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1baffd640 1 -- 172.21.15.49:0/3113536579 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b403f030 con 0x7fe1bc102a80 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.292+0000 7fe1baffd640 1 -- 172.21.15.49:0/3113536579 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe1b40044c0 con 0x7fe1bc102a80 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.293+0000 7fe1baffd640 1 -- 172.21.15.49:0/3113536579 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1b4035070 con 0x7fe1bc102a80 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.293+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1bc1a89a0 con 0x7fe1bc102a80 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.293+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1bc1a8e30 con 0x7fe1bc102a80 2024-09-21T06:28:41.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.293+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1bc103d00 con 0x7fe1bc102a80 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.295+0000 7fe1baffd640 1 -- 172.21.15.49:0/3113536579 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fe1b4042030 con 0x7fe1bc102a80 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.296+0000 7fe1baffd640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe1a40b6550 0x7fe1a40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.296+0000 7fe1c1065640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe1a40b6550 0x7fe1a40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.296+0000 7fe1baffd640 1 -- 172.21.15.49:0/3113536579 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe1b4105d20 con 0x7fe1bc102a80 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.296+0000 7fe1c1065640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe1a40b6550 0x7fe1a40b8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc100c00 tx=0x7fe1b0009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.299+0000 7fe1baffd640 1 -- 172.21.15.49:0/3113536579 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1b40ce1b0 con 0x7fe1bc102a80 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.490+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fe1bc1112d0 con 0x7fe1bc102a80 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.494+0000 7fe1baffd640 1 -- 172.21.15.49:0/3113536579 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7fe1b40c9030 con 0x7fe1bc102a80 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.496+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe1a40b6550 msgr2=0x7fe1a40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.496+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe1a40b6550 0x7fe1a40b8a60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc100c00 tx=0x7fe1b0009500 comp rx=0 tx=0).stop 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.496+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 msgr2=0x7fe1bc10ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.496+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 0x7fe1bc10ffd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4005940 tx=0x7fe1b40040c0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.497+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 shutdown_connections 2024-09-21T06:28:41.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.497+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe1a40b6550 0x7fe1a40b8a60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.497+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe1bc108d10 0x7fe1bc110a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.497+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe1bc1083c0 0x7fe1bc110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.497+0000 7fe1c3aca640 1 --2- 172.21.15.49:0/3113536579 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe1bc102a80 0x7fe1bc10ffd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:41.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.497+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 >> 172.21.15.49:0/3113536579 conn(0x7fe1bc079740 msgr2=0x7fe1bc1013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:41.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.497+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 shutdown_connections 2024-09-21T06:28:41.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:39.497+0000 7fe1c3aca640 1 -- 172.21.15.49:0/3113536579 wait complete. 2024-09-21T06:28:41.352 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:41 smithi049 ceph-mon[31177]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:41.352 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:41 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3075583926' entity='client.admin' 2024-09-21T06:28:41.538 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:41.538 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:41.539 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:41.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:41 smithi098 ceph-mon[34704]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:41.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:41 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3075583926' entity='client.admin' 2024-09-21T06:28:41.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:41 smithi079 ceph-mon[34346]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:41.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:41 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3075583926' entity='client.admin' 2024-09-21T06:28:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.842+0000 7f99cb15b640 1 -- 172.21.15.49:0/1302473481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c41083d0 msgr2=0x7f99c41087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.842+0000 7f99cb15b640 1 --2- 172.21.15.49:0/1302473481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c41083d0 0x7f99c41087e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009900 tx=0x7f99b002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.842+0000 7f99cb15b640 1 -- 172.21.15.49:0/1302473481 shutdown_connections 2024-09-21T06:28:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.842+0000 7f99cb15b640 1 --2- 172.21.15.49:0/1302473481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99c4108d20 0x7f99c410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.842+0000 7f99cb15b640 1 --2- 172.21.15.49:0/1302473481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c41083d0 0x7f99c41087e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.842+0000 7f99cb15b640 1 --2- 172.21.15.49:0/1302473481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c4102ae0 0x7f99c4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.843+0000 7f99cb15b640 1 -- 172.21.15.49:0/1302473481 >> 172.21.15.49:0/1302473481 conn(0x7f99c4079760 msgr2=0x7f99c4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.843+0000 7f99cb15b640 1 -- 172.21.15.49:0/1302473481 shutdown_connections 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.843+0000 7f99cb15b640 1 -- 172.21.15.49:0/1302473481 wait complete. 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.843+0000 7f99cb15b640 1 Processor -- start 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.843+0000 7f99cb15b640 1 -- start start 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.843+0000 7f99cb15b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99c4102ae0 0x7f99c419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.843+0000 7f99cb15b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c41083d0 0x7f99c419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.843+0000 7f99cb15b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c4108d20 0x7f99c419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99cb15b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4113ab0 con 0x7f99c4108d20 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99cb15b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4113930 con 0x7f99c41083d0 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99cb15b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f99c4113c30 con 0x7f99c4102ae0 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c96f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c4108d20 0x7f99c419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c96f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c4108d20 0x7f99c419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40286/0 (socket says 172.21.15.49:40286) 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c96f8640 1 -- 172.21.15.49:0/3662400795 learned_addr learned my addr 172.21.15.49:0/3662400795 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c8ef7640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99c4102ae0 0x7f99c419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c3fff640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c41083d0 0x7f99c419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c96f8640 1 -- 172.21.15.49:0/3662400795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99c4102ae0 msgr2=0x7f99c419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c96f8640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99c4102ae0 0x7f99c419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c96f8640 1 -- 172.21.15.49:0/3662400795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c41083d0 msgr2=0x7f99c419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c96f8640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c41083d0 0x7f99c419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c96f8640 1 -- 172.21.15.49:0/3662400795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c41a0310 con 0x7f99c4108d20 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c96f8640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c4108d20 0x7f99c419fca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00cce0 tx=0x7f99bc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c1ffb640 1 -- 172.21.15.49:0/3662400795 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00f450 con 0x7f99c4108d20 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c1ffb640 1 -- 172.21.15.49:0/3662400795 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99bc00faa0 con 0x7f99c4108d20 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c41a0600 con 0x7f99c4108d20 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.844+0000 7f99c1ffb640 1 -- 172.21.15.49:0/3662400795 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc018b70 con 0x7f99c4108d20 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.845+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c41a6e20 con 0x7f99c4108d20 2024-09-21T06:28:43.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.846+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c4103d10 con 0x7f99c4108d20 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.847+0000 7f99c1ffb640 1 -- 172.21.15.49:0/3662400795 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f99bc018d10 con 0x7f99c4108d20 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.848+0000 7f99c1ffb640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99b40b6580 0x7f99b40b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.848+0000 7f99c8ef7640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99b40b6580 0x7f99b40b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.849+0000 7f99c1ffb640 1 -- 172.21.15.49:0/3662400795 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f99bc0e5b80 con 0x7f99c4108d20 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.849+0000 7f99c8ef7640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99b40b6580 0x7f99b40b8a90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005e10 tx=0x7f99b8005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:41.853+0000 7f99c1ffb640 1 -- 172.21.15.49:0/3662400795 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99bc014030 con 0x7f99c4108d20 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.044+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f99c410ab70 con 0x7f99c4108d20 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.048+0000 7f99c1ffb640 1 -- 172.21.15.49:0/3662400795 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v34)=0 v34) ==== 119+0+0 (secure 0 0 0) 0x7f99bc0ae010 con 0x7f99c4108d20 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99b40b6580 msgr2=0x7f99b40b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99b40b6580 0x7f99b40b8a90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005e10 tx=0x7f99b8005da0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c4108d20 msgr2=0x7f99c419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c4108d20 0x7f99c419fca0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00cce0 tx=0x7f99bc00a620 comp rx=0 tx=0).stop 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 shutdown_connections 2024-09-21T06:28:43.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99b40b6580 0x7f99b40b8a90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99c4108d20 0x7f99c419fca0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99c41083d0 0x7f99c419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 --2- 172.21.15.49:0/3662400795 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99c4102ae0 0x7f99c419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 >> 172.21.15.49:0/3662400795 conn(0x7f99c4079760 msgr2=0x7f99c41052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 shutdown_connections 2024-09-21T06:28:43.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:42.050+0000 7f99cb15b640 1 -- 172.21.15.49:0/3662400795 wait complete. 2024-09-21T06:28:43.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:43 smithi049 ceph-mon[31177]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:43.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:43 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3662400795' entity='client.admin' 2024-09-21T06:28:43.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:43 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:43.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:43 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:43.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:43 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:43.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:43 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:43.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:43 smithi079 ceph-mon[34346]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:43.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:43 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3662400795' entity='client.admin' 2024-09-21T06:28:43.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:43 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:43.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:43 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:43.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:43 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:43.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:43 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:43.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:43 smithi098 ceph-mon[34704]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:43.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:43 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3662400795' entity='client.admin' 2024-09-21T06:28:43.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:43 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:43.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:43 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:43.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:43 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:43.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:43 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:28:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 -- 172.21.15.49:0/1443598447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 msgr2=0x7f75c4103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 --2- 172.21.15.49:0/1443598447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 0x7f75c4103fc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009900 tx=0x7f75bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 -- 172.21.15.49:0/1443598447 shutdown_connections 2024-09-21T06:28:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 --2- 172.21.15.49:0/1443598447 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c4109e40 0x7f75c4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 --2- 172.21.15.49:0/1443598447 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75c41094f0 0x7f75c4109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 --2- 172.21.15.49:0/1443598447 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 0x7f75c4103fc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 -- 172.21.15.49:0/1443598447 >> 172.21.15.49:0/1443598447 conn(0x7f75c40ff600 msgr2=0x7f75c4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 -- 172.21.15.49:0/1443598447 shutdown_connections 2024-09-21T06:28:44.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 -- 172.21.15.49:0/1443598447 wait complete. 2024-09-21T06:28:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.352+0000 7f75cc7db640 1 Processor -- start 2024-09-21T06:28:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75cc7db640 1 -- start start 2024-09-21T06:28:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75cc7db640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 0x7f75c419c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75cc7db640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c41094f0 0x7f75c419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75cc7db640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75c4109e40 0x7f75c41a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75cc7db640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4113b00 con 0x7f75c4103bb0 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75cc7db640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4113980 con 0x7f75c41094f0 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75cc7db640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f75c4113c80 con 0x7f75c4109e40 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75ca577640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 0x7f75c419c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75ca577640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 0x7f75c419c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40300/0 (socket says 172.21.15.49:40300) 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75ca577640 1 -- 172.21.15.49:0/856563878 learned_addr learned my addr 172.21.15.49:0/856563878 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75cad78640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75c4109e40 0x7f75c41a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75c9d76640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c41094f0 0x7f75c419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75ca577640 1 -- 172.21.15.49:0/856563878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75c4109e40 msgr2=0x7f75c41a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75ca577640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75c4109e40 0x7f75c41a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75ca577640 1 -- 172.21.15.49:0/856563878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c41094f0 msgr2=0x7f75c419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75ca577640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c41094f0 0x7f75c419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.353+0000 7f75ca577640 1 -- 172.21.15.49:0/856563878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c41a2660 con 0x7f75c4103bb0 2024-09-21T06:28:44.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.354+0000 7f75ca577640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 0x7f75c419c6f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75bc005940 tx=0x7f75bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.354+0000 7f75c37fe640 1 -- 172.21.15.49:0/856563878 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc03f030 con 0x7f75c4103bb0 2024-09-21T06:28:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.354+0000 7f75c37fe640 1 -- 172.21.15.49:0/856563878 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75bc003aa0 con 0x7f75c4103bb0 2024-09-21T06:28:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.354+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75c41a28f0 con 0x7f75c4103bb0 2024-09-21T06:28:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.354+0000 7f75c37fe640 1 -- 172.21.15.49:0/856563878 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75bc035070 con 0x7f75c4103bb0 2024-09-21T06:28:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.354+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75c41a90b0 con 0x7f75c4103bb0 2024-09-21T06:28:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.355+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75c4103fc0 con 0x7f75c4103bb0 2024-09-21T06:28:44.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.357+0000 7f75c37fe640 1 -- 172.21.15.49:0/856563878 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f75bc042030 con 0x7f75c4103bb0 2024-09-21T06:28:44.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.358+0000 7f75c37fe640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75ac0b6550 0x7f75ac0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.358+0000 7f75c9d76640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75ac0b6550 0x7f75ac0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.358+0000 7f75c37fe640 1 -- 172.21.15.49:0/856563878 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f75bc105d50 con 0x7f75c4103bb0 2024-09-21T06:28:44.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.358+0000 7f75c9d76640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75ac0b6550 0x7f75ac0b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75c4107f10 tx=0x7f75b8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.362+0000 7f75c37fe640 1 -- 172.21.15.49:0/856563878 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75bc0d25c0 con 0x7f75c4103bb0 2024-09-21T06:28:44.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.533+0000 7f8506fca640 1 -- 172.21.15.49:0/2736918974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 msgr2=0x7f850010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.533+0000 7f8506fca640 1 --2- 172.21.15.49:0/2736918974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 0x7f850010f560 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009ca0 tx=0x7f84f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.533+0000 7f8506fca640 1 -- 172.21.15.49:0/2736918974 shutdown_connections 2024-09-21T06:28:44.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.533+0000 7f8506fca640 1 --2- 172.21.15.49:0/2736918974 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 0x7f850010f560 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.533+0000 7f8506fca640 1 --2- 172.21.15.49:0/2736918974 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f85001083e0 0x7f85001087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.533+0000 7f8506fca640 1 --2- 172.21.15.49:0/2736918974 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8500102aa0 0x7f8500102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.533+0000 7f8506fca640 1 -- 172.21.15.49:0/2736918974 >> 172.21.15.49:0/2736918974 conn(0x7f85000797e0 msgr2=0x7f8500079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.533+0000 7f8506fca640 1 -- 172.21.15.49:0/2736918974 shutdown_connections 2024-09-21T06:28:44.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.533+0000 7f8506fca640 1 -- 172.21.15.49:0/2736918974 wait complete. 2024-09-21T06:28:44.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.534+0000 7f8506fca640 1 Processor -- start 2024-09-21T06:28:44.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.534+0000 7f8506fca640 1 -- start start 2024-09-21T06:28:44.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.534+0000 7f8506fca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8500102aa0 0x7f85001993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.534+0000 7f8506fca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85001083e0 0x7f8500199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.534+0000 7f8506fca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 0x7f850019ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.534+0000 7f8506fca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f85001129a0 con 0x7f8500108d30 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.534+0000 7f8506fca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8500112820 con 0x7f85001083e0 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.534+0000 7f8506fca640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8500112b20 con 0x7f8500102aa0 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8505567640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 0x7f850019ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8505567640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 0x7f850019ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40314/0 (socket says 172.21.15.49:40314) 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8505567640 1 -- 172.21.15.49:0/1797207457 learned_addr learned my addr 172.21.15.49:0/1797207457 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f84fffff640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85001083e0 0x7f8500199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8504d66640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8500102aa0 0x7f85001993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8505567640 1 -- 172.21.15.49:0/1797207457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8500102aa0 msgr2=0x7f85001993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8505567640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8500102aa0 0x7f85001993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8505567640 1 -- 172.21.15.49:0/1797207457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85001083e0 msgr2=0x7f8500199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8505567640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85001083e0 0x7f8500199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8505567640 1 -- 172.21.15.49:0/1797207457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850019f320 con 0x7f8500108d30 2024-09-21T06:28:44.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f8505567640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 0x7f850019ebf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f84f8005cc0 tx=0x7f84f802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f84fdffb640 1 -- 172.21.15.49:0/1797207457 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8003bf0 con 0x7f8500108d30 2024-09-21T06:28:44.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.535+0000 7f84fdffb640 1 -- 172.21.15.49:0/1797207457 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84f8003d90 con 0x7f8500108d30 2024-09-21T06:28:44.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.536+0000 7f84fdffb640 1 -- 172.21.15.49:0/1797207457 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f802fbc0 con 0x7f8500108d30 2024-09-21T06:28:44.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.536+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f850019f5b0 con 0x7f8500108d30 2024-09-21T06:28:44.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.536+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85001a5d70 con 0x7f8500108d30 2024-09-21T06:28:44.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.537+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8500103d20 con 0x7f8500108d30 2024-09-21T06:28:44.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.539+0000 7f84fdffb640 1 -- 172.21.15.49:0/1797207457 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f84f802fd60 con 0x7f8500108d30 2024-09-21T06:28:44.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.540+0000 7f84fdffb640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84f00b6550 0x7f84f00b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:44.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.540+0000 7f8504d66640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84f00b6550 0x7f84f00b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:44.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.540+0000 7f84fdffb640 1 -- 172.21.15.49:0/1797207457 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f84f8106d10 con 0x7f8500108d30 2024-09-21T06:28:44.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.541+0000 7f8504d66640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84f00b6550 0x7f84f00b8a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84f400bbe0 tx=0x7f84f400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:44.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.543+0000 7f84fdffb640 1 -- 172.21.15.49:0/1797207457 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84f80cf100 con 0x7f8500108d30 2024-09-21T06:28:44.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.561+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f75c41a92e0 con 0x7f75c4103bb0 2024-09-21T06:28:44.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.565+0000 7f75c37fe640 1 -- 172.21.15.49:0/856563878 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v35)=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7f75bc0d7500 con 0x7f75c4103bb0 2024-09-21T06:28:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75ac0b6550 msgr2=0x7f75ac0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75ac0b6550 0x7f75ac0b8a60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75c4107f10 tx=0x7f75b8005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 msgr2=0x7f75c419c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 0x7f75c419c6f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75bc005940 tx=0x7f75bc004270 comp rx=0 tx=0).stop 2024-09-21T06:28:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 shutdown_connections 2024-09-21T06:28:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75ac0b6550 0x7f75ac0b8a60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75c4109e40 0x7f75c41a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75c41094f0 0x7f75c419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 --2- 172.21.15.49:0/856563878 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f75c4103bb0 0x7f75c419c6f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 >> 172.21.15.49:0/856563878 conn(0x7f75c40ff600 msgr2=0x7f75c4108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 shutdown_connections 2024-09-21T06:28:44.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.567+0000 7f75cc7db640 1 -- 172.21.15.49:0/856563878 wait complete. 2024-09-21T06:28:44.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.745+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f8500102eb0 con 0x7f8500108d30 2024-09-21T06:28:44.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.750+0000 7f84fdffb640 1 -- 172.21.15.49:0/1797207457 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v36)=0 v36) ==== 116+0+0 (secure 0 0 0) 0x7f8500102eb0 con 0x7f8500108d30 2024-09-21T06:28:44.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84f00b6550 msgr2=0x7f84f00b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84f00b6550 0x7f84f00b8a60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84f400bbe0 tx=0x7f84f400b390 comp rx=0 tx=0).stop 2024-09-21T06:28:44.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 msgr2=0x7f850019ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:44.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 0x7f850019ebf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f84f8005cc0 tx=0x7f84f802f380 comp rx=0 tx=0).stop 2024-09-21T06:28:44.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 shutdown_connections 2024-09-21T06:28:44.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84f00b6550 0x7f84f00b8a60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8500108d30 0x7f850019ebf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f85001083e0 0x7f8500199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 --2- 172.21.15.49:0/1797207457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8500102aa0 0x7f85001993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:44.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 >> 172.21.15.49:0/1797207457 conn(0x7f85000797e0 msgr2=0x7f85001043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:44.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 shutdown_connections 2024-09-21T06:28:44.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:44.752+0000 7f8506fca640 1 -- 172.21.15.49:0/1797207457 wait complete. 2024-09-21T06:28:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.163+0000 7f8ae39c2640 1 -- 172.21.15.49:0/4093892019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 msgr2=0x7f8adc1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.163+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/4093892019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 0x7f8adc1087c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8acc009900 tx=0x7f8acc02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.163+0000 7f8ae39c2640 1 -- 172.21.15.49:0/4093892019 shutdown_connections 2024-09-21T06:28:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.163+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/4093892019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8adc108d00 0x7f8adc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.163+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/4093892019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 0x7f8adc1087c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.163+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/4093892019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8adc102a70 0x7f8adc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.163+0000 7f8ae39c2640 1 -- 172.21.15.49:0/4093892019 >> 172.21.15.49:0/4093892019 conn(0x7f8adc079730 msgr2=0x7f8adc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.163+0000 7f8ae39c2640 1 -- 172.21.15.49:0/4093892019 shutdown_connections 2024-09-21T06:28:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.163+0000 7f8ae39c2640 1 -- 172.21.15.49:0/4093892019 wait complete. 2024-09-21T06:28:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae39c2640 1 Processor -- start 2024-09-21T06:28:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae39c2640 1 -- start start 2024-09-21T06:28:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae39c2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8adc102a70 0x7f8adc19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae39c2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 0x7f8adc19ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae39c2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8adc108d00 0x7f8adc19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae39c2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc113a90 con 0x7f8adc1083b0 2024-09-21T06:28:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae39c2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc113910 con 0x7f8adc102a70 2024-09-21T06:28:45.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae39c2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8adc113c10 con 0x7f8adc108d00 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae0f5d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 0x7f8adc19ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae0f5d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 0x7f8adc19ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40330/0 (socket says 172.21.15.49:40330) 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.164+0000 7f8ae0f5d640 1 -- 172.21.15.49:0/3680980800 learned_addr learned my addr 172.21.15.49:0/3680980800 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae175e640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8adc102a70 0x7f8adc19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae0f5d640 1 -- 172.21.15.49:0/3680980800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8adc108d00 msgr2=0x7f8adc19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae1f5f640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8adc108d00 0x7f8adc19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae0f5d640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8adc108d00 0x7f8adc19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae0f5d640 1 -- 172.21.15.49:0/3680980800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8adc102a70 msgr2=0x7f8adc19a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae0f5d640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8adc102a70 0x7f8adc19a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae0f5d640 1 -- 172.21.15.49:0/3680980800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc1a0470 con 0x7f8adc1083b0 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae175e640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8adc102a70 0x7f8adc19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:45.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae1f5f640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8adc108d00 0x7f8adc19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:45.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae0f5d640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 0x7f8adc19ab60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8acc032fd0 tx=0x7f8acc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:45.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ad27fc640 1 -- 172.21.15.49:0/3680980800 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc03f030 con 0x7f8adc1083b0 2024-09-21T06:28:45.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ad27fc640 1 -- 172.21.15.49:0/3680980800 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8acc004490 con 0x7f8adc1083b0 2024-09-21T06:28:45.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8adc1a0700 con 0x7f8adc1083b0 2024-09-21T06:28:45.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ad27fc640 1 -- 172.21.15.49:0/3680980800 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8acc035070 con 0x7f8adc1083b0 2024-09-21T06:28:45.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.165+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8adc1a0c30 con 0x7f8adc1083b0 2024-09-21T06:28:45.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.166+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8adc103cf0 con 0x7f8adc1083b0 2024-09-21T06:28:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.168+0000 7f8ad27fc640 1 -- 172.21.15.49:0/3680980800 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f8acc042030 con 0x7f8adc1083b0 2024-09-21T06:28:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.168+0000 7f8ad27fc640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ac80b6580 0x7f8ac80b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.169+0000 7f8ae175e640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ac80b6580 0x7f8ac80b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.169+0000 7f8ad27fc640 1 -- 172.21.15.49:0/3680980800 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8acc106000 con 0x7f8adc1083b0 2024-09-21T06:28:45.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.169+0000 7f8ae175e640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ac80b6580 0x7f8ac80b8a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800abe0 tx=0x7f8ad800a5c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:45.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.172+0000 7f8ad27fc640 1 -- 172.21.15.49:0/3680980800 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8adc1a0c30 con 0x7f8adc1083b0 2024-09-21T06:28:45.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.362+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f8adc102e80 con 0x7f8adc1083b0 2024-09-21T06:28:45.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.366+0000 7f8ad27fc640 1 -- 172.21.15.49:0/3680980800 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v37)=0 v37) ==== 120+0+0 (secure 0 0 0) 0x7f8adc102e80 con 0x7f8adc1083b0 2024-09-21T06:28:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ac80b6580 msgr2=0x7f8ac80b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ac80b6580 0x7f8ac80b8a90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800abe0 tx=0x7f8ad800a5c0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 msgr2=0x7f8adc19ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 0x7f8adc19ab60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8acc032fd0 tx=0x7f8acc004270 comp rx=0 tx=0).stop 2024-09-21T06:28:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 shutdown_connections 2024-09-21T06:28:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ac80b6580 0x7f8ac80b8a90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8adc108d00 0x7f8adc19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8adc1083b0 0x7f8adc19ab60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 --2- 172.21.15.49:0/3680980800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8adc102a70 0x7f8adc19a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 >> 172.21.15.49:0/3680980800 conn(0x7f8adc079730 msgr2=0x7f8adc104580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 shutdown_connections 2024-09-21T06:28:45.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:45.369+0000 7f8ae39c2640 1 -- 172.21.15.49:0/3680980800 wait complete. 2024-09-21T06:28:45.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:45 smithi049 ceph-mon[31177]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:45.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:45 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/856563878' entity='client.admin' 2024-09-21T06:28:45.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:45 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1797207457' entity='client.admin' 2024-09-21T06:28:45.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:45 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3680980800' entity='client.admin' 2024-09-21T06:28:45.785 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi049') 2024-09-21T06:28:45.785 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi049') 2024-09-21T06:28:45.785 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi049') 2024-09-21T06:28:45.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:45 smithi079 ceph-mon[34346]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:45.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:45 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/856563878' entity='client.admin' 2024-09-21T06:28:45.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:45 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1797207457' entity='client.admin' 2024-09-21T06:28:45.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:45 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3680980800' entity='client.admin' 2024-09-21T06:28:46.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:45 smithi098 ceph-mon[34704]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:46.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:45 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/856563878' entity='client.admin' 2024-09-21T06:28:46.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:45 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1797207457' entity='client.admin' 2024-09-21T06:28:46.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:45 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3680980800' entity='client.admin' 2024-09-21T06:28:46.689 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.690 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.690 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.690 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.690 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.690 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.690 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.690 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.690 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.691 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.691 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.691 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.691 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.691 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.691 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.691 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '4a3fd104-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi049') 2024-09-21T06:28:46.691 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T06:28:46.944 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:47.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.447+0000 7f7b55bcf640 1 -- 172.21.15.49:0/808841707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b50108cf0 msgr2=0x7f7b5010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.447+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/808841707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b50108cf0 0x7f7b5010f520 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009ca0 tx=0x7f7b4802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.447+0000 7f7b55bcf640 1 -- 172.21.15.49:0/808841707 shutdown_connections 2024-09-21T06:28:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.447+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/808841707 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b50108cf0 0x7f7b5010f520 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.447+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/808841707 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b501083a0 0x7f7b501087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.447+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/808841707 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b50102a60 0x7f7b50102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.447+0000 7f7b55bcf640 1 -- 172.21.15.49:0/808841707 >> 172.21.15.49:0/808841707 conn(0x7f7b50079730 msgr2=0x7f7b50079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.447+0000 7f7b55bcf640 1 -- 172.21.15.49:0/808841707 shutdown_connections 2024-09-21T06:28:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.447+0000 7f7b55bcf640 1 -- 172.21.15.49:0/808841707 wait complete. 2024-09-21T06:28:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b55bcf640 1 Processor -- start 2024-09-21T06:28:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b55bcf640 1 -- start start 2024-09-21T06:28:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b55bcf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50102a60 0x7f7b5019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b55bcf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b501083a0 0x7f7b5019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b55bcf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b50108cf0 0x7f7b5019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b55bcf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7b50112960 con 0x7f7b501083a0 2024-09-21T06:28:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b55bcf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7b501127e0 con 0x7f7b50108cf0 2024-09-21T06:28:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b55bcf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7b50112ae0 con 0x7f7b50102a60 2024-09-21T06:28:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b4effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b501083a0 0x7f7b5019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b4effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b501083a0 0x7f7b5019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53626/0 (socket says 172.21.15.49:53626) 2024-09-21T06:28:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.448+0000 7f7b4effd640 1 -- 172.21.15.49:0/2891587313 learned_addr learned my addr 172.21.15.49:0/2891587313 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4ffff640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b50108cf0 0x7f7b5019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4f7fe640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50102a60 0x7f7b5019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4effd640 1 -- 172.21.15.49:0/2891587313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50102a60 msgr2=0x7f7b5019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4effd640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50102a60 0x7f7b5019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4effd640 1 -- 172.21.15.49:0/2891587313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b50108cf0 msgr2=0x7f7b5019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4effd640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b50108cf0 0x7f7b5019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4effd640 1 -- 172.21.15.49:0/2891587313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b501a0370 con 0x7f7b501083a0 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4f7fe640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50102a60 0x7f7b5019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4effd640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b501083a0 0x7f7b5019a9a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800c970 tx=0x7f7b3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4cff9640 1 -- 172.21.15.49:0/2891587313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b38007bb0 con 0x7f7b501083a0 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b501a0660 con 0x7f7b501083a0 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4cff9640 1 -- 172.21.15.49:0/2891587313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b38007d50 con 0x7f7b501083a0 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b4cff9640 1 -- 172.21.15.49:0/2891587313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800f450 con 0x7f7b501083a0 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.449+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b501a6dc0 con 0x7f7b501083a0 2024-09-21T06:28:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.450+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b50102e70 con 0x7f7b501083a0 2024-09-21T06:28:47.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.453+0000 7f7b4cff9640 1 -- 172.21.15.49:0/2891587313 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f7b38004f20 con 0x7f7b501083a0 2024-09-21T06:28:47.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.454+0000 7f7b4cff9640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b3c0b64d0 0x7f7b3c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:47.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.454+0000 7f7b4f7fe640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b3c0b64d0 0x7f7b3c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:47.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.454+0000 7f7b4cff9640 1 -- 172.21.15.49:0/2891587313 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7b380e5750 con 0x7f7b501083a0 2024-09-21T06:28:47.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.454+0000 7f7b4f7fe640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b3c0b64d0 0x7f7b3c0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b400058c0 tx=0x7f7b40005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:47.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.457+0000 7f7b4cff9640 1 -- 172.21.15.49:0/2891587313 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b38014030 con 0x7f7b501083a0 2024-09-21T06:28:47.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.648+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f7b5019b530 con 0x7f7b501083a0 2024-09-21T06:28:47.650 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:47 smithi049 ceph-mon[31177]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:47.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.649+0000 7f7b4cff9640 1 -- 172.21.15.49:0/2891587313 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+22127 (secure 0 0 0) 0x7f7b5019b530 con 0x7f7b501083a0 2024-09-21T06:28:47.651 INFO:teuthology.orchestra.run.smithi049.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global dev auth_debug true 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global basic log_to_file true 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global basic log_to_journald false 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global basic log_to_stderr false 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced mon_allow_pool_delete true 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T06:28:47.652 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:global dev ms_die_on_bug true 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:global dev ms_die_on_old_message true 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:global dev ms_die_on_skipped_message false 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced debug_mon 20/20 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced debug_ms 1/1 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced debug_paxos 20/20 2024-09-21T06:28:47.653 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T06:28:47.654 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced debug_client 20/20 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:28:47.655 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev bdev_debug_aio true 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced bdev_enable_discard true 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced bluestore_allocator bitmap * 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced debug_bluefs 1/20 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced debug_bluestore 1/20 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced debug_ms 1/1 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced debug_osd 20/20 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced debug_rocksdb 4/10 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev osd_debug_op_order true 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev osd_debug_shutdown true 2024-09-21T06:28:47.656 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T06:28:47.657 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced debug_mds 20/20 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced debug_ms 2/2 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced mds_bal_split_size 100 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:mds dev mds_debug_frag true 2024-09-21T06:28:47.658 INFO:teuthology.orchestra.run.smithi049.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:mds dev mds_verify_scatter true 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:client advanced client_mount_timeout 600 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:client advanced debug_client 20/20 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:client advanced debug_ms 1/1 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T06:28:47.659 INFO:teuthology.orchestra.run.smithi049.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T06:28:47.660 INFO:teuthology.orchestra.run.smithi049.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T06:28:47.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b3c0b64d0 msgr2=0x7f7b3c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b3c0b64d0 0x7f7b3c0b89e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7b400058c0 tx=0x7f7b40005850 comp rx=0 tx=0).stop 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b501083a0 msgr2=0x7f7b5019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b501083a0 0x7f7b5019a9a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800c970 tx=0x7f7b3800ce30 comp rx=0 tx=0).stop 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 shutdown_connections 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b3c0b64d0 0x7f7b3c0b89e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b50108cf0 0x7f7b5019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b501083a0 0x7f7b5019a9a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 --2- 172.21.15.49:0/2891587313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b50102a60 0x7f7b5019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 >> 172.21.15.49:0/2891587313 conn(0x7f7b50079730 msgr2=0x7f7b50101900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 shutdown_connections 2024-09-21T06:28:47.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:47.652+0000 7f7b55bcf640 1 -- 172.21.15.49:0/2891587313 wait complete. 2024-09-21T06:28:47.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:47 smithi079 ceph-mon[34346]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:48.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:47 smithi098 ceph-mon[34704]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:48.197 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T06:28:48.198 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:28:48.198 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:28:48.215 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:28:48.215 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_1 2024-09-21T06:28:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:28:48.271 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:48.271 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T06:28:48.272 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:48.272 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:48.272 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-21 06:27:25.223278941 +0000 2024-09-21T06:28:48.272 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-21 06:23:01.896195651 +0000 2024-09-21T06:28:48.272 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-21 06:23:01.896195651 +0000 2024-09-21T06:28:48.272 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-21 06:23:01.896195651 +0000 2024-09-21T06:28:48.272 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:28:48.336 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-21T06:28:48.336 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-21T06:28:48.336 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000110219 s, 4.6 MB/s 2024-09-21T06:28:48.337 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:28:48.394 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_2 2024-09-21T06:28:48.450 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:28:48.450 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:48.450 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T06:28:48.450 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:48.450 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:48.451 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-21 06:27:25.255278073 +0000 2024-09-21T06:28:48.451 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-21 06:23:02.211187009 +0000 2024-09-21T06:28:48.451 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-21 06:23:02.211187009 +0000 2024-09-21T06:28:48.451 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-21 06:23:02.211187009 +0000 2024-09-21T06:28:48.451 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:28:48.514 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-21T06:28:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-21T06:28:48.515 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000109688 s, 4.7 MB/s 2024-09-21T06:28:48.516 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:28:48.573 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_3 2024-09-21T06:28:48.630 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:28:48.630 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:48.630 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T06:28:48.630 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:48.630 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:48.630 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-21 06:27:25.288277178 +0000 2024-09-21T06:28:48.630 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-21 06:23:02.528178313 +0000 2024-09-21T06:28:48.630 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-21 06:23:02.528178313 +0000 2024-09-21T06:28:48.630 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-21 06:23:02.528178313 +0000 2024-09-21T06:28:48.631 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:28:48.695 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-21T06:28:48.695 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-21T06:28:48.695 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000106882 s, 4.8 MB/s 2024-09-21T06:28:48.696 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:28:48.755 DEBUG:teuthology.orchestra.run.smithi049:> stat /dev/vg_nvme/lv_4 2024-09-21T06:28:48.811 INFO:teuthology.orchestra.run.smithi049.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:28:48.811 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:48.811 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T06:28:48.811 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:48.811 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:48.812 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-21 06:27:25.320276310 +0000 2024-09-21T06:28:48.812 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-21 06:23:02.856169315 +0000 2024-09-21T06:28:48.812 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-21 06:23:02.856169315 +0000 2024-09-21T06:28:48.812 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-21 06:23:02.856169315 +0000 2024-09-21T06:28:48.812 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:28:48.872 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:48 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2891587313' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:28:48.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records in 2024-09-21T06:28:48.875 INFO:teuthology.orchestra.run.smithi049.stderr:1+0 records out 2024-09-21T06:28:48.875 INFO:teuthology.orchestra.run.smithi049.stderr:512 bytes copied, 0.000105882 s, 4.8 MB/s 2024-09-21T06:28:48.876 DEBUG:teuthology.orchestra.run.smithi049:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:28:48.933 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-21T06:28:48.933 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:28:48.952 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:28:48.953 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-09-21T06:28:49.011 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:28:49.011 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:49.011 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T06:28:49.011 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:49.011 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:49.011 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 06:28:20.419508007 +0000 2024-09-21T06:28:49.011 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 06:23:12.982112814 +0000 2024-09-21T06:28:49.011 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 06:23:12.982112814 +0000 2024-09-21T06:28:49.011 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-21 06:23:12.982112814 +0000 2024-09-21T06:28:49.011 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:28:49.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:48 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2891587313' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:28:49.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:48 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2891587313' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:28:49.079 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T06:28:49.079 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T06:28:49.080 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000285547 s, 1.8 MB/s 2024-09-21T06:28:49.081 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:28:49.140 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-09-21T06:28:49.198 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:28:49.198 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:49.198 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-21T06:28:49.198 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:49.198 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:49.198 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 06:28:20.419508007 +0000 2024-09-21T06:28:49.198 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 06:23:13.315104861 +0000 2024-09-21T06:28:49.198 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 06:23:13.315104861 +0000 2024-09-21T06:28:49.198 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-21 06:23:13.315104861 +0000 2024-09-21T06:28:49.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:28:49.265 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T06:28:49.265 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T06:28:49.265 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000211885 s, 2.4 MB/s 2024-09-21T06:28:49.266 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:28:49.325 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-09-21T06:28:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:28:49.382 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:49.382 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T06:28:49.382 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:49.382 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:49.383 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 06:28:20.419508007 +0000 2024-09-21T06:28:49.383 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 06:23:13.629097362 +0000 2024-09-21T06:28:49.383 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 06:23:13.629097362 +0000 2024-09-21T06:28:49.383 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-21 06:23:13.629097362 +0000 2024-09-21T06:28:49.383 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:28:49.448 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T06:28:49.448 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T06:28:49.448 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000180226 s, 2.8 MB/s 2024-09-21T06:28:49.449 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:28:49.508 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-09-21T06:28:49.566 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:28:49.566 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:49.566 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T06:28:49.566 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:49.567 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:49.567 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-21 06:28:20.420507983 +0000 2024-09-21T06:28:49.567 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-21 06:23:13.936090031 +0000 2024-09-21T06:28:49.567 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-21 06:23:13.936090031 +0000 2024-09-21T06:28:49.567 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: 2024-09-21 06:23:13.936090031 +0000 2024-09-21T06:28:49.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:28:49.634 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-21T06:28:49.634 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-21T06:28:49.634 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000216529 s, 2.4 MB/s 2024-09-21T06:28:49.635 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:28:49.695 DEBUG:teuthology.orchestra.run.smithi098:> set -ex 2024-09-21T06:28:49.695 DEBUG:teuthology.orchestra.run.smithi098:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:28:49.715 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:28:49.715 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_1 2024-09-21T06:28:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:28:49.774 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:49.774 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T06:28:49.774 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:49.774 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:49.774 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-21 06:28:18.140707719 +0000 2024-09-21T06:28:49.774 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-21 06:23:21.006750899 +0000 2024-09-21T06:28:49.775 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-21 06:23:21.006750899 +0000 2024-09-21T06:28:49.775 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-21 06:23:21.006750899 +0000 2024-09-21T06:28:49.775 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:28:49.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:49 smithi079 ceph-mon[34346]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:49.840 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:49 smithi098 ceph-mon[34704]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:49.844 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-21T06:28:49.844 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-21T06:28:49.844 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000284194 s, 1.8 MB/s 2024-09-21T06:28:49.845 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:28:49.904 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_2 2024-09-21T06:28:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:28:49.962 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:49.962 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T06:28:49.962 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:49.962 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:49.962 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-21 06:28:18.140707719 +0000 2024-09-21T06:28:49.962 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-21 06:23:21.340746438 +0000 2024-09-21T06:28:49.962 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-21 06:23:21.340746438 +0000 2024-09-21T06:28:49.963 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-21 06:23:21.340746438 +0000 2024-09-21T06:28:49.963 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:28:49.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:49 smithi049 ceph-mon[31177]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:50.028 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-21T06:28:50.028 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-21T06:28:50.028 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.00021169 s, 2.4 MB/s 2024-09-21T06:28:50.030 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:28:50.086 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_3 2024-09-21T06:28:50.142 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:28:50.143 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:50.143 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T06:28:50.143 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:50.143 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:50.143 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-21 06:28:18.140707719 +0000 2024-09-21T06:28:50.143 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-21 06:23:21.683741858 +0000 2024-09-21T06:28:50.143 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-21 06:23:21.683741858 +0000 2024-09-21T06:28:50.143 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-21 06:23:21.683741858 +0000 2024-09-21T06:28:50.143 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:28:50.206 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-21T06:28:50.206 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-21T06:28:50.206 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000207298 s, 2.5 MB/s 2024-09-21T06:28:50.208 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:28:50.264 DEBUG:teuthology.orchestra.run.smithi098:> stat /dev/vg_nvme/lv_4 2024-09-21T06:28:50.321 INFO:teuthology.orchestra.run.smithi098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:28:50.321 INFO:teuthology.orchestra.run.smithi098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:50.321 INFO:teuthology.orchestra.run.smithi098.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T06:28:50.321 INFO:teuthology.orchestra.run.smithi098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:50.321 INFO:teuthology.orchestra.run.smithi098.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:50.322 INFO:teuthology.orchestra.run.smithi098.stdout:Access: 2024-09-21 06:28:18.141707706 +0000 2024-09-21T06:28:50.322 INFO:teuthology.orchestra.run.smithi098.stdout:Modify: 2024-09-21 06:23:21.999737638 +0000 2024-09-21T06:28:50.322 INFO:teuthology.orchestra.run.smithi098.stdout:Change: 2024-09-21 06:23:21.999737638 +0000 2024-09-21T06:28:50.322 INFO:teuthology.orchestra.run.smithi098.stdout: Birth: 2024-09-21 06:23:21.999737638 +0000 2024-09-21T06:28:50.322 DEBUG:teuthology.orchestra.run.smithi098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:28:50.385 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records in 2024-09-21T06:28:50.385 INFO:teuthology.orchestra.run.smithi098.stderr:1+0 records out 2024-09-21T06:28:50.385 INFO:teuthology.orchestra.run.smithi098.stderr:512 bytes copied, 0.000175643 s, 2.9 MB/s 2024-09-21T06:28:50.387 DEBUG:teuthology.orchestra.run.smithi098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:28:50.442 INFO:tasks.cephadm:Deploying osd.0 on smithi049 with /dev/vg_nvme/lv_4... 2024-09-21T06:28:50.442 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:28:50.707 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:51.831 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:51 smithi049 ceph-mon[31177]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:52.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:51 smithi098 ceph-mon[34704]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:51 smithi079 ceph-mon[34346]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:53.094 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:28:53.122 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi049:vg_nvme/lv_4 2024-09-21T06:28:53.377 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:53.803 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:53 smithi049 ceph-mon[31177]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 -- 172.21.15.49:0/71014547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7801049e0 msgr2=0x7fb780104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 --2- 172.21.15.49:0/71014547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7801049e0 0x7fb780104df0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb770009900 tx=0x7fb77002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 -- 172.21.15.49:0/71014547 shutdown_connections 2024-09-21T06:28:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 --2- 172.21.15.49:0/71014547 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb78010de40 0x7fb780110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 --2- 172.21.15.49:0/71014547 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb780105330 0x7fb78010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 --2- 172.21.15.49:0/71014547 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb7801049e0 0x7fb780104df0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 -- 172.21.15.49:0/71014547 >> 172.21.15.49:0/71014547 conn(0x7fb780079750 msgr2=0x7fb780079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 -- 172.21.15.49:0/71014547 shutdown_connections 2024-09-21T06:28:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 -- 172.21.15.49:0/71014547 wait complete. 2024-09-21T06:28:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.813+0000 7fb785b8f640 1 Processor -- start 2024-09-21T06:28:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb785b8f640 1 -- start start 2024-09-21T06:28:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb785b8f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7801049e0 0x7fb78019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb785b8f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb780105330 0x7fb78019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb785b8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78010de40 0x7fb78019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb785b8f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb780113ac0 con 0x7fb78010de40 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb785b8f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb780113940 con 0x7fb7801049e0 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb785b8f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb780113c40 con 0x7fb780105330 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78010de40 0x7fb78019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78010de40 0x7fb78019fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53644/0 (socket says 172.21.15.49:53644) 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77ffff640 1 -- 172.21.15.49:0/4055399873 learned_addr learned my addr 172.21.15.49:0/4055399873 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77f7fe640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7801049e0 0x7fb78019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77effd640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb780105330 0x7fb78019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77ffff640 1 -- 172.21.15.49:0/4055399873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb780105330 msgr2=0x7fb78019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77ffff640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb780105330 0x7fb78019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77ffff640 1 -- 172.21.15.49:0/4055399873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7801049e0 msgr2=0x7fb78019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77ffff640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7801049e0 0x7fb78019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:53.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.814+0000 7fb77ffff640 1 -- 172.21.15.49:0/4055399873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7801a0480 con 0x7fb78010de40 2024-09-21T06:28:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.815+0000 7fb77ffff640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78010de40 0x7fb78019fd50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb77800cad0 tx=0x7fb77800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.815+0000 7fb77cff9640 1 -- 172.21.15.49:0/4055399873 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77800ae20 con 0x7fb78010de40 2024-09-21T06:28:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.815+0000 7fb77cff9640 1 -- 172.21.15.49:0/4055399873 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb778005020 con 0x7fb78010de40 2024-09-21T06:28:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.815+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7801a0770 con 0x7fb78010de40 2024-09-21T06:28:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.815+0000 7fb77cff9640 1 -- 172.21.15.49:0/4055399873 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77800f6b0 con 0x7fb78010de40 2024-09-21T06:28:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.815+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7801a6ed0 con 0x7fb78010de40 2024-09-21T06:28:53.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.816+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78006c220 con 0x7fb78010de40 2024-09-21T06:28:53.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.818+0000 7fb77cff9640 1 -- 172.21.15.49:0/4055399873 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7fb7780051d0 con 0x7fb78010de40 2024-09-21T06:28:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.819+0000 7fb77cff9640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb7680b64d0 0x7fb7680b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.819+0000 7fb77f7fe640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb7680b64d0 0x7fb7680b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.819+0000 7fb77cff9640 1 -- 172.21.15.49:0/4055399873 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb7780e5ab0 con 0x7fb78010de40 2024-09-21T06:28:53.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.820+0000 7fb77f7fe640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb7680b64d0 0x7fb7680b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb770000c00 tx=0x7fb770031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:53.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:53.823+0000 7fb77cff9640 1 -- 172.21.15.49:0/4055399873 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb778014030 con 0x7fb78010de40 2024-09-21T06:28:53.848 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:53 smithi098 ceph-mon[34704]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:54.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:28:54.026+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb780108f70 con 0x7fb7680b64d0 2024-09-21T06:28:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:53 smithi079 ceph-mon[34346]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:54.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:28:54.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:28:54.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:54.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:28:54.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:28:54.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:55.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:28:55.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:28:55.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:55.950 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:55 smithi049 ceph-mon[31177]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:55.951 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:55 smithi049 ceph-mon[31177]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:56.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:55 smithi098 ceph-mon[34704]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:56.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:55 smithi098 ceph-mon[34704]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:56.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:55 smithi079 ceph-mon[34346]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:56.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:55 smithi079 ceph-mon[34346]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:56.914 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:56 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1788365431' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f7e75c04-e943-49d1-b755-eea63952deac"} : dispatch 2024-09-21T06:28:56.914 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:56 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1788365431' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7e75c04-e943-49d1-b755-eea63952deac"}]': finished 2024-09-21T06:28:56.914 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:56 smithi049 ceph-mon[31177]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:28:56.914 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:56 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:57.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:56 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1788365431' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f7e75c04-e943-49d1-b755-eea63952deac"} : dispatch 2024-09-21T06:28:57.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:56 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1788365431' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7e75c04-e943-49d1-b755-eea63952deac"}]': finished 2024-09-21T06:28:57.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:56 smithi098 ceph-mon[34704]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:28:57.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:56 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:57.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:56 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1788365431' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f7e75c04-e943-49d1-b755-eea63952deac"} : dispatch 2024-09-21T06:28:57.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:56 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1788365431' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7e75c04-e943-49d1-b755-eea63952deac"}]': finished 2024-09-21T06:28:57.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:56 smithi079 ceph-mon[34346]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:28:57.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:56 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:57.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:57 smithi049 ceph-mon[31177]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:57 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4225321949' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:28:58.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:57 smithi098 ceph-mon[34704]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:58.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:57 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4225321949' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:28:58.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:57 smithi079 ceph-mon[34346]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:58.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:57 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4225321949' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:28:59.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:28:59 smithi049 ceph-mon[31177]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:00.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:28:59 smithi098 ceph-mon[34704]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:00.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:28:59 smithi079 ceph-mon[34346]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:01.858 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:01 smithi049 ceph-mon[31177]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:01 smithi098 ceph-mon[34704]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:02.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:01 smithi079 ceph-mon[34346]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:03.714 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:03 smithi049 ceph-mon[31177]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:04.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:03 smithi098 ceph-mon[34704]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:04.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:03 smithi079 ceph-mon[34346]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:04.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:04 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:29:04.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:04 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:05.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:04 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:29:05.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:04 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:05.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:04 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:29:05.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:04 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:05.704 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:05 smithi049 ceph-mon[31177]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:05.704 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:05 smithi049 ceph-mon[31177]: Deploying daemon osd.0 on smithi049 2024-09-21T06:29:06.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:05 smithi098 ceph-mon[34704]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:06.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:05 smithi098 ceph-mon[34704]: Deploying daemon osd.0 on smithi049 2024-09-21T06:29:06.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:05 smithi079 ceph-mon[34346]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:06.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:05 smithi079 ceph-mon[34346]: Deploying daemon osd.0 on smithi049 2024-09-21T06:29:07.799 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:07 smithi049 ceph-mon[31177]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:08.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:07 smithi098 ceph-mon[34704]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:08.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:07 smithi079 ceph-mon[34346]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:09 smithi049 ceph-mon[31177]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:09 smithi098 ceph-mon[34704]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:09 smithi079 ceph-mon[34346]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:11.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:11 smithi049 ceph-mon[31177]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:11 smithi098 ceph-mon[34704]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:11 smithi079 ceph-mon[34346]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:12.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:13.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:13 smithi049 ceph-mon[31177]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:13.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:13.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:13.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:13.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:13.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:14.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:13 smithi098 ceph-mon[34704]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:14.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:14.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:14.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:14.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:14.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:13 smithi079 ceph-mon[34346]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:14.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:14.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:14.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:14.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.989+0000 7fb77cff9640 1 -- 172.21.15.49:0/4055399873 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb780108f70 con 0x7fb7680b64d0 2024-09-21T06:29:14.991 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 0 on host 'smithi049' 2024-09-21T06:29:14.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb7680b64d0 msgr2=0x7fb7680b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:14.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb7680b64d0 0x7fb7680b89e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb770000c00 tx=0x7fb770031400 comp rx=0 tx=0).stop 2024-09-21T06:29:14.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78010de40 msgr2=0x7fb78019fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:14.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78010de40 0x7fb78019fd50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb77800cad0 tx=0x7fb77800cf90 comp rx=0 tx=0).stop 2024-09-21T06:29:14.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 shutdown_connections 2024-09-21T06:29:14.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb7680b64d0 0x7fb7680b89e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:14.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb78010de40 0x7fb78019fd50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:14.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb780105330 0x7fb78019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:14.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 --2- 172.21.15.49:0/4055399873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb7801049e0 0x7fb78019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:14.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 >> 172.21.15.49:0/4055399873 conn(0x7fb780079750 msgr2=0x7fb780100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:14.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 shutdown_connections 2024-09-21T06:29:14.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:29:14.992+0000 7fb785b8f640 1 -- 172.21.15.49:0/4055399873 wait complete. 2024-09-21T06:29:15.602 DEBUG:teuthology.orchestra.run.smithi049:osd.0> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T06:29:15.605 INFO:tasks.cephadm:Deploying osd.1 on smithi079 with /dev/vg_nvme/lv_4... 2024-09-21T06:29:15.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:29:15.843 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:15 smithi049 ceph-mon[31177]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:15.844 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:15.844 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:15.844 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:15.846 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:29:15.967 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:15 smithi079 ceph-mon[34346]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:15.967 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:15.967 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:15.967 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:16.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:15 smithi098 ceph-mon[34704]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:16.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:17.473 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:29:17 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0[48004]: 2024-09-21T06:29:17.233+0000 7f3038a5f640 -1 osd.0 0 log_to_monitors true 2024-09-21T06:29:17.898 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:17 smithi049 ceph-mon[31177]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:17.899 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:17 smithi049 ceph-mon[31177]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:29:18.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:17 smithi098 ceph-mon[34704]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:18.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:17 smithi098 ceph-mon[34704]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:29:18.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:17 smithi079 ceph-mon[34346]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:18.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:17 smithi079 ceph-mon[34346]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:29:18.373 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:29:18.400 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi079:vg_nvme/lv_4 2024-09-21T06:29:18.650 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:18.757 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:18.758 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:18.758 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:18 smithi079 ceph-mon[34346]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:29:18.973 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0[48004]: 2024-09-21T06:29:18.633+0000 7f30349e1640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T06:29:18.973 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0[48004]: 2024-09-21T06:29:18.637+0000 7f30307df640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:29:18.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:29:18.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:18.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:18 smithi049 ceph-mon[31177]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:29:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:29:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:29:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:29:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:19.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:19.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:19.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:19.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:19.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:18 smithi098 ceph-mon[34704]: from='osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:29:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.083+0000 7f8a77996640 1 -- 172.21.15.79:0/1326358286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 msgr2=0x7f8a70104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.083+0000 7f8a77996640 1 --2- 172.21.15.79:0/1326358286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 0x7f8a70104dc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009900 tx=0x7f8a6002a410 comp rx=0 tx=0).stop 2024-09-21T06:29:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.083+0000 7f8a77996640 1 -- 172.21.15.79:0/1326358286 shutdown_connections 2024-09-21T06:29:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.083+0000 7f8a77996640 1 --2- 172.21.15.79:0/1326358286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a7010de10 0x7f8a70110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.083+0000 7f8a77996640 1 --2- 172.21.15.79:0/1326358286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a70105300 0x7f8a7010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.083+0000 7f8a77996640 1 --2- 172.21.15.79:0/1326358286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 0x7f8a70104dc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.091 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.083+0000 7f8a77996640 1 -- 172.21.15.79:0/1326358286 >> 172.21.15.79:0/1326358286 conn(0x7f8a70079730 msgr2=0x7f8a70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.083+0000 7f8a77996640 1 -- 172.21.15.79:0/1326358286 shutdown_connections 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.083+0000 7f8a77996640 1 -- 172.21.15.79:0/1326358286 wait complete. 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a77996640 1 Processor -- start 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a77996640 1 -- start start 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a77996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 0x7f8a7019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a77996640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a70105300 0x7f8a7019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a77996640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a7010de10 0x7f8a7019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a77996640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a70113a90 con 0x7f8a70105300 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a77996640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a70113910 con 0x7f8a701049b0 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a77996640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a70113c10 con 0x7f8a7010de10 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a75732640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 0x7f8a7019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a75732640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 0x7f8a7019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:57448/0 (socket says 172.21.15.79:57448) 2024-09-21T06:29:19.092 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a75732640 1 -- 172.21.15.79:0/1037296470 learned_addr learned my addr 172.21.15.79:0/1037296470 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a74f31640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a70105300 0x7f8a7019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a75f33640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a7010de10 0x7f8a7019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a75732640 1 -- 172.21.15.79:0/1037296470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a7010de10 msgr2=0x7f8a7019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a75732640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a7010de10 0x7f8a7019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.084+0000 7f8a75732640 1 -- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a70105300 msgr2=0x7f8a7019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.085+0000 7f8a75732640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a70105300 0x7f8a7019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.085+0000 7f8a75732640 1 -- 172.21.15.79:0/1037296470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a701a03b0 con 0x7f8a701049b0 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.085+0000 7f8a75732640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 0x7f8a7019a500 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8a60032fd0 tx=0x7f8a60004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.085+0000 7f8a667fc640 1 -- 172.21.15.79:0/1037296470 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6003f030 con 0x7f8a701049b0 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.085+0000 7f8a667fc640 1 -- 172.21.15.79:0/1037296470 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a60004490 con 0x7f8a701049b0 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.085+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a701a0640 con 0x7f8a701049b0 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.085+0000 7f8a667fc640 1 -- 172.21.15.79:0/1037296470 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a60035070 con 0x7f8a701049b0 2024-09-21T06:29:19.093 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.085+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a701a0b70 con 0x7f8a701049b0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.086+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a70104dc0 con 0x7f8a701049b0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.087+0000 7f8a667fc640 1 -- 172.21.15.79:0/1037296470 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f8a60042030 con 0x7f8a701049b0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.088+0000 7f8a667fc640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a5c0b6580 0x7f8a5c0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.089+0000 7f8a667fc640 1 -- 172.21.15.79:0/1037296470 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f8a60105d30 con 0x7f8a701049b0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.089+0000 7f8a74f31640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a5c0b6580 0x7f8a5c0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.089+0000 7f8a74f31640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a5c0b6580 0x7f8a5c0b8a90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a7007a0a0 tx=0x7f8a6c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:19.094 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.093+0000 7f8a667fc640 1 -- 172.21.15.79:0/1037296470 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a6010a070 con 0x7f8a701049b0 2024-09-21T06:29:19.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:19.287+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8a70063800 con 0x7f8a5c0b6580 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi049 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi049 to 17088M 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:19.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:19 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:19.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi049 2024-09-21T06:29:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi049 to 17088M 2024-09-21T06:29:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:29:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:19 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi049 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi049 to 17088M 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:19 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:20.866 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:20 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:29:20.866 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:20 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:29:20.866 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:20 smithi079 ceph-mon[34346]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:20.866 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:20 smithi079 ceph-mon[34346]: osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] boot 2024-09-21T06:29:20.866 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:20 smithi079 ceph-mon[34346]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:29:20.867 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:20 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:20.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:20 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:29:20.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:20 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:29:20.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:20 smithi049 ceph-mon[31177]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:20.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:20 smithi049 ceph-mon[31177]: osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] boot 2024-09-21T06:29:20.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:20 smithi049 ceph-mon[31177]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:29:20.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:20 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:21.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:20 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:29:21.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:20 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:29:21.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:20 smithi098 ceph-mon[34704]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:21.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:20 smithi098 ceph-mon[34704]: osd.0 [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] boot 2024-09-21T06:29:21.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:20 smithi098 ceph-mon[34704]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:29:21.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:20 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:29:21.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:21 smithi049 ceph-mon[31177]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:21 smithi049 ceph-mon[31177]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:29:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:21 smithi049 ceph-mon[31177]: from='client.? 172.21.15.79:0/2711367515' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fda4851b-7967-4ce0-8ddc-0535145fd111"} : dispatch 2024-09-21T06:29:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:21 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fda4851b-7967-4ce0-8ddc-0535145fd111"} : dispatch 2024-09-21T06:29:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:21 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fda4851b-7967-4ce0-8ddc-0535145fd111"}]': finished 2024-09-21T06:29:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:21 smithi049 ceph-mon[31177]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:29:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:22.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:21 smithi098 ceph-mon[34704]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:22.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:21 smithi098 ceph-mon[34704]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:29:22.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:21 smithi098 ceph-mon[34704]: from='client.? 172.21.15.79:0/2711367515' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fda4851b-7967-4ce0-8ddc-0535145fd111"} : dispatch 2024-09-21T06:29:22.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:21 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fda4851b-7967-4ce0-8ddc-0535145fd111"} : dispatch 2024-09-21T06:29:22.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:21 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fda4851b-7967-4ce0-8ddc-0535145fd111"}]': finished 2024-09-21T06:29:22.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:21 smithi098 ceph-mon[34704]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:29:22.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:21 smithi079 ceph-mon[34346]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:29:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:21 smithi079 ceph-mon[34346]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:29:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:21 smithi079 ceph-mon[34346]: from='client.? 172.21.15.79:0/2711367515' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fda4851b-7967-4ce0-8ddc-0535145fd111"} : dispatch 2024-09-21T06:29:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:21 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fda4851b-7967-4ce0-8ddc-0535145fd111"} : dispatch 2024-09-21T06:29:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:21 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fda4851b-7967-4ce0-8ddc-0535145fd111"}]': finished 2024-09-21T06:29:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:21 smithi079 ceph-mon[34346]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:29:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:23.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:22 smithi098 ceph-mon[34704]: from='client.? 172.21.15.79:0/1693780624' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:23.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:22 smithi079 ceph-mon[34346]: from='client.? 172.21.15.79:0/1693780624' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:23.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:22 smithi049 ceph-mon[31177]: from='client.? 172.21.15.79:0/1693780624' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:24.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:23 smithi098 ceph-mon[34704]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:23 smithi079 ceph-mon[34346]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:24.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:23 smithi049 ceph-mon[31177]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:25 smithi098 ceph-mon[34704]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:25 smithi079 ceph-mon[34346]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:26.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:25 smithi049 ceph-mon[31177]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:27 smithi098 ceph-mon[34704]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:27 smithi079 ceph-mon[34346]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:27 smithi049 ceph-mon[31177]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:29 smithi098 ceph-mon[34704]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:29 smithi079 ceph-mon[34346]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:30.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:29 smithi049 ceph-mon[31177]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:30.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:29:30.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:31.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:29:31.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:31.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:29:31.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:31.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:31 smithi079 ceph-mon[34346]: Deploying daemon osd.1 on smithi079 2024-09-21T06:29:31.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:31 smithi079 ceph-mon[34346]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:32.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:31 smithi098 ceph-mon[34704]: Deploying daemon osd.1 on smithi079 2024-09-21T06:29:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:31 smithi098 ceph-mon[34704]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:32.124 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:31 smithi049 ceph-mon[31177]: Deploying daemon osd.1 on smithi079 2024-09-21T06:29:32.124 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:31 smithi049 ceph-mon[31177]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:33 smithi098 ceph-mon[34704]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:34.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:33 smithi079 ceph-mon[34346]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:34.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:33 smithi049 ceph-mon[31177]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:35.944 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:35 smithi079 ceph-mon[34346]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:35 smithi098 ceph-mon[34704]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:36.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:35 smithi049 ceph-mon[31177]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:36.862 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:36 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:36.862 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:36 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:36.862 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:36 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:37.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:36 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:37.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:36 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:37.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:36 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:37.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:36 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:37.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:36 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:37.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:36 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:37.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:37 smithi079 ceph-mon[34346]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:38.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:37 smithi098 ceph-mon[34704]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:38.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:37 smithi049 ceph-mon[31177]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:39.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:39 smithi049 ceph-mon[31177]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:39.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:39.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:39.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:39.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:39.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:39.738 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:39 smithi079 ceph-mon[34346]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:39.738 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:39.738 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:39.738 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:39.738 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:39.739 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:39.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:39 smithi098 ceph-mon[34704]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:39.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:39.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:39.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:39.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:39.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:40.286 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.284+0000 7f8a667fc640 1 -- 172.21.15.79:0/1037296470 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8a70063800 con 0x7f8a5c0b6580 2024-09-21T06:29:40.287 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 1 on host 'smithi079' 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a5c0b6580 msgr2=0x7f8a5c0b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a5c0b6580 0x7f8a5c0b8a90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8a7007a0a0 tx=0x7f8a6c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 msgr2=0x7f8a7019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 0x7f8a7019a500 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8a60032fd0 tx=0x7f8a60004270 comp rx=0 tx=0).stop 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 shutdown_connections 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a5c0b6580 0x7f8a5c0b8a90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a7010de10 0x7f8a7019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a70105300 0x7f8a7019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 --2- 172.21.15.79:0/1037296470 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a701049b0 0x7f8a7019a500 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 >> 172.21.15.79:0/1037296470 conn(0x7f8a70079730 msgr2=0x7f8a700ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:40.289 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 shutdown_connections 2024-09-21T06:29:40.290 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:29:40.287+0000 7f8a77996640 1 -- 172.21.15.79:0/1037296470 wait complete. 2024-09-21T06:29:40.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:40.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:40.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:40.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:40.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:40.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:40.907 DEBUG:teuthology.orchestra.run.smithi079:osd.1> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T06:29:40.909 INFO:tasks.cephadm:Deploying osd.2 on smithi098 with /dev/vg_nvme/lv_4... 2024-09-21T06:29:40.909 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:29:40.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:40.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:40.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:41.161 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:29:41.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:41 smithi098 ceph-mon[34704]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:41.761 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:41 smithi079 ceph-mon[34346]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:41.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:41 smithi049 ceph-mon[31177]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:42.036 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:29:41 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1[39087]: 2024-09-21T06:29:41.758+0000 7fef2acf3640 -1 osd.1 0 log_to_monitors true 2024-09-21T06:29:42.506 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:42 smithi098 ceph-mon[34704]: from='osd.1 [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:42.507 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:42 smithi098 ceph-mon[34704]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:42.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:42 smithi079 ceph-mon[34346]: from='osd.1 [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:42.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:42 smithi079 ceph-mon[34346]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:42.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:42 smithi049 ceph-mon[31177]: from='osd.1 [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:42.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:42 smithi049 ceph-mon[31177]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:43.501 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:29:43.526 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:43 smithi098 ceph-mon[34704]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:43.526 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:43 smithi098 ceph-mon[34704]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:29:43.526 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:43 smithi098 ceph-mon[34704]: from='osd.1 [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:29:43.526 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:43 smithi098 ceph-mon[34704]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:29:43.526 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:43 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:43.527 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:43 smithi098 ceph-mon[34704]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:29:43.528 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_4 2024-09-21T06:29:43.610 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:43 smithi079 ceph-mon[34346]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:43.610 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:43 smithi079 ceph-mon[34346]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:29:43.610 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:43 smithi079 ceph-mon[34346]: from='osd.1 [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:29:43.610 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:43 smithi079 ceph-mon[34346]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:29:43.611 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:43 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:43.611 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:43 smithi079 ceph-mon[34346]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:29:43.611 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:29:43 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1[39087]: 2024-09-21T06:29:43.492+0000 7fef26c75640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T06:29:43.611 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:29:43 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1[39087]: 2024-09-21T06:29:43.499+0000 7fef22a73640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:29:43.779 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:29:43.912 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:43 smithi049 ceph-mon[31177]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:43.912 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:43 smithi049 ceph-mon[31177]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:29:43.912 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:43 smithi049 ceph-mon[31177]: from='osd.1 [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:29:43.912 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:43 smithi049 ceph-mon[31177]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:29:43.912 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:43 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:43.912 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:43 smithi049 ceph-mon[31177]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:29:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.201+0000 7f922b087640 1 -- 172.21.15.98:0/638347767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224109ec0 msgr2=0x7f92241106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.201+0000 7f922b087640 1 --2- 172.21.15.98:0/638347767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224109ec0 0x7f92241106f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f921c009ca0 tx=0x7f921c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.201+0000 7f922b087640 1 -- 172.21.15.98:0/638347767 shutdown_connections 2024-09-21T06:29:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.201+0000 7f922b087640 1 --2- 172.21.15.98:0/638347767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224109ec0 0x7f92241106f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.201+0000 7f922b087640 1 --2- 172.21.15.98:0/638347767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9224109570 0x7f9224109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.203 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.201+0000 7f922b087640 1 --2- 172.21.15.98:0/638347767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9224103c30 0x7f9224104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.201+0000 7f922b087640 1 -- 172.21.15.98:0/638347767 >> 172.21.15.98:0/638347767 conn(0x7f922407b8d0 msgr2=0x7f922407bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:44.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.201+0000 7f922b087640 1 -- 172.21.15.98:0/638347767 shutdown_connections 2024-09-21T06:29:44.204 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.201+0000 7f922b087640 1 -- 172.21.15.98:0/638347767 wait complete. 2024-09-21T06:29:44.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f922b087640 1 Processor -- start 2024-09-21T06:29:44.205 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f922b087640 1 -- start start 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f922b087640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103c30 0x7f922419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f922b087640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9224109570 0x7f922419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f922b087640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9224109ec0 0x7f922419fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f922b087640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9224113ae0 con 0x7f9224109570 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f922b087640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9224113960 con 0x7f9224109ec0 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f922b087640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9224113c60 con 0x7f9224103c30 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f9228e23640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103c30 0x7f922419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f9228e23640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103c30 0x7f922419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:51224/0 (socket says 172.21.15.98:51224) 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f9228e23640 1 -- 172.21.15.98:0/1337631201 learned_addr learned my addr 172.21.15.98:0/1337631201 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f9229624640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9224109ec0 0x7f922419fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f9223fff640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9224109570 0x7f922419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f9228e23640 1 -- 172.21.15.98:0/1337631201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9224109ec0 msgr2=0x7f922419fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.206 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f9228e23640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9224109ec0 0x7f922419fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.202+0000 7f9228e23640 1 -- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9224109570 msgr2=0x7f922419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.203+0000 7f9228e23640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9224109570 0x7f922419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.203+0000 7f9228e23640 1 -- 172.21.15.98:0/1337631201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92241a0280 con 0x7f9224103c30 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.203+0000 7f9223fff640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9224109570 0x7f922419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.203+0000 7f9228e23640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103c30 0x7f922419a3d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f921800c920 tx=0x7f921800cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.203+0000 7f9221ffb640 1 -- 172.21.15.98:0/1337631201 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218007c70 con 0x7f9224103c30 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.203+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92241a0570 con 0x7f9224103c30 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.203+0000 7f9221ffb640 1 -- 172.21.15.98:0/1337631201 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9218007e10 con 0x7f9224103c30 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.203+0000 7f9221ffb640 1 -- 172.21.15.98:0/1337631201 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9218018820 con 0x7f9224103c30 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.203+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92241a6d90 con 0x7f9224103c30 2024-09-21T06:29:44.207 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.204+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9224104040 con 0x7f9224103c30 2024-09-21T06:29:44.208 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.207+0000 7f9221ffb640 1 -- 172.21.15.98:0/1337631201 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f921800f450 con 0x7f9224103c30 2024-09-21T06:29:44.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.207+0000 7f9221ffb640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92140b6500 0x7f92140b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:44.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.207+0000 7f9221ffb640 1 -- 172.21.15.98:0/1337631201 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7f92180e5ca0 con 0x7f9224103c30 2024-09-21T06:29:44.209 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.208+0000 7f9223fff640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92140b6500 0x7f92140b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:44.210 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.208+0000 7f9223fff640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92140b6500 0x7f92140b8a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9224107150 tx=0x7f9210005d90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:44.213 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.212+0000 7f9221ffb640 1 -- 172.21.15.98:0/1337631201 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9218014030 con 0x7f9224103c30 2024-09-21T06:29:44.405 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:29:44.403+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9224063800 con 0x7f92140b6500 2024-09-21T06:29:44.784 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi079 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi079 to 17088M 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:44.786 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.786 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:44.786 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:44.786 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:44.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:29:44.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi079 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi079 to 17088M 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:44.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:44.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:44.820 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi079 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi079 to 17088M 2024-09-21T06:29:44.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:44.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:44.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:29:44.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:44.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:44.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:45.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:45 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:29:45.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:45 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:29:45.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:45 smithi098 ceph-mon[34704]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:45.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:45 smithi098 ceph-mon[34704]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:45.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:45 smithi098 ceph-mon[34704]: osd.1 [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] boot 2024-09-21T06:29:45.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:45 smithi098 ceph-mon[34704]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:29:45.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:45 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:45.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:45 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:29:45.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:45 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:29:45.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:45 smithi079 ceph-mon[34346]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:45.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:45 smithi079 ceph-mon[34346]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:45.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:45 smithi079 ceph-mon[34346]: osd.1 [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] boot 2024-09-21T06:29:45.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:45 smithi079 ceph-mon[34346]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:29:45.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:45 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:45.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:45 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:29:45.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:45 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:29:45.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:45 smithi049 ceph-mon[31177]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:45.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:45 smithi049 ceph-mon[31177]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:45.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:45 smithi049 ceph-mon[31177]: osd.1 [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] boot 2024-09-21T06:29:45.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:45 smithi049 ceph-mon[31177]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:29:45.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:45 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:46.955 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:46 smithi098 ceph-mon[34704]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:29:46.955 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:46 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/1731909503' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4f748692-8431-4e81-8762-0e92b80ede11"} : dispatch 2024-09-21T06:29:46.955 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:46 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4f748692-8431-4e81-8762-0e92b80ede11"} : dispatch 2024-09-21T06:29:46.955 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:46 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f748692-8431-4e81-8762-0e92b80ede11"}]': finished 2024-09-21T06:29:46.955 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:46 smithi098 ceph-mon[34704]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:29:46.955 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:46 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:46.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:46 smithi049 ceph-mon[31177]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:29:46.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:46 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/1731909503' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4f748692-8431-4e81-8762-0e92b80ede11"} : dispatch 2024-09-21T06:29:46.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:46 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4f748692-8431-4e81-8762-0e92b80ede11"} : dispatch 2024-09-21T06:29:46.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:46 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f748692-8431-4e81-8762-0e92b80ede11"}]': finished 2024-09-21T06:29:46.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:46 smithi049 ceph-mon[31177]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:29:46.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:46 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:47.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:46 smithi079 ceph-mon[34346]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:29:47.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:46 smithi079 ceph-mon[34346]: from='client.? 172.21.15.98:0/1731909503' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4f748692-8431-4e81-8762-0e92b80ede11"} : dispatch 2024-09-21T06:29:47.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:46 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "4f748692-8431-4e81-8762-0e92b80ede11"} : dispatch 2024-09-21T06:29:47.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:46 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f748692-8431-4e81-8762-0e92b80ede11"}]': finished 2024-09-21T06:29:47.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:46 smithi079 ceph-mon[34346]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:29:47.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:46 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:47.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:47 smithi049 ceph-mon[31177]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:47.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:47 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/145511110' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:48.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:47 smithi098 ceph-mon[34704]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:48.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:47 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/145511110' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:47 smithi079 ceph-mon[34346]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:47 smithi079 ceph-mon[34346]: from='client.? 172.21.15.98:0/145511110' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:49.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:49 smithi049 ceph-mon[31177]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:50.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:49 smithi098 ceph-mon[34704]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:49 smithi079 ceph-mon[34346]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:51.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:51 smithi049 ceph-mon[31177]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:52.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:51 smithi098 ceph-mon[34704]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:51 smithi079 ceph-mon[34346]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:53.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:53 smithi049 ceph-mon[31177]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:53.996 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:53 smithi098 ceph-mon[34704]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:53 smithi079 ceph-mon[34346]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:55.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:55 smithi098 ceph-mon[34704]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:55.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:29:55.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:55 smithi049 ceph-mon[31177]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:29:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:56.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:55 smithi079 ceph-mon[34346]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:56.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:29:56.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:56.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:56 smithi098 ceph-mon[34704]: Deploying daemon osd.2 on smithi098 2024-09-21T06:29:56.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:56 smithi049 ceph-mon[31177]: Deploying daemon osd.2 on smithi098 2024-09-21T06:29:57.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:56 smithi079 ceph-mon[34346]: Deploying daemon osd.2 on smithi098 2024-09-21T06:29:57.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:57 smithi049 ceph-mon[31177]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:58.013 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:57 smithi098 ceph-mon[34704]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:58.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:57 smithi079 ceph-mon[34346]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:59.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:29:59 smithi049 ceph-mon[31177]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:00.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:29:59 smithi098 ceph-mon[34704]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:00.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:29:59 smithi079 ceph-mon[34346]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:00.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:00 smithi049 ceph-mon[31177]: overall HEALTH_OK 2024-09-21T06:30:00.974 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:00 smithi098 ceph-mon[34704]: overall HEALTH_OK 2024-09-21T06:30:01.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:00 smithi079 ceph-mon[34346]: overall HEALTH_OK 2024-09-21T06:30:01.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:01 smithi049 ceph-mon[31177]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:01.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:01.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:01.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:02.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:01 smithi098 ceph-mon[34704]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:02.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:02.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:02.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:01 smithi079 ceph-mon[34346]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:03.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:03 smithi049 ceph-mon[31177]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:04.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:03 smithi098 ceph-mon[34704]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:04.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:03 smithi079 ceph-mon[34346]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:05.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:05 smithi049 ceph-mon[31177]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:05.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:05.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:05.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:05.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:05.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:05.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:05 smithi098 ceph-mon[34704]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:05.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:05.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:05 smithi079 ceph-mon[34346]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:05.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:05.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:05.845 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.843+0000 7f9221ffb640 1 -- 172.21.15.98:0/1337631201 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9224063800 con 0x7f92140b6500 2024-09-21T06:30:05.845 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 2 on host 'smithi098' 2024-09-21T06:30:05.847 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.845+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92140b6500 msgr2=0x7f92140b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.845+0000 7f922b087640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92140b6500 0x7f92140b8a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9224107150 tx=0x7f9210005d90 comp rx=0 tx=0).stop 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103c30 msgr2=0x7f922419a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103c30 0x7f922419a3d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f921800c920 tx=0x7f921800cde0 comp rx=0 tx=0).stop 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 shutdown_connections 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92140b6500 0x7f92140b8a10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9224109ec0 0x7f922419fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9224109570 0x7f922419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 --2- 172.21.15.98:0/1337631201 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9224103c30 0x7f922419a3d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 >> 172.21.15.98:0/1337631201 conn(0x7f922407b8d0 msgr2=0x7f92241054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 shutdown_connections 2024-09-21T06:30:05.848 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:30:05.846+0000 7f922b087640 1 -- 172.21.15.98:0/1337631201 wait complete. 2024-09-21T06:30:06.399 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:06 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:06.399 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:06 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:06.399 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:06 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:06.430 DEBUG:teuthology.orchestra.run.smithi098:osd.2> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T06:30:06.432 INFO:tasks.cephadm:Deploying osd.3 on smithi049 with /dev/vg_nvme/lv_3... 2024-09-21T06:30:06.433 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:30:06.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:06 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:06.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:06 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:06.462 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:06 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:06.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:06 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:06.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:06 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:06.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:06 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:06.704 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:07.768 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:07 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2[39813]: 2024-09-21T06:30:07.729+0000 7f7ced7a4640 -1 osd.2 0 log_to_monitors true 2024-09-21T06:30:08.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:07 smithi098 ceph-mon[34704]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:08.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:07 smithi098 ceph-mon[34704]: from='osd.2 [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:30:08.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:07 smithi098 ceph-mon[34704]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:30:08.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:07 smithi049 ceph-mon[31177]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:08.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:07 smithi049 ceph-mon[31177]: from='osd.2 [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:30:08.051 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:07 smithi049 ceph-mon[31177]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:30:08.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:07 smithi079 ceph-mon[34346]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:08.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:07 smithi079 ceph-mon[34346]: from='osd.2 [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:30:08.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:07 smithi079 ceph-mon[34346]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:30:09.071 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:30:09.071 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:08 smithi098 ceph-mon[34704]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:30:09.071 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:08 smithi098 ceph-mon[34704]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:30:09.072 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:08 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:09.072 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:08 smithi098 ceph-mon[34704]: from='osd.2 [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:30:09.072 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:08 smithi098 ceph-mon[34704]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:30:09.072 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2[39813]: 2024-09-21T06:30:08.859+0000 7f7ce9726640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T06:30:09.072 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2[39813]: 2024-09-21T06:30:08.863+0000 7f7ce5524640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:30:09.096 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:08 smithi049 ceph-mon[31177]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:30:09.096 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:08 smithi049 ceph-mon[31177]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:30:09.096 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:08 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:09.097 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:08 smithi049 ceph-mon[31177]: from='osd.2 [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:30:09.097 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:08 smithi049 ceph-mon[31177]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:30:09.098 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi049:vg_nvme/lv_3 2024-09-21T06:30:09.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:08 smithi079 ceph-mon[34346]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:30:09.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:08 smithi079 ceph-mon[34346]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:30:09.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:08 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:09.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:08 smithi079 ceph-mon[34346]: from='osd.2 [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:30:09.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:08 smithi079 ceph-mon[34346]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:30:09.396 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:09.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.869+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1012486904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c98101f70 msgr2=0x7f3c98102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:09.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.869+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1012486904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c98101f70 0x7f3c98102380 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3c88009900 tx=0x7f3c8802a410 comp rx=0 tx=0).stop 2024-09-21T06:30:09.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.869+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1012486904 shutdown_connections 2024-09-21T06:30:09.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.869+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1012486904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c98109e00 0x7f3c98110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:09.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.869+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1012486904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c981094b0 0x7f3c981098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:09.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.869+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1012486904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c98101f70 0x7f3c98102380 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:09.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.869+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1012486904 >> 172.21.15.49:0/1012486904 conn(0x7f3c98077c60 msgr2=0x7f3c980780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:09.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.869+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1012486904 shutdown_connections 2024-09-21T06:30:09.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.869+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1012486904 wait complete. 2024-09-21T06:30:09.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c9e16a640 1 Processor -- start 2024-09-21T06:30:09.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c9e16a640 1 -- start start 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c9e16a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c98101f70 0x7f3c98102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c9e16a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c981094b0 0x7f3c98103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c9e16a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c98109e00 0x7f3c98103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c9e16a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98113ac0 con 0x7f3c981094b0 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c9e16a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98113940 con 0x7f3c98101f70 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c9e16a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98113c40 con 0x7f3c98109e00 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c96ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c981094b0 0x7f3c98103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c96ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c981094b0 0x7f3c98103450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55718/0 (socket says 172.21.15.49:55718) 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c96ffd640 1 -- 172.21.15.49:0/1582045122 learned_addr learned my addr 172.21.15.49:0/1582045122 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c97fff640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c98109e00 0x7f3c98103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:09.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.870+0000 7f3c977fe640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c98101f70 0x7f3c98102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c96ffd640 1 -- 172.21.15.49:0/1582045122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c98109e00 msgr2=0x7f3c98103990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c96ffd640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c98109e00 0x7f3c98103990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c96ffd640 1 -- 172.21.15.49:0/1582045122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c98101f70 msgr2=0x7f3c98102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c96ffd640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c98101f70 0x7f3c98102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c96ffd640 1 -- 172.21.15.49:0/1582045122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c981a8730 con 0x7f3c981094b0 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c97fff640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c98109e00 0x7f3c98103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c96ffd640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c981094b0 0x7f3c98103450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00e9f0 tx=0x7f3c8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c94ff9640 1 -- 172.21.15.49:0/1582045122 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c00ccc0 con 0x7f3c981094b0 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c94ff9640 1 -- 172.21.15.49:0/1582045122 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c8c0108e0 con 0x7f3c981094b0 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c981a8a20 con 0x7f3c981094b0 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c94ff9640 1 -- 172.21.15.49:0/1582045122 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c018860 con 0x7f3c981094b0 2024-09-21T06:30:09.876 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.871+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c981a8fb0 con 0x7f3c981094b0 2024-09-21T06:30:09.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.872+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c98102380 con 0x7f3c981094b0 2024-09-21T06:30:09.877 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.874+0000 7f3c94ff9640 1 -- 172.21.15.49:0/1582045122 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 19) ==== 154473+0+0 (secure 0 0 0) 0x7f3c8c010430 con 0x7f3c981094b0 2024-09-21T06:30:09.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.875+0000 7f3c94ff9640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c800b6550 0x7f3c800b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:09.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.875+0000 7f3c977fe640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c800b6550 0x7f3c800b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:09.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.875+0000 7f3c94ff9640 1 -- 172.21.15.49:0/1582045122 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3066+0+0 (secure 0 0 0) 0x7f3c8c0e5ff0 con 0x7f3c981094b0 2024-09-21T06:30:09.878 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.875+0000 7f3c977fe640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c800b6550 0x7f3c800b8a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c88000c00 tx=0x7f3c88031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:09.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:09.879+0000 7f3c94ff9640 1 -- 172.21.15.49:0/1582045122 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c8c0b21c0 con 0x7f3c981094b0 2024-09-21T06:30:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:30:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:30:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:09.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:09.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:09.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:10.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:10.079+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3c98063800 con 0x7f3c800b6550 2024-09-21T06:30:10.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:10.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:10.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:30:10.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:30:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:11.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:30:11.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:30:11.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi098 2024-09-21T06:30:11.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-21T06:30:11.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: osd.2 [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] boot 2024-09-21T06:30:11.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:30:11.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:11.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:11.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:11.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:11.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:11.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:11.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:10 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:30:11.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:30:11.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:30:11.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi098 2024-09-21T06:30:11.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-21T06:30:11.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: osd.2 [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] boot 2024-09-21T06:30:11.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:30:11.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:11.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:11.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:11.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:11.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:11.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:11.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:10 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:30:11.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi098 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi098 to 17088M 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: osd.2 [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] boot 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:11.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:10 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:30:11.953 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:30:11.953 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:11 smithi049 ceph-mon[31177]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:30:11.953 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:30:11.954 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:30:11 smithi049 sudo[52218]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:30:11.954 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:30:11 smithi049 sudo[52218]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:11.954 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:30:11 smithi049 sudo[52218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:11.954 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:30:11 smithi049 sudo[52218]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.188 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:30:12.188 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:11 smithi098 ceph-mon[34704]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:30:12.188 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:30:12.188 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43724]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:30:12.189 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43724]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.189 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.189 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43724]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.189 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43727]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:30:12.189 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43727]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.189 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.189 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43727]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.223 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:30:11 smithi049 sudo[52223]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:30:12.223 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:30:11 smithi049 sudo[52223]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.223 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:30:11 smithi049 sudo[52223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.223 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:30:11 smithi049 sudo[52223]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 sudo[52246]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:30:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 sudo[52246]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 sudo[52246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 sudo[52246]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 sudo[52250]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:30:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 sudo[52250]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 sudo[52250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 sudo[52250]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.228 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:30:12.228 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:11 smithi079 ceph-mon[34346]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:30:12.228 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:30:12.228 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42931]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:30:12.229 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42931]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.229 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.229 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42931]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.229 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42934]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:30:12.229 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42934]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.229 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.229 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42934]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43730]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:30:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43730]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43730]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43733]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:30:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43733]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 sudo[43733]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42937]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:30:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42937]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42937]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42940]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:30:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42940]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:30:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:30:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 sudo[42940]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:30:12.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:30:12.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T06:30:12.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:12.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:12.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:12.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:12.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:30:12.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4205967454' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0e648fc9-af23-4980-8379-692e4ca5548f"} : dispatch 2024-09-21T06:30:12.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4205967454' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e648fc9-af23-4980-8379-692e4ca5548f"}]': finished 2024-09-21T06:30:12.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:30:12.975 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:13.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:13.004+0000 7f3c94ff9640 1 -- 172.21.15.49:0/1582045122 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f3c8c0a9a00 con 0x7f3c981094b0 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:30:13.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4205967454' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0e648fc9-af23-4980-8379-692e4ca5548f"} : dispatch 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4205967454' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e648fc9-af23-4980-8379-692e4ca5548f"}]': finished 2024-09-21T06:30:13.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:30:13.298 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:13.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:30:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:30:13.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:30:13.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:30:13.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:30:13.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:30:13.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:30:13.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4205967454' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0e648fc9-af23-4980-8379-692e4ca5548f"} : dispatch 2024-09-21T06:30:13.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4205967454' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0e648fc9-af23-4980-8379-692e4ca5548f"}]': finished 2024-09-21T06:30:13.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:30:13.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:14.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:14 smithi098 ceph-mon[34704]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T06:30:14.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:14 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2083849895' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:14.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:14 smithi079 ceph-mon[34346]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T06:30:14.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:14 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2083849895' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:14.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:14 smithi049 ceph-mon[31177]: mgrmap e20: x(active, since 2m), standbys: z, y 2024-09-21T06:30:14.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:14 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2083849895' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:15.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:15 smithi098 ceph-mon[34704]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:15.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:15 smithi079 ceph-mon[34346]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:15.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:15 smithi049 ceph-mon[31177]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:17.453 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:17 smithi049 ceph-mon[31177]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:17.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:17 smithi098 ceph-mon[34704]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:17.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:17 smithi079 ceph-mon[34346]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:19.432 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:19 smithi049 ceph-mon[31177]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:19.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:19 smithi098 ceph-mon[34704]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:19.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:19 smithi079 ceph-mon[34346]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:21.343 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:21 smithi049 ceph-mon[31177]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:21.343 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:30:21.343 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:21.343 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:21 smithi049 ceph-mon[31177]: Deploying daemon osd.3 on smithi049 2024-09-21T06:30:21.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:21 smithi098 ceph-mon[34704]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:30:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:21 smithi098 ceph-mon[34704]: Deploying daemon osd.3 on smithi049 2024-09-21T06:30:21.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:21 smithi079 ceph-mon[34346]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:21.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:30:21.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:21.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:21 smithi079 ceph-mon[34346]: Deploying daemon osd.3 on smithi049 2024-09-21T06:30:23.360 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:23 smithi049 ceph-mon[31177]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:23.364 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:23 smithi098 ceph-mon[34704]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:23.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:23 smithi079 ceph-mon[34346]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:25.434 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:25 smithi049 ceph-mon[31177]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:25.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:25 smithi098 ceph-mon[34704]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:25.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:25 smithi079 ceph-mon[34346]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:27.417 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:27 smithi049 ceph-mon[31177]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:27.417 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:27.417 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:27.417 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:27.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:27 smithi098 ceph-mon[34704]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:27.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:27.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:27.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:27.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:27 smithi079 ceph-mon[34346]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:27.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:27.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:27.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:29.418 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:29 smithi049 ceph-mon[31177]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:29.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:29 smithi098 ceph-mon[34704]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:29.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:29 smithi079 ceph-mon[34346]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:30.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:30.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:30.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:30.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:30.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.022+0000 7f3c94ff9640 1 -- 172.21.15.49:0/1582045122 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3c98063800 con 0x7f3c800b6550 2024-09-21T06:30:31.024 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 3 on host 'smithi049' 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c800b6550 msgr2=0x7f3c800b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c800b6550 0x7f3c800b8a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3c88000c00 tx=0x7f3c88031400 comp rx=0 tx=0).stop 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c981094b0 msgr2=0x7f3c98103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c981094b0 0x7f3c98103450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00e9f0 tx=0x7f3c8c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 shutdown_connections 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c800b6550 0x7f3c800b8a60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c98109e00 0x7f3c98103990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c981094b0 0x7f3c98103450 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 --2- 172.21.15.49:0/1582045122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c98101f70 0x7f3c98102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 >> 172.21.15.49:0/1582045122 conn(0x7f3c98077c60 msgr2=0x7f3c98107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 shutdown_connections 2024-09-21T06:30:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:30:31.025+0000 7f3c9e16a640 1 -- 172.21.15.49:0/1582045122 wait complete. 2024-09-21T06:30:31.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:31.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:31.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:31.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:31.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.579 DEBUG:teuthology.orchestra.run.smithi049:osd.3> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T06:30:31.581 INFO:tasks.cephadm:Deploying osd.4 on smithi079 with /dev/vg_nvme/lv_3... 2024-09-21T06:30:31.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:30:31.835 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:30:31.857 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:31 smithi049 ceph-mon[31177]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:31.858 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:31.858 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.858 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.955 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:31 smithi079 ceph-mon[34346]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:31.955 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:31.955 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:31.955 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:31 smithi098 ceph-mon[34704]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:32.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:32 smithi049 ceph-mon[31177]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:30:32.723 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:30:32 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3[54253]: 2024-09-21T06:30:32.574+0000 7f6dcffac640 -1 osd.3 0 log_to_monitors true 2024-09-21T06:30:32.876 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:32 smithi079 ceph-mon[34346]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:30:33.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:32 smithi098 ceph-mon[34704]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:30:33.696 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:33 smithi049 ceph-mon[31177]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:33.696 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:33 smithi049 ceph-mon[31177]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:30:33.696 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:33 smithi049 ceph-mon[31177]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:30:33.696 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:33 smithi049 ceph-mon[31177]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:30:33.696 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:33 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:33.696 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:30:33 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3[54253]: 2024-09-21T06:30:33.636+0000 7f6dcbf2e640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T06:30:33.697 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:30:33 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3[54253]: 2024-09-21T06:30:33.642+0000 7f6dc7d2c640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:30:33.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:33 smithi079 ceph-mon[34346]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:33.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:33 smithi079 ceph-mon[34346]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:30:33.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:33 smithi079 ceph-mon[34346]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:30:33.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:33 smithi079 ceph-mon[34346]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:30:33.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:33 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:34.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:33 smithi098 ceph-mon[34704]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:34.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:33 smithi098 ceph-mon[34704]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:30:34.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:33 smithi098 ceph-mon[34704]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:30:34.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:33 smithi098 ceph-mon[34704]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:30:34.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:33 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:34.219 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:30:34.244 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi079:vg_nvme/lv_3 2024-09-21T06:30:34.491 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:34.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:34.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:34.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] boot 2024-09-21T06:30:34.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T06:30:34.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:34.877 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:30:34.877 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:30:34.877 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:34.877 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:34.877 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] boot 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T06:30:34.878 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.968+0000 7f9a283a1640 1 -- 172.21.15.79:0/238120301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20109eb0 msgr2=0x7f9a201106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.968+0000 7f9a283a1640 1 --2- 172.21.15.79:0/238120301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20109eb0 0x7f9a201106e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009ca0 tx=0x7f9a1802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.968+0000 7f9a283a1640 1 -- 172.21.15.79:0/238120301 shutdown_connections 2024-09-21T06:30:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.968+0000 7f9a283a1640 1 --2- 172.21.15.79:0/238120301 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20109eb0 0x7f9a201106e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.968+0000 7f9a283a1640 1 --2- 172.21.15.79:0/238120301 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20109560 0x7f9a20109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.968+0000 7f9a283a1640 1 --2- 172.21.15.79:0/238120301 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a20102080 0x7f9a20102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.968+0000 7f9a283a1640 1 -- 172.21.15.79:0/238120301 >> 172.21.15.79:0/238120301 conn(0x7f9a20079ec0 msgr2=0x7f9a2007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.968+0000 7f9a283a1640 1 -- 172.21.15.79:0/238120301 shutdown_connections 2024-09-21T06:30:34.970 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.968+0000 7f9a283a1640 1 -- 172.21.15.79:0/238120301 wait complete. 2024-09-21T06:30:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a283a1640 1 Processor -- start 2024-09-21T06:30:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a283a1640 1 -- start start 2024-09-21T06:30:34.972 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a283a1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20102080 0x7f9a2019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a283a1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20109560 0x7f9a2019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a283a1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a20109eb0 0x7f9a2019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a283a1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20113b70 con 0x7f9a20109560 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a283a1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9a201139f0 con 0x7f9a20102080 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a283a1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9a20113cf0 con 0x7f9a20109eb0 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a2613d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20102080 0x7f9a2019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a2613d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20102080 0x7f9a2019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:54706/0 (socket says 172.21.15.79:54706) 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a2613d640 1 -- 172.21.15.79:0/482435127 learned_addr learned my addr 172.21.15.79:0/482435127 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.969+0000 7f9a2593c640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20109560 0x7f9a2019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a2693e640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a20109eb0 0x7f9a2019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a2613d640 1 -- 172.21.15.79:0/482435127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a20109eb0 msgr2=0x7f9a2019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a2613d640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a20109eb0 0x7f9a2019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a2613d640 1 -- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20109560 msgr2=0x7f9a2019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:34.973 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a2613d640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20109560 0x7f9a2019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a2613d640 1 -- 172.21.15.79:0/482435127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a201a04b0 con 0x7f9a20102080 2024-09-21T06:30:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a2593c640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20109560 0x7f9a2019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a2613d640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20102080 0x7f9a2019a540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00e9f0 tx=0x7f9a1c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a177fe640 1 -- 172.21.15.79:0/482435127 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00cd80 con 0x7f9a20102080 2024-09-21T06:30:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a177fe640 1 -- 172.21.15.79:0/482435127 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a1c0054d0 con 0x7f9a20102080 2024-09-21T06:30:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a201a07a0 con 0x7f9a20102080 2024-09-21T06:30:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a177fe640 1 -- 172.21.15.79:0/482435127 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c010690 con 0x7f9a20102080 2024-09-21T06:30:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.970+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a201a6f00 con 0x7f9a20102080 2024-09-21T06:30:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.971+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a20102490 con 0x7f9a20102080 2024-09-21T06:30:34.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.973+0000 7f9a177fe640 1 -- 172.21.15.79:0/482435127 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f9a1c004e30 con 0x7f9a20102080 2024-09-21T06:30:34.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.973+0000 7f9a177fe640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:34.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.974+0000 7f9a177fe640 1 -- 172.21.15.79:0/482435127 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3917+0+0 (secure 0 0 0) 0x7f9a1c0e68a0 con 0x7f9a20102080 2024-09-21T06:30:34.975 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.974+0000 7f9a2593c640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.974+0000 7f9a2593c640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a2007a760 tx=0x7f9a1000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:34.978 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:34.977+0000 7f9a177fe640 1 -- 172.21.15.79:0/482435127 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a1c056710 con 0x7f9a20102080 2024-09-21T06:30:35.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: osd.3 [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] boot 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T06:30:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:35.165 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:35.163+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9a20063800 con 0x7f9a0c0b6560 2024-09-21T06:30:35.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:35 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:30:35.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:35 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:30:35.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:35 smithi079 ceph-mon[34346]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:35.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:35 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi049 2024-09-21T06:30:35.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:35 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi049 to 8544M 2024-09-21T06:30:35.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:35.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:35.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:35.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:35 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:30:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:35 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:30:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:35 smithi049 ceph-mon[31177]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:35 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi049 2024-09-21T06:30:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:35 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi049 to 8544M 2024-09-21T06:30:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:35 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:30:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:35 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:30:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:35 smithi098 ceph-mon[34704]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:35 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi049 2024-09-21T06:30:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:35 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi049 to 8544M 2024-09-21T06:30:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:36.817 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:36 smithi079 ceph-mon[34346]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:36.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:36 smithi079 ceph-mon[34346]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:30:36.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:36 smithi049 ceph-mon[31177]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:36.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:36 smithi049 ceph-mon[31177]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:30:37.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:36 smithi098 ceph-mon[34704]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:37.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:36 smithi098 ceph-mon[34704]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:30:37.929 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:37 smithi079 ceph-mon[34346]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:37.929 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:37 smithi079 ceph-mon[34346]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:30:37.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:37 smithi049 ceph-mon[31177]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:37.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:37 smithi049 ceph-mon[31177]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:30:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:37 smithi098 ceph-mon[34704]: pgmap v86: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:37 smithi098 ceph-mon[34704]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:30:38.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:38 smithi049 ceph-mon[31177]: from='client.? 172.21.15.79:0/3620976372' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55463d33-e576-4e98-ac6b-62c264d1efac"} : dispatch 2024-09-21T06:30:38.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:38 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55463d33-e576-4e98-ac6b-62c264d1efac"} : dispatch 2024-09-21T06:30:38.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:38 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55463d33-e576-4e98-ac6b-62c264d1efac"}]': finished 2024-09-21T06:30:38.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:38 smithi049 ceph-mon[31177]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:30:38.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:38.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:38 smithi049 ceph-mon[31177]: from='client.? 172.21.15.79:0/2616967361' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:39.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:38 smithi098 ceph-mon[34704]: from='client.? 172.21.15.79:0/3620976372' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55463d33-e576-4e98-ac6b-62c264d1efac"} : dispatch 2024-09-21T06:30:39.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:38 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55463d33-e576-4e98-ac6b-62c264d1efac"} : dispatch 2024-09-21T06:30:39.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:38 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55463d33-e576-4e98-ac6b-62c264d1efac"}]': finished 2024-09-21T06:30:39.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:38 smithi098 ceph-mon[34704]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:30:39.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:39.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:38 smithi098 ceph-mon[34704]: from='client.? 172.21.15.79:0/2616967361' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:39.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:38 smithi079 ceph-mon[34346]: from='client.? 172.21.15.79:0/3620976372' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55463d33-e576-4e98-ac6b-62c264d1efac"} : dispatch 2024-09-21T06:30:39.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:38 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "55463d33-e576-4e98-ac6b-62c264d1efac"} : dispatch 2024-09-21T06:30:39.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:38 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55463d33-e576-4e98-ac6b-62c264d1efac"}]': finished 2024-09-21T06:30:39.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:38 smithi079 ceph-mon[34346]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:30:39.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:39.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:38 smithi079 ceph-mon[34346]: from='client.? 172.21.15.79:0/2616967361' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:40.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:39 smithi098 ceph-mon[34704]: pgmap v89: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:39 smithi079 ceph-mon[34346]: pgmap v89: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:40.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:39 smithi049 ceph-mon[31177]: pgmap v89: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:42.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:41 smithi098 ceph-mon[34704]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:41 smithi079 ceph-mon[34346]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:42.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:41 smithi049 ceph-mon[31177]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:44.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:43 smithi098 ceph-mon[34704]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:30:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:43 smithi079 ceph-mon[34346]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:30:44.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:43 smithi049 ceph-mon[31177]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:30:45.944 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:45 smithi079 ceph-mon[34346]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:30:46.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:45 smithi098 ceph-mon[34704]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:30:46.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:45 smithi049 ceph-mon[31177]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:30:46.947 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:46 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:30:46.947 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:46 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:47.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:46 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:30:47.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:46 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:46 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:30:47.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:46 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:47.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:47 smithi079 ceph-mon[34346]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:30:47.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:47 smithi079 ceph-mon[34346]: Deploying daemon osd.4 on smithi079 2024-09-21T06:30:48.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:47 smithi098 ceph-mon[34704]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:30:48.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:47 smithi098 ceph-mon[34704]: Deploying daemon osd.4 on smithi079 2024-09-21T06:30:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:47 smithi049 ceph-mon[31177]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:30:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:47 smithi049 ceph-mon[31177]: Deploying daemon osd.4 on smithi079 2024-09-21T06:30:49.907 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:49 smithi079 ceph-mon[34346]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T06:30:50.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:49 smithi098 ceph-mon[34704]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T06:30:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:49 smithi049 ceph-mon[31177]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T06:30:51.888 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:51 smithi079 ceph-mon[34346]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:52.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:51 smithi098 ceph-mon[34704]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:52.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:51 smithi049 ceph-mon[31177]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:53.044 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:53.044 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:53.044 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:53.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:53.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:53.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:53.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:54.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:53 smithi098 ceph-mon[34704]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:53 smithi079 ceph-mon[34346]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:53 smithi049 ceph-mon[31177]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:56.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:55 smithi098 ceph-mon[34704]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:56.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:56.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:56.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.057 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:55 smithi079 ceph-mon[34346]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:56.057 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.057 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.057 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:56.057 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:56.057 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:55 smithi049 ceph-mon[31177]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.375 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.372+0000 7f9a177fe640 1 -- 172.21.15.79:0/482435127 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9a20063800 con 0x7f9a0c0b6560 2024-09-21T06:30:56.375 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 4 on host 'smithi079' 2024-09-21T06:30:56.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.374+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9a0c0b6560 msgr2=0x7f9a0c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:56.377 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.374+0000 7f9a283a1640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9a2007a760 tx=0x7f9a1000b390 comp rx=0 tx=0).stop 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.374+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20102080 msgr2=0x7f9a2019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.374+0000 7f9a283a1640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20102080 0x7f9a2019a540 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00e9f0 tx=0x7f9a1c00edf0 comp rx=0 tx=0).stop 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.375+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 shutdown_connections 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.375+0000 7f9a283a1640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9a0c0b6560 0x7f9a0c0b8a70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.375+0000 7f9a283a1640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9a20109eb0 0x7f9a2019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.375+0000 7f9a283a1640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9a20109560 0x7f9a2019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.375+0000 7f9a283a1640 1 --2- 172.21.15.79:0/482435127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9a20102080 0x7f9a2019a540 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.375+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 >> 172.21.15.79:0/482435127 conn(0x7f9a20079ec0 msgr2=0x7f9a20105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.375+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 shutdown_connections 2024-09-21T06:30:56.378 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:30:56.375+0000 7f9a283a1640 1 -- 172.21.15.79:0/482435127 wait complete. 2024-09-21T06:30:56.977 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:56 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:56.978 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:56 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:56.978 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:56 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:57.011 DEBUG:teuthology.orchestra.run.smithi079:osd.4> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T06:30:57.013 INFO:tasks.cephadm:Deploying osd.5 on smithi098 with /dev/vg_nvme/lv_3... 2024-09-21T06:30:57.013 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:30:57.041 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:56 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:57.041 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:56 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:57.041 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:56 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:57.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:56 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:57.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:56 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:57.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:56 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:30:57.264 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:30:58.035 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:57 smithi079 ceph-mon[34346]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:58.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:57 smithi098 ceph-mon[34704]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:58.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:57 smithi049 ceph-mon[31177]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:58.304 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:30:58 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4[45517]: 2024-09-21T06:30:58.032+0000 7f62811c9640 -1 osd.4 0 log_to_monitors true 2024-09-21T06:30:59.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:58 smithi098 ceph-mon[34704]: from='osd.4 [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:59.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:58 smithi098 ceph-mon[34704]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:59.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:58 smithi079 ceph-mon[34346]: from='osd.4 [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:59.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:58 smithi079 ceph-mon[34346]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:59.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:58 smithi049 ceph-mon[31177]: from='osd.4 [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:59.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:58 smithi049 ceph-mon[31177]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:59.770 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:30:59.801 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_3 2024-09-21T06:30:59.865 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:59 smithi098 ceph-mon[34704]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:30:59.865 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:59 smithi098 ceph-mon[34704]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:30:59.865 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:59 smithi098 ceph-mon[34704]: from='osd.4 [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:30:59.865 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:59 smithi098 ceph-mon[34704]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:30:59.865 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:59 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:59.865 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:30:59 smithi098 ceph-mon[34704]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:31:00.068 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:30:59 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4[45517]: 2024-09-21T06:30:59.783+0000 7f627d14b640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T06:31:00.068 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:30:59 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4[45517]: 2024-09-21T06:30:59.791+0000 7f6278f49640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:31:00.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:59 smithi079 ceph-mon[34346]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:31:00.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:59 smithi079 ceph-mon[34346]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:31:00.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:59 smithi079 ceph-mon[34346]: from='osd.4 [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:31:00.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:59 smithi079 ceph-mon[34346]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:31:00.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:59 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:00.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:30:59 smithi079 ceph-mon[34346]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:31:00.093 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:31:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:59 smithi049 ceph-mon[31177]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:31:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:59 smithi049 ceph-mon[31177]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:31:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:59 smithi049 ceph-mon[31177]: from='osd.4 [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:31:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:59 smithi049 ceph-mon[31177]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:31:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:59 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:30:59 smithi049 ceph-mon[31177]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:31:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.594+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/187328802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 msgr2=0x7f7b681087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.594+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/187328802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 0x7f7b681087f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009900 tx=0x7f7b5c02a410 comp rx=0 tx=0).stop 2024-09-21T06:31:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.595+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/187328802 shutdown_connections 2024-09-21T06:31:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.595+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/187328802 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b68108d30 0x7f7b6810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.595+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/187328802 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 0x7f7b681087f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.595+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/187328802 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b68103100 0x7f7b68103510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.595+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/187328802 >> 172.21.15.98:0/187328802 conn(0x7f7b68079e30 msgr2=0x7f7b6807a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.595+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/187328802 shutdown_connections 2024-09-21T06:31:00.597 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.595+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/187328802 wait complete. 2024-09-21T06:31:00.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.595+0000 7f7b6cfc6640 1 Processor -- start 2024-09-21T06:31:00.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b6cfc6640 1 -- start start 2024-09-21T06:31:00.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b6cfc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b68103100 0x7f7b680fee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:00.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b6cfc6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 0x7f7b680ff3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:00.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b6cfc6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b68108d30 0x7f7b680ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:00.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b6cfc6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7b681129f0 con 0x7f7b68108d30 2024-09-21T06:31:00.599 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b6cfc6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7b68112870 con 0x7f7b68103100 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b6cfc6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7b68112b70 con 0x7f7b681083e0 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b65d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 0x7f7b680ff3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b65d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 0x7f7b680ff3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:39788/0 (socket says 172.21.15.98:39788) 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b65d9b640 1 -- 172.21.15.98:0/602173620 learned_addr learned my addr 172.21.15.98:0/602173620 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b66d9d640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b68108d30 0x7f7b680ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b6659c640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b68103100 0x7f7b680fee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b65d9b640 1 -- 172.21.15.98:0/602173620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b68103100 msgr2=0x7f7b680fee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b65d9b640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b68103100 0x7f7b680fee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b65d9b640 1 -- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b68108d30 msgr2=0x7f7b680ff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b65d9b640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b68108d30 0x7f7b680ff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b65d9b640 1 -- 172.21.15.98:0/602173620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b681a87b0 con 0x7f7b681083e0 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b66d9d640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b68108d30 0x7f7b680ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:31:00.600 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.596+0000 7f7b65d9b640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 0x7f7b680ff3a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c02a930 tx=0x7f7b5c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:00.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.597+0000 7f7b577fe640 1 -- 172.21.15.98:0/602173620 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c03f030 con 0x7f7b681083e0 2024-09-21T06:31:00.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.597+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b681a8a40 con 0x7f7b681083e0 2024-09-21T06:31:00.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.597+0000 7f7b577fe640 1 -- 172.21.15.98:0/602173620 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b5c003aa0 con 0x7f7b681083e0 2024-09-21T06:31:00.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.597+0000 7f7b577fe640 1 -- 172.21.15.98:0/602173620 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c035070 con 0x7f7b681083e0 2024-09-21T06:31:00.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.597+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b681a8f20 con 0x7f7b681083e0 2024-09-21T06:31:00.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.598+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b68103510 con 0x7f7b681083e0 2024-09-21T06:31:00.601 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.599+0000 7f7b577fe640 1 -- 172.21.15.98:0/602173620 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f7b5c042030 con 0x7f7b681083e0 2024-09-21T06:31:00.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.600+0000 7f7b577fe640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b500b6560 0x7f7b500b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:00.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.600+0000 7f7b577fe640 1 -- 172.21.15.98:0/602173620 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7f7b5c106eb0 con 0x7f7b681083e0 2024-09-21T06:31:00.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.600+0000 7f7b6659c640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b500b6560 0x7f7b500b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:00.602 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.601+0000 7f7b6659c640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b500b6560 0x7f7b500b8a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b58005fd0 tx=0x7f7b58005e40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:00.605 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.604+0000 7f7b577fe640 1 -- 172.21.15.98:0/602173620 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b5c138710 con 0x7f7b681083e0 2024-09-21T06:31:00.795 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:00.793+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7b68063800 con 0x7f7b500b6560 2024-09-21T06:31:01.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:31:01.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:31:01.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:01.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:01.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi079 2024-09-21T06:31:01.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:01.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:01.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi079 to 8544M 2024-09-21T06:31:01.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:01.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:01.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:00 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:31:01.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:31:01.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi079 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi079 to 8544M 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:01.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:00 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:31:01.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:31:01.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:01.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:01.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi079 2024-09-21T06:31:01.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:01.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:01.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi079 to 8544M 2024-09-21T06:31:01.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:01.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:01.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:01.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:00 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: osd.4 [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] boot 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:02.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:02.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:31:02.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:31:02.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:31:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: osd.4 [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] boot 2024-09-21T06:31:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:31:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:02.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: osd.4 [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] boot 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:02.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:03.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:02 smithi098 ceph-mon[34704]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:31:03.124 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:02 smithi049 ceph-mon[31177]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:31:03.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:02 smithi079 ceph-mon[34346]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:31:04.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:03 smithi098 ceph-mon[34704]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:04.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:03 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/1297219058' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "db652115-165f-4226-aec4-f0d0971e8395"} : dispatch 2024-09-21T06:31:04.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:03 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "db652115-165f-4226-aec4-f0d0971e8395"} : dispatch 2024-09-21T06:31:04.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:03 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db652115-165f-4226-aec4-f0d0971e8395"}]': finished 2024-09-21T06:31:04.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:03 smithi098 ceph-mon[34704]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:31:04.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:03 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:04.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:03 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/19911635' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:03 smithi049 ceph-mon[31177]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:03 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/1297219058' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "db652115-165f-4226-aec4-f0d0971e8395"} : dispatch 2024-09-21T06:31:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:03 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "db652115-165f-4226-aec4-f0d0971e8395"} : dispatch 2024-09-21T06:31:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:03 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db652115-165f-4226-aec4-f0d0971e8395"}]': finished 2024-09-21T06:31:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:03 smithi049 ceph-mon[31177]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:31:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:03 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:03 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/19911635' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:04.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:03 smithi079 ceph-mon[34346]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:04.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:03 smithi079 ceph-mon[34346]: from='client.? 172.21.15.98:0/1297219058' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "db652115-165f-4226-aec4-f0d0971e8395"} : dispatch 2024-09-21T06:31:04.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:03 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "db652115-165f-4226-aec4-f0d0971e8395"} : dispatch 2024-09-21T06:31:04.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:03 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db652115-165f-4226-aec4-f0d0971e8395"}]': finished 2024-09-21T06:31:04.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:03 smithi079 ceph-mon[34346]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:31:04.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:03 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:04.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:03 smithi079 ceph-mon[34346]: from='client.? 172.21.15.98:0/19911635' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:06.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:05 smithi049 ceph-mon[31177]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:06.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:05 smithi098 ceph-mon[34704]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:06.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:05 smithi079 ceph-mon[34346]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:08.222 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:07 smithi098 ceph-mon[34704]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:08.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:07 smithi049 ceph-mon[31177]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:08.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:07 smithi079 ceph-mon[34346]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:09.964 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:09 smithi098 ceph-mon[34704]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:10.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:09 smithi049 ceph-mon[31177]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:10.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:09 smithi079 ceph-mon[34346]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:11 smithi049 ceph-mon[31177]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:12.267 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:11 smithi098 ceph-mon[34704]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:12.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:11 smithi079 ceph-mon[34346]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:13.189 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:31:13.189 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:13.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:31:13.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:31:13.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:14.095 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:13 smithi098 ceph-mon[34704]: Deploying daemon osd.5 on smithi098 2024-09-21T06:31:14.095 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:13 smithi098 ceph-mon[34704]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:13 smithi049 ceph-mon[31177]: Deploying daemon osd.5 on smithi098 2024-09-21T06:31:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:13 smithi049 ceph-mon[31177]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:14.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:13 smithi079 ceph-mon[34346]: Deploying daemon osd.5 on smithi098 2024-09-21T06:31:14.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:13 smithi079 ceph-mon[34346]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:16.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:15 smithi049 ceph-mon[31177]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:16.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:15 smithi098 ceph-mon[34704]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:16.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:15 smithi079 ceph-mon[34346]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:18.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:17 smithi098 ceph-mon[34704]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:18.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:17 smithi049 ceph-mon[31177]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:17 smithi079 ceph-mon[34346]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:19.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:19.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:19.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:19.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:19.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:19.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:19.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:19 smithi098 ceph-mon[34704]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:20.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:19 smithi049 ceph-mon[31177]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:20.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:19 smithi079 ceph-mon[34346]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:21.950 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:21 smithi098 ceph-mon[34704]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:21.950 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:21.950 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:21.950 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:21.950 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:21.950 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:21.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:21 smithi049 ceph-mon[31177]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:21.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:21.992 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.990+0000 7f7b577fe640 1 -- 172.21.15.98:0/602173620 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7b68063800 con 0x7f7b500b6560 2024-09-21T06:31:21.992 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 5 on host 'smithi098' 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b500b6560 msgr2=0x7f7b500b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b500b6560 0x7f7b500b8a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b58005fd0 tx=0x7f7b58005e40 comp rx=0 tx=0).stop 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 msgr2=0x7f7b680ff3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 0x7f7b680ff3a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c02a930 tx=0x7f7b5c004270 comp rx=0 tx=0).stop 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 shutdown_connections 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7b500b6560 0x7f7b500b8a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7b68108d30 0x7f7b680ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7b681083e0 0x7f7b680ff3a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 --2- 172.21.15.98:0/602173620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7b68103100 0x7f7b680fee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 >> 172.21.15.98:0/602173620 conn(0x7f7b68079e30 msgr2=0x7f7b681012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 shutdown_connections 2024-09-21T06:31:21.994 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:31:21.992+0000 7f7b6cfc6640 1 -- 172.21.15.98:0/602173620 wait complete. 2024-09-21T06:31:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:21 smithi079 ceph-mon[34346]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:22.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:22.605 DEBUG:teuthology.orchestra.run.smithi098:osd.5> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T06:31:22.648 INFO:tasks.cephadm:Deploying osd.6 on smithi049 with /dev/vg_nvme/lv_2... 2024-09-21T06:31:22.648 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:31:22.837 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:22.837 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:22.837 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:22.916 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:22.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:22.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:22.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:23.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:23.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:23.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:23.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:23 smithi098 ceph-mon[34704]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:23 smithi049 ceph-mon[31177]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:24.063 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:31:23 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:31:23.810+0000 7f16744fd640 -1 osd.5 0 log_to_monitors true 2024-09-21T06:31:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:23 smithi079 ceph-mon[34346]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:24.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:24 smithi049 ceph-mon[31177]: from='osd.5 [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:31:24.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:24 smithi049 ceph-mon[31177]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:31:25.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:24 smithi098 ceph-mon[34704]: from='osd.5 [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:31:25.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:24 smithi098 ceph-mon[34704]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:31:25.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:24 smithi079 ceph-mon[34346]: from='osd.5 [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:31:25.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:24 smithi079 ceph-mon[34346]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:31:25.585 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:31:25.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi049:vg_nvme/lv_2 2024-09-21T06:31:25.747 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:31:25.670+0000 7f167047f640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T06:31:25.747 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:31:25.676+0000 7f166c27d640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:31:25.747 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:25.747 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:31:25.747 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:31:25.747 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='osd.5 [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:25.748 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:25.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:31:25.782 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='osd.5 [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:25.783 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.875 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:31:25.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:25.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:31:25.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:31:25.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:25.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='osd.5 [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:31:25.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:31:25.971 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.971 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.971 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:25.971 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:25.971 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:25.971 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:25.971 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:25.971 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.282+0000 7f10e729f640 1 -- 172.21.15.49:0/1815448418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 msgr2=0x7f10e01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.282+0000 7f10e729f640 1 --2- 172.21.15.49:0/1815448418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 0x7f10e01087b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009900 tx=0x7f10d002a410 comp rx=0 tx=0).stop 2024-09-21T06:31:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.282+0000 7f10e729f640 1 -- 172.21.15.49:0/1815448418 shutdown_connections 2024-09-21T06:31:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.282+0000 7f10e729f640 1 --2- 172.21.15.49:0/1815448418 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e0108cf0 0x7f10e010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.282+0000 7f10e729f640 1 --2- 172.21.15.49:0/1815448418 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 0x7f10e01087b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.282+0000 7f10e729f640 1 --2- 172.21.15.49:0/1815448418 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0102a60 0x7f10e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:26.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.282+0000 7f10e729f640 1 -- 172.21.15.49:0/1815448418 >> 172.21.15.49:0/1815448418 conn(0x7f10e0079730 msgr2=0x7f10e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.282+0000 7f10e729f640 1 -- 172.21.15.49:0/1815448418 shutdown_connections 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.282+0000 7f10e729f640 1 -- 172.21.15.49:0/1815448418 wait complete. 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.283+0000 7f10e729f640 1 Processor -- start 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.283+0000 7f10e729f640 1 -- start start 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.283+0000 7f10e729f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e0102a60 0x7f10e019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.283+0000 7f10e729f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 0x7f10e019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.283+0000 7f10e729f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0108cf0 0x7f10e019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.283+0000 7f10e729f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0112960 con 0x7f10e01083a0 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.283+0000 7f10e729f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10e01127e0 con 0x7f10e0108cf0 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.283+0000 7f10e729f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10e0112ae0 con 0x7f10e0102a60 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e483a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 0x7f10e019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e483a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 0x7f10e019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51870/0 (socket says 172.21.15.49:51870) 2024-09-21T06:31:26.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e503b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e0102a60 0x7f10e019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e483a640 1 -- 172.21.15.49:0/3172420745 learned_addr learned my addr 172.21.15.49:0/3172420745 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e583c640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0108cf0 0x7f10e019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e483a640 1 -- 172.21.15.49:0/3172420745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e0102a60 msgr2=0x7f10e019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e483a640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e0102a60 0x7f10e019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e483a640 1 -- 172.21.15.49:0/3172420745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0108cf0 msgr2=0x7f10e019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e483a640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0108cf0 0x7f10e019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e483a640 1 -- 172.21.15.49:0/3172420745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e01a0450 con 0x7f10e01083a0 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e503b640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e0102a60 0x7f10e019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e483a640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 0x7f10e019aa80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006010 tx=0x7f10d0004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10d67fc640 1 -- 172.21.15.49:0/3172420745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d003f030 con 0x7f10e01083a0 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10d67fc640 1 -- 172.21.15.49:0/3172420745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10d0003aa0 con 0x7f10e01083a0 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e01a06e0 con 0x7f10e01083a0 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10d67fc640 1 -- 172.21.15.49:0/3172420745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0035070 con 0x7f10e01083a0 2024-09-21T06:31:26.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.284+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e01a6ea0 con 0x7f10e01083a0 2024-09-21T06:31:26.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.285+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e0103ce0 con 0x7f10e01083a0 2024-09-21T06:31:26.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.287+0000 7f10d67fc640 1 -- 172.21.15.49:0/3172420745 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f10d0042030 con 0x7f10e01083a0 2024-09-21T06:31:26.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.288+0000 7f10d67fc640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10cc0b6560 0x7f10cc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:26.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.288+0000 7f10e503b640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10cc0b6560 0x7f10cc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:26.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.288+0000 7f10d67fc640 1 -- 172.21.15.49:0/3172420745 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4468+0+0 (secure 0 0 0) 0x7f10d0106c70 con 0x7f10e01083a0 2024-09-21T06:31:26.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.289+0000 7f10e503b640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10cc0b6560 0x7f10cc0b8a70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f10dc005d00 tx=0x7f10dc00b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:26.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.292+0000 7f10d67fc640 1 -- 172.21.15.49:0/3172420745 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10d00d27c0 con 0x7f10e01083a0 2024-09-21T06:31:26.492 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:26.490+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f10e0063800 con 0x7f10cc0b6560 2024-09-21T06:31:26.820 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:26 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi098 2024-09-21T06:31:26.820 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:26 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-21T06:31:26.820 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:26 smithi049 ceph-mon[31177]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:31:26.820 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:26 smithi049 ceph-mon[31177]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:31:26.821 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:26 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:26.821 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:26 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:26.821 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:26 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:26.821 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:26 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:26.821 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:26 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:26 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi098 2024-09-21T06:31:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:26 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-21T06:31:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:26 smithi098 ceph-mon[34704]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:31:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:26 smithi098 ceph-mon[34704]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:31:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:26 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:26 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:26 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:26 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:26 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:27.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:26 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi098 2024-09-21T06:31:27.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:26 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi098 to 8544M 2024-09-21T06:31:27.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:26 smithi079 ceph-mon[34346]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:31:27.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:26 smithi079 ceph-mon[34346]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:31:27.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:26 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:27.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:26 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:27.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:26 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:27.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:26 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:27.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:26 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:27 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:31:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:27 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:31:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:27 smithi049 ceph-mon[31177]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:27 smithi049 ceph-mon[31177]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:27 smithi049 ceph-mon[31177]: osd.5 [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] boot 2024-09-21T06:31:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:27 smithi049 ceph-mon[31177]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:31:27.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:27 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:31:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:27 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:31:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:27 smithi098 ceph-mon[34704]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:27 smithi098 ceph-mon[34704]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:27 smithi098 ceph-mon[34704]: osd.5 [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] boot 2024-09-21T06:31:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:27 smithi098 ceph-mon[34704]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:31:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:27 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:31:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:27 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:31:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:27 smithi079 ceph-mon[34346]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:31:28.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:27 smithi079 ceph-mon[34346]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:28.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:28.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:27 smithi079 ceph-mon[34346]: osd.5 [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] boot 2024-09-21T06:31:28.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:27 smithi079 ceph-mon[34346]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:31:28.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:31:28.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:28 smithi049 ceph-mon[31177]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:31:29.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:28 smithi098 ceph-mon[34704]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:31:29.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:28 smithi079 ceph-mon[34346]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:31:29.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:29 smithi049 ceph-mon[31177]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:29.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:29 smithi049 ceph-mon[31177]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:31:29.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:29 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2920850324' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "889a9a6d-e3ad-4d6e-931c-b20e0e47c84e"} : dispatch 2024-09-21T06:31:29.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:29 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2920850324' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "889a9a6d-e3ad-4d6e-931c-b20e0e47c84e"}]': finished 2024-09-21T06:31:29.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:29 smithi049 ceph-mon[31177]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:31:29.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:29.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:29 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2127094862' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:30.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:29 smithi098 ceph-mon[34704]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:29 smithi098 ceph-mon[34704]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:31:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:29 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2920850324' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "889a9a6d-e3ad-4d6e-931c-b20e0e47c84e"} : dispatch 2024-09-21T06:31:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:29 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2920850324' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "889a9a6d-e3ad-4d6e-931c-b20e0e47c84e"}]': finished 2024-09-21T06:31:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:29 smithi098 ceph-mon[34704]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:31:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:29 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2127094862' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:29 smithi079 ceph-mon[34346]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:30.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:29 smithi079 ceph-mon[34346]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:31:30.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:29 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2920850324' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "889a9a6d-e3ad-4d6e-931c-b20e0e47c84e"} : dispatch 2024-09-21T06:31:30.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:29 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2920850324' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "889a9a6d-e3ad-4d6e-931c-b20e0e47c84e"}]': finished 2024-09-21T06:31:30.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:29 smithi079 ceph-mon[34346]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:31:30.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:30.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:29 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2127094862' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:31.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:31 smithi049 ceph-mon[31177]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:32.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:31 smithi098 ceph-mon[34704]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:31 smithi079 ceph-mon[34346]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:33.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:33 smithi049 ceph-mon[31177]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T06:31:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:33 smithi098 ceph-mon[34704]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T06:31:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:33 smithi079 ceph-mon[34346]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-21T06:31:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:35 smithi049 ceph-mon[31177]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:31:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:35 smithi098 ceph-mon[34704]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:31:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:35 smithi079 ceph-mon[34346]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:31:37.967 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:37 smithi049 ceph-mon[31177]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:31:37.967 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:31:37.967 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:38.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:37 smithi098 ceph-mon[34704]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:31:38.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:31:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:38.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:37 smithi079 ceph-mon[34346]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:31:38.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:31:38.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:38.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:38 smithi049 ceph-mon[31177]: Deploying daemon osd.6 on smithi049 2024-09-21T06:31:39.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:38 smithi098 ceph-mon[34704]: Deploying daemon osd.6 on smithi049 2024-09-21T06:31:39.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:38 smithi079 ceph-mon[34346]: Deploying daemon osd.6 on smithi049 2024-09-21T06:31:39.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:39 smithi049 ceph-mon[31177]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:31:40.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:39 smithi098 ceph-mon[34704]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:31:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:39 smithi079 ceph-mon[34346]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:31:41.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:41 smithi049 ceph-mon[31177]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T06:31:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:41 smithi098 ceph-mon[34704]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T06:31:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:41 smithi079 ceph-mon[34346]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T06:31:43.712 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:43 smithi049 ceph-mon[31177]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:31:43.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:43 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:43 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:43 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:44.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:43 smithi098 ceph-mon[34704]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:31:44.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:43 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:44.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:43 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:44.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:43 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:43 smithi079 ceph-mon[34346]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:31:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:43 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:43 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:43 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:45.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:45 smithi049 ceph-mon[31177]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:46.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:45 smithi098 ceph-mon[34704]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:46.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:45 smithi079 ceph-mon[34346]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:47.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.156+0000 7f10d67fc640 1 -- 172.21.15.49:0/3172420745 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f10e0063800 con 0x7f10cc0b6560 2024-09-21T06:31:47.158 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 6 on host 'smithi049' 2024-09-21T06:31:47.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10cc0b6560 msgr2=0x7f10cc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10cc0b6560 0x7f10cc0b8a70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f10dc005d00 tx=0x7f10dc00b410 comp rx=0 tx=0).stop 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 msgr2=0x7f10e019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 0x7f10e019aa80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006010 tx=0x7f10d0004060 comp rx=0 tx=0).stop 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 shutdown_connections 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10cc0b6560 0x7f10cc0b8a70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10e0108cf0 0x7f10e019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10e01083a0 0x7f10e019aa80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 --2- 172.21.15.49:0/3172420745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10e0102a60 0x7f10e019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 >> 172.21.15.49:0/3172420745 conn(0x7f10e0079730 msgr2=0x7f10e006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 shutdown_connections 2024-09-21T06:31:47.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:31:47.159+0000 7f10e729f640 1 -- 172.21.15.49:0/3172420745 wait complete. 2024-09-21T06:31:47.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:47 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:47.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:47 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:47.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:47 smithi098 ceph-mon[34704]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:47.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:47 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:47.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:47 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:47.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:47 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:47.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:47 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:47.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:47 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:47.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:47 smithi079 ceph-mon[34346]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:47.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:47 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:47.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:47 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:47.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:47 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:47.458 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:47 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:47.459 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:47 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:47.459 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:47 smithi049 ceph-mon[31177]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:47.459 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:47 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:47.459 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:47 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:47.459 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:47 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:47.848 DEBUG:teuthology.orchestra.run.smithi049:osd.6> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T06:31:47.850 INFO:tasks.cephadm:Deploying osd.7 on smithi079 with /dev/vg_nvme/lv_2... 2024-09-21T06:31:47.850 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:31:48.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:48 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:48.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:48 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:48.069 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:48 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:48.104 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:31:48.217 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:48 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:48.218 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:48 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:48.218 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:48 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:48.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:48 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:48 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:48 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:49.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:49 smithi049 ceph-mon[31177]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:49.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:49 smithi098 ceph-mon[34704]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:49.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:49 smithi079 ceph-mon[34346]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:49.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:31:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:31:49.326+0000 7f1f61873640 -1 osd.6 0 log_to_monitors true 2024-09-21T06:31:50.254 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:50 smithi079 ceph-mon[34346]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:31:50.314 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:50 smithi049 ceph-mon[31177]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:31:50.532 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:31:50.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:50 smithi098 ceph-mon[34704]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:31:50.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi079:vg_nvme/lv_2 2024-09-21T06:31:50.814 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi049 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:51.094 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi049 to 5696M 2024-09-21T06:31:51.095 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.095 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:51.095 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:51.095 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.095 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:51 smithi079 ceph-mon[34346]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:31:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.329+0000 7fd124f64640 1 -- 172.21.15.79:0/388704744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120105290 msgr2=0x7fd12010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.329+0000 7fd124f64640 1 --2- 172.21.15.79:0/388704744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120105290 0x7fd12010d8d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd108009900 tx=0x7fd10802a410 comp rx=0 tx=0).stop 2024-09-21T06:31:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.329+0000 7fd124f64640 1 -- 172.21.15.79:0/388704744 shutdown_connections 2024-09-21T06:31:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.329+0000 7fd124f64640 1 --2- 172.21.15.79:0/388704744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd12010de10 0x7fd1201102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.329+0000 7fd124f64640 1 --2- 172.21.15.79:0/388704744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120105290 0x7fd12010d8d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.329+0000 7fd124f64640 1 --2- 172.21.15.79:0/388704744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd120104860 0x7fd120104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.329+0000 7fd124f64640 1 -- 172.21.15.79:0/388704744 >> 172.21.15.79:0/388704744 conn(0x7fd120079730 msgr2=0x7fd120079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.329+0000 7fd124f64640 1 -- 172.21.15.79:0/388704744 shutdown_connections 2024-09-21T06:31:51.331 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.329+0000 7fd124f64640 1 -- 172.21.15.79:0/388704744 wait complete. 2024-09-21T06:31:51.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd124f64640 1 Processor -- start 2024-09-21T06:31:51.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd124f64640 1 -- start start 2024-09-21T06:31:51.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd124f64640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120104860 0x7fd12019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:51.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd124f64640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd120105290 0x7fd12019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:51.333 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd124f64640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd12010de10 0x7fd12019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:51.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd124f64640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd120113aa0 con 0x7fd120105290 2024-09-21T06:31:51.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd124f64640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd120113920 con 0x7fd120104860 2024-09-21T06:31:51.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd124f64640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd120113c20 con 0x7fd12010de10 2024-09-21T06:31:51.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd11e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120104860 0x7fd12019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:51.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd11e59c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120104860 0x7fd12019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48364/0 (socket says 172.21.15.79:48364) 2024-09-21T06:31:51.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd11e59c640 1 -- 172.21.15.79:0/1755884135 learned_addr learned my addr 172.21.15.79:0/1755884135 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T06:31:51.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd117fff640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd120105290 0x7fd12019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:51.334 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd11ed9d640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd12010de10 0x7fd12019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:51.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd11e59c640 1 -- 172.21.15.79:0/1755884135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd12010de10 msgr2=0x7fd12019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:51.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd11e59c640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd12010de10 0x7fd12019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:51.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd11e59c640 1 -- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd120105290 msgr2=0x7fd12019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:51.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd11e59c640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd120105290 0x7fd12019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:51.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.330+0000 7fd11e59c640 1 -- 172.21.15.79:0/1755884135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1201a0480 con 0x7fd120104860 2024-09-21T06:31:51.335 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.331+0000 7fd11e59c640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120104860 0x7fd12019a510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd11000b4a0 tx=0x7fd11000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:51.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.331+0000 7fd1177fe640 1 -- 172.21.15.79:0/1755884135 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110014070 con 0x7fd120104860 2024-09-21T06:31:51.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.331+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1201a0770 con 0x7fd120104860 2024-09-21T06:31:51.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.331+0000 7fd1177fe640 1 -- 172.21.15.79:0/1755884135 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd110010ac0 con 0x7fd120104860 2024-09-21T06:31:51.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.331+0000 7fd1177fe640 1 -- 172.21.15.79:0/1755884135 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd110017c30 con 0x7fd120104860 2024-09-21T06:31:51.336 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.331+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd120102650 con 0x7fd120104860 2024-09-21T06:31:51.337 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.332+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd120104c70 con 0x7fd120104860 2024-09-21T06:31:51.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.333+0000 7fd1177fe640 1 -- 172.21.15.79:0/1755884135 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fd110017070 con 0x7fd120104860 2024-09-21T06:31:51.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.334+0000 7fd1177fe640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd10c0ba970 0x7fd10c0bce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:51.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.334+0000 7fd1177fe640 1 -- 172.21.15.79:0/1755884135 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4900+0+0 (secure 0 0 0) 0x7fd1100e5cf0 con 0x7fd120104860 2024-09-21T06:31:51.338 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.334+0000 7fd117fff640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd10c0ba970 0x7fd10c0bce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:51.339 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.335+0000 7fd117fff640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd10c0ba970 0x7fd10c0bce80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd108009230 tx=0x7fd108031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:51.340 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.337+0000 7fd1177fe640 1 -- 172.21.15.79:0/1755884135 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1100ad2d0 con 0x7fd120104860 2024-09-21T06:31:51.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:31:51.050+0000 7f1f5d7f5640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T06:31:51.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:31:51.060+0000 7f1f595f3640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:31:51.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:31:51.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:31:51.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:31:51.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:51.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:51.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi049 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi049 to 5696M 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:51 smithi049 ceph-mon[31177]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:31:51.533 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:31:51.531+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd120063800 con 0x7fd10c0ba970 2024-09-21T06:31:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:31:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:31:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:31:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:51.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi049 2024-09-21T06:31:51.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:51.548 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:51.549 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:51.549 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi049 to 5696M 2024-09-21T06:31:51.549 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.549 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:51.549 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:51.550 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:31:51.550 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:51 smithi098 ceph-mon[34704]: from='osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:31:52.112 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:52 smithi079 ceph-mon[34346]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:31:52.113 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:52.113 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:52.113 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:52 smithi079 ceph-mon[34346]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:52.113 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:52.113 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:52.113 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:52.114 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:52.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:52 smithi049 ceph-mon[31177]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:31:52.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:52.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:52.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:52 smithi049 ceph-mon[31177]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:52.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:52.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:52.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:52.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:52.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:52 smithi098 ceph-mon[34704]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:31:52.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:52.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:52.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:52 smithi098 ceph-mon[34704]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:52.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:52.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:52.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:52.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:53 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:31:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:53 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:31:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:53 smithi079 ceph-mon[34346]: osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] boot 2024-09-21T06:31:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:53 smithi079 ceph-mon[34346]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:31:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:53 smithi079 ceph-mon[34346]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:53.447 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:53 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:31:53.447 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:53 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:31:53.447 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:53 smithi098 ceph-mon[34704]: osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] boot 2024-09-21T06:31:53.447 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:53 smithi098 ceph-mon[34704]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:31:53.447 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:53.447 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:53 smithi098 ceph-mon[34704]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:53.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:53 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:31:53.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:53 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:31:53.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:53 smithi049 ceph-mon[31177]: osd.6 [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] boot 2024-09-21T06:31:53.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:53 smithi049 ceph-mon[31177]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:31:53.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:53.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:53 smithi049 ceph-mon[31177]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:54 smithi079 ceph-mon[34346]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T06:31:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:54 smithi079 ceph-mon[34346]: from='client.? 172.21.15.79:0/3295352916' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a34b10e4-7b61-4d29-aed8-1c18e98dc8ae"} : dispatch 2024-09-21T06:31:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:54 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a34b10e4-7b61-4d29-aed8-1c18e98dc8ae"} : dispatch 2024-09-21T06:31:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:54 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a34b10e4-7b61-4d29-aed8-1c18e98dc8ae"}]': finished 2024-09-21T06:31:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:54 smithi079 ceph-mon[34346]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:31:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:54.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:54 smithi049 ceph-mon[31177]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T06:31:54.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:54 smithi049 ceph-mon[31177]: from='client.? 172.21.15.79:0/3295352916' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a34b10e4-7b61-4d29-aed8-1c18e98dc8ae"} : dispatch 2024-09-21T06:31:54.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:54 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a34b10e4-7b61-4d29-aed8-1c18e98dc8ae"} : dispatch 2024-09-21T06:31:54.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:54 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a34b10e4-7b61-4d29-aed8-1c18e98dc8ae"}]': finished 2024-09-21T06:31:54.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:54 smithi049 ceph-mon[31177]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:31:54.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:54.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:54 smithi098 ceph-mon[34704]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T06:31:54.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:54 smithi098 ceph-mon[34704]: from='client.? 172.21.15.79:0/3295352916' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a34b10e4-7b61-4d29-aed8-1c18e98dc8ae"} : dispatch 2024-09-21T06:31:54.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:54 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a34b10e4-7b61-4d29-aed8-1c18e98dc8ae"} : dispatch 2024-09-21T06:31:54.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:54 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a34b10e4-7b61-4d29-aed8-1c18e98dc8ae"}]': finished 2024-09-21T06:31:54.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:54 smithi098 ceph-mon[34704]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:31:54.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:55.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:55 smithi049 ceph-mon[31177]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:55.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:55 smithi049 ceph-mon[31177]: from='client.? 172.21.15.79:0/992497649' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:55.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:55 smithi098 ceph-mon[34704]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:55.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:55 smithi098 ceph-mon[34704]: from='client.? 172.21.15.79:0/992497649' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:55.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:55 smithi079 ceph-mon[34346]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:55.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:55 smithi079 ceph-mon[34346]: from='client.? 172.21.15.79:0/992497649' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:57.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:57 smithi049 ceph-mon[31177]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:57.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:57 smithi098 ceph-mon[34704]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:57.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:57 smithi079 ceph-mon[34346]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:59.265 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:31:59 smithi079 ceph-mon[34346]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:59.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:31:59 smithi049 ceph-mon[31177]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:59.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:31:59 smithi098 ceph-mon[34704]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:01.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:01 smithi079 ceph-mon[34346]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:01.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:01 smithi049 ceph-mon[31177]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:01.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:01 smithi098 ceph-mon[34704]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:02.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:32:02.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:02.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:32:02.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:02.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:32:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:03.374 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:03 smithi049 ceph-mon[31177]: Deploying daemon osd.7 on smithi079 2024-09-21T06:32:03.374 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:03 smithi049 ceph-mon[31177]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:03.383 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:03 smithi079 ceph-mon[34346]: Deploying daemon osd.7 on smithi079 2024-09-21T06:32:03.383 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:03 smithi079 ceph-mon[34346]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:03.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:03 smithi098 ceph-mon[34704]: Deploying daemon osd.7 on smithi079 2024-09-21T06:32:03.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:03 smithi098 ceph-mon[34704]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:05.316 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:05 smithi079 ceph-mon[34346]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:05.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:05 smithi049 ceph-mon[31177]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:05.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:05 smithi098 ceph-mon[34704]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:07.405 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:07 smithi079 ceph-mon[34346]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:07 smithi049 ceph-mon[31177]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:07.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:07 smithi098 ceph-mon[34704]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:08.401 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:08 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:08.401 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:08 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:08.401 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:08 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:08.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:08 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:08.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:08 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:08.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:08 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:08.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:08 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:08.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:08 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:08.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:08 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:09.405 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:09 smithi079 ceph-mon[34346]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:09.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:09 smithi049 ceph-mon[31177]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:09.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:09 smithi098 ceph-mon[34704]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:11.671 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.669+0000 7fd1177fe640 1 -- 172.21.15.79:0/1755884135 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd120063800 con 0x7fd10c0ba970 2024-09-21T06:32:11.671 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 7 on host 'smithi079' 2024-09-21T06:32:11.673 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.671+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd10c0ba970 msgr2=0x7fd10c0bce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.671+0000 7fd124f64640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd10c0ba970 0x7fd10c0bce80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd108009230 tx=0x7fd108031400 comp rx=0 tx=0).stop 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.671+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120104860 msgr2=0x7fd12019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.671+0000 7fd124f64640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120104860 0x7fd12019a510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd11000b4a0 tx=0x7fd11000b960 comp rx=0 tx=0).stop 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.672+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 shutdown_connections 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.672+0000 7fd124f64640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd10c0ba970 0x7fd10c0bce80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.672+0000 7fd124f64640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd12010de10 0x7fd12019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.672+0000 7fd124f64640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd120105290 0x7fd12019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.672+0000 7fd124f64640 1 --2- 172.21.15.79:0/1755884135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd120104860 0x7fd12019a510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.672+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 >> 172.21.15.79:0/1755884135 conn(0x7fd120079730 msgr2=0x7fd1201008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.672+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 shutdown_connections 2024-09-21T06:32:11.674 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:32:11.672+0000 7fd124f64640 1 -- 172.21.15.79:0/1755884135 wait complete. 2024-09-21T06:32:11.968 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:11 smithi079 ceph-mon[34346]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:11.968 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:11.968 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:11.968 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:11.968 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:11.968 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:11.968 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:11.968 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:11 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:11.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:11 smithi049 ceph-mon[31177]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:11.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:11 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:11 smithi098 ceph-mon[34704]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:11 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:12.279 DEBUG:teuthology.orchestra.run.smithi079:osd.7> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T06:32:12.281 INFO:tasks.cephadm:Deploying osd.8 on smithi098 with /dev/vg_nvme/lv_2... 2024-09-21T06:32:12.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:32:12.537 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:32:12.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:12.987 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:13.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:13.770 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:13 smithi079 ceph-mon[34346]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:13.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:13 smithi098 ceph-mon[34704]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:13.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:13 smithi049 ceph-mon[31177]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:14.368 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:32:14 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:32:14.113+0000 7f1f7cb6a640 -1 osd.7 0 log_to_monitors true 2024-09-21T06:32:14.923 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:14 smithi079 ceph-mon[34346]: from='osd.7 [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:32:14.923 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:14 smithi079 ceph-mon[34346]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:32:14.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:14 smithi049 ceph-mon[31177]: from='osd.7 [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:32:14.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:14 smithi049 ceph-mon[31177]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:32:15.007 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:14 smithi098 ceph-mon[34704]: from='osd.7 [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:32:15.007 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:14 smithi098 ceph-mon[34704]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:32:15.011 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:32:15.038 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_2 2024-09-21T06:32:15.361 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:32:15.739 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:15.739 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:32:15.739 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='osd.7 [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:32:15.739 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:32:15.739 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:15.739 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:32:15.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:15.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:15.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:15.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:15.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:15.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:15.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:15.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:15.740 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:15.864 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 -- 172.21.15.98:0/2557766597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 msgr2=0x7f1858110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 --2- 172.21.15.98:0/2557766597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 0x7f1858110620 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1850009ca0 tx=0x7f185002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 -- 172.21.15.98:0/2557766597 shutdown_connections 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 --2- 172.21.15.98:0/2557766597 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 0x7f1858110620 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 --2- 172.21.15.98:0/2557766597 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18581094a0 0x7f18581098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 --2- 172.21.15.98:0/2557766597 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1858103b60 0x7f1858103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 -- 172.21.15.98:0/2557766597 >> 172.21.15.98:0/2557766597 conn(0x7f185807b850 msgr2=0x7f185807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 -- 172.21.15.98:0/2557766597 shutdown_connections 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 -- 172.21.15.98:0/2557766597 wait complete. 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 Processor -- start 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.861+0000 7f185fca3640 1 -- start start 2024-09-21T06:32:15.865 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185fca3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1858103b60 0x7f185819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185fca3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18581094a0 0x7f185819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185fca3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 0x7f185819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185fca3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1858113ab0 con 0x7f18581094a0 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185fca3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1858113930 con 0x7f1858103b60 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185fca3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1858113c30 con 0x7f1858109df0 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185e240640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 0x7f185819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185e240640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 0x7f185819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43034/0 (socket says 172.21.15.98:43034) 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185e240640 1 -- 172.21.15.98:0/3945585870 learned_addr learned my addr 172.21.15.98:0/3945585870 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185da3f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1858103b60 0x7f185819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185d23e640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18581094a0 0x7f185819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:15.866 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185e240640 1 -- 172.21.15.98:0/3945585870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1858103b60 msgr2=0x7f185819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185e240640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1858103b60 0x7f185819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185e240640 1 -- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18581094a0 msgr2=0x7f185819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185e240640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18581094a0 0x7f185819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185e240640 1 -- 172.21.15.98:0/3945585870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18581a0450 con 0x7f1858109df0 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.862+0000 7f185e240640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 0x7f185819fd20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1850005cc0 tx=0x7f1850031700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.863+0000 7f184effd640 1 -- 172.21.15.98:0/3945585870 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1850003b70 con 0x7f1858109df0 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.863+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18581a06e0 con 0x7f1858109df0 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.863+0000 7f184effd640 1 -- 172.21.15.98:0/3945585870 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18500318f0 con 0x7f1858109df0 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.863+0000 7f184effd640 1 -- 172.21.15.98:0/3945585870 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185002f950 con 0x7f1858109df0 2024-09-21T06:32:15.867 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.863+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18581a6ea0 con 0x7f1858109df0 2024-09-21T06:32:15.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.864+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1858103f70 con 0x7f1858109df0 2024-09-21T06:32:15.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.865+0000 7f184effd640 1 -- 172.21.15.98:0/3945585870 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1850004b40 con 0x7f1858109df0 2024-09-21T06:32:15.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.866+0000 7f184effd640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18440b6560 0x7f18440b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:15.868 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.866+0000 7f184effd640 1 -- 172.21.15.98:0/3945585870 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5332+0+0 (secure 0 0 0) 0x7f1850107b50 con 0x7f1858109df0 2024-09-21T06:32:15.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.866+0000 7f185da3f640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18440b6560 0x7f18440b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:15.869 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.867+0000 7f185da3f640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18440b6560 0x7f18440b8a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1854009bd0 tx=0x7f1854005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:15.871 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:15.869+0000 7f184effd640 1 -- 172.21.15.98:0/3945585870 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18500cef80 con 0x7f1858109df0 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='osd.7 [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:15.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:15.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:15.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:15.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:15.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:16.060 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:16.058+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f185810bc50 con 0x7f18440b6560 2024-09-21T06:32:16.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:16.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:32:16.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='osd.7 [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:16.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi079 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi079 to 5696M 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: from='osd.7 ' entity='osd.7' 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T06:32:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi079 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi079 to 5696M 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: from='osd.7 ' entity='osd.7' 2024-09-21T06:32:17.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T06:32:17.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:17.068 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:32:16.622+0000 7f1f79301640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T06:32:17.068 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:32:16.816+0000 7f1f708e2640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:32:17.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi079 2024-09-21T06:32:17.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi079 to 5696M 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: from='osd.7 ' entity='osd.7' 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: osdmap e47: 8 total, 7 up, 8 in 2024-09-21T06:32:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:17.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:17 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:32:17.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:17 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:32:17.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:17 smithi049 ceph-mon[31177]: from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:17.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:17 smithi049 ceph-mon[31177]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:17.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:17.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:17 smithi049 ceph-mon[31177]: osd.7 [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] boot 2024-09-21T06:32:17.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:17 smithi049 ceph-mon[31177]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:32:17.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:18.021 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:17 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:32:18.021 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:17 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:32:18.021 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:17 smithi098 ceph-mon[34704]: from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:18.021 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:17 smithi098 ceph-mon[34704]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:18.021 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:18.021 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:17 smithi098 ceph-mon[34704]: osd.7 [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] boot 2024-09-21T06:32:18.021 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:17 smithi098 ceph-mon[34704]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:32:18.021 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:18.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:17 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:32:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:17 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:32:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:17 smithi079 ceph-mon[34346]: from='client.24490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:17 smithi079 ceph-mon[34346]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:32:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:17 smithi079 ceph-mon[34346]: osd.7 [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] boot 2024-09-21T06:32:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:17 smithi079 ceph-mon[34346]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:32:18.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:32:18.950 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:18 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/1845818405' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1f6bee13-9c82-4580-824f-db812385bbbe"} : dispatch 2024-09-21T06:32:18.951 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:18 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1f6bee13-9c82-4580-824f-db812385bbbe"} : dispatch 2024-09-21T06:32:18.951 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:18 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f6bee13-9c82-4580-824f-db812385bbbe"}]': finished 2024-09-21T06:32:18.951 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:18 smithi098 ceph-mon[34704]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:32:18.951 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:18.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:18 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/1845818405' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1f6bee13-9c82-4580-824f-db812385bbbe"} : dispatch 2024-09-21T06:32:18.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:18 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1f6bee13-9c82-4580-824f-db812385bbbe"} : dispatch 2024-09-21T06:32:18.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:18 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f6bee13-9c82-4580-824f-db812385bbbe"}]': finished 2024-09-21T06:32:18.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:18 smithi049 ceph-mon[31177]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:32:18.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:19.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:18 smithi079 ceph-mon[34346]: from='client.? 172.21.15.98:0/1845818405' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1f6bee13-9c82-4580-824f-db812385bbbe"} : dispatch 2024-09-21T06:32:19.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:18 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1f6bee13-9c82-4580-824f-db812385bbbe"} : dispatch 2024-09-21T06:32:19.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:18 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f6bee13-9c82-4580-824f-db812385bbbe"}]': finished 2024-09-21T06:32:19.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:18 smithi079 ceph-mon[34346]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:32:19.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:19 smithi049 ceph-mon[31177]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:19 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/1798103892' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:20.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:19 smithi098 ceph-mon[34704]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:19 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/1798103892' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:19 smithi079 ceph-mon[34346]: pgmap v159: 1 pgs: 1 remapped+peering; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:19 smithi079 ceph-mon[34346]: from='client.? 172.21.15.98:0/1798103892' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:21.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:20 smithi098 ceph-mon[34704]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:32:21.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:20 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:21.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:20 smithi079 ceph-mon[34346]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:32:21.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:20 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:21.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:20 smithi049 ceph-mon[31177]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:32:21.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:20 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:22.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:21 smithi098 ceph-mon[34704]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:21 smithi079 ceph-mon[34346]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:22.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:21 smithi049 ceph-mon[31177]: pgmap v162: 1 pgs: 1 remapped+peering; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:24.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:23 smithi098 ceph-mon[34704]: pgmap v163: 1 pgs: 1 remapped+peering; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:23 smithi079 ceph-mon[34346]: pgmap v163: 1 pgs: 1 remapped+peering; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:24.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:23 smithi049 ceph-mon[31177]: pgmap v163: 1 pgs: 1 remapped+peering; 577 KiB data, 220 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:25.765 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:25 smithi098 ceph-mon[34704]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 180 KiB/s, 0 objects/s recovering 2024-09-21T06:32:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:25 smithi079 ceph-mon[34346]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 180 KiB/s, 0 objects/s recovering 2024-09-21T06:32:26.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:25 smithi049 ceph-mon[31177]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 180 KiB/s, 0 objects/s recovering 2024-09-21T06:32:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:27 smithi098 ceph-mon[34704]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T06:32:28.080 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:32:28.080 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:28.080 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:27 smithi079 ceph-mon[34346]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T06:32:28.081 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:32:28.081 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:27 smithi049 ceph-mon[31177]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T06:32:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:32:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:28.907 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:28 smithi098 ceph-mon[34704]: Deploying daemon osd.8 on smithi098 2024-09-21T06:32:29.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:28 smithi079 ceph-mon[34346]: Deploying daemon osd.8 on smithi098 2024-09-21T06:32:29.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:28 smithi049 ceph-mon[31177]: Deploying daemon osd.8 on smithi098 2024-09-21T06:32:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:29 smithi098 ceph-mon[34704]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-21T06:32:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:29 smithi079 ceph-mon[34346]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-21T06:32:30.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:29 smithi049 ceph-mon[31177]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 119 KiB/s, 0 objects/s recovering 2024-09-21T06:32:31.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:31 smithi098 ceph-mon[34704]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-21T06:32:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:31 smithi079 ceph-mon[34346]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-21T06:32:32.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:31 smithi049 ceph-mon[31177]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 111 KiB/s, 0 objects/s recovering 2024-09-21T06:32:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:33 smithi049 ceph-mon[31177]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:32:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:33 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:33 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:34.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:33 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:33 smithi098 ceph-mon[34704]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:32:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:33 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:34.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:33 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:34.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:33 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:33 smithi079 ceph-mon[34346]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:32:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:33 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:33 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:33 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:35 smithi098 ceph-mon[34704]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:32:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:35 smithi079 ceph-mon[34346]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:32:36.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:36.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:36.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.226 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:35 smithi049 ceph-mon[31177]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:32:36.226 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.226 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.226 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:36.227 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:36.227 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.665 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.663+0000 7f184effd640 1 -- 172.21.15.98:0/3945585870 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f185401b3f0 con 0x7f18440b6560 2024-09-21T06:32:36.665 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 8 on host 'smithi098' 2024-09-21T06:32:36.667 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18440b6560 msgr2=0x7f18440b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18440b6560 0x7f18440b8a70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1854009bd0 tx=0x7f1854005f90 comp rx=0 tx=0).stop 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 msgr2=0x7f185819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 0x7f185819fd20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1850005cc0 tx=0x7f1850031700 comp rx=0 tx=0).stop 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 shutdown_connections 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18440b6560 0x7f18440b8a70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1858109df0 0x7f185819fd20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18581094a0 0x7f185819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 --2- 172.21.15.98:0/3945585870 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1858103b60 0x7f185819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 >> 172.21.15.98:0/3945585870 conn(0x7f185807b850 msgr2=0x7f18581074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 shutdown_connections 2024-09-21T06:32:36.668 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:32:36.666+0000 7f185fca3640 1 -- 172.21.15.98:0/3945585870 wait complete. 2024-09-21T06:32:36.968 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:36 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:36.968 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:36 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:36.968 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:36 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:37.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:36 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:37.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:36 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:37.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:36 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:37.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:36 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:37.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:36 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:37.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:36 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:37.272 DEBUG:teuthology.orchestra.run.smithi098:osd.8> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T06:32:37.274 INFO:tasks.cephadm:Deploying osd.9 on smithi049 with /dev/vg_nvme/lv_1... 2024-09-21T06:32:37.275 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:32:37.544 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:37 smithi049 ceph-mon[31177]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:38.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:37 smithi098 ceph-mon[34704]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:38.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:37 smithi079 ceph-mon[34346]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:39.296 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:32:38 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:32:38.869+0000 7f1537887640 -1 osd.8 0 log_to_monitors true 2024-09-21T06:32:39.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:39 smithi049 ceph-mon[31177]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:39.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:39 smithi049 ceph-mon[31177]: from='osd.8 [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:39.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:39 smithi049 ceph-mon[31177]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:40.017 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:39 smithi098 ceph-mon[34704]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:40.017 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:39 smithi098 ceph-mon[34704]: from='osd.8 [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:40.017 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:39 smithi098 ceph-mon[34704]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:39 smithi079 ceph-mon[34346]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:39 smithi079 ceph-mon[34346]: from='osd.8 [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:39 smithi079 ceph-mon[34346]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:40.458 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:32:40.484 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi049:vg_nvme/lv_1 2024-09-21T06:32:40.741 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='osd.8 [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:41.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:41.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:41.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:32:41.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='osd.8 [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:41.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='osd.8 [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:41.108 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.109 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:41.109 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:41.109 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:41.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.202+0000 7fcf06f5f640 1 -- 172.21.15.49:0/1754785954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf00104a30 msgr2=0x7fcf00104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:41.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.202+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/1754785954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf00104a30 0x7fcf00104e40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009900 tx=0x7fcef002a410 comp rx=0 tx=0).stop 2024-09-21T06:32:41.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.202+0000 7fcf06f5f640 1 -- 172.21.15.49:0/1754785954 shutdown_connections 2024-09-21T06:32:41.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.202+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/1754785954 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf0010de60 0x7fcf00110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.202+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/1754785954 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf00105380 0x7fcf0010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.202+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/1754785954 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf00104a30 0x7fcf00104e40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.202+0000 7fcf06f5f640 1 -- 172.21.15.49:0/1754785954 >> 172.21.15.49:0/1754785954 conn(0x7fcf00079760 msgr2=0x7fcf00079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:41.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.202+0000 7fcf06f5f640 1 -- 172.21.15.49:0/1754785954 shutdown_connections 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.202+0000 7fcf06f5f640 1 -- 172.21.15.49:0/1754785954 wait complete. 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf06f5f640 1 Processor -- start 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf06f5f640 1 -- start start 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf06f5f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf00104a30 0x7fcf0019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf06f5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf00105380 0x7fcf0019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf06f5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf0010de60 0x7fcf0019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf06f5f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcf00113ac0 con 0x7fcf0010de60 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf06f5f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcf00113940 con 0x7fcf00104a30 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf06f5f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcf00113c40 con 0x7fcf00105380 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcefffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf00105380 0x7fcf0019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf054fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf0010de60 0x7fcf0019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:41.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcefffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf00105380 0x7fcf0019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:40632/0 (socket says 172.21.15.49:40632) 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcefffff640 1 -- 172.21.15.49:0/810593790 learned_addr learned my addr 172.21.15.49:0/810593790 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.203+0000 7fcf04cfb640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf00104a30 0x7fcf0019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcf054fc640 1 -- 172.21.15.49:0/810593790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf00105380 msgr2=0x7fcf0019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcf054fc640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf00105380 0x7fcf0019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcf054fc640 1 -- 172.21.15.49:0/810593790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf00104a30 msgr2=0x7fcf0019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcf054fc640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf00104a30 0x7fcf0019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcf054fc640 1 -- 172.21.15.49:0/810593790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf001a0440 con 0x7fcf0010de60 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcefffff640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf00105380 0x7fcf0019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcf054fc640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf0010de60 0x7fcf0019fd10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009fd0 tx=0x7fcef800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcefdffb640 1 -- 172.21.15.49:0/810593790 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef800ce20 con 0x7fcf0010de60 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf001a0730 con 0x7fcf0010de60 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcefdffb640 1 -- 172.21.15.49:0/810593790 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcef8005020 con 0x7fcf0010de60 2024-09-21T06:32:41.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcefdffb640 1 -- 172.21.15.49:0/810593790 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcef8010690 con 0x7fcf0010de60 2024-09-21T06:32:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.204+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf001a6e90 con 0x7fcf0010de60 2024-09-21T06:32:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.205+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf0006c1f0 con 0x7fcf0010de60 2024-09-21T06:32:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.207+0000 7fcefdffb640 1 -- 172.21.15.49:0/810593790 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fcef80054d0 con 0x7fcf0010de60 2024-09-21T06:32:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.208+0000 7fcefdffb640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcee80b6560 0x7fcee80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.208+0000 7fcf04cfb640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcee80b6560 0x7fcee80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.208+0000 7fcefdffb640 1 -- 172.21.15.49:0/810593790 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5764+0+0 (secure 0 0 0) 0x7fcef80e6fd0 con 0x7fcf0010de60 2024-09-21T06:32:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.208+0000 7fcf04cfb640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcee80b6560 0x7fcee80b8a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcef0000c00 tx=0x7fcef0031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:41.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.212+0000 7fcefdffb640 1 -- 172.21.15.49:0/810593790 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcef80ae250 con 0x7fcf0010de60 2024-09-21T06:32:41.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:32:41.414+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fcf00063800 con 0x7fcee80b6560 2024-09-21T06:32:42.045 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:32:41.682+0000 7f1533809640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T06:32:42.046 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:32:41.712+0000 7f152b5ff640 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:32:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi098 2024-09-21T06:32:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-21T06:32:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:32:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T06:32:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:42.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: from='osd.8 ' entity='osd.8' 2024-09-21T06:32:42.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: osd.8 [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] boot 2024-09-21T06:32:42.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:32:42.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi098 2024-09-21T06:32:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-21T06:32:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:32:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T06:32:42.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:42.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:42.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:42.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:42.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: from='osd.8 ' entity='osd.8' 2024-09-21T06:32:42.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: osd.8 [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] boot 2024-09-21T06:32:42.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:32:42.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:42.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi098 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi098 to 5696M 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 221 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: osdmap e52: 9 total, 8 up, 9 in 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: from='osd.8 ' entity='osd.8' 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: osd.8 [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] boot 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:32:42.103 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:43.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:42 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:32:43.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:42 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:32:43.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:42 smithi098 ceph-mon[34704]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:43.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:42 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:32:43.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:42 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:32:43.059 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:42 smithi049 ceph-mon[31177]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:43.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:42 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:32:43.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:42 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:32:43.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:42 smithi079 ceph-mon[34346]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi049:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:44.045 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:43 smithi049 ceph-mon[31177]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 415 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:44.046 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:43 smithi049 ceph-mon[31177]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:32:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:43 smithi079 ceph-mon[34346]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 415 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:43 smithi079 ceph-mon[34346]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:32:44.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:43 smithi098 ceph-mon[34704]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 415 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:44.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:43 smithi098 ceph-mon[34704]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:32:45.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:44 smithi079 ceph-mon[34346]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T06:32:45.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:44 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1057898987' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d40c6e35-9aac-4e01-bcdf-fbdf15e06099"} : dispatch 2024-09-21T06:32:45.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:44 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1057898987' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d40c6e35-9aac-4e01-bcdf-fbdf15e06099"}]': finished 2024-09-21T06:32:45.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:44 smithi079 ceph-mon[34346]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:32:45.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:44 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:45.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:44 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/613456623' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:45.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:44 smithi049 ceph-mon[31177]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T06:32:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:44 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1057898987' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d40c6e35-9aac-4e01-bcdf-fbdf15e06099"} : dispatch 2024-09-21T06:32:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:44 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1057898987' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d40c6e35-9aac-4e01-bcdf-fbdf15e06099"}]': finished 2024-09-21T06:32:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:44 smithi049 ceph-mon[31177]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:32:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:44 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:44 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/613456623' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:44 smithi098 ceph-mon[34704]: osdmap e55: 9 total, 9 up, 9 in 2024-09-21T06:32:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:44 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1057898987' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d40c6e35-9aac-4e01-bcdf-fbdf15e06099"} : dispatch 2024-09-21T06:32:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:44 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1057898987' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d40c6e35-9aac-4e01-bcdf-fbdf15e06099"}]': finished 2024-09-21T06:32:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:44 smithi098 ceph-mon[34704]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:32:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:44 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:44 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/613456623' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:46.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:45 smithi079 ceph-mon[34346]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 415 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:46.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:45 smithi049 ceph-mon[31177]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 415 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:46.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:45 smithi098 ceph-mon[34704]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 415 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:47 smithi079 ceph-mon[34346]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 415 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:47 smithi049 ceph-mon[31177]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 415 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:48.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:47 smithi098 ceph-mon[34704]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 415 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:49 smithi079 ceph-mon[34346]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:32:50.094 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:49 smithi049 ceph-mon[31177]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:32:50.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:49 smithi098 ceph-mon[34704]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:32:51.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:51 smithi049 ceph-mon[31177]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T06:32:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:51 smithi079 ceph-mon[34346]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T06:32:52.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:51 smithi098 ceph-mon[34704]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T06:32:52.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:32:52.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:53.197 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:32:53.197 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:32:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:53.868 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:53 smithi049 ceph-mon[31177]: Deploying daemon osd.9 on smithi049 2024-09-21T06:32:53.869 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:53 smithi049 ceph-mon[31177]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T06:32:54.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:53 smithi098 ceph-mon[34704]: Deploying daemon osd.9 on smithi049 2024-09-21T06:32:54.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:53 smithi098 ceph-mon[34704]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T06:32:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:53 smithi079 ceph-mon[34346]: Deploying daemon osd.9 on smithi049 2024-09-21T06:32:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:53 smithi079 ceph-mon[34346]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T06:32:56.120 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:55 smithi079 ceph-mon[34346]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T06:32:56.171 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:55 smithi049 ceph-mon[31177]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T06:32:56.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:55 smithi098 ceph-mon[34704]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-21T06:32:58.197 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:57 smithi049 ceph-mon[31177]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:58.198 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:58.198 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:58.198 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:58.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:57 smithi098 ceph-mon[34704]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:58.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:58.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:58.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:58.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:57 smithi079 ceph-mon[34346]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:58.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:58.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:58.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:32:59.958 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:32:59 smithi049 ceph-mon[31177]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:33:00.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:32:59 smithi098 ceph-mon[34704]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:33:00.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:32:59 smithi079 ceph-mon[34346]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:33:00.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.993+0000 7fcefdffb640 1 -- 172.21.15.49:0/810593790 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcf00063800 con 0x7fcee80b6560 2024-09-21T06:33:00.995 INFO:teuthology.orchestra.run.smithi049.stdout:Created osd(s) 9 on host 'smithi049' 2024-09-21T06:33:00.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.995+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcee80b6560 msgr2=0x7fcee80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcee80b6560 0x7fcee80b8a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcef0000c00 tx=0x7fcef0031400 comp rx=0 tx=0).stop 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf0010de60 msgr2=0x7fcf0019fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf0010de60 0x7fcf0019fd10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009fd0 tx=0x7fcef800ef10 comp rx=0 tx=0).stop 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 shutdown_connections 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcee80b6560 0x7fcee80b8a70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcf0010de60 0x7fcf0019fd10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcf00105380 0x7fcf0019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 --2- 172.21.15.49:0/810593790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcf00104a30 0x7fcf0019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 >> 172.21.15.49:0/810593790 conn(0x7fcf00079760 msgr2=0x7fcf00100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 shutdown_connections 2024-09-21T06:33:00.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:00.996+0000 7fcf06f5f640 1 -- 172.21.15.49:0/810593790 wait complete. 2024-09-21T06:33:01.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:01 smithi098 ceph-mon[34704]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:01.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:01.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:01.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:01.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:01 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.549 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:01 smithi049 ceph-mon[31177]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:01.550 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.550 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.550 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:01.550 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:01.550 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.550 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:01.550 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.551 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:01 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:01 smithi079 ceph-mon[34346]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:01.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:01.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:01.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:01.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:01 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:01.578 DEBUG:teuthology.orchestra.run.smithi049:osd.9> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T06:33:01.581 INFO:tasks.cephadm:Deploying osd.10 on smithi079 with /dev/vg_nvme/lv_1... 2024-09-21T06:33:01.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:33:01.837 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:33:03.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:03 smithi079 ceph-mon[34346]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:03.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:03 smithi049 ceph-mon[31177]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:03.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:03 smithi098 ceph-mon[34704]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:03.913 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:33:03 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:33:03.698+0000 7fade0990640 -1 osd.9 0 log_to_monitors true 2024-09-21T06:33:04.454 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:04 smithi079 ceph-mon[34346]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:33:04.458 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-21T06:33:04.485 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi079:vg_nvme/lv_1 2024-09-21T06:33:04.503 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:04 smithi098 ceph-mon[34704]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:33:04.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:04 smithi049 ceph-mon[31177]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:33:04.740 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:33:05.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.184+0000 7f5b0c120640 1 -- 172.21.15.79:0/1515132410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b04102ae0 msgr2=0x7f5b04102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:05.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.184+0000 7f5b0c120640 1 --2- 172.21.15.79:0/1515132410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b04102ae0 0x7f5b04102ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f5b00009900 tx=0x7f5b0002a410 comp rx=0 tx=0).stop 2024-09-21T06:33:05.189 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.184+0000 7f5b0c120640 1 -- 172.21.15.79:0/1515132410 shutdown_connections 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.184+0000 7f5b0c120640 1 --2- 172.21.15.79:0/1515132410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04108d20 0x7f5b0410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.184+0000 7f5b0c120640 1 --2- 172.21.15.79:0/1515132410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b041083d0 0x7f5b041087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.184+0000 7f5b0c120640 1 --2- 172.21.15.79:0/1515132410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b04102ae0 0x7f5b04102ef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.184+0000 7f5b0c120640 1 -- 172.21.15.79:0/1515132410 >> 172.21.15.79:0/1515132410 conn(0x7f5b04079790 msgr2=0x7f5b04079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.184+0000 7f5b0c120640 1 -- 172.21.15.79:0/1515132410 shutdown_connections 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.184+0000 7f5b0c120640 1 -- 172.21.15.79:0/1515132410 wait complete. 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b0c120640 1 Processor -- start 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b0c120640 1 -- start start 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b0c120640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04102ae0 0x7f5b0419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b0c120640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b041083d0 0x7f5b0419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b0c120640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b04108d20 0x7f5b0419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b0c120640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5b041129e0 con 0x7f5b04102ae0 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b0c120640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04112860 con 0x7f5b041083d0 2024-09-21T06:33:05.190 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b0c120640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04112b60 con 0x7f5b04108d20 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b096bb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b041083d0 0x7f5b0419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b096bb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b041083d0 0x7f5b0419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.79:48716/0 (socket says 172.21.15.79:48716) 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b096bb640 1 -- 172.21.15.79:0/3348724199 learned_addr learned my addr 172.21.15.79:0/3348724199 (peer_addr_for_me v2:172.21.15.79:0/0) 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b09ebc640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04102ae0 0x7f5b0419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b0a6bd640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b04108d20 0x7f5b0419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b096bb640 1 -- 172.21.15.79:0/3348724199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b04108d20 msgr2=0x7f5b0419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b096bb640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b04108d20 0x7f5b0419fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b096bb640 1 -- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04102ae0 msgr2=0x7f5b0419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b096bb640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04102ae0 0x7f5b0419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.185+0000 7f5b096bb640 1 -- 172.21.15.79:0/3348724199 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b041a0570 con 0x7f5b041083d0 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.186+0000 7f5b096bb640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b041083d0 0x7f5b0419aba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5af400d740 tx=0x7f5af400dc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.186+0000 7f5afaffd640 1 -- 172.21.15.79:0/3348724199 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af4017070 con 0x7f5b041083d0 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.186+0000 7f5afaffd640 1 -- 172.21.15.79:0/3348724199 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af400de50 con 0x7f5b041083d0 2024-09-21T06:33:05.191 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.186+0000 7f5afaffd640 1 -- 172.21.15.79:0/3348724199 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af400f620 con 0x7f5b041083d0 2024-09-21T06:33:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.186+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b041a0860 con 0x7f5b041083d0 2024-09-21T06:33:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.186+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b041a6fc0 con 0x7f5b041083d0 2024-09-21T06:33:05.192 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.187+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b04103d10 con 0x7f5b041083d0 2024-09-21T06:33:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.189+0000 7f5afaffd640 1 -- 172.21.15.79:0/3348724199 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f5af401a070 con 0x7f5b041083d0 2024-09-21T06:33:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.189+0000 7f5afaffd640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5af00b6560 0x7f5af00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.189+0000 7f5afaffd640 1 -- 172.21.15.79:0/3348724199 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6180+0+0 (secure 0 0 0) 0x7f5af40e6440 con 0x7f5b041083d0 2024-09-21T06:33:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.190+0000 7f5b09ebc640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5af00b6560 0x7f5af00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:05.193 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.190+0000 7f5b09ebc640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5af00b6560 0x7f5af00b8a70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b00031440 tx=0x7f5b00009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:05.195 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.193+0000 7f5afaffd640 1 -- 172.21.15.79:0/3348724199 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5af40b1900 con 0x7f5b041083d0 2024-09-21T06:33:05.386 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:05.384+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5b041061e0 con 0x7f5af00b6560 2024-09-21T06:33:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:33:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:33:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:33:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi049 2024-09-21T06:33:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi049 to 4272M 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:05.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:05 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi049 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi049 to 4272M 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:05.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:05.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:05 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:05.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:33:05.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:33:05.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]} : dispatch 2024-09-21T06:33:05.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:05.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi049 2024-09-21T06:33:05.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:05.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi049 to 4272M 2024-09-21T06:33:05.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:05.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:05.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:05.724 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:05 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:06.316 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:33:06.041+0000 7faddc912640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T06:33:06.316 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:33:06.058+0000 7fadd4708640 -1 osd.9 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:33:06.316 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-mon[31177]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:33:06.316 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-mon[31177]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T06:33:06.316 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:06.316 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:06.316 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-mon[31177]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:06.317 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:33:06.317 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:33:06.317 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:06.317 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:06 smithi049 ceph-mon[31177]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' 2024-09-21T06:33:06.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:06 smithi098 ceph-mon[34704]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:33:06.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:06 smithi098 ceph-mon[34704]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T06:33:06.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:06 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:06.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:06 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:06.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:06 smithi098 ceph-mon[34704]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:06.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:06 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:33:06.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:06 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:33:06.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:06 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:06.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:06 smithi098 ceph-mon[34704]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' 2024-09-21T06:33:06.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:06 smithi079 ceph-mon[34346]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi049", "root=default"]}]': finished 2024-09-21T06:33:06.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:06 smithi079 ceph-mon[34346]: osdmap e58: 10 total, 9 up, 10 in 2024-09-21T06:33:06.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:06 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:06.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:06 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:06.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:06 smithi079 ceph-mon[34346]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi079:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:06.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:06 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:33:06.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:06 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:33:06.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:06 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:06.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:06 smithi079 ceph-mon[34346]: from='osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806]' entity='osd.9' 2024-09-21T06:33:07.443 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:07 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:33:07.443 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:07 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:33:07.444 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:07 smithi079 ceph-mon[34346]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:07.444 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:07 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:07.444 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:07 smithi079 ceph-mon[34346]: osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] boot 2024-09-21T06:33:07.444 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:07 smithi079 ceph-mon[34346]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:33:07.444 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:07 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:07 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:33:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:07 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:33:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:07 smithi049 ceph-mon[31177]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:07 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:07 smithi049 ceph-mon[31177]: osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] boot 2024-09-21T06:33:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:07 smithi049 ceph-mon[31177]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:33:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:07 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:07.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:07 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:33:07.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:07 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:33:07.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:07 smithi098 ceph-mon[34704]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:33:07.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:07 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:07.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:07 smithi098 ceph-mon[34704]: osd.9 [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] boot 2024-09-21T06:33:07.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:07 smithi098 ceph-mon[34704]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:33:07.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:07 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:33:08.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:08 smithi079 ceph-mon[34346]: from='client.? 172.21.15.79:0/2220627381' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "add766c1-16ba-4411-ab43-7acaf3d5c480"} : dispatch 2024-09-21T06:33:08.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:08 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "add766c1-16ba-4411-ab43-7acaf3d5c480"} : dispatch 2024-09-21T06:33:08.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:08 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "add766c1-16ba-4411-ab43-7acaf3d5c480"}]': finished 2024-09-21T06:33:08.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:08 smithi079 ceph-mon[34346]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:33:08.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:08 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:08 smithi098 ceph-mon[34704]: from='client.? 172.21.15.79:0/2220627381' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "add766c1-16ba-4411-ab43-7acaf3d5c480"} : dispatch 2024-09-21T06:33:08.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:08 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "add766c1-16ba-4411-ab43-7acaf3d5c480"} : dispatch 2024-09-21T06:33:08.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:08 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "add766c1-16ba-4411-ab43-7acaf3d5c480"}]': finished 2024-09-21T06:33:08.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:08 smithi098 ceph-mon[34704]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:33:08.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:08 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:08 smithi049 ceph-mon[31177]: from='client.? 172.21.15.79:0/2220627381' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "add766c1-16ba-4411-ab43-7acaf3d5c480"} : dispatch 2024-09-21T06:33:08.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:08 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "add766c1-16ba-4411-ab43-7acaf3d5c480"} : dispatch 2024-09-21T06:33:08.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:08 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "add766c1-16ba-4411-ab43-7acaf3d5c480"}]': finished 2024-09-21T06:33:08.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:08 smithi049 ceph-mon[31177]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:33:08.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:08 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:09.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:09 smithi098 ceph-mon[34704]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:09.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:09 smithi098 ceph-mon[34704]: from='client.? 172.21.15.79:0/2155901799' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:33:09.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:09 smithi079 ceph-mon[34346]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:09.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:09 smithi079 ceph-mon[34346]: from='client.? 172.21.15.79:0/2155901799' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:33:09.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:09 smithi049 ceph-mon[31177]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:09.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:09 smithi049 ceph-mon[31177]: from='client.? 172.21.15.79:0/2155901799' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:33:11.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:11 smithi098 ceph-mon[34704]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:11.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:11 smithi079 ceph-mon[34346]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:11.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:11 smithi049 ceph-mon[31177]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:13.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:13 smithi079 ceph-mon[34346]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:13.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:13 smithi098 ceph-mon[34704]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:13.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:13 smithi049 ceph-mon[31177]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:15.355 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:15 smithi079 ceph-mon[34346]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:15.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:15 smithi098 ceph-mon[34704]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:15.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:15 smithi049 ceph-mon[31177]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:17.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:17 smithi049 ceph-mon[31177]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:17.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:33:17.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:17.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:17 smithi049 ceph-mon[31177]: Deploying daemon osd.10 on smithi079 2024-09-21T06:33:17.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:17 smithi098 ceph-mon[34704]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:17.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:33:17.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:17.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:17 smithi098 ceph-mon[34704]: Deploying daemon osd.10 on smithi079 2024-09-21T06:33:17.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:17 smithi079 ceph-mon[34346]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:17.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:33:17.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:17.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:17 smithi079 ceph-mon[34346]: Deploying daemon osd.10 on smithi079 2024-09-21T06:33:19.435 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:19 smithi079 ceph-mon[34346]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:19.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:19 smithi098 ceph-mon[34704]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:19.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:19 smithi049 ceph-mon[31177]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:21.489 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:21 smithi079 ceph-mon[34346]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:21.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:21 smithi098 ceph-mon[34704]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:21.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:21 smithi049 ceph-mon[31177]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:22.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:22.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:22.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:22 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:22.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:22 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:22.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:22.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:22.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:22 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:23.413 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:23 smithi079 ceph-mon[34346]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:23.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:23 smithi098 ceph-mon[34704]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:23.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:23 smithi049 ceph-mon[31177]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:24.828 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.827+0000 7f5afaffd640 1 -- 172.21.15.79:0/3348724199 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5b041061e0 con 0x7f5af00b6560 2024-09-21T06:33:24.829 INFO:teuthology.orchestra.run.smithi079.stdout:Created osd(s) 10 on host 'smithi079' 2024-09-21T06:33:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5af00b6560 msgr2=0x7f5af00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5af00b6560 0x7f5af00b8a70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5b00031440 tx=0x7f5b00009560 comp rx=0 tx=0).stop 2024-09-21T06:33:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b041083d0 msgr2=0x7f5b0419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b041083d0 0x7f5b0419aba0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5af400d740 tx=0x7f5af400dc00 comp rx=0 tx=0).stop 2024-09-21T06:33:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 shutdown_connections 2024-09-21T06:33:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5af00b6560 0x7f5af00b8a70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5b04108d20 0x7f5b0419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5b041083d0 0x7f5b0419aba0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 --2- 172.21.15.79:0/3348724199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5b04102ae0 0x7f5b0419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 >> 172.21.15.79:0/3348724199 conn(0x7f5b04079790 msgr2=0x7f5b04101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 shutdown_connections 2024-09-21T06:33:24.833 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-21T06:33:24.830+0000 7f5b0c120640 1 -- 172.21.15.79:0/3348724199 wait complete. 2024-09-21T06:33:25.429 DEBUG:teuthology.orchestra.run.smithi079:osd.10> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T06:33:25.432 INFO:tasks.cephadm:Deploying osd.11 on smithi098 with /dev/vg_nvme/lv_1... 2024-09-21T06:33:25.432 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:33:25.692 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:33:26.135 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:25 smithi098 ceph-mon[34704]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:26.135 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:26.135 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:26.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:25 smithi049 ceph-mon[31177]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:26.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:26.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:26.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:25 smithi079 ceph-mon[34346]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:26.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:26.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:27.173 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:26 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:27.173 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:26 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:27.173 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:26 smithi098 ceph-mon[34704]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:27.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:26 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:27.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:26 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:27.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:26 smithi049 ceph-mon[31177]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:27.268 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:26 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:27.268 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:26 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:27.268 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:26 smithi079 ceph-mon[34346]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:28.250 INFO:teuthology.orchestra.run.smithi098.stdout: 2024-09-21T06:33:28.275 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi098:vg_nvme/lv_1 2024-09-21T06:33:28.533 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:33:28.565 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:33:28 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:33:28.158+0000 7fb584a1a640 -1 osd.10 0 log_to_monitors true 2024-09-21T06:33:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.970+0000 7f585cf09640 1 -- 172.21.15.98:0/3717633538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5858105b00 msgr2=0x7f585810f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.970+0000 7f585cf09640 1 --2- 172.21.15.98:0/3717633538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5858105b00 0x7f585810f590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5850009cd0 tx=0x7f585002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:33:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.970+0000 7f585cf09640 1 -- 172.21.15.98:0/3717633538 shutdown_connections 2024-09-21T06:33:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.970+0000 7f585cf09640 1 --2- 172.21.15.98:0/3717633538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5858105b00 0x7f585810f590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.970+0000 7f585cf09640 1 --2- 172.21.15.98:0/3717633538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f58581051b0 0x7f58581055c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.970+0000 7f585cf09640 1 --2- 172.21.15.98:0/3717633538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58581031e0 0x7f58581035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.971+0000 7f585cf09640 1 -- 172.21.15.98:0/3717633538 >> 172.21.15.98:0/3717633538 conn(0x7f5858077cc0 msgr2=0x7f5858078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.971+0000 7f585cf09640 1 -- 172.21.15.98:0/3717633538 shutdown_connections 2024-09-21T06:33:28.976 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.971+0000 7f585cf09640 1 -- 172.21.15.98:0/3717633538 wait complete. 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.971+0000 7f585cf09640 1 Processor -- start 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.971+0000 7f585cf09640 1 -- start start 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f585cf09640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58581031e0 0x7f58580fee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f585cf09640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58581051b0 0x7f58580ff340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f585cf09640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5858105b00 0x7f58580ff880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f585cf09640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5858112a40 con 0x7f5858105b00 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f585cf09640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f58581128c0 con 0x7f58581031e0 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f585cf09640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5858112bc0 con 0x7f58581051b0 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5855d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58581051b0 0x7f58580ff340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5855d9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58581051b0 0x7f58580ff340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:33212/0 (socket says 172.21.15.98:33212) 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5855d9b640 1 -- 172.21.15.98:0/2611957389 learned_addr learned my addr 172.21.15.98:0/2611957389 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-21T06:33:28.977 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5856d9d640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5858105b00 0x7f58580ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f585659c640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58581031e0 0x7f58580fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5855d9b640 1 -- 172.21.15.98:0/2611957389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58581031e0 msgr2=0x7f58580fee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5855d9b640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58581031e0 0x7f58580fee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5855d9b640 1 -- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5858105b00 msgr2=0x7f58580ff880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5855d9b640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5858105b00 0x7f58580ff880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5855d9b640 1 -- 172.21.15.98:0/2611957389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58581a87a0 con 0x7f58581051b0 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.972+0000 7f5855d9b640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58581051b0 0x7f58580ff340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f584c00d950 tx=0x7f584c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.973+0000 7f58477fe640 1 -- 172.21.15.98:0/2611957389 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c017070 con 0x7f58581051b0 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.973+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58581a8a90 con 0x7f58581051b0 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.973+0000 7f58477fe640 1 -- 172.21.15.98:0/2611957389 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584c009c30 con 0x7f58581051b0 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.973+0000 7f58477fe640 1 -- 172.21.15.98:0/2611957389 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584c0047a0 con 0x7f58581051b0 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.973+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58581a9020 con 0x7f58581051b0 2024-09-21T06:33:28.978 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.974+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58581035f0 con 0x7f58581051b0 2024-09-21T06:33:28.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.975+0000 7f58477fe640 1 -- 172.21.15.98:0/2611957389 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f584c004020 con 0x7f58581051b0 2024-09-21T06:33:28.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.976+0000 7f58477fe640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f58400b6560 0x7f58400b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:28.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.976+0000 7f58477fe640 1 -- 172.21.15.98:0/2611957389 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6591+0+0 (secure 0 0 0) 0x7f584c0e6d90 con 0x7f58581051b0 2024-09-21T06:33:28.979 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.976+0000 7f585659c640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f58400b6560 0x7f58400b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:28.980 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.977+0000 7f585659c640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f58400b6560 0x7f58400b8a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5848005fd0 tx=0x7f5848005e40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:28.981 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:28.980+0000 7f58477fe640 1 -- 172.21.15.98:0/2611957389 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f584c020020 con 0x7f58581051b0 2024-09-21T06:33:29.178 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:29.176+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f5858063800 con 0x7f58400b6560 2024-09-21T06:33:29.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='osd.10 [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:29.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:29.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:29.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:29.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='osd.10 [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:29.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:29.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:29.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:29.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:29.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:29.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:29.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='osd.10 [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:29.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:29.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:29.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:29.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:29.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:29.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:30.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi079 2024-09-21T06:33:30.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi079 to 4272M 2024-09-21T06:33:30.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:33:30.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:33:30.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:30.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: from='osd.10 [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:33:30.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:33:30.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: from='client.24562 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:30.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:33:30.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:33:30.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:30 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi079 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi079 to 4272M 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: from='osd.10 [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: from='client.24562 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:33:30.524 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:33:30.525 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:30 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:30.568 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:33:30.167+0000 7fb58099c640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T06:33:30.568 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:33:30.187+0000 7fb57c79a640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:33:30.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi079 2024-09-21T06:33:30.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi079 to 4272M 2024-09-21T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: from='osd.10 [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]} : dispatch 2024-09-21T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: from='client.24562 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi098:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:33:30.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:30 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:31.323 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:31 smithi098 ceph-mon[34704]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:31.323 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:31 smithi098 ceph-mon[34704]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:33:31.323 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:31 smithi098 ceph-mon[34704]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:33:31.323 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:31.324 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:31.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:31 smithi049 ceph-mon[31177]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:31.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:31 smithi049 ceph-mon[31177]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:33:31.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:31 smithi049 ceph-mon[31177]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:33:31.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:31.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:31.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:31 smithi079 ceph-mon[34346]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:31.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:31 smithi079 ceph-mon[34346]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi079", "root=default"]}]': finished 2024-09-21T06:33:31.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:31 smithi079 ceph-mon[34346]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:33:31.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:31.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: osd.10 [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] boot 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/951049378' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2ccde96-c178-4fb1-8bb9-6c0093978251"} : dispatch 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2ccde96-c178-4fb1-8bb9-6c0093978251"} : dispatch 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2ccde96-c178-4fb1-8bb9-6c0093978251"}]': finished 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T06:33:32.278 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:32 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:33:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:33:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: osd.10 [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] boot 2024-09-21T06:33:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:33:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/951049378' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2ccde96-c178-4fb1-8bb9-6c0093978251"} : dispatch 2024-09-21T06:33:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2ccde96-c178-4fb1-8bb9-6c0093978251"} : dispatch 2024-09-21T06:33:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2ccde96-c178-4fb1-8bb9-6c0093978251"}]': finished 2024-09-21T06:33:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T06:33:32.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:32 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:32.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:33:32.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:33:32.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: osd.10 [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] boot 2024-09-21T06:33:32.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:33:32.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:32.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: from='client.? 172.21.15.98:0/951049378' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2ccde96-c178-4fb1-8bb9-6c0093978251"} : dispatch 2024-09-21T06:33:32.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b2ccde96-c178-4fb1-8bb9-6c0093978251"} : dispatch 2024-09-21T06:33:32.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b2ccde96-c178-4fb1-8bb9-6c0093978251"}]': finished 2024-09-21T06:33:32.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: osdmap e64: 12 total, 11 up, 12 in 2024-09-21T06:33:32.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:32 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:33.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:33 smithi049 ceph-mon[31177]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:33.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:33 smithi049 ceph-mon[31177]: from='client.? 172.21.15.98:0/3158566481' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:33:33.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:33 smithi049 ceph-mon[31177]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T06:33:33.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:33 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:33.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:33 smithi098 ceph-mon[34704]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:33.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:33 smithi098 ceph-mon[34704]: from='client.? 172.21.15.98:0/3158566481' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:33:33.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:33 smithi098 ceph-mon[34704]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T06:33:33.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:33 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:33.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:33 smithi079 ceph-mon[34346]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:33.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:33 smithi079 ceph-mon[34346]: from='client.? 172.21.15.98:0/3158566481' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:33:33.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:33 smithi079 ceph-mon[34346]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T06:33:33.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:33 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:35.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:35 smithi049 ceph-mon[31177]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:35.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:35 smithi098 ceph-mon[34704]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:35.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:35 smithi079 ceph-mon[34346]: pgmap v214: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:37.466 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:37 smithi098 ceph-mon[34704]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:37.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:37 smithi049 ceph-mon[31177]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:37.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:37 smithi079 ceph-mon[34346]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:39.379 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:39 smithi098 ceph-mon[34704]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T06:33:39.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:39 smithi049 ceph-mon[31177]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T06:33:39.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:39 smithi079 ceph-mon[34346]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-09-21T06:33:41.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:41 smithi098 ceph-mon[34704]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:33:41.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:33:41.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:41.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:41 smithi098 ceph-mon[34704]: Deploying daemon osd.11 on smithi098 2024-09-21T06:33:41.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:41 smithi049 ceph-mon[31177]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:33:41.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:33:41.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:41.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:41 smithi049 ceph-mon[31177]: Deploying daemon osd.11 on smithi098 2024-09-21T06:33:41.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:41 smithi079 ceph-mon[34346]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:33:41.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:33:41.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:41.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:41 smithi079 ceph-mon[34346]: Deploying daemon osd.11 on smithi098 2024-09-21T06:33:43.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:43 smithi098 ceph-mon[34704]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:33:43.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:43 smithi049 ceph-mon[31177]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:33:43.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:43 smithi079 ceph-mon[34346]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:33:45.445 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:45 smithi098 ceph-mon[34704]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T06:33:45.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:45 smithi049 ceph-mon[31177]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T06:33:45.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:45 smithi079 ceph-mon[34346]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T06:33:46.471 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:46 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:46.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:46 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:46.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:46 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:46.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:46 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:46.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:46 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:46.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:46 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:46.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:46 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:46.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:46 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:46.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:46 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:47.472 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:47 smithi098 ceph-mon[34704]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:33:47.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:47 smithi049 ceph-mon[31177]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:33:47.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:47 smithi079 ceph-mon[34346]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:33:49.738 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.736+0000 7f58477fe640 1 -- 172.21.15.98:0/2611957389 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f5858063800 con 0x7f58400b6560 2024-09-21T06:33:49.739 INFO:teuthology.orchestra.run.smithi098.stdout:Created osd(s) 11 on host 'smithi098' 2024-09-21T06:33:49.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f58400b6560 msgr2=0x7f58400b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:49.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f58400b6560 0x7f58400b8a70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5848005fd0 tx=0x7f5848005e40 comp rx=0 tx=0).stop 2024-09-21T06:33:49.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58581051b0 msgr2=0x7f58580ff340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:49.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58581051b0 0x7f58580ff340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f584c00d950 tx=0x7f584c00de10 comp rx=0 tx=0).stop 2024-09-21T06:33:49.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 shutdown_connections 2024-09-21T06:33:49.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f58400b6560 0x7f58400b8a70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5858105b00 0x7f58580ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f58581051b0 0x7f58580ff340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.740 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 --2- 172.21.15.98:0/2611957389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f58581031e0 0x7f58580fee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 >> 172.21.15.98:0/2611957389 conn(0x7f5858077cc0 msgr2=0x7f58581064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:49.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 shutdown_connections 2024-09-21T06:33:49.741 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:33:49.738+0000 7f585cf09640 1 -- 172.21.15.98:0/2611957389 wait complete. 2024-09-21T06:33:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:49 smithi098 ceph-mon[34704]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:33:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:49 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:49 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:49 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:49 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:49 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:49 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:49 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:49 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:49 smithi049 ceph-mon[31177]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:33:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:49 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:49 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:49 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:49 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:49 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:49 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:49 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:49 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:49 smithi079 ceph-mon[34346]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:33:50.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:49 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:49 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:49 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:50.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:49 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:50.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:49 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:49 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:50.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:49 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:49 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:50.372 DEBUG:teuthology.orchestra.run.smithi098:osd.11> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T06:33:50.375 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T06:33:50.375 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:33:50.648 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.098+0000 7f56f2ca1640 1 -- 172.21.15.49:0/3602544691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109550 msgr2=0x7f56ec109960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.098+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/3602544691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109550 0x7f56ec109960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009900 tx=0x7f56e002a410 comp rx=0 tx=0).stop 2024-09-21T06:33:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.098+0000 7f56f2ca1640 1 -- 172.21.15.49:0/3602544691 shutdown_connections 2024-09-21T06:33:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.098+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/3602544691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ec109ea0 0x7f56ec1106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.098+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/3602544691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109550 0x7f56ec109960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.098+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/3602544691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec102100 0x7f56ec102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.098+0000 7f56f2ca1640 1 -- 172.21.15.49:0/3602544691 >> 172.21.15.49:0/3602544691 conn(0x7f56ec079ea0 msgr2=0x7f56ec07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.098+0000 7f56f2ca1640 1 -- 172.21.15.49:0/3602544691 shutdown_connections 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.098+0000 7f56f2ca1640 1 -- 172.21.15.49:0/3602544691 wait complete. 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.099+0000 7f56f2ca1640 1 Processor -- start 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.099+0000 7f56f2ca1640 1 -- start start 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.099+0000 7f56f2ca1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ec102100 0x7f56ec1030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.099+0000 7f56f2ca1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec109550 0x7f56ec1035e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.099+0000 7f56f2ca1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109ea0 0x7f56ec103b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.099+0000 7f56f2ca1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec113b60 con 0x7f56ec109ea0 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.099+0000 7f56f2ca1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec1139e0 con 0x7f56ec109550 2024-09-21T06:33:51.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.099+0000 7f56f2ca1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec113ce0 con 0x7f56ec102100 2024-09-21T06:33:51.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f123e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109ea0 0x7f56ec103b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f123e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109ea0 0x7f56ec103b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49880/0 (socket says 172.21.15.49:49880) 2024-09-21T06:33:51.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f123e640 1 -- 172.21.15.49:0/1879856219 learned_addr learned my addr 172.21.15.49:0/1879856219 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:33:51.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f0a3d640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ec102100 0x7f56ec1030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56ebfff640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec109550 0x7f56ec1035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f123e640 1 -- 172.21.15.49:0/1879856219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ec102100 msgr2=0x7f56ec1030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f123e640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ec102100 0x7f56ec1030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f123e640 1 -- 172.21.15.49:0/1879856219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec109550 msgr2=0x7f56ec1035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f123e640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec109550 0x7f56ec1035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f123e640 1 -- 172.21.15.49:0/1879856219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec1a8870 con 0x7f56ec109ea0 2024-09-21T06:33:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f0a3d640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ec102100 0x7f56ec1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f123e640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109ea0 0x7f56ec103b20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f56e400eb10 tx=0x7f56e400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56e9ffb640 1 -- 172.21.15.49:0/1879856219 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4004b20 con 0x7f56ec109ea0 2024-09-21T06:33:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56e9ffb640 1 -- 172.21.15.49:0/1879856219 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56e4004cc0 con 0x7f56ec109ea0 2024-09-21T06:33:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec1a8b60 con 0x7f56ec109ea0 2024-09-21T06:33:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.100+0000 7f56e9ffb640 1 -- 172.21.15.49:0/1879856219 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4010670 con 0x7f56ec109ea0 2024-09-21T06:33:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.101+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec1a9020 con 0x7f56ec109ea0 2024-09-21T06:33:51.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.101+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec102510 con 0x7f56ec109ea0 2024-09-21T06:33:51.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.103+0000 7f56e9ffb640 1 -- 172.21.15.49:0/1879856219 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f56e4005000 con 0x7f56ec109ea0 2024-09-21T06:33:51.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.104+0000 7f56e9ffb640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56d40b6560 0x7f56d40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:51.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.104+0000 7f56f0a3d640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56d40b6560 0x7f56d40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:51.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.104+0000 7f56e9ffb640 1 -- 172.21.15.49:0/1879856219 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 7024+0+0 (secure 0 0 0) 0x7f56e40e7570 con 0x7f56ec109ea0 2024-09-21T06:33:51.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.104+0000 7f56f0a3d640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56d40b6560 0x7f56d40b8a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f56ec104af0 tx=0x7f56dc00b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:51.109 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.107+0000 7f56e9ffb640 1 -- 172.21.15.49:0/1879856219 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f56e4056710 con 0x7f56ec109ea0 2024-09-21T06:33:51.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.295+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f56ec1043a0 con 0x7f56ec109ea0 2024-09-21T06:33:51.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.296+0000 7f56e9ffb640 1 -- 172.21.15.49:0/1879856219 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f56ec1043a0 con 0x7f56ec109ea0 2024-09-21T06:33:51.299 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:33:51.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56d40b6560 msgr2=0x7f56d40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56d40b6560 0x7f56d40b8a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f56ec104af0 tx=0x7f56dc00b410 comp rx=0 tx=0).stop 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109ea0 msgr2=0x7f56ec103b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109ea0 0x7f56ec103b20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f56e400eb10 tx=0x7f56e400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 shutdown_connections 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56d40b6560 0x7f56d40b8a70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f56ec109ea0 0x7f56ec103b20 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f56ec109550 0x7f56ec1035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 --2- 172.21.15.49:0/1879856219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f56ec102100 0x7f56ec1030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.298+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 >> 172.21.15.49:0/1879856219 conn(0x7f56ec079ea0 msgr2=0x7f56ec107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.299+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 shutdown_connections 2024-09-21T06:33:51.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:51.299+0000 7f56f2ca1640 1 -- 172.21.15.49:0/1879856219 wait complete. 2024-09-21T06:33:52.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:51 smithi098 ceph-mon[34704]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:52.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:51 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1879856219' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:52.047 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:33:51 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:33:51.879+0000 7f4278c0f640 -1 osd.11 0 log_to_monitors true 2024-09-21T06:33:52.048 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726900411,"num_in_osds":12,"osd_in_since":1726900411,"num_remapped_pgs":0} 2024-09-21T06:33:52.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:51 smithi049 ceph-mon[31177]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:52.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:51 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1879856219' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:52.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:51 smithi079 ceph-mon[34346]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:52.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:51 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1879856219' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:53.049 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:33:53.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:52 smithi049 ceph-mon[31177]: from='osd.11 [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:52 smithi049 ceph-mon[31177]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:53.235 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:52 smithi098 ceph-mon[34704]: from='osd.11 [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:53.235 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:52 smithi098 ceph-mon[34704]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:53.317 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:52 smithi079 ceph-mon[34346]: from='osd.11 [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:52 smithi079 ceph-mon[34346]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:53.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.805+0000 7effdea2a640 1 -- 172.21.15.49:0/773684880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd81083c0 msgr2=0x7effd81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.805+0000 7effdea2a640 1 --2- 172.21.15.49:0/773684880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd81083c0 0x7effd81087d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7effcc009900 tx=0x7effcc02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.805+0000 7effdea2a640 1 -- 172.21.15.49:0/773684880 shutdown_connections 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.805+0000 7effdea2a640 1 --2- 172.21.15.49:0/773684880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8108d10 0x7effd810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.805+0000 7effdea2a640 1 --2- 172.21.15.49:0/773684880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd81083c0 0x7effd81087d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.805+0000 7effdea2a640 1 --2- 172.21.15.49:0/773684880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd8102a80 0x7effd8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.805+0000 7effdea2a640 1 -- 172.21.15.49:0/773684880 >> 172.21.15.49:0/773684880 conn(0x7effd8079740 msgr2=0x7effd8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.805+0000 7effdea2a640 1 -- 172.21.15.49:0/773684880 shutdown_connections 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.805+0000 7effdea2a640 1 -- 172.21.15.49:0/773684880 wait complete. 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.806+0000 7effdea2a640 1 Processor -- start 2024-09-21T06:33:53.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.806+0000 7effdea2a640 1 -- start start 2024-09-21T06:33:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.806+0000 7effdea2a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd8102a80 0x7effd810ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.806+0000 7effdea2a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd81083c0 0x7effd8110510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:53.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.806+0000 7effdea2a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8108d10 0x7effd8110a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.806+0000 7effdea2a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7effd8113aa0 con 0x7effd8108d10 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.806+0000 7effdea2a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7effd8113920 con 0x7effd8102a80 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.806+0000 7effdea2a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7effd8113c20 con 0x7effd81083c0 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdcfc7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8108d10 0x7effd8110a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdcfc7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8108d10 0x7effd8110a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49902/0 (socket says 172.21.15.49:49902) 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdcfc7640 1 -- 172.21.15.49:0/1542252059 learned_addr learned my addr 172.21.15.49:0/1542252059 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effd77fe640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd81083c0 0x7effd8110510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effd7fff640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd8102a80 0x7effd810ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdcfc7640 1 -- 172.21.15.49:0/1542252059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd81083c0 msgr2=0x7effd8110510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdcfc7640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd81083c0 0x7effd8110510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdcfc7640 1 -- 172.21.15.49:0/1542252059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd8102a80 msgr2=0x7effd810ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdcfc7640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd8102a80 0x7effd810ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdcfc7640 1 -- 172.21.15.49:0/1542252059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd81a87d0 con 0x7effd8108d10 2024-09-21T06:33:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effd7fff640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd8102a80 0x7effd810ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdcfc7640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8108d10 0x7effd8110a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7effd000efd0 tx=0x7effd000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effd57fa640 1 -- 172.21.15.49:0/1542252059 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0003b70 con 0x7effd8108d10 2024-09-21T06:33:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effd57fa640 1 -- 172.21.15.49:0/1542252059 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd0003d10 con 0x7effd8108d10 2024-09-21T06:33:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd81a8ac0 con 0x7effd8108d10 2024-09-21T06:33:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.807+0000 7effd57fa640 1 -- 172.21.15.49:0/1542252059 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd00108a0 con 0x7effd8108d10 2024-09-21T06:33:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.808+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd81a8fd0 con 0x7effd8108d10 2024-09-21T06:33:53.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.808+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd8103d00 con 0x7effd8108d10 2024-09-21T06:33:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.810+0000 7effd57fa640 1 -- 172.21.15.49:0/1542252059 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7effd0004b40 con 0x7effd8108d10 2024-09-21T06:33:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.811+0000 7effd57fa640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7effc00b6560 0x7effc00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.811+0000 7effd7fff640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7effc00b6560 0x7effc00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.811+0000 7effd57fa640 1 -- 172.21.15.49:0/1542252059 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7046+0+0 (secure 0 0 0) 0x7effd00e76a0 con 0x7effd8108d10 2024-09-21T06:33:53.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.811+0000 7effd7fff640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7effc00b6560 0x7effc00b8a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7effd8111a20 tx=0x7effc8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:53.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:53.814+0000 7effd57fa640 1 -- 172.21.15.49:0/1542252059 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effd00ae420 con 0x7effd8108d10 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='osd.11 [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:53.974 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:54.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.003+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7effd8102e90 con 0x7effd8108d10 2024-09-21T06:33:54.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.003+0000 7effd57fa640 1 -- 172.21.15.49:0/1542252059 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7effd8102e90 con 0x7effd8108d10 2024-09-21T06:33:54.005 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:33:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7effc00b6560 msgr2=0x7effc00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7effc00b6560 0x7effc00b8a70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7effd8111a20 tx=0x7effc8005f90 comp rx=0 tx=0).stop 2024-09-21T06:33:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8108d10 msgr2=0x7effd8110a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8108d10 0x7effd8110a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7effd000efd0 tx=0x7effd000c6a0 comp rx=0 tx=0).stop 2024-09-21T06:33:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 shutdown_connections 2024-09-21T06:33:54.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7effc00b6560 0x7effc00b8a70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7effd8108d10 0x7effd8110a50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7effd81083c0 0x7effd8110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 --2- 172.21.15.49:0/1542252059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7effd8102a80 0x7effd810ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 >> 172.21.15.49:0/1542252059 conn(0x7effd8079740 msgr2=0x7effd81044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 shutdown_connections 2024-09-21T06:33:54.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:54.005+0000 7effdea2a640 1 -- 172.21.15.49:0/1542252059 wait complete. 2024-09-21T06:33:54.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:33:53.880+0000 7f4274b91640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T06:33:54.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:33:53.895+0000 7f427098f640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:33:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:33:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:33:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='osd.11 [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:54.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:33:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='osd.11 [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]} : dispatch 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:33:54.612 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726900411,"num_in_osds":12,"osd_in_since":1726900411,"num_remapped_pgs":0} 2024-09-21T06:33:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:54 smithi049 ceph-mon[31177]: Detected new or changed devices on smithi098 2024-09-21T06:33:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:54 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-21T06:33:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:54 smithi049 ceph-mon[31177]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:33:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:54 smithi049 ceph-mon[31177]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:33:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:54 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1542252059' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:55.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:54 smithi098 ceph-mon[34704]: Detected new or changed devices on smithi098 2024-09-21T06:33:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:54 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-21T06:33:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:54 smithi098 ceph-mon[34704]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:33:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:54 smithi098 ceph-mon[34704]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:33:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:54 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1542252059' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:54 smithi079 ceph-mon[34346]: Detected new or changed devices on smithi098 2024-09-21T06:33:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:54 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi098 to 4272M 2024-09-21T06:33:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:54 smithi079 ceph-mon[34346]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi098", "root=default"]}]': finished 2024-09-21T06:33:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:54 smithi079 ceph-mon[34346]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:33:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:54 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1542252059' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:55.613 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:33:55.884 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:55 smithi049 ceph-mon[31177]: purged_snaps scrub starts 2024-09-21T06:33:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:55 smithi049 ceph-mon[31177]: purged_snaps scrub ok 2024-09-21T06:33:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:55 smithi049 ceph-mon[31177]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:55 smithi049 ceph-mon[31177]: osd.11 [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] boot 2024-09-21T06:33:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:55 smithi049 ceph-mon[31177]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T06:33:55.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:56.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:55 smithi079 ceph-mon[34346]: purged_snaps scrub starts 2024-09-21T06:33:56.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:55 smithi079 ceph-mon[34346]: purged_snaps scrub ok 2024-09-21T06:33:56.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:55 smithi079 ceph-mon[34346]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:56.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:56.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:55 smithi079 ceph-mon[34346]: osd.11 [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] boot 2024-09-21T06:33:56.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:55 smithi079 ceph-mon[34346]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T06:33:56.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:55 smithi098 ceph-mon[34704]: purged_snaps scrub starts 2024-09-21T06:33:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:55 smithi098 ceph-mon[34704]: purged_snaps scrub ok 2024-09-21T06:33:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:55 smithi098 ceph-mon[34704]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:55 smithi098 ceph-mon[34704]: osd.11 [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] boot 2024-09-21T06:33:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:55 smithi098 ceph-mon[34704]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T06:33:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:56.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.353+0000 7fbcd8da1640 1 -- 172.21.15.49:0/1709311399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 msgr2=0x7fbcd41096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.353+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/1709311399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 0x7fbcd41096e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbcc8009900 tx=0x7fbcc802a410 comp rx=0 tx=0).stop 2024-09-21T06:33:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.354+0000 7fbcd8da1640 1 -- 172.21.15.49:0/1709311399 shutdown_connections 2024-09-21T06:33:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.354+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/1709311399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcd4109c20 0x7fbcd4110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.354+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/1709311399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 0x7fbcd41096e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.354+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/1709311399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbcd4103990 0x7fbcd4103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.354+0000 7fbcd8da1640 1 -- 172.21.15.49:0/1709311399 >> 172.21.15.49:0/1709311399 conn(0x7fbcd40ff3e0 msgr2=0x7fbcd4101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.354+0000 7fbcd8da1640 1 -- 172.21.15.49:0/1709311399 shutdown_connections 2024-09-21T06:33:56.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.354+0000 7fbcd8da1640 1 -- 172.21.15.49:0/1709311399 wait complete. 2024-09-21T06:33:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.354+0000 7fbcd8da1640 1 Processor -- start 2024-09-21T06:33:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.354+0000 7fbcd8da1640 1 -- start start 2024-09-21T06:33:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd8da1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcd4103990 0x7fbcd419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd8da1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 0x7fbcd419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd8da1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbcd4109c20 0x7fbcd41a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd8da1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4113900 con 0x7fbcd41092d0 2024-09-21T06:33:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd8da1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4113780 con 0x7fbcd4103990 2024-09-21T06:33:56.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd8da1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbcd4113a80 con 0x7fbcd4109c20 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 0x7fbcd419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 0x7fbcd419cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47364/0 (socket says 172.21.15.49:47364) 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd2ffd640 1 -- 172.21.15.49:0/3473410229 learned_addr learned my addr 172.21.15.49:0/3473410229 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd3fff640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbcd4109c20 0x7fbcd41a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd37fe640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcd4103990 0x7fbcd419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd3fff640 1 -- 172.21.15.49:0/3473410229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcd4103990 msgr2=0x7fbcd419c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd3fff640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcd4103990 0x7fbcd419c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd3fff640 1 -- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 msgr2=0x7fbcd419cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd3fff640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 0x7fbcd419cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd3fff640 1 -- 172.21.15.49:0/3473410229 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd41a2500 con 0x7fbcd4109c20 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.355+0000 7fbcd2ffd640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 0x7fbcd419cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.356+0000 7fbcd3fff640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbcd4109c20 0x7fbcd41a1dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00be20 tx=0x7fbccc00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.356+0000 7fbcd0ff9640 1 -- 172.21.15.49:0/3473410229 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc019070 con 0x7fbcd4109c20 2024-09-21T06:33:56.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.356+0000 7fbcd0ff9640 1 -- 172.21.15.49:0/3473410229 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbccc0148f0 con 0x7fbcd4109c20 2024-09-21T06:33:56.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.356+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd41a27f0 con 0x7fbcd4109c20 2024-09-21T06:33:56.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.356+0000 7fbcd0ff9640 1 -- 172.21.15.49:0/3473410229 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc012840 con 0x7fbcd4109c20 2024-09-21T06:33:56.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.356+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcd41a8f50 con 0x7fbcd4109c20 2024-09-21T06:33:56.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.357+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcd4103da0 con 0x7fbcd4109c20 2024-09-21T06:33:56.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.358+0000 7fbcd0ff9640 1 -- 172.21.15.49:0/3473410229 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fbccc01c070 con 0x7fbcd4109c20 2024-09-21T06:33:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.359+0000 7fbcd0ff9640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbcbc0b6560 0x7fbcbc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.359+0000 7fbcd37fe640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbcbc0b6560 0x7fbcbc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.359+0000 7fbcd0ff9640 1 -- 172.21.15.49:0/3473410229 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7342+0+0 (secure 0 0 0) 0x7fbccc0e6bc0 con 0x7fbcd4109c20 2024-09-21T06:33:56.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.360+0000 7fbcd37fe640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbcbc0b6560 0x7fbcbc0b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40058c0 tx=0x7fbcc400a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:56.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.362+0000 7fbcd0ff9640 1 -- 172.21.15.49:0/3473410229 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbccc0b1b60 con 0x7fbcd4109c20 2024-09-21T06:33:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.550+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbcd419d6c0 con 0x7fbcd4109c20 2024-09-21T06:33:56.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.551+0000 7fbcd0ff9640 1 -- 172.21.15.49:0/3473410229 <== mon.1 v2:172.21.15.98:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7fbcd419d6c0 con 0x7fbcd4109c20 2024-09-21T06:33:56.553 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:33:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbcbc0b6560 msgr2=0x7fbcbc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbcbc0b6560 0x7fbcbc0b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbcc40058c0 tx=0x7fbcc400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbcd4109c20 msgr2=0x7fbcd41a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbcd4109c20 0x7fbcd41a1dd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00be20 tx=0x7fbccc00bf10 comp rx=0 tx=0).stop 2024-09-21T06:33:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 shutdown_connections 2024-09-21T06:33:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbcbc0b6560 0x7fbcbc0b8a70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbcd4109c20 0x7fbcd41a1dd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbcd41092d0 0x7fbcd419cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 --2- 172.21.15.49:0/3473410229 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbcd4103990 0x7fbcd419c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:56.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 >> 172.21.15.49:0/3473410229 conn(0x7fbcd40ff3e0 msgr2=0x7fbcd41079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:56.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 shutdown_connections 2024-09-21T06:33:56.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:56.553+0000 7fbcd8da1640 1 -- 172.21.15.49:0/3473410229 wait complete. 2024-09-21T06:33:57.150 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:56 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3473410229' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:57.177 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":68,"num_osds":12,"num_up_osds":12,"osd_up_since":1726900434,"num_in_osds":12,"osd_in_since":1726900411,"num_remapped_pgs":0} 2024-09-21T06:33:57.178 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:33:57.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:56 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3473410229' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:57.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:56 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3473410229' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:57.431 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:57.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.928+0000 7f060907a640 1 -- 172.21.15.49:0/2818381467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 msgr2=0x7f0604110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:57.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.928+0000 7f060907a640 1 --2- 172.21.15.49:0/2818381467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 0x7f0604110300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009ca0 tx=0x7f05fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.928+0000 7f060907a640 1 -- 172.21.15.49:0/2818381467 shutdown_connections 2024-09-21T06:33:57.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.928+0000 7f060907a640 1 --2- 172.21.15.49:0/2818381467 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 0x7f0604110300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.928+0000 7f060907a640 1 --2- 172.21.15.49:0/2818381467 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06041052b0 0x7f060410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.928+0000 7f060907a640 1 --2- 172.21.15.49:0/2818381467 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0604104880 0x7f0604104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.928+0000 7f060907a640 1 -- 172.21.15.49:0/2818381467 >> 172.21.15.49:0/2818381467 conn(0x7f0604079730 msgr2=0x7f0604079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:57.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.928+0000 7f060907a640 1 -- 172.21.15.49:0/2818381467 shutdown_connections 2024-09-21T06:33:57.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.928+0000 7f060907a640 1 -- 172.21.15.49:0/2818381467 wait complete. 2024-09-21T06:33:57.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.929+0000 7f060907a640 1 Processor -- start 2024-09-21T06:33:57.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.929+0000 7f060907a640 1 -- start start 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.929+0000 7f060907a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0604104880 0x7f0604102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.929+0000 7f060907a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06041052b0 0x7f0604102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.929+0000 7f060907a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 0x7f0604103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.929+0000 7f060907a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0604113a70 con 0x7f060410de30 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.929+0000 7f060907a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f06041138f0 con 0x7f06041052b0 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.929+0000 7f060907a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0604113bf0 con 0x7f0604104880 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 0x7f0604103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 0x7f0604103210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47390/0 (socket says 172.21.15.49:47390) 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060359e640 1 -- 172.21.15.49:0/277856177 learned_addr learned my addr 172.21.15.49:0/277856177 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060259c640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06041052b0 0x7f0604102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f0602d9d640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0604104880 0x7f0604102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060359e640 1 -- 172.21.15.49:0/277856177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0604104880 msgr2=0x7f0604102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060359e640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0604104880 0x7f0604102790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060359e640 1 -- 172.21.15.49:0/277856177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06041052b0 msgr2=0x7f0604102cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060359e640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06041052b0 0x7f0604102cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060359e640 1 -- 172.21.15.49:0/277856177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06041a87a0 con 0x7f060410de30 2024-09-21T06:33:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060359e640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 0x7f0604103210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f05fc005cc0 tx=0x7f05fc02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f05ebfff640 1 -- 172.21.15.49:0/277856177 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc003bf0 con 0x7f060410de30 2024-09-21T06:33:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06041a8a30 con 0x7f060410de30 2024-09-21T06:33:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f05ebfff640 1 -- 172.21.15.49:0/277856177 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05fc003d90 con 0x7f060410de30 2024-09-21T06:33:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.930+0000 7f05ebfff640 1 -- 172.21.15.49:0/277856177 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc02fbc0 con 0x7f060410de30 2024-09-21T06:33:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.931+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06041a8f70 con 0x7f060410de30 2024-09-21T06:33:57.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.932+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0604104c90 con 0x7f060410de30 2024-09-21T06:33:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.933+0000 7f05ebfff640 1 -- 172.21.15.49:0/277856177 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f05fc02fd60 con 0x7f060410de30 2024-09-21T06:33:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.934+0000 7f05ebfff640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6560 0x7f05ec0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.934+0000 7f0602d9d640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6560 0x7f05ec0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:57.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.934+0000 7f05ebfff640 1 -- 172.21.15.49:0/277856177 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f05fc1084e0 con 0x7f060410de30 2024-09-21T06:33:57.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.934+0000 7f0602d9d640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6560 0x7f05ec0b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f06041041e0 tx=0x7f05f400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:57.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:57.938+0000 7f05ebfff640 1 -- 172.21.15.49:0/277856177 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05fc0cf140 con 0x7f060410de30 2024-09-21T06:33:58.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.128+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06041a9330 con 0x7f060410de30 2024-09-21T06:33:58.130 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:57 smithi049 ceph-mon[31177]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:58.130 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:57 smithi049 ceph-mon[31177]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:33:58.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.129+0000 7f05ebfff640 1 -- 172.21.15.49:0/277856177 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18674 (secure 0 0 0) 0x7f05fc0098b0 con 0x7f060410de30 2024-09-21T06:33:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:33:58.131 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":69,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:33:56.886115+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:33:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6560 msgr2=0x7f05ec0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6560 0x7f05ec0b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f06041041e0 tx=0x7f05f400b390 comp rx=0 tx=0).stop 2024-09-21T06:33:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 msgr2=0x7f0604103210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 0x7f0604103210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f05fc005cc0 tx=0x7f05fc02f380 comp rx=0 tx=0).stop 2024-09-21T06:33:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 shutdown_connections 2024-09-21T06:33:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6560 0x7f05ec0b8a70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f060410de30 0x7f0604103210 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:58.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06041052b0 0x7f0604102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 --2- 172.21.15.49:0/277856177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0604104880 0x7f0604102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.131+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 >> 172.21.15.49:0/277856177 conn(0x7f0604079730 msgr2=0x7f06041068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.132+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 shutdown_connections 2024-09-21T06:33:58.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:58.132+0000 7f060907a640 1 -- 172.21.15.49:0/277856177 wait complete. 2024-09-21T06:33:58.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:57 smithi098 ceph-mon[34704]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:58.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:57 smithi098 ceph-mon[34704]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:33:58.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:57 smithi079 ceph-mon[34346]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:58.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:57 smithi079 ceph-mon[34346]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:33:58.652 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:30:10.495246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:33:58.652 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T06:33:58.906 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:58.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:58 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/277856177' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:33:59.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:58 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/277856177' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:33:59.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:58 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/277856177' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:33:59.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.354+0000 7fd776ad6640 1 -- 172.21.15.49:0/2535059983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 msgr2=0x7fd770103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:59.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.354+0000 7fd776ad6640 1 --2- 172.21.15.49:0/2535059983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 0x7fd770103f70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd764009900 tx=0x7fd76402a410 comp rx=0 tx=0).stop 2024-09-21T06:33:59.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.354+0000 7fd776ad6640 1 -- 172.21.15.49:0/2535059983 shutdown_connections 2024-09-21T06:33:59.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.354+0000 7fd776ad6640 1 --2- 172.21.15.49:0/2535059983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd770109df0 0x7fd770110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.354+0000 7fd776ad6640 1 --2- 172.21.15.49:0/2535059983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7701094a0 0x7fd7701098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.354+0000 7fd776ad6640 1 --2- 172.21.15.49:0/2535059983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 0x7fd770103f70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.354+0000 7fd776ad6640 1 -- 172.21.15.49:0/2535059983 >> 172.21.15.49:0/2535059983 conn(0x7fd77007b850 msgr2=0x7fd77007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:59.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.354+0000 7fd776ad6640 1 -- 172.21.15.49:0/2535059983 shutdown_connections 2024-09-21T06:33:59.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.354+0000 7fd776ad6640 1 -- 172.21.15.49:0/2535059983 wait complete. 2024-09-21T06:33:59.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.355+0000 7fd776ad6640 1 Processor -- start 2024-09-21T06:33:59.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.355+0000 7fd776ad6640 1 -- start start 2024-09-21T06:33:59.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.355+0000 7fd776ad6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 0x7fd77019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:59.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.355+0000 7fd776ad6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7701094a0 0x7fd77019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:59.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.355+0000 7fd776ad6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd770109df0 0x7fd77019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.355+0000 7fd776ad6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd770113ab0 con 0x7fd770103b60 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.355+0000 7fd776ad6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd770113930 con 0x7fd770109df0 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.355+0000 7fd776ad6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd770113c30 con 0x7fd7701094a0 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd774872640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 0x7fd77019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd774872640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 0x7fd77019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47406/0 (socket says 172.21.15.49:47406) 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd774872640 1 -- 172.21.15.49:0/4234052827 learned_addr learned my addr 172.21.15.49:0/4234052827 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd76ffff640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7701094a0 0x7fd77019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd775073640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd770109df0 0x7fd77019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd774872640 1 -- 172.21.15.49:0/4234052827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7701094a0 msgr2=0x7fd77019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd774872640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7701094a0 0x7fd77019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd774872640 1 -- 172.21.15.49:0/4234052827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd770109df0 msgr2=0x7fd77019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd774872640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd770109df0 0x7fd77019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd774872640 1 -- 172.21.15.49:0/4234052827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7701a0470 con 0x7fd770103b60 2024-09-21T06:33:59.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd774872640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 0x7fd77019a500 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd764005940 tx=0x7fd7640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:59.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd76dffb640 1 -- 172.21.15.49:0/4234052827 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76403f030 con 0x7fd770103b60 2024-09-21T06:33:59.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7701a0700 con 0x7fd770103b60 2024-09-21T06:33:59.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd76dffb640 1 -- 172.21.15.49:0/4234052827 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd764003cb0 con 0x7fd770103b60 2024-09-21T06:33:59.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.356+0000 7fd76dffb640 1 -- 172.21.15.49:0/4234052827 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd764035070 con 0x7fd770103b60 2024-09-21T06:33:59.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.357+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7701a6ec0 con 0x7fd770103b60 2024-09-21T06:33:59.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.358+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd770104de0 con 0x7fd770103b60 2024-09-21T06:33:59.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.359+0000 7fd76dffb640 1 -- 172.21.15.49:0/4234052827 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fd764042030 con 0x7fd770103b60 2024-09-21T06:33:59.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.360+0000 7fd76dffb640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7600b6560 0x7fd7600b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:59.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.360+0000 7fd76ffff640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7600b6560 0x7fd7600b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:59.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.360+0000 7fd76dffb640 1 -- 172.21.15.49:0/4234052827 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fd764107a00 con 0x7fd770103b60 2024-09-21T06:33:59.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.360+0000 7fd76ffff640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7600b6560 0x7fd7600b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd7701064c0 tx=0x7fd75c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:59.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.363+0000 7fd76dffb640 1 -- 172.21.15.49:0/4234052827 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7640d2a40 con 0x7fd770103b60 2024-09-21T06:33:59.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.551+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd77010bbc0 con 0x7fd770103b60 2024-09-21T06:33:59.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.551+0000 7fd76dffb640 1 -- 172.21.15.49:0/4234052827 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7fd7640d7980 con 0x7fd770103b60 2024-09-21T06:33:59.553 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-09-21T06:33:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7600b6560 msgr2=0x7fd7600b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7600b6560 0x7fd7600b8a70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd7701064c0 tx=0x7fd75c00b390 comp rx=0 tx=0).stop 2024-09-21T06:33:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 msgr2=0x7fd77019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 0x7fd77019a500 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd764005940 tx=0x7fd7640042f0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 shutdown_connections 2024-09-21T06:33:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7600b6560 0x7fd7600b8a70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd770109df0 0x7fd77019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7701094a0 0x7fd77019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 --2- 172.21.15.49:0/4234052827 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd770103b60 0x7fd77019a500 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 >> 172.21.15.49:0/4234052827 conn(0x7fd77007b850 msgr2=0x7fd7701075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 shutdown_connections 2024-09-21T06:33:59.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:33:59.553+0000 7fd776ad6640 1 -- 172.21.15.49:0/4234052827 wait complete. 2024-09-21T06:34:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:59 smithi049 ceph-mon[31177]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:33:59 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4234052827' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:34:00.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:59 smithi098 ceph-mon[34704]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:00.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:33:59 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4234052827' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:34:00.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:59 smithi079 ceph-mon[34346]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:00.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:33:59 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4234052827' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.a on smithi049 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.d on smithi049 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.g on smithi049 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.j on smithi049 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.b on smithi079 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.e on smithi079 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.h on smithi079 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.k on smithi079 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.c on smithi098 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.f on smithi098 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.i on smithi098 2024-09-21T06:34:00.331 INFO:tasks.cephadm:Adding mds.l on smithi098 2024-09-21T06:34:00.332 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l' 2024-09-21T06:34:00.592 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:34:00.997 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:00 smithi098 ceph-mon[34704]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.089+0000 7f9687da6640 1 -- 172.21.15.98:0/600732274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9680102a70 msgr2=0x7f9680102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.089+0000 7f9687da6640 1 --2- 172.21.15.98:0/600732274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9680102a70 0x7f9680102e80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9670009ca0 tx=0x7f967002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.090+0000 7f9687da6640 1 -- 172.21.15.98:0/600732274 shutdown_connections 2024-09-21T06:34:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.090+0000 7f9687da6640 1 --2- 172.21.15.98:0/600732274 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680108d00 0x7f968010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.090+0000 7f9687da6640 1 --2- 172.21.15.98:0/600732274 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f96801083b0 0x7f96801087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.090+0000 7f9687da6640 1 --2- 172.21.15.98:0/600732274 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9680102a70 0x7f9680102e80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.090+0000 7f9687da6640 1 -- 172.21.15.98:0/600732274 >> 172.21.15.98:0/600732274 conn(0x7f9680079710 msgr2=0x7f9680079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:01.092 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.090+0000 7f9687da6640 1 -- 172.21.15.98:0/600732274 shutdown_connections 2024-09-21T06:34:01.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.090+0000 7f9687da6640 1 -- 172.21.15.98:0/600732274 wait complete. 2024-09-21T06:34:01.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.090+0000 7f9687da6640 1 Processor -- start 2024-09-21T06:34:01.093 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.090+0000 7f9687da6640 1 -- start start 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9687da6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9680102a70 0x7f968019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9687da6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96801083b0 0x7f968019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9687da6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680108d00 0x7f968019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9687da6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f96801129c0 con 0x7f9680102a70 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9687da6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9680112840 con 0x7f9680108d00 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9687da6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9680112b40 con 0x7f96801083b0 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685341640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96801083b0 0x7f968019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685341640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96801083b0 0x7f968019b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.98:43724/0 (socket says 172.21.15.98:43724) 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685341640 1 -- 172.21.15.98:0/4016332310 learned_addr learned my addr 172.21.15.98:0/4016332310 (peer_addr_for_me v2:172.21.15.98:0/0) 2024-09-21T06:34:01.095 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685b42640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9680102a70 0x7f968019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9686343640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680108d00 0x7f968019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685341640 1 -- 172.21.15.98:0/4016332310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680108d00 msgr2=0x7f968019bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685341640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680108d00 0x7f968019bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685341640 1 -- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9680102a70 msgr2=0x7f968019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685341640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9680102a70 0x7f968019b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685341640 1 -- 172.21.15.98:0/4016332310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96801a6620 con 0x7f96801083b0 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9686343640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680108d00 0x7f968019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9685341640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96801083b0 0x7f968019b850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f967400d740 tx=0x7f967400dc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f967effd640 1 -- 172.21.15.98:0/4016332310 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674017070 con 0x7f96801083b0 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f967effd640 1 -- 172.21.15.98:0/4016332310 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f967400de50 con 0x7f96801083b0 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96801a6910 con 0x7f96801083b0 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.091+0000 7f967effd640 1 -- 172.21.15.98:0/4016332310 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f967400f620 con 0x7f96801083b0 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.092+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96801a6ea0 con 0x7f96801083b0 2024-09-21T06:34:01.096 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.092+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9680103cf0 con 0x7f96801083b0 2024-09-21T06:34:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.094+0000 7f967effd640 1 -- 172.21.15.98:0/4016332310 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f967401a070 con 0x7f96801083b0 2024-09-21T06:34:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.095+0000 7f967effd640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96680b65e0 0x7f96680b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.095+0000 7f967effd640 1 -- 172.21.15.98:0/4016332310 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f96740e6910 con 0x7f96801083b0 2024-09-21T06:34:01.097 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.095+0000 7f9685b42640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96680b65e0 0x7f96680b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:01.098 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.095+0000 7f9685b42640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96680b65e0 0x7f96680b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9670005e30 tx=0x7f9670009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:01.099 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.098+0000 7f967effd640 1 -- 172.21.15.98:0/4016332310 <== mon.1 v2:172.21.15.98:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96740ad5f0 con 0x7f96801083b0 2024-09-21T06:34:01.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:00 smithi049 ceph-mon[31177]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:01.287 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.285+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}) -- 0x7f968010ab30 con 0x7f96680b65e0 2024-09-21T06:34:01.296 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.295+0000 7f967effd640 1 -- 172.21.15.98:0/4016332310 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f968010ab30 con 0x7f96680b65e0 2024-09-21T06:34:01.297 INFO:teuthology.orchestra.run.smithi098.stdout:Scheduled mds.all update... 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96680b65e0 msgr2=0x7f96680b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96680b65e0 0x7f96680b8af0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9670005e30 tx=0x7f9670009360 comp rx=0 tx=0).stop 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96801083b0 msgr2=0x7f968019b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96801083b0 0x7f968019b850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f967400d740 tx=0x7f967400dc00 comp rx=0 tx=0).stop 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 shutdown_connections 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96680b65e0 0x7f96680b8af0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9680108d00 0x7f968019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f96801083b0 0x7f968019b850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 --2- 172.21.15.98:0/4016332310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9680102a70 0x7f968019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 >> 172.21.15.98:0/4016332310 conn(0x7f9680079710 msgr2=0x7f96801064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 shutdown_connections 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi098.stderr:2024-09-21T06:34:01.297+0000 7f9687da6640 1 -- 172.21.15.98:0/4016332310 wait complete. 2024-09-21T06:34:01.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:00 smithi079 ceph-mon[34346]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:01.941 DEBUG:teuthology.orchestra.run.smithi049:mds.a> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T06:34:01.944 DEBUG:teuthology.orchestra.run.smithi049:mds.d> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T06:34:01.988 DEBUG:teuthology.orchestra.run.smithi049:mds.g> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T06:34:02.031 DEBUG:teuthology.orchestra.run.smithi049:mds.j> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T06:34:02.074 DEBUG:teuthology.orchestra.run.smithi079:mds.b> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T06:34:02.077 DEBUG:teuthology.orchestra.run.smithi079:mds.e> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T06:34:02.120 DEBUG:teuthology.orchestra.run.smithi079:mds.h> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T06:34:02.163 DEBUG:teuthology.orchestra.run.smithi079:mds.k> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T06:34:02.206 DEBUG:teuthology.orchestra.run.smithi098:mds.c> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T06:34:02.208 DEBUG:teuthology.orchestra.run.smithi098:mds.f> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T06:34:02.251 DEBUG:teuthology.orchestra.run.smithi098:mds.i> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T06:34:02.295 DEBUG:teuthology.orchestra.run.smithi098:mds.l> sudo journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T06:34:02.338 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T06:34:02.339 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: Saving service mds.all spec with placement smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:02.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:02 smithi098 ceph-mon[34704]: Deploying daemon mds.l on smithi098 2024-09-21T06:34:02.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:02.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: Saving service mds.all spec with placement smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-09-21T06:34:02.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:02.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:02.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:02.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:02.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:02.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:02.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:02.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:02.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:02 smithi079 ceph-mon[34346]: Deploying daemon mds.l on smithi098 2024-09-21T06:34:02.592 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:02.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:02.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: Saving service mds.all spec with placement smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-09-21T06:34:02.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:02.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:02.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:02.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:02.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:02.665 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:02.666 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:02.666 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:02.666 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:02 smithi049 ceph-mon[31177]: Deploying daemon mds.l on smithi098 2024-09-21T06:34:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.079+0000 7f82ca142640 1 -- 172.21.15.49:0/4141652591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c41094c0 msgr2=0x7f82c41098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.079+0000 7f82ca142640 1 --2- 172.21.15.49:0/4141652591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c41094c0 0x7f82c41098d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009900 tx=0x7f82ac02a410 comp rx=0 tx=0).stop 2024-09-21T06:34:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.079+0000 7f82ca142640 1 -- 172.21.15.49:0/4141652591 shutdown_connections 2024-09-21T06:34:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.079+0000 7f82ca142640 1 --2- 172.21.15.49:0/4141652591 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82c4109e10 0x7f82c4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.079+0000 7f82ca142640 1 --2- 172.21.15.49:0/4141652591 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c41094c0 0x7f82c41098d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.079+0000 7f82ca142640 1 --2- 172.21.15.49:0/4141652591 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c4103b80 0x7f82c4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.079+0000 7f82ca142640 1 -- 172.21.15.49:0/4141652591 >> 172.21.15.49:0/4141652591 conn(0x7f82c40ff610 msgr2=0x7f82c4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.080+0000 7f82ca142640 1 -- 172.21.15.49:0/4141652591 shutdown_connections 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.080+0000 7f82ca142640 1 -- 172.21.15.49:0/4141652591 wait complete. 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.080+0000 7f82ca142640 1 Processor -- start 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82ca142640 1 -- start start 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82ca142640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82c4103b80 0x7f82c419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82ca142640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41094c0 0x7f82c419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82ca142640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c4109e10 0x7f82c419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82ca142640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f82c4113ad0 con 0x7f82c4109e10 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82ca142640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82c4113950 con 0x7f82c41094c0 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82ca142640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82c4113c50 con 0x7f82c4103b80 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c4109e10 0x7f82c419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:03.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c4109e10 0x7f82c419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47426/0 (socket says 172.21.15.49:47426) 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c3fff640 1 -- 172.21.15.49:0/348941003 learned_addr learned my addr 172.21.15.49:0/348941003 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c2ffd640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41094c0 0x7f82c419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c37fe640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82c4103b80 0x7f82c419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c3fff640 1 -- 172.21.15.49:0/348941003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82c4103b80 msgr2=0x7f82c419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c3fff640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82c4103b80 0x7f82c419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c3fff640 1 -- 172.21.15.49:0/348941003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41094c0 msgr2=0x7f82c419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c3fff640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41094c0 0x7f82c419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c3fff640 1 -- 172.21.15.49:0/348941003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c41a0430 con 0x7f82c4109e10 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.081+0000 7f82c37fe640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82c4103b80 0x7f82c419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.082+0000 7f82c3fff640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c4109e10 0x7f82c419fd00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00eb10 tx=0x7f82bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.082+0000 7f82c0ff9640 1 -- 172.21.15.49:0/348941003 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc004b20 con 0x7f82c4109e10 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.082+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c41a0720 con 0x7f82c4109e10 2024-09-21T06:34:03.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.082+0000 7f82c0ff9640 1 -- 172.21.15.49:0/348941003 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82bc004cc0 con 0x7f82c4109e10 2024-09-21T06:34:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.082+0000 7f82c0ff9640 1 -- 172.21.15.49:0/348941003 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82bc010670 con 0x7f82c4109e10 2024-09-21T06:34:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.082+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c41a6e80 con 0x7f82c4109e10 2024-09-21T06:34:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.083+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c4103f90 con 0x7f82c4109e10 2024-09-21T06:34:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.084+0000 7f82c0ff9640 1 -- 172.21.15.49:0/348941003 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f82bc005000 con 0x7f82c4109e10 2024-09-21T06:34:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.085+0000 7f82c0ff9640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82b00b6560 0x7f82b00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.085+0000 7f82c37fe640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82b00b6560 0x7f82b00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.085+0000 7f82c0ff9640 1 -- 172.21.15.49:0/348941003 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f82bc0e77a0 con 0x7f82c4109e10 2024-09-21T06:34:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.086+0000 7f82c37fe640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82b00b6560 0x7f82b00b8a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009c20 tx=0x7f82b4005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:03.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.088+0000 7f82c0ff9640 1 -- 172.21.15.49:0/348941003 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82bc056710 con 0x7f82c4109e10 2024-09-21T06:34:03.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.314+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82c419b5f0 con 0x7f82c4109e10 2024-09-21T06:34:03.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.315+0000 7f82c0ff9640 1 -- 172.21.15.49:0/348941003 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f82c419b5f0 con 0x7f82c4109e10 2024-09-21T06:34:03.317 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:03.317 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":1,"btime":"2024-09-21T06:26:23:438315+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T06:34:03.317 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 1 2024-09-21T06:34:03.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82b00b6560 msgr2=0x7f82b00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82b00b6560 0x7f82b00b8a70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009c20 tx=0x7f82b4005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c4109e10 msgr2=0x7f82c419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c4109e10 0x7f82c419fd00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f82bc00eb10 tx=0x7f82bc00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 shutdown_connections 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82b00b6560 0x7f82b00b8a70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82c4109e10 0x7f82c419fd00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82c41094c0 0x7f82c419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 --2- 172.21.15.49:0/348941003 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82c4103b80 0x7f82c419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 >> 172.21.15.49:0/348941003 conn(0x7f82c40ff610 msgr2=0x7f82c4101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 shutdown_connections 2024-09-21T06:34:03.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:03.318+0000 7f82ca142640 1 -- 172.21.15.49:0/348941003 wait complete. 2024-09-21T06:34:03.546 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:34:03 smithi098 systemd[1]: Starting Ceph mds.l for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:03.946 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:03 smithi098 ceph-mon[34704]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:03.946 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:03 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/348941003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:03.947 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:34:03 smithi098 podman[63159]: 2024-09-21 06:34:03.592549829 +0000 UTC m=+0.015962820 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:03.947 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:34:03 smithi098 podman[63159]: 2024-09-21 06:34:03.700934492 +0000 UTC m=+0.124347474 container create 1aaf4aeb560c7b9e23e2a5eb8e31f06225f5b542e41072841fe8f5ea2125d602 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-l, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:34:03.947 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:34:03 smithi098 podman[63159]: 2024-09-21 06:34:03.945412607 +0000 UTC m=+0.368825587 container init 1aaf4aeb560c7b9e23e2a5eb8e31f06225f5b542e41072841fe8f5ea2125d602 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:34:03.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:03 smithi049 ceph-mon[31177]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:03.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:03 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/348941003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:04.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:03 smithi079 ceph-mon[34346]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:04.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:03 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/348941003' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:04.296 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:34:03 smithi098 podman[63159]: 2024-09-21 06:34:03.948180443 +0000 UTC m=+0.371593425 container start 1aaf4aeb560c7b9e23e2a5eb8e31f06225f5b542e41072841fe8f5ea2125d602 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-l, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:34:04.296 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:34:03 smithi098 ceph-mds[63178]: -- 172.21.15.98:0/1635072133 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a3026ab860 con 0x55a306853180 2024-09-21T06:34:04.296 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:34:03 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-l[63174]: starting mds.l at 2024-09-21T06:34:04.296 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:34:04 smithi098 bash[63159]: 1aaf4aeb560c7b9e23e2a5eb8e31f06225f5b542e41072841fe8f5ea2125d602 2024-09-21T06:34:04.296 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:34:04 smithi098 systemd[1]: Started Ceph mds.l for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.98:6832/144176304,v1:172.21.15.98:6833/144176304] up:boot 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: fsmap 1 up:standby 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:05.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:05.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:04 smithi079 ceph-mon[34346]: Deploying daemon mds.k on smithi079 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.98:6832/144176304,v1:172.21.15.98:6833/144176304] up:boot 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: fsmap 1 up:standby 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:05.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:04 smithi098 ceph-mon[34704]: Deploying daemon mds.k on smithi079 2024-09-21T06:34:05.374 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.98:6832/144176304,v1:172.21.15.98:6833/144176304] up:boot 2024-09-21T06:34:05.374 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: fsmap 1 up:standby 2024-09-21T06:34:05.374 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:34:05.375 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:05.375 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:05.375 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:05.375 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:05.375 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:05.375 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:05.375 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:05.375 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:04 smithi049 ceph-mon[31177]: Deploying daemon mds.k on smithi079 2024-09-21T06:34:06.026 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:06.068 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:34:05 smithi079 systemd[1]: Starting Ceph mds.k for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:06.305 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:06.476 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:34:06 smithi079 podman[62691]: 2024-09-21 06:34:06.108062178 +0000 UTC m=+0.015776745 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:06.476 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:34:06 smithi079 podman[62691]: 2024-09-21 06:34:06.211086045 +0000 UTC m=+0.118800637 container create 5a3ae4097bae47f8bc71dcca4f7c3773cd147e17f50bf24e3b05780231c84afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:34:06.476 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:34:06 smithi079 podman[62691]: 2024-09-21 06:34:06.438266079 +0000 UTC m=+0.345980634 container init 5a3ae4097bae47f8bc71dcca4f7c3773cd147e17f50bf24e3b05780231c84afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:34:06.476 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:34:06 smithi079 podman[62691]: 2024-09-21 06:34:06.441227456 +0000 UTC m=+0.348942004 container start 5a3ae4097bae47f8bc71dcca4f7c3773cd147e17f50bf24e3b05780231c84afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:34:06.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.740+0000 7efcabd34640 1 -- 172.21.15.49:0/2354335452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca410de60 msgr2=0x7efca4110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.740+0000 7efcabd34640 1 --2- 172.21.15.49:0/2354335452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca410de60 0x7efca4110330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009ca0 tx=0x7efc9c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.740+0000 7efcabd34640 1 -- 172.21.15.49:0/2354335452 shutdown_connections 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.740+0000 7efcabd34640 1 --2- 172.21.15.49:0/2354335452 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca410de60 0x7efca4110330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.740+0000 7efcabd34640 1 --2- 172.21.15.49:0/2354335452 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca4105380 0x7efca410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.740+0000 7efcabd34640 1 --2- 172.21.15.49:0/2354335452 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efca4104a30 0x7efca4104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.740+0000 7efcabd34640 1 -- 172.21.15.49:0/2354335452 >> 172.21.15.49:0/2354335452 conn(0x7efca40797b0 msgr2=0x7efca4079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.740+0000 7efcabd34640 1 -- 172.21.15.49:0/2354335452 shutdown_connections 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.740+0000 7efcabd34640 1 -- 172.21.15.49:0/2354335452 wait complete. 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.741+0000 7efcabd34640 1 Processor -- start 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.741+0000 7efcabd34640 1 -- start start 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.741+0000 7efcabd34640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca4104a30 0x7efca419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:06.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.741+0000 7efcabd34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca4105380 0x7efca419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.741+0000 7efcabd34640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efca410de60 0x7efca419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.741+0000 7efcabd34640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efca4113ac0 con 0x7efca4104a30 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.741+0000 7efcabd34640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efca4113940 con 0x7efca4105380 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.741+0000 7efcabd34640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efca4113c40 con 0x7efca410de60 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.741+0000 7efca9ad0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca4104a30 0x7efca419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efca9ad0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca4104a30 0x7efca419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50798/0 (socket says 172.21.15.49:50798) 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efca9ad0640 1 -- 172.21.15.49:0/666501366 learned_addr learned my addr 172.21.15.49:0/666501366 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efca92cf640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca4105380 0x7efca419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efcaa2d1640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efca410de60 0x7efca419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efca9ad0640 1 -- 172.21.15.49:0/666501366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efca410de60 msgr2=0x7efca419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efca9ad0640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efca410de60 0x7efca419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efca9ad0640 1 -- 172.21.15.49:0/666501366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca4105380 msgr2=0x7efca419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efca9ad0640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca4105380 0x7efca419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efca9ad0640 1 -- 172.21.15.49:0/666501366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca41a03e0 con 0x7efca4104a30 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efca9ad0640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca4104a30 0x7efca419a470 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efca000d770 tx=0x7efca000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efc9affd640 1 -- 172.21.15.49:0/666501366 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0017070 con 0x7efca4104a30 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efca41a06d0 con 0x7efca4104a30 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efc9affd640 1 -- 172.21.15.49:0/666501366 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efca00054d0 con 0x7efca4104a30 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efc9affd640 1 -- 172.21.15.49:0/666501366 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0004c30 con 0x7efca4104a30 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.742+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efca41a6e30 con 0x7efca4104a30 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.744+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efca4104e40 con 0x7efca4104a30 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.745+0000 7efc9affd640 1 -- 172.21.15.49:0/666501366 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7efca0004dd0 con 0x7efca4104a30 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.746+0000 7efc9affd640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efc900b6560 0x7efc900b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.747+0000 7efca92cf640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efc900b6560 0x7efc900b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.747+0000 7efc9affd640 1 -- 172.21.15.49:0/666501366 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7efca00e6e40 con 0x7efca4104a30 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.747+0000 7efca92cf640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efc900b6560 0x7efc900b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efc940095f0 tx=0x7efc94005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:06.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.750+0000 7efc9affd640 1 -- 172.21.15.49:0/666501366 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efca00adaa0 con 0x7efca4104a30 2024-09-21T06:34:06.818 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:34:06 smithi079 ceph-mds[62710]: -- 172.21.15.79:0/1748332103 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56364bf0f860 con 0x5636500b7600 2024-09-21T06:34:06.818 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:34:06 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k[62706]: starting mds.k at 2024-09-21T06:34:06.818 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:34:06 smithi079 bash[62691]: 5a3ae4097bae47f8bc71dcca4f7c3773cd147e17f50bf24e3b05780231c84afd 2024-09-21T06:34:06.818 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:34:06 smithi079 systemd[1]: Started Ceph mds.k for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:06.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.983+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efca4102770 con 0x7efca4104a30 2024-09-21T06:34:06.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.984+0000 7efc9affd640 1 -- 172.21.15.49:0/666501366 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1432 (secure 0 0 0) 0x7efca00b1e80 con 0x7efca4104a30 2024-09-21T06:34:06.986 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:06.986 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":2,"btime":"2024-09-21T06:34:03:986822+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:34:06.986 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 2 2024-09-21T06:34:06.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.986+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efc900b6560 msgr2=0x7efc900b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:06.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.986+0000 7efcabd34640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efc900b6560 0x7efc900b8a70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efc940095f0 tx=0x7efc94005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.986+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca4104a30 msgr2=0x7efca419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.986+0000 7efcabd34640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca4104a30 0x7efca419a470 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efca000d770 tx=0x7efca000dc30 comp rx=0 tx=0).stop 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.987+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 shutdown_connections 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.987+0000 7efcabd34640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efc900b6560 0x7efc900b8a70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.987+0000 7efcabd34640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efca410de60 0x7efca419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.987+0000 7efcabd34640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efca4105380 0x7efca419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.987+0000 7efcabd34640 1 --2- 172.21.15.49:0/666501366 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efca4104a30 0x7efca419a470 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.987+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 >> 172.21.15.49:0/666501366 conn(0x7efca40797b0 msgr2=0x7efca4107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.987+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 shutdown_connections 2024-09-21T06:34:06.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:06.987+0000 7efcabd34640 1 -- 172.21.15.49:0/666501366 wait complete. 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: Deploying daemon mds.j on smithi049 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/666501366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:07.779 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.79:6832/3655012367,v1:172.21.15.79:6833/3655012367] up:boot 2024-09-21T06:34:07.780 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: fsmap 2 up:standby 2024-09-21T06:34:07.780 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:07 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:34:07.868 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:07.868 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:07.868 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:07.868 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:07.869 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:07.869 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:07.869 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:07.869 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: Deploying daemon mds.j on smithi049 2024-09-21T06:34:07.869 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/666501366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:07.869 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.79:6832/3655012367,v1:172.21.15.79:6833/3655012367] up:boot 2024-09-21T06:34:07.869 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: fsmap 2 up:standby 2024-09-21T06:34:07.869 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:07 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:34:08.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:08.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:08.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:08.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:08.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:08.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:08.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:08.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: Deploying daemon mds.j on smithi049 2024-09-21T06:34:08.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/666501366' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:08.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.79:6832/3655012367,v1:172.21.15.79:6833/3655012367] up:boot 2024-09-21T06:34:08.048 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: fsmap 2 up:standby 2024-09-21T06:34:08.048 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:07 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:34:08.973 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:34:08 smithi049 systemd[1]: Starting Ceph mds.j for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:09.238 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:34:08 smithi049 podman[72465]: 2024-09-21 06:34:08.980688625 +0000 UTC m=+0.102999952 container create 7dc3a2b449959fcab176b34d955021e1fa16ba42f90b5bf3f6d73d76f307ca82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-j, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:34:09.238 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:34:08 smithi049 podman[72465]: 2024-09-21 06:34:08.893869964 +0000 UTC m=+0.016181253 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:09.238 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:34:09 smithi049 podman[72465]: 2024-09-21 06:34:09.200155963 +0000 UTC m=+0.322467259 container init 7dc3a2b449959fcab176b34d955021e1fa16ba42f90b5bf3f6d73d76f307ca82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:34:09.238 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:34:09 smithi049 podman[72465]: 2024-09-21 06:34:09.203161448 +0000 UTC m=+0.325472746 container start 7dc3a2b449959fcab176b34d955021e1fa16ba42f90b5bf3f6d73d76f307ca82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-j, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T06:34:09.626 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:34:09 smithi049 ceph-mds[72484]: -- 172.21.15.49:0/3920614397 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e9c1c0f860 con 0x55e9c5db7a80 2024-09-21T06:34:09.627 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:34:09 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-j[72480]: starting mds.j at 2024-09-21T06:34:09.627 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:34:09 smithi049 bash[72465]: 7dc3a2b449959fcab176b34d955021e1fa16ba42f90b5bf3f6d73d76f307ca82 2024-09-21T06:34:09.627 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:34:09 smithi049 systemd[1]: Started Ceph mds.j for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:09 smithi049 ceph-mon[31177]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:09.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:09 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:09 smithi098 ceph-mon[34704]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:09 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:09 smithi079 ceph-mon[34346]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:10.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:10.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:10.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:10.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:09 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:10.672 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:10.915 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:10 smithi049 ceph-mon[31177]: Deploying daemon mds.d on smithi049 2024-09-21T06:34:10.915 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:10 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.49:6834/3345748950,v1:172.21.15.49:6835/3345748950] up:boot 2024-09-21T06:34:10.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:10 smithi049 ceph-mon[31177]: fsmap 3 up:standby 2024-09-21T06:34:10.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:10 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:34:10.935 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:11.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:10 smithi098 ceph-mon[34704]: Deploying daemon mds.d on smithi049 2024-09-21T06:34:11.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:10 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.49:6834/3345748950,v1:172.21.15.49:6835/3345748950] up:boot 2024-09-21T06:34:11.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:10 smithi098 ceph-mon[34704]: fsmap 3 up:standby 2024-09-21T06:34:11.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:10 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:34:11.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:10 smithi079 ceph-mon[34346]: Deploying daemon mds.d on smithi049 2024-09-21T06:34:11.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:10 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.49:6834/3345748950,v1:172.21.15.49:6835/3345748950] up:boot 2024-09-21T06:34:11.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:10 smithi079 ceph-mon[34346]: fsmap 3 up:standby 2024-09-21T06:34:11.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:10 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:34:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.547+0000 7fd7c6d84640 1 -- 172.21.15.49:0/4027336903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c01083c0 msgr2=0x7fd7c01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.547+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/4027336903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c01083c0 0x7fd7c01087d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009900 tx=0x7fd7b002a410 comp rx=0 tx=0).stop 2024-09-21T06:34:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.547+0000 7fd7c6d84640 1 -- 172.21.15.49:0/4027336903 shutdown_connections 2024-09-21T06:34:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.547+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/4027336903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c0108d10 0x7fd7c010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.547+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/4027336903 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c01083c0 0x7fd7c01087d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.547+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/4027336903 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c0102a80 0x7fd7c0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.547+0000 7fd7c6d84640 1 -- 172.21.15.49:0/4027336903 >> 172.21.15.49:0/4027336903 conn(0x7fd7c0079740 msgr2=0x7fd7c0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.547+0000 7fd7c6d84640 1 -- 172.21.15.49:0/4027336903 shutdown_connections 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.547+0000 7fd7c6d84640 1 -- 172.21.15.49:0/4027336903 wait complete. 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c6d84640 1 Processor -- start 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c6d84640 1 -- start start 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c6d84640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c0102a80 0x7fd7c019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c6d84640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01083c0 0x7fd7c019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c6d84640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c0108d10 0x7fd7c019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c6d84640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0112980 con 0x7fd7c0108d10 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c6d84640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0112800 con 0x7fd7c0102a80 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c6d84640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c0112b00 con 0x7fd7c01083c0 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c5321640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c0108d10 0x7fd7c019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c5321640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c0108d10 0x7fd7c019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50826/0 (socket says 172.21.15.49:50826) 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7c5321640 1 -- 172.21.15.49:0/3962499133 learned_addr learned my addr 172.21.15.49:0/3962499133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.548+0000 7fd7bffff640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01083c0 0x7fd7c019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7c4b20640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c0102a80 0x7fd7c019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7c5321640 1 -- 172.21.15.49:0/3962499133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01083c0 msgr2=0x7fd7c019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7c5321640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01083c0 0x7fd7c019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7c5321640 1 -- 172.21.15.49:0/3962499133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c0102a80 msgr2=0x7fd7c019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7c5321640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c0102a80 0x7fd7c019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7c5321640 1 -- 172.21.15.49:0/3962499133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c01a0490 con 0x7fd7c0108d10 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7c5321640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c0108d10 0x7fd7c019fd60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800cad0 tx=0x7fd7b800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7bdffb640 1 -- 172.21.15.49:0/3962499133 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800ae20 con 0x7fd7c0108d10 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c01a0780 con 0x7fd7c0108d10 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7bdffb640 1 -- 172.21.15.49:0/3962499133 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7b8005020 con 0x7fd7c0108d10 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7bdffb640 1 -- 172.21.15.49:0/3962499133 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800f6b0 con 0x7fd7c0108d10 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.549+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c01a6ee0 con 0x7fd7c0108d10 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.550+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c0103d00 con 0x7fd7c0108d10 2024-09-21T06:34:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.552+0000 7fd7bdffb640 1 -- 172.21.15.49:0/3962499133 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fd7b80051d0 con 0x7fd7c0108d10 2024-09-21T06:34:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.552+0000 7fd7bdffb640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7ac0b6560 0x7fd7ac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.553+0000 7fd7c4b20640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7ac0b6560 0x7fd7ac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.553+0000 7fd7bdffb640 1 -- 172.21.15.49:0/3962499133 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fd7b80e6fb0 con 0x7fd7c0108d10 2024-09-21T06:34:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.553+0000 7fd7c4b20640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7ac0b6560 0x7fd7ac0b8a70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005fd0 tx=0x7fd7a8005e20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:11.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.557+0000 7fd7bdffb640 1 -- 172.21.15.49:0/3962499133 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7b8014030 con 0x7fd7c0108d10 2024-09-21T06:34:11.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.797+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7c01a70b0 con 0x7fd7c0108d10 2024-09-21T06:34:11.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.797+0000 7fd7bdffb640 1 -- 172.21.15.49:0/3962499133 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7fd7b80adc10 con 0x7fd7c0108d10 2024-09-21T06:34:11.799 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:11.799 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":4,"btime":"2024-09-21T06:34:09:619091+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:34:11.800 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 4 2024-09-21T06:34:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.799+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7ac0b6560 msgr2=0x7fd7ac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7ac0b6560 0x7fd7ac0b8a70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005fd0 tx=0x7fd7a8005e20 comp rx=0 tx=0).stop 2024-09-21T06:34:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c0108d10 msgr2=0x7fd7c019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:11.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c0108d10 0x7fd7c019fd60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800cad0 tx=0x7fd7b800cf90 comp rx=0 tx=0).stop 2024-09-21T06:34:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 shutdown_connections 2024-09-21T06:34:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7ac0b6560 0x7fd7ac0b8a70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7c0108d10 0x7fd7c019fd60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7c01083c0 0x7fd7c019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 --2- 172.21.15.49:0/3962499133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7c0102a80 0x7fd7c019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 >> 172.21.15.49:0/3962499133 conn(0x7fd7c0079740 msgr2=0x7fd7c0101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 shutdown_connections 2024-09-21T06:34:11.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:11.800+0000 7fd7c6d84640 1 -- 172.21.15.49:0/3962499133 wait complete. 2024-09-21T06:34:11.890 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:11 smithi049 ceph-mon[31177]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:12.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:11 smithi098 ceph-mon[34704]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:11 smithi079 ceph-mon[34346]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:12.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:12 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3962499133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:12.973 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:34:12 smithi049 systemd[1]: Started Ceph mds.d for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:13.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:12 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3962499133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:13.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:12 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3962499133' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.49:6836/3068546594,v1:172.21.15.49:6837/3068546594] up:boot 2024-09-21T06:34:14.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: fsmap 4 up:standby 2024-09-21T06:34:14.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:34:14.262 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:14.262 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:14.262 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:14.262 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:14.262 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:14.263 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:14.263 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:14.263 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.49:6836/3068546594,v1:172.21.15.49:6837/3068546594] up:boot 2024-09-21T06:34:14.263 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: fsmap 4 up:standby 2024-09-21T06:34:14.263 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.49:6836/3068546594,v1:172.21.15.49:6837/3068546594] up:boot 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: fsmap 4 up:standby 2024-09-21T06:34:14.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:34:14.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:14.818 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:34:14 smithi079 systemd[1]: Starting Ceph mds.e for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:14.919 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:14.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:14 smithi049 ceph-mon[31177]: Deploying daemon mds.e on smithi079 2024-09-21T06:34:15.170 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:14 smithi079 ceph-mon[34346]: Deploying daemon mds.e on smithi079 2024-09-21T06:34:15.170 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:34:14 smithi079 podman[62974]: 2024-09-21 06:34:14.861489889 +0000 UTC m=+0.016022193 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:15.170 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:34:14 smithi079 podman[62974]: 2024-09-21 06:34:14.963297995 +0000 UTC m=+0.117830299 container create 38046e04c28e0d9670024c78cd539988aa6af03508c9a83c92e5e12f3cf2f54b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:34:15.170 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:34:15 smithi079 podman[62974]: 2024-09-21 06:34:15.132362482 +0000 UTC m=+0.286894785 container init 38046e04c28e0d9670024c78cd539988aa6af03508c9a83c92e5e12f3cf2f54b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T06:34:15.171 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:34:15 smithi079 podman[62974]: 2024-09-21 06:34:15.135133992 +0000 UTC m=+0.289666301 container start 38046e04c28e0d9670024c78cd539988aa6af03508c9a83c92e5e12f3cf2f54b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T06:34:15.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:14 smithi098 ceph-mon[34704]: Deploying daemon mds.e on smithi079 2024-09-21T06:34:15.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.412+0000 7f24b6290640 1 -- 172.21.15.49:0/3576684358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 msgr2=0x7f24b01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:15.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.412+0000 7f24b6290640 1 --2- 172.21.15.49:0/3576684358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 0x7f24b01087d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009900 tx=0x7f24a402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:15.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.412+0000 7f24b6290640 1 -- 172.21.15.49:0/3576684358 shutdown_connections 2024-09-21T06:34:15.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.412+0000 7f24b6290640 1 --2- 172.21.15.49:0/3576684358 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b0108d10 0x7f24b010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:15.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.412+0000 7f24b6290640 1 --2- 172.21.15.49:0/3576684358 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 0x7f24b01087d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:15.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.412+0000 7f24b6290640 1 --2- 172.21.15.49:0/3576684358 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0102a80 0x7f24b0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:15.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.412+0000 7f24b6290640 1 -- 172.21.15.49:0/3576684358 >> 172.21.15.49:0/3576684358 conn(0x7f24b0079740 msgr2=0x7f24b0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:15.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.412+0000 7f24b6290640 1 -- 172.21.15.49:0/3576684358 shutdown_connections 2024-09-21T06:34:15.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.412+0000 7f24b6290640 1 -- 172.21.15.49:0/3576684358 wait complete. 2024-09-21T06:34:15.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24b6290640 1 Processor -- start 2024-09-21T06:34:15.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24b6290640 1 -- start start 2024-09-21T06:34:15.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24b6290640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0102a80 0x7f24b019b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:15.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24b6290640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 0x7f24b019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:15.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24b6290640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b0108d10 0x7f24b019bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:15.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24b6290640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0112980 con 0x7f24b01083c0 2024-09-21T06:34:15.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24b6290640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0112800 con 0x7f24b0108d10 2024-09-21T06:34:15.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24b6290640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f24b0112b00 con 0x7f24b0102a80 2024-09-21T06:34:15.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24af7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 0x7f24b019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:15.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24af7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 0x7f24b019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:50870/0 (socket says 172.21.15.49:50870) 2024-09-21T06:34:15.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.413+0000 7f24af7fe640 1 -- 172.21.15.49:0/2443946040 learned_addr learned my addr 172.21.15.49:0/2443946040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:15.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24affff640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0102a80 0x7f24b019b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:15.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24b482d640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b0108d10 0x7f24b019bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:15.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24af7fe640 1 -- 172.21.15.49:0/2443946040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0102a80 msgr2=0x7f24b019b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:15.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24af7fe640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0102a80 0x7f24b019b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:15.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24af7fe640 1 -- 172.21.15.49:0/2443946040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b0108d10 msgr2=0x7f24b019bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:15.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24af7fe640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b0108d10 0x7f24b019bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:15.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24af7fe640 1 -- 172.21.15.49:0/2443946040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24b01a6560 con 0x7f24b01083c0 2024-09-21T06:34:15.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24af7fe640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 0x7f24b019b790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f24a4006010 tx=0x7f24a4004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:15.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24ad7fa640 1 -- 172.21.15.49:0/2443946040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a403f030 con 0x7f24b01083c0 2024-09-21T06:34:15.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24ad7fa640 1 -- 172.21.15.49:0/2443946040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24a4003aa0 con 0x7f24b01083c0 2024-09-21T06:34:15.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24b01a67f0 con 0x7f24b01083c0 2024-09-21T06:34:15.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24ad7fa640 1 -- 172.21.15.49:0/2443946040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24a4035070 con 0x7f24b01083c0 2024-09-21T06:34:15.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.414+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24b01a6cd0 con 0x7f24b01083c0 2024-09-21T06:34:15.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.415+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b0103d00 con 0x7f24b01083c0 2024-09-21T06:34:15.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.417+0000 7f24ad7fa640 1 -- 172.21.15.49:0/2443946040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f24a4042030 con 0x7f24b01083c0 2024-09-21T06:34:15.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.418+0000 7f24ad7fa640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24980b6560 0x7f24980b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:15.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.418+0000 7f24affff640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24980b6560 0x7f24980b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:15.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.418+0000 7f24ad7fa640 1 -- 172.21.15.49:0/2443946040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f24a41077a0 con 0x7f24b01083c0 2024-09-21T06:34:15.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.419+0000 7f24affff640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24980b6560 0x7f24980b8a70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f24b006c700 tx=0x7f24a000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:15.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.422+0000 7f24ad7fa640 1 -- 172.21.15.49:0/2443946040 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24a40d27c0 con 0x7f24b01083c0 2024-09-21T06:34:15.568 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-mds[62993]: -- 172.21.15.79:0/1842526098 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b3382b860 con 0x559b379d3600 2024-09-21T06:34:15.569 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e[62989]: starting mds.e at 2024-09-21T06:34:15.569 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:34:15 smithi079 bash[62974]: 38046e04c28e0d9670024c78cd539988aa6af03508c9a83c92e5e12f3cf2f54b 2024-09-21T06:34:15.569 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:34:15 smithi079 systemd[1]: Started Ceph mds.e for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.648+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24b010ab30 con 0x7f24b01083c0 2024-09-21T06:34:15.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.648+0000 7f24ad7fa640 1 -- 172.21.15.49:0/2443946040 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7f24a40d7700 con 0x7f24b01083c0 2024-09-21T06:34:15.650 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:15.650 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":5,"btime":"2024-09-21T06:34:13:638711+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:34:15.651 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 5 2024-09-21T06:34:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24980b6560 msgr2=0x7f24980b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:15.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24980b6560 0x7f24980b8a70 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f24b006c700 tx=0x7f24a000b390 comp rx=0 tx=0).stop 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 msgr2=0x7f24b019b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 0x7f24b019b790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f24a4006010 tx=0x7f24a4004060 comp rx=0 tx=0).stop 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 shutdown_connections 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24980b6560 0x7f24980b8a70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f24b0108d10 0x7f24b019bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24b01083c0 0x7f24b019b790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 --2- 172.21.15.49:0/2443946040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24b0102a80 0x7f24b019b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 >> 172.21.15.49:0/2443946040 conn(0x7f24b0079740 msgr2=0x7f24b0104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 shutdown_connections 2024-09-21T06:34:15.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:15.651+0000 7f24b6290640 1 -- 172.21.15.49:0/2443946040 wait complete. 2024-09-21T06:34:15.970 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:15 smithi049 ceph-mon[31177]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:15.971 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:15.971 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:15.971 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:15.971 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:15.971 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:15.971 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:15 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:15.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:15 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2443946040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:16.008 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:15 smithi098 ceph-mon[34704]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:16.008 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:16.008 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:16.008 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:16.008 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:16.008 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:16.009 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:15 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:16.009 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:15 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2443946040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:16.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-mon[34346]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:16.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:16.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:16.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:16.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:16.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:16.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:16.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:15 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2443946040' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:17.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:16 smithi049 ceph-mon[31177]: Deploying daemon mds.f on smithi098 2024-09-21T06:34:17.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:16 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.79:6834/1332274866,v1:172.21.15.79:6835/1332274866] up:boot 2024-09-21T06:34:17.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:16 smithi049 ceph-mon[31177]: fsmap 5 up:standby 2024-09-21T06:34:17.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:16 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:34:17.283 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:16 smithi098 ceph-mon[34704]: Deploying daemon mds.f on smithi098 2024-09-21T06:34:17.283 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:16 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.79:6834/1332274866,v1:172.21.15.79:6835/1332274866] up:boot 2024-09-21T06:34:17.283 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:16 smithi098 ceph-mon[34704]: fsmap 5 up:standby 2024-09-21T06:34:17.283 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:16 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:34:17.284 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:34:17 smithi098 systemd[1]: Starting Ceph mds.f for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:17.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:16 smithi079 ceph-mon[34346]: Deploying daemon mds.f on smithi098 2024-09-21T06:34:17.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:16 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.79:6834/1332274866,v1:172.21.15.79:6835/1332274866] up:boot 2024-09-21T06:34:17.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:16 smithi079 ceph-mon[34346]: fsmap 5 up:standby 2024-09-21T06:34:17.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:16 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:34:17.544 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:34:17 smithi098 podman[63432]: 2024-09-21 06:34:17.184332383 +0000 UTC m=+0.015971272 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:17.544 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:34:17 smithi098 podman[63432]: 2024-09-21 06:34:17.315037119 +0000 UTC m=+0.146676043 container create 8dc5e4d6d215f6a4d068fda03daf07f54023f2c7efbf8ba2f2d3297c960475b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T06:34:17.544 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:34:17 smithi098 podman[63432]: 2024-09-21 06:34:17.542816518 +0000 UTC m=+0.374455397 container init 8dc5e4d6d215f6a4d068fda03daf07f54023f2c7efbf8ba2f2d3297c960475b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:34:17.796 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:34:17 smithi098 podman[63432]: 2024-09-21 06:34:17.545821225 +0000 UTC m=+0.377460113 container start 8dc5e4d6d215f6a4d068fda03daf07f54023f2c7efbf8ba2f2d3297c960475b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T06:34:17.796 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-mds[63451]: -- 172.21.15.98:0/2647453684 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5570e7305860 con 0x5570eb4ada80 2024-09-21T06:34:17.796 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f[63447]: starting mds.f at 2024-09-21T06:34:17.796 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:34:17 smithi098 bash[63432]: 8dc5e4d6d215f6a4d068fda03daf07f54023f2c7efbf8ba2f2d3297c960475b2 2024-09-21T06:34:17.796 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:34:17 smithi098 systemd[1]: Started Ceph mds.f for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:18.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-mon[34704]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:18.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:18.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:18.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:18.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:18.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:18.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:18.206 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:17 smithi098 ceph-mon[34704]: Deploying daemon mds.c on smithi098 2024-09-21T06:34:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:17 smithi049 ceph-mon[31177]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:17 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:17 smithi049 ceph-mon[31177]: Deploying daemon mds.c on smithi098 2024-09-21T06:34:18.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:17 smithi079 ceph-mon[34346]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:18.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:18.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:18.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:18.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:18.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:18.239 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:17 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:18.240 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:17 smithi079 ceph-mon[34346]: Deploying daemon mds.c on smithi098 2024-09-21T06:34:18.540 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:18.811 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:19.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:18 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.98:6834/1874380420,v1:172.21.15.98:6835/1874380420] up:boot 2024-09-21T06:34:19.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:18 smithi079 ceph-mon[34346]: fsmap 6 up:standby 2024-09-21T06:34:19.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:18 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:34:19.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:18 smithi079 ceph-mon[34346]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:19.176 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:18 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.98:6834/1874380420,v1:172.21.15.98:6835/1874380420] up:boot 2024-09-21T06:34:19.176 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:18 smithi098 ceph-mon[34704]: fsmap 6 up:standby 2024-09-21T06:34:19.177 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:18 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:34:19.177 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:18 smithi098 ceph-mon[34704]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:19.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:18 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.98:6834/1874380420,v1:172.21.15.98:6835/1874380420] up:boot 2024-09-21T06:34:19.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:18 smithi049 ceph-mon[31177]: fsmap 6 up:standby 2024-09-21T06:34:19.216 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:18 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:34:19.217 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:18 smithi049 ceph-mon[31177]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.215+0000 7f3c73f5f640 1 -- 172.21.15.49:0/3002836316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c102ae0 msgr2=0x7f3c6c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.215+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/3002836316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c102ae0 0x7f3c6c102ef0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3c68009900 tx=0x7f3c6802a410 comp rx=0 tx=0).stop 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.215+0000 7f3c73f5f640 1 -- 172.21.15.49:0/3002836316 shutdown_connections 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.215+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/3002836316 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c6c108d70 0x7f3c6c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.215+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/3002836316 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6c108420 0x7f3c6c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.215+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/3002836316 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c102ae0 0x7f3c6c102ef0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.215+0000 7f3c73f5f640 1 -- 172.21.15.49:0/3002836316 >> 172.21.15.49:0/3002836316 conn(0x7f3c6c079770 msgr2=0x7f3c6c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.215+0000 7f3c73f5f640 1 -- 172.21.15.49:0/3002836316 shutdown_connections 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.215+0000 7f3c73f5f640 1 -- 172.21.15.49:0/3002836316 wait complete. 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c73f5f640 1 Processor -- start 2024-09-21T06:34:19.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c73f5f640 1 -- start start 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c73f5f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c6c102ae0 0x7f3c6c1994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c73f5f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6c108420 0x7f3c6c199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c73f5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c108d70 0x7f3c6c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c73f5f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c112a30 con 0x7f3c6c108d70 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c73f5f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c1128b0 con 0x7f3c6c102ae0 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c73f5f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6c112bb0 con 0x7f3c6c108420 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c724fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c108d70 0x7f3c6c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c724fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c108d70 0x7f3c6c19ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41664/0 (socket says 172.21.15.49:41664) 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.216+0000 7f3c724fc640 1 -- 172.21.15.49:0/4258165327 learned_addr learned my addr 172.21.15.49:0/4258165327 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c71cfb640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c6c102ae0 0x7f3c6c1994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c714fa640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6c108420 0x7f3c6c199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c724fc640 1 -- 172.21.15.49:0/4258165327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6c108420 msgr2=0x7f3c6c199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:19.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c724fc640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6c108420 0x7f3c6c199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c724fc640 1 -- 172.21.15.49:0/4258165327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c6c102ae0 msgr2=0x7f3c6c1994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c724fc640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c6c102ae0 0x7f3c6c1994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c724fc640 1 -- 172.21.15.49:0/4258165327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c6c19f370 con 0x7f3c6c108d70 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c724fc640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c108d70 0x7f3c6c19ed00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400cce0 tx=0x7f3c6400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c62ffd640 1 -- 172.21.15.49:0/4258165327 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c6400f450 con 0x7f3c6c108d70 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c62ffd640 1 -- 172.21.15.49:0/4258165327 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c6400faa0 con 0x7f3c6c108d70 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c6c19f660 con 0x7f3c6c108d70 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c62ffd640 1 -- 172.21.15.49:0/4258165327 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c64018b70 con 0x7f3c6c108d70 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.217+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6c1a5e80 con 0x7f3c6c108d70 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.219+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c6c103d60 con 0x7f3c6c108d70 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.220+0000 7f3c62ffd640 1 -- 172.21.15.49:0/4258165327 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f3c64018d10 con 0x7f3c6c108d70 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.220+0000 7f3c62ffd640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c580b6610 0x7f3c580b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.221+0000 7f3c71cfb640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c580b6610 0x7f3c580b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:19.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.221+0000 7f3c62ffd640 1 -- 172.21.15.49:0/4258165327 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f3c640e7270 con 0x7f3c6c108d70 2024-09-21T06:34:19.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.221+0000 7f3c71cfb640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c580b6610 0x7f3c580b8b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c68031440 tx=0x7f3c68009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:19.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.226+0000 7f3c62ffd640 1 -- 172.21.15.49:0/4258165327 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c64014030 con 0x7f3c6c108d70 2024-09-21T06:34:19.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.452+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c6c19a5f0 con 0x7f3c6c108d70 2024-09-21T06:34:19.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.452+0000 7f3c62ffd640 1 -- 172.21.15.49:0/4258165327 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5557 (secure 0 0 0) 0x7f3c6c19a5f0 con 0x7f3c6c108d70 2024-09-21T06:34:19.454 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:19.454 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":7,"btime":"2024-09-21T06:34:17:904096+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-21T06:34:19.454 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 7 2024-09-21T06:34:19.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c580b6610 msgr2=0x7f3c580b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:19.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c580b6610 0x7f3c580b8b20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3c68031440 tx=0x7f3c68009560 comp rx=0 tx=0).stop 2024-09-21T06:34:19.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c108d70 msgr2=0x7f3c6c19ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:19.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c108d70 0x7f3c6c19ed00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3c6400cce0 tx=0x7f3c6400a620 comp rx=0 tx=0).stop 2024-09-21T06:34:19.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 shutdown_connections 2024-09-21T06:34:19.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c580b6610 0x7f3c580b8b20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:19.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c6c108d70 0x7f3c6c19ed00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:19.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c6c108420 0x7f3c6c199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:19.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 --2- 172.21.15.49:0/4258165327 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c6c102ae0 0x7f3c6c1994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:19.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 >> 172.21.15.49:0/4258165327 conn(0x7f3c6c079770 msgr2=0x7f3c6c106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:19.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 shutdown_connections 2024-09-21T06:34:19.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:19.454+0000 7f3c73f5f640 1 -- 172.21.15.49:0/4258165327 wait complete. 2024-09-21T06:34:19.914 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:34:19 smithi098 podman[63705]: 2024-09-21 06:34:19.794774177 +0000 UTC m=+0.131024066 container create 21d70cb7e6a7d0b641d3c8f52b9c8a0dbc1afef45c310d1d63adeef36d776ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T06:34:20.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:19 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4258165327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:20.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:19 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4258165327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:20.296 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:34:20 smithi098 podman[63705]: 2024-09-21 06:34:20.014676081 +0000 UTC m=+0.350925967 container init 21d70cb7e6a7d0b641d3c8f52b9c8a0dbc1afef45c310d1d63adeef36d776ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T06:34:20.296 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:34:20 smithi098 podman[63705]: 2024-09-21 06:34:20.017575476 +0000 UTC m=+0.353825362 container start 21d70cb7e6a7d0b641d3c8f52b9c8a0dbc1afef45c310d1d63adeef36d776ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T06:34:20.296 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:34:20 smithi098 ceph-mds[63725]: -- 172.21.15.98:0/2359622879 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ce0c29d860 con 0x55ce10445180 2024-09-21T06:34:20.296 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:34:20 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c[63721]: starting mds.c at 2024-09-21T06:34:20.296 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:34:20 smithi098 bash[63705]: 21d70cb7e6a7d0b641d3c8f52b9c8a0dbc1afef45c310d1d63adeef36d776ce1 2024-09-21T06:34:20.296 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:34:20 smithi098 systemd[1]: Started Ceph mds.c for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:20.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:19 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4258165327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: Deploying daemon mds.h on smithi079 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] up:boot 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: fsmap 7 up:standby 2024-09-21T06:34:21.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:21 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:34:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: Deploying daemon mds.h on smithi079 2024-09-21T06:34:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] up:boot 2024-09-21T06:34:21.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: fsmap 7 up:standby 2024-09-21T06:34:21.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:21 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:34:21.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:21.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:21.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:21.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:21.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:21.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:21.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:21.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: Deploying daemon mds.h on smithi079 2024-09-21T06:34:21.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] up:boot 2024-09-21T06:34:21.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: fsmap 7 up:standby 2024-09-21T06:34:21.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:21 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:34:22.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:22.318 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:34:22 smithi079 systemd[1]: Starting Ceph mds.h for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:22.540 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:22.636 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:34:22 smithi079 podman[63244]: 2024-09-21 06:34:22.341169318 +0000 UTC m=+0.098788799 container create 80337552f03dc9126469b12a270cf6e96e193f46bfbcf802de1843d315781668 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:34:22.636 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:34:22 smithi079 podman[63244]: 2024-09-21 06:34:22.258234257 +0000 UTC m=+0.015853738 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:22.636 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:34:22 smithi079 podman[63244]: 2024-09-21 06:34:22.55200998 +0000 UTC m=+0.309629467 container init 80337552f03dc9126469b12a270cf6e96e193f46bfbcf802de1843d315781668 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:34:22.636 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:34:22 smithi079 podman[63244]: 2024-09-21 06:34:22.554796718 +0000 UTC m=+0.312416206 container start 80337552f03dc9126469b12a270cf6e96e193f46bfbcf802de1843d315781668 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:34:22.636 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:34:22 smithi079 ceph-mds[63263]: -- 172.21.15.79:0/2382343478 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556ebb8c1860 con 0x556ebfa69600 2024-09-21T06:34:22.636 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:34:22 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h[63259]: starting mds.h at 2024-09-21T06:34:22.637 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:34:22 smithi079 bash[63244]: 80337552f03dc9126469b12a270cf6e96e193f46bfbcf802de1843d315781668 2024-09-21T06:34:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.056+0000 7fa70edc6640 1 -- 172.21.15.49:0/1874071670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa708102aa0 msgr2=0x7fa708102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.056+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1874071670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa708102aa0 0x7fa708102eb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc009900 tx=0x7fa6fc02a410 comp rx=0 tx=0).stop 2024-09-21T06:34:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.056+0000 7fa70edc6640 1 -- 172.21.15.49:0/1874071670 shutdown_connections 2024-09-21T06:34:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.056+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1874071670 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa708108d30 0x7fa70810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.056+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1874071670 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa7081083e0 0x7fa7081087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.056+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1874071670 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa708102aa0 0x7fa708102eb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.056+0000 7fa70edc6640 1 -- 172.21.15.49:0/1874071670 >> 172.21.15.49:0/1874071670 conn(0x7fa7080797e0 msgr2=0x7fa708079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.056+0000 7fa70edc6640 1 -- 172.21.15.49:0/1874071670 shutdown_connections 2024-09-21T06:34:23.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.056+0000 7fa70edc6640 1 -- 172.21.15.49:0/1874071670 wait complete. 2024-09-21T06:34:23.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70edc6640 1 Processor -- start 2024-09-21T06:34:23.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70edc6640 1 -- start start 2024-09-21T06:34:23.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70edc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa708102aa0 0x7fa708104290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70edc6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7081083e0 0x7fa7081047d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70edc6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa708108d30 0x7fa708104d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70edc6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa7081129a0 con 0x7fa7081083e0 2024-09-21T06:34:23.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70edc6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa708112820 con 0x7fa708102aa0 2024-09-21T06:34:23.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70edc6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa708112b20 con 0x7fa708108d30 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa707fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7081083e0 0x7fa7081047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa707fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7081083e0 0x7fa7081047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41684/0 (socket says 172.21.15.49:41684) 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa707fff640 1 -- 172.21.15.49:0/1487892973 learned_addr learned my addr 172.21.15.49:0/1487892973 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70d363640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa708108d30 0x7fa708104d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70cb62640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa708102aa0 0x7fa708104290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa707fff640 1 -- 172.21.15.49:0/1487892973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa708108d30 msgr2=0x7fa708104d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa707fff640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa708108d30 0x7fa708104d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa707fff640 1 -- 172.21.15.49:0/1487892973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa708102aa0 msgr2=0x7fa708104290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa707fff640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa708102aa0 0x7fa708104290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa707fff640 1 -- 172.21.15.49:0/1487892973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7081a87a0 con 0x7fa7081083e0 2024-09-21T06:34:23.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.057+0000 7fa70d363640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa708108d30 0x7fa708104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:23.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.058+0000 7fa707fff640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7081083e0 0x7fa7081047d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400c970 tx=0x7fa6f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:23.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.058+0000 7fa705ffb640 1 -- 172.21.15.49:0/1487892973 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4007bb0 con 0x7fa7081083e0 2024-09-21T06:34:23.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.058+0000 7fa705ffb640 1 -- 172.21.15.49:0/1487892973 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6f4007d50 con 0x7fa7081083e0 2024-09-21T06:34:23.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.058+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7081a8a90 con 0x7fa7081083e0 2024-09-21T06:34:23.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.059+0000 7fa705ffb640 1 -- 172.21.15.49:0/1487892973 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f4018730 con 0x7fa7081083e0 2024-09-21T06:34:23.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.059+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7081a8f80 con 0x7fa7081083e0 2024-09-21T06:34:23.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.060+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa708102eb0 con 0x7fa7081083e0 2024-09-21T06:34:23.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.061+0000 7fa705ffb640 1 -- 172.21.15.49:0/1487892973 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fa6f400f990 con 0x7fa7081083e0 2024-09-21T06:34:23.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.062+0000 7fa705ffb640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6f80b6560 0x7fa6f80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:23.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.062+0000 7fa70cb62640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6f80b6560 0x7fa6f80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:23.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.062+0000 7fa705ffb640 1 -- 172.21.15.49:0/1487892973 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fa6f40e6fd0 con 0x7fa7081083e0 2024-09-21T06:34:23.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.063+0000 7fa70cb62640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6f80b6560 0x7fa6f80b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc000c00 tx=0x7fa6fc031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:23.068 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:34:22 smithi079 systemd[1]: Started Ceph mds.h for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:23.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.066+0000 7fa705ffb640 1 -- 172.21.15.49:0/1487892973 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6f4014030 con 0x7fa7081083e0 2024-09-21T06:34:23.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.294+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7081a9270 con 0x7fa7081083e0 2024-09-21T06:34:23.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.294+0000 7fa705ffb640 1 -- 172.21.15.49:0/1487892973 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7204 (secure 0 0 0) 0x7fa6f40adbd0 con 0x7fa7081083e0 2024-09-21T06:34:23.298 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:23.298 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":9,"btime":"2024-09-21T06:34:23:166617+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T06:34:23.298 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 9 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6f80b6560 msgr2=0x7fa6f80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6f80b6560 0x7fa6f80b8a70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc000c00 tx=0x7fa6fc031400 comp rx=0 tx=0).stop 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7081083e0 msgr2=0x7fa7081047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7081083e0 0x7fa7081047d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa6f400c970 tx=0x7fa6f400ce30 comp rx=0 tx=0).stop 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 shutdown_connections 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6f80b6560 0x7fa6f80b8a70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa708108d30 0x7fa708104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa7081083e0 0x7fa7081047d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 --2- 172.21.15.49:0/1487892973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa708102aa0 0x7fa708104290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 >> 172.21.15.49:0/1487892973 conn(0x7fa7080797e0 msgr2=0x7fa7081019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 shutdown_connections 2024-09-21T06:34:23.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:23.297+0000 7fa70edc6640 1 -- 172.21.15.49:0/1487892973 wait complete. 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: Deploying daemon mds.i on smithi098 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.79:6836/1540546438,v1:172.21.15.79:6837/1540546438] up:boot 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: fsmap 8 up:standby 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:34:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:23 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1487892973' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:23.989 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: Deploying daemon mds.i on smithi098 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.79:6836/1540546438,v1:172.21.15.79:6837/1540546438] up:boot 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: fsmap 8 up:standby 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:34:23.990 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:23 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1487892973' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: Deploying daemon mds.i on smithi098 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.79:6836/1540546438,v1:172.21.15.79:6837/1540546438] up:boot 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: fsmap 8 up:standby 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:34:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:23 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1487892973' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:24.546 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:34:24 smithi098 systemd[1]: Starting Ceph mds.i for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:24.945 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:34:24 smithi098 podman[63976]: 2024-09-21 06:34:24.576010324 +0000 UTC m=+0.015938862 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:24.945 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:34:24 smithi098 podman[63976]: 2024-09-21 06:34:24.683026988 +0000 UTC m=+0.122955512 container create 4f7bf42b82f7e7953e170675500e0dcff49020f2e1cdec410b775a29641bc8f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T06:34:24.945 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:34:24 smithi098 podman[63976]: 2024-09-21 06:34:24.944142296 +0000 UTC m=+0.384070824 container init 4f7bf42b82f7e7953e170675500e0dcff49020f2e1cdec410b775a29641bc8f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T06:34:25.296 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:34:24 smithi098 podman[63976]: 2024-09-21 06:34:24.94697129 +0000 UTC m=+0.386899833 container start 4f7bf42b82f7e7953e170675500e0dcff49020f2e1cdec410b775a29641bc8f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:34:25.296 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:34:24 smithi098 ceph-mds[63995]: -- 172.21.15.98:0/514561300 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5581bf235860 con 0x5581c33dd180 2024-09-21T06:34:25.296 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:34:24 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i[63991]: starting mds.i at 2024-09-21T06:34:25.296 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:34:25 smithi098 bash[63976]: 4f7bf42b82f7e7953e170675500e0dcff49020f2e1cdec410b775a29641bc8f8 2024-09-21T06:34:25.296 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:34:25 smithi098 systemd[1]: Started Ceph mds.i for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:25 smithi049 ceph-mon[31177]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:25.773 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:25 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:25.866 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:25 smithi098 ceph-mon[34704]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:25 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:25 smithi079 ceph-mon[34346]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:26.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:26.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:26.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:26.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:25 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:26.121 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:26.794 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:26 smithi049 ceph-mon[31177]: Deploying daemon mds.g on smithi049 2024-09-21T06:34:26.794 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:26 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] up:boot 2024-09-21T06:34:26.794 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:26 smithi049 ceph-mon[31177]: fsmap 9 up:standby 2024-09-21T06:34:26.794 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:26 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:34:26.969 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:26 smithi079 ceph-mon[34346]: Deploying daemon mds.g on smithi049 2024-09-21T06:34:26.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:26 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] up:boot 2024-09-21T06:34:26.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:26 smithi079 ceph-mon[34346]: fsmap 9 up:standby 2024-09-21T06:34:26.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:26 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:34:27.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:26 smithi098 ceph-mon[34704]: Deploying daemon mds.g on smithi049 2024-09-21T06:34:27.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:26 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] up:boot 2024-09-21T06:34:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:26 smithi098 ceph-mon[34704]: fsmap 9 up:standby 2024-09-21T06:34:27.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:26 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:34:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.214+0000 7fc103639640 1 -- 172.21.15.49:0/1252000212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102fa0 msgr2=0x7fc0fc10fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.214+0000 7fc103639640 1 --2- 172.21.15.49:0/1252000212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102fa0 0x7fc0fc10fcc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0009900 tx=0x7fc0f002a480 comp rx=0 tx=0).stop 2024-09-21T06:34:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.214+0000 7fc103639640 1 -- 172.21.15.49:0/1252000212 shutdown_connections 2024-09-21T06:34:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.214+0000 7fc103639640 1 --2- 172.21.15.49:0/1252000212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0fc110200 0x7fc0fc112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.214+0000 7fc103639640 1 --2- 172.21.15.49:0/1252000212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102fa0 0x7fc0fc10fcc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.214+0000 7fc103639640 1 --2- 172.21.15.49:0/1252000212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0fc102650 0x7fc0fc102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:27.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.214+0000 7fc103639640 1 -- 172.21.15.49:0/1252000212 >> 172.21.15.49:0/1252000212 conn(0x7fc0fc079760 msgr2=0x7fc0fc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.214+0000 7fc103639640 1 -- 172.21.15.49:0/1252000212 shutdown_connections 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.214+0000 7fc103639640 1 -- 172.21.15.49:0/1252000212 wait complete. 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc103639640 1 Processor -- start 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc103639640 1 -- start start 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc103639640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102650 0x7fc0fc19c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc103639640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0fc102fa0 0x7fc0fc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc103639640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0fc110200 0x7fc0fc1a1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc103639640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc115ca0 con 0x7fc0fc102650 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc103639640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc115b20 con 0x7fc0fc110200 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc103639640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc0fc115e20 con 0x7fc0fc102fa0 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc1013d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102650 0x7fc0fc19c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:27.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc1013d5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102650 0x7fc0fc19c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46374/0 (socket says 172.21.15.49:46374) 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc1013d5640 1 -- 172.21.15.49:0/665062684 learned_addr learned my addr 172.21.15.49:0/665062684 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.215+0000 7fc100bd4640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0fc102fa0 0x7fc0fc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc101bd6640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0fc110200 0x7fc0fc1a1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc1013d5640 1 -- 172.21.15.49:0/665062684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0fc102fa0 msgr2=0x7fc0fc19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc1013d5640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0fc102fa0 0x7fc0fc19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc1013d5640 1 -- 172.21.15.49:0/665062684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0fc110200 msgr2=0x7fc0fc1a1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc1013d5640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0fc110200 0x7fc0fc1a1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc1013d5640 1 -- 172.21.15.49:0/665062684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0fc1a26a0 con 0x7fc0fc102650 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc100bd4640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0fc102fa0 0x7fc0fc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc101bd6640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0fc110200 0x7fc0fc1a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc1013d5640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102650 0x7fc0fc19c730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800d770 tx=0x7fc0f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc0ee7fc640 1 -- 172.21.15.49:0/665062684 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8017070 con 0x7fc0fc102650 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc0ee7fc640 1 -- 172.21.15.49:0/665062684 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0f80054d0 con 0x7fc0fc102650 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0fc1a2990 con 0x7fc0fc102650 2024-09-21T06:34:27.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc0ee7fc640 1 -- 172.21.15.49:0/665062684 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8004c30 con 0x7fc0fc102650 2024-09-21T06:34:27.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.216+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0fc1a90f0 con 0x7fc0fc102650 2024-09-21T06:34:27.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.217+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0fc06c1f0 con 0x7fc0fc102650 2024-09-21T06:34:27.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.219+0000 7fc0ee7fc640 1 -- 172.21.15.49:0/665062684 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fc0f8004dd0 con 0x7fc0fc102650 2024-09-21T06:34:27.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.220+0000 7fc0ee7fc640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc0e80b65e0 0x7fc0e80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:27.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.220+0000 7fc100bd4640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc0e80b65e0 0x7fc0e80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:27.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.220+0000 7fc0ee7fc640 1 -- 172.21.15.49:0/665062684 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fc0f80e6e50 con 0x7fc0fc102650 2024-09-21T06:34:27.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.220+0000 7fc100bd4640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc0e80b65e0 0x7fc0e80b8af0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0031440 tx=0x7fc0f0009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:27.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.223+0000 7fc0ee7fc640 1 -- 172.21.15.49:0/665062684 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0f80adb30 con 0x7fc0fc102650 2024-09-21T06:34:27.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.471+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0fc19d860 con 0x7fc0fc102650 2024-09-21T06:34:27.474 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.472+0000 7fc0ee7fc640 1 -- 172.21.15.49:0/665062684 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8031 (secure 0 0 0) 0x7fc0f80b1f10 con 0x7fc0fc102650 2024-09-21T06:34:27.475 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:27.475 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":10,"btime":"2024-09-21T06:34:25:686531+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24685,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T06:34:27.475 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 10 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc0e80b65e0 msgr2=0x7fc0e80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc0e80b65e0 0x7fc0e80b8af0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0031440 tx=0x7fc0f0009680 comp rx=0 tx=0).stop 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102650 msgr2=0x7fc0fc19c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102650 0x7fc0fc19c730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800d770 tx=0x7fc0f800dc30 comp rx=0 tx=0).stop 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 shutdown_connections 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc0e80b65e0 0x7fc0e80b8af0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc0fc110200 0x7fc0fc1a1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc0fc102fa0 0x7fc0fc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 --2- 172.21.15.49:0/665062684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc0fc102650 0x7fc0fc19c730 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:27.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 >> 172.21.15.49:0/665062684 conn(0x7fc0fc079760 msgr2=0x7fc0fc108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:27.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 shutdown_connections 2024-09-21T06:34:27.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:27.474+0000 7fc103639640 1 -- 172.21.15.49:0/665062684 wait complete. 2024-09-21T06:34:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:27 smithi049 ceph-mon[31177]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:27 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/665062684' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:27.988 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:27 smithi079 ceph-mon[34346]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:27.989 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:27 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/665062684' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:27 smithi098 ceph-mon[34704]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:27 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/665062684' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:28.540 INFO:journalctl@ceph.mds.g.smithi049.stdout:Sep 21 06:34:28 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-g[73600]: starting mds.g at 2024-09-21T06:34:28.540 INFO:journalctl@ceph.mds.g.smithi049.stdout:Sep 21 06:34:28 smithi049 bash[73572]: 047847e5223ec8274ca4c66f62a029552bb584eaeb720bcd89e22be2b1b9cafa 2024-09-21T06:34:28.972 INFO:journalctl@ceph.mds.g.smithi049.stdout:Sep 21 06:34:28 smithi049 systemd[1]: Started Ceph mds.g for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:29.914 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:29.914 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:29.914 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:29.914 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:29.914 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:29.915 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:29.915 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:29.915 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: Deploying daemon mds.a on smithi049 2024-09-21T06:34:29.915 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.49:6838/649653683,v1:172.21.15.49:6839/649653683] up:boot 2024-09-21T06:34:29.915 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: fsmap 10 up:standby 2024-09-21T06:34:29.915 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:29 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:34:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: Deploying daemon mds.a on smithi049 2024-09-21T06:34:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.49:6838/649653683,v1:172.21.15.49:6839/649653683] up:boot 2024-09-21T06:34:30.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: fsmap 10 up:standby 2024-09-21T06:34:30.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:29 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:34:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: Deploying daemon mds.a on smithi049 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.49:6838/649653683,v1:172.21.15.49:6839/649653683] up:boot 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: fsmap 10 up:standby 2024-09-21T06:34:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:29 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:34:30.293 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:30.473 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:34:30 smithi049 systemd[1]: Starting Ceph mds.a for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:30.877 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:34:30 smithi049 podman[73873]: 2024-09-21 06:34:30.525950886 +0000 UTC m=+0.017214762 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:30.877 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:34:30 smithi049 podman[73873]: 2024-09-21 06:34:30.656733155 +0000 UTC m=+0.147997079 container create f33742388f7331f2da33be6076db1521a828772ce883bccf642dd5dde5ea8afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:34:30.877 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:34:30 smithi049 podman[73873]: 2024-09-21 06:34:30.875944124 +0000 UTC m=+0.367208005 container init f33742388f7331f2da33be6076db1521a828772ce883bccf642dd5dde5ea8afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-a, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:34:31.043 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:31.166 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:34:30 smithi049 podman[73873]: 2024-09-21 06:34:30.8800118 +0000 UTC m=+0.371275663 container start f33742388f7331f2da33be6076db1521a828772ce883bccf642dd5dde5ea8afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-a, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T06:34:31.166 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:34:30 smithi049 ceph-mds[73917]: -- 172.21.15.49:0/618092051 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56271963dc20 con 0x56271d7e5a80 2024-09-21T06:34:31.166 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:34:30 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-a[73901]: starting mds.a at 2024-09-21T06:34:31.166 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:34:30 smithi049 bash[73873]: f33742388f7331f2da33be6076db1521a828772ce883bccf642dd5dde5ea8afd 2024-09-21T06:34:31.166 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:34:30 smithi049 systemd[1]: Started Ceph mds.a for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.573+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1759115409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 msgr2=0x7fad441098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.573+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1759115409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 0x7fad441098b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fad38009900 tx=0x7fad3802a410 comp rx=0 tx=0).stop 2024-09-21T06:34:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.573+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1759115409 shutdown_connections 2024-09-21T06:34:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.573+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1759115409 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad44109df0 0x7fad44110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.573+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1759115409 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 0x7fad441098b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.573+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1759115409 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad44103b60 0x7fad44103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.573+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1759115409 >> 172.21.15.49:0/1759115409 conn(0x7fad4407b850 msgr2=0x7fad4407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.573+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1759115409 shutdown_connections 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.573+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1759115409 wait complete. 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad4b5d7640 1 Processor -- start 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad4b5d7640 1 -- start start 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad4b5d7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad44103b60 0x7fad4419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad4b5d7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 0x7fad4419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad4b5d7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad44109df0 0x7fad4419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad4b5d7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fad44113ad0 con 0x7fad441094a0 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad4b5d7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad44113950 con 0x7fad44109df0 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad4b5d7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fad44113c50 con 0x7fad44103b60 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad48b72640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 0x7fad4419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad48b72640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 0x7fad4419aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46430/0 (socket says 172.21.15.49:46430) 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad48b72640 1 -- 172.21.15.49:0/1754962607 learned_addr learned my addr 172.21.15.49:0/1754962607 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad49b74640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad44109df0 0x7fad4419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.574+0000 7fad49373640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad44103b60 0x7fad4419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad48b72640 1 -- 172.21.15.49:0/1754962607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad44103b60 msgr2=0x7fad4419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad48b72640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad44103b60 0x7fad4419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad48b72640 1 -- 172.21.15.49:0/1754962607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad44109df0 msgr2=0x7fad4419fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad48b72640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad44109df0 0x7fad4419fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad48b72640 1 -- 172.21.15.49:0/1754962607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad441a0570 con 0x7fad441094a0 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad49b74640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad44109df0 0x7fad4419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad48b72640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 0x7fad4419aba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad38006010 tx=0x7fad38004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad367fc640 1 -- 172.21.15.49:0/1754962607 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3803f030 con 0x7fad441094a0 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad367fc640 1 -- 172.21.15.49:0/1754962607 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad38003aa0 con 0x7fad441094a0 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad441a0800 con 0x7fad441094a0 2024-09-21T06:34:31.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad367fc640 1 -- 172.21.15.49:0/1754962607 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38035070 con 0x7fad441094a0 2024-09-21T06:34:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.575+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad441a6fc0 con 0x7fad441094a0 2024-09-21T06:34:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.576+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad44103f70 con 0x7fad441094a0 2024-09-21T06:34:31.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.579+0000 7fad367fc640 1 -- 172.21.15.49:0/1754962607 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fad38042030 con 0x7fad441094a0 2024-09-21T06:34:31.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.580+0000 7fad367fc640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad300b65e0 0x7fad300b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.580+0000 7fad49373640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad300b65e0 0x7fad300b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.580+0000 7fad367fc640 1 -- 172.21.15.49:0/1754962607 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7fad38107810 con 0x7fad441094a0 2024-09-21T06:34:31.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.580+0000 7fad49373640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad300b65e0 0x7fad300b8af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad40009bd0 tx=0x7fad40005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.583+0000 7fad367fc640 1 -- 172.21.15.49:0/1754962607 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad380d2850 con 0x7fad441094a0 2024-09-21T06:34:31.693 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:31 smithi079 ceph-mon[34346]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:31.693 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:31.693 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:31.693 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:31.693 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:31.693 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:31.693 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:31 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:31.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.813+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad4419b730 con 0x7fad441094a0 2024-09-21T06:34:31.815 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:31 smithi049 ceph-mon[31177]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:31.815 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:31.815 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:31.815 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:31.816 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:31.816 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:31.816 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:31 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:31.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.814+0000 7fad367fc640 1 -- 172.21.15.49:0/1754962607 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9680 (secure 0 0 0) 0x7fad4419b730 con 0x7fad441094a0 2024-09-21T06:34:31.817 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:31.817 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":12,"btime":"2024-09-21T06:34:31:593910+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24685,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T06:34:31.817 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 12 2024-09-21T06:34:31.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad300b65e0 msgr2=0x7fad300b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad300b65e0 0x7fad300b8af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fad40009bd0 tx=0x7fad40005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:31.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 msgr2=0x7fad4419aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 0x7fad4419aba0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad38006010 tx=0x7fad38004060 comp rx=0 tx=0).stop 2024-09-21T06:34:31.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 shutdown_connections 2024-09-21T06:34:31.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad300b65e0 0x7fad300b8af0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad44109df0 0x7fad4419fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad441094a0 0x7fad4419aba0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 --2- 172.21.15.49:0/1754962607 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad44103b60 0x7fad4419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.816+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 >> 172.21.15.49:0/1754962607 conn(0x7fad4407b850 msgr2=0x7fad44107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.817+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 shutdown_connections 2024-09-21T06:34:31.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:31.817+0000 7fad4b5d7640 1 -- 172.21.15.49:0/1754962607 wait complete. 2024-09-21T06:34:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:31 smithi098 ceph-mon[34704]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:32.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:31 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:32.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:32 smithi049 ceph-mon[31177]: Deploying daemon mds.b on smithi079 2024-09-21T06:34:32.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:32 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.49:6840/3262402873,v1:172.21.15.49:6841/3262402873] up:boot 2024-09-21T06:34:32.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:32 smithi049 ceph-mon[31177]: fsmap 11 up:standby 2024-09-21T06:34:32.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:32 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:34:32.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:32 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1754962607' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:32.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:32 smithi079 ceph-mon[34346]: Deploying daemon mds.b on smithi079 2024-09-21T06:34:32.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:32 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.49:6840/3262402873,v1:172.21.15.49:6841/3262402873] up:boot 2024-09-21T06:34:32.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:32 smithi079 ceph-mon[34346]: fsmap 11 up:standby 2024-09-21T06:34:32.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:32 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:34:32.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:32 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1754962607' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:33.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:32 smithi098 ceph-mon[34704]: Deploying daemon mds.b on smithi079 2024-09-21T06:34:33.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:32 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.49:6840/3262402873,v1:172.21.15.49:6841/3262402873] up:boot 2024-09-21T06:34:33.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:32 smithi098 ceph-mon[34704]: fsmap 11 up:standby 2024-09-21T06:34:33.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:32 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:34:33.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:32 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1754962607' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:33.264 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:33 smithi079 systemd[1]: Starting Ceph mds.b for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:33.544 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:33 smithi079 podman[63526]: 2024-09-21 06:34:33.165322356 +0000 UTC m=+0.016509108 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:33.544 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:33 smithi079 podman[63526]: 2024-09-21 06:34:33.277130663 +0000 UTC m=+0.128317407 container create 5b485a5417c972a5ae18672e3115343c334fb0dcb4e5d5adf96d680f70b84981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:34:33.544 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:33 smithi079 podman[63526]: 2024-09-21 06:34:33.507017858 +0000 UTC m=+0.358204603 container init 5b485a5417c972a5ae18672e3115343c334fb0dcb4e5d5adf96d680f70b84981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T06:34:33.544 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:33 smithi079 podman[63526]: 2024-09-21 06:34:33.509746498 +0000 UTC m=+0.360933243 container start 5b485a5417c972a5ae18672e3115343c334fb0dcb4e5d5adf96d680f70b84981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:34:33.544 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:33 smithi079 ceph-mds[63545]: -- 172.21.15.79:0/557036432 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bac138dc20 con 0x55bac5535a80 2024-09-21T06:34:33.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:33 smithi079 ceph-mon[34346]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:33.819 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b[63541]: starting mds.b at 2024-09-21T06:34:33.819 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:33 smithi079 bash[63526]: 5b485a5417c972a5ae18672e3115343c334fb0dcb4e5d5adf96d680f70b84981 2024-09-21T06:34:33.819 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:33 smithi079 systemd[1]: Started Ceph mds.b for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:33.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:33 smithi049 ceph-mon[31177]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:33 smithi098 ceph-mon[34704]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:34.499 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:34.801 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:34.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:34 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] up:boot 2024-09-21T06:34:34.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:34 smithi049 ceph-mon[31177]: fsmap 12 up:standby 2024-09-21T06:34:34.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:34:34.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:34.924 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:34.924 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:34.924 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:34.924 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:34.924 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:34 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:35.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:34 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] up:boot 2024-09-21T06:34:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:34 smithi098 ceph-mon[34704]: fsmap 12 up:standby 2024-09-21T06:34:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:34:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:34 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:35.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:34 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] up:boot 2024-09-21T06:34:35.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:34 smithi079 ceph-mon[34346]: fsmap 12 up:standby 2024-09-21T06:34:35.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:34:35.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:34 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:35.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.292+0000 7f6b04662640 1 -- 172.21.15.49:0/368375765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 msgr2=0x7f6afc11b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.292+0000 7f6b04662640 1 --2- 172.21.15.49:0/368375765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 0x7f6afc11b030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009ca0 tx=0x7f6af402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.292+0000 7f6b04662640 1 -- 172.21.15.49:0/368375765 shutdown_connections 2024-09-21T06:34:35.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.292+0000 7f6b04662640 1 --2- 172.21.15.49:0/368375765 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 0x7f6afc11b030 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.292+0000 7f6b04662640 1 --2- 172.21.15.49:0/368375765 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6afc113eb0 0x7f6afc1142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.292+0000 7f6b04662640 1 --2- 172.21.15.49:0/368375765 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc10e5c0 0x7f6afc10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.292+0000 7f6b04662640 1 -- 172.21.15.49:0/368375765 >> 172.21.15.49:0/368375765 conn(0x7f6afc10a3c0 msgr2=0x7f6afc10c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.292+0000 7f6b04662640 1 -- 172.21.15.49:0/368375765 shutdown_connections 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.292+0000 7f6b04662640 1 -- 172.21.15.49:0/368375765 wait complete. 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.293+0000 7f6b04662640 1 Processor -- start 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.293+0000 7f6b04662640 1 -- start start 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.293+0000 7f6b04662640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6afc10e5c0 0x7f6afc1a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.293+0000 7f6b04662640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc113eb0 0x7f6afc1a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.293+0000 7f6b04662640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 0x7f6afc1aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.293+0000 7f6b04662640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc11e4d0 con 0x7f6afc114800 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.293+0000 7f6b04662640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc11e350 con 0x7f6afc113eb0 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.293+0000 7f6b04662640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6afc11e650 con 0x7f6afc10e5c0 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.293+0000 7f6b02bff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 0x7f6afc1aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b02bff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 0x7f6afc1aa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46446/0 (socket says 172.21.15.49:46446) 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b02bff640 1 -- 172.21.15.49:0/97954522 learned_addr learned my addr 172.21.15.49:0/97954522 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:35.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b01bfd640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc113eb0 0x7f6afc1a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b023fe640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6afc10e5c0 0x7f6afc1a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b02bff640 1 -- 172.21.15.49:0/97954522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6afc10e5c0 msgr2=0x7f6afc1a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b02bff640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6afc10e5c0 0x7f6afc1a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b02bff640 1 -- 172.21.15.49:0/97954522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc113eb0 msgr2=0x7f6afc1a5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b02bff640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc113eb0 0x7f6afc1a5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b02bff640 1 -- 172.21.15.49:0/97954522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6afc1aadd0 con 0x7f6afc114800 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b02bff640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 0x7f6afc1aa6a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6af40098d0 tx=0x7f6af40317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6af37fe640 1 -- 172.21.15.49:0/97954522 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4003b70 con 0x7f6afc114800 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6afc1ab060 con 0x7f6afc114800 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6af37fe640 1 -- 172.21.15.49:0/97954522 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6af4003d10 con 0x7f6afc114800 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6af37fe640 1 -- 172.21.15.49:0/97954522 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af402fa20 con 0x7f6afc114800 2024-09-21T06:34:35.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.294+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6afc1b1820 con 0x7f6afc114800 2024-09-21T06:34:35.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.295+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6afc10e9d0 con 0x7f6afc114800 2024-09-21T06:34:35.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.298+0000 7f6af37fe640 1 -- 172.21.15.49:0/97954522 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f6af402fc20 con 0x7f6afc114800 2024-09-21T06:34:35.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.299+0000 7f6af37fe640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ae80b6560 0x7f6ae80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.300+0000 7f6b023fe640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ae80b6560 0x7f6ae80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.300+0000 7f6af37fe640 1 -- 172.21.15.49:0/97954522 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7f6af4108450 con 0x7f6afc114800 2024-09-21T06:34:35.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.300+0000 7f6b023fe640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ae80b6560 0x7f6ae80b8a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009bd0 tx=0x7f6af8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.302+0000 7f6af37fe640 1 -- 172.21.15.49:0/97954522 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6af40cf010 con 0x7f6afc114800 2024-09-21T06:34:35.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.550+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6afc116650 con 0x7f6afc114800 2024-09-21T06:34:35.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.551+0000 7f6af37fe640 1 -- 172.21.15.49:0/97954522 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10506 (secure 0 0 0) 0x7f6af40d33f0 con 0x7f6afc114800 2024-09-21T06:34:35.553 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:35.553 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":13,"btime":"2024-09-21T06:34:33:607975+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24638,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24676,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24685,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24686,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T06:34:35.553 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 13 2024-09-21T06:34:35.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ae80b6560 msgr2=0x7f6ae80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ae80b6560 0x7f6ae80b8a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009bd0 tx=0x7f6af8005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:35.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 msgr2=0x7f6afc1aa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 0x7f6afc1aa6a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6af40098d0 tx=0x7f6af40317b0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 shutdown_connections 2024-09-21T06:34:35.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ae80b6560 0x7f6ae80b8a70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6afc114800 0x7f6afc1aa6a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6afc113eb0 0x7f6afc1a5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 --2- 172.21.15.49:0/97954522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6afc10e5c0 0x7f6afc1a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.553+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 >> 172.21.15.49:0/97954522 conn(0x7f6afc10a3c0 msgr2=0x7f6afc113430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:35.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.554+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 shutdown_connections 2024-09-21T06:34:35.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:35.554+0000 7f6b04662640 1 -- 172.21.15.49:0/97954522 wait complete. 2024-09-21T06:34:35.905 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:35 smithi049 ceph-mon[31177]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:35.905 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.905 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.905 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.905 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:35 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:35.905 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:35 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/97954522' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:35 smithi098 ceph-mon[34704]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:35 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:35 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/97954522' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:35 smithi079 ceph-mon[34346]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:35 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:35 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/97954522' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:36.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T06:34:36.536 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:37.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.021+0000 7ff668ad0640 1 -- 172.21.15.49:0/467584598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff664102a60 msgr2=0x7ff664102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.021+0000 7ff668ad0640 1 --2- 172.21.15.49:0/467584598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff664102a60 0x7ff664102e70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff654009860 tx=0x7ff65402a340 comp rx=0 tx=0).stop 2024-09-21T06:34:37.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.022+0000 7ff668ad0640 1 -- 172.21.15.49:0/467584598 shutdown_connections 2024-09-21T06:34:37.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.022+0000 7ff668ad0640 1 --2- 172.21.15.49:0/467584598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff664108cf0 0x7ff66410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.022+0000 7ff668ad0640 1 --2- 172.21.15.49:0/467584598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff6641083a0 0x7ff6641087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.022+0000 7ff668ad0640 1 --2- 172.21.15.49:0/467584598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff664102a60 0x7ff664102e70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.022+0000 7ff668ad0640 1 -- 172.21.15.49:0/467584598 >> 172.21.15.49:0/467584598 conn(0x7ff664079730 msgr2=0x7ff664079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:37.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.022+0000 7ff668ad0640 1 -- 172.21.15.49:0/467584598 shutdown_connections 2024-09-21T06:34:37.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.022+0000 7ff668ad0640 1 -- 172.21.15.49:0/467584598 wait complete. 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.022+0000 7ff668ad0640 1 Processor -- start 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff668ad0640 1 -- start start 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff668ad0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff664102a60 0x7ff66419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff668ad0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6641083a0 0x7ff66419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff668ad0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664108cf0 0x7ff66419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff668ad0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff664112960 con 0x7ff664108cf0 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff668ad0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641127e0 con 0x7ff664102a60 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff668ad0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff664112ae0 con 0x7ff6641083a0 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff662d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664108cf0 0x7ff66419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:37.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff662d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664108cf0 0x7ff66419fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37194/0 (socket says 172.21.15.49:37194) 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff662d9d640 1 -- 172.21.15.49:0/149507312 learned_addr learned my addr 172.21.15.49:0/149507312 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff66259c640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff664102a60 0x7ff66419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff661d9b640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6641083a0 0x7ff66419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff66259c640 1 -- 172.21.15.49:0/149507312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6641083a0 msgr2=0x7ff66419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff66259c640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6641083a0 0x7ff66419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff66259c640 1 -- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664108cf0 msgr2=0x7ff66419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff66259c640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664108cf0 0x7ff66419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff66259c640 1 -- 172.21.15.49:0/149507312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6641a03b0 con 0x7ff664102a60 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff662d9d640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664108cf0 0x7ff66419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.023+0000 7ff661d9b640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6641083a0 0x7ff66419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.024+0000 7ff66259c640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff664102a60 0x7ff66419a440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff654035040 tx=0x7ff654032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.024+0000 7ff6537fe640 1 -- 172.21.15.49:0/149507312 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654037040 con 0x7ff664102a60 2024-09-21T06:34:37.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.024+0000 7ff6537fe640 1 -- 172.21.15.49:0/149507312 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff654030c10 con 0x7ff664102a60 2024-09-21T06:34:37.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.024+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6641a0640 con 0x7ff664102a60 2024-09-21T06:34:37.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.024+0000 7ff6537fe640 1 -- 172.21.15.49:0/149507312 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540035f0 con 0x7ff664102a60 2024-09-21T06:34:37.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.024+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6641a6e00 con 0x7ff664102a60 2024-09-21T06:34:37.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.025+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff664102e70 con 0x7ff664102a60 2024-09-21T06:34:37.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.027+0000 7ff6537fe640 1 -- 172.21.15.49:0/149507312 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7ff654043020 con 0x7ff664102a60 2024-09-21T06:34:37.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.027+0000 7ff6537fe640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff64c0b65e0 0x7ff64c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:37.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.028+0000 7ff661d9b640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff64c0b65e0 0x7ff64c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:37.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.028+0000 7ff6537fe640 1 -- 172.21.15.49:0/149507312 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7ff654105fa0 con 0x7ff664102a60 2024-09-21T06:34:37.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.028+0000 7ff661d9b640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff64c0b65e0 0x7ff64c0b8af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff664100c50 tx=0x7ff658009260 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:37.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.032+0000 7ff6537fe640 1 -- 172.21.15.49:0/149507312 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6540ccbe0 con 0x7ff664102a60 2024-09-21T06:34:37.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.236+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff6641a7030 con 0x7ff664102a60 2024-09-21T06:34:37.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.237+0000 7ff6537fe640 1 -- 172.21.15.49:0/149507312 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7ff654030dc0 con 0x7ff664102a60 2024-09-21T06:34:37.238 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:37.239 INFO:teuthology.orchestra.run.smithi049.stdout:[ 2024-09-21T06:34:37.239 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:34:37.239 INFO:teuthology.orchestra.run.smithi049.stdout: "poolnum": 1, 2024-09-21T06:34:37.239 INFO:teuthology.orchestra.run.smithi049.stdout: "poolname": ".mgr" 2024-09-21T06:34:37.239 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:34:37.239 INFO:teuthology.orchestra.run.smithi049.stdout:] 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff64c0b65e0 msgr2=0x7ff64c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff64c0b65e0 0x7ff64c0b8af0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff664100c50 tx=0x7ff658009260 comp rx=0 tx=0).stop 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff664102a60 msgr2=0x7ff66419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff664102a60 0x7ff66419a440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff654035040 tx=0x7ff654032d50 comp rx=0 tx=0).stop 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 shutdown_connections 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff64c0b65e0 0x7ff64c0b8af0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff664108cf0 0x7ff66419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff6641083a0 0x7ff66419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 --2- 172.21.15.49:0/149507312 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff664102a60 0x7ff66419a440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 >> 172.21.15.49:0/149507312 conn(0x7ff664079730 msgr2=0x7ff664101ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 shutdown_connections 2024-09-21T06:34:37.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:37.239+0000 7ff668ad0640 1 -- 172.21.15.49:0/149507312 wait complete. 2024-09-21T06:34:37.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:37 smithi098 ceph-mon[34704]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:37.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:37.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:37.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:37.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:37.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:37.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:37 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:37.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:37 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/149507312' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:34:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:37 smithi049 ceph-mon[31177]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:37 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:37.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:37 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/149507312' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:34:37.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:37 smithi079 ceph-mon[34346]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:37 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:37 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/149507312' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:34:37.952 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:34:37.952 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:34:38.683 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:38 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.805 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.805 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.805 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.805 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.805 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:38 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:38.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:38 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.155+0000 7ff992ef6640 1 -- 172.21.15.49:0/171120703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c109df0 msgr2=0x7ff98c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.155+0000 7ff992ef6640 1 --2- 172.21.15.49:0/171120703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c109df0 0x7ff98c110620 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff984009ca0 tx=0x7ff98402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.155+0000 7ff992ef6640 1 -- 172.21.15.49:0/171120703 shutdown_connections 2024-09-21T06:34:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.155+0000 7ff992ef6640 1 --2- 172.21.15.49:0/171120703 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c109df0 0x7ff98c110620 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.155+0000 7ff992ef6640 1 --2- 172.21.15.49:0/171120703 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff98c1094a0 0x7ff98c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.155+0000 7ff992ef6640 1 --2- 172.21.15.49:0/171120703 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff98c103b60 0x7ff98c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.155+0000 7ff992ef6640 1 -- 172.21.15.49:0/171120703 >> 172.21.15.49:0/171120703 conn(0x7ff98c07b850 msgr2=0x7ff98c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:39.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.155+0000 7ff992ef6640 1 -- 172.21.15.49:0/171120703 shutdown_connections 2024-09-21T06:34:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.156+0000 7ff992ef6640 1 -- 172.21.15.49:0/171120703 wait complete. 2024-09-21T06:34:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.156+0000 7ff992ef6640 1 Processor -- start 2024-09-21T06:34:39.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.156+0000 7ff992ef6640 1 -- start start 2024-09-21T06:34:39.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.156+0000 7ff992ef6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c103b60 0x7ff98c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.156+0000 7ff992ef6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff98c1094a0 0x7ff98c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.156+0000 7ff992ef6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff98c109df0 0x7ff98c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.156+0000 7ff992ef6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c113b10 con 0x7ff98c103b60 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.156+0000 7ff992ef6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c113990 con 0x7ff98c109df0 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff992ef6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c113c90 con 0x7ff98c1094a0 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff990c92640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c103b60 0x7ff98c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff990c92640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c103b60 0x7ff98c19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37220/0 (socket says 172.21.15.49:37220) 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff990c92640 1 -- 172.21.15.49:0/2986985812 learned_addr learned my addr 172.21.15.49:0/2986985812 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff991493640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff98c109df0 0x7ff98c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff98bfff640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff98c1094a0 0x7ff98c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff990c92640 1 -- 172.21.15.49:0/2986985812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff98c1094a0 msgr2=0x7ff98c19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff990c92640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff98c1094a0 0x7ff98c19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff990c92640 1 -- 172.21.15.49:0/2986985812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff98c109df0 msgr2=0x7ff98c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff990c92640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff98c109df0 0x7ff98c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff990c92640 1 -- 172.21.15.49:0/2986985812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c1a0390 con 0x7ff98c103b60 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff991493640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff98c109df0 0x7ff98c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff990c92640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c103b60 0x7ff98c19a4e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff98000b4a0 tx=0x7ff98000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff989ffb640 1 -- 172.21.15.49:0/2986985812 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980014070 con 0x7ff98c103b60 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff989ffb640 1 -- 172.21.15.49:0/2986985812 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff980010ac0 con 0x7ff98c103b60 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98c1a0680 con 0x7ff98c103b60 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.157+0000 7ff989ffb640 1 -- 172.21.15.49:0/2986985812 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980017c30 con 0x7ff98c103b60 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.158+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98c1a6ea0 con 0x7ff98c103b60 2024-09-21T06:34:39.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.159+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98c103f70 con 0x7ff98c103b60 2024-09-21T06:34:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.160+0000 7ff989ffb640 1 -- 172.21.15.49:0/2986985812 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7ff980017070 con 0x7ff98c103b60 2024-09-21T06:34:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.161+0000 7ff989ffb640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff97c0b6610 0x7ff97c0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.161+0000 7ff98bfff640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff97c0b6610 0x7ff97c0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.161+0000 7ff989ffb640 1 -- 172.21.15.49:0/2986985812 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7342+0+0 (secure 0 0 0) 0x7ff9800e6270 con 0x7ff98c103b60 2024-09-21T06:34:39.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.161+0000 7ff98bfff640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff97c0b6610 0x7ff97c0b8b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff978005e10 tx=0x7ff978005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:39.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.165+0000 7ff989ffb640 1 -- 172.21.15.49:0/2986985812 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff9800aced0 con 0x7ff98c103b60 2024-09-21T06:34:39.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.423+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff98c10bc40 con 0x7ff98c103b60 2024-09-21T06:34:39.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.857+0000 7ff989ffb640 1 -- 172.21.15.49:0/2986985812 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7ff9800b12b0 con 0x7ff98c103b60 2024-09-21T06:34:39.859 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' created 2024-09-21T06:34:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.859+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff97c0b6610 msgr2=0x7ff97c0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.859+0000 7ff992ef6640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff97c0b6610 0x7ff97c0b8b20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff978005e10 tx=0x7ff978005da0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c103b60 msgr2=0x7ff98c19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c103b60 0x7ff98c19a4e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff98000b4a0 tx=0x7ff98000b960 comp rx=0 tx=0).stop 2024-09-21T06:34:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 shutdown_connections 2024-09-21T06:34:39.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff97c0b6610 0x7ff97c0b8b20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff98c109df0 0x7ff98c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff98c1094a0 0x7ff98c19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 --2- 172.21.15.49:0/2986985812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff98c103b60 0x7ff98c19a4e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 >> 172.21.15.49:0/2986985812 conn(0x7ff98c07b850 msgr2=0x7ff98c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 shutdown_connections 2024-09-21T06:34:39.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:39.860+0000 7ff992ef6640 1 -- 172.21.15.49:0/2986985812 wait complete. 2024-09-21T06:34:40.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:39 smithi049 ceph-mon[31177]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:40.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:39 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2986985812' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:34:40.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:40.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:40.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:40.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:40.215 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:39 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:40.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:39 smithi098 ceph-mon[34704]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:40.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:39 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2986985812' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:34:40.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:40.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:40.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:40.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:40.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:39 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:40.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:39 smithi079 ceph-mon[34346]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:40.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:39 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2986985812' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:34:40.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:40.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:40.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:40.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:40.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:39 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:34:40.577 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:34:40.842 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:41.126 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:40 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2986985812' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:34:41.126 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:40 smithi049 ceph-mon[31177]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:34:41.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:40 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2986985812' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:34:41.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:40 smithi098 ceph-mon[34704]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:34:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.313+0000 7f684c1bc640 1 -- 172.21.15.49:0/1465657054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102a60 msgr2=0x7f6844102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.313+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1465657054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102a60 0x7f6844102e70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f683c009ca0 tx=0x7f683c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.313+0000 7f684c1bc640 1 -- 172.21.15.49:0/1465657054 shutdown_connections 2024-09-21T06:34:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.313+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1465657054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6844108cf0 0x7f684410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.313+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1465657054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f68441083a0 0x7f68441087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.313+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1465657054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844102a60 0x7f6844102e70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.313+0000 7f684c1bc640 1 -- 172.21.15.49:0/1465657054 >> 172.21.15.49:0/1465657054 conn(0x7f6844079730 msgr2=0x7f6844079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.313+0000 7f684c1bc640 1 -- 172.21.15.49:0/1465657054 shutdown_connections 2024-09-21T06:34:41.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.313+0000 7f684c1bc640 1 -- 172.21.15.49:0/1465657054 wait complete. 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684c1bc640 1 Processor -- start 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684c1bc640 1 -- start start 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684c1bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6844102a60 0x7f684410ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684c1bc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68441083a0 0x7f68441104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684c1bc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844108cf0 0x7f6844110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684c1bc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6844113a80 con 0x7f6844108cf0 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684c1bc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6844113900 con 0x7f68441083a0 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684c1bc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6844113c00 con 0x7f6844102a60 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684a759640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844108cf0 0x7f6844110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684a759640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844108cf0 0x7f6844110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37238/0 (socket says 172.21.15.49:37238) 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f684a759640 1 -- 172.21.15.49:0/1582838485 learned_addr learned my addr 172.21.15.49:0/1582838485 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.314+0000 7f6849757640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68441083a0 0x7f68441104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:41.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f6849f58640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6844102a60 0x7f684410ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f684a759640 1 -- 172.21.15.49:0/1582838485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6844102a60 msgr2=0x7f684410ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f684a759640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6844102a60 0x7f684410ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f684a759640 1 -- 172.21.15.49:0/1582838485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68441083a0 msgr2=0x7f68441104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f684a759640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68441083a0 0x7f68441104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f684a759640 1 -- 172.21.15.49:0/1582838485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68441a86a0 con 0x7f6844108cf0 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f684a759640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844108cf0 0x7f6844110a30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f683400c970 tx=0x7f683400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f6842ffd640 1 -- 172.21.15.49:0/1582838485 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834007bb0 con 0x7f6844108cf0 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f6842ffd640 1 -- 172.21.15.49:0/1582838485 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6834007d50 con 0x7f6844108cf0 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68441a8990 con 0x7f6844108cf0 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f6842ffd640 1 -- 172.21.15.49:0/1582838485 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834018770 con 0x7f6844108cf0 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.315+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68441a8e80 con 0x7f6844108cf0 2024-09-21T06:34:41.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.316+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6844102e70 con 0x7f6844108cf0 2024-09-21T06:34:41.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:40 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2986985812' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:34:41.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:40 smithi079 ceph-mon[34346]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:34:41.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.319+0000 7f6842ffd640 1 -- 172.21.15.49:0/1582838485 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f683400f990 con 0x7f6844108cf0 2024-09-21T06:34:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.320+0000 7f6842ffd640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f682c0b6560 0x7f682c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:41.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.320+0000 7f6849f58640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f682c0b6560 0x7f682c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.320+0000 7f6842ffd640 1 -- 172.21.15.49:0/1582838485 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7712+0+0 (secure 0 0 0) 0x7f68340e7170 con 0x7f6844108cf0 2024-09-21T06:34:41.322 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.320+0000 7f6849f58640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f682c0b6560 0x7f682c0b8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f683c005e30 tx=0x7f683c009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:41.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.323+0000 7f6842ffd640 1 -- 172.21.15.49:0/1582838485 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6834014030 con 0x7f6844108cf0 2024-09-21T06:34:41.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.513+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f68441112b0 con 0x7f6844108cf0 2024-09-21T06:34:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.865+0000 7f6842ffd640 1 -- 172.21.15.49:0/1582838485 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v72) ==== 170+0+0 (secure 0 0 0) 0x7f68441112b0 con 0x7f6844108cf0 2024-09-21T06:34:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' created 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f682c0b6560 msgr2=0x7f682c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f682c0b6560 0x7f682c0b8a70 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f683c005e30 tx=0x7f683c009360 comp rx=0 tx=0).stop 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844108cf0 msgr2=0x7f6844110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844108cf0 0x7f6844110a30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f683400c970 tx=0x7f683400ce30 comp rx=0 tx=0).stop 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 shutdown_connections 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f682c0b6560 0x7f682c0b8a70 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6844108cf0 0x7f6844110a30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f68441083a0 0x7f68441104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 --2- 172.21.15.49:0/1582838485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6844102a60 0x7f684410ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.868+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 >> 172.21.15.49:0/1582838485 conn(0x7f6844079730 msgr2=0x7f68441014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.869+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 shutdown_connections 2024-09-21T06:34:41.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:41.869+0000 7f684c1bc640 1 -- 172.21.15.49:0/1582838485 wait complete. 2024-09-21T06:34:42.186 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:41 smithi049 ceph-mon[31177]: pgmap v252: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:42.186 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:41 smithi049 ceph-mon[31177]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:34:42.186 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:41 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1582838485' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:34:42.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:41 smithi098 ceph-mon[34704]: pgmap v252: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:42.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:41 smithi098 ceph-mon[34704]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:34:42.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:41 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1582838485' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:34:42.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:41 smithi079 ceph-mon[34346]: pgmap v252: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:42.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:41 smithi079 ceph-mon[34346]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:34:42.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:41 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1582838485' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:34:42.526 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:34:42.785 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:43.199 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:42 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1582838485' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:34:43.199 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:42 smithi049 ceph-mon[31177]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:34:43.199 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:42 smithi049 ceph-mon[31177]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:34:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.293+0000 7f1f1c64a640 1 -- 172.21.15.49:0/275771144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 msgr2=0x7f1f1410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.293+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/275771144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 0x7f1f1410f520 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c009ca0 tx=0x7f1f0c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.293+0000 7f1f1c64a640 1 -- 172.21.15.49:0/275771144 shutdown_connections 2024-09-21T06:34:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.293+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/275771144 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 0x7f1f1410f520 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.293+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/275771144 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f141083a0 0x7f1f141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.293+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/275771144 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f14102a60 0x7f1f14102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.293+0000 7f1f1c64a640 1 -- 172.21.15.49:0/275771144 >> 172.21.15.49:0/275771144 conn(0x7f1f14079730 msgr2=0x7f1f14079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:43.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.293+0000 7f1f1c64a640 1 -- 172.21.15.49:0/275771144 shutdown_connections 2024-09-21T06:34:43.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.293+0000 7f1f1c64a640 1 -- 172.21.15.49:0/275771144 wait complete. 2024-09-21T06:34:43.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:42 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1582838485' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:34:43.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:42 smithi098 ceph-mon[34704]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:34:43.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:42 smithi098 ceph-mon[34704]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.294+0000 7f1f1c64a640 1 Processor -- start 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.294+0000 7f1f1c64a640 1 -- start start 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1c64a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14102a60 0x7f1f1419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1c64a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f141083a0 0x7f1f1419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1c64a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 0x7f1f1419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1c64a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14113ac0 con 0x7f1f14108cf0 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1c64a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14113940 con 0x7f1f14102a60 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1c64a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14113c40 con 0x7f1f141083a0 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1abe7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 0x7f1f1419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1abe7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 0x7f1f1419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37270/0 (socket says 172.21.15.49:37270) 2024-09-21T06:34:43.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1abe7640 1 -- 172.21.15.49:0/1033667699 learned_addr learned my addr 172.21.15.49:0/1033667699 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f19be5640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f141083a0 0x7f1f1419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1a3e6640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14102a60 0x7f1f1419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1abe7640 1 -- 172.21.15.49:0/1033667699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f141083a0 msgr2=0x7f1f1419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1abe7640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f141083a0 0x7f1f1419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1abe7640 1 -- 172.21.15.49:0/1033667699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14102a60 msgr2=0x7f1f1419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1abe7640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14102a60 0x7f1f1419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1abe7640 1 -- 172.21.15.49:0/1033667699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f141a0440 con 0x7f1f14108cf0 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f1abe7640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 0x7f1f1419fd10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005cc0 tx=0x7f1f0c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.295+0000 7f1f077fe640 1 -- 172.21.15.49:0/1033667699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c003cf0 con 0x7f1f14108cf0 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.296+0000 7f1f077fe640 1 -- 172.21.15.49:0/1033667699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f0c0044f0 con 0x7f1f14108cf0 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.296+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f141a06d0 con 0x7f1f14108cf0 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.296+0000 7f1f077fe640 1 -- 172.21.15.49:0/1033667699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c02fc30 con 0x7f1f14108cf0 2024-09-21T06:34:43.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.296+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f141a6e90 con 0x7f1f14108cf0 2024-09-21T06:34:43.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.297+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f14102e70 con 0x7f1f14108cf0 2024-09-21T06:34:43.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.298+0000 7f1f077fe640 1 -- 172.21.15.49:0/1033667699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f1f0c0046a0 con 0x7f1f14108cf0 2024-09-21T06:34:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.299+0000 7f1f077fe640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1f000b6560 0x7f1f000b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.299+0000 7f1f1a3e6640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1f000b6560 0x7f1f000b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.299+0000 7f1f077fe640 1 -- 172.21.15.49:0/1033667699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 8094+0+0 (secure 0 0 0) 0x7f1f0c108890 con 0x7f1f14108cf0 2024-09-21T06:34:43.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.300+0000 7f1f1a3e6640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1f000b6560 0x7f1f000b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009990 tx=0x7f1f10009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:43.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.303+0000 7f1f077fe640 1 -- 172.21.15.49:0/1033667699 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f0c0cf200 con 0x7f1f14108cf0 2024-09-21T06:34:43.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:42 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1582838485' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:34:43.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:42 smithi079 ceph-mon[34346]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:34:43.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:42 smithi079 ceph-mon[34346]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:34:43.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.530+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1f1419b600 con 0x7f1f14108cf0 2024-09-21T06:34:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.901+0000 7f1f077fe640 1 -- 172.21.15.49:0/1033667699 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f1f1419b600 con 0x7f1f14108cf0 2024-09-21T06:34:43.903 INFO:teuthology.orchestra.run.smithi049.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T06:34:43.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1f000b6560 msgr2=0x7f1f000b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1f000b6560 0x7f1f000b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1f10009990 tx=0x7f1f10009110 comp rx=0 tx=0).stop 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 msgr2=0x7f1f1419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 0x7f1f1419fd10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c005cc0 tx=0x7f1f0c02f470 comp rx=0 tx=0).stop 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 shutdown_connections 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1f000b6560 0x7f1f000b8a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1f14108cf0 0x7f1f1419fd10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1f141083a0 0x7f1f1419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 --2- 172.21.15.49:0/1033667699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1f14102a60 0x7f1f1419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 >> 172.21.15.49:0/1033667699 conn(0x7f1f14079730 msgr2=0x7f1f14105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 shutdown_connections 2024-09-21T06:34:43.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:43.905+0000 7f1f1c64a640 1 -- 172.21.15.49:0/1033667699 wait complete. 2024-09-21T06:34:44.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:43 smithi049 ceph-mon[31177]: pgmap v255: 97 pgs: 1 creating+activating, 1 creating+peering, 80 unknown, 15 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:44.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:43 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1033667699' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:34:44.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:43 smithi049 ceph-mon[31177]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:34:44.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:43 smithi098 ceph-mon[34704]: pgmap v255: 97 pgs: 1 creating+activating, 1 creating+peering, 80 unknown, 15 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:44.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:43 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1033667699' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:34:44.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:43 smithi098 ceph-mon[34704]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:34:44.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:43 smithi079 ceph-mon[34346]: pgmap v255: 97 pgs: 1 creating+activating, 1 creating+peering, 80 unknown, 15 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:44.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:43 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1033667699' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:34:44.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:43 smithi079 ceph-mon[34346]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:34:44.569 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:34:44.831 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:44 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1033667699' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:34:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:44 smithi049 ceph-mon[31177]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:34:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:44 smithi049 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:34:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:44 smithi049 ceph-mon[31177]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:34:45.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:44 smithi049 ceph-mon[31177]: pgmap v258: 97 pgs: 1 creating+activating, 16 creating+peering, 45 unknown, 35 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:44 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1033667699' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:34:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:44 smithi098 ceph-mon[34704]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:34:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:44 smithi098 ceph-mon[34704]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:34:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:44 smithi098 ceph-mon[34704]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:34:45.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:44 smithi098 ceph-mon[34704]: pgmap v258: 97 pgs: 1 creating+activating, 16 creating+peering, 45 unknown, 35 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:45.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:44 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1033667699' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:34:45.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:44 smithi079 ceph-mon[34346]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:34:45.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:44 smithi079 ceph-mon[34346]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:34:45.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:44 smithi079 ceph-mon[34346]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:34:45.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:44 smithi079 ceph-mon[34346]: pgmap v258: 97 pgs: 1 creating+activating, 16 creating+peering, 45 unknown, 35 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.339+0000 7f3dfb358640 1 -- 172.21.15.49:0/267680505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df410de10 msgr2=0x7f3df4110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.339+0000 7f3dfb358640 1 --2- 172.21.15.49:0/267680505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df410de10 0x7f3df4110300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009ca0 tx=0x7f3dec02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.339+0000 7f3dfb358640 1 -- 172.21.15.49:0/267680505 shutdown_connections 2024-09-21T06:34:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.339+0000 7f3dfb358640 1 --2- 172.21.15.49:0/267680505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df410de10 0x7f3df4110300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.339+0000 7f3dfb358640 1 --2- 172.21.15.49:0/267680505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df4105300 0x7f3df410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.339+0000 7f3dfb358640 1 --2- 172.21.15.49:0/267680505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df41049b0 0x7f3df4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.339+0000 7f3dfb358640 1 -- 172.21.15.49:0/267680505 >> 172.21.15.49:0/267680505 conn(0x7f3df4079730 msgr2=0x7f3df4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.339+0000 7f3dfb358640 1 -- 172.21.15.49:0/267680505 shutdown_connections 2024-09-21T06:34:45.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.339+0000 7f3dfb358640 1 -- 172.21.15.49:0/267680505 wait complete. 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3dfb358640 1 Processor -- start 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3dfb358640 1 -- start start 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3dfb358640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41049b0 0x7f3df419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3dfb358640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df4105300 0x7f3df419ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3dfb358640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df410de10 0x7f3df419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3dfb358640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4113a90 con 0x7f3df41049b0 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3dfb358640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4113910 con 0x7f3df410de10 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3dfb358640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3df4113c10 con 0x7f3df4105300 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3df90f4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41049b0 0x7f3df419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:45.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3df90f4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41049b0 0x7f3df419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37292/0 (socket says 172.21.15.49:37292) 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.340+0000 7f3df90f4640 1 -- 172.21.15.49:0/498152349 learned_addr learned my addr 172.21.15.49:0/498152349 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df88f3640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df4105300 0x7f3df419ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df98f5640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df410de10 0x7f3df419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df90f4640 1 -- 172.21.15.49:0/498152349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df4105300 msgr2=0x7f3df419ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df90f4640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df4105300 0x7f3df419ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df90f4640 1 -- 172.21.15.49:0/498152349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df410de10 msgr2=0x7f3df419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df90f4640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df410de10 0x7f3df419fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df90f4640 1 -- 172.21.15.49:0/498152349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df41a0510 con 0x7f3df41049b0 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df98f5640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df410de10 0x7f3df419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df88f3640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df4105300 0x7f3df419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3df90f4640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41049b0 0x7f3df419a5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d770 tx=0x7f3df000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3dea7fc640 1 -- 172.21.15.49:0/498152349 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0017070 con 0x7f3df41049b0 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3dea7fc640 1 -- 172.21.15.49:0/498152349 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3df0009c30 con 0x7f3df41049b0 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df41a0800 con 0x7f3df41049b0 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3dea7fc640 1 -- 172.21.15.49:0/498152349 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df0003cc0 con 0x7f3df41049b0 2024-09-21T06:34:45.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.341+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df41a6f60 con 0x7f3df41049b0 2024-09-21T06:34:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.342+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df4104dc0 con 0x7f3df41049b0 2024-09-21T06:34:45.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.344+0000 7f3dea7fc640 1 -- 172.21.15.49:0/498152349 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f3df0003e60 con 0x7f3df41049b0 2024-09-21T06:34:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.345+0000 7f3dea7fc640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3de00b65e0 0x7f3de00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.345+0000 7f3df88f3640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3de00b65e0 0x7f3de00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.345+0000 7f3dea7fc640 1 -- 172.21.15.49:0/498152349 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f3df00e7120 con 0x7f3df41049b0 2024-09-21T06:34:45.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.346+0000 7f3df88f3640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3de00b65e0 0x7f3de00b8af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3de4005fd0 tx=0x7f3de400b5d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:45.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.349+0000 7f3dea7fc640 1 -- 172.21.15.49:0/498152349 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3df0009de0 con 0x7f3df41049b0 2024-09-21T06:34:45.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.536+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3df419b6d0 con 0x7f3df41049b0 2024-09-21T06:34:45.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.538+0000 7f3dea7fc640 1 -- 172.21.15.49:0/498152349 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22485 (secure 0 0 0) 0x7f3df00b6020 con 0x7f3df41049b0 2024-09-21T06:34:45.540 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:45.540 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":74,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:34:43.531374+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:34:45.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3de00b65e0 msgr2=0x7f3de00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:45.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3de00b65e0 0x7f3de00b8af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3de4005fd0 tx=0x7f3de400b5d0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41049b0 msgr2=0x7f3df419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:45.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41049b0 0x7f3df419a5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3df000d770 tx=0x7f3df000dc30 comp rx=0 tx=0).stop 2024-09-21T06:34:45.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 shutdown_connections 2024-09-21T06:34:45.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3de00b65e0 0x7f3de00b8af0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3df410de10 0x7f3df419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3df4105300 0x7f3df419ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 --2- 172.21.15.49:0/498152349 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3df41049b0 0x7f3df419a5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:45.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.540+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 >> 172.21.15.49:0/498152349 conn(0x7f3df4079730 msgr2=0x7f3df40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:45.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.541+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 shutdown_connections 2024-09-21T06:34:45.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:45.541+0000 7f3dfb358640 1 -- 172.21.15.49:0/498152349 wait complete. 2024-09-21T06:34:46.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:45 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] up:active 2024-09-21T06:34:46.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:45 smithi049 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:46.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:45 smithi049 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:46.220 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:45 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/498152349' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:46.249 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:34:46.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:45 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] up:active 2024-09-21T06:34:46.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:45 smithi098 ceph-mon[34704]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:46.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:45 smithi098 ceph-mon[34704]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:46.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:45 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/498152349' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:46.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:45 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] up:active 2024-09-21T06:34:46.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:45 smithi079 ceph-mon[34346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:46.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:45 smithi079 ceph-mon[34346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:46.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:45 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/498152349' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:46.505 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.015+0000 7fa2c9152640 1 -- 172.21.15.49:0/3992411585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c41083c0 msgr2=0x7fa2c41087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.015+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3992411585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c41083c0 0x7fa2c41087d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8009900 tx=0x7fa2b802a410 comp rx=0 tx=0).stop 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.015+0000 7fa2c9152640 1 -- 172.21.15.49:0/3992411585 shutdown_connections 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.015+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3992411585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c4108d10 0x7fa2c410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.015+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3992411585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c41083c0 0x7fa2c41087d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.015+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3992411585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2c4102a80 0x7fa2c4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.015+0000 7fa2c9152640 1 -- 172.21.15.49:0/3992411585 >> 172.21.15.49:0/3992411585 conn(0x7fa2c4079740 msgr2=0x7fa2c4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.015+0000 7fa2c9152640 1 -- 172.21.15.49:0/3992411585 shutdown_connections 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.015+0000 7fa2c9152640 1 -- 172.21.15.49:0/3992411585 wait complete. 2024-09-21T06:34:47.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.016+0000 7fa2c9152640 1 Processor -- start 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.016+0000 7fa2c9152640 1 -- start start 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c9152640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2c4102a80 0x7fa2c419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c9152640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c41083c0 0x7fa2c419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c9152640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c4108d10 0x7fa2c419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c9152640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c4112980 con 0x7fa2c4108d10 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c9152640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c4112800 con 0x7fa2c4102a80 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c9152640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c4112b00 con 0x7fa2c41083c0 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c4108d10 0x7fa2c419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c4108d10 0x7fa2c419bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51232/0 (socket says 172.21.15.49:51232) 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c359e640 1 -- 172.21.15.49:0/3666720410 learned_addr learned my addr 172.21.15.49:0/3666720410 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c2d9d640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2c4102a80 0x7fa2c419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c259c640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c41083c0 0x7fa2c419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:47.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c359e640 1 -- 172.21.15.49:0/3666720410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c41083c0 msgr2=0x7fa2c419b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c359e640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c41083c0 0x7fa2c419b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c359e640 1 -- 172.21.15.49:0/3666720410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2c4102a80 msgr2=0x7fa2c419b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c359e640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2c4102a80 0x7fa2c419b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c359e640 1 -- 172.21.15.49:0/3666720410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c41a6560 con 0x7fa2c4108d10 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.017+0000 7fa2c2d9d640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2c4102a80 0x7fa2c419b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.018+0000 7fa2c359e640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c4108d10 0x7fa2c419bd50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00cad0 tx=0x7fa2bc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.018+0000 7fa2abfff640 1 -- 172.21.15.49:0/3666720410 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00ae20 con 0x7fa2c4108d10 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.018+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c4199120 con 0x7fa2c4108d10 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.018+0000 7fa2abfff640 1 -- 172.21.15.49:0/3666720410 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2bc005020 con 0x7fa2c4108d10 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.018+0000 7fa2abfff640 1 -- 172.21.15.49:0/3666720410 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc00f6b0 con 0x7fa2c4108d10 2024-09-21T06:34:47.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.018+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c4199680 con 0x7fa2c4108d10 2024-09-21T06:34:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.019+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c4103d00 con 0x7fa2c4108d10 2024-09-21T06:34:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.020+0000 7fa2abfff640 1 -- 172.21.15.49:0/3666720410 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fa2bc0051d0 con 0x7fa2c4108d10 2024-09-21T06:34:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.021+0000 7fa2abfff640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2ac0b6590 0x7fa2ac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.021+0000 7fa2c2d9d640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2ac0b6590 0x7fa2ac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.021+0000 7fa2abfff640 1 -- 172.21.15.49:0/3666720410 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7fa2bc0e7730 con 0x7fa2c4108d10 2024-09-21T06:34:47.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.022+0000 7fa2c2d9d640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2ac0b6590 0x7fa2ac0b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4005fd0 tx=0x7fa2b4005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.024+0000 7fa2abfff640 1 -- 172.21.15.49:0/3666720410 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa2bc014030 con 0x7fa2c4108d10 2024-09-21T06:34:47.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.212+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2c4102e90 con 0x7fa2c4108d10 2024-09-21T06:34:47.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:46 smithi049 ceph-mon[31177]: pgmap v259: 97 pgs: 15 creating+peering, 10 unknown, 72 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 0 op/s 2024-09-21T06:34:47.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.214+0000 7fa2abfff640 1 -- 172.21.15.49:0/3666720410 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22485 (secure 0 0 0) 0x7fa2bc0adfe0 con 0x7fa2c4108d10 2024-09-21T06:34:47.216 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:34:47.216 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":74,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:34:43.531374+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:34:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2ac0b6590 msgr2=0x7fa2ac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2ac0b6590 0x7fa2ac0b8aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa2b4005fd0 tx=0x7fa2b4005850 comp rx=0 tx=0).stop 2024-09-21T06:34:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c4108d10 msgr2=0x7fa2c419bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c4108d10 0x7fa2c419bd50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00cad0 tx=0x7fa2bc00cf90 comp rx=0 tx=0).stop 2024-09-21T06:34:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 shutdown_connections 2024-09-21T06:34:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2ac0b6590 0x7fa2ac0b8aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2c4108d10 0x7fa2c419bd50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2c41083c0 0x7fa2c419b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 --2- 172.21.15.49:0/3666720410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2c4102a80 0x7fa2c419b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 >> 172.21.15.49:0/3666720410 conn(0x7fa2c4079740 msgr2=0x7fa2c4104490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 shutdown_connections 2024-09-21T06:34:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:47.216+0000 7fa2c9152640 1 -- 172.21.15.49:0/3666720410 wait complete. 2024-09-21T06:34:47.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:46 smithi098 ceph-mon[34704]: pgmap v259: 97 pgs: 15 creating+peering, 10 unknown, 72 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 0 op/s 2024-09-21T06:34:47.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:46 smithi079 ceph-mon[34346]: pgmap v259: 97 pgs: 15 creating+peering, 10 unknown, 72 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 0 op/s 2024-09-21T06:34:47.937 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:47 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3666720410' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:47.969 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:34:48.229 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:47 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3666720410' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:48.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:47 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3666720410' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:48.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.668+0000 7f5ec2b47640 1 -- 172.21.15.49:0/1287523857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc102a60 msgr2=0x7f5ebc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:48.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.668+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/1287523857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc102a60 0x7f5ebc102e70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009900 tx=0x7f5eb002a410 comp rx=0 tx=0).stop 2024-09-21T06:34:48.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.668+0000 7f5ec2b47640 1 -- 172.21.15.49:0/1287523857 shutdown_connections 2024-09-21T06:34:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.668+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/1287523857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ebc108cf0 0x7f5ebc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.668+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/1287523857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ebc1083a0 0x7f5ebc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.668+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/1287523857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc102a60 0x7f5ebc102e70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.668+0000 7f5ec2b47640 1 -- 172.21.15.49:0/1287523857 >> 172.21.15.49:0/1287523857 conn(0x7f5ebc079730 msgr2=0x7f5ebc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.668+0000 7f5ec2b47640 1 -- 172.21.15.49:0/1287523857 shutdown_connections 2024-09-21T06:34:48.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.668+0000 7f5ec2b47640 1 -- 172.21.15.49:0/1287523857 wait complete. 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.669+0000 7f5ec2b47640 1 Processor -- start 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.669+0000 7f5ec2b47640 1 -- start start 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.669+0000 7f5ec2b47640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ebc102a60 0x7f5ebc199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ec2b47640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc1083a0 0x7f5ebc1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ec2b47640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ebc108cf0 0x7f5ebc19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ec2b47640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc112a10 con 0x7f5ebc1083a0 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ec2b47640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc112890 con 0x7f5ebc102a60 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ec2b47640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ebc112b90 con 0x7f5ebc108cf0 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ebbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc1083a0 0x7f5ebc1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ebbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc1083a0 0x7f5ebc1999e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51244/0 (socket says 172.21.15.49:51244) 2024-09-21T06:34:48.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ebbfff640 1 -- 172.21.15.49:0/3490671718 learned_addr learned my addr 172.21.15.49:0/3490671718 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ec08e3640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ebc102a60 0x7f5ebc199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ec10e4640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ebc108cf0 0x7f5ebc19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ebbfff640 1 -- 172.21.15.49:0/3490671718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ebc108cf0 msgr2=0x7f5ebc19ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ebbfff640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ebc108cf0 0x7f5ebc19ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ebbfff640 1 -- 172.21.15.49:0/3490671718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ebc102a60 msgr2=0x7f5ebc199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ebbfff640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ebc102a60 0x7f5ebc199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ebbfff640 1 -- 172.21.15.49:0/3490671718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ebc19f3b0 con 0x7f5ebc1083a0 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ec10e4640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ebc108cf0 0x7f5ebc19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ebbfff640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc1083a0 0x7f5ebc1999e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800d770 tx=0x7f5ea800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5eb9ffb640 1 -- 172.21.15.49:0/3490671718 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8017070 con 0x7f5ebc1083a0 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5eb9ffb640 1 -- 172.21.15.49:0/3490671718 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ea8009c30 con 0x7f5ebc1083a0 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.670+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ebc19f6a0 con 0x7f5ebc1083a0 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.671+0000 7f5eb9ffb640 1 -- 172.21.15.49:0/3490671718 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800f620 con 0x7f5ebc1083a0 2024-09-21T06:34:48.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.671+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ebc1a5e00 con 0x7f5ebc1083a0 2024-09-21T06:34:48.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.672+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ebc102e70 con 0x7f5ebc1083a0 2024-09-21T06:34:48.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.673+0000 7f5eb9ffb640 1 -- 172.21.15.49:0/3490671718 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f5ea801a070 con 0x7f5ebc1083a0 2024-09-21T06:34:48.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.674+0000 7f5eb9ffb640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5eac0b65e0 0x7f5eac0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:48.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.674+0000 7f5ec08e3640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5eac0b65e0 0x7f5eac0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:48.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.674+0000 7f5eb9ffb640 1 -- 172.21.15.49:0/3490671718 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f5ea80e6db0 con 0x7f5ebc1083a0 2024-09-21T06:34:48.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.675+0000 7f5ec08e3640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5eac0b65e0 0x7f5eac0b8af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0005ab0 tx=0x7f5eb0005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:48.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.677+0000 7f5eb9ffb640 1 -- 172.21.15.49:0/3490671718 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ea8009de0 con 0x7f5ebc1083a0 2024-09-21T06:34:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.906+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5ebc19a570 con 0x7f5ebc1083a0 2024-09-21T06:34:48.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.931+0000 7f5eb9ffb640 1 -- 172.21.15.49:0/3490671718 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f5ebc19a570 con 0x7f5ebc1083a0 2024-09-21T06:34:48.934 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:48 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T06:34:48.617+0000 7f26bd9b9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:34:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5eac0b65e0 msgr2=0x7f5eac0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5eac0b65e0 0x7f5eac0b8af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0005ab0 tx=0x7f5eb0005a20 comp rx=0 tx=0).stop 2024-09-21T06:34:48.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc1083a0 msgr2=0x7f5ebc1999e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc1083a0 0x7f5ebc1999e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ea800d770 tx=0x7f5ea800dc30 comp rx=0 tx=0).stop 2024-09-21T06:34:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 shutdown_connections 2024-09-21T06:34:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5eac0b65e0 0x7f5eac0b8af0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ebc108cf0 0x7f5ebc19ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ebc1083a0 0x7f5ebc1999e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 --2- 172.21.15.49:0/3490671718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ebc102a60 0x7f5ebc199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.934+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 >> 172.21.15.49:0/3490671718 conn(0x7f5ebc079730 msgr2=0x7f5ebc101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.935+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 shutdown_connections 2024-09-21T06:34:48.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:48.935+0000 7f5ec2b47640 1 -- 172.21.15.49:0/3490671718 wait complete. 2024-09-21T06:34:49.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:48 smithi049 ceph-mon[31177]: pgmap v260: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-21T06:34:49.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:48 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3490671718' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:34:49.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:48 smithi098 ceph-mon[34704]: pgmap v260: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-21T06:34:49.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:48 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3490671718' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:34:49.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:48 smithi079 ceph-mon[34346]: pgmap v260: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s wr, 7 op/s 2024-09-21T06:34:49.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:48 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3490671718' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:34:49.531 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-21T06:34:49.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T06:34:49.788 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:50.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:49 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3490671718' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:34:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:49 smithi049 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.242+0000 7ff3c8874640 1 -- 172.21.15.49:0/1923603298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 msgr2=0x7ff3c4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.242+0000 7ff3c8874640 1 --2- 172.21.15.49:0/1923603298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 0x7ff3c4110640 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009900 tx=0x7ff3b402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.242+0000 7ff3c8874640 1 -- 172.21.15.49:0/1923603298 shutdown_connections 2024-09-21T06:34:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.242+0000 7ff3c8874640 1 --2- 172.21.15.49:0/1923603298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 0x7ff3c4110640 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.242+0000 7ff3c8874640 1 --2- 172.21.15.49:0/1923603298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3c41094c0 0x7ff3c41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.242+0000 7ff3c8874640 1 --2- 172.21.15.49:0/1923603298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c4103b80 0x7ff3c4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:50.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.242+0000 7ff3c8874640 1 -- 172.21.15.49:0/1923603298 >> 172.21.15.49:0/1923603298 conn(0x7ff3c40ff610 msgr2=0x7ff3c4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.242+0000 7ff3c8874640 1 -- 172.21.15.49:0/1923603298 shutdown_connections 2024-09-21T06:34:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.242+0000 7ff3c8874640 1 -- 172.21.15.49:0/1923603298 wait complete. 2024-09-21T06:34:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c8874640 1 Processor -- start 2024-09-21T06:34:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c8874640 1 -- start start 2024-09-21T06:34:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c8874640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c4103b80 0x7ff3c419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c8874640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3c41094c0 0x7ff3c419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c8874640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 0x7ff3c419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:50.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c8874640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4113ad0 con 0x7ff3c4109e10 2024-09-21T06:34:50.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c8874640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4113950 con 0x7ff3c4103b80 2024-09-21T06:34:50.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c8874640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4113c50 con 0x7ff3c41094c0 2024-09-21T06:34:50.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 0x7ff3c419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:50.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 0x7ff3c419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51258/0 (socket says 172.21.15.49:51258) 2024-09-21T06:34:50.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.243+0000 7ff3c2d9d640 1 -- 172.21.15.49:0/964348959 learned_addr learned my addr 172.21.15.49:0/964348959 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:50.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c259c640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c4103b80 0x7ff3c419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:50.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c1d9b640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3c41094c0 0x7ff3c419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:50.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c2d9d640 1 -- 172.21.15.49:0/964348959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3c41094c0 msgr2=0x7ff3c419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:50.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c2d9d640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3c41094c0 0x7ff3c419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:50.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c2d9d640 1 -- 172.21.15.49:0/964348959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c4103b80 msgr2=0x7ff3c419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:50.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c2d9d640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c4103b80 0x7ff3c419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:50.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c2d9d640 1 -- 172.21.15.49:0/964348959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c41a0450 con 0x7ff3c4109e10 2024-09-21T06:34:50.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c2d9d640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 0x7ff3c419fd20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4004770 tx=0x7ff3b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:50.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3bb7fe640 1 -- 172.21.15.49:0/964348959 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b403f030 con 0x7ff3c4109e10 2024-09-21T06:34:50.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3bb7fe640 1 -- 172.21.15.49:0/964348959 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3b4003aa0 con 0x7ff3c4109e10 2024-09-21T06:34:50.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c41a06e0 con 0x7ff3c4109e10 2024-09-21T06:34:50.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3bb7fe640 1 -- 172.21.15.49:0/964348959 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4035070 con 0x7ff3c4109e10 2024-09-21T06:34:50.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.244+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c41a6ea0 con 0x7ff3c4109e10 2024-09-21T06:34:50.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.245+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c4104e00 con 0x7ff3c4109e10 2024-09-21T06:34:50.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.247+0000 7ff3bb7fe640 1 -- 172.21.15.49:0/964348959 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7ff3b4042030 con 0x7ff3c4109e10 2024-09-21T06:34:50.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.248+0000 7ff3bb7fe640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3b00b65e0 0x7ff3b00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:50.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.248+0000 7ff3c259c640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3b00b65e0 0x7ff3b00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:50.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.248+0000 7ff3bb7fe640 1 -- 172.21.15.49:0/964348959 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7ff3b4107c60 con 0x7ff3c4109e10 2024-09-21T06:34:50.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.248+0000 7ff3c259c640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3b00b65e0 0x7ff3b00b8af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc005fd0 tx=0x7ff3bc009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:50.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.251+0000 7ff3bb7fe640 1 -- 172.21.15.49:0/964348959 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3b40d28f0 con 0x7ff3c4109e10 2024-09-21T06:34:50.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:49 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3490671718' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:34:50.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:49 smithi098 ceph-mon[34704]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:50.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:49 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3490671718' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:34:50.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:49 smithi079 ceph-mon[34346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:50.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.478+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7ff3c410bc30 con 0x7ff3c4109e10 2024-09-21T06:34:50.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.939+0000 7ff3bb7fe640 1 -- 172.21.15.49:0/964348959 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7ff3b40efe20 con 0x7ff3c4109e10 2024-09-21T06:34:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3b00b65e0 msgr2=0x7ff3b00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3b00b65e0 0x7ff3b00b8af0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc005fd0 tx=0x7ff3bc009680 comp rx=0 tx=0).stop 2024-09-21T06:34:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 msgr2=0x7ff3c419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 0x7ff3c419fd20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4004770 tx=0x7ff3b4004270 comp rx=0 tx=0).stop 2024-09-21T06:34:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 shutdown_connections 2024-09-21T06:34:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3b00b65e0 0x7ff3b00b8af0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3c4109e10 0x7ff3c419fd20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3c41094c0 0x7ff3c419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:50.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 --2- 172.21.15.49:0/964348959 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3c4103b80 0x7ff3c419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:50.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 >> 172.21.15.49:0/964348959 conn(0x7ff3c40ff610 msgr2=0x7ff3c4108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:50.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 shutdown_connections 2024-09-21T06:34:50.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:50.942+0000 7ff3c8874640 1 -- 172.21.15.49:0/964348959 wait complete. 2024-09-21T06:34:51.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:50 smithi049 ceph-mon[31177]: pgmap v261: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:34:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:50 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/964348959' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:34:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:50 smithi098 ceph-mon[34704]: pgmap v261: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:34:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:50 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/964348959' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:34:51.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:50 smithi079 ceph-mon[34346]: pgmap v261: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:34:51.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:50 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/964348959' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:34:51.540 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T06:34:51.796 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:52.164 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:51 smithi049 ceph-mon[31177]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:34:52.164 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:51 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/964348959' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:34:52.164 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:51 smithi049 ceph-mon[31177]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:34:52.164 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:51 smithi049 ceph-mon[31177]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:52.165 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:51 smithi049 ceph-mon[31177]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:34:52.165 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:51 smithi049 ceph-mon[31177]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:34:52.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.258+0000 7f15e4ef5640 1 -- 172.21.15.49:0/1991052352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 msgr2=0x7f15e010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:52.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.258+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/1991052352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 0x7f15e010f550 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009ca0 tx=0x7f15d802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.258+0000 7f15e4ef5640 1 -- 172.21.15.49:0/1991052352 shutdown_connections 2024-09-21T06:34:52.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.258+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/1991052352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 0x7f15e010f550 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.258+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/1991052352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e01083d0 0x7f15e01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.258+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/1991052352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15e0102a90 0x7f15e0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.258+0000 7f15e4ef5640 1 -- 172.21.15.49:0/1991052352 >> 172.21.15.49:0/1991052352 conn(0x7f15e0079750 msgr2=0x7f15e0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:52.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.258+0000 7f15e4ef5640 1 -- 172.21.15.49:0/1991052352 shutdown_connections 2024-09-21T06:34:52.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.258+0000 7f15e4ef5640 1 -- 172.21.15.49:0/1991052352 wait complete. 2024-09-21T06:34:52.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15e4ef5640 1 Processor -- start 2024-09-21T06:34:52.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15e4ef5640 1 -- start start 2024-09-21T06:34:52.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15e4ef5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e0102a90 0x7f15e019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:52.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15e4ef5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15e01083d0 0x7f15e019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:52.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15e4ef5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 0x7f15e019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:52.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15e4ef5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f15e01129e0 con 0x7f15e0108d20 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15e4ef5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0112860 con 0x7f15e0102a90 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15e4ef5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0112b60 con 0x7f15e01083d0 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15ded9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 0x7f15e019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15ded9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 0x7f15e019bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51264/0 (socket says 172.21.15.49:51264) 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.259+0000 7f15ded9d640 1 -- 172.21.15.49:0/2260242541 learned_addr learned my addr 172.21.15.49:0/2260242541 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15ddd9b640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15e01083d0 0x7f15e019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15de59c640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e0102a90 0x7f15e019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15ded9d640 1 -- 172.21.15.49:0/2260242541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15e01083d0 msgr2=0x7f15e019b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15ded9d640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15e01083d0 0x7f15e019b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15ded9d640 1 -- 172.21.15.49:0/2260242541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e0102a90 msgr2=0x7f15e019b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15ded9d640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e0102a90 0x7f15e019b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15ded9d640 1 -- 172.21.15.49:0/2260242541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e01990e0 con 0x7f15e0108d20 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15ded9d640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 0x7f15e019bd70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009430 tx=0x7f15d80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:52.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15cf7fe640 1 -- 172.21.15.49:0/2260242541 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d8003b70 con 0x7f15e0108d20 2024-09-21T06:34:52.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e0199370 con 0x7f15e0108d20 2024-09-21T06:34:52.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15cf7fe640 1 -- 172.21.15.49:0/2260242541 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15d8003d10 con 0x7f15e0108d20 2024-09-21T06:34:52.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e0199900 con 0x7f15e0108d20 2024-09-21T06:34:52.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.260+0000 7f15cf7fe640 1 -- 172.21.15.49:0/2260242541 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d802fa30 con 0x7f15e0108d20 2024-09-21T06:34:52.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.261+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e0103d10 con 0x7f15e0108d20 2024-09-21T06:34:52.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.263+0000 7f15cf7fe640 1 -- 172.21.15.49:0/2260242541 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f15d802fbd0 con 0x7f15e0108d20 2024-09-21T06:34:52.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.264+0000 7f15cf7fe640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f15c80b6610 0x7f15c80b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:52.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.264+0000 7f15de59c640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f15c80b6610 0x7f15c80b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:52.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.264+0000 7f15cf7fe640 1 -- 172.21.15.49:0/2260242541 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f15d8108680 con 0x7f15e0108d20 2024-09-21T06:34:52.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.265+0000 7f15de59c640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f15c80b6610 0x7f15c80b8b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15e006c6e0 tx=0x7f15d000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:52.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.267+0000 7f15cf7fe640 1 -- 172.21.15.49:0/2260242541 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15d80cef30 con 0x7f15e0108d20 2024-09-21T06:34:52.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:51 smithi098 ceph-mon[34704]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:34:52.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:51 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/964348959' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:34:52.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:51 smithi098 ceph-mon[34704]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:34:52.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:51 smithi098 ceph-mon[34704]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:52.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:51 smithi098 ceph-mon[34704]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:34:52.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:51 smithi098 ceph-mon[34704]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:34:52.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:51 smithi079 ceph-mon[34346]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:34:52.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:51 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/964348959' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:34:52.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:51 smithi079 ceph-mon[34346]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:34:52.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:51 smithi079 ceph-mon[34346]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:52.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:51 smithi079 ceph-mon[34346]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:34:52.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:51 smithi079 ceph-mon[34346]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:34:52.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.496+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f15e019ae20 con 0x7f15e0108d20 2024-09-21T06:34:52.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.960+0000 7f15cf7fe640 1 -- 172.21.15.49:0/2260242541 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f15d80d3310 con 0x7f15e0108d20 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f15c80b6610 msgr2=0x7f15c80b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f15c80b6610 0x7f15c80b8b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f15e006c6e0 tx=0x7f15d000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 msgr2=0x7f15e019bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 0x7f15e019bd70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009430 tx=0x7f15d80319f0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 shutdown_connections 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f15c80b6610 0x7f15c80b8b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f15e0108d20 0x7f15e019bd70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f15e01083d0 0x7f15e019b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 --2- 172.21.15.49:0/2260242541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f15e0102a90 0x7f15e019b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 >> 172.21.15.49:0/2260242541 conn(0x7f15e0079750 msgr2=0x7f15e0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:52.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 shutdown_connections 2024-09-21T06:34:52.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:52.963+0000 7f15e4ef5640 1 -- 172.21.15.49:0/2260242541 wait complete. 2024-09-21T06:34:53.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:52 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] up:active 2024-09-21T06:34:53.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:52 smithi098 ceph-mon[34704]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:34:53.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:52 smithi098 ceph-mon[34704]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:34:53.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:52 smithi098 ceph-mon[34704]: Cluster is now healthy 2024-09-21T06:34:53.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:52 smithi098 ceph-mon[34704]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:34:53.211 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:52 smithi098 ceph-mon[34704]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T06:34:53.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:52 smithi098 ceph-mon[34704]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T06:34:53.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:52 smithi098 ceph-mon[34704]: pgmap v262: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-21T06:34:53.212 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:52 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2260242541' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:34:53.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:52 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] up:active 2024-09-21T06:34:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:52 smithi049 ceph-mon[31177]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:34:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:52 smithi049 ceph-mon[31177]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:34:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:52 smithi049 ceph-mon[31177]: Cluster is now healthy 2024-09-21T06:34:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:52 smithi049 ceph-mon[31177]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:34:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:52 smithi049 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T06:34:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:52 smithi049 ceph-mon[31177]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T06:34:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:52 smithi049 ceph-mon[31177]: pgmap v262: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-21T06:34:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:52 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2260242541' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:34:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:52 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] up:active 2024-09-21T06:34:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:52 smithi079 ceph-mon[34346]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:34:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:52 smithi079 ceph-mon[34346]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:34:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:52 smithi079 ceph-mon[34346]: Cluster is now healthy 2024-09-21T06:34:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:52 smithi079 ceph-mon[34346]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:34:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:52 smithi079 ceph-mon[34346]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-21T06:34:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:52 smithi079 ceph-mon[34346]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-21T06:34:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:52 smithi079 ceph-mon[34346]: pgmap v262: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-21T06:34:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:52 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2260242541' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:34:53.615 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T06:34:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:53.964 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:53 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T06:34:53.618+0000 7f26bd9b9640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T06:34:53.964 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:34:53 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T06:34:53.618+0000 7f26bd9b9640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T06:34:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:53 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2260242541' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:34:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:53 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] up:active 2024-09-21T06:34:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:53 smithi049 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T06:34:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:53 smithi049 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:54.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:53 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2260242541' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:34:54.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:53 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] up:active 2024-09-21T06:34:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:53 smithi098 ceph-mon[34704]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T06:34:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:53 smithi098 ceph-mon[34704]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:53 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2260242541' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:34:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:53 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] up:active 2024-09-21T06:34:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:53 smithi079 ceph-mon[34346]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-21T06:34:54.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:53 smithi079 ceph-mon[34346]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:54.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.405+0000 7f25e725a640 1 -- 172.21.15.49:0/110401585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 msgr2=0x7f25e010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.405+0000 7f25e725a640 1 --2- 172.21.15.49:0/110401585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 0x7f25e010f520 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009ca0 tx=0x7f25d802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.405+0000 7f25e725a640 1 -- 172.21.15.49:0/110401585 shutdown_connections 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.405+0000 7f25e725a640 1 --2- 172.21.15.49:0/110401585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 0x7f25e010f520 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.405+0000 7f25e725a640 1 --2- 172.21.15.49:0/110401585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e01083a0 0x7f25e01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.405+0000 7f25e725a640 1 --2- 172.21.15.49:0/110401585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e0102a60 0x7f25e0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.405+0000 7f25e725a640 1 -- 172.21.15.49:0/110401585 >> 172.21.15.49:0/110401585 conn(0x7f25e0079730 msgr2=0x7f25e0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.405+0000 7f25e725a640 1 -- 172.21.15.49:0/110401585 shutdown_connections 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.405+0000 7f25e725a640 1 -- 172.21.15.49:0/110401585 wait complete. 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e725a640 1 Processor -- start 2024-09-21T06:34:54.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e725a640 1 -- start start 2024-09-21T06:34:54.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e725a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e0102a60 0x7f25e019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e725a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e01083a0 0x7f25e019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e725a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 0x7f25e019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e725a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0112960 con 0x7f25e0108cf0 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e725a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25e01127e0 con 0x7f25e0102a60 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e725a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f25e0112ae0 con 0x7f25e01083a0 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e57f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 0x7f25e019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e57f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 0x7f25e019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51280/0 (socket says 172.21.15.49:51280) 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e57f7640 1 -- 172.21.15.49:0/2967603705 learned_addr learned my addr 172.21.15.49:0/2967603705 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.406+0000 7f25e4ff6640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e0102a60 0x7f25e019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25dffff640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e01083a0 0x7f25e019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25e57f7640 1 -- 172.21.15.49:0/2967603705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e01083a0 msgr2=0x7f25e019b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25e57f7640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e01083a0 0x7f25e019b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25e57f7640 1 -- 172.21.15.49:0/2967603705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e0102a60 msgr2=0x7f25e019b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25e57f7640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e0102a60 0x7f25e019b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25e57f7640 1 -- 172.21.15.49:0/2967603705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e01a6550 con 0x7f25e0108cf0 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25e57f7640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 0x7f25e019bd10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f25d8005cc0 tx=0x7f25d802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25ddffb640 1 -- 172.21.15.49:0/2967603705 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d8003bf0 con 0x7f25e0108cf0 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25ddffb640 1 -- 172.21.15.49:0/2967603705 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25d8003d90 con 0x7f25e0108cf0 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e01a67e0 con 0x7f25e0108cf0 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25ddffb640 1 -- 172.21.15.49:0/2967603705 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d802fbc0 con 0x7f25e0108cf0 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.407+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01a6d20 con 0x7f25e0108cf0 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.409+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e0102e70 con 0x7f25e0108cf0 2024-09-21T06:34:54.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.410+0000 7f25ddffb640 1 -- 172.21.15.49:0/2967603705 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f25d8004610 con 0x7f25e0108cf0 2024-09-21T06:34:54.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.411+0000 7f25ddffb640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25c80b6560 0x7f25c80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:54.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.411+0000 7f25e4ff6640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25c80b6560 0x7f25c80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:54.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.411+0000 7f25ddffb640 1 -- 172.21.15.49:0/2967603705 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f25d8108600 con 0x7f25e0108cf0 2024-09-21T06:34:54.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.411+0000 7f25e4ff6640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25c80b6560 0x7f25c80b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f25d00058c0 tx=0x7f25d000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:54.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.415+0000 7f25ddffb640 1 -- 172.21.15.49:0/2967603705 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25d80ceeb0 con 0x7f25e0108cf0 2024-09-21T06:34:54.646 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.644+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f25e002e640 con 0x7f25e0108cf0 2024-09-21T06:34:54.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.967+0000 7f25ddffb640 1 -- 172.21.15.49:0/2967603705 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f25d80098b0 con 0x7f25e0108cf0 2024-09-21T06:34:54.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25c80b6560 msgr2=0x7f25c80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25c80b6560 0x7f25c80b8a70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f25d00058c0 tx=0x7f25d000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 msgr2=0x7f25e019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 0x7f25e019bd10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f25d8005cc0 tx=0x7f25d802f380 comp rx=0 tx=0).stop 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 shutdown_connections 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25c80b6560 0x7f25c80b8a70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f25e0108cf0 0x7f25e019bd10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25e01083a0 0x7f25e019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 --2- 172.21.15.49:0/2967603705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f25e0102a60 0x7f25e019b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 >> 172.21.15.49:0/2967603705 conn(0x7f25e0079730 msgr2=0x7f25e0104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 shutdown_connections 2024-09-21T06:34:54.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:54.970+0000 7f25e725a640 1 -- 172.21.15.49:0/2967603705 wait complete. 2024-09-21T06:34:55.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:54 smithi049 ceph-mon[31177]: pgmap v263: 97 pgs: 97 active+clean; 580 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T06:34:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:54 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2967603705' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:34:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:54 smithi098 ceph-mon[34704]: pgmap v263: 97 pgs: 97 active+clean; 580 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T06:34:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:54 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2967603705' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:34:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:54 smithi079 ceph-mon[34346]: pgmap v263: 97 pgs: 97 active+clean; 580 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-09-21T06:34:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:54 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2967603705' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:34:55.554 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-21T06:34:55.554 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T06:34:55.818 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:56.190 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:55 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2967603705' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:34:56.190 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:55 smithi049 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:56.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:55 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2967603705' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:34:56.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:55 smithi079 ceph-mon[34346]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.284+0000 7fa57265e640 1 -- 172.21.15.49:0/2616981448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c109df0 msgr2=0x7fa56c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.284+0000 7fa57265e640 1 --2- 172.21.15.49:0/2616981448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c109df0 0x7fa56c110620 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa564009ca0 tx=0x7fa56402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.284+0000 7fa57265e640 1 -- 172.21.15.49:0/2616981448 shutdown_connections 2024-09-21T06:34:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.284+0000 7fa57265e640 1 --2- 172.21.15.49:0/2616981448 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c109df0 0x7fa56c110620 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.284+0000 7fa57265e640 1 --2- 172.21.15.49:0/2616981448 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c1094a0 0x7fa56c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.284+0000 7fa57265e640 1 --2- 172.21.15.49:0/2616981448 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa56c103b60 0x7fa56c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.284+0000 7fa57265e640 1 -- 172.21.15.49:0/2616981448 >> 172.21.15.49:0/2616981448 conn(0x7fa56c07b850 msgr2=0x7fa56c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.284+0000 7fa57265e640 1 -- 172.21.15.49:0/2616981448 shutdown_connections 2024-09-21T06:34:56.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.284+0000 7fa57265e640 1 -- 172.21.15.49:0/2616981448 wait complete. 2024-09-21T06:34:56.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.285+0000 7fa57265e640 1 Processor -- start 2024-09-21T06:34:56.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.285+0000 7fa57265e640 1 -- start start 2024-09-21T06:34:56.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.285+0000 7fa57265e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa56c103b60 0x7fa56c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:56.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.285+0000 7fa57265e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c1094a0 0x7fa56c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.285+0000 7fa57265e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c109df0 0x7fa56c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.285+0000 7fa57265e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c113ab0 con 0x7fa56c1094a0 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.285+0000 7fa57265e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c113930 con 0x7fa56c109df0 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.285+0000 7fa57265e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa56c113c30 con 0x7fa56c103b60 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c1094a0 0x7fa56c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c1094a0 0x7fa56c19a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47592/0 (socket says 172.21.15.49:47592) 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56b7fe640 1 -- 172.21.15.49:0/2372495787 learned_addr learned my addr 172.21.15.49:0/2372495787 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa570bfb640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c109df0 0x7fa56c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56bfff640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa56c103b60 0x7fa56c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56b7fe640 1 -- 172.21.15.49:0/2372495787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa56c103b60 msgr2=0x7fa56c19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56b7fe640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa56c103b60 0x7fa56c19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56b7fe640 1 -- 172.21.15.49:0/2372495787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c109df0 msgr2=0x7fa56c19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56b7fe640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c109df0 0x7fa56c19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56b7fe640 1 -- 172.21.15.49:0/2372495787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56c1a0270 con 0x7fa56c1094a0 2024-09-21T06:34:56.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa570bfb640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c109df0 0x7fa56c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:56.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56bfff640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa56c103b60 0x7fa56c19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:56.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa56b7fe640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c1094a0 0x7fa56c19a960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c8c0 tx=0x7fa56000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:56.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa5697fa640 1 -- 172.21.15.49:0/2372495787 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa560007bb0 con 0x7fa56c1094a0 2024-09-21T06:34:56.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56c1a0560 con 0x7fa56c1094a0 2024-09-21T06:34:56.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa5697fa640 1 -- 172.21.15.49:0/2372495787 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa560007d50 con 0x7fa56c1094a0 2024-09-21T06:34:56.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa5697fa640 1 -- 172.21.15.49:0/2372495787 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5600187c0 con 0x7fa56c1094a0 2024-09-21T06:34:56.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.286+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56c1a6d80 con 0x7fa56c1094a0 2024-09-21T06:34:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.287+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa56c103f70 con 0x7fa56c1094a0 2024-09-21T06:34:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.289+0000 7fa5697fa640 1 -- 172.21.15.49:0/2372495787 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7fa56000fa20 con 0x7fa56c1094a0 2024-09-21T06:34:56.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.290+0000 7fa5697fa640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa5540b6590 0x7fa5540b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.290+0000 7fa56bfff640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa5540b6590 0x7fa5540b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.290+0000 7fa5697fa640 1 -- 172.21.15.49:0/2372495787 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7fa5600e7720 con 0x7fa56c1094a0 2024-09-21T06:34:56.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.290+0000 7fa56bfff640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa5540b6590 0x7fa5540b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00abe0 tx=0x7fa55c00a5c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:56.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.293+0000 7fa5697fa640 1 -- 172.21.15.49:0/2372495787 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa560014030 con 0x7fa56c1094a0 2024-09-21T06:34:56.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:55 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2967603705' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:34:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:55 smithi098 ceph-mon[34704]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:56.507 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.505+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa56c063800 con 0x7fa5540b6590 2024-09-21T06:34:56.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.532+0000 7fa5697fa640 1 -- 172.21.15.49:0/2372495787 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa56c063800 con 0x7fa5540b6590 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa5540b6590 msgr2=0x7fa5540b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa5540b6590 0x7fa5540b8aa0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00abe0 tx=0x7fa55c00a5c0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c1094a0 msgr2=0x7fa56c19a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c1094a0 0x7fa56c19a960 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c8c0 tx=0x7fa56000cd80 comp rx=0 tx=0).stop 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 shutdown_connections 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa5540b6590 0x7fa5540b8aa0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa56c109df0 0x7fa56c19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa56c1094a0 0x7fa56c19a960 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 --2- 172.21.15.49:0/2372495787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa56c103b60 0x7fa56c19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 >> 172.21.15.49:0/2372495787 conn(0x7fa56c07b850 msgr2=0x7fa56c105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:56.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 shutdown_connections 2024-09-21T06:34:56.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:56.534+0000 7fa57265e640 1 -- 172.21.15.49:0/2372495787 wait complete. 2024-09-21T06:34:56.948 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:34:56 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:34:56.511+0000 7f3988c1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:56.949 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:34:56 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:34:56.511+0000 7f3988c1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:56.949 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:34:56 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:34:56.511+0000 7f3988c1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:56.949 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:34:56 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:34:56.511+0000 7f3988c1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:56.949 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:34:56 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:34:56.511+0000 7f3988c1d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:57.183 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T06:34:57.207 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:56 smithi049 ceph-mon[31177]: pgmap v264: 97 pgs: 97 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 2.3 KiB/s wr, 9 op/s 2024-09-21T06:34:57.207 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:56 smithi049 ceph-mon[31177]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:57.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:56 smithi098 ceph-mon[34704]: pgmap v264: 97 pgs: 97 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 2.3 KiB/s wr, 9 op/s 2024-09-21T06:34:57.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:56 smithi098 ceph-mon[34704]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:57.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:56 smithi079 ceph-mon[34346]: pgmap v264: 97 pgs: 97 active+clean; 581 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 2.3 KiB/s wr, 9 op/s 2024-09-21T06:34:57.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:56 smithi079 ceph-mon[34346]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:57.443 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.908+0000 7f85530a8640 1 -- 172.21.15.49:0/2418341164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 msgr2=0x7f854c1026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.908+0000 7f85530a8640 1 --2- 172.21.15.49:0/2418341164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 0x7f854c1026a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8540009900 tx=0x7f854002a410 comp rx=0 tx=0).stop 2024-09-21T06:34:57.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.909+0000 7f85530a8640 1 -- 172.21.15.49:0/2418341164 shutdown_connections 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.909+0000 7f85530a8640 1 --2- 172.21.15.49:0/2418341164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c108520 0x7f854c10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.909+0000 7f85530a8640 1 --2- 172.21.15.49:0/2418341164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f854c107bd0 0x7f854c107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.909+0000 7f85530a8640 1 --2- 172.21.15.49:0/2418341164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 0x7f854c1026a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.909+0000 7f85530a8640 1 -- 172.21.15.49:0/2418341164 >> 172.21.15.49:0/2418341164 conn(0x7f854c079ea0 msgr2=0x7f854c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.909+0000 7f85530a8640 1 -- 172.21.15.49:0/2418341164 shutdown_connections 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.909+0000 7f85530a8640 1 -- 172.21.15.49:0/2418341164 wait complete. 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.909+0000 7f85530a8640 1 Processor -- start 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f85530a8640 1 -- start start 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f85530a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 0x7f854c199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f85530a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c107bd0 0x7f854c19a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f85530a8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f854c108520 0x7f854c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f85530a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f854c1121f0 con 0x7f854c102290 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f85530a8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f854c112070 con 0x7f854c107bd0 2024-09-21T06:34:57.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f85530a8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f854c112370 con 0x7f854c108520 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f8550e44640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 0x7f854c199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f8550e44640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 0x7f854c199c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47630/0 (socket says 172.21.15.49:47630) 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f8550e44640 1 -- 172.21.15.49:0/193430621 learned_addr learned my addr 172.21.15.49:0/193430621 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f854bfff640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c107bd0 0x7f854c19a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f8551645640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f854c108520 0x7f854c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f8550e44640 1 -- 172.21.15.49:0/193430621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f854c108520 msgr2=0x7f854c19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f8550e44640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f854c108520 0x7f854c19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f8550e44640 1 -- 172.21.15.49:0/193430621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c107bd0 msgr2=0x7f854c19a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f8550e44640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c107bd0 0x7f854c19a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f8550e44640 1 -- 172.21.15.49:0/193430621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c19d220 con 0x7f854c102290 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.910+0000 7f854bfff640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c107bd0 0x7f854c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.911+0000 7f8550e44640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 0x7f854c199c70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8540006010 tx=0x7f85400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:57.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.911+0000 7f8549ffb640 1 -- 172.21.15.49:0/193430621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f854003f030 con 0x7f854c102290 2024-09-21T06:34:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.911+0000 7f8549ffb640 1 -- 172.21.15.49:0/193430621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8540003800 con 0x7f854c102290 2024-09-21T06:34:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.911+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c19d4b0 con 0x7f854c102290 2024-09-21T06:34:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.911+0000 7f8549ffb640 1 -- 172.21.15.49:0/193430621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540035070 con 0x7f854c102290 2024-09-21T06:34:57.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.911+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c19d990 con 0x7f854c102290 2024-09-21T06:34:57.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.912+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c1026a0 con 0x7f854c102290 2024-09-21T06:34:57.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.914+0000 7f8549ffb640 1 -- 172.21.15.49:0/193430621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 20) ==== 154529+0+0 (secure 0 0 0) 0x7f8540003cb0 con 0x7f854c102290 2024-09-21T06:34:57.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.915+0000 7f8549ffb640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f853c0b6590 0x7f853c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:57.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.915+0000 7f854bfff640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f853c0b6590 0x7f853c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:57.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.915+0000 7f8549ffb640 1 -- 172.21.15.49:0/193430621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f8540107f40 con 0x7f854c102290 2024-09-21T06:34:57.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.915+0000 7f854bfff640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f853c0b6590 0x7f853c0b8aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8538005fd0 tx=0x7f8538005ea0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:57.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:57.918+0000 7f8549ffb640 1 -- 172.21.15.49:0/193430621 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f85400ce7f0 con 0x7f854c102290 2024-09-21T06:34:58.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.136+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f854c10a2d0 con 0x7f853c0b6590 2024-09-21T06:34:58.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.162+0000 7f8549ffb640 1 -- 172.21.15.49:0/193430621 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f854c10a2d0 con 0x7f853c0b6590 2024-09-21T06:34:58.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f853c0b6590 msgr2=0x7f853c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f853c0b6590 0x7f853c0b8aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8538005fd0 tx=0x7f8538005ea0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 msgr2=0x7f854c199c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 0x7f854c199c70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8540006010 tx=0x7f85400042f0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 shutdown_connections 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f853c0b6590 0x7f853c0b8aa0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f854c108520 0x7f854c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f854c107bd0 0x7f854c19a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 --2- 172.21.15.49:0/193430621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f854c102290 0x7f854c199c70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 >> 172.21.15.49:0/193430621 conn(0x7f854c079ea0 msgr2=0x7f854c105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 shutdown_connections 2024-09-21T06:34:58.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:58.164+0000 7f85530a8640 1 -- 172.21.15.49:0/193430621 wait complete. 2024-09-21T06:34:58.816 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T06:34:59.120 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:59.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:59 smithi049 ceph-mon[31177]: pgmap v265: 97 pgs: 97 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-09-21T06:34:59.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:34:59 smithi049 ceph-mon[31177]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:59.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:59 smithi098 ceph-mon[34704]: pgmap v265: 97 pgs: 97 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-09-21T06:34:59.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:34:59 smithi098 ceph-mon[34704]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:59.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:59 smithi079 ceph-mon[34346]: pgmap v265: 97 pgs: 97 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-09-21T06:34:59.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:34:59 smithi079 ceph-mon[34346]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.610+0000 7f1977b8b640 1 -- 172.21.15.49:0/2041459324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701052d0 msgr2=0x7f197010d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.610+0000 7f1977b8b640 1 --2- 172.21.15.49:0/2041459324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701052d0 0x7f197010d910 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1960009900 tx=0x7f196002a410 comp rx=0 tx=0).stop 2024-09-21T06:34:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.610+0000 7f1977b8b640 1 -- 172.21.15.49:0/2041459324 shutdown_connections 2024-09-21T06:34:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.610+0000 7f1977b8b640 1 --2- 172.21.15.49:0/2041459324 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f197010de50 0x7f1970110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.610+0000 7f1977b8b640 1 --2- 172.21.15.49:0/2041459324 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701052d0 0x7f197010d910 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.610+0000 7f1977b8b640 1 --2- 172.21.15.49:0/2041459324 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19701048a0 0x7f1970104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.610+0000 7f1977b8b640 1 -- 172.21.15.49:0/2041459324 >> 172.21.15.49:0/2041459324 conn(0x7f1970079740 msgr2=0x7f1970079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.610+0000 7f1977b8b640 1 -- 172.21.15.49:0/2041459324 shutdown_connections 2024-09-21T06:34:59.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.610+0000 7f1977b8b640 1 -- 172.21.15.49:0/2041459324 wait complete. 2024-09-21T06:34:59.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.611+0000 7f1977b8b640 1 Processor -- start 2024-09-21T06:34:59.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.611+0000 7f1977b8b640 1 -- start start 2024-09-21T06:34:59.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1977b8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701048a0 0x7f197019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:59.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1977b8b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19701052d0 0x7f197019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1977b8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f197010de50 0x7f197019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1977b8b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1970113a90 con 0x7f19701048a0 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1977b8b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1970113910 con 0x7f197010de50 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1977b8b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1970113c10 con 0x7f19701052d0 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975927640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701048a0 0x7f197019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975927640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701048a0 0x7f197019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47646/0 (socket says 172.21.15.49:47646) 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975927640 1 -- 172.21.15.49:0/4230193775 learned_addr learned my addr 172.21.15.49:0/4230193775 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975126640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19701052d0 0x7f197019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1976128640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f197010de50 0x7f197019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975927640 1 -- 172.21.15.49:0/4230193775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19701052d0 msgr2=0x7f197019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975927640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19701052d0 0x7f197019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975927640 1 -- 172.21.15.49:0/4230193775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f197010de50 msgr2=0x7f197019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975927640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f197010de50 0x7f197019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975927640 1 -- 172.21.15.49:0/4230193775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19701a04b0 con 0x7f19701048a0 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.612+0000 7f1975927640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701048a0 0x7f197019a540 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f196c00e9c0 tx=0x7f196c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:59.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.613+0000 7f1966ffd640 1 -- 172.21.15.49:0/4230193775 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c00cd80 con 0x7f19701048a0 2024-09-21T06:34:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.613+0000 7f1966ffd640 1 -- 172.21.15.49:0/4230193775 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f196c0035f0 con 0x7f19701048a0 2024-09-21T06:34:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.613+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19701a07a0 con 0x7f19701048a0 2024-09-21T06:34:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.613+0000 7f1966ffd640 1 -- 172.21.15.49:0/4230193775 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196c010690 con 0x7f19701048a0 2024-09-21T06:34:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.613+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19701a6f00 con 0x7f19701048a0 2024-09-21T06:34:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.614+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f197006c1a0 con 0x7f19701048a0 2024-09-21T06:34:59.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.615+0000 7f1966ffd640 1 -- 172.21.15.49:0/4230193775 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f196c004000 con 0x7f19701048a0 2024-09-21T06:34:59.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.616+0000 7f1966ffd640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f195c0b6670 0x7f195c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:59.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.616+0000 7f1975126640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f195c0b6670 0x7f195c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:59.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.616+0000 7f1966ffd640 1 -- 172.21.15.49:0/4230193775 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f196c0e7950 con 0x7f19701048a0 2024-09-21T06:34:59.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.617+0000 7f1975126640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f195c0b6670 0x7f195c0b8b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1960000c00 tx=0x7f1960031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:59.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.620+0000 7f1966ffd640 1 -- 172.21.15.49:0/4230193775 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f196c0ae0a0 con 0x7f19701048a0 2024-09-21T06:34:59.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.837+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f1970108ff0 con 0x7f195c0b6670 2024-09-21T06:34:59.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.842+0000 7f1966ffd640 1 -- 172.21.15.49:0/4230193775 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1960032d10 con 0x7f195c0b6670 2024-09-21T06:34:59.844 INFO:teuthology.orchestra.run.smithi049.stdout:/volumes/qa/sv_0/db9f4f6b-7739-426c-9361-470afc664169 2024-09-21T06:34:59.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f195c0b6670 msgr2=0x7f195c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:59.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f195c0b6670 0x7f195c0b8b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1960000c00 tx=0x7f1960031400 comp rx=0 tx=0).stop 2024-09-21T06:34:59.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701048a0 msgr2=0x7f197019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:59.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701048a0 0x7f197019a540 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f196c00e9c0 tx=0x7f196c00ee80 comp rx=0 tx=0).stop 2024-09-21T06:34:59.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 shutdown_connections 2024-09-21T06:34:59.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f195c0b6670 0x7f195c0b8b80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:59.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f197010de50 0x7f197019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:59.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19701052d0 0x7f197019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:59.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 --2- 172.21.15.49:0/4230193775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19701048a0 0x7f197019a540 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:59.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 >> 172.21.15.49:0/4230193775 conn(0x7f1970079740 msgr2=0x7f1970100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:59.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 shutdown_connections 2024-09-21T06:34:59.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:34:59.844+0000 7f1977b8b640 1 -- 172.21.15.49:0/4230193775 wait complete. 2024-09-21T06:35:00.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:00 smithi049 ceph-mon[31177]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-21T06:35:00.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:00 smithi049 ceph-mon[31177]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:00.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:00 smithi098 ceph-mon[34704]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-21T06:35:00.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:00 smithi098 ceph-mon[34704]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:00.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T06:35:00.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:00 smithi079 ceph-mon[34346]: mgrmap e21: x(active, since 6m), standbys: z, y 2024-09-21T06:35:00.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:00 smithi079 ceph-mon[34346]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:00.808 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.260+0000 7fe082b11640 1 -- 172.21.15.49:0/2225440663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c1083f0 msgr2=0x7fe07c108800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.260+0000 7fe082b11640 1 --2- 172.21.15.49:0/2225440663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c1083f0 0x7fe07c108800 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe064009900 tx=0x7fe06402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.260+0000 7fe082b11640 1 -- 172.21.15.49:0/2225440663 shutdown_connections 2024-09-21T06:35:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.260+0000 7fe082b11640 1 --2- 172.21.15.49:0/2225440663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe07c108d40 0x7fe07c10f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.260+0000 7fe082b11640 1 --2- 172.21.15.49:0/2225440663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c1083f0 0x7fe07c108800 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.260+0000 7fe082b11640 1 --2- 172.21.15.49:0/2225440663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe07c102ab0 0x7fe07c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.260+0000 7fe082b11640 1 -- 172.21.15.49:0/2225440663 >> 172.21.15.49:0/2225440663 conn(0x7fe07c0797c0 msgr2=0x7fe07c079bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.260+0000 7fe082b11640 1 -- 172.21.15.49:0/2225440663 shutdown_connections 2024-09-21T06:35:01.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.260+0000 7fe082b11640 1 -- 172.21.15.49:0/2225440663 wait complete. 2024-09-21T06:35:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe082b11640 1 Processor -- start 2024-09-21T06:35:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe082b11640 1 -- start start 2024-09-21T06:35:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe082b11640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe07c102ab0 0x7fe07c0ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe082b11640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe07c1083f0 0x7fe07c0ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:01.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe082b11640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c108d40 0x7fe07c100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe082b11640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c112aa0 con 0x7fe07c108d40 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe082b11640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c112920 con 0x7fe07c102ab0 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe082b11640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c112c20 con 0x7fe07c1083f0 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0810ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c108d40 0x7fe07c100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0810ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c108d40 0x7fe07c100070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47664/0 (socket says 172.21.15.49:47664) 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0810ae640 1 -- 172.21.15.49:0/1986910700 learned_addr learned my addr 172.21.15.49:0/1986910700 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0808ad640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe07c102ab0 0x7fe07c0ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe07bfff640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe07c1083f0 0x7fe07c0ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0810ae640 1 -- 172.21.15.49:0/1986910700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe07c1083f0 msgr2=0x7fe07c0ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0810ae640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe07c1083f0 0x7fe07c0ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0810ae640 1 -- 172.21.15.49:0/1986910700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe07c102ab0 msgr2=0x7fe07c0ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0810ae640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe07c102ab0 0x7fe07c0ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0810ae640 1 -- 172.21.15.49:0/1986910700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c1a8940 con 0x7fe07c108d40 2024-09-21T06:35:01.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe0808ad640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe07c102ab0 0x7fe07c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.261+0000 7fe07bfff640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe07c1083f0 0x7fe07c0ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.262+0000 7fe0810ae640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c108d40 0x7fe07c100070 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe074009fd0 tx=0x7fe07400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.262+0000 7fe079ffb640 1 -- 172.21.15.49:0/1986910700 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074011830 con 0x7fe07c108d40 2024-09-21T06:35:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.262+0000 7fe079ffb640 1 -- 172.21.15.49:0/1986910700 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe074016070 con 0x7fe07c108d40 2024-09-21T06:35:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.262+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c1a8c30 con 0x7fe07c108d40 2024-09-21T06:35:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.262+0000 7fe079ffb640 1 -- 172.21.15.49:0/1986910700 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074010de0 con 0x7fe07c108d40 2024-09-21T06:35:01.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.262+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c1a9120 con 0x7fe07c108d40 2024-09-21T06:35:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.263+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c103d30 con 0x7fe07c108d40 2024-09-21T06:35:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.264+0000 7fe079ffb640 1 -- 172.21.15.49:0/1986910700 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fe0740119d0 con 0x7fe07c108d40 2024-09-21T06:35:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.265+0000 7fe079ffb640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe0680b65f0 0x7fe0680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.265+0000 7fe0808ad640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe0680b65f0 0x7fe0680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.265+0000 7fe079ffb640 1 -- 172.21.15.49:0/1986910700 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7fe0740e6b90 con 0x7fe07c108d40 2024-09-21T06:35:01.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.266+0000 7fe0808ad640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe0680b65f0 0x7fe0680b8b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe07c101040 tx=0x7fe06c009570 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:01.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.270+0000 7fe079ffb640 1 -- 172.21.15.49:0/1986910700 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe0740ad2e0 con 0x7fe07c108d40 2024-09-21T06:35:01.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:01 smithi049 ceph-mon[31177]: pgmap v266: 97 pgs: 97 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-21T06:35:01.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.485+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe07c063800 con 0x7fe0680b65f0 2024-09-21T06:35:01.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.512+0000 7fe079ffb640 1 -- 172.21.15.49:0/1986910700 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe07c063800 con 0x7fe0680b65f0 2024-09-21T06:35:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe0680b65f0 msgr2=0x7fe0680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe0680b65f0 0x7fe0680b8b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe07c101040 tx=0x7fe06c009570 comp rx=0 tx=0).stop 2024-09-21T06:35:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c108d40 msgr2=0x7fe07c100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c108d40 0x7fe07c100070 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe074009fd0 tx=0x7fe07400b8e0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 shutdown_connections 2024-09-21T06:35:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe0680b65f0 0x7fe0680b8b00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe07c108d40 0x7fe07c100070 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe07c1083f0 0x7fe07c0ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 --2- 172.21.15.49:0/1986910700 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe07c102ab0 0x7fe07c0ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.514+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 >> 172.21.15.49:0/1986910700 conn(0x7fe07c0797c0 msgr2=0x7fe07c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.515+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 shutdown_connections 2024-09-21T06:35:01.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:01.515+0000 7fe082b11640 1 -- 172.21.15.49:0/1986910700 wait complete. 2024-09-21T06:35:01.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:01 smithi098 ceph-mon[34704]: pgmap v266: 97 pgs: 97 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-21T06:35:01.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:01 smithi079 ceph-mon[34346]: pgmap v266: 97 pgs: 97 active+clean; 582 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-09-21T06:35:02.075 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T06:35:02.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:02 smithi049 ceph-mon[31177]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:02.334 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:02.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:02 smithi098 ceph-mon[34704]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:02.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:02 smithi079 ceph-mon[34346]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.818+0000 7f4ffaebf640 1 -- 172.21.15.49:0/3791946464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff41083a0 msgr2=0x7f4ff41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.818+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/3791946464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff41083a0 0x7f4ff41087b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009ca0 tx=0x7f4fe402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.818+0000 7f4ffaebf640 1 -- 172.21.15.49:0/3791946464 shutdown_connections 2024-09-21T06:35:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.818+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/3791946464 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff4108cf0 0x7f4ff410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.818+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/3791946464 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff41083a0 0x7f4ff41087b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:02.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.818+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/3791946464 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ff4102a60 0x7f4ff4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.818+0000 7f4ffaebf640 1 -- 172.21.15.49:0/3791946464 >> 172.21.15.49:0/3791946464 conn(0x7f4ff4079730 msgr2=0x7f4ff4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.818+0000 7f4ffaebf640 1 -- 172.21.15.49:0/3791946464 shutdown_connections 2024-09-21T06:35:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.818+0000 7f4ffaebf640 1 -- 172.21.15.49:0/3791946464 wait complete. 2024-09-21T06:35:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.819+0000 7f4ffaebf640 1 Processor -- start 2024-09-21T06:35:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.819+0000 7f4ffaebf640 1 -- start start 2024-09-21T06:35:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.819+0000 7f4ffaebf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff4102a60 0x7f4ff40ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.819+0000 7f4ffaebf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ff41083a0 0x7f4ff40ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.819+0000 7f4ffaebf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff4108cf0 0x7f4ff41000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:02.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.819+0000 7f4ffaebf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4112960 con 0x7f4ff4102a60 2024-09-21T06:35:02.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.819+0000 7f4ffaebf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff41127e0 con 0x7f4ff41083a0 2024-09-21T06:35:02.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.819+0000 7f4ffaebf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff4112ae0 con 0x7f4ff4108cf0 2024-09-21T06:35:02.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.819+0000 7f4ff8c5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff4102a60 0x7f4ff40ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:02.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff8c5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff4102a60 0x7f4ff40ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47690/0 (socket says 172.21.15.49:47690) 2024-09-21T06:35:02.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff8c5b640 1 -- 172.21.15.49:0/2407294258 learned_addr learned my addr 172.21.15.49:0/2407294258 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:02.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff3fff640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ff41083a0 0x7f4ff40ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff945c640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff4108cf0 0x7f4ff41000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff8c5b640 1 -- 172.21.15.49:0/2407294258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff4108cf0 msgr2=0x7f4ff41000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff8c5b640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff4108cf0 0x7f4ff41000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:02.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff8c5b640 1 -- 172.21.15.49:0/2407294258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ff41083a0 msgr2=0x7f4ff40ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff8c5b640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ff41083a0 0x7f4ff40ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff8c5b640 1 -- 172.21.15.49:0/2407294258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff41a87c0 con 0x7f4ff4102a60 2024-09-21T06:35:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff8c5b640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff4102a60 0x7f4ff40ff670 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00d950 tx=0x7f4fdc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff1ffb640 1 -- 172.21.15.49:0/2407294258 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc017070 con 0x7f4ff4102a60 2024-09-21T06:35:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff1ffb640 1 -- 172.21.15.49:0/2407294258 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fdc009c30 con 0x7f4ff4102a60 2024-09-21T06:35:02.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ff1ffb640 1 -- 172.21.15.49:0/2407294258 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00f620 con 0x7f4ff4102a60 2024-09-21T06:35:02.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.820+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff41a8ab0 con 0x7f4ff4102a60 2024-09-21T06:35:02.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.821+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff41a8f70 con 0x7f4ff4102a60 2024-09-21T06:35:02.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.822+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff4102e70 con 0x7f4ff4102a60 2024-09-21T06:35:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.823+0000 7f4ff1ffb640 1 -- 172.21.15.49:0/2407294258 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f4fdc010460 con 0x7f4ff4102a60 2024-09-21T06:35:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.824+0000 7f4ff1ffb640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4fe00b6670 0x7f4fe00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.824+0000 7f4ff3fff640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4fe00b6670 0x7f4fe00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.824+0000 7f4ff1ffb640 1 -- 172.21.15.49:0/2407294258 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f4fdc0e70c0 con 0x7f4ff4102a60 2024-09-21T06:35:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.825+0000 7f4ff3fff640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4fe00b6670 0x7f4fe00b8b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4005e30 tx=0x7f4fe4009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:02.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:02.827+0000 7f4ff1ffb640 1 -- 172.21.15.49:0/2407294258 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4fdc0ad890 con 0x7f4ff4102a60 2024-09-21T06:35:03.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.044+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f4ff4104130 con 0x7f4fe00b6670 2024-09-21T06:35:03.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.049+0000 7f4ff1ffb640 1 -- 172.21.15.49:0/2407294258 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f4ff4104130 con 0x7f4fe00b6670 2024-09-21T06:35:03.052 INFO:teuthology.orchestra.run.smithi049.stdout:/volumes/qa/sv_1/2e65a34b-3b13-4412-8f21-6f1c5a1359aa 2024-09-21T06:35:03.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4fe00b6670 msgr2=0x7f4fe00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4fe00b6670 0x7f4fe00b8b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4005e30 tx=0x7f4fe4009360 comp rx=0 tx=0).stop 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff4102a60 msgr2=0x7f4ff40ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff4102a60 0x7f4ff40ff670 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00d950 tx=0x7f4fdc00de10 comp rx=0 tx=0).stop 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 shutdown_connections 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4fe00b6670 0x7f4fe00b8b80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ff4108cf0 0x7f4ff41000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ff41083a0 0x7f4ff40ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 --2- 172.21.15.49:0/2407294258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ff4102a60 0x7f4ff40ff670 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 >> 172.21.15.49:0/2407294258 conn(0x7f4ff4079730 msgr2=0x7f4ff4101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 shutdown_connections 2024-09-21T06:35:03.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:03.052+0000 7f4ffaebf640 1 -- 172.21.15.49:0/2407294258 wait complete. 2024-09-21T06:35:03.411 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:03 smithi049 ceph-mon[31177]: pgmap v267: 97 pgs: 97 active+clean; 609 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-21T06:35:03.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:03 smithi098 ceph-mon[34704]: pgmap v267: 97 pgs: 97 active+clean; 609 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-21T06:35:03.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:03 smithi079 ceph-mon[34346]: pgmap v267: 97 pgs: 97 active+clean; 609 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-09-21T06:35:03.706 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:03.966 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:04.394 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:04 smithi049 ceph-mon[31177]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:04.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.414+0000 7f6b44ce2640 1 -- 172.21.15.49:0/194771077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b401083d0 msgr2=0x7f6b401087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.414+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/194771077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b401083d0 0x7f6b401087e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6b34009ca0 tx=0x7f6b3402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.414+0000 7f6b44ce2640 1 -- 172.21.15.49:0/194771077 shutdown_connections 2024-09-21T06:35:04.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.414+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/194771077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b40108d20 0x7f6b4010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.414+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/194771077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b401083d0 0x7f6b401087e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.414+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/194771077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b40102ae0 0x7f6b40102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.414+0000 7f6b44ce2640 1 -- 172.21.15.49:0/194771077 >> 172.21.15.49:0/194771077 conn(0x7f6b40079760 msgr2=0x7f6b40079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.414+0000 7f6b44ce2640 1 -- 172.21.15.49:0/194771077 shutdown_connections 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.414+0000 7f6b44ce2640 1 -- 172.21.15.49:0/194771077 wait complete. 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.415+0000 7f6b44ce2640 1 Processor -- start 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.415+0000 7f6b44ce2640 1 -- start start 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b44ce2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b40102ae0 0x7f6b40199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b44ce2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b401083d0 0x7f6b401998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b44ce2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b40108d20 0x7f6b4019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b44ce2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40112990 con 0x7f6b40102ae0 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b44ce2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40112810 con 0x7f6b40108d20 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b44ce2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6b40112b10 con 0x7f6b401083d0 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b40102ae0 0x7f6b40199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b40102ae0 0x7f6b40199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47722/0 (socket says 172.21.15.49:47722) 2024-09-21T06:35:04.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3e59c640 1 -- 172.21.15.49:0/3059046365 learned_addr learned my addr 172.21.15.49:0/3059046365 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3dd9b640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b401083d0 0x7f6b401998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3ed9d640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b40108d20 0x7f6b4019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3e59c640 1 -- 172.21.15.49:0/3059046365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b401083d0 msgr2=0x7f6b401998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3e59c640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b401083d0 0x7f6b401998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3e59c640 1 -- 172.21.15.49:0/3059046365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b40108d20 msgr2=0x7f6b4019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3e59c640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b40108d20 0x7f6b4019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3e59c640 1 -- 172.21.15.49:0/3059046365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4019f1f0 con 0x7f6b40102ae0 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.416+0000 7f6b3e59c640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b40102ae0 0x7f6b40199340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c920 tx=0x7f6b3000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.417+0000 7f6b2f7fe640 1 -- 172.21.15.49:0/3059046365 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30007c70 con 0x7f6b40102ae0 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.417+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4019f4e0 con 0x7f6b40102ae0 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.417+0000 7f6b2f7fe640 1 -- 172.21.15.49:0/3059046365 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b30007e10 con 0x7f6b40102ae0 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.417+0000 7f6b2f7fe640 1 -- 172.21.15.49:0/3059046365 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b30018820 con 0x7f6b40102ae0 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.417+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b401a5d00 con 0x7f6b40102ae0 2024-09-21T06:35:04.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.418+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b40103d10 con 0x7f6b40102ae0 2024-09-21T06:35:04.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.419+0000 7f6b2f7fe640 1 -- 172.21.15.49:0/3059046365 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6b3000f450 con 0x7f6b40102ae0 2024-09-21T06:35:04.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.420+0000 7f6b2f7fe640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6b280b66a0 0x7f6b280b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.420+0000 7f6b3dd9b640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6b280b66a0 0x7f6b280b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.420+0000 7f6b2f7fe640 1 -- 172.21.15.49:0/3059046365 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f6b300e7770 con 0x7f6b40102ae0 2024-09-21T06:35:04.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.421+0000 7f6b3dd9b640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6b280b66a0 0x7f6b280b8bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b340098d0 tx=0x7f6b340093e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:04.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.423+0000 7f6b2f7fe640 1 -- 172.21.15.49:0/3059046365 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b30014030 con 0x7f6b40102ae0 2024-09-21T06:35:04.489 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:04 smithi098 ceph-mon[34704]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:04.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:04 smithi079 ceph-mon[34346]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:04.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.650+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b40102ef0 con 0x7f6b40102ae0 2024-09-21T06:35:04.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.651+0000 7f6b2f7fe640 1 -- 172.21.15.49:0/3059046365 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7f6b300adfd0 con 0x7f6b40102ae0 2024-09-21T06:35:04.654 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2024-09-21T06:35:04.655 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:04.655 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"btime":"2024-09-21T06:34:54:962997+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:34:54.645934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:35:04.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6b280b66a0 msgr2=0x7f6b280b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6b280b66a0 0x7f6b280b8bb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b340098d0 tx=0x7f6b340093e0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b40102ae0 msgr2=0x7f6b40199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b40102ae0 0x7f6b40199340 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000c920 tx=0x7f6b3000cde0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 shutdown_connections 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6b280b66a0 0x7f6b280b8bb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6b40108d20 0x7f6b4019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6b401083d0 0x7f6b401998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 --2- 172.21.15.49:0/3059046365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6b40102ae0 0x7f6b40199340 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 >> 172.21.15.49:0/3059046365 conn(0x7f6b40079760 msgr2=0x7f6b401043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 shutdown_connections 2024-09-21T06:35:04.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:04.654+0000 7f6b44ce2640 1 -- 172.21.15.49:0/3059046365 wait complete. 2024-09-21T06:35:05.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:05 smithi049 ceph-mon[31177]: pgmap v268: 97 pgs: 97 active+clean; 609 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T06:35:05.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:05 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3059046365' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:05.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:35:05.480 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:05.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:05 smithi098 ceph-mon[34704]: pgmap v268: 97 pgs: 97 active+clean; 609 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T06:35:05.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:05 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3059046365' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:05.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:05 smithi079 ceph-mon[34346]: pgmap v268: 97 pgs: 97 active+clean; 609 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.3 KiB/s wr, 13 op/s 2024-09-21T06:35:05.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:05 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3059046365' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.928+0000 7f5480f29640 1 -- 172.21.15.49:0/3381966489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c1049c0 msgr2=0x7f547c104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.928+0000 7f5480f29640 1 --2- 172.21.15.49:0/3381966489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c1049c0 0x7f547c104dd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f546c009900 tx=0x7f546c02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.928+0000 7f5480f29640 1 -- 172.21.15.49:0/3381966489 shutdown_connections 2024-09-21T06:35:05.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.928+0000 7f5480f29640 1 --2- 172.21.15.49:0/3381966489 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f547c10de20 0x7f547c110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.928+0000 7f5480f29640 1 --2- 172.21.15.49:0/3381966489 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f547c105310 0x7f547c10d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.928+0000 7f5480f29640 1 --2- 172.21.15.49:0/3381966489 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c1049c0 0x7f547c104dd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.928+0000 7f5480f29640 1 -- 172.21.15.49:0/3381966489 >> 172.21.15.49:0/3381966489 conn(0x7f547c079710 msgr2=0x7f547c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.928+0000 7f5480f29640 1 -- 172.21.15.49:0/3381966489 shutdown_connections 2024-09-21T06:35:05.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.928+0000 7f5480f29640 1 -- 172.21.15.49:0/3381966489 wait complete. 2024-09-21T06:35:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f5480f29640 1 Processor -- start 2024-09-21T06:35:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f5480f29640 1 -- start start 2024-09-21T06:35:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f5480f29640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f547c1049c0 0x7f547c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f5480f29640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f547c105310 0x7f547c19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.936 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f5480f29640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c10de20 0x7f547c19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f5480f29640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f547c113aa0 con 0x7f547c10de20 2024-09-21T06:35:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f5480f29640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f547c113920 con 0x7f547c1049c0 2024-09-21T06:35:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f5480f29640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f547c113c20 con 0x7f547c105310 2024-09-21T06:35:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f547ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c10de20 0x7f547c19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f547ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c10de20 0x7f547c19fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47750/0 (socket says 172.21.15.49:47750) 2024-09-21T06:35:05.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f547ad9d640 1 -- 172.21.15.49:0/2233422434 learned_addr learned my addr 172.21.15.49:0/2233422434 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f5479d9b640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f547c105310 0x7f547c19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.929+0000 7f547a59c640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f547c1049c0 0x7f547c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f547ad9d640 1 -- 172.21.15.49:0/2233422434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f547c105310 msgr2=0x7f547c19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f547ad9d640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f547c105310 0x7f547c19aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f547ad9d640 1 -- 172.21.15.49:0/2233422434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f547c1049c0 msgr2=0x7f547c19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.938 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f547ad9d640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f547c1049c0 0x7f547c19a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f547ad9d640 1 -- 172.21.15.49:0/2233422434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547c1a0480 con 0x7f547c10de20 2024-09-21T06:35:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f547a59c640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f547c1049c0 0x7f547c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f547ad9d640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c10de20 0x7f547c19fd50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f547400eaa0 tx=0x7f547400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f546b7fe640 1 -- 172.21.15.49:0/2233422434 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547400cdb0 con 0x7f547c10de20 2024-09-21T06:35:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f546b7fe640 1 -- 172.21.15.49:0/2233422434 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5474005020 con 0x7f547c10de20 2024-09-21T06:35:05.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f547c1a0770 con 0x7f547c10de20 2024-09-21T06:35:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f546b7fe640 1 -- 172.21.15.49:0/2233422434 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54740116d0 con 0x7f547c10de20 2024-09-21T06:35:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.930+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f547c1a6ed0 con 0x7f547c10de20 2024-09-21T06:35:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.931+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f547c06c280 con 0x7f547c10de20 2024-09-21T06:35:05.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.933+0000 7f546b7fe640 1 -- 172.21.15.49:0/2233422434 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f54740051d0 con 0x7f547c10de20 2024-09-21T06:35:05.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.934+0000 7f546b7fe640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54640b65f0 0x7f54640b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.934+0000 7f547a59c640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54640b65f0 0x7f54640b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.934+0000 7f546b7fe640 1 -- 172.21.15.49:0/2233422434 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f54740e7a00 con 0x7f547c10de20 2024-09-21T06:35:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.935+0000 7f547a59c640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54640b65f0 0x7f54640b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f546c031440 tx=0x7f546c009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:05.937+0000 7f546b7fe640 1 -- 172.21.15.49:0/2233422434 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5474016030 con 0x7f547c10de20 2024-09-21T06:35:06.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.126+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f547c104dd0 con 0x7f547c10de20 2024-09-21T06:35:06.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.127+0000 7f546b7fe640 1 -- 172.21.15.49:0/2233422434 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+22485 (secure 0 0 0) 0x7f54740ae150 con 0x7f547c10de20 2024-09-21T06:35:06.130 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:06.130 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":74,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:34:43.531374+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:35:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54640b65f0 msgr2=0x7f54640b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54640b65f0 0x7f54640b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f546c031440 tx=0x7f546c009680 comp rx=0 tx=0).stop 2024-09-21T06:35:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c10de20 msgr2=0x7f547c19fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c10de20 0x7f547c19fd50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f547400eaa0 tx=0x7f547400ef60 comp rx=0 tx=0).stop 2024-09-21T06:35:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 shutdown_connections 2024-09-21T06:35:06.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54640b65f0 0x7f54640b8b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f547c10de20 0x7f547c19fd50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f547c105310 0x7f547c19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 --2- 172.21.15.49:0/2233422434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f547c1049c0 0x7f547c19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.129+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 >> 172.21.15.49:0/2233422434 conn(0x7f547c079710 msgr2=0x7f547c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.130+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 shutdown_connections 2024-09-21T06:35:06.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:06.130+0000 7f5480f29640 1 -- 172.21.15.49:0/2233422434 wait complete. 2024-09-21T06:35:06.425 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:06 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2233422434' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:06.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:06 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2233422434' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:06.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:06 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2233422434' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:06.780 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:35:06.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:35:07.056 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:07.434 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:07 smithi049 ceph-mon[31177]: pgmap v269: 97 pgs: 97 active+clean; 609 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 KiB/s wr, 10 op/s 2024-09-21T06:35:07.520 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:07 smithi079 ceph-mon[34346]: pgmap v269: 97 pgs: 97 active+clean; 609 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 KiB/s wr, 10 op/s 2024-09-21T06:35:07.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.522+0000 7f6ab0da6640 1 -- 172.21.15.49:0/293004664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac1094a0 msgr2=0x7f6aac1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.522+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/293004664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac1094a0 0x7f6aac1098b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0009900 tx=0x7f6aa002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.522+0000 7f6ab0da6640 1 -- 172.21.15.49:0/293004664 shutdown_connections 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.522+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/293004664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aac109df0 0x7f6aac110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.522+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/293004664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac1094a0 0x7f6aac1098b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.522+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/293004664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac103b60 0x7f6aac103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.522+0000 7f6ab0da6640 1 -- 172.21.15.49:0/293004664 >> 172.21.15.49:0/293004664 conn(0x7f6aac07b850 msgr2=0x7f6aac07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.522+0000 7f6ab0da6640 1 -- 172.21.15.49:0/293004664 shutdown_connections 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.522+0000 7f6ab0da6640 1 -- 172.21.15.49:0/293004664 wait complete. 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.523+0000 7f6ab0da6640 1 Processor -- start 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.523+0000 7f6ab0da6640 1 -- start start 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.523+0000 7f6ab0da6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aac103b60 0x7f6aac19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.523+0000 7f6ab0da6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac1094a0 0x7f6aac19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.523+0000 7f6ab0da6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac109df0 0x7f6aac19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:07.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.523+0000 7f6ab0da6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac113ab0 con 0x7f6aac109df0 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.523+0000 7f6ab0da6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac113930 con 0x7f6aac103b60 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.523+0000 7f6ab0da6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac113c30 con 0x7f6aac1094a0 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.523+0000 7f6aaad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac109df0 0x7f6aac19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aaad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac109df0 0x7f6aac19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38888/0 (socket says 172.21.15.49:38888) 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aaad9d640 1 -- 172.21.15.49:0/3797483043 learned_addr learned my addr 172.21.15.49:0/3797483043 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aaa59c640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aac103b60 0x7f6aac19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aa9d9b640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac1094a0 0x7f6aac19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aaad9d640 1 -- 172.21.15.49:0/3797483043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac1094a0 msgr2=0x7f6aac19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aaad9d640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac1094a0 0x7f6aac19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aaad9d640 1 -- 172.21.15.49:0/3797483043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aac103b60 msgr2=0x7f6aac19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aaad9d640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aac103b60 0x7f6aac19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aaad9d640 1 -- 172.21.15.49:0/3797483043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aac1a03f0 con 0x7f6aac109df0 2024-09-21T06:35:07.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6aaad9d640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac109df0 0x7f6aac19fcc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009fd0 tx=0x7f6aa400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6a9b7fe640 1 -- 172.21.15.49:0/3797483043 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4017070 con 0x7f6aac109df0 2024-09-21T06:35:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6a9b7fe640 1 -- 172.21.15.49:0/3797483043 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa4003e20 con 0x7f6aac109df0 2024-09-21T06:35:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6a9b7fe640 1 -- 172.21.15.49:0/3797483043 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4010460 con 0x7f6aac109df0 2024-09-21T06:35:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aac1a06e0 con 0x7f6aac109df0 2024-09-21T06:35:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.524+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aac1a6e40 con 0x7f6aac109df0 2024-09-21T06:35:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.526+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aac104de0 con 0x7f6aac109df0 2024-09-21T06:35:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.527+0000 7f6a9b7fe640 1 -- 172.21.15.49:0/3797483043 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6aa4003970 con 0x7f6aac109df0 2024-09-21T06:35:07.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.528+0000 7f6a9b7fe640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6a940b65f0 0x7f6a940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:07.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.528+0000 7f6aaa59c640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6a940b65f0 0x7f6a940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:07.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.529+0000 7f6a9b7fe640 1 -- 172.21.15.49:0/3797483043 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f6aa40e72f0 con 0x7f6aac109df0 2024-09-21T06:35:07.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.529+0000 7f6aaa59c640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6a940b65f0 0x7f6a940b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c005fd0 tx=0x7f6a9c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:07.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.532+0000 7f6a9b7fe640 1 -- 172.21.15.49:0/3797483043 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6aa40ad9e0 con 0x7f6aac109df0 2024-09-21T06:35:07.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:07 smithi098 ceph-mon[34704]: pgmap v269: 97 pgs: 97 active+clean; 609 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 KiB/s wr, 10 op/s 2024-09-21T06:35:07.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.715+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6aac063800 con 0x7f6a940b65f0 2024-09-21T06:35:07.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.720+0000 7f6a9b7fe640 1 -- 172.21.15.49:0/3797483043 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258671 (secure 0 0 0) 0x7f6aac063800 con 0x7f6a940b65f0 2024-09-21T06:35:07.724 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:07.725 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-09-21T06:35:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6a940b65f0 msgr2=0x7f6a940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6a940b65f0 0x7f6a940b8b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c005fd0 tx=0x7f6a9c00b390 comp rx=0 tx=0).stop 2024-09-21T06:35:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac109df0 msgr2=0x7f6aac19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac109df0 0x7f6aac19fcc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009fd0 tx=0x7f6aa400b260 comp rx=0 tx=0).stop 2024-09-21T06:35:07.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 shutdown_connections 2024-09-21T06:35:07.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6a940b65f0 0x7f6a940b8b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6aac109df0 0x7f6aac19fcc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6aac1094a0 0x7f6aac19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 --2- 172.21.15.49:0/3797483043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6aac103b60 0x7f6aac19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 >> 172.21.15.49:0/3797483043 conn(0x7f6aac07b850 msgr2=0x7f6aac105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:07.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 shutdown_connections 2024-09-21T06:35:07.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:07.723+0000 7f6ab0da6640 1 -- 172.21.15.49:0/3797483043 wait complete. 2024-09-21T06:35:08.443 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:08 smithi049 ceph-mon[31177]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:08.471 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2024-09-21T06:35:06.109851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":623618,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":161,"num_read_kb":147,"num_write":265,"num_write_kb":2224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356532,"kb_used_data":11444,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585292,"statfs":{"total":1151940427776,"available":1151575339008,"internally_reserved":0,"allocated":11718656,"data_stored":6618860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":29434,"num_objects":19,"num_object_clones":0,"num_object_copies":57,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":79,"num_read_kb":77,"num_write":49,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003049"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917367+0000","last_change":"2024-09-21T06:34:42.895466+0000","last_active":"2024-09-21T06:34:43.917367+0000","last_peered":"2024-09-21T06:34:43.917367+0000","last_clean":"2024-09-21T06:34:43.917367+0000","last_became_active":"2024-09-21T06:34:42.895084+0000","last_became_peered":"2024-09-21T06:34:42.895084+0000","last_unstale":"2024-09-21T06:34:43.917367+0000","last_undegraded":"2024-09-21T06:34:43.917367+0000","last_fullsized":"2024-09-21T06:34:43.917367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.513107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918459+0000","last_change":"2024-09-21T06:34:42.888307+0000","last_active":"2024-09-21T06:34:43.918459+0000","last_peered":"2024-09-21T06:34:43.918459+0000","last_clean":"2024-09-21T06:34:43.918459+0000","last_became_active":"2024-09-21T06:34:42.886106+0000","last_became_peered":"2024-09-21T06:34:42.886106+0000","last_unstale":"2024-09-21T06:34:43.918459+0000","last_undegraded":"2024-09-21T06:34:43.918459+0000","last_fullsized":"2024-09-21T06:34:43.918459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:57.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919099+0000","last_change":"2024-09-21T06:34:42.897217+0000","last_active":"2024-09-21T06:34:43.919099+0000","last_peered":"2024-09-21T06:34:43.919099+0000","last_clean":"2024-09-21T06:34:43.919099+0000","last_became_active":"2024-09-21T06:34:42.896849+0000","last_became_peered":"2024-09-21T06:34:42.896849+0000","last_unstale":"2024-09-21T06:34:43.919099+0000","last_undegraded":"2024-09-21T06:34:43.919099+0000","last_fullsized":"2024-09-21T06:34:43.919099+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:28.749566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908228+0000","last_change":"2024-09-21T06:34:42.887236+0000","last_active":"2024-09-21T06:34:43.908228+0000","last_peered":"2024-09-21T06:34:43.908228+0000","last_clean":"2024-09-21T06:34:43.908228+0000","last_became_active":"2024-09-21T06:34:42.886137+0000","last_became_peered":"2024-09-21T06:34:42.886137+0000","last_unstale":"2024-09-21T06:34:43.908228+0000","last_undegraded":"2024-09-21T06:34:43.908228+0000","last_fullsized":"2024-09-21T06:34:43.908228+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:23.728433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919987+0000","last_change":"2024-09-21T06:34:42.885792+0000","last_active":"2024-09-21T06:34:43.919987+0000","last_peered":"2024-09-21T06:34:43.919987+0000","last_clean":"2024-09-21T06:34:43.919987+0000","last_became_active":"2024-09-21T06:34:42.885372+0000","last_became_peered":"2024-09-21T06:34:42.885372+0000","last_unstale":"2024-09-21T06:34:43.919987+0000","last_undegraded":"2024-09-21T06:34:43.919987+0000","last_fullsized":"2024-09-21T06:34:43.919987+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:29.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917621+0000","last_change":"2024-09-21T06:34:42.896814+0000","last_active":"2024-09-21T06:34:43.917621+0000","last_peered":"2024-09-21T06:34:43.917621+0000","last_clean":"2024-09-21T06:34:43.917621+0000","last_became_active":"2024-09-21T06:34:42.896147+0000","last_became_peered":"2024-09-21T06:34:42.896147+0000","last_unstale":"2024-09-21T06:34:43.917621+0000","last_undegraded":"2024-09-21T06:34:43.917621+0000","last_fullsized":"2024-09-21T06:34:43.917621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:49.037539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917503+0000","last_change":"2024-09-21T06:34:42.896264+0000","last_active":"2024-09-21T06:34:43.917503+0000","last_peered":"2024-09-21T06:34:43.917503+0000","last_clean":"2024-09-21T06:34:43.917503+0000","last_became_active":"2024-09-21T06:34:42.895793+0000","last_became_peered":"2024-09-21T06:34:42.895793+0000","last_unstale":"2024-09-21T06:34:43.917503+0000","last_undegraded":"2024-09-21T06:34:43.917503+0000","last_fullsized":"2024-09-21T06:34:43.917503+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:06.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.915557+0000","last_change":"2024-09-21T06:34:42.892538+0000","last_active":"2024-09-21T06:34:43.915557+0000","last_peered":"2024-09-21T06:34:43.915557+0000","last_clean":"2024-09-21T06:34:43.915557+0000","last_became_active":"2024-09-21T06:34:42.892139+0000","last_became_peered":"2024-09-21T06:34:42.892139+0000","last_unstale":"2024-09-21T06:34:43.915557+0000","last_undegraded":"2024-09-21T06:34:43.915557+0000","last_fullsized":"2024-09-21T06:34:43.915557+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:51.808969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.923851+0000","last_change":"2024-09-21T06:34:42.900198+0000","last_active":"2024-09-21T06:34:43.923851+0000","last_peered":"2024-09-21T06:34:43.923851+0000","last_clean":"2024-09-21T06:34:43.923851+0000","last_became_active":"2024-09-21T06:34:42.899837+0000","last_became_peered":"2024-09-21T06:34:42.899837+0000","last_unstale":"2024-09-21T06:34:43.923851+0000","last_undegraded":"2024-09-21T06:34:43.923851+0000","last_fullsized":"2024-09-21T06:34:43.923851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:20.762470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919185+0000","last_change":"2024-09-21T06:34:42.895533+0000","last_active":"2024-09-21T06:34:43.919185+0000","last_peered":"2024-09-21T06:34:43.919185+0000","last_clean":"2024-09-21T06:34:43.919185+0000","last_became_active":"2024-09-21T06:34:42.895162+0000","last_became_peered":"2024-09-21T06:34:42.895162+0000","last_unstale":"2024-09-21T06:34:43.919185+0000","last_undegraded":"2024-09-21T06:34:43.919185+0000","last_fullsized":"2024-09-21T06:34:43.919185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:25.495493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918180+0000","last_change":"2024-09-21T06:34:42.894173+0000","last_active":"2024-09-21T06:34:43.918180+0000","last_peered":"2024-09-21T06:34:43.918180+0000","last_clean":"2024-09-21T06:34:43.918180+0000","last_became_active":"2024-09-21T06:34:42.893817+0000","last_became_peered":"2024-09-21T06:34:42.893817+0000","last_unstale":"2024-09-21T06:34:43.918180+0000","last_undegraded":"2024-09-21T06:34:43.918180+0000","last_fullsized":"2024-09-21T06:34:43.918180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:31.580564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908339+0000","last_change":"2024-09-21T06:34:42.886536+0000","last_active":"2024-09-21T06:34:43.908339+0000","last_peered":"2024-09-21T06:34:43.908339+0000","last_clean":"2024-09-21T06:34:43.908339+0000","last_became_active":"2024-09-21T06:34:42.885636+0000","last_became_peered":"2024-09-21T06:34:42.885636+0000","last_unstale":"2024-09-21T06:34:43.908339+0000","last_undegraded":"2024-09-21T06:34:43.908339+0000","last_fullsized":"2024-09-21T06:34:43.908339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:11.074850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905532+0000","last_change":"2024-09-21T06:34:42.882665+0000","last_active":"2024-09-21T06:34:43.905532+0000","last_peered":"2024-09-21T06:34:43.905532+0000","last_clean":"2024-09-21T06:34:43.905532+0000","last_became_active":"2024-09-21T06:34:42.882254+0000","last_became_peered":"2024-09-21T06:34:42.882254+0000","last_unstale":"2024-09-21T06:34:43.905532+0000","last_undegraded":"2024-09-21T06:34:43.905532+0000","last_fullsized":"2024-09-21T06:34:43.905532+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:01.203542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916610+0000","last_change":"2024-09-21T06:34:42.884034+0000","last_active":"2024-09-21T06:34:43.916610+0000","last_peered":"2024-09-21T06:34:43.916610+0000","last_clean":"2024-09-21T06:34:43.916610+0000","last_became_active":"2024-09-21T06:34:42.883685+0000","last_became_peered":"2024-09-21T06:34:42.883685+0000","last_unstale":"2024-09-21T06:34:43.916610+0000","last_undegraded":"2024-09-21T06:34:43.916610+0000","last_fullsized":"2024-09-21T06:34:43.916610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:00.124019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916636+0000","last_change":"2024-09-21T06:34:42.894686+0000","last_active":"2024-09-21T06:34:43.916636+0000","last_peered":"2024-09-21T06:34:43.916636+0000","last_clean":"2024-09-21T06:34:43.916636+0000","last_became_active":"2024-09-21T06:34:42.893980+0000","last_became_peered":"2024-09-21T06:34:42.893980+0000","last_unstale":"2024-09-21T06:34:43.916636+0000","last_undegraded":"2024-09-21T06:34:43.916636+0000","last_fullsized":"2024-09-21T06:34:43.916636+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:00.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.921631+0000","last_change":"2024-09-21T06:34:42.891462+0000","last_active":"2024-09-21T06:34:43.921631+0000","last_peered":"2024-09-21T06:34:43.921631+0000","last_clean":"2024-09-21T06:34:43.921631+0000","last_became_active":"2024-09-21T06:34:42.891085+0000","last_became_peered":"2024-09-21T06:34:42.891085+0000","last_unstale":"2024-09-21T06:34:43.921631+0000","last_undegraded":"2024-09-21T06:34:43.921631+0000","last_fullsized":"2024-09-21T06:34:43.921631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:03.942909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917660+0000","last_change":"2024-09-21T06:34:42.897049+0000","last_active":"2024-09-21T06:34:43.917660+0000","last_peered":"2024-09-21T06:34:43.917660+0000","last_clean":"2024-09-21T06:34:43.917660+0000","last_became_active":"2024-09-21T06:34:42.896131+0000","last_became_peered":"2024-09-21T06:34:42.896131+0000","last_unstale":"2024-09-21T06:34:43.917660+0000","last_undegraded":"2024-09-21T06:34:43.917660+0000","last_fullsized":"2024-09-21T06:34:43.917660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:47.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919333+0000","last_change":"2024-09-21T06:34:42.887894+0000","last_active":"2024-09-21T06:34:43.919333+0000","last_peered":"2024-09-21T06:34:43.919333+0000","last_clean":"2024-09-21T06:34:43.919333+0000","last_became_active":"2024-09-21T06:34:42.887436+0000","last_became_peered":"2024-09-21T06:34:42.887436+0000","last_unstale":"2024-09-21T06:34:43.919333+0000","last_undegraded":"2024-09-21T06:34:43.919333+0000","last_fullsized":"2024-09-21T06:34:43.919333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:22.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916272+0000","last_change":"2024-09-21T06:34:42.888071+0000","last_active":"2024-09-21T06:34:43.916272+0000","last_peered":"2024-09-21T06:34:43.916272+0000","last_clean":"2024-09-21T06:34:43.916272+0000","last_became_active":"2024-09-21T06:34:42.887295+0000","last_became_peered":"2024-09-21T06:34:42.887295+0000","last_unstale":"2024-09-21T06:34:43.916272+0000","last_undegraded":"2024-09-21T06:34:43.916272+0000","last_fullsized":"2024-09-21T06:34:43.916272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:49.937367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916191+0000","last_change":"2024-09-21T06:34:42.891963+0000","last_active":"2024-09-21T06:34:43.916191+0000","last_peered":"2024-09-21T06:34:43.916191+0000","last_clean":"2024-09-21T06:34:43.916191+0000","last_became_active":"2024-09-21T06:34:42.891603+0000","last_became_peered":"2024-09-21T06:34:42.891603+0000","last_unstale":"2024-09-21T06:34:43.916191+0000","last_undegraded":"2024-09-21T06:34:43.916191+0000","last_fullsized":"2024-09-21T06:34:43.916191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:47.608523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905487+0000","last_change":"2024-09-21T06:34:42.895909+0000","last_active":"2024-09-21T06:34:43.905487+0000","last_peered":"2024-09-21T06:34:43.905487+0000","last_clean":"2024-09-21T06:34:43.905487+0000","last_became_active":"2024-09-21T06:34:42.895477+0000","last_became_peered":"2024-09-21T06:34:42.895477+0000","last_unstale":"2024-09-21T06:34:43.905487+0000","last_undegraded":"2024-09-21T06:34:43.905487+0000","last_fullsized":"2024-09-21T06:34:43.905487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.284523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.923459+0000","last_change":"2024-09-21T06:34:42.893554+0000","last_active":"2024-09-21T06:34:43.923459+0000","last_peered":"2024-09-21T06:34:43.923459+0000","last_clean":"2024-09-21T06:34:43.923459+0000","last_became_active":"2024-09-21T06:34:42.892949+0000","last_became_peered":"2024-09-21T06:34:42.892949+0000","last_unstale":"2024-09-21T06:34:43.923459+0000","last_undegraded":"2024-09-21T06:34:43.923459+0000","last_fullsized":"2024-09-21T06:34:43.923459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:57.107590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916014+0000","last_change":"2024-09-21T06:34:42.894574+0000","last_active":"2024-09-21T06:34:43.916014+0000","last_peered":"2024-09-21T06:34:43.916014+0000","last_clean":"2024-09-21T06:34:43.916014+0000","last_became_active":"2024-09-21T06:34:42.894027+0000","last_became_peered":"2024-09-21T06:34:42.894027+0000","last_unstale":"2024-09-21T06:34:43.916014+0000","last_undegraded":"2024-09-21T06:34:43.916014+0000","last_fullsized":"2024-09-21T06:34:43.916014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:58.425792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.907661+0000","last_change":"2024-09-21T06:34:42.893029+0000","last_active":"2024-09-21T06:34:43.907661+0000","last_peered":"2024-09-21T06:34:43.907661+0000","last_clean":"2024-09-21T06:34:43.907661+0000","last_became_active":"2024-09-21T06:34:42.892428+0000","last_became_peered":"2024-09-21T06:34:42.892428+0000","last_unstale":"2024-09-21T06:34:43.907661+0000","last_undegraded":"2024-09-21T06:34:43.907661+0000","last_fullsized":"2024-09-21T06:34:43.907661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:33.414088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917613+0000","last_change":"2024-09-21T06:34:42.894347+0000","last_active":"2024-09-21T06:34:43.917613+0000","last_peered":"2024-09-21T06:34:43.917613+0000","last_clean":"2024-09-21T06:34:43.917613+0000","last_became_active":"2024-09-21T06:34:42.893966+0000","last_became_peered":"2024-09-21T06:34:42.893966+0000","last_unstale":"2024-09-21T06:34:43.917613+0000","last_undegraded":"2024-09-21T06:34:43.917613+0000","last_fullsized":"2024-09-21T06:34:43.917613+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:15.862407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916833+0000","last_change":"2024-09-21T06:34:42.888826+0000","last_active":"2024-09-21T06:34:43.916833+0000","last_peered":"2024-09-21T06:34:43.916833+0000","last_clean":"2024-09-21T06:34:43.916833+0000","last_became_active":"2024-09-21T06:34:42.888447+0000","last_became_peered":"2024-09-21T06:34:42.888447+0000","last_unstale":"2024-09-21T06:34:43.916833+0000","last_undegraded":"2024-09-21T06:34:43.916833+0000","last_fullsized":"2024-09-21T06:34:43.916833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:52.634516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916805+0000","last_change":"2024-09-21T06:34:42.889377+0000","last_active":"2024-09-21T06:34:43.916805+0000","last_peered":"2024-09-21T06:34:43.916805+0000","last_clean":"2024-09-21T06:34:43.916805+0000","last_became_active":"2024-09-21T06:34:42.888978+0000","last_became_peered":"2024-09-21T06:34:42.888978+0000","last_unstale":"2024-09-21T06:34:43.916805+0000","last_undegraded":"2024-09-21T06:34:43.916805+0000","last_fullsized":"2024-09-21T06:34:43.916805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:34.734283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905511+0000","last_change":"2024-09-21T06:34:42.878128+0000","last_active":"2024-09-21T06:34:43.905511+0000","last_peered":"2024-09-21T06:34:43.905511+0000","last_clean":"2024-09-21T06:34:43.905511+0000","last_became_active":"2024-09-21T06:34:42.877742+0000","last_became_peered":"2024-09-21T06:34:42.877742+0000","last_unstale":"2024-09-21T06:34:43.905511+0000","last_undegraded":"2024-09-21T06:34:43.905511+0000","last_fullsized":"2024-09-21T06:34:43.905511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:04.992402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918058+0000","last_change":"2024-09-21T06:34:42.882659+0000","last_active":"2024-09-21T06:34:43.918058+0000","last_peered":"2024-09-21T06:34:43.918058+0000","last_clean":"2024-09-21T06:34:43.918058+0000","last_became_active":"2024-09-21T06:34:42.882306+0000","last_became_peered":"2024-09-21T06:34:42.882306+0000","last_unstale":"2024-09-21T06:34:43.918058+0000","last_undegraded":"2024-09-21T06:34:43.918058+0000","last_fullsized":"2024-09-21T06:34:43.918058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:31.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916119+0000","last_change":"2024-09-21T06:34:42.890089+0000","last_active":"2024-09-21T06:34:43.916119+0000","last_peered":"2024-09-21T06:34:43.916119+0000","last_clean":"2024-09-21T06:34:43.916119+0000","last_became_active":"2024-09-21T06:34:42.889739+0000","last_became_peered":"2024-09-21T06:34:42.889739+0000","last_unstale":"2024-09-21T06:34:43.916119+0000","last_undegraded":"2024-09-21T06:34:43.916119+0000","last_fullsized":"2024-09-21T06:34:43.916119+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.212760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917101+0000","last_change":"2024-09-21T06:34:42.881260+0000","last_active":"2024-09-21T06:34:43.917101+0000","last_peered":"2024-09-21T06:34:43.917101+0000","last_clean":"2024-09-21T06:34:43.917101+0000","last_became_active":"2024-09-21T06:34:42.880831+0000","last_became_peered":"2024-09-21T06:34:42.880831+0000","last_unstale":"2024-09-21T06:34:43.917101+0000","last_undegraded":"2024-09-21T06:34:43.917101+0000","last_fullsized":"2024-09-21T06:34:43.917101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:05.650463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916344+0000","last_change":"2024-09-21T06:34:42.893859+0000","last_active":"2024-09-21T06:34:43.916344+0000","last_peered":"2024-09-21T06:34:43.916344+0000","last_clean":"2024-09-21T06:34:43.916344+0000","last_became_active":"2024-09-21T06:34:42.893485+0000","last_became_peered":"2024-09-21T06:34:42.893485+0000","last_unstale":"2024-09-21T06:34:43.916344+0000","last_undegraded":"2024-09-21T06:34:43.916344+0000","last_fullsized":"2024-09-21T06:34:43.916344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:59.936750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.920663+0000","last_change":"2024-09-21T06:34:42.887164+0000","last_active":"2024-09-21T06:34:43.920663+0000","last_peered":"2024-09-21T06:34:43.920663+0000","last_clean":"2024-09-21T06:34:43.920663+0000","last_became_active":"2024-09-21T06:34:42.886314+0000","last_became_peered":"2024-09-21T06:34:42.886314+0000","last_unstale":"2024-09-21T06:34:43.920663+0000","last_undegraded":"2024-09-21T06:34:43.920663+0000","last_fullsized":"2024-09-21T06:34:43.920663+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:09.529922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:35:00.987564+0000","last_change":"2024-09-21T06:34:40.883170+0000","last_active":"2024-09-21T06:35:00.987564+0000","last_peered":"2024-09-21T06:35:00.987564+0000","last_clean":"2024-09-21T06:35:00.987564+0000","last_became_active":"2024-09-21T06:34:40.882760+0000","last_became_peered":"2024-09-21T06:34:40.882760+0000","last_unstale":"2024-09-21T06:35:00.987564+0000","last_undegraded":"2024-09-21T06:35:00.987564+0000","last_fullsized":"2024-09-21T06:35:00.987564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:41.388275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908174+0000","last_change":"2024-09-21T06:34:42.893842+0000","last_active":"2024-09-21T06:34:43.908174+0000","last_peered":"2024-09-21T06:34:43.908174+0000","last_clean":"2024-09-21T06:34:43.908174+0000","last_became_active":"2024-09-21T06:34:42.893501+0000","last_became_peered":"2024-09-21T06:34:42.893501+0000","last_unstale":"2024-09-21T06:34:43.908174+0000","last_undegraded":"2024-09-21T06:34:43.908174+0000","last_fullsized":"2024-09-21T06:34:43.908174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.610084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965072+0000","last_change":"2024-09-21T06:34:40.878685+0000","last_active":"2024-09-21T06:34:51.965072+0000","last_peered":"2024-09-21T06:34:51.965072+0000","last_clean":"2024-09-21T06:34:51.965072+0000","last_became_active":"2024-09-21T06:34:40.878279+0000","last_became_peered":"2024-09-21T06:34:40.878279+0000","last_unstale":"2024-09-21T06:34:51.965072+0000","last_undegraded":"2024-09-21T06:34:51.965072+0000","last_fullsized":"2024-09-21T06:34:51.965072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:11.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.963202+0000","last_change":"2024-09-21T06:34:40.872074+0000","last_active":"2024-09-21T06:34:51.963202+0000","last_peered":"2024-09-21T06:34:51.963202+0000","last_clean":"2024-09-21T06:34:51.963202+0000","last_became_active":"2024-09-21T06:34:40.871637+0000","last_became_peered":"2024-09-21T06:34:40.871637+0000","last_unstale":"2024-09-21T06:34:51.963202+0000","last_undegraded":"2024-09-21T06:34:51.963202+0000","last_fullsized":"2024-09-21T06:34:51.963202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.915904+0000","last_change":"2024-09-21T06:34:42.882803+0000","last_active":"2024-09-21T06:34:43.915904+0000","last_peered":"2024-09-21T06:34:43.915904+0000","last_clean":"2024-09-21T06:34:43.915904+0000","last_became_active":"2024-09-21T06:34:42.881509+0000","last_became_peered":"2024-09-21T06:34:42.881509+0000","last_unstale":"2024-09-21T06:34:43.915904+0000","last_undegraded":"2024-09-21T06:34:43.915904+0000","last_fullsized":"2024-09-21T06:34:43.915904+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908429+0000","last_change":"2024-09-21T06:34:40.883054+0000","last_active":"2024-09-21T06:34:43.908429+0000","last_peered":"2024-09-21T06:34:43.908429+0000","last_clean":"2024-09-21T06:34:43.908429+0000","last_became_active":"2024-09-21T06:34:40.882299+0000","last_became_peered":"2024-09-21T06:34:40.882299+0000","last_unstale":"2024-09-21T06:34:43.908429+0000","last_undegraded":"2024-09-21T06:34:43.908429+0000","last_fullsized":"2024-09-21T06:34:43.908429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:17.813744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918692+0000","last_change":"2024-09-21T06:34:42.886437+0000","last_active":"2024-09-21T06:34:43.918692+0000","last_peered":"2024-09-21T06:34:43.918692+0000","last_clean":"2024-09-21T06:34:43.918692+0000","last_became_active":"2024-09-21T06:34:42.886075+0000","last_became_peered":"2024-09-21T06:34:42.886075+0000","last_unstale":"2024-09-21T06:34:43.918692+0000","last_undegraded":"2024-09-21T06:34:43.918692+0000","last_fullsized":"2024-09-21T06:34:43.918692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.179323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:59.985354+0000","last_change":"2024-09-21T06:34:40.880931+0000","last_active":"2024-09-21T06:34:59.985354+0000","last_peered":"2024-09-21T06:34:59.985354+0000","last_clean":"2024-09-21T06:34:59.985354+0000","last_became_active":"2024-09-21T06:34:40.880555+0000","last_became_peered":"2024-09-21T06:34:40.880555+0000","last_unstale":"2024-09-21T06:34:59.985354+0000","last_undegraded":"2024-09-21T06:34:59.985354+0000","last_fullsized":"2024-09-21T06:34:59.985354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:29.304297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.922300+0000","last_change":"2024-09-21T06:34:42.899618+0000","last_active":"2024-09-21T06:34:43.922300+0000","last_peered":"2024-09-21T06:34:43.922300+0000","last_clean":"2024-09-21T06:34:43.922300+0000","last_became_active":"2024-09-21T06:34:42.899230+0000","last_became_peered":"2024-09-21T06:34:42.899230+0000","last_unstale":"2024-09-21T06:34:43.922300+0000","last_undegraded":"2024-09-21T06:34:43.922300+0000","last_fullsized":"2024-09-21T06:34:43.922300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:27.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.958657+0000","last_change":"2024-09-21T06:34:40.882988+0000","last_active":"2024-09-21T06:34:50.958657+0000","last_peered":"2024-09-21T06:34:50.958657+0000","last_clean":"2024-09-21T06:34:50.958657+0000","last_became_active":"2024-09-21T06:34:40.882533+0000","last_became_peered":"2024-09-21T06:34:40.882533+0000","last_unstale":"2024-09-21T06:34:50.958657+0000","last_undegraded":"2024-09-21T06:34:50.958657+0000","last_fullsized":"2024-09-21T06:34:50.958657+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:23.220540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.920206+0000","last_change":"2024-09-21T06:34:42.889556+0000","last_active":"2024-09-21T06:34:43.920206+0000","last_peered":"2024-09-21T06:34:43.920206+0000","last_clean":"2024-09-21T06:34:43.920206+0000","last_became_active":"2024-09-21T06:34:42.888853+0000","last_became_peered":"2024-09-21T06:34:42.888853+0000","last_unstale":"2024-09-21T06:34:43.920206+0000","last_undegraded":"2024-09-21T06:34:43.920206+0000","last_fullsized":"2024-09-21T06:34:43.920206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:24.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.958166+0000","last_change":"2024-09-21T06:34:40.891450+0000","last_active":"2024-09-21T06:34:50.958166+0000","last_peered":"2024-09-21T06:34:50.958166+0000","last_clean":"2024-09-21T06:34:50.958166+0000","last_became_active":"2024-09-21T06:34:40.890892+0000","last_became_peered":"2024-09-21T06:34:40.890892+0000","last_unstale":"2024-09-21T06:34:50.958166+0000","last_undegraded":"2024-09-21T06:34:50.958166+0000","last_fullsized":"2024-09-21T06:34:50.958166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.975342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.923881+0000","last_change":"2024-09-21T06:34:42.893122+0000","last_active":"2024-09-21T06:34:43.923881+0000","last_peered":"2024-09-21T06:34:43.923881+0000","last_clean":"2024-09-21T06:34:43.923881+0000","last_became_active":"2024-09-21T06:34:42.892730+0000","last_became_peered":"2024-09-21T06:34:42.892730+0000","last_unstale":"2024-09-21T06:34:43.923881+0000","last_undegraded":"2024-09-21T06:34:43.923881+0000","last_fullsized":"2024-09-21T06:34:43.923881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:06.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'16","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:35:00.989563+0000","last_change":"2024-09-21T06:34:40.881360+0000","last_active":"2024-09-21T06:35:00.989563+0000","last_peered":"2024-09-21T06:35:00.989563+0000","last_clean":"2024-09-21T06:35:00.989563+0000","last_became_active":"2024-09-21T06:34:40.880690+0000","last_became_peered":"2024-09-21T06:34:40.880690+0000","last_unstale":"2024-09-21T06:35:00.989563+0000","last_undegraded":"2024-09-21T06:35:00.989563+0000","last_fullsized":"2024-09-21T06:35:00.989563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:46.081596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29015,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":39,"num_write":17,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.920977+0000","last_change":"2024-09-21T06:34:42.890487+0000","last_active":"2024-09-21T06:34:43.920977+0000","last_peered":"2024-09-21T06:34:43.920977+0000","last_clean":"2024-09-21T06:34:43.920977+0000","last_became_active":"2024-09-21T06:34:42.890100+0000","last_became_peered":"2024-09-21T06:34:42.890100+0000","last_unstale":"2024-09-21T06:34:43.920977+0000","last_undegraded":"2024-09-21T06:34:43.920977+0000","last_fullsized":"2024-09-21T06:34:43.920977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.206869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965442+0000","last_change":"2024-09-21T06:34:40.876187+0000","last_active":"2024-09-21T06:34:51.965442+0000","last_peered":"2024-09-21T06:34:51.965442+0000","last_clean":"2024-09-21T06:34:51.965442+0000","last_became_active":"2024-09-21T06:34:40.875687+0000","last_became_peered":"2024-09-21T06:34:40.875687+0000","last_unstale":"2024-09-21T06:34:51.965442+0000","last_undegraded":"2024-09-21T06:34:51.965442+0000","last_fullsized":"2024-09-21T06:34:51.965442+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:51.758625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905176+0000","last_change":"2024-09-21T06:34:42.895900+0000","last_active":"2024-09-21T06:34:43.905176+0000","last_peered":"2024-09-21T06:34:43.905176+0000","last_clean":"2024-09-21T06:34:43.905176+0000","last_became_active":"2024-09-21T06:34:42.895504+0000","last_became_peered":"2024-09-21T06:34:42.895504+0000","last_unstale":"2024-09-21T06:34:43.905176+0000","last_undegraded":"2024-09-21T06:34:43.905176+0000","last_fullsized":"2024-09-21T06:34:43.905176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:28.414017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.957934+0000","last_change":"2024-09-21T06:34:40.882856+0000","last_active":"2024-09-21T06:34:50.957934+0000","last_peered":"2024-09-21T06:34:50.957934+0000","last_clean":"2024-09-21T06:34:50.957934+0000","last_became_active":"2024-09-21T06:34:40.882424+0000","last_became_peered":"2024-09-21T06:34:40.882424+0000","last_unstale":"2024-09-21T06:34:50.957934+0000","last_undegraded":"2024-09-21T06:34:50.957934+0000","last_fullsized":"2024-09-21T06:34:50.957934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:38.815928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918644+0000","last_change":"2024-09-21T06:34:42.890611+0000","last_active":"2024-09-21T06:34:43.918644+0000","last_peered":"2024-09-21T06:34:43.918644+0000","last_clean":"2024-09-21T06:34:43.918644+0000","last_became_active":"2024-09-21T06:34:42.890246+0000","last_became_peered":"2024-09-21T06:34:42.890246+0000","last_unstale":"2024-09-21T06:34:43.918644+0000","last_undegraded":"2024-09-21T06:34:43.918644+0000","last_fullsized":"2024-09-21T06:34:43.918644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:05.074903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":33,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:59.985946+0000","last_change":"2024-09-21T06:34:40.877003+0000","last_active":"2024-09-21T06:34:59.985946+0000","last_peered":"2024-09-21T06:34:59.985946+0000","last_clean":"2024-09-21T06:34:59.985946+0000","last_became_active":"2024-09-21T06:34:40.876516+0000","last_became_peered":"2024-09-21T06:34:40.876516+0000","last_unstale":"2024-09-21T06:34:59.985946+0000","last_undegraded":"2024-09-21T06:34:59.985946+0000","last_fullsized":"2024-09-21T06:34:59.985946+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:14.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917048+0000","last_change":"2024-09-21T06:34:42.896816+0000","last_active":"2024-09-21T06:34:43.917048+0000","last_peered":"2024-09-21T06:34:43.917048+0000","last_clean":"2024-09-21T06:34:43.917048+0000","last_became_active":"2024-09-21T06:34:42.896329+0000","last_became_peered":"2024-09-21T06:34:42.896329+0000","last_unstale":"2024-09-21T06:34:43.917048+0000","last_undegraded":"2024-09-21T06:34:43.917048+0000","last_fullsized":"2024-09-21T06:34:43.917048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.462498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.966465+0000","last_change":"2024-09-21T06:34:40.892809+0000","last_active":"2024-09-21T06:34:51.966465+0000","last_peered":"2024-09-21T06:34:51.966465+0000","last_clean":"2024-09-21T06:34:51.966465+0000","last_became_active":"2024-09-21T06:34:40.892433+0000","last_became_peered":"2024-09-21T06:34:40.892433+0000","last_unstale":"2024-09-21T06:34:51.966465+0000","last_undegraded":"2024-09-21T06:34:51.966465+0000","last_fullsized":"2024-09-21T06:34:51.966465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:43.744202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.907801+0000","last_change":"2024-09-21T06:34:42.898672+0000","last_active":"2024-09-21T06:34:43.907801+0000","last_peered":"2024-09-21T06:34:43.907801+0000","last_clean":"2024-09-21T06:34:43.907801+0000","last_became_active":"2024-09-21T06:34:42.898287+0000","last_became_peered":"2024-09-21T06:34:42.898287+0000","last_unstale":"2024-09-21T06:34:43.907801+0000","last_undegraded":"2024-09-21T06:34:43.907801+0000","last_fullsized":"2024-09-21T06:34:43.907801+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.657150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:52.972301+0000","last_change":"2024-09-21T06:34:40.876791+0000","last_active":"2024-09-21T06:34:52.972301+0000","last_peered":"2024-09-21T06:34:52.972301+0000","last_clean":"2024-09-21T06:34:52.972301+0000","last_became_active":"2024-09-21T06:34:40.876323+0000","last_became_peered":"2024-09-21T06:34:40.876323+0000","last_unstale":"2024-09-21T06:34:52.972301+0000","last_undegraded":"2024-09-21T06:34:52.972301+0000","last_fullsized":"2024-09-21T06:34:52.972301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:20.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.915922+0000","last_change":"2024-09-21T06:34:42.893054+0000","last_active":"2024-09-21T06:34:43.915922+0000","last_peered":"2024-09-21T06:34:43.915922+0000","last_clean":"2024-09-21T06:34:43.915922+0000","last_became_active":"2024-09-21T06:34:42.892695+0000","last_became_peered":"2024-09-21T06:34:42.892695+0000","last_unstale":"2024-09-21T06:34:43.915922+0000","last_undegraded":"2024-09-21T06:34:43.915922+0000","last_fullsized":"2024-09-21T06:34:43.915922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:41.464109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.914951+0000","last_change":"2024-09-21T06:34:40.877644+0000","last_active":"2024-09-21T06:34:43.914951+0000","last_peered":"2024-09-21T06:34:43.914951+0000","last_clean":"2024-09-21T06:34:43.914951+0000","last_became_active":"2024-09-21T06:34:40.877238+0000","last_became_peered":"2024-09-21T06:34:40.877238+0000","last_unstale":"2024-09-21T06:34:43.914951+0000","last_undegraded":"2024-09-21T06:34:43.914951+0000","last_fullsized":"2024-09-21T06:34:43.914951+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:21.055801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919066+0000","last_change":"2024-09-21T06:34:42.892399+0000","last_active":"2024-09-21T06:34:43.919066+0000","last_peered":"2024-09-21T06:34:43.919066+0000","last_clean":"2024-09-21T06:34:43.919066+0000","last_became_active":"2024-09-21T06:34:42.891873+0000","last_became_peered":"2024-09-21T06:34:42.891873+0000","last_unstale":"2024-09-21T06:34:43.919066+0000","last_undegraded":"2024-09-21T06:34:43.919066+0000","last_fullsized":"2024-09-21T06:34:43.919066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:09.684516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919444+0000","last_change":"2024-09-21T06:34:40.881603+0000","last_active":"2024-09-21T06:34:43.919444+0000","last_peered":"2024-09-21T06:34:43.919444+0000","last_clean":"2024-09-21T06:34:43.919444+0000","last_became_active":"2024-09-21T06:34:40.881226+0000","last_became_peered":"2024-09-21T06:34:40.881226+0000","last_unstale":"2024-09-21T06:34:43.919444+0000","last_undegraded":"2024-09-21T06:34:43.919444+0000","last_fullsized":"2024-09-21T06:34:43.919444+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:09.252102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917988+0000","last_change":"2024-09-21T06:34:42.897354+0000","last_active":"2024-09-21T06:34:43.917988+0000","last_peered":"2024-09-21T06:34:43.917988+0000","last_clean":"2024-09-21T06:34:43.917988+0000","last_became_active":"2024-09-21T06:34:42.896981+0000","last_became_peered":"2024-09-21T06:34:42.896981+0000","last_unstale":"2024-09-21T06:34:43.917988+0000","last_undegraded":"2024-09-21T06:34:43.917988+0000","last_fullsized":"2024-09-21T06:34:43.917988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:07.598107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965481+0000","last_change":"2024-09-21T06:34:40.890831+0000","last_active":"2024-09-21T06:34:51.965481+0000","last_peered":"2024-09-21T06:34:51.965481+0000","last_clean":"2024-09-21T06:34:51.965481+0000","last_became_active":"2024-09-21T06:34:40.890420+0000","last_became_peered":"2024-09-21T06:34:40.890420+0000","last_unstale":"2024-09-21T06:34:51.965481+0000","last_undegraded":"2024-09-21T06:34:51.965481+0000","last_fullsized":"2024-09-21T06:34:51.965481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:17.822323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919428+0000","last_change":"2024-09-21T06:34:42.894825+0000","last_active":"2024-09-21T06:34:43.919428+0000","last_peered":"2024-09-21T06:34:43.919428+0000","last_clean":"2024-09-21T06:34:43.919428+0000","last_became_active":"2024-09-21T06:34:42.893347+0000","last_became_peered":"2024-09-21T06:34:42.893347+0000","last_unstale":"2024-09-21T06:34:43.919428+0000","last_undegraded":"2024-09-21T06:34:43.919428+0000","last_fullsized":"2024-09-21T06:34:43.919428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:14.946035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":88,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917264+0000","last_change":"2024-09-21T06:33:33.165773+0000","last_active":"2024-09-21T06:34:43.917264+0000","last_peered":"2024-09-21T06:34:43.917264+0000","last_clean":"2024-09-21T06:34:43.917264+0000","last_became_active":"2024-09-21T06:33:33.159754+0000","last_became_peered":"2024-09-21T06:33:33.159754+0000","last_unstale":"2024-09-21T06:34:43.917264+0000","last_undegraded":"2024-09-21T06:34:43.917264+0000","last_fullsized":"2024-09-21T06:34:43.917264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_clean_scrub_stamp":"2024-09-21T06:30:10.865158+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:15.953330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:52.972701+0000","last_change":"2024-09-21T06:34:40.876091+0000","last_active":"2024-09-21T06:34:52.972701+0000","last_peered":"2024-09-21T06:34:52.972701+0000","last_clean":"2024-09-21T06:34:52.972701+0000","last_became_active":"2024-09-21T06:34:40.875576+0000","last_became_peered":"2024-09-21T06:34:40.875576+0000","last_unstale":"2024-09-21T06:34:52.972701+0000","last_undegraded":"2024-09-21T06:34:52.972701+0000","last_fullsized":"2024-09-21T06:34:52.972701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:34.392145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916629+0000","last_change":"2024-09-21T06:34:42.892283+0000","last_active":"2024-09-21T06:34:43.916629+0000","last_peered":"2024-09-21T06:34:43.916629+0000","last_clean":"2024-09-21T06:34:43.916629+0000","last_became_active":"2024-09-21T06:34:42.891839+0000","last_became_peered":"2024-09-21T06:34:42.891839+0000","last_unstale":"2024-09-21T06:34:43.916629+0000","last_undegraded":"2024-09-21T06:34:43.916629+0000","last_fullsized":"2024-09-21T06:34:43.916629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:10.202352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.962645+0000","last_change":"2024-09-21T06:34:40.880967+0000","last_active":"2024-09-21T06:34:51.962645+0000","last_peered":"2024-09-21T06:34:51.962645+0000","last_clean":"2024-09-21T06:34:51.962645+0000","last_became_active":"2024-09-21T06:34:40.880351+0000","last_became_peered":"2024-09-21T06:34:40.880351+0000","last_unstale":"2024-09-21T06:34:51.962645+0000","last_undegraded":"2024-09-21T06:34:51.962645+0000","last_fullsized":"2024-09-21T06:34:51.962645+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:52.694732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905058+0000","last_change":"2024-09-21T06:34:42.876102+0000","last_active":"2024-09-21T06:34:43.905058+0000","last_peered":"2024-09-21T06:34:43.905058+0000","last_clean":"2024-09-21T06:34:43.905058+0000","last_became_active":"2024-09-21T06:34:42.875065+0000","last_became_peered":"2024-09-21T06:34:42.875065+0000","last_unstale":"2024-09-21T06:34:43.905058+0000","last_undegraded":"2024-09-21T06:34:43.905058+0000","last_fullsized":"2024-09-21T06:34:43.905058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:23.867180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":34,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:35:01.988114+0000","last_change":"2024-09-21T06:34:40.890355+0000","last_active":"2024-09-21T06:35:01.988114+0000","last_peered":"2024-09-21T06:35:01.988114+0000","last_clean":"2024-09-21T06:35:01.988114+0000","last_became_active":"2024-09-21T06:34:40.889974+0000","last_became_peered":"2024-09-21T06:34:40.889974+0000","last_unstale":"2024-09-21T06:35:01.988114+0000","last_undegraded":"2024-09-21T06:35:01.988114+0000","last_fullsized":"2024-09-21T06:35:01.988114+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:58.349625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908099+0000","last_change":"2024-09-21T06:34:42.899831+0000","last_active":"2024-09-21T06:34:43.908099+0000","last_peered":"2024-09-21T06:34:43.908099+0000","last_clean":"2024-09-21T06:34:43.908099+0000","last_became_active":"2024-09-21T06:34:42.899372+0000","last_became_peered":"2024-09-21T06:34:42.899372+0000","last_unstale":"2024-09-21T06:34:43.908099+0000","last_undegraded":"2024-09-21T06:34:43.908099+0000","last_fullsized":"2024-09-21T06:34:43.908099+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:50.165222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918550+0000","last_change":"2024-09-21T06:34:40.882380+0000","last_active":"2024-09-21T06:34:43.918550+0000","last_peered":"2024-09-21T06:34:43.918550+0000","last_clean":"2024-09-21T06:34:43.918550+0000","last_became_active":"2024-09-21T06:34:40.881463+0000","last_became_peered":"2024-09-21T06:34:40.881463+0000","last_unstale":"2024-09-21T06:34:43.918550+0000","last_undegraded":"2024-09-21T06:34:43.918550+0000","last_fullsized":"2024-09-21T06:34:43.918550+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:25.620174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918412+0000","last_change":"2024-09-21T06:34:42.897205+0000","last_active":"2024-09-21T06:34:43.918412+0000","last_peered":"2024-09-21T06:34:43.918412+0000","last_clean":"2024-09-21T06:34:43.918412+0000","last_became_active":"2024-09-21T06:34:42.896705+0000","last_became_peered":"2024-09-21T06:34:42.896705+0000","last_unstale":"2024-09-21T06:34:43.918412+0000","last_undegraded":"2024-09-21T06:34:43.918412+0000","last_fullsized":"2024-09-21T06:34:43.918412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.333176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918646+0000","last_change":"2024-09-21T06:34:40.890356+0000","last_active":"2024-09-21T06:34:43.918646+0000","last_peered":"2024-09-21T06:34:43.918646+0000","last_clean":"2024-09-21T06:34:43.918646+0000","last_became_active":"2024-09-21T06:34:40.889963+0000","last_became_peered":"2024-09-21T06:34:40.889963+0000","last_unstale":"2024-09-21T06:34:43.918646+0000","last_undegraded":"2024-09-21T06:34:43.918646+0000","last_fullsized":"2024-09-21T06:34:43.918646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:09.621779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:46.185197+0000","last_change":"2024-09-21T06:34:42.884933+0000","last_active":"2024-09-21T06:34:46.185197+0000","last_peered":"2024-09-21T06:34:46.185197+0000","last_clean":"2024-09-21T06:34:46.185197+0000","last_became_active":"2024-09-21T06:34:42.884506+0000","last_became_peered":"2024-09-21T06:34:42.884506+0000","last_unstale":"2024-09-21T06:34:46.185197+0000","last_undegraded":"2024-09-21T06:34:46.185197+0000","last_fullsized":"2024-09-21T06:34:46.185197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:14.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.956171+0000","last_change":"2024-09-21T06:34:40.891408+0000","last_active":"2024-09-21T06:34:50.956171+0000","last_peered":"2024-09-21T06:34:50.956171+0000","last_clean":"2024-09-21T06:34:50.956171+0000","last_became_active":"2024-09-21T06:34:40.891016+0000","last_became_peered":"2024-09-21T06:34:40.891016+0000","last_unstale":"2024-09-21T06:34:50.956171+0000","last_undegraded":"2024-09-21T06:34:50.956171+0000","last_fullsized":"2024-09-21T06:34:50.956171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:51.712869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905559+0000","last_change":"2024-09-21T06:34:42.880047+0000","last_active":"2024-09-21T06:34:43.905559+0000","last_peered":"2024-09-21T06:34:43.905559+0000","last_clean":"2024-09-21T06:34:43.905559+0000","last_became_active":"2024-09-21T06:34:42.879664+0000","last_became_peered":"2024-09-21T06:34:42.879664+0000","last_unstale":"2024-09-21T06:34:43.905559+0000","last_undegraded":"2024-09-21T06:34:43.905559+0000","last_fullsized":"2024-09-21T06:34:43.905559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:03.621493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'6","reported_seq":25,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:58.911597+0000","last_change":"2024-09-21T06:34:40.877199+0000","last_active":"2024-09-21T06:34:58.911597+0000","last_peered":"2024-09-21T06:34:58.911597+0000","last_clean":"2024-09-21T06:34:58.911597+0000","last_became_active":"2024-09-21T06:34:40.876811+0000","last_became_peered":"2024-09-21T06:34:40.876811+0000","last_unstale":"2024-09-21T06:34:58.911597+0000","last_undegraded":"2024-09-21T06:34:58.911597+0000","last_fullsized":"2024-09-21T06:34:58.911597+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:03.917619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917851+0000","last_change":"2024-09-21T06:34:42.892033+0000","last_active":"2024-09-21T06:34:43.917851+0000","last_peered":"2024-09-21T06:34:43.917851+0000","last_clean":"2024-09-21T06:34:43.917851+0000","last_became_active":"2024-09-21T06:34:42.891631+0000","last_became_peered":"2024-09-21T06:34:42.891631+0000","last_unstale":"2024-09-21T06:34:43.917851+0000","last_undegraded":"2024-09-21T06:34:43.917851+0000","last_fullsized":"2024-09-21T06:34:43.917851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:05.621754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.955066+0000","last_change":"2024-09-21T06:34:40.869754+0000","last_active":"2024-09-21T06:34:50.955066+0000","last_peered":"2024-09-21T06:34:50.955066+0000","last_clean":"2024-09-21T06:34:50.955066+0000","last_became_active":"2024-09-21T06:34:40.869311+0000","last_became_peered":"2024-09-21T06:34:40.869311+0000","last_unstale":"2024-09-21T06:34:50.955066+0000","last_undegraded":"2024-09-21T06:34:50.955066+0000","last_fullsized":"2024-09-21T06:34:50.955066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:10.959880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918692+0000","last_change":"2024-09-21T06:34:42.889198+0000","last_active":"2024-09-21T06:34:43.918692+0000","last_peered":"2024-09-21T06:34:43.918692+0000","last_clean":"2024-09-21T06:34:43.918692+0000","last_became_active":"2024-09-21T06:34:42.888813+0000","last_became_peered":"2024-09-21T06:34:42.888813+0000","last_unstale":"2024-09-21T06:34:43.918692+0000","last_undegraded":"2024-09-21T06:34:43.918692+0000","last_fullsized":"2024-09-21T06:34:43.918692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:25.270225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.958524+0000","last_change":"2024-09-21T06:34:40.892267+0000","last_active":"2024-09-21T06:34:50.958524+0000","last_peered":"2024-09-21T06:34:50.958524+0000","last_clean":"2024-09-21T06:34:50.958524+0000","last_became_active":"2024-09-21T06:34:40.891791+0000","last_became_peered":"2024-09-21T06:34:40.891791+0000","last_unstale":"2024-09-21T06:34:50.958524+0000","last_undegraded":"2024-09-21T06:34:50.958524+0000","last_fullsized":"2024-09-21T06:34:50.958524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:07.864647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919935+0000","last_change":"2024-09-21T06:34:42.894361+0000","last_active":"2024-09-21T06:34:43.919935+0000","last_peered":"2024-09-21T06:34:43.919935+0000","last_clean":"2024-09-21T06:34:43.919935+0000","last_became_active":"2024-09-21T06:34:42.893976+0000","last_became_peered":"2024-09-21T06:34:42.893976+0000","last_unstale":"2024-09-21T06:34:43.919935+0000","last_undegraded":"2024-09-21T06:34:43.919935+0000","last_fullsized":"2024-09-21T06:34:43.919935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:32.741495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.957922+0000","last_change":"2024-09-21T06:34:40.875952+0000","last_active":"2024-09-21T06:34:50.957922+0000","last_peered":"2024-09-21T06:34:50.957922+0000","last_clean":"2024-09-21T06:34:50.957922+0000","last_became_active":"2024-09-21T06:34:40.875598+0000","last_became_peered":"2024-09-21T06:34:40.875598+0000","last_unstale":"2024-09-21T06:34:50.957922+0000","last_undegraded":"2024-09-21T06:34:50.957922+0000","last_fullsized":"2024-09-21T06:34:50.957922+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:29.873037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916594+0000","last_change":"2024-09-21T06:34:42.887639+0000","last_active":"2024-09-21T06:34:43.916594+0000","last_peered":"2024-09-21T06:34:43.916594+0000","last_clean":"2024-09-21T06:34:43.916594+0000","last_became_active":"2024-09-21T06:34:42.887201+0000","last_became_peered":"2024-09-21T06:34:42.887201+0000","last_unstale":"2024-09-21T06:34:43.916594+0000","last_undegraded":"2024-09-21T06:34:43.916594+0000","last_fullsized":"2024-09-21T06:34:43.916594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:59.431007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916337+0000","last_change":"2024-09-21T06:34:40.880145+0000","last_active":"2024-09-21T06:34:43.916337+0000","last_peered":"2024-09-21T06:34:43.916337+0000","last_clean":"2024-09-21T06:34:43.916337+0000","last_became_active":"2024-09-21T06:34:40.879480+0000","last_became_peered":"2024-09-21T06:34:40.879480+0000","last_unstale":"2024-09-21T06:34:43.916337+0000","last_undegraded":"2024-09-21T06:34:43.916337+0000","last_fullsized":"2024-09-21T06:34:43.916337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.551228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917821+0000","last_change":"2024-09-21T06:34:42.882455+0000","last_active":"2024-09-21T06:34:43.917821+0000","last_peered":"2024-09-21T06:34:43.917821+0000","last_clean":"2024-09-21T06:34:43.917821+0000","last_became_active":"2024-09-21T06:34:42.880714+0000","last_became_peered":"2024-09-21T06:34:42.880714+0000","last_unstale":"2024-09-21T06:34:43.917821+0000","last_undegraded":"2024-09-21T06:34:43.917821+0000","last_fullsized":"2024-09-21T06:34:43.917821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:39.264152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.957419+0000","last_change":"2024-09-21T06:34:40.879560+0000","last_active":"2024-09-21T06:34:50.957419+0000","last_peered":"2024-09-21T06:34:50.957419+0000","last_clean":"2024-09-21T06:34:50.957419+0000","last_became_active":"2024-09-21T06:34:40.878433+0000","last_became_peered":"2024-09-21T06:34:40.878433+0000","last_unstale":"2024-09-21T06:34:50.957419+0000","last_undegraded":"2024-09-21T06:34:50.957419+0000","last_fullsized":"2024-09-21T06:34:50.957419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:07.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917703+0000","last_change":"2024-09-21T06:34:42.896193+0000","last_active":"2024-09-21T06:34:43.917703+0000","last_peered":"2024-09-21T06:34:43.917703+0000","last_clean":"2024-09-21T06:34:43.917703+0000","last_became_active":"2024-09-21T06:34:42.895753+0000","last_became_peered":"2024-09-21T06:34:42.895753+0000","last_unstale":"2024-09-21T06:34:43.917703+0000","last_undegraded":"2024-09-21T06:34:43.917703+0000","last_fullsized":"2024-09-21T06:34:43.917703+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:47.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.907715+0000","last_change":"2024-09-21T06:34:42.898653+0000","last_active":"2024-09-21T06:34:43.907715+0000","last_peered":"2024-09-21T06:34:43.907715+0000","last_clean":"2024-09-21T06:34:43.907715+0000","last_became_active":"2024-09-21T06:34:42.898272+0000","last_became_peered":"2024-09-21T06:34:42.898272+0000","last_unstale":"2024-09-21T06:34:43.907715+0000","last_undegraded":"2024-09-21T06:34:43.907715+0000","last_fullsized":"2024-09-21T06:34:43.907715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:40.134130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.925061+0000","last_change":"2024-09-21T06:34:40.879386+0000","last_active":"2024-09-21T06:34:43.925061+0000","last_peered":"2024-09-21T06:34:43.925061+0000","last_clean":"2024-09-21T06:34:43.925061+0000","last_became_active":"2024-09-21T06:34:40.879001+0000","last_became_peered":"2024-09-21T06:34:40.879001+0000","last_unstale":"2024-09-21T06:34:43.925061+0000","last_undegraded":"2024-09-21T06:34:43.925061+0000","last_fullsized":"2024-09-21T06:34:43.925061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:48.438361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.923978+0000","last_change":"2024-09-21T06:34:42.901595+0000","last_active":"2024-09-21T06:34:43.923978+0000","last_peered":"2024-09-21T06:34:43.923978+0000","last_clean":"2024-09-21T06:34:43.923978+0000","last_became_active":"2024-09-21T06:34:42.901200+0000","last_became_peered":"2024-09-21T06:34:42.901200+0000","last_unstale":"2024-09-21T06:34:43.923978+0000","last_undegraded":"2024-09-21T06:34:43.923978+0000","last_fullsized":"2024-09-21T06:34:43.923978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:12.044528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965923+0000","last_change":"2024-09-21T06:34:40.878959+0000","last_active":"2024-09-21T06:34:51.965923+0000","last_peered":"2024-09-21T06:34:51.965923+0000","last_clean":"2024-09-21T06:34:51.965923+0000","last_became_active":"2024-09-21T06:34:40.878343+0000","last_became_peered":"2024-09-21T06:34:40.878343+0000","last_unstale":"2024-09-21T06:34:51.965923+0000","last_undegraded":"2024-09-21T06:34:51.965923+0000","last_fullsized":"2024-09-21T06:34:51.965923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:54.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.920019+0000","last_change":"2024-09-21T06:34:42.887868+0000","last_active":"2024-09-21T06:34:43.920019+0000","last_peered":"2024-09-21T06:34:43.920019+0000","last_clean":"2024-09-21T06:34:43.920019+0000","last_became_active":"2024-09-21T06:34:42.887268+0000","last_became_peered":"2024-09-21T06:34:42.887268+0000","last_unstale":"2024-09-21T06:34:43.920019+0000","last_undegraded":"2024-09-21T06:34:43.920019+0000","last_fullsized":"2024-09-21T06:34:43.920019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:41.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.660115+0000","last_change":"2024-09-21T06:34:40.890363+0000","last_active":"2024-09-21T06:34:44.660115+0000","last_peered":"2024-09-21T06:34:44.660115+0000","last_clean":"2024-09-21T06:34:44.660115+0000","last_became_active":"2024-09-21T06:34:40.889967+0000","last_became_peered":"2024-09-21T06:34:40.889967+0000","last_unstale":"2024-09-21T06:34:44.660115+0000","last_undegraded":"2024-09-21T06:34:44.660115+0000","last_fullsized":"2024-09-21T06:34:44.660115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:01.806399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917499+0000","last_change":"2024-09-21T06:34:42.891211+0000","last_active":"2024-09-21T06:34:43.917499+0000","last_peered":"2024-09-21T06:34:43.917499+0000","last_clean":"2024-09-21T06:34:43.917499+0000","last_became_active":"2024-09-21T06:34:42.890813+0000","last_became_peered":"2024-09-21T06:34:42.890813+0000","last_unstale":"2024-09-21T06:34:43.917499+0000","last_undegraded":"2024-09-21T06:34:43.917499+0000","last_fullsized":"2024-09-21T06:34:43.917499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965769+0000","last_change":"2024-09-21T06:34:40.878074+0000","last_active":"2024-09-21T06:34:51.965769+0000","last_peered":"2024-09-21T06:34:51.965769+0000","last_clean":"2024-09-21T06:34:51.965769+0000","last_became_active":"2024-09-21T06:34:40.877688+0000","last_became_peered":"2024-09-21T06:34:40.877688+0000","last_unstale":"2024-09-21T06:34:51.965769+0000","last_undegraded":"2024-09-21T06:34:51.965769+0000","last_fullsized":"2024-09-21T06:34:51.965769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:01.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":33016,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":80,"num_read_kb":78,"num_write":140,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":153494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776145,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":391712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939668,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28452,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716700,"statfs":{"total":95995035648,"available":95965900800,"internally_reserved":0,"allocated":1462272,"data_stored":1012208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070490,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":391948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266718,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":391868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430244,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712592,"statfs":{"total":95995035648,"available":95961694208,"internally_reserved":0,"allocated":1409024,"data_stored":983798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626473,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":391337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":1421312,"data_stored":983482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986227,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":391774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":391648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378686,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":449109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":447368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":392608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":30593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:35:08.476 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:35:08.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:08 smithi098 ceph-mon[34704]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:08.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:08 smithi079 ceph-mon[34346]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:08.734 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:09.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.179+0000 7fea8de13640 1 -- 172.21.15.49:0/2844785524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea881049c0 msgr2=0x7fea88104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.179+0000 7fea8de13640 1 --2- 172.21.15.49:0/2844785524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea881049c0 0x7fea88104dd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fea78009ca0 tx=0x7fea7802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.179+0000 7fea8de13640 1 -- 172.21.15.49:0/2844785524 shutdown_connections 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.179+0000 7fea8de13640 1 --2- 172.21.15.49:0/2844785524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea8810de20 0x7fea88110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.179+0000 7fea8de13640 1 --2- 172.21.15.49:0/2844785524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88105310 0x7fea8810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.179+0000 7fea8de13640 1 --2- 172.21.15.49:0/2844785524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea881049c0 0x7fea88104dd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.179+0000 7fea8de13640 1 -- 172.21.15.49:0/2844785524 >> 172.21.15.49:0/2844785524 conn(0x7fea88079730 msgr2=0x7fea88079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.179+0000 7fea8de13640 1 -- 172.21.15.49:0/2844785524 shutdown_connections 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.179+0000 7fea8de13640 1 -- 172.21.15.49:0/2844785524 wait complete. 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.180+0000 7fea8de13640 1 Processor -- start 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.180+0000 7fea8de13640 1 -- start start 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea8de13640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea881049c0 0x7fea88102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea8de13640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88105310 0x7fea88102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea8de13640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8810de20 0x7fea88103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea8de13640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fea88113aa0 con 0x7fea8810de20 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea8de13640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fea88113920 con 0x7fea88105310 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea8de13640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fea88113c20 con 0x7fea881049c0 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea87fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8810de20 0x7fea88103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea87fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8810de20 0x7fea88103180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38910/0 (socket says 172.21.15.49:38910) 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea87fff640 1 -- 172.21.15.49:0/367156282 learned_addr learned my addr 172.21.15.49:0/367156282 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea877fe640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea881049c0 0x7fea88102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea86ffd640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88105310 0x7fea88102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea87fff640 1 -- 172.21.15.49:0/367156282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea881049c0 msgr2=0x7fea88102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea87fff640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea881049c0 0x7fea88102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea87fff640 1 -- 172.21.15.49:0/367156282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88105310 msgr2=0x7fea88102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea87fff640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88105310 0x7fea88102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea87fff640 1 -- 172.21.15.49:0/367156282 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea881a8750 con 0x7fea8810de20 2024-09-21T06:35:09.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.181+0000 7fea87fff640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8810de20 0x7fea88103180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fea8000d750 tx=0x7fea8000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.182+0000 7fea84ff9640 1 -- 172.21.15.49:0/367156282 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea80017070 con 0x7fea8810de20 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.182+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea881a8a40 con 0x7fea8810de20 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.182+0000 7fea84ff9640 1 -- 172.21.15.49:0/367156282 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea800054d0 con 0x7fea8810de20 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.182+0000 7fea84ff9640 1 -- 172.21.15.49:0/367156282 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea80004c60 con 0x7fea8810de20 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.182+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea881a8f80 con 0x7fea8810de20 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.183+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8806c1e0 con 0x7fea8810de20 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.185+0000 7fea84ff9640 1 -- 172.21.15.49:0/367156282 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fea80009bd0 con 0x7fea8810de20 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.186+0000 7fea84ff9640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fea740b65f0 0x7fea740b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.186+0000 7fea877fe640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fea740b65f0 0x7fea740b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.186+0000 7fea84ff9640 1 -- 172.21.15.49:0/367156282 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7fea800e7190 con 0x7fea8810de20 2024-09-21T06:35:09.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.187+0000 7fea877fe640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fea740b65f0 0x7fea740b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea78000f80 tx=0x7fea78009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:09.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.190+0000 7fea84ff9640 1 -- 172.21.15.49:0/367156282 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea800b1cc0 con 0x7fea8810de20 2024-09-21T06:35:09.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.377+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea88063800 con 0x7fea740b65f0 2024-09-21T06:35:09.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.382+0000 7fea84ff9640 1 -- 172.21.15.49:0/367156282 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258677 (secure 0 0 0) 0x7fea88063800 con 0x7fea740b65f0 2024-09-21T06:35:09.386 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:09.387 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-09-21T06:35:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fea740b65f0 msgr2=0x7fea740b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fea740b65f0 0x7fea740b8b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fea78000f80 tx=0x7fea78009360 comp rx=0 tx=0).stop 2024-09-21T06:35:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8810de20 msgr2=0x7fea88103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8810de20 0x7fea88103180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fea8000d750 tx=0x7fea8000dc10 comp rx=0 tx=0).stop 2024-09-21T06:35:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 shutdown_connections 2024-09-21T06:35:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fea740b65f0 0x7fea740b8b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fea8810de20 0x7fea88103180 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fea88105310 0x7fea88102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 --2- 172.21.15.49:0/367156282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fea881049c0 0x7fea88102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 >> 172.21.15.49:0/367156282 conn(0x7fea88079730 msgr2=0x7fea881007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 shutdown_connections 2024-09-21T06:35:09.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:09.386+0000 7fea8de13640 1 -- 172.21.15.49:0/367156282 wait complete. 2024-09-21T06:35:09.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:09 smithi049 ceph-mon[31177]: pgmap v270: 97 pgs: 97 active+clean; 636 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.5 KiB/s wr, 13 op/s 2024-09-21T06:35:09.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:09 smithi098 ceph-mon[34704]: pgmap v270: 97 pgs: 97 active+clean; 636 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.5 KiB/s wr, 13 op/s 2024-09-21T06:35:09.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:09 smithi079 ceph-mon[34346]: pgmap v270: 97 pgs: 97 active+clean; 636 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.5 KiB/s wr, 13 op/s 2024-09-21T06:35:10.030 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":270,"stamp":"2024-09-21T06:35:08.110404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650841,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":193,"num_read_kb":189,"num_write":282,"num_write_kb":2256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356560,"kb_used_data":11472,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585264,"statfs":{"total":1151940427776,"available":1151575310336,"internally_reserved":0,"allocated":11747328,"data_stored":6646083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55985,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":109,"num_read_kb":117,"num_write":48,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003045"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917367+0000","last_change":"2024-09-21T06:34:42.895466+0000","last_active":"2024-09-21T06:34:43.917367+0000","last_peered":"2024-09-21T06:34:43.917367+0000","last_clean":"2024-09-21T06:34:43.917367+0000","last_became_active":"2024-09-21T06:34:42.895084+0000","last_became_peered":"2024-09-21T06:34:42.895084+0000","last_unstale":"2024-09-21T06:34:43.917367+0000","last_undegraded":"2024-09-21T06:34:43.917367+0000","last_fullsized":"2024-09-21T06:34:43.917367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.513107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918459+0000","last_change":"2024-09-21T06:34:42.888307+0000","last_active":"2024-09-21T06:34:43.918459+0000","last_peered":"2024-09-21T06:34:43.918459+0000","last_clean":"2024-09-21T06:34:43.918459+0000","last_became_active":"2024-09-21T06:34:42.886106+0000","last_became_peered":"2024-09-21T06:34:42.886106+0000","last_unstale":"2024-09-21T06:34:43.918459+0000","last_undegraded":"2024-09-21T06:34:43.918459+0000","last_fullsized":"2024-09-21T06:34:43.918459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:57.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919099+0000","last_change":"2024-09-21T06:34:42.897217+0000","last_active":"2024-09-21T06:34:43.919099+0000","last_peered":"2024-09-21T06:34:43.919099+0000","last_clean":"2024-09-21T06:34:43.919099+0000","last_became_active":"2024-09-21T06:34:42.896849+0000","last_became_peered":"2024-09-21T06:34:42.896849+0000","last_unstale":"2024-09-21T06:34:43.919099+0000","last_undegraded":"2024-09-21T06:34:43.919099+0000","last_fullsized":"2024-09-21T06:34:43.919099+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:28.749566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908228+0000","last_change":"2024-09-21T06:34:42.887236+0000","last_active":"2024-09-21T06:34:43.908228+0000","last_peered":"2024-09-21T06:34:43.908228+0000","last_clean":"2024-09-21T06:34:43.908228+0000","last_became_active":"2024-09-21T06:34:42.886137+0000","last_became_peered":"2024-09-21T06:34:42.886137+0000","last_unstale":"2024-09-21T06:34:43.908228+0000","last_undegraded":"2024-09-21T06:34:43.908228+0000","last_fullsized":"2024-09-21T06:34:43.908228+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:23.728433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919987+0000","last_change":"2024-09-21T06:34:42.885792+0000","last_active":"2024-09-21T06:34:43.919987+0000","last_peered":"2024-09-21T06:34:43.919987+0000","last_clean":"2024-09-21T06:34:43.919987+0000","last_became_active":"2024-09-21T06:34:42.885372+0000","last_became_peered":"2024-09-21T06:34:42.885372+0000","last_unstale":"2024-09-21T06:34:43.919987+0000","last_undegraded":"2024-09-21T06:34:43.919987+0000","last_fullsized":"2024-09-21T06:34:43.919987+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:29.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917621+0000","last_change":"2024-09-21T06:34:42.896814+0000","last_active":"2024-09-21T06:34:43.917621+0000","last_peered":"2024-09-21T06:34:43.917621+0000","last_clean":"2024-09-21T06:34:43.917621+0000","last_became_active":"2024-09-21T06:34:42.896147+0000","last_became_peered":"2024-09-21T06:34:42.896147+0000","last_unstale":"2024-09-21T06:34:43.917621+0000","last_undegraded":"2024-09-21T06:34:43.917621+0000","last_fullsized":"2024-09-21T06:34:43.917621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:49.037539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917503+0000","last_change":"2024-09-21T06:34:42.896264+0000","last_active":"2024-09-21T06:34:43.917503+0000","last_peered":"2024-09-21T06:34:43.917503+0000","last_clean":"2024-09-21T06:34:43.917503+0000","last_became_active":"2024-09-21T06:34:42.895793+0000","last_became_peered":"2024-09-21T06:34:42.895793+0000","last_unstale":"2024-09-21T06:34:43.917503+0000","last_undegraded":"2024-09-21T06:34:43.917503+0000","last_fullsized":"2024-09-21T06:34:43.917503+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:06.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.915557+0000","last_change":"2024-09-21T06:34:42.892538+0000","last_active":"2024-09-21T06:34:43.915557+0000","last_peered":"2024-09-21T06:34:43.915557+0000","last_clean":"2024-09-21T06:34:43.915557+0000","last_became_active":"2024-09-21T06:34:42.892139+0000","last_became_peered":"2024-09-21T06:34:42.892139+0000","last_unstale":"2024-09-21T06:34:43.915557+0000","last_undegraded":"2024-09-21T06:34:43.915557+0000","last_fullsized":"2024-09-21T06:34:43.915557+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:51.808969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.923851+0000","last_change":"2024-09-21T06:34:42.900198+0000","last_active":"2024-09-21T06:34:43.923851+0000","last_peered":"2024-09-21T06:34:43.923851+0000","last_clean":"2024-09-21T06:34:43.923851+0000","last_became_active":"2024-09-21T06:34:42.899837+0000","last_became_peered":"2024-09-21T06:34:42.899837+0000","last_unstale":"2024-09-21T06:34:43.923851+0000","last_undegraded":"2024-09-21T06:34:43.923851+0000","last_fullsized":"2024-09-21T06:34:43.923851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:20.762470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919185+0000","last_change":"2024-09-21T06:34:42.895533+0000","last_active":"2024-09-21T06:34:43.919185+0000","last_peered":"2024-09-21T06:34:43.919185+0000","last_clean":"2024-09-21T06:34:43.919185+0000","last_became_active":"2024-09-21T06:34:42.895162+0000","last_became_peered":"2024-09-21T06:34:42.895162+0000","last_unstale":"2024-09-21T06:34:43.919185+0000","last_undegraded":"2024-09-21T06:34:43.919185+0000","last_fullsized":"2024-09-21T06:34:43.919185+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:25.495493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918180+0000","last_change":"2024-09-21T06:34:42.894173+0000","last_active":"2024-09-21T06:34:43.918180+0000","last_peered":"2024-09-21T06:34:43.918180+0000","last_clean":"2024-09-21T06:34:43.918180+0000","last_became_active":"2024-09-21T06:34:42.893817+0000","last_became_peered":"2024-09-21T06:34:42.893817+0000","last_unstale":"2024-09-21T06:34:43.918180+0000","last_undegraded":"2024-09-21T06:34:43.918180+0000","last_fullsized":"2024-09-21T06:34:43.918180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:31.580564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908339+0000","last_change":"2024-09-21T06:34:42.886536+0000","last_active":"2024-09-21T06:34:43.908339+0000","last_peered":"2024-09-21T06:34:43.908339+0000","last_clean":"2024-09-21T06:34:43.908339+0000","last_became_active":"2024-09-21T06:34:42.885636+0000","last_became_peered":"2024-09-21T06:34:42.885636+0000","last_unstale":"2024-09-21T06:34:43.908339+0000","last_undegraded":"2024-09-21T06:34:43.908339+0000","last_fullsized":"2024-09-21T06:34:43.908339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:11.074850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905532+0000","last_change":"2024-09-21T06:34:42.882665+0000","last_active":"2024-09-21T06:34:43.905532+0000","last_peered":"2024-09-21T06:34:43.905532+0000","last_clean":"2024-09-21T06:34:43.905532+0000","last_became_active":"2024-09-21T06:34:42.882254+0000","last_became_peered":"2024-09-21T06:34:42.882254+0000","last_unstale":"2024-09-21T06:34:43.905532+0000","last_undegraded":"2024-09-21T06:34:43.905532+0000","last_fullsized":"2024-09-21T06:34:43.905532+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:01.203542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916610+0000","last_change":"2024-09-21T06:34:42.884034+0000","last_active":"2024-09-21T06:34:43.916610+0000","last_peered":"2024-09-21T06:34:43.916610+0000","last_clean":"2024-09-21T06:34:43.916610+0000","last_became_active":"2024-09-21T06:34:42.883685+0000","last_became_peered":"2024-09-21T06:34:42.883685+0000","last_unstale":"2024-09-21T06:34:43.916610+0000","last_undegraded":"2024-09-21T06:34:43.916610+0000","last_fullsized":"2024-09-21T06:34:43.916610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:00.124019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916636+0000","last_change":"2024-09-21T06:34:42.894686+0000","last_active":"2024-09-21T06:34:43.916636+0000","last_peered":"2024-09-21T06:34:43.916636+0000","last_clean":"2024-09-21T06:34:43.916636+0000","last_became_active":"2024-09-21T06:34:42.893980+0000","last_became_peered":"2024-09-21T06:34:42.893980+0000","last_unstale":"2024-09-21T06:34:43.916636+0000","last_undegraded":"2024-09-21T06:34:43.916636+0000","last_fullsized":"2024-09-21T06:34:43.916636+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:00.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.921631+0000","last_change":"2024-09-21T06:34:42.891462+0000","last_active":"2024-09-21T06:34:43.921631+0000","last_peered":"2024-09-21T06:34:43.921631+0000","last_clean":"2024-09-21T06:34:43.921631+0000","last_became_active":"2024-09-21T06:34:42.891085+0000","last_became_peered":"2024-09-21T06:34:42.891085+0000","last_unstale":"2024-09-21T06:34:43.921631+0000","last_undegraded":"2024-09-21T06:34:43.921631+0000","last_fullsized":"2024-09-21T06:34:43.921631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:03.942909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917660+0000","last_change":"2024-09-21T06:34:42.897049+0000","last_active":"2024-09-21T06:34:43.917660+0000","last_peered":"2024-09-21T06:34:43.917660+0000","last_clean":"2024-09-21T06:34:43.917660+0000","last_became_active":"2024-09-21T06:34:42.896131+0000","last_became_peered":"2024-09-21T06:34:42.896131+0000","last_unstale":"2024-09-21T06:34:43.917660+0000","last_undegraded":"2024-09-21T06:34:43.917660+0000","last_fullsized":"2024-09-21T06:34:43.917660+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:47.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919333+0000","last_change":"2024-09-21T06:34:42.887894+0000","last_active":"2024-09-21T06:34:43.919333+0000","last_peered":"2024-09-21T06:34:43.919333+0000","last_clean":"2024-09-21T06:34:43.919333+0000","last_became_active":"2024-09-21T06:34:42.887436+0000","last_became_peered":"2024-09-21T06:34:42.887436+0000","last_unstale":"2024-09-21T06:34:43.919333+0000","last_undegraded":"2024-09-21T06:34:43.919333+0000","last_fullsized":"2024-09-21T06:34:43.919333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:22.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916272+0000","last_change":"2024-09-21T06:34:42.888071+0000","last_active":"2024-09-21T06:34:43.916272+0000","last_peered":"2024-09-21T06:34:43.916272+0000","last_clean":"2024-09-21T06:34:43.916272+0000","last_became_active":"2024-09-21T06:34:42.887295+0000","last_became_peered":"2024-09-21T06:34:42.887295+0000","last_unstale":"2024-09-21T06:34:43.916272+0000","last_undegraded":"2024-09-21T06:34:43.916272+0000","last_fullsized":"2024-09-21T06:34:43.916272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:49.937367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916191+0000","last_change":"2024-09-21T06:34:42.891963+0000","last_active":"2024-09-21T06:34:43.916191+0000","last_peered":"2024-09-21T06:34:43.916191+0000","last_clean":"2024-09-21T06:34:43.916191+0000","last_became_active":"2024-09-21T06:34:42.891603+0000","last_became_peered":"2024-09-21T06:34:42.891603+0000","last_unstale":"2024-09-21T06:34:43.916191+0000","last_undegraded":"2024-09-21T06:34:43.916191+0000","last_fullsized":"2024-09-21T06:34:43.916191+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:47.608523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905487+0000","last_change":"2024-09-21T06:34:42.895909+0000","last_active":"2024-09-21T06:34:43.905487+0000","last_peered":"2024-09-21T06:34:43.905487+0000","last_clean":"2024-09-21T06:34:43.905487+0000","last_became_active":"2024-09-21T06:34:42.895477+0000","last_became_peered":"2024-09-21T06:34:42.895477+0000","last_unstale":"2024-09-21T06:34:43.905487+0000","last_undegraded":"2024-09-21T06:34:43.905487+0000","last_fullsized":"2024-09-21T06:34:43.905487+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.284523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.923459+0000","last_change":"2024-09-21T06:34:42.893554+0000","last_active":"2024-09-21T06:34:43.923459+0000","last_peered":"2024-09-21T06:34:43.923459+0000","last_clean":"2024-09-21T06:34:43.923459+0000","last_became_active":"2024-09-21T06:34:42.892949+0000","last_became_peered":"2024-09-21T06:34:42.892949+0000","last_unstale":"2024-09-21T06:34:43.923459+0000","last_undegraded":"2024-09-21T06:34:43.923459+0000","last_fullsized":"2024-09-21T06:34:43.923459+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:57.107590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916014+0000","last_change":"2024-09-21T06:34:42.894574+0000","last_active":"2024-09-21T06:34:43.916014+0000","last_peered":"2024-09-21T06:34:43.916014+0000","last_clean":"2024-09-21T06:34:43.916014+0000","last_became_active":"2024-09-21T06:34:42.894027+0000","last_became_peered":"2024-09-21T06:34:42.894027+0000","last_unstale":"2024-09-21T06:34:43.916014+0000","last_undegraded":"2024-09-21T06:34:43.916014+0000","last_fullsized":"2024-09-21T06:34:43.916014+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:58.425792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.907661+0000","last_change":"2024-09-21T06:34:42.893029+0000","last_active":"2024-09-21T06:34:43.907661+0000","last_peered":"2024-09-21T06:34:43.907661+0000","last_clean":"2024-09-21T06:34:43.907661+0000","last_became_active":"2024-09-21T06:34:42.892428+0000","last_became_peered":"2024-09-21T06:34:42.892428+0000","last_unstale":"2024-09-21T06:34:43.907661+0000","last_undegraded":"2024-09-21T06:34:43.907661+0000","last_fullsized":"2024-09-21T06:34:43.907661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:11:33.414088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917613+0000","last_change":"2024-09-21T06:34:42.894347+0000","last_active":"2024-09-21T06:34:43.917613+0000","last_peered":"2024-09-21T06:34:43.917613+0000","last_clean":"2024-09-21T06:34:43.917613+0000","last_became_active":"2024-09-21T06:34:42.893966+0000","last_became_peered":"2024-09-21T06:34:42.893966+0000","last_unstale":"2024-09-21T06:34:43.917613+0000","last_undegraded":"2024-09-21T06:34:43.917613+0000","last_fullsized":"2024-09-21T06:34:43.917613+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:13:15.862407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916833+0000","last_change":"2024-09-21T06:34:42.888826+0000","last_active":"2024-09-21T06:34:43.916833+0000","last_peered":"2024-09-21T06:34:43.916833+0000","last_clean":"2024-09-21T06:34:43.916833+0000","last_became_active":"2024-09-21T06:34:42.888447+0000","last_became_peered":"2024-09-21T06:34:42.888447+0000","last_unstale":"2024-09-21T06:34:43.916833+0000","last_undegraded":"2024-09-21T06:34:43.916833+0000","last_fullsized":"2024-09-21T06:34:43.916833+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:52.634516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916805+0000","last_change":"2024-09-21T06:34:42.889377+0000","last_active":"2024-09-21T06:34:43.916805+0000","last_peered":"2024-09-21T06:34:43.916805+0000","last_clean":"2024-09-21T06:34:43.916805+0000","last_became_active":"2024-09-21T06:34:42.888978+0000","last_became_peered":"2024-09-21T06:34:42.888978+0000","last_unstale":"2024-09-21T06:34:43.916805+0000","last_undegraded":"2024-09-21T06:34:43.916805+0000","last_fullsized":"2024-09-21T06:34:43.916805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:34.734283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905511+0000","last_change":"2024-09-21T06:34:42.878128+0000","last_active":"2024-09-21T06:34:43.905511+0000","last_peered":"2024-09-21T06:34:43.905511+0000","last_clean":"2024-09-21T06:34:43.905511+0000","last_became_active":"2024-09-21T06:34:42.877742+0000","last_became_peered":"2024-09-21T06:34:42.877742+0000","last_unstale":"2024-09-21T06:34:43.905511+0000","last_undegraded":"2024-09-21T06:34:43.905511+0000","last_fullsized":"2024-09-21T06:34:43.905511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:04.992402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918058+0000","last_change":"2024-09-21T06:34:42.882659+0000","last_active":"2024-09-21T06:34:43.918058+0000","last_peered":"2024-09-21T06:34:43.918058+0000","last_clean":"2024-09-21T06:34:43.918058+0000","last_became_active":"2024-09-21T06:34:42.882306+0000","last_became_peered":"2024-09-21T06:34:42.882306+0000","last_unstale":"2024-09-21T06:34:43.918058+0000","last_undegraded":"2024-09-21T06:34:43.918058+0000","last_fullsized":"2024-09-21T06:34:43.918058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:31.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916119+0000","last_change":"2024-09-21T06:34:42.890089+0000","last_active":"2024-09-21T06:34:43.916119+0000","last_peered":"2024-09-21T06:34:43.916119+0000","last_clean":"2024-09-21T06:34:43.916119+0000","last_became_active":"2024-09-21T06:34:42.889739+0000","last_became_peered":"2024-09-21T06:34:42.889739+0000","last_unstale":"2024-09-21T06:34:43.916119+0000","last_undegraded":"2024-09-21T06:34:43.916119+0000","last_fullsized":"2024-09-21T06:34:43.916119+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.212760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917101+0000","last_change":"2024-09-21T06:34:42.881260+0000","last_active":"2024-09-21T06:34:43.917101+0000","last_peered":"2024-09-21T06:34:43.917101+0000","last_clean":"2024-09-21T06:34:43.917101+0000","last_became_active":"2024-09-21T06:34:42.880831+0000","last_became_peered":"2024-09-21T06:34:42.880831+0000","last_unstale":"2024-09-21T06:34:43.917101+0000","last_undegraded":"2024-09-21T06:34:43.917101+0000","last_fullsized":"2024-09-21T06:34:43.917101+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:50:05.650463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916344+0000","last_change":"2024-09-21T06:34:42.893859+0000","last_active":"2024-09-21T06:34:43.916344+0000","last_peered":"2024-09-21T06:34:43.916344+0000","last_clean":"2024-09-21T06:34:43.916344+0000","last_became_active":"2024-09-21T06:34:42.893485+0000","last_became_peered":"2024-09-21T06:34:42.893485+0000","last_unstale":"2024-09-21T06:34:43.916344+0000","last_undegraded":"2024-09-21T06:34:43.916344+0000","last_fullsized":"2024-09-21T06:34:43.916344+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:59.936750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.920663+0000","last_change":"2024-09-21T06:34:42.887164+0000","last_active":"2024-09-21T06:34:43.920663+0000","last_peered":"2024-09-21T06:34:43.920663+0000","last_clean":"2024-09-21T06:34:43.920663+0000","last_became_active":"2024-09-21T06:34:42.886314+0000","last_became_peered":"2024-09-21T06:34:42.886314+0000","last_unstale":"2024-09-21T06:34:43.920663+0000","last_undegraded":"2024-09-21T06:34:43.920663+0000","last_fullsized":"2024-09-21T06:34:43.920663+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:09.529922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":43,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:35:05.994624+0000","last_change":"2024-09-21T06:34:40.883170+0000","last_active":"2024-09-21T06:35:05.994624+0000","last_peered":"2024-09-21T06:35:05.994624+0000","last_clean":"2024-09-21T06:35:05.994624+0000","last_became_active":"2024-09-21T06:34:40.882760+0000","last_became_peered":"2024-09-21T06:34:40.882760+0000","last_unstale":"2024-09-21T06:35:05.994624+0000","last_undegraded":"2024-09-21T06:35:05.994624+0000","last_fullsized":"2024-09-21T06:35:05.994624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:41.388275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908174+0000","last_change":"2024-09-21T06:34:42.893842+0000","last_active":"2024-09-21T06:34:43.908174+0000","last_peered":"2024-09-21T06:34:43.908174+0000","last_clean":"2024-09-21T06:34:43.908174+0000","last_became_active":"2024-09-21T06:34:42.893501+0000","last_became_peered":"2024-09-21T06:34:42.893501+0000","last_unstale":"2024-09-21T06:34:43.908174+0000","last_undegraded":"2024-09-21T06:34:43.908174+0000","last_fullsized":"2024-09-21T06:34:43.908174+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.610084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965072+0000","last_change":"2024-09-21T06:34:40.878685+0000","last_active":"2024-09-21T06:34:51.965072+0000","last_peered":"2024-09-21T06:34:51.965072+0000","last_clean":"2024-09-21T06:34:51.965072+0000","last_became_active":"2024-09-21T06:34:40.878279+0000","last_became_peered":"2024-09-21T06:34:40.878279+0000","last_unstale":"2024-09-21T06:34:51.965072+0000","last_undegraded":"2024-09-21T06:34:51.965072+0000","last_fullsized":"2024-09-21T06:34:51.965072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:11.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.963202+0000","last_change":"2024-09-21T06:34:40.872074+0000","last_active":"2024-09-21T06:34:51.963202+0000","last_peered":"2024-09-21T06:34:51.963202+0000","last_clean":"2024-09-21T06:34:51.963202+0000","last_became_active":"2024-09-21T06:34:40.871637+0000","last_became_peered":"2024-09-21T06:34:40.871637+0000","last_unstale":"2024-09-21T06:34:51.963202+0000","last_undegraded":"2024-09-21T06:34:51.963202+0000","last_fullsized":"2024-09-21T06:34:51.963202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.915904+0000","last_change":"2024-09-21T06:34:42.882803+0000","last_active":"2024-09-21T06:34:43.915904+0000","last_peered":"2024-09-21T06:34:43.915904+0000","last_clean":"2024-09-21T06:34:43.915904+0000","last_became_active":"2024-09-21T06:34:42.881509+0000","last_became_peered":"2024-09-21T06:34:42.881509+0000","last_unstale":"2024-09-21T06:34:43.915904+0000","last_undegraded":"2024-09-21T06:34:43.915904+0000","last_fullsized":"2024-09-21T06:34:43.915904+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908429+0000","last_change":"2024-09-21T06:34:40.883054+0000","last_active":"2024-09-21T06:34:43.908429+0000","last_peered":"2024-09-21T06:34:43.908429+0000","last_clean":"2024-09-21T06:34:43.908429+0000","last_became_active":"2024-09-21T06:34:40.882299+0000","last_became_peered":"2024-09-21T06:34:40.882299+0000","last_unstale":"2024-09-21T06:34:43.908429+0000","last_undegraded":"2024-09-21T06:34:43.908429+0000","last_fullsized":"2024-09-21T06:34:43.908429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:17.813744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918692+0000","last_change":"2024-09-21T06:34:42.886437+0000","last_active":"2024-09-21T06:34:43.918692+0000","last_peered":"2024-09-21T06:34:43.918692+0000","last_clean":"2024-09-21T06:34:43.918692+0000","last_became_active":"2024-09-21T06:34:42.886075+0000","last_became_peered":"2024-09-21T06:34:42.886075+0000","last_unstale":"2024-09-21T06:34:43.918692+0000","last_undegraded":"2024-09-21T06:34:43.918692+0000","last_fullsized":"2024-09-21T06:34:43.918692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.179323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":36,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:35:04.992662+0000","last_change":"2024-09-21T06:34:40.880931+0000","last_active":"2024-09-21T06:35:04.992662+0000","last_peered":"2024-09-21T06:35:04.992662+0000","last_clean":"2024-09-21T06:35:04.992662+0000","last_became_active":"2024-09-21T06:34:40.880555+0000","last_became_peered":"2024-09-21T06:34:40.880555+0000","last_unstale":"2024-09-21T06:35:04.992662+0000","last_undegraded":"2024-09-21T06:35:04.992662+0000","last_fullsized":"2024-09-21T06:35:04.992662+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:29.304297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.922300+0000","last_change":"2024-09-21T06:34:42.899618+0000","last_active":"2024-09-21T06:34:43.922300+0000","last_peered":"2024-09-21T06:34:43.922300+0000","last_clean":"2024-09-21T06:34:43.922300+0000","last_became_active":"2024-09-21T06:34:42.899230+0000","last_became_peered":"2024-09-21T06:34:42.899230+0000","last_unstale":"2024-09-21T06:34:43.922300+0000","last_undegraded":"2024-09-21T06:34:43.922300+0000","last_fullsized":"2024-09-21T06:34:43.922300+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:27.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.958657+0000","last_change":"2024-09-21T06:34:40.882988+0000","last_active":"2024-09-21T06:34:50.958657+0000","last_peered":"2024-09-21T06:34:50.958657+0000","last_clean":"2024-09-21T06:34:50.958657+0000","last_became_active":"2024-09-21T06:34:40.882533+0000","last_became_peered":"2024-09-21T06:34:40.882533+0000","last_unstale":"2024-09-21T06:34:50.958657+0000","last_undegraded":"2024-09-21T06:34:50.958657+0000","last_fullsized":"2024-09-21T06:34:50.958657+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:23.220540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.920206+0000","last_change":"2024-09-21T06:34:42.889556+0000","last_active":"2024-09-21T06:34:43.920206+0000","last_peered":"2024-09-21T06:34:43.920206+0000","last_clean":"2024-09-21T06:34:43.920206+0000","last_became_active":"2024-09-21T06:34:42.888853+0000","last_became_peered":"2024-09-21T06:34:42.888853+0000","last_unstale":"2024-09-21T06:34:43.920206+0000","last_undegraded":"2024-09-21T06:34:43.920206+0000","last_fullsized":"2024-09-21T06:34:43.920206+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:24.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.958166+0000","last_change":"2024-09-21T06:34:40.891450+0000","last_active":"2024-09-21T06:34:50.958166+0000","last_peered":"2024-09-21T06:34:50.958166+0000","last_clean":"2024-09-21T06:34:50.958166+0000","last_became_active":"2024-09-21T06:34:40.890892+0000","last_became_peered":"2024-09-21T06:34:40.890892+0000","last_unstale":"2024-09-21T06:34:50.958166+0000","last_undegraded":"2024-09-21T06:34:50.958166+0000","last_fullsized":"2024-09-21T06:34:50.958166+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.975342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.923881+0000","last_change":"2024-09-21T06:34:42.893122+0000","last_active":"2024-09-21T06:34:43.923881+0000","last_peered":"2024-09-21T06:34:43.923881+0000","last_clean":"2024-09-21T06:34:43.923881+0000","last_became_active":"2024-09-21T06:34:42.892730+0000","last_became_peered":"2024-09-21T06:34:42.892730+0000","last_unstale":"2024-09-21T06:34:43.923881+0000","last_undegraded":"2024-09-21T06:34:43.923881+0000","last_fullsized":"2024-09-21T06:34:43.923881+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:06.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"74'26","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:35:05.999425+0000","last_change":"2024-09-21T06:34:40.881360+0000","last_active":"2024-09-21T06:35:05.999425+0000","last_peered":"2024-09-21T06:35:05.999425+0000","last_clean":"2024-09-21T06:35:05.999425+0000","last_became_active":"2024-09-21T06:34:40.880690+0000","last_became_peered":"2024-09-21T06:34:40.880690+0000","last_unstale":"2024-09-21T06:35:05.999425+0000","last_undegraded":"2024-09-21T06:35:05.999425+0000","last_fullsized":"2024-09-21T06:35:05.999425+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:46.081596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56238,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":71,"num_write":27,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.920977+0000","last_change":"2024-09-21T06:34:42.890487+0000","last_active":"2024-09-21T06:34:43.920977+0000","last_peered":"2024-09-21T06:34:43.920977+0000","last_clean":"2024-09-21T06:34:43.920977+0000","last_became_active":"2024-09-21T06:34:42.890100+0000","last_became_peered":"2024-09-21T06:34:42.890100+0000","last_unstale":"2024-09-21T06:34:43.920977+0000","last_undegraded":"2024-09-21T06:34:43.920977+0000","last_fullsized":"2024-09-21T06:34:43.920977+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.206869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":26,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965442+0000","last_change":"2024-09-21T06:34:40.876187+0000","last_active":"2024-09-21T06:34:51.965442+0000","last_peered":"2024-09-21T06:34:51.965442+0000","last_clean":"2024-09-21T06:34:51.965442+0000","last_became_active":"2024-09-21T06:34:40.875687+0000","last_became_peered":"2024-09-21T06:34:40.875687+0000","last_unstale":"2024-09-21T06:34:51.965442+0000","last_undegraded":"2024-09-21T06:34:51.965442+0000","last_fullsized":"2024-09-21T06:34:51.965442+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:51.758625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905176+0000","last_change":"2024-09-21T06:34:42.895900+0000","last_active":"2024-09-21T06:34:43.905176+0000","last_peered":"2024-09-21T06:34:43.905176+0000","last_clean":"2024-09-21T06:34:43.905176+0000","last_became_active":"2024-09-21T06:34:42.895504+0000","last_became_peered":"2024-09-21T06:34:42.895504+0000","last_unstale":"2024-09-21T06:34:43.905176+0000","last_undegraded":"2024-09-21T06:34:43.905176+0000","last_fullsized":"2024-09-21T06:34:43.905176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:28.414017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.957934+0000","last_change":"2024-09-21T06:34:40.882856+0000","last_active":"2024-09-21T06:34:50.957934+0000","last_peered":"2024-09-21T06:34:50.957934+0000","last_clean":"2024-09-21T06:34:50.957934+0000","last_became_active":"2024-09-21T06:34:40.882424+0000","last_became_peered":"2024-09-21T06:34:40.882424+0000","last_unstale":"2024-09-21T06:34:50.957934+0000","last_undegraded":"2024-09-21T06:34:50.957934+0000","last_fullsized":"2024-09-21T06:34:50.957934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:38.815928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918644+0000","last_change":"2024-09-21T06:34:42.890611+0000","last_active":"2024-09-21T06:34:43.918644+0000","last_peered":"2024-09-21T06:34:43.918644+0000","last_clean":"2024-09-21T06:34:43.918644+0000","last_became_active":"2024-09-21T06:34:42.890246+0000","last_became_peered":"2024-09-21T06:34:42.890246+0000","last_unstale":"2024-09-21T06:34:43.918644+0000","last_undegraded":"2024-09-21T06:34:43.918644+0000","last_fullsized":"2024-09-21T06:34:43.918644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:05.074903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":38,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:35:04.993035+0000","last_change":"2024-09-21T06:34:40.877003+0000","last_active":"2024-09-21T06:35:04.993035+0000","last_peered":"2024-09-21T06:35:04.993035+0000","last_clean":"2024-09-21T06:35:04.993035+0000","last_became_active":"2024-09-21T06:34:40.876516+0000","last_became_peered":"2024-09-21T06:34:40.876516+0000","last_unstale":"2024-09-21T06:35:04.993035+0000","last_undegraded":"2024-09-21T06:35:04.993035+0000","last_fullsized":"2024-09-21T06:35:04.993035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:14.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917048+0000","last_change":"2024-09-21T06:34:42.896816+0000","last_active":"2024-09-21T06:34:43.917048+0000","last_peered":"2024-09-21T06:34:43.917048+0000","last_clean":"2024-09-21T06:34:43.917048+0000","last_became_active":"2024-09-21T06:34:42.896329+0000","last_became_peered":"2024-09-21T06:34:42.896329+0000","last_unstale":"2024-09-21T06:34:43.917048+0000","last_undegraded":"2024-09-21T06:34:43.917048+0000","last_fullsized":"2024-09-21T06:34:43.917048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.462498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":35,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.966465+0000","last_change":"2024-09-21T06:34:40.892809+0000","last_active":"2024-09-21T06:34:51.966465+0000","last_peered":"2024-09-21T06:34:51.966465+0000","last_clean":"2024-09-21T06:34:51.966465+0000","last_became_active":"2024-09-21T06:34:40.892433+0000","last_became_peered":"2024-09-21T06:34:40.892433+0000","last_unstale":"2024-09-21T06:34:51.966465+0000","last_undegraded":"2024-09-21T06:34:51.966465+0000","last_fullsized":"2024-09-21T06:34:51.966465+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:43.744202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.907801+0000","last_change":"2024-09-21T06:34:42.898672+0000","last_active":"2024-09-21T06:34:43.907801+0000","last_peered":"2024-09-21T06:34:43.907801+0000","last_clean":"2024-09-21T06:34:43.907801+0000","last_became_active":"2024-09-21T06:34:42.898287+0000","last_became_peered":"2024-09-21T06:34:42.898287+0000","last_unstale":"2024-09-21T06:34:43.907801+0000","last_undegraded":"2024-09-21T06:34:43.907801+0000","last_fullsized":"2024-09-21T06:34:43.907801+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:23.657150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:52.972301+0000","last_change":"2024-09-21T06:34:40.876791+0000","last_active":"2024-09-21T06:34:52.972301+0000","last_peered":"2024-09-21T06:34:52.972301+0000","last_clean":"2024-09-21T06:34:52.972301+0000","last_became_active":"2024-09-21T06:34:40.876323+0000","last_became_peered":"2024-09-21T06:34:40.876323+0000","last_unstale":"2024-09-21T06:34:52.972301+0000","last_undegraded":"2024-09-21T06:34:52.972301+0000","last_fullsized":"2024-09-21T06:34:52.972301+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:20.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.915922+0000","last_change":"2024-09-21T06:34:42.893054+0000","last_active":"2024-09-21T06:34:43.915922+0000","last_peered":"2024-09-21T06:34:43.915922+0000","last_clean":"2024-09-21T06:34:43.915922+0000","last_became_active":"2024-09-21T06:34:42.892695+0000","last_became_peered":"2024-09-21T06:34:42.892695+0000","last_unstale":"2024-09-21T06:34:43.915922+0000","last_undegraded":"2024-09-21T06:34:43.915922+0000","last_fullsized":"2024-09-21T06:34:43.915922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:03:41.464109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.914951+0000","last_change":"2024-09-21T06:34:40.877644+0000","last_active":"2024-09-21T06:34:43.914951+0000","last_peered":"2024-09-21T06:34:43.914951+0000","last_clean":"2024-09-21T06:34:43.914951+0000","last_became_active":"2024-09-21T06:34:40.877238+0000","last_became_peered":"2024-09-21T06:34:40.877238+0000","last_unstale":"2024-09-21T06:34:43.914951+0000","last_undegraded":"2024-09-21T06:34:43.914951+0000","last_fullsized":"2024-09-21T06:34:43.914951+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:21.055801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919066+0000","last_change":"2024-09-21T06:34:42.892399+0000","last_active":"2024-09-21T06:34:43.919066+0000","last_peered":"2024-09-21T06:34:43.919066+0000","last_clean":"2024-09-21T06:34:43.919066+0000","last_became_active":"2024-09-21T06:34:42.891873+0000","last_became_peered":"2024-09-21T06:34:42.891873+0000","last_unstale":"2024-09-21T06:34:43.919066+0000","last_undegraded":"2024-09-21T06:34:43.919066+0000","last_fullsized":"2024-09-21T06:34:43.919066+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:09.684516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919444+0000","last_change":"2024-09-21T06:34:40.881603+0000","last_active":"2024-09-21T06:34:43.919444+0000","last_peered":"2024-09-21T06:34:43.919444+0000","last_clean":"2024-09-21T06:34:43.919444+0000","last_became_active":"2024-09-21T06:34:40.881226+0000","last_became_peered":"2024-09-21T06:34:40.881226+0000","last_unstale":"2024-09-21T06:34:43.919444+0000","last_undegraded":"2024-09-21T06:34:43.919444+0000","last_fullsized":"2024-09-21T06:34:43.919444+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:09.252102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917988+0000","last_change":"2024-09-21T06:34:42.897354+0000","last_active":"2024-09-21T06:34:43.917988+0000","last_peered":"2024-09-21T06:34:43.917988+0000","last_clean":"2024-09-21T06:34:43.917988+0000","last_became_active":"2024-09-21T06:34:42.896981+0000","last_became_peered":"2024-09-21T06:34:42.896981+0000","last_unstale":"2024-09-21T06:34:43.917988+0000","last_undegraded":"2024-09-21T06:34:43.917988+0000","last_fullsized":"2024-09-21T06:34:43.917988+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:07.598107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965481+0000","last_change":"2024-09-21T06:34:40.890831+0000","last_active":"2024-09-21T06:34:51.965481+0000","last_peered":"2024-09-21T06:34:51.965481+0000","last_clean":"2024-09-21T06:34:51.965481+0000","last_became_active":"2024-09-21T06:34:40.890420+0000","last_became_peered":"2024-09-21T06:34:40.890420+0000","last_unstale":"2024-09-21T06:34:51.965481+0000","last_undegraded":"2024-09-21T06:34:51.965481+0000","last_fullsized":"2024-09-21T06:34:51.965481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:17.822323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919428+0000","last_change":"2024-09-21T06:34:42.894825+0000","last_active":"2024-09-21T06:34:43.919428+0000","last_peered":"2024-09-21T06:34:43.919428+0000","last_clean":"2024-09-21T06:34:43.919428+0000","last_became_active":"2024-09-21T06:34:42.893347+0000","last_became_peered":"2024-09-21T06:34:42.893347+0000","last_unstale":"2024-09-21T06:34:43.919428+0000","last_undegraded":"2024-09-21T06:34:43.919428+0000","last_fullsized":"2024-09-21T06:34:43.919428+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:14.946035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":88,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917264+0000","last_change":"2024-09-21T06:33:33.165773+0000","last_active":"2024-09-21T06:34:43.917264+0000","last_peered":"2024-09-21T06:34:43.917264+0000","last_clean":"2024-09-21T06:34:43.917264+0000","last_became_active":"2024-09-21T06:33:33.159754+0000","last_became_peered":"2024-09-21T06:33:33.159754+0000","last_unstale":"2024-09-21T06:34:43.917264+0000","last_undegraded":"2024-09-21T06:34:43.917264+0000","last_fullsized":"2024-09-21T06:34:43.917264+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_clean_scrub_stamp":"2024-09-21T06:30:10.865158+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:15.953330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:52.972701+0000","last_change":"2024-09-21T06:34:40.876091+0000","last_active":"2024-09-21T06:34:52.972701+0000","last_peered":"2024-09-21T06:34:52.972701+0000","last_clean":"2024-09-21T06:34:52.972701+0000","last_became_active":"2024-09-21T06:34:40.875576+0000","last_became_peered":"2024-09-21T06:34:40.875576+0000","last_unstale":"2024-09-21T06:34:52.972701+0000","last_undegraded":"2024-09-21T06:34:52.972701+0000","last_fullsized":"2024-09-21T06:34:52.972701+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:34.392145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916629+0000","last_change":"2024-09-21T06:34:42.892283+0000","last_active":"2024-09-21T06:34:43.916629+0000","last_peered":"2024-09-21T06:34:43.916629+0000","last_clean":"2024-09-21T06:34:43.916629+0000","last_became_active":"2024-09-21T06:34:42.891839+0000","last_became_peered":"2024-09-21T06:34:42.891839+0000","last_unstale":"2024-09-21T06:34:43.916629+0000","last_undegraded":"2024-09-21T06:34:43.916629+0000","last_fullsized":"2024-09-21T06:34:43.916629+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:10.202352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.962645+0000","last_change":"2024-09-21T06:34:40.880967+0000","last_active":"2024-09-21T06:34:51.962645+0000","last_peered":"2024-09-21T06:34:51.962645+0000","last_clean":"2024-09-21T06:34:51.962645+0000","last_became_active":"2024-09-21T06:34:40.880351+0000","last_became_peered":"2024-09-21T06:34:40.880351+0000","last_unstale":"2024-09-21T06:34:51.962645+0000","last_undegraded":"2024-09-21T06:34:51.962645+0000","last_fullsized":"2024-09-21T06:34:51.962645+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:52.694732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905058+0000","last_change":"2024-09-21T06:34:42.876102+0000","last_active":"2024-09-21T06:34:43.905058+0000","last_peered":"2024-09-21T06:34:43.905058+0000","last_clean":"2024-09-21T06:34:43.905058+0000","last_became_active":"2024-09-21T06:34:42.875065+0000","last_became_peered":"2024-09-21T06:34:42.875065+0000","last_unstale":"2024-09-21T06:34:43.905058+0000","last_undegraded":"2024-09-21T06:34:43.905058+0000","last_fullsized":"2024-09-21T06:34:43.905058+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:23.867180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:35:06.995089+0000","last_change":"2024-09-21T06:34:40.890355+0000","last_active":"2024-09-21T06:35:06.995089+0000","last_peered":"2024-09-21T06:35:06.995089+0000","last_clean":"2024-09-21T06:35:06.995089+0000","last_became_active":"2024-09-21T06:34:40.889974+0000","last_became_peered":"2024-09-21T06:34:40.889974+0000","last_unstale":"2024-09-21T06:35:06.995089+0000","last_undegraded":"2024-09-21T06:35:06.995089+0000","last_fullsized":"2024-09-21T06:35:06.995089+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:58.349625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.908099+0000","last_change":"2024-09-21T06:34:42.899831+0000","last_active":"2024-09-21T06:34:43.908099+0000","last_peered":"2024-09-21T06:34:43.908099+0000","last_clean":"2024-09-21T06:34:43.908099+0000","last_became_active":"2024-09-21T06:34:42.899372+0000","last_became_peered":"2024-09-21T06:34:42.899372+0000","last_unstale":"2024-09-21T06:34:43.908099+0000","last_undegraded":"2024-09-21T06:34:43.908099+0000","last_fullsized":"2024-09-21T06:34:43.908099+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:50.165222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918550+0000","last_change":"2024-09-21T06:34:40.882380+0000","last_active":"2024-09-21T06:34:43.918550+0000","last_peered":"2024-09-21T06:34:43.918550+0000","last_clean":"2024-09-21T06:34:43.918550+0000","last_became_active":"2024-09-21T06:34:40.881463+0000","last_became_peered":"2024-09-21T06:34:40.881463+0000","last_unstale":"2024-09-21T06:34:43.918550+0000","last_undegraded":"2024-09-21T06:34:43.918550+0000","last_fullsized":"2024-09-21T06:34:43.918550+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:25.620174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918412+0000","last_change":"2024-09-21T06:34:42.897205+0000","last_active":"2024-09-21T06:34:43.918412+0000","last_peered":"2024-09-21T06:34:43.918412+0000","last_clean":"2024-09-21T06:34:43.918412+0000","last_became_active":"2024-09-21T06:34:42.896705+0000","last_became_peered":"2024-09-21T06:34:42.896705+0000","last_unstale":"2024-09-21T06:34:43.918412+0000","last_undegraded":"2024-09-21T06:34:43.918412+0000","last_fullsized":"2024-09-21T06:34:43.918412+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.333176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918646+0000","last_change":"2024-09-21T06:34:40.890356+0000","last_active":"2024-09-21T06:34:43.918646+0000","last_peered":"2024-09-21T06:34:43.918646+0000","last_clean":"2024-09-21T06:34:43.918646+0000","last_became_active":"2024-09-21T06:34:40.889963+0000","last_became_peered":"2024-09-21T06:34:40.889963+0000","last_unstale":"2024-09-21T06:34:43.918646+0000","last_undegraded":"2024-09-21T06:34:43.918646+0000","last_fullsized":"2024-09-21T06:34:43.918646+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:09.621779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:46.185197+0000","last_change":"2024-09-21T06:34:42.884933+0000","last_active":"2024-09-21T06:34:46.185197+0000","last_peered":"2024-09-21T06:34:46.185197+0000","last_clean":"2024-09-21T06:34:46.185197+0000","last_became_active":"2024-09-21T06:34:42.884506+0000","last_became_peered":"2024-09-21T06:34:42.884506+0000","last_unstale":"2024-09-21T06:34:46.185197+0000","last_undegraded":"2024-09-21T06:34:46.185197+0000","last_fullsized":"2024-09-21T06:34:46.185197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:14.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.956171+0000","last_change":"2024-09-21T06:34:40.891408+0000","last_active":"2024-09-21T06:34:50.956171+0000","last_peered":"2024-09-21T06:34:50.956171+0000","last_clean":"2024-09-21T06:34:50.956171+0000","last_became_active":"2024-09-21T06:34:40.891016+0000","last_became_peered":"2024-09-21T06:34:40.891016+0000","last_unstale":"2024-09-21T06:34:50.956171+0000","last_undegraded":"2024-09-21T06:34:50.956171+0000","last_fullsized":"2024-09-21T06:34:50.956171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:51.712869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.905559+0000","last_change":"2024-09-21T06:34:42.880047+0000","last_active":"2024-09-21T06:34:43.905559+0000","last_peered":"2024-09-21T06:34:43.905559+0000","last_clean":"2024-09-21T06:34:43.905559+0000","last_became_active":"2024-09-21T06:34:42.879664+0000","last_became_peered":"2024-09-21T06:34:42.879664+0000","last_unstale":"2024-09-21T06:34:43.905559+0000","last_undegraded":"2024-09-21T06:34:43.905559+0000","last_fullsized":"2024-09-21T06:34:43.905559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:03.621493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'9","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:35:05.912885+0000","last_change":"2024-09-21T06:34:40.877199+0000","last_active":"2024-09-21T06:35:05.912885+0000","last_peered":"2024-09-21T06:35:05.912885+0000","last_clean":"2024-09-21T06:35:05.912885+0000","last_became_active":"2024-09-21T06:34:40.876811+0000","last_became_peered":"2024-09-21T06:34:40.876811+0000","last_unstale":"2024-09-21T06:35:05.912885+0000","last_undegraded":"2024-09-21T06:35:05.912885+0000","last_fullsized":"2024-09-21T06:35:05.912885+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:03.917619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917851+0000","last_change":"2024-09-21T06:34:42.892033+0000","last_active":"2024-09-21T06:34:43.917851+0000","last_peered":"2024-09-21T06:34:43.917851+0000","last_clean":"2024-09-21T06:34:43.917851+0000","last_became_active":"2024-09-21T06:34:42.891631+0000","last_became_peered":"2024-09-21T06:34:42.891631+0000","last_unstale":"2024-09-21T06:34:43.917851+0000","last_undegraded":"2024-09-21T06:34:43.917851+0000","last_fullsized":"2024-09-21T06:34:43.917851+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:05.621754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.955066+0000","last_change":"2024-09-21T06:34:40.869754+0000","last_active":"2024-09-21T06:34:50.955066+0000","last_peered":"2024-09-21T06:34:50.955066+0000","last_clean":"2024-09-21T06:34:50.955066+0000","last_became_active":"2024-09-21T06:34:40.869311+0000","last_became_peered":"2024-09-21T06:34:40.869311+0000","last_unstale":"2024-09-21T06:34:50.955066+0000","last_undegraded":"2024-09-21T06:34:50.955066+0000","last_fullsized":"2024-09-21T06:34:50.955066+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:10.959880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.918692+0000","last_change":"2024-09-21T06:34:42.889198+0000","last_active":"2024-09-21T06:34:43.918692+0000","last_peered":"2024-09-21T06:34:43.918692+0000","last_clean":"2024-09-21T06:34:43.918692+0000","last_became_active":"2024-09-21T06:34:42.888813+0000","last_became_peered":"2024-09-21T06:34:42.888813+0000","last_unstale":"2024-09-21T06:34:43.918692+0000","last_undegraded":"2024-09-21T06:34:43.918692+0000","last_fullsized":"2024-09-21T06:34:43.918692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:25.270225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.958524+0000","last_change":"2024-09-21T06:34:40.892267+0000","last_active":"2024-09-21T06:34:50.958524+0000","last_peered":"2024-09-21T06:34:50.958524+0000","last_clean":"2024-09-21T06:34:50.958524+0000","last_became_active":"2024-09-21T06:34:40.891791+0000","last_became_peered":"2024-09-21T06:34:40.891791+0000","last_unstale":"2024-09-21T06:34:50.958524+0000","last_undegraded":"2024-09-21T06:34:50.958524+0000","last_fullsized":"2024-09-21T06:34:50.958524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:07.864647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.919935+0000","last_change":"2024-09-21T06:34:42.894361+0000","last_active":"2024-09-21T06:34:43.919935+0000","last_peered":"2024-09-21T06:34:43.919935+0000","last_clean":"2024-09-21T06:34:43.919935+0000","last_became_active":"2024-09-21T06:34:42.893976+0000","last_became_peered":"2024-09-21T06:34:42.893976+0000","last_unstale":"2024-09-21T06:34:43.919935+0000","last_undegraded":"2024-09-21T06:34:43.919935+0000","last_fullsized":"2024-09-21T06:34:43.919935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:32.741495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":22,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.957922+0000","last_change":"2024-09-21T06:34:40.875952+0000","last_active":"2024-09-21T06:34:50.957922+0000","last_peered":"2024-09-21T06:34:50.957922+0000","last_clean":"2024-09-21T06:34:50.957922+0000","last_became_active":"2024-09-21T06:34:40.875598+0000","last_became_peered":"2024-09-21T06:34:40.875598+0000","last_unstale":"2024-09-21T06:34:50.957922+0000","last_undegraded":"2024-09-21T06:34:50.957922+0000","last_fullsized":"2024-09-21T06:34:50.957922+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:29.873037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916594+0000","last_change":"2024-09-21T06:34:42.887639+0000","last_active":"2024-09-21T06:34:43.916594+0000","last_peered":"2024-09-21T06:34:43.916594+0000","last_clean":"2024-09-21T06:34:43.916594+0000","last_became_active":"2024-09-21T06:34:42.887201+0000","last_became_peered":"2024-09-21T06:34:42.887201+0000","last_unstale":"2024-09-21T06:34:43.916594+0000","last_undegraded":"2024-09-21T06:34:43.916594+0000","last_fullsized":"2024-09-21T06:34:43.916594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:59.431007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":20,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.916337+0000","last_change":"2024-09-21T06:34:40.880145+0000","last_active":"2024-09-21T06:34:43.916337+0000","last_peered":"2024-09-21T06:34:43.916337+0000","last_clean":"2024-09-21T06:34:43.916337+0000","last_became_active":"2024-09-21T06:34:40.879480+0000","last_became_peered":"2024-09-21T06:34:40.879480+0000","last_unstale":"2024-09-21T06:34:43.916337+0000","last_undegraded":"2024-09-21T06:34:43.916337+0000","last_fullsized":"2024-09-21T06:34:43.916337+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.551228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917821+0000","last_change":"2024-09-21T06:34:42.882455+0000","last_active":"2024-09-21T06:34:43.917821+0000","last_peered":"2024-09-21T06:34:43.917821+0000","last_clean":"2024-09-21T06:34:43.917821+0000","last_became_active":"2024-09-21T06:34:42.880714+0000","last_became_peered":"2024-09-21T06:34:42.880714+0000","last_unstale":"2024-09-21T06:34:43.917821+0000","last_undegraded":"2024-09-21T06:34:43.917821+0000","last_fullsized":"2024-09-21T06:34:43.917821+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:39.264152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":24,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:50.957419+0000","last_change":"2024-09-21T06:34:40.879560+0000","last_active":"2024-09-21T06:34:50.957419+0000","last_peered":"2024-09-21T06:34:50.957419+0000","last_clean":"2024-09-21T06:34:50.957419+0000","last_became_active":"2024-09-21T06:34:40.878433+0000","last_became_peered":"2024-09-21T06:34:40.878433+0000","last_unstale":"2024-09-21T06:34:50.957419+0000","last_undegraded":"2024-09-21T06:34:50.957419+0000","last_fullsized":"2024-09-21T06:34:50.957419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:07.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917703+0000","last_change":"2024-09-21T06:34:42.896193+0000","last_active":"2024-09-21T06:34:43.917703+0000","last_peered":"2024-09-21T06:34:43.917703+0000","last_clean":"2024-09-21T06:34:43.917703+0000","last_became_active":"2024-09-21T06:34:42.895753+0000","last_became_peered":"2024-09-21T06:34:42.895753+0000","last_unstale":"2024-09-21T06:34:43.917703+0000","last_undegraded":"2024-09-21T06:34:43.917703+0000","last_fullsized":"2024-09-21T06:34:43.917703+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:47.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.907715+0000","last_change":"2024-09-21T06:34:42.898653+0000","last_active":"2024-09-21T06:34:43.907715+0000","last_peered":"2024-09-21T06:34:43.907715+0000","last_clean":"2024-09-21T06:34:43.907715+0000","last_became_active":"2024-09-21T06:34:42.898272+0000","last_became_peered":"2024-09-21T06:34:42.898272+0000","last_unstale":"2024-09-21T06:34:43.907715+0000","last_undegraded":"2024-09-21T06:34:43.907715+0000","last_fullsized":"2024-09-21T06:34:43.907715+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:35:40.134130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.925061+0000","last_change":"2024-09-21T06:34:40.879386+0000","last_active":"2024-09-21T06:34:43.925061+0000","last_peered":"2024-09-21T06:34:43.925061+0000","last_clean":"2024-09-21T06:34:43.925061+0000","last_became_active":"2024-09-21T06:34:40.879001+0000","last_became_peered":"2024-09-21T06:34:40.879001+0000","last_unstale":"2024-09-21T06:34:43.925061+0000","last_undegraded":"2024-09-21T06:34:43.925061+0000","last_fullsized":"2024-09-21T06:34:43.925061+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:48.438361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.923978+0000","last_change":"2024-09-21T06:34:42.901595+0000","last_active":"2024-09-21T06:34:43.923978+0000","last_peered":"2024-09-21T06:34:43.923978+0000","last_clean":"2024-09-21T06:34:43.923978+0000","last_became_active":"2024-09-21T06:34:42.901200+0000","last_became_peered":"2024-09-21T06:34:42.901200+0000","last_unstale":"2024-09-21T06:34:43.923978+0000","last_undegraded":"2024-09-21T06:34:43.923978+0000","last_fullsized":"2024-09-21T06:34:43.923978+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:12.044528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":23,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965923+0000","last_change":"2024-09-21T06:34:40.878959+0000","last_active":"2024-09-21T06:34:51.965923+0000","last_peered":"2024-09-21T06:34:51.965923+0000","last_clean":"2024-09-21T06:34:51.965923+0000","last_became_active":"2024-09-21T06:34:40.878343+0000","last_became_peered":"2024-09-21T06:34:40.878343+0000","last_unstale":"2024-09-21T06:34:51.965923+0000","last_undegraded":"2024-09-21T06:34:51.965923+0000","last_fullsized":"2024-09-21T06:34:51.965923+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:54.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.920019+0000","last_change":"2024-09-21T06:34:42.887868+0000","last_active":"2024-09-21T06:34:43.920019+0000","last_peered":"2024-09-21T06:34:43.920019+0000","last_clean":"2024-09-21T06:34:43.920019+0000","last_became_active":"2024-09-21T06:34:42.887268+0000","last_became_peered":"2024-09-21T06:34:42.887268+0000","last_unstale":"2024-09-21T06:34:43.920019+0000","last_undegraded":"2024-09-21T06:34:43.920019+0000","last_fullsized":"2024-09-21T06:34:43.920019+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:41.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":21,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.660115+0000","last_change":"2024-09-21T06:34:40.890363+0000","last_active":"2024-09-21T06:34:44.660115+0000","last_peered":"2024-09-21T06:34:44.660115+0000","last_clean":"2024-09-21T06:34:44.660115+0000","last_became_active":"2024-09-21T06:34:40.889967+0000","last_became_peered":"2024-09-21T06:34:40.889967+0000","last_unstale":"2024-09-21T06:34:44.660115+0000","last_undegraded":"2024-09-21T06:34:44.660115+0000","last_fullsized":"2024-09-21T06:34:44.660115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:01.806399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:43.917499+0000","last_change":"2024-09-21T06:34:42.891211+0000","last_active":"2024-09-21T06:34:43.917499+0000","last_peered":"2024-09-21T06:34:43.917499+0000","last_clean":"2024-09-21T06:34:43.917499+0000","last_became_active":"2024-09-21T06:34:42.890813+0000","last_became_peered":"2024-09-21T06:34:42.890813+0000","last_unstale":"2024-09-21T06:34:43.917499+0000","last_undegraded":"2024-09-21T06:34:43.917499+0000","last_fullsized":"2024-09-21T06:34:43.917499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-09-21T06:34:51.965769+0000","last_change":"2024-09-21T06:34:40.878074+0000","last_active":"2024-09-21T06:34:51.965769+0000","last_peered":"2024-09-21T06:34:51.965769+0000","last_clean":"2024-09-21T06:34:51.965769+0000","last_became_active":"2024-09-21T06:34:40.877688+0000","last_became_peered":"2024-09-21T06:34:40.877688+0000","last_unstale":"2024-09-21T06:34:51.965769+0000","last_undegraded":"2024-09-21T06:34:51.965769+0000","last_fullsized":"2024-09-21T06:34:51.965769+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:01.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60239,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":112,"num_read_kb":120,"num_write":157,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":180717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776145,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":798720,"data_stored":391712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1490944,"data_stored":1039431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070491,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":391948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266719,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":391868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32560,"kb_used_data":1376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712592,"statfs":{"total":95995035648,"available":95961694208,"internally_reserved":0,"allocated":1409024,"data_stored":983798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":802816,"data_stored":391337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28412,"kb_used_data":1388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716740,"statfs":{"total":95995035648,"available":95965941760,"internally_reserved":0,"allocated":1421312,"data_stored":983482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986228,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":806912,"data_stored":391774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717328,"statfs":{"total":95995035648,"available":95966543872,"internally_reserved":0,"allocated":819200,"data_stored":391648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378686,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":884736,"data_stored":449109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542211,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":860160,"data_stored":447368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705736,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":823296,"data_stored":392608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":57979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:35:10.033 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:35:10.034 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T06:35:10.034 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T06:35:10.294 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:10.416 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:10 smithi049 ceph-mon[31177]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:10.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:10 smithi098 ceph-mon[34704]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:10.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:10 smithi079 ceph-mon[34346]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.721+0000 7f662c1bb640 1 -- 172.21.15.49:0/3246984771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624102f40 msgr2=0x7f662410fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.721+0000 7f662c1bb640 1 --2- 172.21.15.49:0/3246984771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624102f40 0x7f662410fc60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6614009900 tx=0x7f661402a480 comp rx=0 tx=0).stop 2024-09-21T06:35:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.721+0000 7f662c1bb640 1 -- 172.21.15.49:0/3246984771 shutdown_connections 2024-09-21T06:35:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.721+0000 7f662c1bb640 1 --2- 172.21.15.49:0/3246984771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f66241101a0 0x7f6624112640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.721+0000 7f662c1bb640 1 --2- 172.21.15.49:0/3246984771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624102f40 0x7f662410fc60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.721+0000 7f662c1bb640 1 --2- 172.21.15.49:0/3246984771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66241025f0 0x7f6624102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.721+0000 7f662c1bb640 1 -- 172.21.15.49:0/3246984771 >> 172.21.15.49:0/3246984771 conn(0x7f6624079720 msgr2=0x7f6624079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.721+0000 7f662c1bb640 1 -- 172.21.15.49:0/3246984771 shutdown_connections 2024-09-21T06:35:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.721+0000 7f662c1bb640 1 -- 172.21.15.49:0/3246984771 wait complete. 2024-09-21T06:35:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662c1bb640 1 Processor -- start 2024-09-21T06:35:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662c1bb640 1 -- start start 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662c1bb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66241025f0 0x7f662419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662c1bb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624102f40 0x7f662419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662c1bb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66241101a0 0x7f66241a2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662c1bb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6624115df0 con 0x7f66241101a0 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662c1bb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6624115c70 con 0x7f66241025f0 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662c1bb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6624115f70 con 0x7f6624102f40 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662a758640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66241101a0 0x7f66241a2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662a758640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66241101a0 0x7f66241a2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38922/0 (socket says 172.21.15.49:38922) 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662a758640 1 -- 172.21.15.49:0/1165247263 learned_addr learned my addr 172.21.15.49:0/1165247263 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f6629756640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624102f40 0x7f662419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f6629f57640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66241025f0 0x7f662419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662a758640 1 -- 172.21.15.49:0/1165247263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624102f40 msgr2=0x7f662419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662a758640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624102f40 0x7f662419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.722+0000 7f662a758640 1 -- 172.21.15.49:0/1165247263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66241025f0 msgr2=0x7f662419c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.723+0000 7f662a758640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66241025f0 0x7f662419c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.723+0000 7f662a758640 1 -- 172.21.15.49:0/1165247263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66241a26f0 con 0x7f66241101a0 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.723+0000 7f6629f57640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66241025f0 0x7f662419c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.723+0000 7f662a758640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66241101a0 0x7f66241a2080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f661c00cce0 tx=0x7f661c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.723+0000 7f661affd640 1 -- 172.21.15.49:0/1165247263 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c00f450 con 0x7f66241101a0 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.723+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66241a29e0 con 0x7f66241101a0 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.723+0000 7f661affd640 1 -- 172.21.15.49:0/1165247263 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f661c00faa0 con 0x7f66241101a0 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.723+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66241a9200 con 0x7f66241101a0 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.723+0000 7f661affd640 1 -- 172.21.15.49:0/1165247263 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c018b70 con 0x7f66241101a0 2024-09-21T06:35:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.724+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f662406c1c0 con 0x7f66241101a0 2024-09-21T06:35:10.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.727+0000 7f661affd640 1 -- 172.21.15.49:0/1165247263 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f661c00f5f0 con 0x7f66241101a0 2024-09-21T06:35:10.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.727+0000 7f661affd640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b6620 0x7f66100b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:10.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.728+0000 7f6629f57640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b6620 0x7f66100b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:10.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.728+0000 7f661affd640 1 -- 172.21.15.49:0/1165247263 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8194+0+0 (secure 0 0 0) 0x7f661c0e7c80 con 0x7f66241101a0 2024-09-21T06:35:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.728+0000 7f6629f57640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b6620 0x7f66100b8b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6620009930 tx=0x7f6620008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.731+0000 7f661affd640 1 -- 172.21.15.49:0/1165247263 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f661c014030 con 0x7f66241101a0 2024-09-21T06:35:10.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.989+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f6624102a00 con 0x7f66241101a0 2024-09-21T06:35:10.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.992+0000 7f661affd640 1 -- 172.21.15.49:0/1165247263 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f6624102a00 con 0x7f66241101a0 2024-09-21T06:35:10.994 INFO:teuthology.orchestra.run.smithi049.stdout:[client.0] 2024-09-21T06:35:10.994 INFO:teuthology.orchestra.run.smithi049.stdout: key = AQAeae5msLoSOxAAM/5B6U0leOgmB8gOBFrmyg== 2024-09-21T06:35:10.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.994+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b6620 msgr2=0x7f66100b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.994+0000 7f662c1bb640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b6620 0x7f66100b8b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6620009930 tx=0x7f6620008040 comp rx=0 tx=0).stop 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.994+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66241101a0 msgr2=0x7f66241a2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.994+0000 7f662c1bb640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66241101a0 0x7f66241a2080 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f661c00cce0 tx=0x7f661c00a620 comp rx=0 tx=0).stop 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.995+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 shutdown_connections 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.995+0000 7f662c1bb640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b6620 0x7f66100b8b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.995+0000 7f662c1bb640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f66241101a0 0x7f66241a2080 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.995+0000 7f662c1bb640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624102f40 0x7f662419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.995+0000 7f662c1bb640 1 --2- 172.21.15.49:0/1165247263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f66241025f0 0x7f662419c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.995+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 >> 172.21.15.49:0/1165247263 conn(0x7f6624079720 msgr2=0x7f6624108c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.995+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 shutdown_connections 2024-09-21T06:35:10.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:10.995+0000 7f662c1bb640 1 -- 172.21.15.49:0/1165247263 wait complete. 2024-09-21T06:35:11.308 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:11 smithi049 ceph-mon[31177]: pgmap v271: 97 pgs: 97 active+clean; 636 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-09-21T06:35:11.308 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:11 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1165247263' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:35:11.308 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:11 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1165247263' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:35:11.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:11 smithi098 ceph-mon[34704]: pgmap v271: 97 pgs: 97 active+clean; 636 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-09-21T06:35:11.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:11 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1165247263' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:35:11.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:11 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1165247263' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:35:11.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:11 smithi079 ceph-mon[34346]: pgmap v271: 97 pgs: 97 active+clean; 636 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.5 KiB/s wr, 7 op/s 2024-09-21T06:35:11.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:11 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1165247263' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:35:11.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:11 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1165247263' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:35:11.754 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:35:11.754 DEBUG:teuthology.orchestra.run.smithi049:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T06:35:11.754 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T06:35:11.796 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T06:35:12.096 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T06:35:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]} : dispatch 2024-09-21T06:35:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T06:35:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-09-21T06:35:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]} : dispatch 2024-09-21T06:35:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]} : dispatch 2024-09-21T06:35:12.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]} : dispatch 2024-09-21T06:35:12.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]} : dispatch 2024-09-21T06:35:12.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:12 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9, 5, 8]} : dispatch 2024-09-21T06:35:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T06:35:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]} : dispatch 2024-09-21T06:35:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T06:35:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-09-21T06:35:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]} : dispatch 2024-09-21T06:35:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]} : dispatch 2024-09-21T06:35:12.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]} : dispatch 2024-09-21T06:35:12.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]} : dispatch 2024-09-21T06:35:12.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:12 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9, 5, 8]} : dispatch 2024-09-21T06:35:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-21T06:35:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]} : dispatch 2024-09-21T06:35:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T06:35:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]} : dispatch 2024-09-21T06:35:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]} : dispatch 2024-09-21T06:35:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]} : dispatch 2024-09-21T06:35:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]} : dispatch 2024-09-21T06:35:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]} : dispatch 2024-09-21T06:35:12.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:12 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9, 5, 8]} : dispatch 2024-09-21T06:35:12.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.606+0000 7f97936a6640 1 -- 172.21.15.49:0/328317073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c105300 msgr2=0x7f978c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.606+0000 7f97936a6640 1 --2- 172.21.15.49:0/328317073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c105300 0x7f978c10d850 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9780009900 tx=0x7f978002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.606+0000 7f97936a6640 1 -- 172.21.15.49:0/328317073 shutdown_connections 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.606+0000 7f97936a6640 1 --2- 172.21.15.49:0/328317073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c10de10 0x7f978c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.606+0000 7f97936a6640 1 --2- 172.21.15.49:0/328317073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c105300 0x7f978c10d850 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.606+0000 7f97936a6640 1 --2- 172.21.15.49:0/328317073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f978c1049b0 0x7f978c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.606+0000 7f97936a6640 1 -- 172.21.15.49:0/328317073 >> 172.21.15.49:0/328317073 conn(0x7f978c079730 msgr2=0x7f978c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.606+0000 7f97936a6640 1 -- 172.21.15.49:0/328317073 shutdown_connections 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.606+0000 7f97936a6640 1 -- 172.21.15.49:0/328317073 wait complete. 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f97936a6640 1 Processor -- start 2024-09-21T06:35:12.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f97936a6640 1 -- start start 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f97936a6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c1049b0 0x7f978c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f97936a6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f978c105300 0x7f978c102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f97936a6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c10de10 0x7f978c103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f97936a6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f978c113a70 con 0x7f978c10de10 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f97936a6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f978c1138f0 con 0x7f978c105300 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f97936a6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f978c113bf0 con 0x7f978c1049b0 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f9791c43640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c10de10 0x7f978c103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f9791c43640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c10de10 0x7f978c103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38940/0 (socket says 172.21.15.49:38940) 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f9791c43640 1 -- 172.21.15.49:0/4135725687 learned_addr learned my addr 172.21.15.49:0/4135725687 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f9791442640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c1049b0 0x7f978c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.607+0000 7f9790c41640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f978c105300 0x7f978c102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f9791c43640 1 -- 172.21.15.49:0/4135725687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c1049b0 msgr2=0x7f978c1026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f9791c43640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c1049b0 0x7f978c1026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f9791c43640 1 -- 172.21.15.49:0/4135725687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f978c105300 msgr2=0x7f978c102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f9791c43640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f978c105300 0x7f978c102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f9791c43640 1 -- 172.21.15.49:0/4135725687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978c1a86b0 con 0x7f978c10de10 2024-09-21T06:35:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f9791c43640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c10de10 0x7f978c103170 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f977c009fd0 tx=0x7f977c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f978a7fc640 1 -- 172.21.15.49:0/4135725687 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c017070 con 0x7f978c10de10 2024-09-21T06:35:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f978a7fc640 1 -- 172.21.15.49:0/4135725687 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f977c003e20 con 0x7f978c10de10 2024-09-21T06:35:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978c1a89a0 con 0x7f978c10de10 2024-09-21T06:35:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f978a7fc640 1 -- 172.21.15.49:0/4135725687 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f977c010460 con 0x7f978c10de10 2024-09-21T06:35:12.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.608+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978c1a8eb0 con 0x7f978c10de10 2024-09-21T06:35:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.609+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978c104dc0 con 0x7f978c10de10 2024-09-21T06:35:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.611+0000 7f978a7fc640 1 -- 172.21.15.49:0/4135725687 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f977c003970 con 0x7f978c10de10 2024-09-21T06:35:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.612+0000 7f978a7fc640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97740b6670 0x7f97740b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.612+0000 7f9791442640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97740b6670 0x7f97740b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.612+0000 7f978a7fc640 1 -- 172.21.15.49:0/4135725687 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8463+0+0 (secure 0 0 0) 0x7f977c0e7240 con 0x7f978c10de10 2024-09-21T06:35:12.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.612+0000 7f9791442640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97740b6670 0x7f97740b8b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f978c104140 tx=0x7f9784005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:12.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.615+0000 7f978a7fc640 1 -- 172.21.15.49:0/4135725687 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f977c0b1cf0 con 0x7f978c10de10 2024-09-21T06:35:12.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.804+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f978c02e640 con 0x7f978c10de10 2024-09-21T06:35:12.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.804+0000 7f978a7fc640 1 -- 172.21.15.49:0/4135725687 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v53) ==== 86+0+133 (secure 0 0 0) 0x7f977c0b6c30 con 0x7f978c10de10 2024-09-21T06:35:12.806 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97740b6670 msgr2=0x7f97740b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97740b6670 0x7f97740b8b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f978c104140 tx=0x7f9784005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c10de10 msgr2=0x7f978c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c10de10 0x7f978c103170 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f977c009fd0 tx=0x7f977c00b260 comp rx=0 tx=0).stop 2024-09-21T06:35:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 shutdown_connections 2024-09-21T06:35:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f97740b6670 0x7f97740b8b80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f978c10de10 0x7f978c103170 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f978c105300 0x7f978c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 --2- 172.21.15.49:0/4135725687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f978c1049b0 0x7f978c1026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 >> 172.21.15.49:0/4135725687 conn(0x7f978c079730 msgr2=0x7f978c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 shutdown_connections 2024-09-21T06:35:12.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:12.807+0000 7f97936a6640 1 -- 172.21.15.49:0/4135725687 wait complete. 2024-09-21T06:35:13.431 INFO:teuthology.orchestra.run.smithi049.stdout:[{"version":53,"timestamp":"2024-09-21T06:34:33.663560+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T06:35:13.431 INFO:tasks.ceph_manager:config epoch is 53 2024-09-21T06:35:13.431 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T06:35:13.431 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T06:35:13.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: pgmap v272: 97 pgs: 97 active+clean; 644 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9, 5, 8]}]': finished 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:35:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:13 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4135725687' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:35:13.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: pgmap v272: 97 pgs: 97 active+clean; 644 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-21T06:35:13.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T06:35:13.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-09-21T06:35:13.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T06:35:13.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-21T06:35:13.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-21T06:35:13.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-09-21T06:35:13.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-09-21T06:35:13.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2024-09-21T06:35:13.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9, 5, 8]}]': finished 2024-09-21T06:35:13.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:35:13.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:13 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4135725687' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:35:13.692 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: pgmap v272: 97 pgs: 97 active+clean; 644 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.2 KiB/s wr, 9 op/s 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [3, 9]}]': finished 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 7]}]': finished 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 7]}]': finished 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.27", "id": [4, 6]}]': finished 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [1, 9, 5, 8]}]': finished 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:35:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:13 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4135725687' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:35:14.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 -- 172.21.15.49:0/3151116869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 msgr2=0x7f83d8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 --2- 172.21.15.49:0/3151116869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 0x7f83d8102ef0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009ca0 tx=0x7f83c802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 -- 172.21.15.49:0/3151116869 shutdown_connections 2024-09-21T06:35:14.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 --2- 172.21.15.49:0/3151116869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d8108d20 0x7f83d810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 --2- 172.21.15.49:0/3151116869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d81083d0 0x7f83d81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 --2- 172.21.15.49:0/3151116869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 0x7f83d8102ef0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 -- 172.21.15.49:0/3151116869 >> 172.21.15.49:0/3151116869 conn(0x7f83d8079760 msgr2=0x7f83d8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 -- 172.21.15.49:0/3151116869 shutdown_connections 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 -- 172.21.15.49:0/3151116869 wait complete. 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 Processor -- start 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.220+0000 7f83df70b640 1 -- start start 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83df70b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 0x7f83d81982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83df70b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d81083d0 0x7f83d8198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83df70b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d8108d20 0x7f83d819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83df70b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8111890 con 0x7f83d8102ae0 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83df70b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8111710 con 0x7f83d8108d20 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83df70b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8111a10 con 0x7f83d81083d0 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dd4a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 0x7f83d81982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dd4a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 0x7f83d81982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38968/0 (socket says 172.21.15.49:38968) 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dd4a7640 1 -- 172.21.15.49:0/3834787444 learned_addr learned my addr 172.21.15.49:0/3834787444 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83ddca8640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d8108d20 0x7f83d819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dcca6640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d81083d0 0x7f83d8198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dd4a7640 1 -- 172.21.15.49:0/3834787444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d81083d0 msgr2=0x7f83d8198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dd4a7640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d81083d0 0x7f83d8198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dd4a7640 1 -- 172.21.15.49:0/3834787444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d8108d20 msgr2=0x7f83d819dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dd4a7640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d8108d20 0x7f83d819dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dd4a7640 1 -- 172.21.15.49:0/3834787444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d819e210 con 0x7f83d8102ae0 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dcca6640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d81083d0 0x7f83d8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.221+0000 7f83dd4a7640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 0x7f83d81982a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f83c8006010 tx=0x7f83c80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.222+0000 7f83d67fc640 1 -- 172.21.15.49:0/3834787444 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8003bf0 con 0x7f83d8102ae0 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.222+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d819e4a0 con 0x7f83d8102ae0 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.222+0000 7f83d67fc640 1 -- 172.21.15.49:0/3834787444 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83c8003d90 con 0x7f83d8102ae0 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.222+0000 7f83d67fc640 1 -- 172.21.15.49:0/3834787444 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c802fc20 con 0x7f83d8102ae0 2024-09-21T06:35:14.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.222+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d81a4c60 con 0x7f83d8102ae0 2024-09-21T06:35:14.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.223+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d8103d10 con 0x7f83d8102ae0 2024-09-21T06:35:14.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.225+0000 7f83d67fc640 1 -- 172.21.15.49:0/3834787444 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f83c80046a0 con 0x7f83d8102ae0 2024-09-21T06:35:14.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.226+0000 7f83d67fc640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f83c00b8800 0x7f83c00bad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:14.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.226+0000 7f83dcca6640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f83c00b8800 0x7f83c00bad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:14.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.226+0000 7f83d67fc640 1 -- 172.21.15.49:0/3834787444 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f83c8108ba0 con 0x7f83d8102ae0 2024-09-21T06:35:14.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.227+0000 7f83dcca6640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f83c00b8800 0x7f83c00bad10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0058c0 tx=0x7f83cc005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:14.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.230+0000 7f83d67fc640 1 -- 172.21.15.49:0/3834787444 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83c8108e20 con 0x7f83d8102ae0 2024-09-21T06:35:14.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:14 smithi049 ceph-mon[31177]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:35:14.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.471+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f83d81993d0 con 0x7f83d8102ae0 2024-09-21T06:35:14.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.476+0000 7f83d67fc640 1 -- 172.21.15.49:0/3834787444 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v21) ==== 74+0+296449 (secure 0 0 0) 0x7f83c80cf190 con 0x7f83d8102ae0 2024-09-21T06:35:14.481 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f83c00b8800 msgr2=0x7f83c00bad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f83c00b8800 0x7f83c00bad10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0058c0 tx=0x7f83cc005850 comp rx=0 tx=0).stop 2024-09-21T06:35:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 msgr2=0x7f83d81982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 0x7f83d81982a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f83c8006010 tx=0x7f83c80319f0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 shutdown_connections 2024-09-21T06:35:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f83c00b8800 0x7f83c00bad10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f83d8108d20 0x7f83d819dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f83d81083d0 0x7f83d8198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 --2- 172.21.15.49:0/3834787444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f83d8102ae0 0x7f83d81982a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 >> 172.21.15.49:0/3834787444 conn(0x7f83d8079760 msgr2=0x7f83d8101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 shutdown_connections 2024-09-21T06:35:14.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:14.480+0000 7f83df70b640 1 -- 172.21.15.49:0/3834787444 wait complete. 2024-09-21T06:35:14.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:14 smithi098 ceph-mon[34704]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:35:14.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:14 smithi079 ceph-mon[34346]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:35:15.237 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":21,"flags":0,"active_gid":14226,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6800","nonce":202634858},{"type":"v1","addr":"172.21.15.49:6801","nonce":202634858}]},"active_addr":"172.21.15.49:6801/202634858","active_change":"2024-09-21T06:28:12.021044+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24142,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24164,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.49:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":1059228292}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":2993677180}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":851141113}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":3664457037}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.49:0","nonce":994308436}]}]} 2024-09-21T06:35:15.243 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T06:35:15.243 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T06:35:15.243 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:35:15.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:15 smithi049 ceph-mon[31177]: pgmap v275: 97 pgs: 5 peering, 92 active+clean; 644 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-21T06:35:15.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:15 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3834787444' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:35:15.498 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:15 smithi098 ceph-mon[34704]: pgmap v275: 97 pgs: 5 peering, 92 active+clean; 644 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-21T06:35:15.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:15 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3834787444' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:35:15.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:15 smithi079 ceph-mon[34346]: pgmap v275: 97 pgs: 5 peering, 92 active+clean; 644 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2024-09-21T06:35:15.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:15 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3834787444' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:35:15.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.927+0000 7fa085732640 1 -- 172.21.15.49:0/2930262882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 msgr2=0x7fa080102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.927+0000 7fa085732640 1 --2- 172.21.15.49:0/2930262882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 0x7fa080102e90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa070009ca0 tx=0x7fa07002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.927+0000 7fa085732640 1 -- 172.21.15.49:0/2930262882 shutdown_connections 2024-09-21T06:35:15.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.927+0000 7fa085732640 1 --2- 172.21.15.49:0/2930262882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa080108d10 0x7fa08010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.927+0000 7fa085732640 1 --2- 172.21.15.49:0/2930262882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0801083c0 0x7fa0801087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.927+0000 7fa085732640 1 --2- 172.21.15.49:0/2930262882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 0x7fa080102e90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.927+0000 7fa085732640 1 -- 172.21.15.49:0/2930262882 >> 172.21.15.49:0/2930262882 conn(0x7fa080079740 msgr2=0x7fa080079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:15.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.927+0000 7fa085732640 1 -- 172.21.15.49:0/2930262882 shutdown_connections 2024-09-21T06:35:15.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.927+0000 7fa085732640 1 -- 172.21.15.49:0/2930262882 wait complete. 2024-09-21T06:35:15.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.928+0000 7fa085732640 1 Processor -- start 2024-09-21T06:35:15.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.928+0000 7fa085732640 1 -- start start 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.928+0000 7fa085732640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 0x7fa080105e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.928+0000 7fa085732640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0801083c0 0x7fa080104430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.928+0000 7fa085732640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa080108d10 0x7fa080104970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.928+0000 7fa085732640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa080112980 con 0x7fa080102a80 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.928+0000 7fa085732640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa080112800 con 0x7fa0801083c0 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.928+0000 7fa085732640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa080112b00 con 0x7fa080108d10 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.928+0000 7fa07effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 0x7fa080105e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 0x7fa080105e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38974/0 (socket says 172.21.15.49:38974) 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07effd640 1 -- 172.21.15.49:0/4252171124 learned_addr learned my addr 172.21.15.49:0/4252171124 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07e7fc640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0801083c0 0x7fa080104430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07f7fe640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa080108d10 0x7fa080104970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07effd640 1 -- 172.21.15.49:0/4252171124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa080108d10 msgr2=0x7fa080104970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07effd640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa080108d10 0x7fa080104970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07effd640 1 -- 172.21.15.49:0/4252171124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0801083c0 msgr2=0x7fa080104430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07effd640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0801083c0 0x7fa080104430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07effd640 1 -- 172.21.15.49:0/4252171124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa080105190 con 0x7fa080102a80 2024-09-21T06:35:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07e7fc640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0801083c0 0x7fa080104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa07effd640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 0x7fa080105e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa070006010 tx=0x7fa0700319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa067fff640 1 -- 172.21.15.49:0/4252171124 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa070003bf0 con 0x7fa080102a80 2024-09-21T06:35:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa067fff640 1 -- 172.21.15.49:0/4252171124 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa070003d90 con 0x7fa080102a80 2024-09-21T06:35:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0801ace20 con 0x7fa080102a80 2024-09-21T06:35:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.929+0000 7fa067fff640 1 -- 172.21.15.49:0/4252171124 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07002fc20 con 0x7fa080102a80 2024-09-21T06:35:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.930+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0801ad2d0 con 0x7fa080102a80 2024-09-21T06:35:15.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.930+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa080103d00 con 0x7fa080102a80 2024-09-21T06:35:15.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.932+0000 7fa067fff640 1 -- 172.21.15.49:0/4252171124 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa0700046a0 con 0x7fa080102a80 2024-09-21T06:35:15.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.933+0000 7fa067fff640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0680b65f0 0x7fa0680b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.933+0000 7fa07e7fc640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0680b65f0 0x7fa0680b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.933+0000 7fa067fff640 1 -- 172.21.15.49:0/4252171124 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fa070108bc0 con 0x7fa080102a80 2024-09-21T06:35:15.935 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.933+0000 7fa07e7fc640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0680b65f0 0x7fa0680b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa080100b90 tx=0x7fa074005e50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.937 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:15.936+0000 7fa067fff640 1 -- 172.21.15.49:0/4252171124 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0700cf210 con 0x7fa080102a80 2024-09-21T06:35:16.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.123+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa080105730 con 0x7fa080102a80 2024-09-21T06:35:16.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.125+0000 7fa067fff640 1 -- 172.21.15.49:0/4252171124 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22926 (secure 0 0 0) 0x7fa0700d35f0 con 0x7fa080102a80 2024-09-21T06:35:16.127 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:16.127 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":76,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:35:13.227165+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9},{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0680b65f0 msgr2=0x7fa0680b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0680b65f0 0x7fa0680b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa080100b90 tx=0x7fa074005e50 comp rx=0 tx=0).stop 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 msgr2=0x7fa080105e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 0x7fa080105e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa070006010 tx=0x7fa0700319f0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 shutdown_connections 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0680b65f0 0x7fa0680b8b00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa080108d10 0x7fa080104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0801083c0 0x7fa080104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 --2- 172.21.15.49:0/4252171124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa080102a80 0x7fa080105e40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 >> 172.21.15.49:0/4252171124 conn(0x7fa080079740 msgr2=0x7fa080106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 shutdown_connections 2024-09-21T06:35:16.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:16.127+0000 7fa085732640 1 -- 172.21.15.49:0/4252171124 wait complete. 2024-09-21T06:35:16.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:16 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4252171124' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:16.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:16 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4252171124' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:16.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:16 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4252171124' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:16.780 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T06:35:16.780 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:35:17.051 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:17.461 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:17 smithi049 ceph-mon[31177]: pgmap v276: 97 pgs: 5 peering, 92 active+clean; 644 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-21T06:35:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.477+0000 7f662c2bf640 1 -- 172.21.15.49:0/3615752643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 msgr2=0x7f662410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.477+0000 7f662c2bf640 1 --2- 172.21.15.49:0/3615752643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 0x7f662410d8d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6618009900 tx=0x7f661802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.477+0000 7f662c2bf640 1 -- 172.21.15.49:0/3615752643 shutdown_connections 2024-09-21T06:35:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.477+0000 7f662c2bf640 1 --2- 172.21.15.49:0/3615752643 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f662410de60 0x7f6624110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.477+0000 7f662c2bf640 1 --2- 172.21.15.49:0/3615752643 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 0x7f662410d8d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.477+0000 7f662c2bf640 1 --2- 172.21.15.49:0/3615752643 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624104a30 0x7f6624104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.477+0000 7f662c2bf640 1 -- 172.21.15.49:0/3615752643 >> 172.21.15.49:0/3615752643 conn(0x7f66240797b0 msgr2=0x7f6624079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.477+0000 7f662c2bf640 1 -- 172.21.15.49:0/3615752643 shutdown_connections 2024-09-21T06:35:17.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.477+0000 7f662c2bf640 1 -- 172.21.15.49:0/3615752643 wait complete. 2024-09-21T06:35:17.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662c2bf640 1 Processor -- start 2024-09-21T06:35:17.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662c2bf640 1 -- start start 2024-09-21T06:35:17.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662c2bf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624104a30 0x7f662419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662c2bf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 0x7f662419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662c2bf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f662410de60 0x7f662419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662c2bf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6624113aa0 con 0x7f6624105380 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662c2bf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6624113920 con 0x7f662410de60 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662c2bf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6624113c20 con 0x7f6624104a30 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662985a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 0x7f662419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662985a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 0x7f662419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54256/0 (socket says 172.21.15.49:54256) 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.478+0000 7f662a05b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624104a30 0x7f662419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662985a640 1 -- 172.21.15.49:0/1078725485 learned_addr learned my addr 172.21.15.49:0/1078725485 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662a85c640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f662410de60 0x7f662419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662985a640 1 -- 172.21.15.49:0/1078725485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624104a30 msgr2=0x7f662419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662985a640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624104a30 0x7f662419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662985a640 1 -- 172.21.15.49:0/1078725485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f662410de60 msgr2=0x7f662419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662985a640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f662410de60 0x7f662419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662985a640 1 -- 172.21.15.49:0/1078725485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66241a0460 con 0x7f6624105380 2024-09-21T06:35:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662a05b640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624104a30 0x7f662419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662a85c640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f662410de60 0x7f662419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662985a640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 0x7f662419aa90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f661802a930 tx=0x7f6618004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f66177fe640 1 -- 172.21.15.49:0/1078725485 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661803f030 con 0x7f6624105380 2024-09-21T06:35:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f66177fe640 1 -- 172.21.15.49:0/1078725485 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6618003aa0 con 0x7f6624105380 2024-09-21T06:35:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66241a06f0 con 0x7f6624105380 2024-09-21T06:35:17.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.479+0000 7f66177fe640 1 -- 172.21.15.49:0/1078725485 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618035070 con 0x7f6624105380 2024-09-21T06:35:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.480+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66241a6eb0 con 0x7f6624105380 2024-09-21T06:35:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.481+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6624104e40 con 0x7f6624105380 2024-09-21T06:35:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.482+0000 7f66177fe640 1 -- 172.21.15.49:0/1078725485 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6618042030 con 0x7f6624105380 2024-09-21T06:35:17.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.483+0000 7f66177fe640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b65f0 0x7f66100b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.483+0000 7f662a05b640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b65f0 0x7f66100b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.483+0000 7f66177fe640 1 -- 172.21.15.49:0/1078725485 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f6618108090 con 0x7f6624105380 2024-09-21T06:35:17.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.484+0000 7f662a05b640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b65f0 0x7f66100b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6620005fd0 tx=0x7f662000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.486+0000 7f66177fe640 1 -- 172.21.15.49:0/1078725485 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66180ce780 con 0x7f6624105380 2024-09-21T06:35:17.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:17 smithi098 ceph-mon[34704]: pgmap v276: 97 pgs: 5 peering, 92 active+clean; 644 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-21T06:35:17.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:17 smithi079 ceph-mon[34346]: pgmap v276: 97 pgs: 5 peering, 92 active+clean; 644 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-09-21T06:35:17.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.698+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6624108f70 con 0x7f6624105380 2024-09-21T06:35:17.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.699+0000 7f66177fe640 1 -- 172.21.15.49:0/1078725485 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22926 (secure 0 0 0) 0x7f66180d2b60 con 0x7f6624105380 2024-09-21T06:35:17.701 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:17.701 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":76,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:35:13.227165+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9},{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:35:17.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b65f0 msgr2=0x7f66100b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b65f0 0x7f66100b8b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6620005fd0 tx=0x7f662000b390 comp rx=0 tx=0).stop 2024-09-21T06:35:17.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 msgr2=0x7f662419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 0x7f662419aa90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f661802a930 tx=0x7f6618004270 comp rx=0 tx=0).stop 2024-09-21T06:35:17.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 shutdown_connections 2024-09-21T06:35:17.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f66100b65f0 0x7f66100b8b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f662410de60 0x7f662419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6624105380 0x7f662419aa90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 --2- 172.21.15.49:0/1078725485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6624104a30 0x7f662419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 >> 172.21.15.49:0/1078725485 conn(0x7f66240797b0 msgr2=0x7f66241008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:17.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 shutdown_connections 2024-09-21T06:35:17.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:17.701+0000 7f662c2bf640 1 -- 172.21.15.49:0/1078725485 wait complete. 2024-09-21T06:35:18.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:18 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1078725485' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:18.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:18 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1078725485' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:18.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:18 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1078725485' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:18.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T06:35:18.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T06:35:18.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T06:35:18.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T06:35:18.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T06:35:18.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T06:35:18.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T06:35:18.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T06:35:18.601 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T06:35:18.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T06:35:18.602 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T06:35:18.603 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T06:35:19.315 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:19.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:19 smithi098 ceph-mon[34704]: pgmap v277: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-21T06:35:19.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:19 smithi079 ceph-mon[34346]: pgmap v277: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-21T06:35:19.602 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:19 smithi049 ceph-mon[31177]: pgmap v277: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.4 KiB/s wr, 6 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-21T06:35:19.616 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:19.623 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:19.623 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:19.624 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:19.624 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:19.625 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:19.627 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:19.652 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.864+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1490555286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43cc107b30 msgr2=0x7f43cc107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.864+0000 7f43d2ea0640 1 --2- 172.21.15.49:0/1490555286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43cc107b30 0x7f43cc107f40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009900 tx=0x7f43b802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.865+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1490555286 shutdown_connections 2024-09-21T06:35:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.865+0000 7f43d2ea0640 1 --2- 172.21.15.49:0/1490555286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc108480 0x7f43cc10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.865+0000 7f43d2ea0640 1 --2- 172.21.15.49:0/1490555286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43cc107b30 0x7f43cc107f40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.865+0000 7f43d2ea0640 1 --2- 172.21.15.49:0/1490555286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43cc1021f0 0x7f43cc102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.865+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1490555286 >> 172.21.15.49:0/1490555286 conn(0x7f43cc077c60 msgr2=0x7f43cc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.865+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1490555286 shutdown_connections 2024-09-21T06:35:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.865+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1490555286 wait complete. 2024-09-21T06:35:19.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.866+0000 7f43d2ea0640 1 Processor -- start 2024-09-21T06:35:19.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.866+0000 7f43d2ea0640 1 -- start start 2024-09-21T06:35:19.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d2ea0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43cc1021f0 0x7f43cc1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:19.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d2ea0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc107b30 0x7f43cc199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:19.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d2ea0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43cc108480 0x7f43cc19ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:19.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d2ea0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc112a10 con 0x7f43cc1021f0 2024-09-21T06:35:19.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d2ea0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc112890 con 0x7f43cc107b30 2024-09-21T06:35:19.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d2ea0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc112b90 con 0x7f43cc108480 2024-09-21T06:35:19.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d0c3c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43cc1021f0 0x7f43cc1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d0c3c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43cc1021f0 0x7f43cc1993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54278/0 (socket says 172.21.15.49:54278) 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d0c3c640 1 -- 172.21.15.49:0/1848390573 learned_addr learned my addr 172.21.15.49:0/1848390573 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43cbfff640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc107b30 0x7f43cc199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d143d640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43cc108480 0x7f43cc19ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d0c3c640 1 -- 172.21.15.49:0/1848390573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43cc108480 msgr2=0x7f43cc19ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d0c3c640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43cc108480 0x7f43cc19ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d0c3c640 1 -- 172.21.15.49:0/1848390573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc107b30 msgr2=0x7f43cc199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d0c3c640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc107b30 0x7f43cc199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43d0c3c640 1 -- 172.21.15.49:0/1848390573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc19f310 con 0x7f43cc1021f0 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.867+0000 7f43cbfff640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43cc107b30 0x7f43cc199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:19.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.868+0000 7f43d0c3c640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43cc1021f0 0x7f43cc1993a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c890 tx=0x7f43c000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.868+0000 7f43c9ffb640 1 -- 172.21.15.49:0/1848390573 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0004220 con 0x7f43cc1021f0 2024-09-21T06:35:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.868+0000 7f43c9ffb640 1 -- 172.21.15.49:0/1848390573 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43c00043c0 con 0x7f43cc1021f0 2024-09-21T06:35:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.868+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc19f600 con 0x7f43cc1021f0 2024-09-21T06:35:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.868+0000 7f43c9ffb640 1 -- 172.21.15.49:0/1848390573 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0004a00 con 0x7f43cc1021f0 2024-09-21T06:35:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.868+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc1a5d60 con 0x7f43cc1021f0 2024-09-21T06:35:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.869+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f43cc063b50 con 0x7f43cc1021f0 2024-09-21T06:35:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.871+0000 7f43c9ffb640 1 -- 172.21.15.49:0/1848390573 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f43c00079b0 con 0x7f43cc1021f0 2024-09-21T06:35:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.872+0000 7f43c9ffb640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43bc0b65f0 0x7f43bc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.872+0000 7f43cbfff640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43bc0b65f0 0x7f43bc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.872+0000 7f43c9ffb640 1 -- 172.21.15.49:0/1848390573 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f43c00e7830 con 0x7f43cc1021f0 2024-09-21T06:35:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.872+0000 7f43c9ffb640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] conn(0x7f43bc0c0400 0x7f43bc0c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.872+0000 7f43c9ffb640 1 -- 172.21.15.49:0/1848390573 --> [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43bc0c2fa0 con 0x7f43bc0c0400 2024-09-21T06:35:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.872+0000 7f43c9ffb640 1 -- 172.21.15.49:0/1848390573 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f43c00e7c80 con 0x7f43cc1021f0 2024-09-21T06:35:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.872+0000 7f43d143d640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] conn(0x7f43bc0c0400 0x7f43bc0c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.872+0000 7f43cbfff640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43bc0b65f0 0x7f43bc0b8b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f43b802aa00 tx=0x7f43b8031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.873+0000 7f43d143d640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] conn(0x7f43bc0c0400 0x7f43bc0c28d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.874+0000 7f43c9ffb640 1 -- 172.21.15.49:0/1848390573 <== osd.4 v2:172.21.15.79:6808/302730711 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f43bc0c2fa0 con 0x7f43bc0c0400 2024-09-21T06:35:19.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.887+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 --> [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f43cc063f80 con 0x7f43bc0c0400 2024-09-21T06:35:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43c9ffb640 1 -- 172.21.15.49:0/1848390573 <== osd.4 v2:172.21.15.79:6808/302730711 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f43cc063f80 con 0x7f43bc0c0400 2024-09-21T06:35:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 >> [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] conn(0x7f43bc0c0400 msgr2=0x7f43bc0c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] conn(0x7f43bc0c0400 0x7f43bc0c28d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43bc0b65f0 msgr2=0x7f43bc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43bc0b65f0 0x7f43bc0b8b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f43b802aa00 tx=0x7f43b8031400 comp rx=0 tx=0).stop 2024-09-21T06:35:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43cc1021f0 msgr2=0x7f43cc1993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 --2- 172.21.15.49:0/1848390573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43cc1021f0 0x7f43cc1993a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f43c000c890 tx=0x7f43c000cd50 comp rx=0 tx=0).stop 2024-09-21T06:35:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d143d640 1 -- 172.21.15.49:0/1848390573 reap_dead start 2024-09-21T06:35:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 shutdown_connections 2024-09-21T06:35:19.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 >> 172.21.15.49:0/1848390573 conn(0x7f43cc077c60 msgr2=0x7f43cc105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:19.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 shutdown_connections 2024-09-21T06:35:19.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:19.888+0000 7f43d2ea0640 1 -- 172.21.15.49:0/1848390573 wait complete. 2024-09-21T06:35:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.251+0000 7fad1b141640 1 -- 172.21.15.49:0/1998331857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad141062b0 msgr2=0x7fad141066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.251+0000 7fad1b141640 1 --2- 172.21.15.49:0/1998331857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad141062b0 0x7fad141066c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad00009900 tx=0x7fad0002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.251+0000 7fad1b141640 1 -- 172.21.15.49:0/1998331857 shutdown_connections 2024-09-21T06:35:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.251+0000 7fad1b141640 1 --2- 172.21.15.49:0/1998331857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad14106c00 0x7fad14110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.251+0000 7fad1b141640 1 --2- 172.21.15.49:0/1998331857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad141062b0 0x7fad141066c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.251+0000 7fad1b141640 1 --2- 172.21.15.49:0/1998331857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad14102060 0x7fad14102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.251+0000 7fad1b141640 1 -- 172.21.15.49:0/1998331857 >> 172.21.15.49:0/1998331857 conn(0x7fad14077ca0 msgr2=0x7fad140780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:21.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.251+0000 7fad1b141640 1 -- 172.21.15.49:0/1998331857 shutdown_connections 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.251+0000 7fad1b141640 1 -- 172.21.15.49:0/1998331857 wait complete. 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad1b141640 1 Processor -- start 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad1b141640 1 -- start start 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad1b141640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad14102060 0x7fad1419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad1b141640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad141062b0 0x7fad1419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad1b141640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad14106c00 0x7fad1419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad1b141640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fad14113ab0 con 0x7fad14102060 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad1b141640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fad14113930 con 0x7fad14106c00 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad1b141640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fad14113c30 con 0x7fad141062b0 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad18edd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad14102060 0x7fad1419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad18edd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad14102060 0x7fad1419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54308/0 (socket says 172.21.15.49:54308) 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad18edd640 1 -- 172.21.15.49:0/846684307 learned_addr learned my addr 172.21.15.49:0/846684307 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.252+0000 7fad196de640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad14106c00 0x7fad1419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad13fff640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad141062b0 0x7fad1419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad18edd640 1 -- 172.21.15.49:0/846684307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad141062b0 msgr2=0x7fad1419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad18edd640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fad141062b0 0x7fad1419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad18edd640 1 -- 172.21.15.49:0/846684307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad14106c00 msgr2=0x7fad1419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad18edd640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fad14106c00 0x7fad1419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad18edd640 1 -- 172.21.15.49:0/846684307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad141a0330 con 0x7fad14102060 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad18edd640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad14102060 0x7fad1419a480 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fad0800c970 tx=0x7fad0800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad11ffb640 1 -- 172.21.15.49:0/846684307 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08007c10 con 0x7fad14102060 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad11ffb640 1 -- 172.21.15.49:0/846684307 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad08007db0 con 0x7fad14102060 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad141a0620 con 0x7fad14102060 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad11ffb640 1 -- 172.21.15.49:0/846684307 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0800f870 con 0x7fad14102060 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.253+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad141a6e40 con 0x7fad14102060 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.254+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad14063b50 con 0x7fad14102060 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.256+0000 7fad11ffb640 1 -- 172.21.15.49:0/846684307 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fad0800fa10 con 0x7fad14102060 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.257+0000 7fad11ffb640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad040b6620 0x7fad040b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.257+0000 7fad13fff640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad040b6620 0x7fad040b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.257+0000 7fad11ffb640 1 -- 172.21.15.49:0/846684307 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fad080e7d80 con 0x7fad14102060 2024-09-21T06:35:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.257+0000 7fad11ffb640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] conn(0x7fad040c0430 0x7fad040c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.257+0000 7fad11ffb640 1 -- 172.21.15.49:0/846684307 --> [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad040c2fd0 con 0x7fad040c0430 2024-09-21T06:35:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.257+0000 7fad11ffb640 1 -- 172.21.15.49:0/846684307 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fad080e81d0 con 0x7fad14102060 2024-09-21T06:35:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.257+0000 7fad196de640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] conn(0x7fad040c0430 0x7fad040c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.257+0000 7fad13fff640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad040b6620 0x7fad040b8b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fad00006010 tx=0x7fad00000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.258+0000 7fad196de640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] conn(0x7fad040c0430 0x7fad040c2900 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:21.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.259+0000 7fad11ffb640 1 -- 172.21.15.49:0/846684307 <== osd.11 v2:172.21.15.98:6824/4262170082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad040c2fd0 con 0x7fad040c0430 2024-09-21T06:35:21.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.275+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 --> [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad14063fd0 con 0x7fad040c0430 2024-09-21T06:35:21.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad11ffb640 1 -- 172.21.15.49:0/846684307 <== osd.11 v2:172.21.15.98:6824/4262170082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fad14063fd0 con 0x7fad040c0430 2024-09-21T06:35:21.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 >> [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] conn(0x7fad040c0430 msgr2=0x7fad040c2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad1b141640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] conn(0x7fad040c0430 0x7fad040c2900 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad040b6620 msgr2=0x7fad040b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad1b141640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fad040b6620 0x7fad040b8b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fad00006010 tx=0x7fad00000bc0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad14102060 msgr2=0x7fad1419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad1b141640 1 --2- 172.21.15.49:0/846684307 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fad14102060 0x7fad1419a480 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fad0800c970 tx=0x7fad0800ce30 comp rx=0 tx=0).stop 2024-09-21T06:35:21.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad196de640 1 -- 172.21.15.49:0/846684307 reap_dead start 2024-09-21T06:35:21.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 shutdown_connections 2024-09-21T06:35:21.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.276+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 >> 172.21.15.49:0/846684307 conn(0x7fad14077ca0 msgr2=0x7fad14105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:21.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.277+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 shutdown_connections 2024-09-21T06:35:21.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.277+0000 7fad1b141640 1 -- 172.21.15.49:0/846684307 wait complete. 2024-09-21T06:35:21.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:21 smithi049 ceph-mon[31177]: pgmap v278: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 4 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-21T06:35:21.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:21 smithi079 ceph-mon[34346]: pgmap v278: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 4 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-21T06:35:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.148+0000 7feceb148640 1 -- 172.21.15.49:0/648379088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece4108cf0 msgr2=0x7fece410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.148+0000 7feceb148640 1 --2- 172.21.15.49:0/648379088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece4108cf0 0x7fece410f520 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009900 tx=0x7fecdc02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.148+0000 7feceb148640 1 -- 172.21.15.49:0/648379088 shutdown_connections 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.148+0000 7feceb148640 1 --2- 172.21.15.49:0/648379088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece4108cf0 0x7fece410f520 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.148+0000 7feceb148640 1 --2- 172.21.15.49:0/648379088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fece41083a0 0x7fece41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.148+0000 7feceb148640 1 --2- 172.21.15.49:0/648379088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece4102a60 0x7fece4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.148+0000 7feceb148640 1 -- 172.21.15.49:0/648379088 >> 172.21.15.49:0/648379088 conn(0x7fece4079730 msgr2=0x7fece4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.148+0000 7feceb148640 1 -- 172.21.15.49:0/648379088 shutdown_connections 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.148+0000 7feceb148640 1 -- 172.21.15.49:0/648379088 wait complete. 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.149+0000 7feceb148640 1 Processor -- start 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.149+0000 7feceb148640 1 -- start start 2024-09-21T06:35:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.149+0000 7feceb148640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece4102a60 0x7fece41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.149+0000 7feceb148640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece41083a0 0x7fece4199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.149+0000 7feceb148640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fece4108cf0 0x7fece419eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.149+0000 7feceb148640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fece4112960 con 0x7fece41083a0 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.149+0000 7feceb148640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fece41127e0 con 0x7fece4102a60 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7feceb148640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fece4112ae0 con 0x7fece4108cf0 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece41083a0 0x7fece4199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece41083a0 0x7fece4199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54290/0 (socket says 172.21.15.49:54290) 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece3fff640 1 -- 172.21.15.49:0/2537361796 learned_addr learned my addr 172.21.15.49:0/2537361796 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece96e5640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fece4108cf0 0x7fece419eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece8ee4640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece4102a60 0x7fece41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece3fff640 1 -- 172.21.15.49:0/2537361796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fece4108cf0 msgr2=0x7fece419eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece3fff640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fece4108cf0 0x7fece419eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece3fff640 1 -- 172.21.15.49:0/2537361796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece4102a60 msgr2=0x7fece41992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece3fff640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece4102a60 0x7fece41992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece3fff640 1 -- 172.21.15.49:0/2537361796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece419f260 con 0x7fece41083a0 2024-09-21T06:35:21.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece8ee4640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fece4102a60 0x7fece41992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:21.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece3fff640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece41083a0 0x7fece4199890 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fecd400ebe0 tx=0x7fecd4007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:21.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece1ffb640 1 -- 172.21.15.49:0/2537361796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd400e0d0 con 0x7fece41083a0 2024-09-21T06:35:21.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece1ffb640 1 -- 172.21.15.49:0/2537361796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecd400e270 con 0x7fece41083a0 2024-09-21T06:35:21.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece419f4f0 con 0x7fece41083a0 2024-09-21T06:35:21.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.150+0000 7fece1ffb640 1 -- 172.21.15.49:0/2537361796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecd4005880 con 0x7fece41083a0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.151+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece406ae60 con 0x7fece41083a0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.151+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fece406b3d0 con 0x7fece41083a0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.153+0000 7fece1ffb640 1 -- 172.21.15.49:0/2537361796 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fecd4004a40 con 0x7fece41083a0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.154+0000 7fece1ffb640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fecd00b6670 0x7fecd00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.154+0000 7fece8ee4640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fecd00b6670 0x7fecd00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.154+0000 7fece1ffb640 1 -- 172.21.15.49:0/2537361796 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fecd40e9380 con 0x7fece41083a0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.154+0000 7fece1ffb640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] conn(0x7fecd00c0480 0x7fecd00c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.154+0000 7fece1ffb640 1 -- 172.21.15.49:0/2537361796 --> [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecd00c3020 con 0x7fecd00c0480 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.154+0000 7fece1ffb640 1 -- 172.21.15.49:0/2537361796 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fecd40e97d0 con 0x7fece41083a0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.154+0000 7fece8ee4640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fecd00b6670 0x7fecd00b8b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feccc0058c0 tx=0x7feccc005ec0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.155+0000 7fece96e5640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] conn(0x7fecd00c0480 0x7fecd00c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.155+0000 7fece96e5640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] conn(0x7fecd00c0480 0x7fecd00c2950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.156+0000 7fece1ffb640 1 -- 172.21.15.49:0/2537361796 <== osd.1 v2:172.21.15.79:6800/2324008814 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecd00c3020 con 0x7fecd00c0480 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.170+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 --> [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fece406b850 con 0x7fecd00c0480 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7fece1ffb640 1 -- 172.21.15.49:0/2537361796 <== osd.1 v2:172.21.15.79:6800/2324008814 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fece406b850 con 0x7fecd00c0480 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 >> [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] conn(0x7fecd00c0480 msgr2=0x7fecd00c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] conn(0x7fecd00c0480 0x7fecd00c2950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fecd00b6670 msgr2=0x7fecd00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fecd00b6670 0x7fecd00b8b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feccc0058c0 tx=0x7feccc005ec0 comp rx=0 tx=0).stop 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece41083a0 msgr2=0x7fece4199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 --2- 172.21.15.49:0/2537361796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fece41083a0 0x7fece4199890 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fecd400ebe0 tx=0x7fecd4007590 comp rx=0 tx=0).stop 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7fece96e5640 1 -- 172.21.15.49:0/2537361796 reap_dead start 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 shutdown_connections 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 >> 172.21.15.49:0/2537361796 conn(0x7fece4079730 msgr2=0x7fece4104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 shutdown_connections 2024-09-21T06:35:21.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:21.171+0000 7feceb148640 1 -- 172.21.15.49:0/2537361796 wait complete. 2024-09-21T06:35:21.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:21 smithi098 ceph-mon[34704]: pgmap v278: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 255 B/s wr, 4 op/s; 7.9 KiB/s, 0 objects/s recovering 2024-09-21T06:35:22.270 INFO:teuthology.orchestra.run.smithi049.stdout:60129542215 2024-09-21T06:35:22.270 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T06:35:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.964+0000 7f0e6e922640 1 -- 172.21.15.49:0/4033383023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e68103b60 msgr2=0x7f0e68103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.964+0000 7f0e6e922640 1 --2- 172.21.15.49:0/4033383023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e68103b60 0x7f0e68103f70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009900 tx=0x7f0e5802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.964+0000 7f0e6e922640 1 -- 172.21.15.49:0/4033383023 shutdown_connections 2024-09-21T06:35:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.964+0000 7f0e6e922640 1 --2- 172.21.15.49:0/4033383023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e68109df0 0x7f0e68110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.964+0000 7f0e6e922640 1 --2- 172.21.15.49:0/4033383023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e681094a0 0x7f0e681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.964+0000 7f0e6e922640 1 --2- 172.21.15.49:0/4033383023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e68103b60 0x7f0e68103f70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.964+0000 7f0e6e922640 1 -- 172.21.15.49:0/4033383023 >> 172.21.15.49:0/4033383023 conn(0x7f0e6807b850 msgr2=0x7f0e6807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.964+0000 7f0e6e922640 1 -- 172.21.15.49:0/4033383023 shutdown_connections 2024-09-21T06:35:22.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.964+0000 7f0e6e922640 1 -- 172.21.15.49:0/4033383023 wait complete. 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.965+0000 7f0e6e922640 1 Processor -- start 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.965+0000 7f0e6e922640 1 -- start start 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.965+0000 7f0e6e922640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e68103b60 0x7f0e6819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.965+0000 7f0e6e922640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e681094a0 0x7f0e6819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.965+0000 7f0e6e922640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e68109df0 0x7f0e6819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.965+0000 7f0e6e922640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68113b10 con 0x7f0e681094a0 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.965+0000 7f0e6e922640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68113990 con 0x7f0e68103b60 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.965+0000 7f0e6e922640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68113c90 con 0x7f0e68109df0 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e5ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e681094a0 0x7f0e6819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e5ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e681094a0 0x7f0e6819ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54332/0 (socket says 172.21.15.49:54332) 2024-09-21T06:35:22.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e5ffff640 1 -- 172.21.15.49:0/2830885035 learned_addr learned my addr 172.21.15.49:0/2830885035 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e67fff640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e68103b60 0x7f0e6819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e6cebf640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e68109df0 0x7f0e6819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e5ffff640 1 -- 172.21.15.49:0/2830885035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e68109df0 msgr2=0x7f0e6819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e5ffff640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e68109df0 0x7f0e6819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e5ffff640 1 -- 172.21.15.49:0/2830885035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e68103b60 msgr2=0x7f0e6819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e5ffff640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e68103b60 0x7f0e6819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e5ffff640 1 -- 172.21.15.49:0/2830885035 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e681a04f0 con 0x7f0e681094a0 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e5ffff640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e681094a0 0x7f0e6819ab20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000d740 tx=0x7f0e5000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e65ffb640 1 -- 172.21.15.49:0/2830885035 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50017070 con 0x7f0e681094a0 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e65ffb640 1 -- 172.21.15.49:0/2830885035 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e5000de50 con 0x7f0e681094a0 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e65ffb640 1 -- 172.21.15.49:0/2830885035 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e5000f620 con 0x7f0e681094a0 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e681a07e0 con 0x7f0e681094a0 2024-09-21T06:35:22.971 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.966+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e681a6f40 con 0x7f0e681094a0 2024-09-21T06:35:22.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.967+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e68063ad0 con 0x7f0e681094a0 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.969+0000 7f0e65ffb640 1 -- 172.21.15.49:0/2830885035 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f0e5001a070 con 0x7f0e681094a0 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.970+0000 7f0e65ffb640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e540b6670 0x7f0e540b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.970+0000 7f0e67fff640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e540b6670 0x7f0e540b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.970+0000 7f0e65ffb640 1 -- 172.21.15.49:0/2830885035 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f0e500e7370 con 0x7f0e681094a0 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.970+0000 7f0e65ffb640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] conn(0x7f0e540c0480 0x7f0e540c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.970+0000 7f0e65ffb640 1 -- 172.21.15.49:0/2830885035 --> [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e540c3020 con 0x7f0e540c0480 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.970+0000 7f0e65ffb640 1 -- 172.21.15.49:0/2830885035 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f0e500e77c0 con 0x7f0e681094a0 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.970+0000 7f0e6cebf640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] conn(0x7f0e540c0480 0x7f0e540c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.970+0000 7f0e67fff640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e540b6670 0x7f0e540b8b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e58031440 tx=0x7f0e58009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.971+0000 7f0e6cebf640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] conn(0x7f0e540c0480 0x7f0e540c2950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.971+0000 7f0e65ffb640 1 -- 172.21.15.49:0/2830885035 <== osd.3 v2:172.21.15.49:6810/2305435073 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e540c3020 con 0x7f0e540c0480 2024-09-21T06:35:22.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.985+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 --> [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e68063ed0 con 0x7f0e540c0480 2024-09-21T06:35:22.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e65ffb640 1 -- 172.21.15.49:0/2830885035 <== osd.3 v2:172.21.15.49:6810/2305435073 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0e68063ed0 con 0x7f0e540c0480 2024-09-21T06:35:22.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] conn(0x7f0e540c0480 msgr2=0x7f0e540c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] conn(0x7f0e540c0480 0x7f0e540c2950 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e540b6670 msgr2=0x7f0e540b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e540b6670 0x7f0e540b8b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0e58031440 tx=0x7f0e58009560 comp rx=0 tx=0).stop 2024-09-21T06:35:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e681094a0 msgr2=0x7f0e6819ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 --2- 172.21.15.49:0/2830885035 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e681094a0 0x7f0e6819ab20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000d740 tx=0x7f0e5000dc00 comp rx=0 tx=0).stop 2024-09-21T06:35:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6cebf640 1 -- 172.21.15.49:0/2830885035 reap_dead start 2024-09-21T06:35:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 shutdown_connections 2024-09-21T06:35:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 >> 172.21.15.49:0/2830885035 conn(0x7f0e6807b850 msgr2=0x7f0e68107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 shutdown_connections 2024-09-21T06:35:22.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:22.986+0000 7f0e6e922640 1 -- 172.21.15.49:0/2830885035 wait complete. 2024-09-21T06:35:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.160+0000 7f9f4c868640 1 -- 172.21.15.49:0/376519250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f48108d00 msgr2=0x7f9f4810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.160+0000 7f9f4c868640 1 --2- 172.21.15.49:0/376519250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f48108d00 0x7f9f4810f530 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009ca0 tx=0x7f9f4002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.160+0000 7f9f4c868640 1 -- 172.21.15.49:0/376519250 shutdown_connections 2024-09-21T06:35:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.160+0000 7f9f4c868640 1 --2- 172.21.15.49:0/376519250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f48108d00 0x7f9f4810f530 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.160+0000 7f9f4c868640 1 --2- 172.21.15.49:0/376519250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f481083b0 0x7f9f481087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.160+0000 7f9f4c868640 1 --2- 172.21.15.49:0/376519250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f48103140 0x7f9f48103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.160+0000 7f9f4c868640 1 -- 172.21.15.49:0/376519250 >> 172.21.15.49:0/376519250 conn(0x7f9f48077c60 msgr2=0x7f9f480780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:23.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.160+0000 7f9f4c868640 1 -- 172.21.15.49:0/376519250 shutdown_connections 2024-09-21T06:35:23.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.160+0000 7f9f4c868640 1 -- 172.21.15.49:0/376519250 wait complete. 2024-09-21T06:35:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.161+0000 7f9f4c868640 1 Processor -- start 2024-09-21T06:35:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.161+0000 7f9f4c868640 1 -- start start 2024-09-21T06:35:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.161+0000 7f9f4c868640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f48103140 0x7f9f4819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.161+0000 7f9f4c868640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f481083b0 0x7f9f4819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.161+0000 7f9f4c868640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f48108d00 0x7f9f4819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f4c868640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9f481129c0 con 0x7f9f48108d00 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f4c868640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48112840 con 0x7f9f48103140 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f4c868640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48112b40 con 0x7f9f481083b0 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f46d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f48108d00 0x7f9f4819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f4659c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f48103140 0x7f9f4819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f46d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f48108d00 0x7f9f4819fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54340/0 (socket says 172.21.15.49:54340) 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f46d9d640 1 -- 172.21.15.49:0/3597572695 learned_addr learned my addr 172.21.15.49:0/3597572695 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f45d9b640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f481083b0 0x7f9f4819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f46d9d640 1 -- 172.21.15.49:0/3597572695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f481083b0 msgr2=0x7f9f4819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f46d9d640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f481083b0 0x7f9f4819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f46d9d640 1 -- 172.21.15.49:0/3597572695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f48103140 msgr2=0x7f9f4819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f46d9d640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f48103140 0x7f9f4819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f46d9d640 1 -- 172.21.15.49:0/3597572695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f481a0390 con 0x7f9f48108d00 2024-09-21T06:35:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f4659c640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f48103140 0x7f9f4819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.162+0000 7f9f46d9d640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f48108d00 0x7f9f4819fc60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9f40005cc0 tx=0x7f9f4002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.163+0000 7f9f377fe640 1 -- 172.21.15.49:0/3597572695 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40003bf0 con 0x7f9f48108d00 2024-09-21T06:35:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.163+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f481a0620 con 0x7f9f48108d00 2024-09-21T06:35:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.163+0000 7f9f377fe640 1 -- 172.21.15.49:0/3597572695 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f40003d90 con 0x7f9f48108d00 2024-09-21T06:35:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.163+0000 7f9f377fe640 1 -- 172.21.15.49:0/3597572695 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4002fbc0 con 0x7f9f48108d00 2024-09-21T06:35:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.163+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f480fecc0 con 0x7f9f48108d00 2024-09-21T06:35:23.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.164+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f48063b10 con 0x7f9f48108d00 2024-09-21T06:35:23.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.166+0000 7f9f377fe640 1 -- 172.21.15.49:0/3597572695 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f9f4002fd60 con 0x7f9f48108d00 2024-09-21T06:35:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.166+0000 7f9f377fe640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f300b65f0 0x7f9f300b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.166+0000 7f9f4659c640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f300b65f0 0x7f9f300b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.166+0000 7f9f377fe640 1 -- 172.21.15.49:0/3597572695 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f9f40108f00 con 0x7f9f48108d00 2024-09-21T06:35:23.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.167+0000 7f9f377fe640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] conn(0x7f9f300c02d0 0x7f9f300c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.167+0000 7f9f377fe640 1 -- 172.21.15.49:0/3597572695 --> [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f40047ec0 con 0x7f9f300c02d0 2024-09-21T06:35:23.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.167+0000 7f9f377fe640 1 -- 172.21.15.49:0/3597572695 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f9f40109350 con 0x7f9f48108d00 2024-09-21T06:35:23.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.167+0000 7f9f45d9b640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] conn(0x7f9f300c02d0 0x7f9f300c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.167+0000 7f9f4659c640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f300b65f0 0x7f9f300b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9f380058c0 tx=0x7f9f3800a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:23.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.167+0000 7f9f45d9b640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] conn(0x7f9f300c02d0 0x7f9f300c27a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:23.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.168+0000 7f9f377fe640 1 -- 172.21.15.49:0/3597572695 <== osd.6 v2:172.21.15.49:6818/306059620 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f40047ec0 con 0x7f9f300c02d0 2024-09-21T06:35:23.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.182+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 --> [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9f48063f10 con 0x7f9f300c02d0 2024-09-21T06:35:23.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.182+0000 7f9f377fe640 1 -- 172.21.15.49:0/3597572695 <== osd.6 v2:172.21.15.49:6818/306059620 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9f48063f10 con 0x7f9f300c02d0 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] conn(0x7f9f300c02d0 msgr2=0x7f9f300c27a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] conn(0x7f9f300c02d0 0x7f9f300c27a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f300b65f0 msgr2=0x7f9f300b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f300b65f0 0x7f9f300b8b00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9f380058c0 tx=0x7f9f3800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f48108d00 msgr2=0x7f9f4819fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 --2- 172.21.15.49:0/3597572695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f48108d00 0x7f9f4819fc60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9f40005cc0 tx=0x7f9f4002f380 comp rx=0 tx=0).stop 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f46d9d640 1 -- 172.21.15.49:0/3597572695 reap_dead start 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 shutdown_connections 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 >> 172.21.15.49:0/3597572695 conn(0x7f9f48077c60 msgr2=0x7f9f481011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 shutdown_connections 2024-09-21T06:35:23.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.183+0000 7f9f4c868640 1 -- 172.21.15.49:0/3597572695 wait complete. 2024-09-21T06:35:23.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:23 smithi079 ceph-mon[34346]: pgmap v279: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 207 B/s wr, 5 op/s; 6.4 KiB/s, 0 objects/s recovering 2024-09-21T06:35:23.583 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:23 smithi049 ceph-mon[31177]: pgmap v279: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 207 B/s wr, 5 op/s; 6.4 KiB/s, 0 objects/s recovering 2024-09-21T06:35:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.584+0000 7f6924f33640 1 -- 172.21.15.49:0/290474684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69201083a0 msgr2=0x7f69201087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.584+0000 7f6924f33640 1 --2- 172.21.15.49:0/290474684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69201083a0 0x7f69201087b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6914009900 tx=0x7f691402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.584+0000 7f6924f33640 1 -- 172.21.15.49:0/290474684 shutdown_connections 2024-09-21T06:35:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.584+0000 7f6924f33640 1 --2- 172.21.15.49:0/290474684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920108cf0 0x7f692010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.584+0000 7f6924f33640 1 --2- 172.21.15.49:0/290474684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69201083a0 0x7f69201087b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.584+0000 7f6924f33640 1 --2- 172.21.15.49:0/290474684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6920102a60 0x7f6920102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.584+0000 7f6924f33640 1 -- 172.21.15.49:0/290474684 >> 172.21.15.49:0/290474684 conn(0x7f6920079730 msgr2=0x7f6920079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.584+0000 7f6924f33640 1 -- 172.21.15.49:0/290474684 shutdown_connections 2024-09-21T06:35:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.584+0000 7f6924f33640 1 -- 172.21.15.49:0/290474684 wait complete. 2024-09-21T06:35:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f6924f33640 1 Processor -- start 2024-09-21T06:35:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f6924f33640 1 -- start start 2024-09-21T06:35:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f6924f33640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6920102a60 0x7f69200ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f6924f33640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69201083a0 0x7f69200ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f6924f33640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920108cf0 0x7f69201000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f6924f33640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6920112960 con 0x7f69201083a0 2024-09-21T06:35:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f6924f33640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f69201127e0 con 0x7f6920108cf0 2024-09-21T06:35:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f6924f33640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6920112ae0 con 0x7f6920102a60 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f691dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69201083a0 0x7f69200ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f691dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69201083a0 0x7f69200ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54350/0 (socket says 172.21.15.49:54350) 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.585+0000 7f691dd9b640 1 -- 172.21.15.49:0/1320371634 learned_addr learned my addr 172.21.15.49:0/1320371634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f691e59c640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6920102a60 0x7f69200ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f691ed9d640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920108cf0 0x7f69201000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f691dd9b640 1 -- 172.21.15.49:0/1320371634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6920102a60 msgr2=0x7f69200ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f691dd9b640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6920102a60 0x7f69200ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f691dd9b640 1 -- 172.21.15.49:0/1320371634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920108cf0 msgr2=0x7f69201000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f691dd9b640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920108cf0 0x7f69201000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f691dd9b640 1 -- 172.21.15.49:0/1320371634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69201a8740 con 0x7f69201083a0 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f691ed9d640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6920108cf0 0x7f69201000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f691dd9b640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69201083a0 0x7f69200ffbb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6914006010 tx=0x7f6914004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f690f7fe640 1 -- 172.21.15.49:0/1320371634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691403f030 con 0x7f69201083a0 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69201a89d0 con 0x7f69201083a0 2024-09-21T06:35:23.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f690f7fe640 1 -- 172.21.15.49:0/1320371634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6914003aa0 con 0x7f69201083a0 2024-09-21T06:35:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69201a8f00 con 0x7f69201083a0 2024-09-21T06:35:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.586+0000 7f690f7fe640 1 -- 172.21.15.49:0/1320371634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6914035070 con 0x7f69201083a0 2024-09-21T06:35:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.587+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6920063b50 con 0x7f69201083a0 2024-09-21T06:35:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.589+0000 7f690f7fe640 1 -- 172.21.15.49:0/1320371634 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6914042030 con 0x7f69201083a0 2024-09-21T06:35:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.590+0000 7f690f7fe640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f69080b6670 0x7f69080b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.590+0000 7f691e59c640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f69080b6670 0x7f69080b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.590+0000 7f690f7fe640 1 -- 172.21.15.49:0/1320371634 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f6914107e50 con 0x7f69201083a0 2024-09-21T06:35:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.590+0000 7f690f7fe640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] conn(0x7f69080c0480 0x7f69080c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.590+0000 7f690f7fe640 1 -- 172.21.15.49:0/1320371634 --> [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6914032970 con 0x7f69080c0480 2024-09-21T06:35:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.590+0000 7f690f7fe640 1 -- 172.21.15.49:0/1320371634 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f69141082a0 con 0x7f69201083a0 2024-09-21T06:35:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.591+0000 7f691ed9d640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] conn(0x7f69080c0480 0x7f69080c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.591+0000 7f691e59c640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f69080b6670 0x7f69080b8b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69201010c0 tx=0x7f6910005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.591+0000 7f691ed9d640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] conn(0x7f69080c0480 0x7f69080c2950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:23.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.592+0000 7f690f7fe640 1 -- 172.21.15.49:0/1320371634 <== osd.5 v2:172.21.15.98:6808/497453656 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6914032970 con 0x7f69080c0480 2024-09-21T06:35:23.597 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:23 smithi098 ceph-mon[34704]: pgmap v279: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 207 B/s wr, 5 op/s; 6.4 KiB/s, 0 objects/s recovering 2024-09-21T06:35:23.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.606+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 --> [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6920063f50 con 0x7f69080c0480 2024-09-21T06:35:23.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.606+0000 7f690f7fe640 1 -- 172.21.15.49:0/1320371634 <== osd.5 v2:172.21.15.98:6808/497453656 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6920063f50 con 0x7f69080c0480 2024-09-21T06:35:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 >> [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] conn(0x7f69080c0480 msgr2=0x7f69080c2950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] conn(0x7f69080c0480 0x7f69080c2950 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f69080b6670 msgr2=0x7f69080b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f69080b6670 0x7f69080b8b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f69201010c0 tx=0x7f6910005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69201083a0 msgr2=0x7f69200ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 --2- 172.21.15.49:0/1320371634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f69201083a0 0x7f69200ffbb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6914006010 tx=0x7f6914004060 comp rx=0 tx=0).stop 2024-09-21T06:35:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f691ed9d640 1 -- 172.21.15.49:0/1320371634 reap_dead start 2024-09-21T06:35:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 shutdown_connections 2024-09-21T06:35:23.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 >> 172.21.15.49:0/1320371634 conn(0x7f6920079730 msgr2=0x7f692006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:23.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 shutdown_connections 2024-09-21T06:35:23.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:23.607+0000 7f6924f33640 1 -- 172.21.15.49:0/1320371634 wait complete. 2024-09-21T06:35:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.699+0000 7f793ac68640 1 -- 172.21.15.49:0/1852581157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79341083d0 msgr2=0x7f79341087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.699+0000 7f793ac68640 1 --2- 172.21.15.49:0/1852581157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79341083d0 0x7f79341087e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7924009ca0 tx=0x7f792402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.699+0000 7f793ac68640 1 -- 172.21.15.49:0/1852581157 shutdown_connections 2024-09-21T06:35:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.699+0000 7f793ac68640 1 --2- 172.21.15.49:0/1852581157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7934108d20 0x7f793410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.699+0000 7f793ac68640 1 --2- 172.21.15.49:0/1852581157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79341083d0 0x7f79341087e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.699+0000 7f793ac68640 1 --2- 172.21.15.49:0/1852581157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7934102a90 0x7f7934102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.699+0000 7f793ac68640 1 -- 172.21.15.49:0/1852581157 >> 172.21.15.49:0/1852581157 conn(0x7f7934079750 msgr2=0x7f7934079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.699+0000 7f793ac68640 1 -- 172.21.15.49:0/1852581157 shutdown_connections 2024-09-21T06:35:24.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.699+0000 7f793ac68640 1 -- 172.21.15.49:0/1852581157 wait complete. 2024-09-21T06:35:24.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.700+0000 7f793ac68640 1 Processor -- start 2024-09-21T06:35:24.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.700+0000 7f793ac68640 1 -- start start 2024-09-21T06:35:24.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f793ac68640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7934102a90 0x7f7934199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f793ac68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79341083d0 0x7f79341998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f793ac68640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7934108d20 0x7f793419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f793ac68640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7934112990 con 0x7f79341083d0 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f793ac68640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7934112810 con 0x7f7934102a90 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f793ac68640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7934112b10 con 0x7f7934108d20 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7933fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79341083d0 0x7f79341998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7933fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79341083d0 0x7f79341998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54376/0 (socket says 172.21.15.49:54376) 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7933fff640 1 -- 172.21.15.49:0/2654913708 learned_addr learned my addr 172.21.15.49:0/2654913708 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7938a04640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7934102a90 0x7f7934199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7939205640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7934108d20 0x7f793419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7933fff640 1 -- 172.21.15.49:0/2654913708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7934108d20 msgr2=0x7f793419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7933fff640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7934108d20 0x7f793419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7933fff640 1 -- 172.21.15.49:0/2654913708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7934102a90 msgr2=0x7f7934199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7933fff640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7934102a90 0x7f7934199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.701+0000 7f7933fff640 1 -- 172.21.15.49:0/2654913708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793419f1f0 con 0x7f79341083d0 2024-09-21T06:35:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.702+0000 7f7933fff640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79341083d0 0x7f79341998e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7924006010 tx=0x7f79240319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.702+0000 7f7931ffb640 1 -- 172.21.15.49:0/2654913708 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7924003bf0 con 0x7f79341083d0 2024-09-21T06:35:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.702+0000 7f7931ffb640 1 -- 172.21.15.49:0/2654913708 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7924003d90 con 0x7f79341083d0 2024-09-21T06:35:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.702+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f793419f480 con 0x7f79341083d0 2024-09-21T06:35:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.702+0000 7f7931ffb640 1 -- 172.21.15.49:0/2654913708 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f792402fb60 con 0x7f79341083d0 2024-09-21T06:35:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.702+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f793419f9c0 con 0x7f79341083d0 2024-09-21T06:35:24.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.703+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f793406bf60 con 0x7f79341083d0 2024-09-21T06:35:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.705+0000 7f7931ffb640 1 -- 172.21.15.49:0/2654913708 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f792402fd00 con 0x7f79341083d0 2024-09-21T06:35:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.705+0000 7f7931ffb640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f79200b6620 0x7f79200b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.705+0000 7f7938a04640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f79200b6620 0x7f79200b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.706+0000 7f7931ffb640 1 -- 172.21.15.49:0/2654913708 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f7924108b00 con 0x7f79341083d0 2024-09-21T06:35:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.706+0000 7f7931ffb640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] conn(0x7f79200c0430 0x7f79200c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.706+0000 7f7931ffb640 1 -- 172.21.15.49:0/2654913708 --> [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79200c2fd0 con 0x7f79200c0430 2024-09-21T06:35:24.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.706+0000 7f7931ffb640 1 -- 172.21.15.49:0/2654913708 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f7924108f50 con 0x7f79341083d0 2024-09-21T06:35:24.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.706+0000 7f7938a04640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f79200b6620 0x7f79200b8b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f791c00abe0 tx=0x7f791c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.706+0000 7f7939205640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] conn(0x7f79200c0430 0x7f79200c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.707+0000 7f7939205640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] conn(0x7f79200c0430 0x7f79200c2900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.707+0000 7f7931ffb640 1 -- 172.21.15.49:0/2654913708 <== osd.2 v2:172.21.15.98:6800/2078306584 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79200c2fd0 con 0x7f79200c0430 2024-09-21T06:35:24.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.721+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 --> [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f793406c360 con 0x7f79200c0430 2024-09-21T06:35:24.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f7931ffb640 1 -- 172.21.15.49:0/2654913708 <== osd.2 v2:172.21.15.98:6800/2078306584 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f793406c360 con 0x7f79200c0430 2024-09-21T06:35:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 >> [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] conn(0x7f79200c0430 msgr2=0x7f79200c2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] conn(0x7f79200c0430 0x7f79200c2900 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f79200b6620 msgr2=0x7f79200b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f79200b6620 0x7f79200b8b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f791c00abe0 tx=0x7f791c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79341083d0 msgr2=0x7f79341998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 --2- 172.21.15.49:0/2654913708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f79341083d0 0x7f79341998e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7924006010 tx=0x7f79240319f0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f7939205640 1 -- 172.21.15.49:0/2654913708 reap_dead start 2024-09-21T06:35:24.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 shutdown_connections 2024-09-21T06:35:24.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 >> 172.21.15.49:0/2654913708 conn(0x7f7934079750 msgr2=0x7f7934104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 shutdown_connections 2024-09-21T06:35:24.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.722+0000 7f793ac68640 1 -- 172.21.15.49:0/2654913708 wait complete. 2024-09-21T06:35:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.898+0000 7f70fe7f4640 1 -- 172.21.15.49:0/3636665644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f8108d20 msgr2=0x7f70f810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.898+0000 7f70fe7f4640 1 --2- 172.21.15.49:0/3636665644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f8108d20 0x7f70f810f550 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f70f0009ca0 tx=0x7f70f002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.898+0000 7f70fe7f4640 1 -- 172.21.15.49:0/3636665644 shutdown_connections 2024-09-21T06:35:24.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.898+0000 7f70fe7f4640 1 --2- 172.21.15.49:0/3636665644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f8108d20 0x7f70f810f550 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.898+0000 7f70fe7f4640 1 --2- 172.21.15.49:0/3636665644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f81083d0 0x7f70f81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.898+0000 7f70fe7f4640 1 --2- 172.21.15.49:0/3636665644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70f8102ae0 0x7f70f8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.898+0000 7f70fe7f4640 1 -- 172.21.15.49:0/3636665644 >> 172.21.15.49:0/3636665644 conn(0x7f70f8079760 msgr2=0x7f70f8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.898+0000 7f70fe7f4640 1 -- 172.21.15.49:0/3636665644 shutdown_connections 2024-09-21T06:35:24.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.898+0000 7f70fe7f4640 1 -- 172.21.15.49:0/3636665644 wait complete. 2024-09-21T06:35:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.899+0000 7f70fe7f4640 1 Processor -- start 2024-09-21T06:35:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.899+0000 7f70fe7f4640 1 -- start start 2024-09-21T06:35:24.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70fe7f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f8102ae0 0x7f70f8199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70fe7f4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f81083d0 0x7f70f8199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70fe7f4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70f8108d20 0x7f70f819eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70fe7f4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8112990 con 0x7f70f81083d0 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70fe7f4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8112810 con 0x7f70f8108d20 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70fe7f4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8112b10 con 0x7f70f8102ae0 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f81083d0 0x7f70f8199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f81083d0 0x7f70f8199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54394/0 (socket says 172.21.15.49:54394) 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f77fe640 1 -- 172.21.15.49:0/678923038 learned_addr learned my addr 172.21.15.49:0/678923038 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70fcd91640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70f8108d20 0x7f70f819eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f7fff640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f8102ae0 0x7f70f8199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f77fe640 1 -- 172.21.15.49:0/678923038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f8102ae0 msgr2=0x7f70f8199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f77fe640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f70f8102ae0 0x7f70f8199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f77fe640 1 -- 172.21.15.49:0/678923038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70f8108d20 msgr2=0x7f70f819eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f77fe640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70f8108d20 0x7f70f819eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f77fe640 1 -- 172.21.15.49:0/678923038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f819f2d0 con 0x7f70f81083d0 2024-09-21T06:35:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f77fe640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f81083d0 0x7f70f8199900 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e9f0 tx=0x7f70ec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f57fa640 1 -- 172.21.15.49:0/678923038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00ccc0 con 0x7f70f81083d0 2024-09-21T06:35:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f819f5c0 con 0x7f70f81083d0 2024-09-21T06:35:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f57fa640 1 -- 172.21.15.49:0/678923038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70ec0054d0 con 0x7f70f81083d0 2024-09-21T06:35:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.900+0000 7f70f57fa640 1 -- 172.21.15.49:0/678923038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec010430 con 0x7f70f81083d0 2024-09-21T06:35:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.901+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f81a5d20 con 0x7f70f81083d0 2024-09-21T06:35:24.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.901+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f70f8063b10 con 0x7f70f81083d0 2024-09-21T06:35:24.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.903+0000 7f70f57fa640 1 -- 172.21.15.49:0/678923038 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f70ec0046c0 con 0x7f70f81083d0 2024-09-21T06:35:24.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.904+0000 7f70f57fa640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70e00b65f0 0x7f70e00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.904+0000 7f70f7fff640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70e00b65f0 0x7f70e00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.904+0000 7f70f57fa640 1 -- 172.21.15.49:0/678923038 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f70ec0e7cb0 con 0x7f70f81083d0 2024-09-21T06:35:24.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.904+0000 7f70f57fa640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] conn(0x7f70e00c0400 0x7f70e00c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.904+0000 7f70f57fa640 1 -- 172.21.15.49:0/678923038 --> [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f70e00c2fa0 con 0x7f70e00c0400 2024-09-21T06:35:24.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.904+0000 7f70f57fa640 1 -- 172.21.15.49:0/678923038 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f70ec0e8100 con 0x7f70f81083d0 2024-09-21T06:35:24.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.905+0000 7f70fcd91640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] conn(0x7f70e00c0400 0x7f70e00c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.905+0000 7f70f7fff640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70e00b65f0 0x7f70e00b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70e8005d00 tx=0x7f70e800b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.905+0000 7f70fcd91640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] conn(0x7f70e00c0400 0x7f70e00c28d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.906+0000 7f70f57fa640 1 -- 172.21.15.49:0/678923038 <== osd.9 v2:172.21.15.49:6826/3971172806 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f70e00c2fa0 con 0x7f70e00c0400 2024-09-21T06:35:24.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.919+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 --> [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f70f8063f90 con 0x7f70e00c0400 2024-09-21T06:35:24.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70f57fa640 1 -- 172.21.15.49:0/678923038 <== osd.9 v2:172.21.15.49:6826/3971172806 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f70f8063f90 con 0x7f70e00c0400 2024-09-21T06:35:24.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] conn(0x7f70e00c0400 msgr2=0x7f70e00c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] conn(0x7f70e00c0400 0x7f70e00c28d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70e00b65f0 msgr2=0x7f70e00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70e00b65f0 0x7f70e00b8b00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f70e8005d00 tx=0x7f70e800b410 comp rx=0 tx=0).stop 2024-09-21T06:35:24.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f81083d0 msgr2=0x7f70f8199900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 --2- 172.21.15.49:0/678923038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70f81083d0 0x7f70f8199900 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00e9f0 tx=0x7f70ec00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fcd91640 1 -- 172.21.15.49:0/678923038 reap_dead start 2024-09-21T06:35:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 shutdown_connections 2024-09-21T06:35:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 >> 172.21.15.49:0/678923038 conn(0x7f70f8079760 msgr2=0x7f70f81043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 shutdown_connections 2024-09-21T06:35:24.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:24.920+0000 7f70fe7f4640 1 -- 172.21.15.49:0/678923038 wait complete. 2024-09-21T06:35:25.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:25 smithi049 ceph-mon[31177]: pgmap v280: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 188 B/s wr, 4 op/s; 5.8 KiB/s, 0 objects/s recovering 2024-09-21T06:35:25.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:25 smithi079 ceph-mon[34346]: pgmap v280: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 188 B/s wr, 4 op/s; 5.8 KiB/s, 0 objects/s recovering 2024-09-21T06:35:25.625 INFO:teuthology.orchestra.run.smithi049.stdout:81604378690 2024-09-21T06:35:25.625 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T06:35:25.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:25 smithi098 ceph-mon[34704]: pgmap v280: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 188 B/s wr, 4 op/s; 5.8 KiB/s, 0 objects/s recovering 2024-09-21T06:35:26.045 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:26.067 INFO:teuthology.orchestra.run.smithi049.stdout:133143986231 2024-09-21T06:35:26.067 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T06:35:26.769 INFO:teuthology.orchestra.run.smithi049.stdout:253403070495 2024-09-21T06:35:26.769 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T06:35:26.978 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:26.978 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:27.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:27 smithi049 ceph-mon[31177]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 170 B/s wr, 4 op/s; 5.3 KiB/s, 0 objects/s recovering 2024-09-21T06:35:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.253+0000 7f2d33b51640 1 -- 172.21.15.49:0/905714661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d2c108cf0 msgr2=0x7f2d2c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.253+0000 7f2d33b51640 1 --2- 172.21.15.49:0/905714661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d2c108cf0 0x7f2d2c10f520 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2d24009ca0 tx=0x7f2d2402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.253+0000 7f2d33b51640 1 -- 172.21.15.49:0/905714661 shutdown_connections 2024-09-21T06:35:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.253+0000 7f2d33b51640 1 --2- 172.21.15.49:0/905714661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d2c108cf0 0x7f2d2c10f520 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.253+0000 7f2d33b51640 1 --2- 172.21.15.49:0/905714661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d2c1083a0 0x7f2d2c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.253+0000 7f2d33b51640 1 --2- 172.21.15.49:0/905714661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c102a60 0x7f2d2c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:27.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.253+0000 7f2d33b51640 1 -- 172.21.15.49:0/905714661 >> 172.21.15.49:0/905714661 conn(0x7f2d2c079730 msgr2=0x7f2d2c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.253+0000 7f2d33b51640 1 -- 172.21.15.49:0/905714661 shutdown_connections 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.253+0000 7f2d33b51640 1 -- 172.21.15.49:0/905714661 wait complete. 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d33b51640 1 Processor -- start 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d33b51640 1 -- start start 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d33b51640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d2c102a60 0x7f2d2c19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d33b51640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c1083a0 0x7f2d2c19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d33b51640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d2c108cf0 0x7f2d2c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d33b51640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c112960 con 0x7f2d2c102a60 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d33b51640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c1127e0 con 0x7f2d2c1083a0 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d33b51640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c112ae0 con 0x7f2d2c108cf0 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d318ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d2c102a60 0x7f2d2c19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:27.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d318ed640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d2c102a60 0x7f2d2c19b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47894/0 (socket says 172.21.15.49:47894) 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d318ed640 1 -- 172.21.15.49:0/1348761334 learned_addr learned my addr 172.21.15.49:0/1348761334 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d320ee640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d2c108cf0 0x7f2d2c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d310ec640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c1083a0 0x7f2d2c19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d318ed640 1 -- 172.21.15.49:0/1348761334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d2c108cf0 msgr2=0x7f2d2c19bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d318ed640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d2c108cf0 0x7f2d2c19bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d318ed640 1 -- 172.21.15.49:0/1348761334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c1083a0 msgr2=0x7f2d2c19b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d318ed640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2d2c1083a0 0x7f2d2c19b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d318ed640 1 -- 172.21.15.49:0/1348761334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c1a6500 con 0x7f2d2c102a60 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.254+0000 7f2d320ee640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2d2c108cf0 0x7f2d2c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.255+0000 7f2d318ed640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d2c102a60 0x7f2d2c19b270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800e9f0 tx=0x7f2d2800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.255+0000 7f2d22ffd640 1 -- 172.21.15.49:0/1348761334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800cd80 con 0x7f2d2c102a60 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.255+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2c1a67f0 con 0x7f2d2c102a60 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.255+0000 7f2d22ffd640 1 -- 172.21.15.49:0/1348761334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d280108e0 con 0x7f2d2c102a60 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.255+0000 7f2d22ffd640 1 -- 172.21.15.49:0/1348761334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d28018980 con 0x7f2d2c102a60 2024-09-21T06:35:27.595 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.255+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2c1a6d80 con 0x7f2d2c102a60 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.256+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d2c063b10 con 0x7f2d2c102a60 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.259+0000 7f2d22ffd640 1 -- 172.21.15.49:0/1348761334 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f2d28010430 con 0x7f2d2c102a60 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.260+0000 7f2d22ffd640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d180b66a0 0x7f2d180b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.260+0000 7f2d22ffd640 1 -- 172.21.15.49:0/1348761334 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f2d280e80f0 con 0x7f2d2c102a60 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.260+0000 7f2d22ffd640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] conn(0x7f2d180c04b0 0x7f2d180c2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.260+0000 7f2d22ffd640 1 -- 172.21.15.49:0/1348761334 --> [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d2800ae50 con 0x7f2d180c04b0 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.260+0000 7f2d22ffd640 1 -- 172.21.15.49:0/1348761334 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f2d280e8540 con 0x7f2d2c102a60 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.260+0000 7f2d320ee640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] conn(0x7f2d180c04b0 0x7f2d180c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.260+0000 7f2d310ec640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d180b66a0 0x7f2d180b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.261+0000 7f2d320ee640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] conn(0x7f2d180c04b0 0x7f2d180c2980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.261+0000 7f2d310ec640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d180b66a0 0x7f2d180b8bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c005fd0 tx=0x7f2d1c00b510 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.262+0000 7f2d22ffd640 1 -- 172.21.15.49:0/1348761334 <== osd.0 v2:172.21.15.49:6802/3210538796 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d2800ae50 con 0x7f2d180c04b0 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.275+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 --> [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d2c063f10 con 0x7f2d180c04b0 2024-09-21T06:35:27.596 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d22ffd640 1 -- 172.21.15.49:0/1348761334 <== osd.0 v2:172.21.15.49:6802/3210538796 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2d2c063f10 con 0x7f2d180c04b0 2024-09-21T06:35:27.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] conn(0x7f2d180c04b0 msgr2=0x7f2d180c2980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:27.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] conn(0x7f2d180c04b0 0x7f2d180c2980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:27.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d180b66a0 msgr2=0x7f2d180b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:27.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d180b66a0 0x7f2d180b8bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c005fd0 tx=0x7f2d1c00b510 comp rx=0 tx=0).stop 2024-09-21T06:35:27.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d2c102a60 msgr2=0x7f2d2c19b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:27.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 --2- 172.21.15.49:0/1348761334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2d2c102a60 0x7f2d2c19b270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800e9f0 tx=0x7f2d2800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:35:27.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d320ee640 1 -- 172.21.15.49:0/1348761334 reap_dead start 2024-09-21T06:35:27.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 shutdown_connections 2024-09-21T06:35:27.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 >> 172.21.15.49:0/1348761334 conn(0x7f2d2c079730 msgr2=0x7f2d2c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:27.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 shutdown_connections 2024-09-21T06:35:27.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:26.276+0000 7f2d33b51640 1 -- 172.21.15.49:0/1348761334 wait complete. 2024-09-21T06:35:27.640 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:27 smithi079 ceph-mon[34346]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 170 B/s wr, 4 op/s; 5.3 KiB/s, 0 objects/s recovering 2024-09-21T06:35:27.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:27 smithi098 ceph-mon[34704]: pgmap v281: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 170 B/s wr, 4 op/s; 5.3 KiB/s, 0 objects/s recovering 2024-09-21T06:35:28.161 INFO:teuthology.orchestra.run.smithi049.stdout:38654705741 2024-09-21T06:35:28.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T06:35:28.170 INFO:teuthology.orchestra.run.smithi049.stdout:154618822707 2024-09-21T06:35:28.170 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T06:35:28.848 INFO:teuthology.orchestra.run.smithi049.stdout:180388626478 2024-09-21T06:35:28.848 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T06:35:29.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.211+0000 7f5e84a2c640 1 -- 172.21.15.49:0/778580204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e80104840 msgr2=0x7f5e80104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:29.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.211+0000 7f5e84a2c640 1 --2- 172.21.15.49:0/778580204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e80104840 0x7f5e80104c50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009900 tx=0x7f5e6802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:29.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.211+0000 7f5e84a2c640 1 -- 172.21.15.49:0/778580204 shutdown_connections 2024-09-21T06:35:29.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.211+0000 7f5e84a2c640 1 --2- 172.21.15.49:0/778580204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8010ddf0 0x7f5e80110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:29.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.211+0000 7f5e84a2c640 1 --2- 172.21.15.49:0/778580204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e80105270 0x7f5e8010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:29.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.211+0000 7f5e84a2c640 1 --2- 172.21.15.49:0/778580204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e80104840 0x7f5e80104c50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.211+0000 7f5e84a2c640 1 -- 172.21.15.49:0/778580204 >> 172.21.15.49:0/778580204 conn(0x7f5e80079730 msgr2=0x7f5e80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.211+0000 7f5e84a2c640 1 -- 172.21.15.49:0/778580204 shutdown_connections 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.211+0000 7f5e84a2c640 1 -- 172.21.15.49:0/778580204 wait complete. 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e84a2c640 1 Processor -- start 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e84a2c640 1 -- start start 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e84a2c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e80104840 0x7f5e8019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e84a2c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e80105270 0x7f5e8019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e84a2c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8010ddf0 0x7f5e8019fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e84a2c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80113b50 con 0x7f5e80104840 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e84a2c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e801139d0 con 0x7f5e80105270 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e84a2c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80113cd0 con 0x7f5e8010ddf0 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e80104840 0x7f5e8019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e7e59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e80104840 0x7f5e8019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47914/0 (socket says 172.21.15.49:47914) 2024-09-21T06:35:29.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e7e59c640 1 -- 172.21.15.49:0/686379131 learned_addr learned my addr 172.21.15.49:0/686379131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e7dd9b640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e80105270 0x7f5e8019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.212+0000 7f5e7ed9d640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8010ddf0 0x7f5e8019fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e7e59c640 1 -- 172.21.15.49:0/686379131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8010ddf0 msgr2=0x7f5e8019fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e7e59c640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e8010ddf0 0x7f5e8019fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e7e59c640 1 -- 172.21.15.49:0/686379131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e80105270 msgr2=0x7f5e8019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e7e59c640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e80105270 0x7f5e8019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e7e59c640 1 -- 172.21.15.49:0/686379131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e801a05b0 con 0x7f5e80104840 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e7dd9b640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e80105270 0x7f5e8019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e7e59c640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e80104840 0x7f5e8019a640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e68031a90 tx=0x7f5e68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e777fe640 1 -- 172.21.15.49:0/686379131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6803f030 con 0x7f5e80104840 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e777fe640 1 -- 172.21.15.49:0/686379131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e68003cb0 con 0x7f5e80104840 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e801a0840 con 0x7f5e80104840 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e777fe640 1 -- 172.21.15.49:0/686379131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68035070 con 0x7f5e80104840 2024-09-21T06:35:29.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.213+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e801a7000 con 0x7f5e80104840 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.214+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e80063b50 con 0x7f5e80104840 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.216+0000 7f5e777fe640 1 -- 172.21.15.49:0/686379131 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f5e68042030 con 0x7f5e80104840 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.217+0000 7f5e777fe640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e6c0b65f0 0x7f5e6c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.217+0000 7f5e7dd9b640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e6c0b65f0 0x7f5e6c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.217+0000 7f5e777fe640 1 -- 172.21.15.49:0/686379131 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f5e68108140 con 0x7f5e80104840 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.217+0000 7f5e777fe640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] conn(0x7f5e6c0c0400 0x7f5e6c0c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.217+0000 7f5e777fe640 1 -- 172.21.15.49:0/686379131 --> [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e6c0c2fa0 con 0x7f5e6c0c0400 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.217+0000 7f5e777fe640 1 -- 172.21.15.49:0/686379131 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f5e681084f0 con 0x7f5e80104840 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.217+0000 7f5e7dd9b640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e6c0b65f0 0x7f5e6c0b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5e8007a020 tx=0x7f5e70008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.218+0000 7f5e7ed9d640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] conn(0x7f5e6c0c0400 0x7f5e6c0c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.218+0000 7f5e7ed9d640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] conn(0x7f5e6c0c0400 0x7f5e6c0c28d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.219+0000 7f5e777fe640 1 -- 172.21.15.49:0/686379131 <== osd.10 v2:172.21.15.79:6824/194415108 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5e6c0c2fa0 con 0x7f5e6c0c0400 2024-09-21T06:35:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.233+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 --> [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e80063fd0 con 0x7f5e6c0c0400 2024-09-21T06:35:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.233+0000 7f5e777fe640 1 -- 172.21.15.49:0/686379131 <== osd.10 v2:172.21.15.79:6824/194415108 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5e80063fd0 con 0x7f5e6c0c0400 2024-09-21T06:35:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 >> [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] conn(0x7f5e6c0c0400 msgr2=0x7f5e6c0c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] conn(0x7f5e6c0c0400 0x7f5e6c0c28d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e6c0b65f0 msgr2=0x7f5e6c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e6c0b65f0 0x7f5e6c0b8b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5e8007a020 tx=0x7f5e70008040 comp rx=0 tx=0).stop 2024-09-21T06:35:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e80104840 msgr2=0x7f5e8019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 --2- 172.21.15.49:0/686379131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e80104840 0x7f5e8019a640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e68031a90 tx=0x7f5e68004270 comp rx=0 tx=0).stop 2024-09-21T06:35:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e7ed9d640 1 -- 172.21.15.49:0/686379131 reap_dead start 2024-09-21T06:35:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 shutdown_connections 2024-09-21T06:35:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 >> 172.21.15.49:0/686379131 conn(0x7f5e80079730 msgr2=0x7f5e800ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 shutdown_connections 2024-09-21T06:35:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:29.234+0000 7f5e84a2c640 1 -- 172.21.15.49:0/686379131 wait complete. 2024-09-21T06:35:29.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:29 smithi049 ceph-mon[31177]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s; 5.3 KiB/s, 0 objects/s recovering 2024-09-21T06:35:29.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:29 smithi098 ceph-mon[34704]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s; 5.3 KiB/s, 0 objects/s recovering 2024-09-21T06:35:29.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:29 smithi079 ceph-mon[34346]: pgmap v282: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s; 5.3 KiB/s, 0 objects/s recovering 2024-09-21T06:35:30.070 INFO:teuthology.orchestra.run.smithi049.stdout:292057776149 2024-09-21T06:35:30.070 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T06:35:30.598 INFO:teuthology.orchestra.run.smithi049.stdout:107374182460 2024-09-21T06:35:30.599 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T06:35:31.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.292+0000 7f28b9056640 1 -- 172.21.15.49:0/2137180960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b4103b60 msgr2=0x7f28b4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.292+0000 7f28b9056640 1 --2- 172.21.15.49:0/2137180960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b4103b60 0x7f28b4103f70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f28a4009ca0 tx=0x7f28a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.292+0000 7f28b9056640 1 -- 172.21.15.49:0/2137180960 shutdown_connections 2024-09-21T06:35:31.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.292+0000 7f28b9056640 1 --2- 172.21.15.49:0/2137180960 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b4109df0 0x7f28b4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.292+0000 7f28b9056640 1 --2- 172.21.15.49:0/2137180960 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b41094a0 0x7f28b41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.292+0000 7f28b9056640 1 --2- 172.21.15.49:0/2137180960 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b4103b60 0x7f28b4103f70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.292+0000 7f28b9056640 1 -- 172.21.15.49:0/2137180960 >> 172.21.15.49:0/2137180960 conn(0x7f28b407b850 msgr2=0x7f28b407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:31.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.292+0000 7f28b9056640 1 -- 172.21.15.49:0/2137180960 shutdown_connections 2024-09-21T06:35:31.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.292+0000 7f28b9056640 1 -- 172.21.15.49:0/2137180960 wait complete. 2024-09-21T06:35:31.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.293+0000 7f28b9056640 1 Processor -- start 2024-09-21T06:35:31.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.293+0000 7f28b9056640 1 -- start start 2024-09-21T06:35:31.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b9056640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b4103b60 0x7f28b419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b9056640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b41094a0 0x7f28b419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b9056640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4109df0 0x7f28b419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b9056640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28b4113ab0 con 0x7f28b4103b60 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b9056640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28b4113930 con 0x7f28b4109df0 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b9056640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28b4113c30 con 0x7f28b41094a0 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b4103b60 0x7f28b419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b2d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b4103b60 0x7f28b419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47930/0 (socket says 172.21.15.49:47930) 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b2d9d640 1 -- 172.21.15.49:0/1246943190 learned_addr learned my addr 172.21.15.49:0/1246943190 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b259c640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b41094a0 0x7f28b419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b359e640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4109df0 0x7f28b419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b2d9d640 1 -- 172.21.15.49:0/1246943190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b41094a0 msgr2=0x7f28b419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b2d9d640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28b41094a0 0x7f28b419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b2d9d640 1 -- 172.21.15.49:0/1246943190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4109df0 msgr2=0x7f28b419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b2d9d640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28b4109df0 0x7f28b419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.294+0000 7f28b2d9d640 1 -- 172.21.15.49:0/1246943190 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b41a0310 con 0x7f28b4103b60 2024-09-21T06:35:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.295+0000 7f28b2d9d640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b4103b60 0x7f28b419a460 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f28a4006010 tx=0x7f28a40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.295+0000 7f28abfff640 1 -- 172.21.15.49:0/1246943190 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a4003bf0 con 0x7f28b4103b60 2024-09-21T06:35:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.295+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b41a05a0 con 0x7f28b4103b60 2024-09-21T06:35:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.295+0000 7f28abfff640 1 -- 172.21.15.49:0/1246943190 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28a4003d90 con 0x7f28b4103b60 2024-09-21T06:35:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.295+0000 7f28abfff640 1 -- 172.21.15.49:0/1246943190 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a402fc20 con 0x7f28b4103b60 2024-09-21T06:35:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.295+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b41a6e20 con 0x7f28b4103b60 2024-09-21T06:35:31.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.296+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28b4063b50 con 0x7f28b4103b60 2024-09-21T06:35:31.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.297+0000 7f28abfff640 1 -- 172.21.15.49:0/1246943190 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f28a40046a0 con 0x7f28b4103b60 2024-09-21T06:35:31.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.298+0000 7f28abfff640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28a00b6620 0x7f28a00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.298+0000 7f28b259c640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28a00b6620 0x7f28a00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.298+0000 7f28abfff640 1 -- 172.21.15.49:0/1246943190 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f28a4108aa0 con 0x7f28b4103b60 2024-09-21T06:35:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.299+0000 7f28abfff640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] conn(0x7f28a00c0430 0x7f28a00c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.299+0000 7f28abfff640 1 -- 172.21.15.49:0/1246943190 --> [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f28a00c2fd0 con 0x7f28a00c0430 2024-09-21T06:35:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.299+0000 7f28abfff640 1 -- 172.21.15.49:0/1246943190 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f28a4108ef0 con 0x7f28b4103b60 2024-09-21T06:35:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.299+0000 7f28b259c640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28a00b6620 0x7f28a00b8b30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f28b41064c0 tx=0x7f289c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.299+0000 7f28b359e640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] conn(0x7f28a00c0430 0x7f28a00c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.299+0000 7f28b359e640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] conn(0x7f28a00c0430 0x7f28a00c2900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:31.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.300+0000 7f28abfff640 1 -- 172.21.15.49:0/1246943190 <== osd.8 v2:172.21.15.98:6816/415055064 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f28a00c2fd0 con 0x7f28a00c0430 2024-09-21T06:35:31.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.314+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 --> [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f28b4063f50 con 0x7f28a00c0430 2024-09-21T06:35:31.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.314+0000 7f28abfff640 1 -- 172.21.15.49:0/1246943190 <== osd.8 v2:172.21.15.98:6816/415055064 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f28b4063f50 con 0x7f28a00c0430 2024-09-21T06:35:31.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 >> [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] conn(0x7f28a00c0430 msgr2=0x7f28a00c2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] conn(0x7f28a00c0430 0x7f28a00c2900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28a00b6620 msgr2=0x7f28a00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28a00b6620 0x7f28a00b8b30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f28b41064c0 tx=0x7f289c00b390 comp rx=0 tx=0).stop 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b4103b60 msgr2=0x7f28b419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 --2- 172.21.15.49:0/1246943190 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28b4103b60 0x7f28b419a460 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f28a4006010 tx=0x7f28a40319f0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b359e640 1 -- 172.21.15.49:0/1246943190 reap_dead start 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 shutdown_connections 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 >> 172.21.15.49:0/1246943190 conn(0x7f28b407b850 msgr2=0x7f28b4107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 shutdown_connections 2024-09-21T06:35:31.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.315+0000 7f28b9056640 1 -- 172.21.15.49:0/1246943190 wait complete. 2024-09-21T06:35:31.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:31 smithi049 ceph-mon[31177]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:35:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.526+0000 7f1688c8a640 1 -- 172.21.15.49:0/2103533977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16841052b0 msgr2=0x7f168410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.526+0000 7f1688c8a640 1 --2- 172.21.15.49:0/2103533977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16841052b0 0x7f168410d8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1678009900 tx=0x7f167802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.526+0000 7f1688c8a640 1 -- 172.21.15.49:0/2103533977 shutdown_connections 2024-09-21T06:35:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.526+0000 7f1688c8a640 1 --2- 172.21.15.49:0/2103533977 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f168410de30 0x7f1684110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.526+0000 7f1688c8a640 1 --2- 172.21.15.49:0/2103533977 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16841052b0 0x7f168410d8f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.526+0000 7f1688c8a640 1 --2- 172.21.15.49:0/2103533977 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1684104880 0x7f1684104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.526+0000 7f1688c8a640 1 -- 172.21.15.49:0/2103533977 >> 172.21.15.49:0/2103533977 conn(0x7f1684079730 msgr2=0x7f1684079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.526+0000 7f1688c8a640 1 -- 172.21.15.49:0/2103533977 shutdown_connections 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.526+0000 7f1688c8a640 1 -- 172.21.15.49:0/2103533977 wait complete. 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f1688c8a640 1 Processor -- start 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f1688c8a640 1 -- start start 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f1688c8a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1684104880 0x7f168419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f1688c8a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16841052b0 0x7f168419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f1688c8a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f168410de30 0x7f168419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f1688c8a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1684113a70 con 0x7f1684104880 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f1688c8a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16841138f0 con 0x7f168410de30 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f1688c8a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1684113bf0 con 0x7f16841052b0 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f168259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1684104880 0x7f168419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f168259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1684104880 0x7f168419a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47948/0 (socket says 172.21.15.49:47948) 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f168259c640 1 -- 172.21.15.49:0/1424617112 learned_addr learned my addr 172.21.15.49:0/1424617112 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:31.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.527+0000 7f1682d9d640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f168410de30 0x7f168419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f1681d9b640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16841052b0 0x7f168419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f168259c640 1 -- 172.21.15.49:0/1424617112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16841052b0 msgr2=0x7f168419aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f168259c640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16841052b0 0x7f168419aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f168259c640 1 -- 172.21.15.49:0/1424617112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f168410de30 msgr2=0x7f168419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f168259c640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f168410de30 0x7f168419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f168259c640 1 -- 172.21.15.49:0/1424617112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16841a03d0 con 0x7f1684104880 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f168259c640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1684104880 0x7f168419a520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f167400ea80 tx=0x7f167400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f16737fe640 1 -- 172.21.15.49:0/1424617112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167400ce40 con 0x7f1684104880 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f16737fe640 1 -- 172.21.15.49:0/1424617112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1674011920 con 0x7f1684104880 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16841a06c0 con 0x7f1684104880 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f16737fe640 1 -- 172.21.15.49:0/1424617112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167401aaa0 con 0x7f1684104880 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.528+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16841a6ee0 con 0x7f1684104880 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.529+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1684063b50 con 0x7f1684104880 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.531+0000 7f16737fe640 1 -- 172.21.15.49:0/1424617112 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f167401ac40 con 0x7f1684104880 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.531+0000 7f16737fe640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f166c0b6620 0x7f166c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.531+0000 7f1681d9b640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f166c0b6620 0x7f166c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.532+0000 7f16737fe640 1 -- 172.21.15.49:0/1424617112 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f16740e7f40 con 0x7f1684104880 2024-09-21T06:35:31.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.532+0000 7f16737fe640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] conn(0x7f166c0c0430 0x7f166c0c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.532+0000 7f16737fe640 1 -- 172.21.15.49:0/1424617112 --> [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f166c0c2fd0 con 0x7f166c0c0430 2024-09-21T06:35:31.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.532+0000 7f16737fe640 1 -- 172.21.15.49:0/1424617112 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f16740e8390 con 0x7f1684104880 2024-09-21T06:35:31.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.532+0000 7f1681d9b640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f166c0b6620 0x7f166c0b8b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f167802a930 tx=0x7f1678000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:31.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.532+0000 7f1682d9d640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] conn(0x7f166c0c0430 0x7f166c0c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.532+0000 7f1682d9d640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] conn(0x7f166c0c0430 0x7f166c0c2900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:31.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.533+0000 7f16737fe640 1 -- 172.21.15.49:0/1424617112 <== osd.7 v2:172.21.15.79:6816/3688302425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f166c0c2fd0 con 0x7f166c0c0430 2024-09-21T06:35:31.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.547+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 --> [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1684063fd0 con 0x7f166c0c0430 2024-09-21T06:35:31.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f16737fe640 1 -- 172.21.15.49:0/1424617112 <== osd.7 v2:172.21.15.79:6816/3688302425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1684063fd0 con 0x7f166c0c0430 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 >> [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] conn(0x7f166c0c0430 msgr2=0x7f166c0c2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] conn(0x7f166c0c0430 0x7f166c0c2900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f166c0b6620 msgr2=0x7f166c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f166c0b6620 0x7f166c0b8b30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f167802a930 tx=0x7f1678000bc0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1684104880 msgr2=0x7f168419a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 --2- 172.21.15.49:0/1424617112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1684104880 0x7f168419a520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f167400ea80 tx=0x7f167400ef40 comp rx=0 tx=0).stop 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1682d9d640 1 -- 172.21.15.49:0/1424617112 reap_dead start 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 shutdown_connections 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 >> 172.21.15.49:0/1424617112 conn(0x7f1684079730 msgr2=0x7f16841008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 shutdown_connections 2024-09-21T06:35:31.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:31.548+0000 7f1688c8a640 1 -- 172.21.15.49:0/1424617112 wait complete. 2024-09-21T06:35:31.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:31 smithi098 ceph-mon[34704]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:35:31.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:31 smithi079 ceph-mon[34346]: pgmap v283: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:35:32.364 INFO:teuthology.orchestra.run.smithi049.stdout:227633266724 2024-09-21T06:35:32.365 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T06:35:32.633 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:32.692 INFO:teuthology.orchestra.run.smithi049.stdout:270582939674 2024-09-21T06:35:32.692 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T06:35:32.911 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:32.912 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:32.912 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:32.916 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:32.922 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:32.926 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:32.926 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:33.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.252+0000 7febd030f640 1 -- 172.21.15.49:0/3050663863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc81083a0 msgr2=0x7febc81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.252+0000 7febd030f640 1 --2- 172.21.15.49:0/3050663863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc81083a0 0x7febc81087b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7febbc009900 tx=0x7febbc02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.252+0000 7febd030f640 1 -- 172.21.15.49:0/3050663863 shutdown_connections 2024-09-21T06:35:33.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.252+0000 7febd030f640 1 --2- 172.21.15.49:0/3050663863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc8108cf0 0x7febc810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.252+0000 7febd030f640 1 --2- 172.21.15.49:0/3050663863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc81083a0 0x7febc81087b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.252+0000 7febd030f640 1 --2- 172.21.15.49:0/3050663863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febc8102a60 0x7febc8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.252+0000 7febd030f640 1 -- 172.21.15.49:0/3050663863 >> 172.21.15.49:0/3050663863 conn(0x7febc8079730 msgr2=0x7febc8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:33.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.252+0000 7febd030f640 1 -- 172.21.15.49:0/3050663863 shutdown_connections 2024-09-21T06:35:33.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.252+0000 7febd030f640 1 -- 172.21.15.49:0/3050663863 wait complete. 2024-09-21T06:35:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febd030f640 1 Processor -- start 2024-09-21T06:35:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febd030f640 1 -- start start 2024-09-21T06:35:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febd030f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc8102a60 0x7febc8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febd030f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febc81083a0 0x7febc81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febd030f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc8108cf0 0x7febc819eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febd030f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7febc8112960 con 0x7febc8102a60 2024-09-21T06:35:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febd030f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7febc81127e0 con 0x7febc81083a0 2024-09-21T06:35:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febd030f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7febc8112ae0 con 0x7febc8108cf0 2024-09-21T06:35:33.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febce0ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc8102a60 0x7febc8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febce0ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc8102a60 0x7febc8199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47962/0 (socket says 172.21.15.49:47962) 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febce0ab640 1 -- 172.21.15.49:0/3387070856 learned_addr learned my addr 172.21.15.49:0/3387070856 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.253+0000 7febcd8aa640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febc81083a0 0x7febc81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febce8ac640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc8108cf0 0x7febc819eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febce0ab640 1 -- 172.21.15.49:0/3387070856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc8108cf0 msgr2=0x7febc819eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febce0ab640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc8108cf0 0x7febc819eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febce0ab640 1 -- 172.21.15.49:0/3387070856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febc81083a0 msgr2=0x7febc81998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febce0ab640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febc81083a0 0x7febc81998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febce0ab640 1 -- 172.21.15.49:0/3387070856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc819f200 con 0x7febc8102a60 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febcd8aa640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febc81083a0 0x7febc81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febce8ac640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc8108cf0 0x7febc819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febce0ab640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc8102a60 0x7febc8199350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7febc0007b50 tx=0x7febc000e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febc77fe640 1 -- 172.21.15.49:0/3387070856 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc0007c40 con 0x7febc8102a60 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc819f4f0 con 0x7febc8102a60 2024-09-21T06:35:33.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febc77fe640 1 -- 172.21.15.49:0/3387070856 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febc0007de0 con 0x7febc8102a60 2024-09-21T06:35:33.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febc77fe640 1 -- 172.21.15.49:0/3387070856 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc000ace0 con 0x7febc8102a60 2024-09-21T06:35:33.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.254+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc806ae60 con 0x7febc8102a60 2024-09-21T06:35:33.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.255+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febc8103ce0 con 0x7febc8102a60 2024-09-21T06:35:33.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.257+0000 7febc77fe640 1 -- 172.21.15.49:0/3387070856 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7febc000eb30 con 0x7febc8102a60 2024-09-21T06:35:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.257+0000 7febc77fe640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7febb00b6620 0x7febb00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.258+0000 7febcd8aa640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7febb00b6620 0x7febb00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.258+0000 7febc77fe640 1 -- 172.21.15.49:0/3387070856 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7febc00e8ea0 con 0x7febc8102a60 2024-09-21T06:35:33.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.258+0000 7febcd8aa640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7febb00b6620 0x7febb00b8b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7febbc000c00 tx=0x7febbc032da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:33.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.261+0000 7febc77fe640 1 -- 172.21.15.49:0/3387070856 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7febc0023060 con 0x7febc8102a60 2024-09-21T06:35:33.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.461+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7febc8102e70 con 0x7febc8102a60 2024-09-21T06:35:33.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:33 smithi049 ceph-mon[31177]: pgmap v284: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:35:33.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.461+0000 7febc77fe640 1 -- 172.21.15.49:0/3387070856 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7febc000ee20 con 0x7febc8102a60 2024-09-21T06:35:33.463 INFO:teuthology.orchestra.run.smithi049.stdout:60129542217 2024-09-21T06:35:33.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7febb00b6620 msgr2=0x7febb00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7febb00b6620 0x7febb00b8b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7febbc000c00 tx=0x7febbc032da0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc8102a60 msgr2=0x7febc8199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc8102a60 0x7febc8199350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7febc0007b50 tx=0x7febc000e420 comp rx=0 tx=0).stop 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 shutdown_connections 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7febb00b6620 0x7febb00b8b30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7febc8108cf0 0x7febc819eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7febc81083a0 0x7febc81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 --2- 172.21.15.49:0/3387070856 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7febc8102a60 0x7febc8199350 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 >> 172.21.15.49:0/3387070856 conn(0x7febc8079730 msgr2=0x7febc81043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 shutdown_connections 2024-09-21T06:35:33.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:33.464+0000 7febd030f640 1 -- 172.21.15.49:0/3387070856 wait complete. 2024-09-21T06:35:33.670 INFO:teuthology.orchestra.run.smithi049.stdout:206158430250 2024-09-21T06:35:33.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T06:35:33.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:33 smithi098 ceph-mon[34704]: pgmap v284: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:35:33.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:33 smithi079 ceph-mon[34346]: pgmap v284: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:35:33.885 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:33.887 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:34.373 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:34 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3387070856' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:35:34.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.600+0000 7f0126924640 1 -- 172.21.15.49:0/528893852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 msgr2=0x7f0120102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:34.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.600+0000 7f0126924640 1 --2- 172.21.15.49:0/528893852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 0x7f0120102ef0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0110009900 tx=0x7f011002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:34.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.600+0000 7f0126924640 1 -- 172.21.15.49:0/528893852 shutdown_connections 2024-09-21T06:35:34.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.600+0000 7f0126924640 1 --2- 172.21.15.49:0/528893852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0120108d20 0x7f012010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.600+0000 7f0126924640 1 --2- 172.21.15.49:0/528893852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f01201083d0 0x7f01201087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.600+0000 7f0126924640 1 --2- 172.21.15.49:0/528893852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 0x7f0120102ef0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.600+0000 7f0126924640 1 -- 172.21.15.49:0/528893852 >> 172.21.15.49:0/528893852 conn(0x7f0120079790 msgr2=0x7f0120079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:34.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.600+0000 7f0126924640 1 -- 172.21.15.49:0/528893852 shutdown_connections 2024-09-21T06:35:34.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.600+0000 7f0126924640 1 -- 172.21.15.49:0/528893852 wait complete. 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0126924640 1 Processor -- start 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0126924640 1 -- start start 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0126924640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 0x7f012019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0126924640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01201083d0 0x7f012019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0126924640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0120108d20 0x7f012019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0126924640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0120112a20 con 0x7f0120102ae0 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0126924640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f01201128a0 con 0x7f01201083d0 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0126924640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0120112ba0 con 0x7f0120108d20 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f011ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 0x7f012019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f011ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 0x7f012019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47988/0 (socket says 172.21.15.49:47988) 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f011ffff640 1 -- 172.21.15.49:0/1437537602 learned_addr learned my addr 172.21.15.49:0/1437537602 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0117fff640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01201083d0 0x7f012019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f011ffff640 1 -- 172.21.15.49:0/1437537602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0120108d20 msgr2=0x7f012019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:34.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f0124ec1640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0120108d20 0x7f012019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f011ffff640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0120108d20 0x7f012019fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f011ffff640 1 -- 172.21.15.49:0/1437537602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01201083d0 msgr2=0x7f012019ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f011ffff640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01201083d0 0x7f012019ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.601+0000 7f011ffff640 1 -- 172.21.15.49:0/1437537602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01201a0530 con 0x7f0120102ae0 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.602+0000 7f0117fff640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01201083d0 0x7f012019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.602+0000 7f0124ec1640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0120108d20 0x7f012019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.602+0000 7f011ffff640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 0x7f012019a5c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0110006010 tx=0x7f01100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.602+0000 7f011dffb640 1 -- 172.21.15.49:0/1437537602 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f011003f030 con 0x7f0120102ae0 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.602+0000 7f011dffb640 1 -- 172.21.15.49:0/1437537602 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0110003800 con 0x7f0120102ae0 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.602+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01201a07c0 con 0x7f0120102ae0 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.602+0000 7f011dffb640 1 -- 172.21.15.49:0/1437537602 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0110035070 con 0x7f0120102ae0 2024-09-21T06:35:34.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.602+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01201a6f80 con 0x7f0120102ae0 2024-09-21T06:35:34.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.603+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0120102ef0 con 0x7f0120102ae0 2024-09-21T06:35:34.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.605+0000 7f011dffb640 1 -- 172.21.15.49:0/1437537602 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f01100039b0 con 0x7f0120102ae0 2024-09-21T06:35:34.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.605+0000 7f011dffb640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f010c0b6670 0x7f010c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:34.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.605+0000 7f0117fff640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f010c0b6670 0x7f010c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:34.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.606+0000 7f011dffb640 1 -- 172.21.15.49:0/1437537602 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f0110107f90 con 0x7f0120102ae0 2024-09-21T06:35:34.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.606+0000 7f0117fff640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f010c0b6670 0x7f010c0b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0108006fd0 tx=0x7f0108008040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:34.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.610+0000 7f011dffb640 1 -- 172.21.15.49:0/1437537602 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01100ce5e0 con 0x7f0120102ae0 2024-09-21T06:35:34.750 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:34.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:34 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3387070856' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:35:34.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.803+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f012019b6f0 con 0x7f0120102ae0 2024-09-21T06:35:34.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.803+0000 7f011dffb640 1 -- 172.21.15.49:0/1437537602 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f01100d29c0 con 0x7f0120102ae0 2024-09-21T06:35:34.806 INFO:teuthology.orchestra.run.smithi049.stdout:292057776151 2024-09-21T06:35:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f010c0b6670 msgr2=0x7f010c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f010c0b6670 0x7f010c0b8b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0108006fd0 tx=0x7f0108008040 comp rx=0 tx=0).stop 2024-09-21T06:35:34.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 msgr2=0x7f012019a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 0x7f012019a5c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0110006010 tx=0x7f01100042f0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 shutdown_connections 2024-09-21T06:35:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f010c0b6670 0x7f010c0b8b80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0120108d20 0x7f012019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f01201083d0 0x7f012019ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 --2- 172.21.15.49:0/1437537602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0120102ae0 0x7f012019a5c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 >> 172.21.15.49:0/1437537602 conn(0x7f0120079790 msgr2=0x7f0120101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 shutdown_connections 2024-09-21T06:35:34.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:34.806+0000 7f0126924640 1 -- 172.21.15.49:0/1437537602 wait complete. 2024-09-21T06:35:34.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:34 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3387070856' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:35:35.041 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542215 got 60129542217 for osd.1 2024-09-21T06:35:35.042 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:35.431 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:35 smithi049 ceph-mon[31177]: pgmap v285: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:35.431 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:35 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1437537602' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:35:35.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:35 smithi098 ceph-mon[34704]: pgmap v285: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:35.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:35 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1437537602' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:35:35.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:35 smithi079 ceph-mon[34346]: pgmap v285: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:35.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:35 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1437537602' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.182+0000 7f6dd74fe640 1 -- 172.21.15.49:0/1539638344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 msgr2=0x7f6dd0110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.182+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/1539638344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 0x7f6dd0110330 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009ca0 tx=0x7f6dc802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.183+0000 7f6dd74fe640 1 -- 172.21.15.49:0/1539638344 shutdown_connections 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.183+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/1539638344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 0x7f6dd0110330 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.183+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/1539638344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd0105310 0x7f6dd010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.183+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/1539638344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd01048e0 0x7f6dd0104cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.183+0000 7f6dd74fe640 1 -- 172.21.15.49:0/1539638344 >> 172.21.15.49:0/1539638344 conn(0x7f6dd00797b0 msgr2=0x7f6dd0079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.183+0000 7f6dd74fe640 1 -- 172.21.15.49:0/1539638344 shutdown_connections 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.183+0000 7f6dd74fe640 1 -- 172.21.15.49:0/1539638344 wait complete. 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.183+0000 7f6dd74fe640 1 Processor -- start 2024-09-21T06:35:36.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.183+0000 7f6dd74fe640 1 -- start start 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd74fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd01048e0 0x7f6dd01027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd74fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd0105310 0x7f6dd0102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd74fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 0x7f6dd0103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd74fe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0113ac0 con 0x7f6dd010de90 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd74fe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0113940 con 0x7f6dd0105310 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd74fe640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0113c40 con 0x7f6dd01048e0 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd5a9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 0x7f6dd0103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd5a9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 0x7f6dd0103270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48012/0 (socket says 172.21.15.49:48012) 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd5a9b640 1 -- 172.21.15.49:0/2537250877 learned_addr learned my addr 172.21.15.49:0/2537250877 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd529a640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd01048e0 0x7f6dd01027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd4a99640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd0105310 0x7f6dd0102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd5a9b640 1 -- 172.21.15.49:0/2537250877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd01048e0 msgr2=0x7f6dd01027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd5a9b640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd01048e0 0x7f6dd01027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd5a9b640 1 -- 172.21.15.49:0/2537250877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd0105310 msgr2=0x7f6dd0102d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd5a9b640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd0105310 0x7f6dd0102d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd5a9b640 1 -- 172.21.15.49:0/2537250877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd01a8660 con 0x7f6dd010de90 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd4a99640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd0105310 0x7f6dd0102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.184+0000 7f6dd5a9b640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 0x7f6dd0103270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8005cc0 tx=0x7f6dc802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.185+0000 7f6dc67fc640 1 -- 172.21.15.49:0/2537250877 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8003bf0 con 0x7f6dd010de90 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.185+0000 7f6dc67fc640 1 -- 172.21.15.49:0/2537250877 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc8003d90 con 0x7f6dd010de90 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.185+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd01a88f0 con 0x7f6dd010de90 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.185+0000 7f6dc67fc640 1 -- 172.21.15.49:0/2537250877 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc802fbc0 con 0x7f6dd010de90 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.185+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd01a8e80 con 0x7f6dd010de90 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.186+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd0104cf0 con 0x7f6dd010de90 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.187+0000 7f6dc67fc640 1 -- 172.21.15.49:0/2537250877 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6dc802fd60 con 0x7f6dd010de90 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.188+0000 7f6dc67fc640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6670 0x7f6dbc0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:36.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.188+0000 7f6dd529a640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6670 0x7f6dbc0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:36.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.188+0000 7f6dc67fc640 1 -- 172.21.15.49:0/2537250877 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f6dc8108a70 con 0x7f6dd010de90 2024-09-21T06:35:36.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.189+0000 7f6dd529a640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6670 0x7f6dbc0b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0104240 tx=0x7f6dcc00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:36.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.193+0000 7f6dc67fc640 1 -- 172.21.15.49:0/2537250877 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6dc80cf0c0 con 0x7f6dd010de90 2024-09-21T06:35:36.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.407+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6dd01a9180 con 0x7f6dd010de90 2024-09-21T06:35:36.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.407+0000 7f6dc67fc640 1 -- 172.21.15.49:0/2537250877 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6dc80098b0 con 0x7f6dd010de90 2024-09-21T06:35:36.410 INFO:teuthology.orchestra.run.smithi049.stdout:81604378693 2024-09-21T06:35:36.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6670 msgr2=0x7f6dbc0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6670 0x7f6dbc0b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0104240 tx=0x7f6dcc00b390 comp rx=0 tx=0).stop 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 msgr2=0x7f6dd0103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 0x7f6dd0103270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8005cc0 tx=0x7f6dc802f380 comp rx=0 tx=0).stop 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 shutdown_connections 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6670 0x7f6dbc0b8b80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd010de90 0x7f6dd0103270 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd0105310 0x7f6dd0102d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 --2- 172.21.15.49:0/2537250877 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd01048e0 0x7f6dd01027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 >> 172.21.15.49:0/2537250877 conn(0x7f6dd00797b0 msgr2=0x7f6dd0107950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 shutdown_connections 2024-09-21T06:35:36.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.410+0000 7f6dd74fe640 1 -- 172.21.15.49:0/2537250877 wait complete. 2024-09-21T06:35:36.533 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:36 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/304960533' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:35:36.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:36 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/304960533' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:35:36.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:36 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/304960533' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:35:37.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.064+0000 7faff85ca640 1 -- 172.21.15.49:0/1875770353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01062c0 msgr2=0x7faff01066d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:37.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.064+0000 7faff85ca640 1 --2- 172.21.15.49:0/1875770353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01062c0 0x7faff01066d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009900 tx=0x7fafe002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:37.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.065+0000 7faff85ca640 1 -- 172.21.15.49:0/1875770353 shutdown_connections 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.065+0000 7faff85ca640 1 --2- 172.21.15.49:0/1875770353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faff0106c10 0x7faff0110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.065+0000 7faff85ca640 1 --2- 172.21.15.49:0/1875770353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01062c0 0x7faff01066d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.065+0000 7faff85ca640 1 --2- 172.21.15.49:0/1875770353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff01020d0 0x7faff01024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.065+0000 7faff85ca640 1 -- 172.21.15.49:0/1875770353 >> 172.21.15.49:0/1875770353 conn(0x7faff0079e30 msgr2=0x7faff007a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.065+0000 7faff85ca640 1 -- 172.21.15.49:0/1875770353 shutdown_connections 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.065+0000 7faff85ca640 1 -- 172.21.15.49:0/1875770353 wait complete. 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.065+0000 7faff85ca640 1 Processor -- start 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.065+0000 7faff85ca640 1 -- start start 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff85ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01020d0 0x7faff019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:37.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff85ca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff01062c0 0x7faff019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff85ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faff0106c10 0x7faff019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff85ca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faff0113ab0 con 0x7faff01020d0 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff85ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faff0113930 con 0x7faff0106c10 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff85ca640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faff0113c30 con 0x7faff01062c0 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6366640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01020d0 0x7faff019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6366640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01020d0 0x7faff019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47994/0 (socket says 172.21.15.49:47994) 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6366640 1 -- 172.21.15.49:0/304960533 learned_addr learned my addr 172.21.15.49:0/304960533 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6b67640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faff0106c10 0x7faff019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff5b65640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff01062c0 0x7faff019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6366640 1 -- 172.21.15.49:0/304960533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff01062c0 msgr2=0x7faff019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6366640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff01062c0 0x7faff019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6366640 1 -- 172.21.15.49:0/304960533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faff0106c10 msgr2=0x7faff019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6366640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faff0106c10 0x7faff019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:37.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6366640 1 -- 172.21.15.49:0/304960533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff01a0410 con 0x7faff01020d0 2024-09-21T06:35:37.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6b67640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faff0106c10 0x7faff019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:37.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff6366640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01020d0 0x7faff019a4a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fafec00d950 tx=0x7fafec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:37.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7fafe77fe640 1 -- 172.21.15.49:0/304960533 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec017070 con 0x7faff01020d0 2024-09-21T06:35:37.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faff01a0700 con 0x7faff01020d0 2024-09-21T06:35:37.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7fafe77fe640 1 -- 172.21.15.49:0/304960533 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafec009c30 con 0x7faff01020d0 2024-09-21T06:35:37.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.066+0000 7fafe77fe640 1 -- 172.21.15.49:0/304960533 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec00f620 con 0x7faff01020d0 2024-09-21T06:35:37.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.067+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faff01a6e60 con 0x7faff01020d0 2024-09-21T06:35:37.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.067+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff01024e0 con 0x7faff01020d0 2024-09-21T06:35:37.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.069+0000 7fafe77fe640 1 -- 172.21.15.49:0/304960533 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fafec005030 con 0x7faff01020d0 2024-09-21T06:35:37.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.070+0000 7fafe77fe640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafdc0b65f0 0x7fafdc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:37.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.070+0000 7faff5b65640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafdc0b65f0 0x7fafdc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:37.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.070+0000 7fafe77fe640 1 -- 172.21.15.49:0/304960533 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fafec0e7280 con 0x7faff01020d0 2024-09-21T06:35:37.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.070+0000 7faff5b65640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafdc0b65f0 0x7fafdc0b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000c00 tx=0x7fafe0031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:37.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.073+0000 7fafe77fe640 1 -- 172.21.15.49:0/304960533 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fafec0ad8d0 con 0x7faff01020d0 2024-09-21T06:35:37.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.279+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7faff010bc50 con 0x7faff01020d0 2024-09-21T06:35:37.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.279+0000 7fafe77fe640 1 -- 172.21.15.49:0/304960533 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fafec009de0 con 0x7faff01020d0 2024-09-21T06:35:37.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.282+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafdc0b65f0 msgr2=0x7fafdc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:37.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.282+0000 7faff85ca640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafdc0b65f0 0x7fafdc0b8b00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000c00 tx=0x7fafe0031400 comp rx=0 tx=0).stop 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.282+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01020d0 msgr2=0x7faff019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.282+0000 7faff85ca640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01020d0 0x7faff019a4a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fafec00d950 tx=0x7fafec00de10 comp rx=0 tx=0).stop 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.282+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 shutdown_connections 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.282+0000 7faff85ca640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fafdc0b65f0 0x7fafdc0b8b00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.283+0000 7faff85ca640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faff0106c10 0x7faff019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.283+0000 7faff85ca640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faff01062c0 0x7faff019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.283+0000 7faff85ca640 1 --2- 172.21.15.49:0/304960533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faff01020d0 0x7faff019a4a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.283+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 >> 172.21.15.49:0/304960533 conn(0x7faff0079e30 msgr2=0x7faff01075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.283+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 shutdown_connections 2024-09-21T06:35:37.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:36.283+0000 7faff85ca640 1 -- 172.21.15.49:0/304960533 wait complete. 2024-09-21T06:35:37.638 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:37 smithi049 ceph-mon[31177]: pgmap v286: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:37.638 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:37 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2537250877' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:35:37.638 INFO:teuthology.orchestra.run.smithi049.stdout:180388626480 2024-09-21T06:35:37.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:37 smithi098 ceph-mon[34704]: pgmap v286: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:37.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:37 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2537250877' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:35:37.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:37 smithi079 ceph-mon[34346]: pgmap v286: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:37.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:37 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2537250877' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:35:37.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.992+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/465201098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc1094b0 msgr2=0x7fa9dc1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.992+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/465201098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc1094b0 0x7fa9dc1098c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009900 tx=0x7fa9c402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.992+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/465201098 shutdown_connections 2024-09-21T06:35:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.992+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/465201098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9dc109e00 0x7fa9dc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.992+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/465201098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc1094b0 0x7fa9dc1098c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.992+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/465201098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9dc103bc0 0x7fa9dc103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.992+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/465201098 >> 172.21.15.49:0/465201098 conn(0x7fa9dc07b910 msgr2=0x7fa9dc07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.992+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/465201098 shutdown_connections 2024-09-21T06:35:38.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.992+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/465201098 wait complete. 2024-09-21T06:35:38.608 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:38 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2206888775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:35:38.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e2fdc640 1 Processor -- start 2024-09-21T06:35:38.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e2fdc640 1 -- start start 2024-09-21T06:35:38.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e2fdc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc103bc0 0x7fa9dc19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e2fdc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9dc1094b0 0x7fa9dc19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e2fdc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9dc109e00 0x7fa9dc19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e2fdc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc113ac0 con 0x7fa9dc103bc0 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e2fdc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc113940 con 0x7fa9dc109e00 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e2fdc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc113c40 con 0x7fa9dc1094b0 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e0d78640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc103bc0 0x7fa9dc19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e0d78640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc103bc0 0x7fa9dc19a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57828/0 (socket says 172.21.15.49:57828) 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9e0d78640 1 -- 172.21.15.49:0/2206888775 learned_addr learned my addr 172.21.15.49:0/2206888775 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.993+0000 7fa9dbfff640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9dc1094b0 0x7fa9dc19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9e0d78640 1 -- 172.21.15.49:0/2206888775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9dc1094b0 msgr2=0x7fa9dc19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9e0d78640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9dc1094b0 0x7fa9dc19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9e0d78640 1 -- 172.21.15.49:0/2206888775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9dc109e00 msgr2=0x7fa9dc19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9e1579640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9dc109e00 0x7fa9dc19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9e0d78640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9dc109e00 0x7fa9dc19fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9e0d78640 1 -- 172.21.15.49:0/2206888775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc1a0440 con 0x7fa9dc103bc0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9e0d78640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc103bc0 0x7fa9dc19a4d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00d950 tx=0x7fa9cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9d9ffb640 1 -- 172.21.15.49:0/2206888775 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc017070 con 0x7fa9dc103bc0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9d9ffb640 1 -- 172.21.15.49:0/2206888775 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9cc009c30 con 0x7fa9dc103bc0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9dc1a0730 con 0x7fa9dc103bc0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9d9ffb640 1 -- 172.21.15.49:0/2206888775 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00f620 con 0x7fa9dc103bc0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.994+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9dc1a6e90 con 0x7fa9dc103bc0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.996+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9dc103fd0 con 0x7fa9dc103bc0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.997+0000 7fa9d9ffb640 1 -- 172.21.15.49:0/2206888775 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa9cc010460 con 0x7fa9dc103bc0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.998+0000 7fa9d9ffb640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9c80b6670 0x7fa9c80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.998+0000 7fa9dbfff640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9c80b6670 0x7fa9c80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.998+0000 7fa9d9ffb640 1 -- 172.21.15.49:0/2206888775 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fa9cc0e7190 con 0x7fa9dc103bc0 2024-09-21T06:35:38.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:37.998+0000 7fa9dbfff640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9c80b6670 0x7fa9c80b8b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009230 tx=0x7fa9c4031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:38.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.002+0000 7fa9d9ffb640 1 -- 172.21.15.49:0/2206888775 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9cc0ad7e0 con 0x7fa9dc103bc0 2024-09-21T06:35:38.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.198+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa9dc10bbd0 con 0x7fa9dc103bc0 2024-09-21T06:35:38.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.191+0000 7fa0b922f640 1 -- 172.21.15.49:0/3429707150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4102a60 msgr2=0x7fa0b4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.191+0000 7fa0b922f640 1 --2- 172.21.15.49:0/3429707150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4102a60 0x7fa0b4102e70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009900 tx=0x7fa09c02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.192+0000 7fa0b922f640 1 -- 172.21.15.49:0/3429707150 shutdown_connections 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.192+0000 7fa0b922f640 1 --2- 172.21.15.49:0/3429707150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b4108cf0 0x7fa0b410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.192+0000 7fa0b922f640 1 --2- 172.21.15.49:0/3429707150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0b41083a0 0x7fa0b41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.192+0000 7fa0b922f640 1 --2- 172.21.15.49:0/3429707150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4102a60 0x7fa0b4102e70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.192+0000 7fa0b922f640 1 -- 172.21.15.49:0/3429707150 >> 172.21.15.49:0/3429707150 conn(0x7fa0b4079730 msgr2=0x7fa0b4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.192+0000 7fa0b922f640 1 -- 172.21.15.49:0/3429707150 shutdown_connections 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.192+0000 7fa0b922f640 1 -- 172.21.15.49:0/3429707150 wait complete. 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.193+0000 7fa0b922f640 1 Processor -- start 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.193+0000 7fa0b922f640 1 -- start start 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.193+0000 7fa0b922f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0b4102a60 0x7fa0b419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.193+0000 7fa0b922f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b41083a0 0x7fa0b419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.193+0000 7fa0b922f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4108cf0 0x7fa0b419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.193+0000 7fa0b922f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4113a80 con 0x7fa0b4108cf0 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.193+0000 7fa0b922f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4113900 con 0x7fa0b4102a60 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.193+0000 7fa0b922f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4113c00 con 0x7fa0b41083a0 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.193+0000 7fa0b359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4108cf0 0x7fa0b419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4108cf0 0x7fa0b419fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57854/0 (socket says 172.21.15.49:57854) 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b359e640 1 -- 172.21.15.49:0/1190362931 learned_addr learned my addr 172.21.15.49:0/1190362931 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b2d9d640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0b4102a60 0x7fa0b419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b259c640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b41083a0 0x7fa0b419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b359e640 1 -- 172.21.15.49:0/1190362931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b41083a0 msgr2=0x7fa0b419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b359e640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b41083a0 0x7fa0b419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b359e640 1 -- 172.21.15.49:0/1190362931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0b4102a60 msgr2=0x7fa0b419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b359e640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0b4102a60 0x7fa0b419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b359e640 1 -- 172.21.15.49:0/1190362931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b41a03a0 con 0x7fa0b4108cf0 2024-09-21T06:35:38.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b359e640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4108cf0 0x7fa0b419fc70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00eaa0 tx=0x7fa0ac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0abfff640 1 -- 172.21.15.49:0/1190362931 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac00cdb0 con 0x7fa0b4108cf0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b41a0690 con 0x7fa0b4108cf0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0abfff640 1 -- 172.21.15.49:0/1190362931 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0ac005020 con 0x7fa0b4108cf0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0abfff640 1 -- 172.21.15.49:0/1190362931 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0ac0116d0 con 0x7fa0b4108cf0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.194+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b41a6df0 con 0x7fa0b4108cf0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.196+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b4102e70 con 0x7fa0b4108cf0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.197+0000 7fa0abfff640 1 -- 172.21.15.49:0/1190362931 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa0ac0054a0 con 0x7fa0b4108cf0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.198+0000 7fa0abfff640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0a00b6670 0x7fa0a00b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.198+0000 7fa0b2d9d640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0a00b6670 0x7fa0a00b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.198+0000 7fa0abfff640 1 -- 172.21.15.49:0/1190362931 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fa0ac0e7650 con 0x7fa0b4108cf0 2024-09-21T06:35:38.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.199+0000 7fa0b2d9d640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0a00b6670 0x7fa0a00b8b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa09c031440 tx=0x7fa09c009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:38.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.206+0000 7fa9d9ffb640 1 -- 172.21.15.49:0/2206888775 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9cc009de0 con 0x7fa9dc103bc0 2024-09-21T06:35:38.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.206+0000 7fa0abfff640 1 -- 172.21.15.49:0/1190362931 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0ac016030 con 0x7fa0b4108cf0 2024-09-21T06:35:38.617 INFO:teuthology.orchestra.run.smithi049.stdout:38654705743 2024-09-21T06:35:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9c80b6670 msgr2=0x7fa9c80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9c80b6670 0x7fa9c80b8b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009230 tx=0x7fa9c4031400 comp rx=0 tx=0).stop 2024-09-21T06:35:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc103bc0 msgr2=0x7fa9dc19a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc103bc0 0x7fa9dc19a4d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00d950 tx=0x7fa9cc00de10 comp rx=0 tx=0).stop 2024-09-21T06:35:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 shutdown_connections 2024-09-21T06:35:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9c80b6670 0x7fa9c80b8b80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9dc109e00 0x7fa9dc19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9dc1094b0 0x7fa9dc19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 --2- 172.21.15.49:0/2206888775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9dc103bc0 0x7fa9dc19a4d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 >> 172.21.15.49:0/2206888775 conn(0x7fa9dc07b910 msgr2=0x7fa9dc105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:38.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 shutdown_connections 2024-09-21T06:35:38.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.209+0000 7fa9e2fdc640 1 -- 172.21.15.49:0/2206888775 wait complete. 2024-09-21T06:35:38.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.405+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa0b410aaf0 con 0x7fa0b4108cf0 2024-09-21T06:35:38.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.405+0000 7fa0abfff640 1 -- 172.21.15.49:0/1190362931 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa0ac0b2080 con 0x7fa0b4108cf0 2024-09-21T06:35:38.619 INFO:teuthology.orchestra.run.smithi049.stdout:270582939676 2024-09-21T06:35:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0a00b6670 msgr2=0x7fa0a00b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0a00b6670 0x7fa0a00b8b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa09c031440 tx=0x7fa09c009560 comp rx=0 tx=0).stop 2024-09-21T06:35:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4108cf0 msgr2=0x7fa0b419fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4108cf0 0x7fa0b419fc70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac00eaa0 tx=0x7fa0ac00ef60 comp rx=0 tx=0).stop 2024-09-21T06:35:38.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 shutdown_connections 2024-09-21T06:35:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa0a00b6670 0x7fa0a00b8b80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa0b4108cf0 0x7fa0b419fc70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa0b41083a0 0x7fa0b419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 --2- 172.21.15.49:0/1190362931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa0b4102a60 0x7fa0b419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.407+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 >> 172.21.15.49:0/1190362931 conn(0x7fa0b4079730 msgr2=0x7fa0b41013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.408+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 shutdown_connections 2024-09-21T06:35:38.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.408+0000 7fa0b922f640 1 -- 172.21.15.49:0/1190362931 wait complete. 2024-09-21T06:35:38.621 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:38 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2206888775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:35:38.622 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378690 got 81604378693 for osd.2 2024-09-21T06:35:38.622 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:38.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.788+0000 7fdf97aba640 1 -- 172.21.15.49:0/217156460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf90109df0 msgr2=0x7fdf90110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.788+0000 7fdf97aba640 1 --2- 172.21.15.49:0/217156460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf90109df0 0x7fdf90110620 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009900 tx=0x7fdf8802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.788+0000 7fdf97aba640 1 -- 172.21.15.49:0/217156460 shutdown_connections 2024-09-21T06:35:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.788+0000 7fdf97aba640 1 --2- 172.21.15.49:0/217156460 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf90109df0 0x7fdf90110620 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.788+0000 7fdf97aba640 1 --2- 172.21.15.49:0/217156460 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf901094a0 0x7fdf901098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.788+0000 7fdf97aba640 1 --2- 172.21.15.49:0/217156460 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf90103b60 0x7fdf90103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.788+0000 7fdf97aba640 1 -- 172.21.15.49:0/217156460 >> 172.21.15.49:0/217156460 conn(0x7fdf9007b850 msgr2=0x7fdf9007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.788+0000 7fdf97aba640 1 -- 172.21.15.49:0/217156460 shutdown_connections 2024-09-21T06:35:38.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.788+0000 7fdf97aba640 1 -- 172.21.15.49:0/217156460 wait complete. 2024-09-21T06:35:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf97aba640 1 Processor -- start 2024-09-21T06:35:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf97aba640 1 -- start start 2024-09-21T06:35:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf97aba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf90103b60 0x7fdf90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf97aba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf901094a0 0x7fdf90075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf97aba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf90109df0 0x7fdf90076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf97aba640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fdf90113ab0 con 0x7fdf901094a0 2024-09-21T06:35:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf97aba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fdf90113930 con 0x7fdf90103b60 2024-09-21T06:35:38.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf97aba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fdf90113c30 con 0x7fdf90109df0 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95055640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf901094a0 0x7fdf90075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95055640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf901094a0 0x7fdf90075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57872/0 (socket says 172.21.15.49:57872) 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95055640 1 -- 172.21.15.49:0/179965161 learned_addr learned my addr 172.21.15.49:0/179965161 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95856640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf90103b60 0x7fdf90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf96057640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf90109df0 0x7fdf90076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95055640 1 -- 172.21.15.49:0/179965161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf90109df0 msgr2=0x7fdf90076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95055640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf90109df0 0x7fdf90076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95055640 1 -- 172.21.15.49:0/179965161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf90103b60 msgr2=0x7fdf90075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95055640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf90103b60 0x7fdf90075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95055640 1 -- 172.21.15.49:0/179965161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf901a8820 con 0x7fdf901094a0 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf96057640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf90109df0 0x7fdf90076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.789+0000 7fdf95856640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf90103b60 0x7fdf90075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:38.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.790+0000 7fdf95055640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf901094a0 0x7fdf90075c50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c970 tx=0x7fdf8400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.790+0000 7fdf8effd640 1 -- 172.21.15.49:0/179965161 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84004220 con 0x7fdf901094a0 2024-09-21T06:35:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.790+0000 7fdf8effd640 1 -- 172.21.15.49:0/179965161 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf840043c0 con 0x7fdf901094a0 2024-09-21T06:35:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.790+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf901a8b10 con 0x7fdf901094a0 2024-09-21T06:35:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.790+0000 7fdf8effd640 1 -- 172.21.15.49:0/179965161 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84004a00 con 0x7fdf901094a0 2024-09-21T06:35:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.790+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf901a9000 con 0x7fdf901094a0 2024-09-21T06:35:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.791+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf90103f70 con 0x7fdf901094a0 2024-09-21T06:35:38.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.793+0000 7fdf8effd640 1 -- 172.21.15.49:0/179965161 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fdf840079b0 con 0x7fdf901094a0 2024-09-21T06:35:38.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:38 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2206888775' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:35:38.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.793+0000 7fdf8effd640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fdf780b65f0 0x7fdf780b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.794+0000 7fdf95856640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fdf780b65f0 0x7fdf780b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.794+0000 7fdf8effd640 1 -- 172.21.15.49:0/179965161 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fdf840e77b0 con 0x7fdf901094a0 2024-09-21T06:35:38.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.794+0000 7fdf95856640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fdf780b65f0 0x7fdf780b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf90077160 tx=0x7fdf80009520 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:38.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.797+0000 7fdf8effd640 1 -- 172.21.15.49:0/179965161 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf84014030 con 0x7fdf901094a0 2024-09-21T06:35:38.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.990+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fdf9002e640 con 0x7fdf901094a0 2024-09-21T06:35:38.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.990+0000 7fdf8effd640 1 -- 172.21.15.49:0/179965161 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdf840ade00 con 0x7fdf901094a0 2024-09-21T06:35:38.993 INFO:teuthology.orchestra.run.smithi049.stdout:107374182463 2024-09-21T06:35:38.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fdf780b65f0 msgr2=0x7fdf780b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fdf780b65f0 0x7fdf780b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf90077160 tx=0x7fdf80009520 comp rx=0 tx=0).stop 2024-09-21T06:35:38.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf901094a0 msgr2=0x7fdf90075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf901094a0 0x7fdf90075c50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c970 tx=0x7fdf8400ce30 comp rx=0 tx=0).stop 2024-09-21T06:35:38.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 shutdown_connections 2024-09-21T06:35:38.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fdf780b65f0 0x7fdf780b8b00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fdf90109df0 0x7fdf90076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fdf901094a0 0x7fdf90075c50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 --2- 172.21.15.49:0/179965161 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fdf90103b60 0x7fdf90075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 >> 172.21.15.49:0/179965161 conn(0x7fdf9007b850 msgr2=0x7fdf901075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 shutdown_connections 2024-09-21T06:35:38.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:38.992+0000 7fdf97aba640 1 -- 172.21.15.49:0/179965161 wait complete. 2024-09-21T06:35:39.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.416+0000 7f494e23f640 1 -- 172.21.15.49:0/479018465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49481083a0 msgr2=0x7f49481087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:39.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.416+0000 7f494e23f640 1 --2- 172.21.15.49:0/479018465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49481083a0 0x7f49481087b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4930009900 tx=0x7f493002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.416+0000 7f494e23f640 1 -- 172.21.15.49:0/479018465 shutdown_connections 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.416+0000 7f494e23f640 1 --2- 172.21.15.49:0/479018465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948108cf0 0x7f494810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.416+0000 7f494e23f640 1 --2- 172.21.15.49:0/479018465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f49481083a0 0x7f49481087b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.416+0000 7f494e23f640 1 --2- 172.21.15.49:0/479018465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4948102a60 0x7f4948102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.416+0000 7f494e23f640 1 -- 172.21.15.49:0/479018465 >> 172.21.15.49:0/479018465 conn(0x7f4948079730 msgr2=0x7f4948079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.416+0000 7f494e23f640 1 -- 172.21.15.49:0/479018465 shutdown_connections 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.416+0000 7f494e23f640 1 -- 172.21.15.49:0/479018465 wait complete. 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.417+0000 7f494e23f640 1 Processor -- start 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.417+0000 7f494e23f640 1 -- start start 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.417+0000 7f494e23f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948102a60 0x7f4948199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.417+0000 7f494e23f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49481083a0 0x7f4948199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.417+0000 7f494e23f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948108cf0 0x7f494819ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:39.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.417+0000 7f494e23f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4948112960 con 0x7f4948108cf0 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.417+0000 7f494e23f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f49481127e0 con 0x7f49481083a0 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.417+0000 7f494e23f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4948112ae0 con 0x7f4948102a60 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4947fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948108cf0 0x7f494819ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4947fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948108cf0 0x7f494819ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57892/0 (socket says 172.21.15.49:57892) 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4947fff640 1 -- 172.21.15.49:0/155659508 learned_addr learned my addr 172.21.15.49:0/155659508 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f49477fe640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948102a60 0x7f4948199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4946ffd640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49481083a0 0x7f4948199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4947fff640 1 -- 172.21.15.49:0/155659508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948102a60 msgr2=0x7f4948199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4947fff640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948102a60 0x7f4948199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4947fff640 1 -- 172.21.15.49:0/155659508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49481083a0 msgr2=0x7f4948199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4947fff640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49481083a0 0x7f4948199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4947fff640 1 -- 172.21.15.49:0/155659508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494819f400 con 0x7f4948108cf0 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4947fff640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948108cf0 0x7f494819ecd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f494000d950 tx=0x7f494000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:39.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4944ff9640 1 -- 172.21.15.49:0/155659508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940017030 con 0x7f4948108cf0 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4944ff9640 1 -- 172.21.15.49:0/155659508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4940004020 con 0x7f4948108cf0 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494819f6f0 con 0x7f4948108cf0 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f4944ff9640 1 -- 172.21.15.49:0/155659508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940003b50 con 0x7f4948108cf0 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.418+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49481a5e50 con 0x7f4948108cf0 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.419+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4948102e70 con 0x7f4948108cf0 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.421+0000 7f4944ff9640 1 -- 172.21.15.49:0/155659508 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f494001a070 con 0x7f4948108cf0 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.422+0000 7f4944ff9640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f49340b65f0 0x7f49340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.422+0000 7f49477fe640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f49340b65f0 0x7f49340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.422+0000 7f4944ff9640 1 -- 172.21.15.49:0/155659508 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f49400e70f0 con 0x7f4948108cf0 2024-09-21T06:35:39.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.422+0000 7f49477fe640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f49340b65f0 0x7f49340b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4938005fd0 tx=0x7f4938009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:39.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.425+0000 7f4944ff9640 1 -- 172.21.15.49:0/155659508 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4940021070 con 0x7f4948108cf0 2024-09-21T06:35:39.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.617+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f494819a5c0 con 0x7f4948108cf0 2024-09-21T06:35:39.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.617+0000 7f4944ff9640 1 -- 172.21.15.49:0/155659508 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f494819a5c0 con 0x7f4948108cf0 2024-09-21T06:35:39.620 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:39 smithi049 ceph-mon[31177]: pgmap v287: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:35:39.620 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:39 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1190362931' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:35:39.620 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:39 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/179965161' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:35:39.620 INFO:teuthology.orchestra.run.smithi049.stdout:227633266726 2024-09-21T06:35:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f49340b65f0 msgr2=0x7f49340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f49340b65f0 0x7f49340b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4938005fd0 tx=0x7f4938009500 comp rx=0 tx=0).stop 2024-09-21T06:35:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948108cf0 msgr2=0x7f494819ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:39.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948108cf0 0x7f494819ecd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f494000d950 tx=0x7f494000de10 comp rx=0 tx=0).stop 2024-09-21T06:35:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 shutdown_connections 2024-09-21T06:35:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f49340b65f0 0x7f49340b8b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4948108cf0 0x7f494819ecd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f49481083a0 0x7f4948199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 --2- 172.21.15.49:0/155659508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4948102a60 0x7f4948199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.620+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 >> 172.21.15.49:0/155659508 conn(0x7f4948079730 msgr2=0x7f49481044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.621+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 shutdown_connections 2024-09-21T06:35:39.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.621+0000 7f494e23f640 1 -- 172.21.15.49:0/155659508 wait complete. 2024-09-21T06:35:39.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:39 smithi098 ceph-mon[34704]: pgmap v287: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:35:39.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:39 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1190362931' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:35:39.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:39 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/179965161' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:35:39.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:39 smithi079 ceph-mon[34346]: pgmap v287: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:35:39.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:39 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1190362931' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:35:39.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:39 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/179965161' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:35:40.554 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705741 got 38654705743 for osd.0 2024-09-21T06:35:40.554 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:40.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:40 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:35:40.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:40 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/155659508' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:35:40.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:40 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2470556239' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:35:40.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.830+0000 7f2464c96640 1 -- 172.21.15.49:0/1377395615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460108d00 msgr2=0x7f246010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.830+0000 7f2464c96640 1 --2- 172.21.15.49:0/1377395615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460108d00 0x7f246010f530 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f2458009ca0 tx=0x7f245802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.830+0000 7f2464c96640 1 -- 172.21.15.49:0/1377395615 shutdown_connections 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.830+0000 7f2464c96640 1 --2- 172.21.15.49:0/1377395615 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2460108d00 0x7f246010f530 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.830+0000 7f2464c96640 1 --2- 172.21.15.49:0/1377395615 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f24601083b0 0x7f24601087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.830+0000 7f2464c96640 1 --2- 172.21.15.49:0/1377395615 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2460102a70 0x7f2460102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.830+0000 7f2464c96640 1 -- 172.21.15.49:0/1377395615 >> 172.21.15.49:0/1377395615 conn(0x7f2460079730 msgr2=0x7f2460079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.830+0000 7f2464c96640 1 -- 172.21.15.49:0/1377395615 shutdown_connections 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.830+0000 7f2464c96640 1 -- 172.21.15.49:0/1377395615 wait complete. 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f2464c96640 1 Processor -- start 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f2464c96640 1 -- start start 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f2464c96640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2460102a70 0x7f246019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:40.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f2464c96640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24601083b0 0x7f246019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f2464c96640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2460108d00 0x7f246019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f2464c96640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2460112970 con 0x7f24601083b0 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f2464c96640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f24601127f0 con 0x7f2460102a70 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f2464c96640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2460112af0 con 0x7f2460108d00 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f245dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24601083b0 0x7f246019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f245dd9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24601083b0 0x7f246019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57908/0 (socket says 172.21.15.49:57908) 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f245dd9b640 1 -- 172.21.15.49:0/2470556239 learned_addr learned my addr 172.21.15.49:0/2470556239 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f245e59c640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2460102a70 0x7f246019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.831+0000 7f245ed9d640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2460108d00 0x7f246019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f245dd9b640 1 -- 172.21.15.49:0/2470556239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2460108d00 msgr2=0x7f246019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f245dd9b640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2460108d00 0x7f246019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f245dd9b640 1 -- 172.21.15.49:0/2470556239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2460102a70 msgr2=0x7f246019b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f245dd9b640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2460102a70 0x7f246019b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f245dd9b640 1 -- 172.21.15.49:0/2470556239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24601a65a0 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f245dd9b640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24601083b0 0x7f246019b820 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f245400e9f0 tx=0x7f245400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f244f7fe640 1 -- 172.21.15.49:0/2470556239 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245400ccc0 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f244f7fe640 1 -- 172.21.15.49:0/2470556239 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24540054d0 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24601a6890 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f244f7fe640 1 -- 172.21.15.49:0/2470556239 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2454010430 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.832+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24601a6d80 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.833+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2460103cf0 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.836+0000 7f244f7fe640 1 -- 172.21.15.49:0/2470556239 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f24540046c0 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.836+0000 7f244f7fe640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24480b65f0 0x7f24480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.836+0000 7f245e59c640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24480b65f0 0x7f24480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.836+0000 7f244f7fe640 1 -- 172.21.15.49:0/2470556239 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f24540e7ab0 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.837+0000 7f245e59c640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24480b65f0 0x7f24480b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f246006c660 tx=0x7f2450005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:39.840+0000 7f244f7fe640 1 -- 172.21.15.49:0/2470556239 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2454056710 con 0x7f24601083b0 2024-09-21T06:35:40.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.035+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f2460102e80 con 0x7f24601083b0 2024-09-21T06:35:40.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.035+0000 7f244f7fe640 1 -- 172.21.15.49:0/2470556239 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2460102e80 con 0x7f24601083b0 2024-09-21T06:35:40.638 INFO:teuthology.orchestra.run.smithi049.stdout:253403070498 2024-09-21T06:35:40.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24480b65f0 msgr2=0x7f24480b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:40.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24480b65f0 0x7f24480b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f246006c660 tx=0x7f2450005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:40.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24601083b0 msgr2=0x7f246019b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:40.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24601083b0 0x7f246019b820 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f245400e9f0 tx=0x7f245400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 shutdown_connections 2024-09-21T06:35:40.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f24480b65f0 0x7f24480b8b00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2460108d00 0x7f246019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f24601083b0 0x7f246019b820 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 --2- 172.21.15.49:0/2470556239 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2460102a70 0x7f246019b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 >> 172.21.15.49:0/2470556239 conn(0x7f2460079730 msgr2=0x7f2460104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:40.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 shutdown_connections 2024-09-21T06:35:40.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:40.038+0000 7f2464c96640 1 -- 172.21.15.49:0/2470556239 wait complete. 2024-09-21T06:35:40.639 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:40 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:35:40.639 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:40 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/155659508' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:35:40.639 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:40 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2470556239' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:35:40.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:40 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:35:40.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:40 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/155659508' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:35:40.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:40 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2470556239' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:35:41.250 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266724 got 227633266726 for osd.8 2024-09-21T06:35:41.250 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.656+0000 7f4c56029640 1 -- 172.21.15.49:0/1929328610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c50109e40 msgr2=0x7f4c50110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.656+0000 7f4c56029640 1 --2- 172.21.15.49:0/1929328610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c50109e40 0x7f4c50110670 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009ca0 tx=0x7f4c4802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.656+0000 7f4c56029640 1 -- 172.21.15.49:0/1929328610 shutdown_connections 2024-09-21T06:35:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.656+0000 7f4c56029640 1 --2- 172.21.15.49:0/1929328610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c50109e40 0x7f4c50110670 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.656+0000 7f4c56029640 1 --2- 172.21.15.49:0/1929328610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c501094f0 0x7f4c50109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.656+0000 7f4c56029640 1 --2- 172.21.15.49:0/1929328610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c50103bb0 0x7f4c50103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.656+0000 7f4c56029640 1 -- 172.21.15.49:0/1929328610 >> 172.21.15.49:0/1929328610 conn(0x7f4c500ff600 msgr2=0x7f4c50101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.656+0000 7f4c56029640 1 -- 172.21.15.49:0/1929328610 shutdown_connections 2024-09-21T06:35:41.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.657+0000 7f4c56029640 1 -- 172.21.15.49:0/1929328610 wait complete. 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.657+0000 7f4c56029640 1 Processor -- start 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c56029640 1 -- start start 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c56029640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c50103bb0 0x7f4c5019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c56029640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c501094f0 0x7f4c5019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c56029640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c50109e40 0x7f4c5019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c56029640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4c50113b00 con 0x7f4c501094f0 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c56029640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4c50113980 con 0x7f4c50103bb0 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c56029640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4c50113c80 con 0x7f4c50109e40 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c4effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c501094f0 0x7f4c5019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c4effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c501094f0 0x7f4c5019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57926/0 (socket says 172.21.15.49:57926) 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c4effd640 1 -- 172.21.15.49:0/3056067628 learned_addr learned my addr 172.21.15.49:0/3056067628 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c4f7fe640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c50103bb0 0x7f4c5019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.658+0000 7f4c4ffff640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c50109e40 0x7f4c5019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c4effd640 1 -- 172.21.15.49:0/3056067628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c50109e40 msgr2=0x7f4c5019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c4effd640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c50109e40 0x7f4c5019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c4effd640 1 -- 172.21.15.49:0/3056067628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c50103bb0 msgr2=0x7f4c5019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c4effd640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c50103bb0 0x7f4c5019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c4effd640 1 -- 172.21.15.49:0/3056067628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c501a0340 con 0x7f4c501094f0 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c4effd640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c501094f0 0x7f4c5019aa30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c8c0 tx=0x7f4c4400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c4cff9640 1 -- 172.21.15.49:0/3056067628 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44007bb0 con 0x7f4c501094f0 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c4cff9640 1 -- 172.21.15.49:0/3056067628 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c44007d50 con 0x7f4c501094f0 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c501a0630 con 0x7f4c501094f0 2024-09-21T06:35:41.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c4cff9640 1 -- 172.21.15.49:0/3056067628 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c440187c0 con 0x7f4c501094f0 2024-09-21T06:35:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.659+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c501a6e50 con 0x7f4c501094f0 2024-09-21T06:35:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.660+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c50103fc0 con 0x7f4c501094f0 2024-09-21T06:35:41.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.662+0000 7f4c4cff9640 1 -- 172.21.15.49:0/3056067628 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f4c4400fa20 con 0x7f4c501094f0 2024-09-21T06:35:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.662+0000 7f4c4cff9640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c380b6620 0x7f4c380b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.662+0000 7f4c4f7fe640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c380b6620 0x7f4c380b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.663+0000 7f4c4cff9640 1 -- 172.21.15.49:0/3056067628 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f4c440e76b0 con 0x7f4c501094f0 2024-09-21T06:35:41.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.663+0000 7f4c4f7fe640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c380b6620 0x7f4c380b8b30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000bbe0 tx=0x7f4c4000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.667+0000 7f4c4cff9640 1 -- 172.21.15.49:0/3056067628 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c44014030 con 0x7f4c501094f0 2024-09-21T06:35:41.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.825+0000 7f53ac516640 1 -- 172.21.15.49:0/2537958181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a4108d10 msgr2=0x7f53a410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.825+0000 7f53ac516640 1 --2- 172.21.15.49:0/2537958181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a4108d10 0x7f53a410f540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f539c009be0 tx=0x7f539c02a6c0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.825+0000 7f53ac516640 1 -- 172.21.15.49:0/2537958181 shutdown_connections 2024-09-21T06:35:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.825+0000 7f53ac516640 1 --2- 172.21.15.49:0/2537958181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a4108d10 0x7f53a410f540 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.825+0000 7f53ac516640 1 --2- 172.21.15.49:0/2537958181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a41083c0 0x7f53a41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.825+0000 7f53ac516640 1 --2- 172.21.15.49:0/2537958181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53a4102a80 0x7f53a4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.825+0000 7f53ac516640 1 -- 172.21.15.49:0/2537958181 >> 172.21.15.49:0/2537958181 conn(0x7f53a4079740 msgr2=0x7f53a4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.826+0000 7f53ac516640 1 -- 172.21.15.49:0/2537958181 shutdown_connections 2024-09-21T06:35:41.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.826+0000 7f53ac516640 1 -- 172.21.15.49:0/2537958181 wait complete. 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.826+0000 7f53ac516640 1 Processor -- start 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.826+0000 7f53ac516640 1 -- start start 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53ac516640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a4102a80 0x7f53a419c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53ac516640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53a41083c0 0x7f53a419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53ac516640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a4108d10 0x7f53a41a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53ac516640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4112980 con 0x7f53a41083c0 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53ac516640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4112800 con 0x7f53a4102a80 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53ac516640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f53a4112b00 con 0x7f53a4108d10 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53a9ab1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53a41083c0 0x7f53a419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53aa2b2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a4102a80 0x7f53a419c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53a9ab1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53a41083c0 0x7f53a419cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57948/0 (socket says 172.21.15.49:57948) 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53a9ab1640 1 -- 172.21.15.49:0/1632875525 learned_addr learned my addr 172.21.15.49:0/1632875525 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53aaab3640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a4108d10 0x7f53a41a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53aa2b2640 1 -- 172.21.15.49:0/1632875525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a4108d10 msgr2=0x7f53a41a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53aa2b2640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a4108d10 0x7f53a41a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53aa2b2640 1 -- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53a41083c0 msgr2=0x7f53a419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53aa2b2640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53a41083c0 0x7f53a419cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53aa2b2640 1 -- 172.21.15.49:0/1632875525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a41a2540 con 0x7f53a4102a80 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53a9ab1640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53a41083c0 0x7f53a419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.827+0000 7f53aa2b2640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a4102a80 0x7f53a419c5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53a0005fd0 tx=0x7f53a000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.828+0000 7f539b7fe640 1 -- 172.21.15.49:0/1632875525 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a000cd00 con 0x7f53a4102a80 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.828+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a41a2830 con 0x7f53a4102a80 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.828+0000 7f539b7fe640 1 -- 172.21.15.49:0/1632875525 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53a00035f0 con 0x7f53a4102a80 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.828+0000 7f539b7fe640 1 -- 172.21.15.49:0/1632875525 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a0010690 con 0x7f53a4102a80 2024-09-21T06:35:41.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.828+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a41a8f90 con 0x7f53a4102a80 2024-09-21T06:35:41.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.829+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53a4102e90 con 0x7f53a4102a80 2024-09-21T06:35:41.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.830+0000 7f539b7fe640 1 -- 172.21.15.49:0/1632875525 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f53a0003aa0 con 0x7f53a4102a80 2024-09-21T06:35:41.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.831+0000 7f539b7fe640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f53900b65f0 0x7f53900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.831+0000 7f53a9ab1640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f53900b65f0 0x7f53900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.831+0000 7f539b7fe640 1 -- 172.21.15.49:0/1632875525 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f53a00e78d0 con 0x7f53a4102a80 2024-09-21T06:35:41.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.832+0000 7f53a9ab1640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f53900b65f0 0x7f53900b8b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f53a4079d20 tx=0x7f539400b480 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.834+0000 7f539b7fe640 1 -- 172.21.15.49:0/1632875525 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f53a0009510 con 0x7f53a4102a80 2024-09-21T06:35:41.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.861+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4c5010b6a0 con 0x7f4c501094f0 2024-09-21T06:35:41.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.861+0000 7f4c4cff9640 1 -- 172.21.15.49:0/3056067628 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4c440add00 con 0x7f4c501094f0 2024-09-21T06:35:41.864 INFO:teuthology.orchestra.run.smithi049.stdout:133143986235 2024-09-21T06:35:41.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c380b6620 msgr2=0x7f4c380b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c380b6620 0x7f4c380b8b30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000bbe0 tx=0x7f4c4000b390 comp rx=0 tx=0).stop 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c501094f0 msgr2=0x7f4c5019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c501094f0 0x7f4c5019aa30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c8c0 tx=0x7f4c4400cd80 comp rx=0 tx=0).stop 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 shutdown_connections 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c380b6620 0x7f4c380b8b30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4c50109e40 0x7f4c5019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4c501094f0 0x7f4c5019aa30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 --2- 172.21.15.49:0/3056067628 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4c50103bb0 0x7f4c5019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 >> 172.21.15.49:0/3056067628 conn(0x7f4c500ff600 msgr2=0x7f4c50101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 shutdown_connections 2024-09-21T06:35:41.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:41.864+0000 7f4c56029640 1 -- 172.21.15.49:0/3056067628 wait complete. 2024-09-21T06:35:42.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.027+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f53a41a9380 con 0x7f53a4102a80 2024-09-21T06:35:42.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:41 smithi049 ceph-mon[31177]: pgmap v288: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:42.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.030 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:41 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.031 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:41 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3056067628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:35:42.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.028+0000 7f539b7fe640 1 -- 172.21.15.49:0/1632875525 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f53a00adfb0 con 0x7f53a4102a80 2024-09-21T06:35:42.031 INFO:teuthology.orchestra.run.smithi049.stdout:154618822710 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f53900b65f0 msgr2=0x7f53900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f53900b65f0 0x7f53900b8b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f53a4079d20 tx=0x7f539400b480 comp rx=0 tx=0).stop 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a4102a80 msgr2=0x7f53a419c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a4102a80 0x7f53a419c5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f53a0005fd0 tx=0x7f53a000ee50 comp rx=0 tx=0).stop 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 shutdown_connections 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f53900b65f0 0x7f53900b8b00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f53a4108d10 0x7f53a41a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f53a41083c0 0x7f53a419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 --2- 172.21.15.49:0/1632875525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f53a4102a80 0x7f53a419c5d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 >> 172.21.15.49:0/1632875525 conn(0x7f53a4079740 msgr2=0x7f53a4104290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 shutdown_connections 2024-09-21T06:35:42.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:42.030+0000 7f53ac516640 1 -- 172.21.15.49:0/1632875525 wait complete. 2024-09-21T06:35:42.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:41 smithi098 ceph-mon[34704]: pgmap v288: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:42.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:41 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:41 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3056067628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:35:42.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:41 smithi079 ceph-mon[34346]: pgmap v288: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:42.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:41 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:42.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:41 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3056067628' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:35:42.674 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822707 got 154618822710 for osd.5 2024-09-21T06:35:42.675 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:42.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:42 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1632875525' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:35:43.138 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776149 got 292057776151 for osd.11 2024-09-21T06:35:43.139 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:43.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:42 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1632875525' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:35:43.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:42 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1632875525' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:35:43.525 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626478 got 180388626480 for osd.6 2024-09-21T06:35:43.525 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:43.929 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182460 got 107374182463 for osd.3 2024-09-21T06:35:43.929 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:44.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:43 smithi049 ceph-mon[31177]: pgmap v289: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:35:44.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:43 smithi098 ceph-mon[34704]: pgmap v289: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:35:44.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:43 smithi079 ceph-mon[34346]: pgmap v289: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:35:44.378 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939674 got 270582939676 for osd.10 2024-09-21T06:35:44.378 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:44.771 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986231 got 133143986235 for osd.4 2024-09-21T06:35:44.771 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:45.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070495 got 253403070498 for osd.9 2024-09-21T06:35:45.192 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:45.207 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.634+0000 7fceaea6b640 1 -- 172.21.15.49:0/1037355555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 msgr2=0x7fcea8102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.634+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1037355555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 0x7fcea8102600 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009900 tx=0x7fcea002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.634+0000 7fceaea6b640 1 -- 172.21.15.49:0/1037355555 shutdown_connections 2024-09-21T06:35:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.634+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1037355555 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea8108480 0x7fcea810ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.634+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1037355555 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcea8107b30 0x7fcea8107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.634+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1037355555 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 0x7fcea8102600 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.634+0000 7fceaea6b640 1 -- 172.21.15.49:0/1037355555 >> 172.21.15.49:0/1037355555 conn(0x7fcea8077c60 msgr2=0x7fcea80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:45.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.634+0000 7fceaea6b640 1 -- 172.21.15.49:0/1037355555 shutdown_connections 2024-09-21T06:35:45.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.634+0000 7fceaea6b640 1 -- 172.21.15.49:0/1037355555 wait complete. 2024-09-21T06:35:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceaea6b640 1 Processor -- start 2024-09-21T06:35:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceaea6b640 1 -- start start 2024-09-21T06:35:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceaea6b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 0x7fcea819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceaea6b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcea8107b30 0x7fcea819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceaea6b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea8108480 0x7fcea819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:45.638 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceaea6b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcea8113ad0 con 0x7fcea81021f0 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceaea6b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcea8113950 con 0x7fcea8108480 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceaea6b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcea8113c50 con 0x7fcea8107b30 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceac807640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 0x7fcea819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceac807640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 0x7fcea819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57966/0 (socket says 172.21.15.49:57966) 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fceac807640 1 -- 172.21.15.49:0/1740598406 learned_addr learned my addr 172.21.15.49:0/1740598406 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.635+0000 7fcead008640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea8108480 0x7fcea819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fceac807640 1 -- 172.21.15.49:0/1740598406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcea8107b30 msgr2=0x7fcea819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fcea7fff640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcea8107b30 0x7fcea819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fceac807640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcea8107b30 0x7fcea819ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fceac807640 1 -- 172.21.15.49:0/1740598406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea8108480 msgr2=0x7fcea819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fceac807640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea8108480 0x7fcea819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fceac807640 1 -- 172.21.15.49:0/1740598406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea81a04d0 con 0x7fcea81021f0 2024-09-21T06:35:45.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fceac807640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 0x7fcea819a560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcea0005940 tx=0x7fcea00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fcea5ffb640 1 -- 172.21.15.49:0/1740598406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea003f030 con 0x7fcea81021f0 2024-09-21T06:35:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fcea5ffb640 1 -- 172.21.15.49:0/1740598406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcea0003cb0 con 0x7fcea81021f0 2024-09-21T06:35:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea81a0760 con 0x7fcea81021f0 2024-09-21T06:35:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fcea5ffb640 1 -- 172.21.15.49:0/1740598406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0035070 con 0x7fcea81021f0 2024-09-21T06:35:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.636+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea81a6f20 con 0x7fcea81021f0 2024-09-21T06:35:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.637+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea8103470 con 0x7fcea81021f0 2024-09-21T06:35:45.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.639+0000 7fcea5ffb640 1 -- 172.21.15.49:0/1740598406 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fcea0042030 con 0x7fcea81021f0 2024-09-21T06:35:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.640+0000 7fcea5ffb640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce940b65f0 0x7fce940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.640+0000 7fcea7fff640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce940b65f0 0x7fce940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:45.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.640+0000 7fcea5ffb640 1 -- 172.21.15.49:0/1740598406 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fcea01080f0 con 0x7fcea81021f0 2024-09-21T06:35:45.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.640+0000 7fcea7fff640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce940b65f0 0x7fce940b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcea8104ae0 tx=0x7fce98008230 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:45.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.643+0000 7fcea5ffb640 1 -- 172.21.15.49:0/1740598406 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcea00ce740 con 0x7fcea81021f0 2024-09-21T06:35:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.832+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcea810a220 con 0x7fcea81021f0 2024-09-21T06:35:45.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.832+0000 7fcea5ffb640 1 -- 172.21.15.49:0/1740598406 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcea00d2b20 con 0x7fcea81021f0 2024-09-21T06:35:45.834 INFO:teuthology.orchestra.run.smithi049.stdout:206158430253 2024-09-21T06:35:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.834+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce940b65f0 msgr2=0x7fce940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.834+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce940b65f0 0x7fce940b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcea8104ae0 tx=0x7fce98008230 comp rx=0 tx=0).stop 2024-09-21T06:35:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.834+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 msgr2=0x7fcea819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:45.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.834+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 0x7fcea819a560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fcea0005940 tx=0x7fcea00042f0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.835+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 shutdown_connections 2024-09-21T06:35:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.835+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce940b65f0 0x7fce940b8b00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.835+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcea8108480 0x7fcea819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.835+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcea8107b30 0x7fcea819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.835+0000 7fceaea6b640 1 --2- 172.21.15.49:0/1740598406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcea81021f0 0x7fcea819a560 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.835+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 >> 172.21.15.49:0/1740598406 conn(0x7fcea8077c60 msgr2=0x7fcea8105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.835+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 shutdown_connections 2024-09-21T06:35:45.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:45.835+0000 7fceaea6b640 1 -- 172.21.15.49:0/1740598406 wait complete. 2024-09-21T06:35:46.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:45 smithi049 ceph-mon[31177]: pgmap v290: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:46.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:45 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1740598406' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:35:46.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:45 smithi098 ceph-mon[34704]: pgmap v290: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:46.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:45 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1740598406' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:35:46.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:45 smithi079 ceph-mon[34346]: pgmap v290: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:46.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:45 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1740598406' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:35:46.456 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430250 got 206158430253 for osd.7 2024-09-21T06:35:46.456 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:46.456 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:35:46.456 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:35:46.950 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.445+0000 7f319b278640 1 -- 172.21.15.49:0/288608699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3194109df0 msgr2=0x7f3194110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.445+0000 7f319b278640 1 --2- 172.21.15.49:0/288608699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3194109df0 0x7f3194110620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f318c009ca0 tx=0x7f318c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.445+0000 7f319b278640 1 -- 172.21.15.49:0/288608699 shutdown_connections 2024-09-21T06:35:47.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.445+0000 7f319b278640 1 --2- 172.21.15.49:0/288608699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3194109df0 0x7f3194110620 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.445+0000 7f319b278640 1 --2- 172.21.15.49:0/288608699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f31941094a0 0x7f31941098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.445+0000 7f319b278640 1 --2- 172.21.15.49:0/288608699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3194103b60 0x7f3194103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.446+0000 7f319b278640 1 -- 172.21.15.49:0/288608699 >> 172.21.15.49:0/288608699 conn(0x7f319407b850 msgr2=0x7f319407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:47.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.446+0000 7f319b278640 1 -- 172.21.15.49:0/288608699 shutdown_connections 2024-09-21T06:35:47.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.446+0000 7f319b278640 1 -- 172.21.15.49:0/288608699 wait complete. 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.446+0000 7f319b278640 1 Processor -- start 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.446+0000 7f319b278640 1 -- start start 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f319b278640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3194103b60 0x7f319419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f319b278640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31941094a0 0x7f319419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f319b278640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3194109df0 0x7f319419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f319b278640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3194113ab0 con 0x7f31941094a0 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f319b278640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3194113930 con 0x7f3194103b60 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f319b278640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3194113c30 con 0x7f3194109df0 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3198813640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31941094a0 0x7f319419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3198813640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31941094a0 0x7f319419a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51520/0 (socket says 172.21.15.49:51520) 2024-09-21T06:35:47.450 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3198813640 1 -- 172.21.15.49:0/468490214 learned_addr learned my addr 172.21.15.49:0/468490214 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3199815640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3194109df0 0x7f319419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3199014640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3194103b60 0x7f319419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3198813640 1 -- 172.21.15.49:0/468490214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3194109df0 msgr2=0x7f319419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3198813640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3194109df0 0x7f319419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3198813640 1 -- 172.21.15.49:0/468490214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3194103b60 msgr2=0x7f319419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3198813640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3194103b60 0x7f319419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3198813640 1 -- 172.21.15.49:0/468490214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31941a0390 con 0x7f31941094a0 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3199014640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3194103b60 0x7f319419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f3198813640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31941094a0 0x7f319419a9c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f318400c970 tx=0x7f318400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.447+0000 7f318a7fc640 1 -- 172.21.15.49:0/468490214 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184007bb0 con 0x7f31941094a0 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.448+0000 7f318a7fc640 1 -- 172.21.15.49:0/468490214 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3184007d50 con 0x7f31941094a0 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.448+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941a0680 con 0x7f31941094a0 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.448+0000 7f318a7fc640 1 -- 172.21.15.49:0/468490214 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318400f450 con 0x7f31941094a0 2024-09-21T06:35:47.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.448+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31941a6de0 con 0x7f31941094a0 2024-09-21T06:35:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.449+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3194103f70 con 0x7f31941094a0 2024-09-21T06:35:47.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.450+0000 7f318a7fc640 1 -- 172.21.15.49:0/468490214 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3184004eb0 con 0x7f31941094a0 2024-09-21T06:35:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.451+0000 7f318a7fc640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31800b6670 0x7f31800b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.451+0000 7f3199014640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31800b6670 0x7f31800b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.451+0000 7f318a7fc640 1 -- 172.21.15.49:0/468490214 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f31840e7680 con 0x7f31941094a0 2024-09-21T06:35:47.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.451+0000 7f3199014640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31800b6670 0x7f31800b8b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31900058c0 tx=0x7f3190005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:47.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.454+0000 7f318a7fc640 1 -- 172.21.15.49:0/468490214 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3184014030 con 0x7f31941094a0 2024-09-21T06:35:47.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.661+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3194063800 con 0x7f31800b6670 2024-09-21T06:35:47.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.667+0000 7f318a7fc640 1 -- 172.21.15.49:0/468490214 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258682 (secure 0 0 0) 0x7f3194063800 con 0x7f31800b6670 2024-09-21T06:35:47.671 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:47.672 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-09-21T06:35:47.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31800b6670 msgr2=0x7f31800b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31800b6670 0x7f31800b8b80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31900058c0 tx=0x7f3190005850 comp rx=0 tx=0).stop 2024-09-21T06:35:47.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31941094a0 msgr2=0x7f319419a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31941094a0 0x7f319419a9c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f318400c970 tx=0x7f318400ce30 comp rx=0 tx=0).stop 2024-09-21T06:35:47.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 shutdown_connections 2024-09-21T06:35:47.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f31800b6670 0x7f31800b8b80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3194109df0 0x7f319419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f31941094a0 0x7f319419a9c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 --2- 172.21.15.49:0/468490214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3194103b60 0x7f319419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 >> 172.21.15.49:0/468490214 conn(0x7f319407b850 msgr2=0x7f31941074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:47.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 shutdown_connections 2024-09-21T06:35:47.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:47.671+0000 7f319b278640 1 -- 172.21.15.49:0/468490214 wait complete. 2024-09-21T06:35:47.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:47 smithi049 ceph-mon[31177]: pgmap v291: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:47.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:47 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:47.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:47 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:48.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:47 smithi098 ceph-mon[34704]: pgmap v291: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:47 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:47 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:48.299 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-09-21T06:35:46.120558+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660493,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":394,"num_read_kb":291,"num_write":286,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":3016592,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357040,"kb_used_data":11880,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584784,"statfs":{"total":1151940427776,"available":1151574818816,"internally_reserved":0,"allocated":12165120,"data_stored":6886755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003309"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232192+0000","last_change":"2024-09-21T06:34:42.895466+0000","last_active":"2024-09-21T06:35:13.232192+0000","last_peered":"2024-09-21T06:35:13.232192+0000","last_clean":"2024-09-21T06:35:13.232192+0000","last_became_active":"2024-09-21T06:34:42.895084+0000","last_became_peered":"2024-09-21T06:34:42.895084+0000","last_unstale":"2024-09-21T06:35:13.232192+0000","last_undegraded":"2024-09-21T06:35:13.232192+0000","last_fullsized":"2024-09-21T06:35:13.232192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.513107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497010+0000","last_change":"2024-09-21T06:34:42.888307+0000","last_active":"2024-09-21T06:35:13.497010+0000","last_peered":"2024-09-21T06:35:13.497010+0000","last_clean":"2024-09-21T06:35:13.497010+0000","last_became_active":"2024-09-21T06:34:42.886106+0000","last_became_peered":"2024-09-21T06:34:42.886106+0000","last_unstale":"2024-09-21T06:35:13.497010+0000","last_undegraded":"2024-09-21T06:35:13.497010+0000","last_fullsized":"2024-09-21T06:35:13.497010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:57.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497322+0000","last_change":"2024-09-21T06:34:42.897217+0000","last_active":"2024-09-21T06:35:13.497322+0000","last_peered":"2024-09-21T06:35:13.497322+0000","last_clean":"2024-09-21T06:35:13.497322+0000","last_became_active":"2024-09-21T06:34:42.896849+0000","last_became_peered":"2024-09-21T06:34:42.896849+0000","last_unstale":"2024-09-21T06:35:13.497322+0000","last_undegraded":"2024-09-21T06:35:13.497322+0000","last_fullsized":"2024-09-21T06:35:13.497322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:28.749566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498837+0000","last_change":"2024-09-21T06:34:42.887236+0000","last_active":"2024-09-21T06:35:13.498837+0000","last_peered":"2024-09-21T06:35:13.498837+0000","last_clean":"2024-09-21T06:35:13.498837+0000","last_became_active":"2024-09-21T06:34:42.886137+0000","last_became_peered":"2024-09-21T06:34:42.886137+0000","last_unstale":"2024-09-21T06:35:13.498837+0000","last_undegraded":"2024-09-21T06:35:13.498837+0000","last_fullsized":"2024-09-21T06:35:13.498837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:23.728433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498181+0000","last_change":"2024-09-21T06:34:42.885792+0000","last_active":"2024-09-21T06:35:13.498181+0000","last_peered":"2024-09-21T06:35:13.498181+0000","last_clean":"2024-09-21T06:35:13.498181+0000","last_became_active":"2024-09-21T06:34:42.885372+0000","last_became_peered":"2024-09-21T06:34:42.885372+0000","last_unstale":"2024-09-21T06:35:13.498181+0000","last_undegraded":"2024-09-21T06:35:13.498181+0000","last_fullsized":"2024-09-21T06:35:13.498181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:29.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231589+0000","last_change":"2024-09-21T06:34:42.896814+0000","last_active":"2024-09-21T06:35:13.231589+0000","last_peered":"2024-09-21T06:35:13.231589+0000","last_clean":"2024-09-21T06:35:13.231589+0000","last_became_active":"2024-09-21T06:34:42.896147+0000","last_became_peered":"2024-09-21T06:34:42.896147+0000","last_unstale":"2024-09-21T06:35:13.231589+0000","last_undegraded":"2024-09-21T06:35:13.231589+0000","last_fullsized":"2024-09-21T06:35:13.231589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:49.037539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288675+0000","last_change":"2024-09-21T06:34:42.896264+0000","last_active":"2024-09-21T06:35:13.288675+0000","last_peered":"2024-09-21T06:35:13.288675+0000","last_clean":"2024-09-21T06:35:13.288675+0000","last_became_active":"2024-09-21T06:34:42.895793+0000","last_became_peered":"2024-09-21T06:34:42.895793+0000","last_unstale":"2024-09-21T06:35:13.288675+0000","last_undegraded":"2024-09-21T06:35:13.288675+0000","last_fullsized":"2024-09-21T06:35:13.288675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:06.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234345+0000","last_change":"2024-09-21T06:34:42.892538+0000","last_active":"2024-09-21T06:35:13.234345+0000","last_peered":"2024-09-21T06:35:13.234345+0000","last_clean":"2024-09-21T06:35:13.234345+0000","last_became_active":"2024-09-21T06:34:42.892139+0000","last_became_peered":"2024-09-21T06:34:42.892139+0000","last_unstale":"2024-09-21T06:35:13.234345+0000","last_undegraded":"2024-09-21T06:35:13.234345+0000","last_fullsized":"2024-09-21T06:35:13.234345+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:51.808969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.499901+0000","last_change":"2024-09-21T06:35:13.499797+0000","last_active":"2024-09-21T06:35:13.499901+0000","last_peered":"2024-09-21T06:35:13.499901+0000","last_clean":"2024-09-21T06:35:13.499901+0000","last_became_active":"2024-09-21T06:35:13.499380+0000","last_became_peered":"2024-09-21T06:35:13.499380+0000","last_unstale":"2024-09-21T06:35:13.499901+0000","last_undegraded":"2024-09-21T06:35:13.499901+0000","last_fullsized":"2024-09-21T06:35:13.499901+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:21.809657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11],"acting":[9,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231994+0000","last_change":"2024-09-21T06:34:42.895533+0000","last_active":"2024-09-21T06:35:13.231994+0000","last_peered":"2024-09-21T06:35:13.231994+0000","last_clean":"2024-09-21T06:35:13.231994+0000","last_became_active":"2024-09-21T06:34:42.895162+0000","last_became_peered":"2024-09-21T06:34:42.895162+0000","last_unstale":"2024-09-21T06:35:13.231994+0000","last_undegraded":"2024-09-21T06:35:13.231994+0000","last_fullsized":"2024-09-21T06:35:13.231994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:25.495493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289315+0000","last_change":"2024-09-21T06:34:42.894173+0000","last_active":"2024-09-21T06:35:13.289315+0000","last_peered":"2024-09-21T06:35:13.289315+0000","last_clean":"2024-09-21T06:35:13.289315+0000","last_became_active":"2024-09-21T06:34:42.893817+0000","last_became_peered":"2024-09-21T06:34:42.893817+0000","last_unstale":"2024-09-21T06:35:13.289315+0000","last_undegraded":"2024-09-21T06:35:13.289315+0000","last_fullsized":"2024-09-21T06:35:13.289315+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:31.580564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498906+0000","last_change":"2024-09-21T06:34:42.886536+0000","last_active":"2024-09-21T06:35:13.498906+0000","last_peered":"2024-09-21T06:35:13.498906+0000","last_clean":"2024-09-21T06:35:13.498906+0000","last_became_active":"2024-09-21T06:34:42.885636+0000","last_became_peered":"2024-09-21T06:34:42.885636+0000","last_unstale":"2024-09-21T06:35:13.498906+0000","last_undegraded":"2024-09-21T06:35:13.498906+0000","last_fullsized":"2024-09-21T06:35:13.498906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:11.074850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498187+0000","last_change":"2024-09-21T06:34:42.882665+0000","last_active":"2024-09-21T06:35:13.498187+0000","last_peered":"2024-09-21T06:35:13.498187+0000","last_clean":"2024-09-21T06:35:13.498187+0000","last_became_active":"2024-09-21T06:34:42.882254+0000","last_became_peered":"2024-09-21T06:34:42.882254+0000","last_unstale":"2024-09-21T06:35:13.498187+0000","last_undegraded":"2024-09-21T06:35:13.498187+0000","last_fullsized":"2024-09-21T06:35:13.498187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:01.203542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.496843+0000","last_change":"2024-09-21T06:34:42.884034+0000","last_active":"2024-09-21T06:35:13.496843+0000","last_peered":"2024-09-21T06:35:13.496843+0000","last_clean":"2024-09-21T06:35:13.496843+0000","last_became_active":"2024-09-21T06:34:42.883685+0000","last_became_peered":"2024-09-21T06:34:42.883685+0000","last_unstale":"2024-09-21T06:35:13.496843+0000","last_undegraded":"2024-09-21T06:35:13.496843+0000","last_fullsized":"2024-09-21T06:35:13.496843+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:00.124019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.496838+0000","last_change":"2024-09-21T06:34:42.894686+0000","last_active":"2024-09-21T06:35:13.496838+0000","last_peered":"2024-09-21T06:35:13.496838+0000","last_clean":"2024-09-21T06:35:13.496838+0000","last_became_active":"2024-09-21T06:34:42.893980+0000","last_became_peered":"2024-09-21T06:34:42.893980+0000","last_unstale":"2024-09-21T06:35:13.496838+0000","last_undegraded":"2024-09-21T06:35:13.496838+0000","last_fullsized":"2024-09-21T06:35:13.496838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:00.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233970+0000","last_change":"2024-09-21T06:34:42.891462+0000","last_active":"2024-09-21T06:35:13.233970+0000","last_peered":"2024-09-21T06:35:13.233970+0000","last_clean":"2024-09-21T06:35:13.233970+0000","last_became_active":"2024-09-21T06:34:42.891085+0000","last_became_peered":"2024-09-21T06:34:42.891085+0000","last_unstale":"2024-09-21T06:35:13.233970+0000","last_undegraded":"2024-09-21T06:35:13.233970+0000","last_fullsized":"2024-09-21T06:35:13.233970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:03.942909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232313+0000","last_change":"2024-09-21T06:34:42.897049+0000","last_active":"2024-09-21T06:35:13.232313+0000","last_peered":"2024-09-21T06:35:13.232313+0000","last_clean":"2024-09-21T06:35:13.232313+0000","last_became_active":"2024-09-21T06:34:42.896131+0000","last_became_peered":"2024-09-21T06:34:42.896131+0000","last_unstale":"2024-09-21T06:35:13.232313+0000","last_undegraded":"2024-09-21T06:35:13.232313+0000","last_fullsized":"2024-09-21T06:35:13.232313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:47.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.230971+0000","last_change":"2024-09-21T06:34:42.887894+0000","last_active":"2024-09-21T06:35:13.230971+0000","last_peered":"2024-09-21T06:35:13.230971+0000","last_clean":"2024-09-21T06:35:13.230971+0000","last_became_active":"2024-09-21T06:34:42.887436+0000","last_became_peered":"2024-09-21T06:34:42.887436+0000","last_unstale":"2024-09-21T06:35:13.230971+0000","last_undegraded":"2024-09-21T06:35:13.230971+0000","last_fullsized":"2024-09-21T06:35:13.230971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:22.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.236161+0000","last_change":"2024-09-21T06:34:42.888071+0000","last_active":"2024-09-21T06:35:13.236161+0000","last_peered":"2024-09-21T06:35:13.236161+0000","last_clean":"2024-09-21T06:35:13.236161+0000","last_became_active":"2024-09-21T06:34:42.887295+0000","last_became_peered":"2024-09-21T06:34:42.887295+0000","last_unstale":"2024-09-21T06:35:13.236161+0000","last_undegraded":"2024-09-21T06:35:13.236161+0000","last_fullsized":"2024-09-21T06:35:13.236161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:49.937367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232048+0000","last_change":"2024-09-21T06:34:42.891963+0000","last_active":"2024-09-21T06:35:13.232048+0000","last_peered":"2024-09-21T06:35:13.232048+0000","last_clean":"2024-09-21T06:35:13.232048+0000","last_became_active":"2024-09-21T06:34:42.891603+0000","last_became_peered":"2024-09-21T06:34:42.891603+0000","last_unstale":"2024-09-21T06:35:13.232048+0000","last_undegraded":"2024-09-21T06:35:13.232048+0000","last_fullsized":"2024-09-21T06:35:13.232048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:47.608523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498262+0000","last_change":"2024-09-21T06:34:42.895909+0000","last_active":"2024-09-21T06:35:13.498262+0000","last_peered":"2024-09-21T06:35:13.498262+0000","last_clean":"2024-09-21T06:35:13.498262+0000","last_became_active":"2024-09-21T06:34:42.895477+0000","last_became_peered":"2024-09-21T06:34:42.895477+0000","last_unstale":"2024-09-21T06:35:13.498262+0000","last_undegraded":"2024-09-21T06:35:13.498262+0000","last_fullsized":"2024-09-21T06:35:13.498262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.284523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234197+0000","last_change":"2024-09-21T06:34:42.893554+0000","last_active":"2024-09-21T06:35:13.234197+0000","last_peered":"2024-09-21T06:35:13.234197+0000","last_clean":"2024-09-21T06:35:13.234197+0000","last_became_active":"2024-09-21T06:34:42.892949+0000","last_became_peered":"2024-09-21T06:34:42.892949+0000","last_unstale":"2024-09-21T06:35:13.234197+0000","last_undegraded":"2024-09-21T06:35:13.234197+0000","last_fullsized":"2024-09-21T06:35:13.234197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:57.107590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234415+0000","last_change":"2024-09-21T06:34:42.894574+0000","last_active":"2024-09-21T06:35:13.234415+0000","last_peered":"2024-09-21T06:35:13.234415+0000","last_clean":"2024-09-21T06:35:13.234415+0000","last_became_active":"2024-09-21T06:34:42.894027+0000","last_became_peered":"2024-09-21T06:34:42.894027+0000","last_unstale":"2024-09-21T06:35:13.234415+0000","last_undegraded":"2024-09-21T06:35:13.234415+0000","last_fullsized":"2024-09-21T06:35:13.234415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:58.425792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.499832+0000","last_change":"2024-09-21T06:35:13.499715+0000","last_active":"2024-09-21T06:35:13.499832+0000","last_peered":"2024-09-21T06:35:13.499832+0000","last_clean":"2024-09-21T06:35:13.499832+0000","last_became_active":"2024-09-21T06:35:13.499171+0000","last_became_peered":"2024-09-21T06:35:13.499171+0000","last_unstale":"2024-09-21T06:35:13.499832+0000","last_undegraded":"2024-09-21T06:35:13.499832+0000","last_fullsized":"2024-09-21T06:35:13.499832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:35.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.499580+0000","last_change":"2024-09-21T06:35:13.499458+0000","last_active":"2024-09-21T06:35:13.499580+0000","last_peered":"2024-09-21T06:35:13.499580+0000","last_clean":"2024-09-21T06:35:13.499580+0000","last_became_active":"2024-09-21T06:35:13.498984+0000","last_became_peered":"2024-09-21T06:35:13.498984+0000","last_unstale":"2024-09-21T06:35:13.499580+0000","last_undegraded":"2024-09-21T06:35:13.499580+0000","last_fullsized":"2024-09-21T06:35:13.499580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:10.871658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.236419+0000","last_change":"2024-09-21T06:34:42.888826+0000","last_active":"2024-09-21T06:35:13.236419+0000","last_peered":"2024-09-21T06:35:13.236419+0000","last_clean":"2024-09-21T06:35:13.236419+0000","last_became_active":"2024-09-21T06:34:42.888447+0000","last_became_peered":"2024-09-21T06:34:42.888447+0000","last_unstale":"2024-09-21T06:35:13.236419+0000","last_undegraded":"2024-09-21T06:35:13.236419+0000","last_fullsized":"2024-09-21T06:35:13.236419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:52.634516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232176+0000","last_change":"2024-09-21T06:34:42.889377+0000","last_active":"2024-09-21T06:35:13.232176+0000","last_peered":"2024-09-21T06:35:13.232176+0000","last_clean":"2024-09-21T06:35:13.232176+0000","last_became_active":"2024-09-21T06:34:42.888978+0000","last_became_peered":"2024-09-21T06:34:42.888978+0000","last_unstale":"2024-09-21T06:35:13.232176+0000","last_undegraded":"2024-09-21T06:35:13.232176+0000","last_fullsized":"2024-09-21T06:35:13.232176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:34.734283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498353+0000","last_change":"2024-09-21T06:34:42.878128+0000","last_active":"2024-09-21T06:35:13.498353+0000","last_peered":"2024-09-21T06:35:13.498353+0000","last_clean":"2024-09-21T06:35:13.498353+0000","last_became_active":"2024-09-21T06:34:42.877742+0000","last_became_peered":"2024-09-21T06:34:42.877742+0000","last_unstale":"2024-09-21T06:35:13.498353+0000","last_undegraded":"2024-09-21T06:35:13.498353+0000","last_fullsized":"2024-09-21T06:35:13.498353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:04.992402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497138+0000","last_change":"2024-09-21T06:34:42.882659+0000","last_active":"2024-09-21T06:35:13.497138+0000","last_peered":"2024-09-21T06:35:13.497138+0000","last_clean":"2024-09-21T06:35:13.497138+0000","last_became_active":"2024-09-21T06:34:42.882306+0000","last_became_peered":"2024-09-21T06:34:42.882306+0000","last_unstale":"2024-09-21T06:35:13.497138+0000","last_undegraded":"2024-09-21T06:35:13.497138+0000","last_fullsized":"2024-09-21T06:35:13.497138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:31.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.235558+0000","last_change":"2024-09-21T06:34:42.890089+0000","last_active":"2024-09-21T06:35:13.235558+0000","last_peered":"2024-09-21T06:35:13.235558+0000","last_clean":"2024-09-21T06:35:13.235558+0000","last_became_active":"2024-09-21T06:34:42.889739+0000","last_became_peered":"2024-09-21T06:34:42.889739+0000","last_unstale":"2024-09-21T06:35:13.235558+0000","last_undegraded":"2024-09-21T06:35:13.235558+0000","last_fullsized":"2024-09-21T06:35:13.235558+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.212760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.290729+0000","last_change":"2024-09-21T06:35:13.290617+0000","last_active":"2024-09-21T06:35:13.290729+0000","last_peered":"2024-09-21T06:35:13.290729+0000","last_clean":"2024-09-21T06:35:13.290729+0000","last_became_active":"2024-09-21T06:35:13.290005+0000","last_became_peered":"2024-09-21T06:35:13.290005+0000","last_unstale":"2024-09-21T06:35:13.290729+0000","last_undegraded":"2024-09-21T06:35:13.290729+0000","last_fullsized":"2024-09-21T06:35:13.290729+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:39.490034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231667+0000","last_change":"2024-09-21T06:34:42.893859+0000","last_active":"2024-09-21T06:35:13.231667+0000","last_peered":"2024-09-21T06:35:13.231667+0000","last_clean":"2024-09-21T06:35:13.231667+0000","last_became_active":"2024-09-21T06:34:42.893485+0000","last_became_peered":"2024-09-21T06:34:42.893485+0000","last_unstale":"2024-09-21T06:35:13.231667+0000","last_undegraded":"2024-09-21T06:35:13.231667+0000","last_fullsized":"2024-09-21T06:35:13.231667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:59.936750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497987+0000","last_change":"2024-09-21T06:34:42.887164+0000","last_active":"2024-09-21T06:35:13.497987+0000","last_peered":"2024-09-21T06:35:13.497987+0000","last_clean":"2024-09-21T06:35:13.497987+0000","last_became_active":"2024-09-21T06:34:42.886314+0000","last_became_peered":"2024-09-21T06:34:42.886314+0000","last_unstale":"2024-09-21T06:35:13.497987+0000","last_undegraded":"2024-09-21T06:35:13.497987+0000","last_fullsized":"2024-09-21T06:35:13.497987+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:09.529922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:41.045448+0000","last_change":"2024-09-21T06:34:40.883170+0000","last_active":"2024-09-21T06:35:41.045448+0000","last_peered":"2024-09-21T06:35:41.045448+0000","last_clean":"2024-09-21T06:35:41.045448+0000","last_became_active":"2024-09-21T06:34:40.882760+0000","last_became_peered":"2024-09-21T06:34:40.882760+0000","last_unstale":"2024-09-21T06:35:41.045448+0000","last_undegraded":"2024-09-21T06:35:41.045448+0000","last_fullsized":"2024-09-21T06:35:41.045448+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:41.388275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233824+0000","last_change":"2024-09-21T06:34:42.893842+0000","last_active":"2024-09-21T06:35:13.233824+0000","last_peered":"2024-09-21T06:35:13.233824+0000","last_clean":"2024-09-21T06:35:13.233824+0000","last_became_active":"2024-09-21T06:34:42.893501+0000","last_became_peered":"2024-09-21T06:34:42.893501+0000","last_unstale":"2024-09-21T06:35:13.233824+0000","last_undegraded":"2024-09-21T06:35:13.233824+0000","last_fullsized":"2024-09-21T06:35:13.233824+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.610084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232236+0000","last_change":"2024-09-21T06:34:40.878685+0000","last_active":"2024-09-21T06:35:13.232236+0000","last_peered":"2024-09-21T06:35:13.232236+0000","last_clean":"2024-09-21T06:35:13.232236+0000","last_became_active":"2024-09-21T06:34:40.878279+0000","last_became_peered":"2024-09-21T06:34:40.878279+0000","last_unstale":"2024-09-21T06:35:13.232236+0000","last_undegraded":"2024-09-21T06:35:13.232236+0000","last_fullsized":"2024-09-21T06:35:13.232236+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:11.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498113+0000","last_change":"2024-09-21T06:34:40.872074+0000","last_active":"2024-09-21T06:35:13.498113+0000","last_peered":"2024-09-21T06:35:13.498113+0000","last_clean":"2024-09-21T06:35:13.498113+0000","last_became_active":"2024-09-21T06:34:40.871637+0000","last_became_peered":"2024-09-21T06:34:40.871637+0000","last_unstale":"2024-09-21T06:35:13.498113+0000","last_undegraded":"2024-09-21T06:35:13.498113+0000","last_fullsized":"2024-09-21T06:35:13.498113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234507+0000","last_change":"2024-09-21T06:34:42.882803+0000","last_active":"2024-09-21T06:35:13.234507+0000","last_peered":"2024-09-21T06:35:13.234507+0000","last_clean":"2024-09-21T06:35:13.234507+0000","last_became_active":"2024-09-21T06:34:42.881509+0000","last_became_peered":"2024-09-21T06:34:42.881509+0000","last_unstale":"2024-09-21T06:35:13.234507+0000","last_undegraded":"2024-09-21T06:35:13.234507+0000","last_fullsized":"2024-09-21T06:35:13.234507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233917+0000","last_change":"2024-09-21T06:34:40.883054+0000","last_active":"2024-09-21T06:35:13.233917+0000","last_peered":"2024-09-21T06:35:13.233917+0000","last_clean":"2024-09-21T06:35:13.233917+0000","last_became_active":"2024-09-21T06:34:40.882299+0000","last_became_peered":"2024-09-21T06:34:40.882299+0000","last_unstale":"2024-09-21T06:35:13.233917+0000","last_undegraded":"2024-09-21T06:35:13.233917+0000","last_fullsized":"2024-09-21T06:35:13.233917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:17.813744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.230626+0000","last_change":"2024-09-21T06:34:42.886437+0000","last_active":"2024-09-21T06:35:13.230626+0000","last_peered":"2024-09-21T06:35:13.230626+0000","last_clean":"2024-09-21T06:35:13.230626+0000","last_became_active":"2024-09-21T06:34:42.886075+0000","last_became_peered":"2024-09-21T06:34:42.886075+0000","last_unstale":"2024-09-21T06:35:13.230626+0000","last_undegraded":"2024-09-21T06:35:13.230626+0000","last_fullsized":"2024-09-21T06:35:13.230626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.179323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":75,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:40.043685+0000","last_change":"2024-09-21T06:34:40.880931+0000","last_active":"2024-09-21T06:35:40.043685+0000","last_peered":"2024-09-21T06:35:40.043685+0000","last_clean":"2024-09-21T06:35:40.043685+0000","last_became_active":"2024-09-21T06:34:40.880555+0000","last_became_peered":"2024-09-21T06:34:40.880555+0000","last_unstale":"2024-09-21T06:35:40.043685+0000","last_undegraded":"2024-09-21T06:35:40.043685+0000","last_fullsized":"2024-09-21T06:35:40.043685+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:29.304297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234518+0000","last_change":"2024-09-21T06:34:42.899618+0000","last_active":"2024-09-21T06:35:13.234518+0000","last_peered":"2024-09-21T06:35:13.234518+0000","last_clean":"2024-09-21T06:35:13.234518+0000","last_became_active":"2024-09-21T06:34:42.899230+0000","last_became_peered":"2024-09-21T06:34:42.899230+0000","last_unstale":"2024-09-21T06:35:13.234518+0000","last_undegraded":"2024-09-21T06:35:13.234518+0000","last_fullsized":"2024-09-21T06:35:13.234518+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:27.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289319+0000","last_change":"2024-09-21T06:34:40.882988+0000","last_active":"2024-09-21T06:35:13.289319+0000","last_peered":"2024-09-21T06:35:13.289319+0000","last_clean":"2024-09-21T06:35:13.289319+0000","last_became_active":"2024-09-21T06:34:40.882533+0000","last_became_peered":"2024-09-21T06:34:40.882533+0000","last_unstale":"2024-09-21T06:35:13.289319+0000","last_undegraded":"2024-09-21T06:35:13.289319+0000","last_fullsized":"2024-09-21T06:35:13.289319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:23.220540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497233+0000","last_change":"2024-09-21T06:34:42.889556+0000","last_active":"2024-09-21T06:35:13.497233+0000","last_peered":"2024-09-21T06:35:13.497233+0000","last_clean":"2024-09-21T06:35:13.497233+0000","last_became_active":"2024-09-21T06:34:42.888853+0000","last_became_peered":"2024-09-21T06:34:42.888853+0000","last_unstale":"2024-09-21T06:35:13.497233+0000","last_undegraded":"2024-09-21T06:35:13.497233+0000","last_fullsized":"2024-09-21T06:35:13.497233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:24.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234209+0000","last_change":"2024-09-21T06:34:40.891450+0000","last_active":"2024-09-21T06:35:13.234209+0000","last_peered":"2024-09-21T06:35:13.234209+0000","last_clean":"2024-09-21T06:35:13.234209+0000","last_became_active":"2024-09-21T06:34:40.890892+0000","last_became_peered":"2024-09-21T06:34:40.890892+0000","last_unstale":"2024-09-21T06:35:13.234209+0000","last_undegraded":"2024-09-21T06:35:13.234209+0000","last_fullsized":"2024-09-21T06:35:13.234209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.975342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234403+0000","last_change":"2024-09-21T06:34:42.893122+0000","last_active":"2024-09-21T06:35:13.234403+0000","last_peered":"2024-09-21T06:35:13.234403+0000","last_clean":"2024-09-21T06:35:13.234403+0000","last_became_active":"2024-09-21T06:34:42.892730+0000","last_became_peered":"2024-09-21T06:34:42.892730+0000","last_unstale":"2024-09-21T06:35:13.234403+0000","last_undegraded":"2024-09-21T06:35:13.234403+0000","last_fullsized":"2024-09-21T06:35:13.234403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:06.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'28","reported_seq":174,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:40.553747+0000","last_change":"2024-09-21T06:35:13.509359+0000","last_active":"2024-09-21T06:35:40.553747+0000","last_peered":"2024-09-21T06:35:40.553747+0000","last_clean":"2024-09-21T06:35:40.553747+0000","last_became_active":"2024-09-21T06:35:13.499621+0000","last_became_peered":"2024-09-21T06:35:13.499621+0000","last_unstale":"2024-09-21T06:35:40.553747+0000","last_undegraded":"2024-09-21T06:35:40.553747+0000","last_fullsized":"2024-09-21T06:35:40.553747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:52.396964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65890,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":95,"num_read_kb":103,"num_write":29,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":64752,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498425+0000","last_change":"2024-09-21T06:34:42.890487+0000","last_active":"2024-09-21T06:35:13.498425+0000","last_peered":"2024-09-21T06:35:13.498425+0000","last_clean":"2024-09-21T06:35:13.498425+0000","last_became_active":"2024-09-21T06:34:42.890100+0000","last_became_peered":"2024-09-21T06:34:42.890100+0000","last_unstale":"2024-09-21T06:35:13.498425+0000","last_undegraded":"2024-09-21T06:35:13.498425+0000","last_fullsized":"2024-09-21T06:35:13.498425+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.206869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.236142+0000","last_change":"2024-09-21T06:34:40.876187+0000","last_active":"2024-09-21T06:35:13.236142+0000","last_peered":"2024-09-21T06:35:13.236142+0000","last_clean":"2024-09-21T06:35:13.236142+0000","last_became_active":"2024-09-21T06:34:40.875687+0000","last_became_peered":"2024-09-21T06:34:40.875687+0000","last_unstale":"2024-09-21T06:35:13.236142+0000","last_undegraded":"2024-09-21T06:35:13.236142+0000","last_fullsized":"2024-09-21T06:35:13.236142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:51.758625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498115+0000","last_change":"2024-09-21T06:34:42.895900+0000","last_active":"2024-09-21T06:35:13.498115+0000","last_peered":"2024-09-21T06:35:13.498115+0000","last_clean":"2024-09-21T06:35:13.498115+0000","last_became_active":"2024-09-21T06:34:42.895504+0000","last_became_peered":"2024-09-21T06:34:42.895504+0000","last_unstale":"2024-09-21T06:35:13.498115+0000","last_undegraded":"2024-09-21T06:35:13.498115+0000","last_fullsized":"2024-09-21T06:35:13.498115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:28.414017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233328+0000","last_change":"2024-09-21T06:34:40.882856+0000","last_active":"2024-09-21T06:35:13.233328+0000","last_peered":"2024-09-21T06:35:13.233328+0000","last_clean":"2024-09-21T06:35:13.233328+0000","last_became_active":"2024-09-21T06:34:40.882424+0000","last_became_peered":"2024-09-21T06:34:40.882424+0000","last_unstale":"2024-09-21T06:35:13.233328+0000","last_undegraded":"2024-09-21T06:35:13.233328+0000","last_fullsized":"2024-09-21T06:35:13.233328+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:38.815928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288742+0000","last_change":"2024-09-21T06:34:42.890611+0000","last_active":"2024-09-21T06:35:13.288742+0000","last_peered":"2024-09-21T06:35:13.288742+0000","last_clean":"2024-09-21T06:35:13.288742+0000","last_became_active":"2024-09-21T06:34:42.890246+0000","last_became_peered":"2024-09-21T06:34:42.890246+0000","last_unstale":"2024-09-21T06:35:13.288742+0000","last_undegraded":"2024-09-21T06:35:13.288742+0000","last_fullsized":"2024-09-21T06:35:13.288742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:05.074903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":77,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:40.043699+0000","last_change":"2024-09-21T06:34:40.877003+0000","last_active":"2024-09-21T06:35:40.043699+0000","last_peered":"2024-09-21T06:35:40.043699+0000","last_clean":"2024-09-21T06:35:40.043699+0000","last_became_active":"2024-09-21T06:34:40.876516+0000","last_became_peered":"2024-09-21T06:34:40.876516+0000","last_unstale":"2024-09-21T06:35:40.043699+0000","last_undegraded":"2024-09-21T06:35:40.043699+0000","last_fullsized":"2024-09-21T06:35:40.043699+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:14.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288432+0000","last_change":"2024-09-21T06:34:42.896816+0000","last_active":"2024-09-21T06:35:13.288432+0000","last_peered":"2024-09-21T06:35:13.288432+0000","last_clean":"2024-09-21T06:35:13.288432+0000","last_became_active":"2024-09-21T06:34:42.896329+0000","last_became_peered":"2024-09-21T06:34:42.896329+0000","last_unstale":"2024-09-21T06:35:13.288432+0000","last_undegraded":"2024-09-21T06:35:13.288432+0000","last_fullsized":"2024-09-21T06:35:13.288432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.462498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497893+0000","last_change":"2024-09-21T06:34:40.892809+0000","last_active":"2024-09-21T06:35:13.497893+0000","last_peered":"2024-09-21T06:35:13.497893+0000","last_clean":"2024-09-21T06:35:13.497893+0000","last_became_active":"2024-09-21T06:34:40.892433+0000","last_became_peered":"2024-09-21T06:34:40.892433+0000","last_unstale":"2024-09-21T06:35:13.497893+0000","last_undegraded":"2024-09-21T06:35:13.497893+0000","last_fullsized":"2024-09-21T06:35:13.497893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:43.744202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.500652+0000","last_change":"2024-09-21T06:35:13.500503+0000","last_active":"2024-09-21T06:35:13.500652+0000","last_peered":"2024-09-21T06:35:13.500652+0000","last_clean":"2024-09-21T06:35:13.500652+0000","last_became_active":"2024-09-21T06:35:13.499704+0000","last_became_peered":"2024-09-21T06:35:13.499704+0000","last_unstale":"2024-09-21T06:35:13.500652+0000","last_undegraded":"2024-09-21T06:35:13.500652+0000","last_fullsized":"2024-09-21T06:35:13.500652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:45.469909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498658+0000","last_change":"2024-09-21T06:34:40.876791+0000","last_active":"2024-09-21T06:35:13.498658+0000","last_peered":"2024-09-21T06:35:13.498658+0000","last_clean":"2024-09-21T06:35:13.498658+0000","last_became_active":"2024-09-21T06:34:40.876323+0000","last_became_peered":"2024-09-21T06:34:40.876323+0000","last_unstale":"2024-09-21T06:35:13.498658+0000","last_undegraded":"2024-09-21T06:35:13.498658+0000","last_fullsized":"2024-09-21T06:35:13.498658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:20.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.499366+0000","last_change":"2024-09-21T06:35:13.499258+0000","last_active":"2024-09-21T06:35:13.499366+0000","last_peered":"2024-09-21T06:35:13.499366+0000","last_clean":"2024-09-21T06:35:13.499366+0000","last_became_active":"2024-09-21T06:35:13.498747+0000","last_became_peered":"2024-09-21T06:35:13.498747+0000","last_unstale":"2024-09-21T06:35:13.499366+0000","last_undegraded":"2024-09-21T06:35:13.499366+0000","last_fullsized":"2024-09-21T06:35:13.499366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:23.977754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498517+0000","last_change":"2024-09-21T06:34:40.877644+0000","last_active":"2024-09-21T06:35:13.498517+0000","last_peered":"2024-09-21T06:35:13.498517+0000","last_clean":"2024-09-21T06:35:13.498517+0000","last_became_active":"2024-09-21T06:34:40.877238+0000","last_became_peered":"2024-09-21T06:34:40.877238+0000","last_unstale":"2024-09-21T06:35:13.498517+0000","last_undegraded":"2024-09-21T06:35:13.498517+0000","last_fullsized":"2024-09-21T06:35:13.498517+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:21.055801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289360+0000","last_change":"2024-09-21T06:34:42.892399+0000","last_active":"2024-09-21T06:35:13.289360+0000","last_peered":"2024-09-21T06:35:13.289360+0000","last_clean":"2024-09-21T06:35:13.289360+0000","last_became_active":"2024-09-21T06:34:42.891873+0000","last_became_peered":"2024-09-21T06:34:42.891873+0000","last_unstale":"2024-09-21T06:35:13.289360+0000","last_undegraded":"2024-09-21T06:35:13.289360+0000","last_fullsized":"2024-09-21T06:35:13.289360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:09.684516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234408+0000","last_change":"2024-09-21T06:34:40.881603+0000","last_active":"2024-09-21T06:35:13.234408+0000","last_peered":"2024-09-21T06:35:13.234408+0000","last_clean":"2024-09-21T06:35:13.234408+0000","last_became_active":"2024-09-21T06:34:40.881226+0000","last_became_peered":"2024-09-21T06:34:40.881226+0000","last_unstale":"2024-09-21T06:35:13.234408+0000","last_undegraded":"2024-09-21T06:35:13.234408+0000","last_fullsized":"2024-09-21T06:35:13.234408+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:09.252102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289062+0000","last_change":"2024-09-21T06:34:42.897354+0000","last_active":"2024-09-21T06:35:13.289062+0000","last_peered":"2024-09-21T06:35:13.289062+0000","last_clean":"2024-09-21T06:35:13.289062+0000","last_became_active":"2024-09-21T06:34:42.896981+0000","last_became_peered":"2024-09-21T06:34:42.896981+0000","last_unstale":"2024-09-21T06:35:13.289062+0000","last_undegraded":"2024-09-21T06:35:13.289062+0000","last_fullsized":"2024-09-21T06:35:13.289062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:07.598107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.236419+0000","last_change":"2024-09-21T06:34:40.890831+0000","last_active":"2024-09-21T06:35:13.236419+0000","last_peered":"2024-09-21T06:35:13.236419+0000","last_clean":"2024-09-21T06:35:13.236419+0000","last_became_active":"2024-09-21T06:34:40.890420+0000","last_became_peered":"2024-09-21T06:34:40.890420+0000","last_unstale":"2024-09-21T06:35:13.236419+0000","last_undegraded":"2024-09-21T06:35:13.236419+0000","last_fullsized":"2024-09-21T06:35:13.236419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:17.822323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289284+0000","last_change":"2024-09-21T06:34:42.894825+0000","last_active":"2024-09-21T06:35:13.289284+0000","last_peered":"2024-09-21T06:35:13.289284+0000","last_clean":"2024-09-21T06:35:13.289284+0000","last_became_active":"2024-09-21T06:34:42.893347+0000","last_became_peered":"2024-09-21T06:34:42.893347+0000","last_unstale":"2024-09-21T06:35:13.289284+0000","last_undegraded":"2024-09-21T06:35:13.289284+0000","last_fullsized":"2024-09-21T06:35:13.289284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:14.946035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288659+0000","last_change":"2024-09-21T06:33:33.165773+0000","last_active":"2024-09-21T06:35:13.288659+0000","last_peered":"2024-09-21T06:35:13.288659+0000","last_clean":"2024-09-21T06:35:13.288659+0000","last_became_active":"2024-09-21T06:33:33.159754+0000","last_became_peered":"2024-09-21T06:33:33.159754+0000","last_unstale":"2024-09-21T06:35:13.288659+0000","last_undegraded":"2024-09-21T06:35:13.288659+0000","last_fullsized":"2024-09-21T06:35:13.288659+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_clean_scrub_stamp":"2024-09-21T06:30:10.865158+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:15.953330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498235+0000","last_change":"2024-09-21T06:34:40.876091+0000","last_active":"2024-09-21T06:35:13.498235+0000","last_peered":"2024-09-21T06:35:13.498235+0000","last_clean":"2024-09-21T06:35:13.498235+0000","last_became_active":"2024-09-21T06:34:40.875576+0000","last_became_peered":"2024-09-21T06:34:40.875576+0000","last_unstale":"2024-09-21T06:35:13.498235+0000","last_undegraded":"2024-09-21T06:35:13.498235+0000","last_fullsized":"2024-09-21T06:35:13.498235+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:34.392145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234623+0000","last_change":"2024-09-21T06:34:42.892283+0000","last_active":"2024-09-21T06:35:13.234623+0000","last_peered":"2024-09-21T06:35:13.234623+0000","last_clean":"2024-09-21T06:35:13.234623+0000","last_became_active":"2024-09-21T06:34:42.891839+0000","last_became_peered":"2024-09-21T06:34:42.891839+0000","last_unstale":"2024-09-21T06:35:13.234623+0000","last_undegraded":"2024-09-21T06:35:13.234623+0000","last_fullsized":"2024-09-21T06:35:13.234623+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:10.202352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288727+0000","last_change":"2024-09-21T06:34:40.880967+0000","last_active":"2024-09-21T06:35:13.288727+0000","last_peered":"2024-09-21T06:35:13.288727+0000","last_clean":"2024-09-21T06:35:13.288727+0000","last_became_active":"2024-09-21T06:34:40.880351+0000","last_became_peered":"2024-09-21T06:34:40.880351+0000","last_unstale":"2024-09-21T06:35:13.288727+0000","last_undegraded":"2024-09-21T06:35:13.288727+0000","last_fullsized":"2024-09-21T06:35:13.288727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:52.694732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497967+0000","last_change":"2024-09-21T06:34:42.876102+0000","last_active":"2024-09-21T06:35:13.497967+0000","last_peered":"2024-09-21T06:35:13.497967+0000","last_clean":"2024-09-21T06:35:13.497967+0000","last_became_active":"2024-09-21T06:34:42.875065+0000","last_became_peered":"2024-09-21T06:34:42.875065+0000","last_unstale":"2024-09-21T06:35:13.497967+0000","last_undegraded":"2024-09-21T06:35:13.497967+0000","last_fullsized":"2024-09-21T06:35:13.497967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:23.867180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":78,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:42.045719+0000","last_change":"2024-09-21T06:34:40.890355+0000","last_active":"2024-09-21T06:35:42.045719+0000","last_peered":"2024-09-21T06:35:42.045719+0000","last_clean":"2024-09-21T06:35:42.045719+0000","last_became_active":"2024-09-21T06:34:40.889974+0000","last_became_peered":"2024-09-21T06:34:40.889974+0000","last_unstale":"2024-09-21T06:35:42.045719+0000","last_undegraded":"2024-09-21T06:35:42.045719+0000","last_fullsized":"2024-09-21T06:35:42.045719+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:58.349625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233638+0000","last_change":"2024-09-21T06:34:42.899831+0000","last_active":"2024-09-21T06:35:13.233638+0000","last_peered":"2024-09-21T06:35:13.233638+0000","last_clean":"2024-09-21T06:35:13.233638+0000","last_became_active":"2024-09-21T06:34:42.899372+0000","last_became_peered":"2024-09-21T06:34:42.899372+0000","last_unstale":"2024-09-21T06:35:13.233638+0000","last_undegraded":"2024-09-21T06:35:13.233638+0000","last_fullsized":"2024-09-21T06:35:13.233638+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:50.165222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288940+0000","last_change":"2024-09-21T06:34:40.882380+0000","last_active":"2024-09-21T06:35:13.288940+0000","last_peered":"2024-09-21T06:35:13.288940+0000","last_clean":"2024-09-21T06:35:13.288940+0000","last_became_active":"2024-09-21T06:34:40.881463+0000","last_became_peered":"2024-09-21T06:34:40.881463+0000","last_unstale":"2024-09-21T06:35:13.288940+0000","last_undegraded":"2024-09-21T06:35:13.288940+0000","last_fullsized":"2024-09-21T06:35:13.288940+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:25.620174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231661+0000","last_change":"2024-09-21T06:34:42.897205+0000","last_active":"2024-09-21T06:35:13.231661+0000","last_peered":"2024-09-21T06:35:13.231661+0000","last_clean":"2024-09-21T06:35:13.231661+0000","last_became_active":"2024-09-21T06:34:42.896705+0000","last_became_peered":"2024-09-21T06:34:42.896705+0000","last_unstale":"2024-09-21T06:35:13.231661+0000","last_undegraded":"2024-09-21T06:35:13.231661+0000","last_fullsized":"2024-09-21T06:35:13.231661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.333176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.230820+0000","last_change":"2024-09-21T06:34:40.890356+0000","last_active":"2024-09-21T06:35:13.230820+0000","last_peered":"2024-09-21T06:35:13.230820+0000","last_clean":"2024-09-21T06:35:13.230820+0000","last_became_active":"2024-09-21T06:34:40.889963+0000","last_became_peered":"2024-09-21T06:34:40.889963+0000","last_unstale":"2024-09-21T06:35:13.230820+0000","last_undegraded":"2024-09-21T06:35:13.230820+0000","last_fullsized":"2024-09-21T06:35:13.230820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:09.621779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231671+0000","last_change":"2024-09-21T06:34:42.884933+0000","last_active":"2024-09-21T06:35:13.231671+0000","last_peered":"2024-09-21T06:35:13.231671+0000","last_clean":"2024-09-21T06:35:13.231671+0000","last_became_active":"2024-09-21T06:34:42.884506+0000","last_became_peered":"2024-09-21T06:34:42.884506+0000","last_unstale":"2024-09-21T06:35:13.231671+0000","last_undegraded":"2024-09-21T06:35:13.231671+0000","last_fullsized":"2024-09-21T06:35:13.231671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:14.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498566+0000","last_change":"2024-09-21T06:34:40.891408+0000","last_active":"2024-09-21T06:35:13.498566+0000","last_peered":"2024-09-21T06:35:13.498566+0000","last_clean":"2024-09-21T06:35:13.498566+0000","last_became_active":"2024-09-21T06:34:40.891016+0000","last_became_peered":"2024-09-21T06:34:40.891016+0000","last_unstale":"2024-09-21T06:35:13.498566+0000","last_undegraded":"2024-09-21T06:35:13.498566+0000","last_fullsized":"2024-09-21T06:35:13.498566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:51.712869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498387+0000","last_change":"2024-09-21T06:34:42.880047+0000","last_active":"2024-09-21T06:35:13.498387+0000","last_peered":"2024-09-21T06:35:13.498387+0000","last_clean":"2024-09-21T06:35:13.498387+0000","last_became_active":"2024-09-21T06:34:42.879664+0000","last_became_peered":"2024-09-21T06:34:42.879664+0000","last_unstale":"2024-09-21T06:35:13.498387+0000","last_undegraded":"2024-09-21T06:35:13.498387+0000","last_fullsized":"2024-09-21T06:35:13.498387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:03.621493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.230979+0000","last_change":"2024-09-21T06:34:40.877199+0000","last_active":"2024-09-21T06:35:13.230979+0000","last_peered":"2024-09-21T06:35:13.230979+0000","last_clean":"2024-09-21T06:35:13.230979+0000","last_became_active":"2024-09-21T06:34:40.876811+0000","last_became_peered":"2024-09-21T06:34:40.876811+0000","last_unstale":"2024-09-21T06:35:13.230979+0000","last_undegraded":"2024-09-21T06:35:13.230979+0000","last_fullsized":"2024-09-21T06:35:13.230979+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:03.917619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289411+0000","last_change":"2024-09-21T06:35:13.289318+0000","last_active":"2024-09-21T06:35:13.289411+0000","last_peered":"2024-09-21T06:35:13.289411+0000","last_clean":"2024-09-21T06:35:13.289411+0000","last_became_active":"2024-09-21T06:35:13.288961+0000","last_became_peered":"2024-09-21T06:35:13.288961+0000","last_unstale":"2024-09-21T06:35:13.289411+0000","last_undegraded":"2024-09-21T06:35:13.289411+0000","last_fullsized":"2024-09-21T06:35:13.289411+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:05.659772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498332+0000","last_change":"2024-09-21T06:34:40.869754+0000","last_active":"2024-09-21T06:35:13.498332+0000","last_peered":"2024-09-21T06:35:13.498332+0000","last_clean":"2024-09-21T06:35:13.498332+0000","last_became_active":"2024-09-21T06:34:40.869311+0000","last_became_peered":"2024-09-21T06:34:40.869311+0000","last_unstale":"2024-09-21T06:35:13.498332+0000","last_undegraded":"2024-09-21T06:35:13.498332+0000","last_fullsized":"2024-09-21T06:35:13.498332+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:10.959880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497041+0000","last_change":"2024-09-21T06:34:42.889198+0000","last_active":"2024-09-21T06:35:13.497041+0000","last_peered":"2024-09-21T06:35:13.497041+0000","last_clean":"2024-09-21T06:35:13.497041+0000","last_became_active":"2024-09-21T06:34:42.888813+0000","last_became_peered":"2024-09-21T06:34:42.888813+0000","last_unstale":"2024-09-21T06:35:13.497041+0000","last_undegraded":"2024-09-21T06:35:13.497041+0000","last_fullsized":"2024-09-21T06:35:13.497041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:25.270225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234099+0000","last_change":"2024-09-21T06:34:40.892267+0000","last_active":"2024-09-21T06:35:13.234099+0000","last_peered":"2024-09-21T06:35:13.234099+0000","last_clean":"2024-09-21T06:35:13.234099+0000","last_became_active":"2024-09-21T06:34:40.891791+0000","last_became_peered":"2024-09-21T06:34:40.891791+0000","last_unstale":"2024-09-21T06:35:13.234099+0000","last_undegraded":"2024-09-21T06:35:13.234099+0000","last_fullsized":"2024-09-21T06:35:13.234099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:07.864647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498203+0000","last_change":"2024-09-21T06:34:42.894361+0000","last_active":"2024-09-21T06:35:13.498203+0000","last_peered":"2024-09-21T06:35:13.498203+0000","last_clean":"2024-09-21T06:35:13.498203+0000","last_became_active":"2024-09-21T06:34:42.893976+0000","last_became_peered":"2024-09-21T06:34:42.893976+0000","last_unstale":"2024-09-21T06:35:13.498203+0000","last_undegraded":"2024-09-21T06:35:13.498203+0000","last_fullsized":"2024-09-21T06:35:13.498203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:32.741495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234544+0000","last_change":"2024-09-21T06:34:40.875952+0000","last_active":"2024-09-21T06:35:13.234544+0000","last_peered":"2024-09-21T06:35:13.234544+0000","last_clean":"2024-09-21T06:35:13.234544+0000","last_became_active":"2024-09-21T06:34:40.875598+0000","last_became_peered":"2024-09-21T06:34:40.875598+0000","last_unstale":"2024-09-21T06:35:13.234544+0000","last_undegraded":"2024-09-21T06:35:13.234544+0000","last_fullsized":"2024-09-21T06:35:13.234544+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:29.873037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231692+0000","last_change":"2024-09-21T06:34:42.887639+0000","last_active":"2024-09-21T06:35:13.231692+0000","last_peered":"2024-09-21T06:35:13.231692+0000","last_clean":"2024-09-21T06:35:13.231692+0000","last_became_active":"2024-09-21T06:34:42.887201+0000","last_became_peered":"2024-09-21T06:34:42.887201+0000","last_unstale":"2024-09-21T06:35:13.231692+0000","last_undegraded":"2024-09-21T06:35:13.231692+0000","last_fullsized":"2024-09-21T06:35:13.231692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:59.431007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.235713+0000","last_change":"2024-09-21T06:34:40.880145+0000","last_active":"2024-09-21T06:35:13.235713+0000","last_peered":"2024-09-21T06:35:13.235713+0000","last_clean":"2024-09-21T06:35:13.235713+0000","last_became_active":"2024-09-21T06:34:40.879480+0000","last_became_peered":"2024-09-21T06:34:40.879480+0000","last_unstale":"2024-09-21T06:35:13.235713+0000","last_undegraded":"2024-09-21T06:35:13.235713+0000","last_fullsized":"2024-09-21T06:35:13.235713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.551228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.235151+0000","last_change":"2024-09-21T06:34:42.882455+0000","last_active":"2024-09-21T06:35:13.235151+0000","last_peered":"2024-09-21T06:35:13.235151+0000","last_clean":"2024-09-21T06:35:13.235151+0000","last_became_active":"2024-09-21T06:34:42.880714+0000","last_became_peered":"2024-09-21T06:34:42.880714+0000","last_unstale":"2024-09-21T06:35:13.235151+0000","last_undegraded":"2024-09-21T06:35:13.235151+0000","last_fullsized":"2024-09-21T06:35:13.235151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:39.264152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498289+0000","last_change":"2024-09-21T06:34:40.879560+0000","last_active":"2024-09-21T06:35:13.498289+0000","last_peered":"2024-09-21T06:35:13.498289+0000","last_clean":"2024-09-21T06:35:13.498289+0000","last_became_active":"2024-09-21T06:34:40.878433+0000","last_became_peered":"2024-09-21T06:34:40.878433+0000","last_unstale":"2024-09-21T06:35:13.498289+0000","last_undegraded":"2024-09-21T06:35:13.498289+0000","last_fullsized":"2024-09-21T06:35:13.498289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:07.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288729+0000","last_change":"2024-09-21T06:34:42.896193+0000","last_active":"2024-09-21T06:35:13.288729+0000","last_peered":"2024-09-21T06:35:13.288729+0000","last_clean":"2024-09-21T06:35:13.288729+0000","last_became_active":"2024-09-21T06:34:42.895753+0000","last_became_peered":"2024-09-21T06:34:42.895753+0000","last_unstale":"2024-09-21T06:35:13.288729+0000","last_undegraded":"2024-09-21T06:35:13.288729+0000","last_fullsized":"2024-09-21T06:35:13.288729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:47.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.290529+0000","last_change":"2024-09-21T06:35:13.290402+0000","last_active":"2024-09-21T06:35:13.290529+0000","last_peered":"2024-09-21T06:35:13.290529+0000","last_clean":"2024-09-21T06:35:13.290529+0000","last_became_active":"2024-09-21T06:35:13.289718+0000","last_became_peered":"2024-09-21T06:35:13.289718+0000","last_unstale":"2024-09-21T06:35:13.290529+0000","last_undegraded":"2024-09-21T06:35:13.290529+0000","last_fullsized":"2024-09-21T06:35:13.290529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:06.684007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498453+0000","last_change":"2024-09-21T06:34:40.879386+0000","last_active":"2024-09-21T06:35:13.498453+0000","last_peered":"2024-09-21T06:35:13.498453+0000","last_clean":"2024-09-21T06:35:13.498453+0000","last_became_active":"2024-09-21T06:34:40.879001+0000","last_became_peered":"2024-09-21T06:34:40.879001+0000","last_unstale":"2024-09-21T06:35:13.498453+0000","last_undegraded":"2024-09-21T06:35:13.498453+0000","last_fullsized":"2024-09-21T06:35:13.498453+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:48.438361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234122+0000","last_change":"2024-09-21T06:34:42.901595+0000","last_active":"2024-09-21T06:35:13.234122+0000","last_peered":"2024-09-21T06:35:13.234122+0000","last_clean":"2024-09-21T06:35:13.234122+0000","last_became_active":"2024-09-21T06:34:42.901200+0000","last_became_peered":"2024-09-21T06:34:42.901200+0000","last_unstale":"2024-09-21T06:35:13.234122+0000","last_undegraded":"2024-09-21T06:35:13.234122+0000","last_fullsized":"2024-09-21T06:35:13.234122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:12.044528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498519+0000","last_change":"2024-09-21T06:34:40.878959+0000","last_active":"2024-09-21T06:35:13.498519+0000","last_peered":"2024-09-21T06:35:13.498519+0000","last_clean":"2024-09-21T06:35:13.498519+0000","last_became_active":"2024-09-21T06:34:40.878343+0000","last_became_peered":"2024-09-21T06:34:40.878343+0000","last_unstale":"2024-09-21T06:35:13.498519+0000","last_undegraded":"2024-09-21T06:35:13.498519+0000","last_fullsized":"2024-09-21T06:35:13.498519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:54.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497230+0000","last_change":"2024-09-21T06:34:42.887868+0000","last_active":"2024-09-21T06:35:13.497230+0000","last_peered":"2024-09-21T06:35:13.497230+0000","last_clean":"2024-09-21T06:35:13.497230+0000","last_became_active":"2024-09-21T06:34:42.887268+0000","last_became_peered":"2024-09-21T06:34:42.887268+0000","last_unstale":"2024-09-21T06:35:13.497230+0000","last_undegraded":"2024-09-21T06:35:13.497230+0000","last_fullsized":"2024-09-21T06:35:13.497230+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:41.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.235006+0000","last_change":"2024-09-21T06:34:40.890363+0000","last_active":"2024-09-21T06:35:13.235006+0000","last_peered":"2024-09-21T06:35:13.235006+0000","last_clean":"2024-09-21T06:35:13.235006+0000","last_became_active":"2024-09-21T06:34:40.889967+0000","last_became_peered":"2024-09-21T06:34:40.889967+0000","last_unstale":"2024-09-21T06:35:13.235006+0000","last_undegraded":"2024-09-21T06:35:13.235006+0000","last_fullsized":"2024-09-21T06:35:13.235006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:01.806399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234793+0000","last_change":"2024-09-21T06:34:42.891211+0000","last_active":"2024-09-21T06:35:13.234793+0000","last_peered":"2024-09-21T06:35:13.234793+0000","last_clean":"2024-09-21T06:35:13.234793+0000","last_became_active":"2024-09-21T06:34:42.890813+0000","last_became_peered":"2024-09-21T06:34:42.890813+0000","last_unstale":"2024-09-21T06:35:13.234793+0000","last_undegraded":"2024-09-21T06:35:13.234793+0000","last_fullsized":"2024-09-21T06:35:13.234793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231483+0000","last_change":"2024-09-21T06:34:40.878074+0000","last_active":"2024-09-21T06:35:13.231483+0000","last_peered":"2024-09-21T06:35:13.231483+0000","last_clean":"2024-09-21T06:35:13.231483+0000","last_became_active":"2024-09-21T06:34:40.877688+0000","last_became_peered":"2024-09-21T06:34:40.877688+0000","last_unstale":"2024-09-21T06:35:13.231483+0000","last_undegraded":"2024-09-21T06:35:13.231483+0000","last_fullsized":"2024-09-21T06:35:13.231483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:01.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69891,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":313,"num_read_kb":222,"num_write":161,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":64752,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":209673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776154,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":831488,"data_stored":409355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939677,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1066726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070499,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":409591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266727,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":409511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430253,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32600,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712552,"statfs":{"total":95995035648,"available":95961653248,"internally_reserved":0,"allocated":1441792,"data_stored":1001441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626482,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":408980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28448,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716704,"statfs":{"total":95995035648,"available":95965904896,"internally_reserved":0,"allocated":1454080,"data_stored":1001125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":475307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":851968,"data_stored":409291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378695,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":410514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":474663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":410251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:35:48.303 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:35:48.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:47 smithi079 ceph-mon[34346]: pgmap v291: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:48.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:47 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:48.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:47 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:48.568 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:48.945 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:48 smithi049 ceph-mon[31177]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:48.946 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:48 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:35:48.946 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:48 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:35:48.946 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:48 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.036+0000 7f55328ea640 1 -- 172.21.15.49:0/1763178446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c102a60 msgr2=0x7f552c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.036+0000 7f55328ea640 1 --2- 172.21.15.49:0/1763178446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c102a60 0x7f552c102e70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f551c009900 tx=0x7f551c02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:49.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.036+0000 7f55328ea640 1 -- 172.21.15.49:0/1763178446 shutdown_connections 2024-09-21T06:35:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.036+0000 7f55328ea640 1 --2- 172.21.15.49:0/1763178446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f552c108cf0 0x7f552c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.036+0000 7f55328ea640 1 --2- 172.21.15.49:0/1763178446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f552c1083a0 0x7f552c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.036+0000 7f55328ea640 1 --2- 172.21.15.49:0/1763178446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c102a60 0x7f552c102e70 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.036+0000 7f55328ea640 1 -- 172.21.15.49:0/1763178446 >> 172.21.15.49:0/1763178446 conn(0x7f552c079730 msgr2=0x7f552c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.036+0000 7f55328ea640 1 -- 172.21.15.49:0/1763178446 shutdown_connections 2024-09-21T06:35:49.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.036+0000 7f55328ea640 1 -- 172.21.15.49:0/1763178446 wait complete. 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.037+0000 7f55328ea640 1 Processor -- start 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.037+0000 7f55328ea640 1 -- start start 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f55328ea640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f552c102a60 0x7f552c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f55328ea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c1083a0 0x7f552c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f55328ea640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f552c108cf0 0x7f552c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f55328ea640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f552c112960 con 0x7f552c1083a0 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f55328ea640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f552c1127e0 con 0x7f552c108cf0 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f55328ea640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f552c112ae0 con 0x7f552c102a60 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f552b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c1083a0 0x7f552c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f552b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c1083a0 0x7f552c19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51528/0 (socket says 172.21.15.49:51528) 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f552b7fe640 1 -- 172.21.15.49:0/522989711 learned_addr learned my addr 172.21.15.49:0/522989711 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:49.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f552bfff640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f552c102a60 0x7f552c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f5530e87640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f552c108cf0 0x7f552c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f552b7fe640 1 -- 172.21.15.49:0/522989711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f552c102a60 msgr2=0x7f552c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f552b7fe640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f552c102a60 0x7f552c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f552b7fe640 1 -- 172.21.15.49:0/522989711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f552c108cf0 msgr2=0x7f552c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f552b7fe640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f552c108cf0 0x7f552c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f552b7fe640 1 -- 172.21.15.49:0/522989711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c1a0330 con 0x7f552c1083a0 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.038+0000 7f5530e87640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f552c108cf0 0x7f552c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.039+0000 7f552b7fe640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c1083a0 0x7f552c19aa20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f552000d770 tx=0x7f552000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.039+0000 7f55297fa640 1 -- 172.21.15.49:0/522989711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5520017070 con 0x7f552c1083a0 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.039+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552c1a0620 con 0x7f552c1083a0 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.039+0000 7f55297fa640 1 -- 172.21.15.49:0/522989711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5520009c30 con 0x7f552c1083a0 2024-09-21T06:35:49.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.039+0000 7f55297fa640 1 -- 172.21.15.49:0/522989711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f552000f620 con 0x7f552c1083a0 2024-09-21T06:35:49.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.039+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552c1a6e40 con 0x7f552c1083a0 2024-09-21T06:35:49.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.040+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f552c102e70 con 0x7f552c1083a0 2024-09-21T06:35:49.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.041+0000 7f55297fa640 1 -- 172.21.15.49:0/522989711 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f552001a070 con 0x7f552c1083a0 2024-09-21T06:35:49.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.042+0000 7f55297fa640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55140b6620 0x7f55140b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:49.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.042+0000 7f552bfff640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55140b6620 0x7f55140b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:49.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.042+0000 7f55297fa640 1 -- 172.21.15.49:0/522989711 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f55200e70c0 con 0x7f552c1083a0 2024-09-21T06:35:49.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.043+0000 7f552bfff640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55140b6620 0x7f55140b8b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f551c031440 tx=0x7f551c009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:49.047 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.045+0000 7f55297fa640 1 -- 172.21.15.49:0/522989711 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f55200ad710 con 0x7f552c1083a0 2024-09-21T06:35:49.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.231+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f552c101170 con 0x7f55140b6620 2024-09-21T06:35:49.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.235+0000 7f55297fa640 1 -- 172.21.15.49:0/522989711 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258683 (secure 0 0 0) 0x7f552c101170 con 0x7f55140b6620 2024-09-21T06:35:49.237 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:49.241 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-09-21T06:35:49.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55140b6620 msgr2=0x7f55140b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55140b6620 0x7f55140b8b30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f551c031440 tx=0x7f551c009560 comp rx=0 tx=0).stop 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c1083a0 msgr2=0x7f552c19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c1083a0 0x7f552c19aa20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f552000d770 tx=0x7f552000dc30 comp rx=0 tx=0).stop 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 shutdown_connections 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55140b6620 0x7f55140b8b30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f552c108cf0 0x7f552c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f552c1083a0 0x7f552c19aa20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 --2- 172.21.15.49:0/522989711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f552c102a60 0x7f552c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 >> 172.21.15.49:0/522989711 conn(0x7f552c079730 msgr2=0x7f552c106740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 shutdown_connections 2024-09-21T06:35:49.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:49.238+0000 7f55328ea640 1 -- 172.21.15.49:0/522989711 wait complete. 2024-09-21T06:35:49.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:48 smithi098 ceph-mon[34704]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:49.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:48 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:35:49.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:48 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:35:49.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:48 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:49.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:48 smithi079 ceph-mon[34346]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:49.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:48 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:35:49.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:48 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:35:49.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:48 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:35:49.881 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-21T06:35:48.121059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660493,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":424,"num_read_kb":306,"num_write":286,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":3016592,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357040,"kb_used_data":11880,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584784,"statfs":{"total":1151940427776,"available":1151574818816,"internally_reserved":0,"allocated":12165120,"data_stored":6886755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003139"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232192+0000","last_change":"2024-09-21T06:34:42.895466+0000","last_active":"2024-09-21T06:35:13.232192+0000","last_peered":"2024-09-21T06:35:13.232192+0000","last_clean":"2024-09-21T06:35:13.232192+0000","last_became_active":"2024-09-21T06:34:42.895084+0000","last_became_peered":"2024-09-21T06:34:42.895084+0000","last_unstale":"2024-09-21T06:35:13.232192+0000","last_undegraded":"2024-09-21T06:35:13.232192+0000","last_fullsized":"2024-09-21T06:35:13.232192+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.513107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497010+0000","last_change":"2024-09-21T06:34:42.888307+0000","last_active":"2024-09-21T06:35:13.497010+0000","last_peered":"2024-09-21T06:35:13.497010+0000","last_clean":"2024-09-21T06:35:13.497010+0000","last_became_active":"2024-09-21T06:34:42.886106+0000","last_became_peered":"2024-09-21T06:34:42.886106+0000","last_unstale":"2024-09-21T06:35:13.497010+0000","last_undegraded":"2024-09-21T06:35:13.497010+0000","last_fullsized":"2024-09-21T06:35:13.497010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:57.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497322+0000","last_change":"2024-09-21T06:34:42.897217+0000","last_active":"2024-09-21T06:35:13.497322+0000","last_peered":"2024-09-21T06:35:13.497322+0000","last_clean":"2024-09-21T06:35:13.497322+0000","last_became_active":"2024-09-21T06:34:42.896849+0000","last_became_peered":"2024-09-21T06:34:42.896849+0000","last_unstale":"2024-09-21T06:35:13.497322+0000","last_undegraded":"2024-09-21T06:35:13.497322+0000","last_fullsized":"2024-09-21T06:35:13.497322+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:28.749566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498837+0000","last_change":"2024-09-21T06:34:42.887236+0000","last_active":"2024-09-21T06:35:13.498837+0000","last_peered":"2024-09-21T06:35:13.498837+0000","last_clean":"2024-09-21T06:35:13.498837+0000","last_became_active":"2024-09-21T06:34:42.886137+0000","last_became_peered":"2024-09-21T06:34:42.886137+0000","last_unstale":"2024-09-21T06:35:13.498837+0000","last_undegraded":"2024-09-21T06:35:13.498837+0000","last_fullsized":"2024-09-21T06:35:13.498837+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:23.728433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498181+0000","last_change":"2024-09-21T06:34:42.885792+0000","last_active":"2024-09-21T06:35:13.498181+0000","last_peered":"2024-09-21T06:35:13.498181+0000","last_clean":"2024-09-21T06:35:13.498181+0000","last_became_active":"2024-09-21T06:34:42.885372+0000","last_became_peered":"2024-09-21T06:34:42.885372+0000","last_unstale":"2024-09-21T06:35:13.498181+0000","last_undegraded":"2024-09-21T06:35:13.498181+0000","last_fullsized":"2024-09-21T06:35:13.498181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:29.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231589+0000","last_change":"2024-09-21T06:34:42.896814+0000","last_active":"2024-09-21T06:35:13.231589+0000","last_peered":"2024-09-21T06:35:13.231589+0000","last_clean":"2024-09-21T06:35:13.231589+0000","last_became_active":"2024-09-21T06:34:42.896147+0000","last_became_peered":"2024-09-21T06:34:42.896147+0000","last_unstale":"2024-09-21T06:35:13.231589+0000","last_undegraded":"2024-09-21T06:35:13.231589+0000","last_fullsized":"2024-09-21T06:35:13.231589+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:49.037539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288675+0000","last_change":"2024-09-21T06:34:42.896264+0000","last_active":"2024-09-21T06:35:13.288675+0000","last_peered":"2024-09-21T06:35:13.288675+0000","last_clean":"2024-09-21T06:35:13.288675+0000","last_became_active":"2024-09-21T06:34:42.895793+0000","last_became_peered":"2024-09-21T06:34:42.895793+0000","last_unstale":"2024-09-21T06:35:13.288675+0000","last_undegraded":"2024-09-21T06:35:13.288675+0000","last_fullsized":"2024-09-21T06:35:13.288675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:06.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234345+0000","last_change":"2024-09-21T06:34:42.892538+0000","last_active":"2024-09-21T06:35:13.234345+0000","last_peered":"2024-09-21T06:35:13.234345+0000","last_clean":"2024-09-21T06:35:13.234345+0000","last_became_active":"2024-09-21T06:34:42.892139+0000","last_became_peered":"2024-09-21T06:34:42.892139+0000","last_unstale":"2024-09-21T06:35:13.234345+0000","last_undegraded":"2024-09-21T06:35:13.234345+0000","last_fullsized":"2024-09-21T06:35:13.234345+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:51.808969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.499901+0000","last_change":"2024-09-21T06:35:13.499797+0000","last_active":"2024-09-21T06:35:13.499901+0000","last_peered":"2024-09-21T06:35:13.499901+0000","last_clean":"2024-09-21T06:35:13.499901+0000","last_became_active":"2024-09-21T06:35:13.499380+0000","last_became_peered":"2024-09-21T06:35:13.499380+0000","last_unstale":"2024-09-21T06:35:13.499901+0000","last_undegraded":"2024-09-21T06:35:13.499901+0000","last_fullsized":"2024-09-21T06:35:13.499901+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:21.809657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11],"acting":[9,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231994+0000","last_change":"2024-09-21T06:34:42.895533+0000","last_active":"2024-09-21T06:35:13.231994+0000","last_peered":"2024-09-21T06:35:13.231994+0000","last_clean":"2024-09-21T06:35:13.231994+0000","last_became_active":"2024-09-21T06:34:42.895162+0000","last_became_peered":"2024-09-21T06:34:42.895162+0000","last_unstale":"2024-09-21T06:35:13.231994+0000","last_undegraded":"2024-09-21T06:35:13.231994+0000","last_fullsized":"2024-09-21T06:35:13.231994+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:25.495493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289315+0000","last_change":"2024-09-21T06:34:42.894173+0000","last_active":"2024-09-21T06:35:13.289315+0000","last_peered":"2024-09-21T06:35:13.289315+0000","last_clean":"2024-09-21T06:35:13.289315+0000","last_became_active":"2024-09-21T06:34:42.893817+0000","last_became_peered":"2024-09-21T06:34:42.893817+0000","last_unstale":"2024-09-21T06:35:13.289315+0000","last_undegraded":"2024-09-21T06:35:13.289315+0000","last_fullsized":"2024-09-21T06:35:13.289315+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:31.580564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498906+0000","last_change":"2024-09-21T06:34:42.886536+0000","last_active":"2024-09-21T06:35:13.498906+0000","last_peered":"2024-09-21T06:35:13.498906+0000","last_clean":"2024-09-21T06:35:13.498906+0000","last_became_active":"2024-09-21T06:34:42.885636+0000","last_became_peered":"2024-09-21T06:34:42.885636+0000","last_unstale":"2024-09-21T06:35:13.498906+0000","last_undegraded":"2024-09-21T06:35:13.498906+0000","last_fullsized":"2024-09-21T06:35:13.498906+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:11.074850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498187+0000","last_change":"2024-09-21T06:34:42.882665+0000","last_active":"2024-09-21T06:35:13.498187+0000","last_peered":"2024-09-21T06:35:13.498187+0000","last_clean":"2024-09-21T06:35:13.498187+0000","last_became_active":"2024-09-21T06:34:42.882254+0000","last_became_peered":"2024-09-21T06:34:42.882254+0000","last_unstale":"2024-09-21T06:35:13.498187+0000","last_undegraded":"2024-09-21T06:35:13.498187+0000","last_fullsized":"2024-09-21T06:35:13.498187+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:01.203542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.496843+0000","last_change":"2024-09-21T06:34:42.884034+0000","last_active":"2024-09-21T06:35:13.496843+0000","last_peered":"2024-09-21T06:35:13.496843+0000","last_clean":"2024-09-21T06:35:13.496843+0000","last_became_active":"2024-09-21T06:34:42.883685+0000","last_became_peered":"2024-09-21T06:34:42.883685+0000","last_unstale":"2024-09-21T06:35:13.496843+0000","last_undegraded":"2024-09-21T06:35:13.496843+0000","last_fullsized":"2024-09-21T06:35:13.496843+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:00.124019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.496838+0000","last_change":"2024-09-21T06:34:42.894686+0000","last_active":"2024-09-21T06:35:13.496838+0000","last_peered":"2024-09-21T06:35:13.496838+0000","last_clean":"2024-09-21T06:35:13.496838+0000","last_became_active":"2024-09-21T06:34:42.893980+0000","last_became_peered":"2024-09-21T06:34:42.893980+0000","last_unstale":"2024-09-21T06:35:13.496838+0000","last_undegraded":"2024-09-21T06:35:13.496838+0000","last_fullsized":"2024-09-21T06:35:13.496838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:00.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233970+0000","last_change":"2024-09-21T06:34:42.891462+0000","last_active":"2024-09-21T06:35:13.233970+0000","last_peered":"2024-09-21T06:35:13.233970+0000","last_clean":"2024-09-21T06:35:13.233970+0000","last_became_active":"2024-09-21T06:34:42.891085+0000","last_became_peered":"2024-09-21T06:34:42.891085+0000","last_unstale":"2024-09-21T06:35:13.233970+0000","last_undegraded":"2024-09-21T06:35:13.233970+0000","last_fullsized":"2024-09-21T06:35:13.233970+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:03.942909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232313+0000","last_change":"2024-09-21T06:34:42.897049+0000","last_active":"2024-09-21T06:35:13.232313+0000","last_peered":"2024-09-21T06:35:13.232313+0000","last_clean":"2024-09-21T06:35:13.232313+0000","last_became_active":"2024-09-21T06:34:42.896131+0000","last_became_peered":"2024-09-21T06:34:42.896131+0000","last_unstale":"2024-09-21T06:35:13.232313+0000","last_undegraded":"2024-09-21T06:35:13.232313+0000","last_fullsized":"2024-09-21T06:35:13.232313+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:47.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.230971+0000","last_change":"2024-09-21T06:34:42.887894+0000","last_active":"2024-09-21T06:35:13.230971+0000","last_peered":"2024-09-21T06:35:13.230971+0000","last_clean":"2024-09-21T06:35:13.230971+0000","last_became_active":"2024-09-21T06:34:42.887436+0000","last_became_peered":"2024-09-21T06:34:42.887436+0000","last_unstale":"2024-09-21T06:35:13.230971+0000","last_undegraded":"2024-09-21T06:35:13.230971+0000","last_fullsized":"2024-09-21T06:35:13.230971+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:22.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.236161+0000","last_change":"2024-09-21T06:34:42.888071+0000","last_active":"2024-09-21T06:35:13.236161+0000","last_peered":"2024-09-21T06:35:13.236161+0000","last_clean":"2024-09-21T06:35:13.236161+0000","last_became_active":"2024-09-21T06:34:42.887295+0000","last_became_peered":"2024-09-21T06:34:42.887295+0000","last_unstale":"2024-09-21T06:35:13.236161+0000","last_undegraded":"2024-09-21T06:35:13.236161+0000","last_fullsized":"2024-09-21T06:35:13.236161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:49.937367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232048+0000","last_change":"2024-09-21T06:34:42.891963+0000","last_active":"2024-09-21T06:35:13.232048+0000","last_peered":"2024-09-21T06:35:13.232048+0000","last_clean":"2024-09-21T06:35:13.232048+0000","last_became_active":"2024-09-21T06:34:42.891603+0000","last_became_peered":"2024-09-21T06:34:42.891603+0000","last_unstale":"2024-09-21T06:35:13.232048+0000","last_undegraded":"2024-09-21T06:35:13.232048+0000","last_fullsized":"2024-09-21T06:35:13.232048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:47.608523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498262+0000","last_change":"2024-09-21T06:34:42.895909+0000","last_active":"2024-09-21T06:35:13.498262+0000","last_peered":"2024-09-21T06:35:13.498262+0000","last_clean":"2024-09-21T06:35:13.498262+0000","last_became_active":"2024-09-21T06:34:42.895477+0000","last_became_peered":"2024-09-21T06:34:42.895477+0000","last_unstale":"2024-09-21T06:35:13.498262+0000","last_undegraded":"2024-09-21T06:35:13.498262+0000","last_fullsized":"2024-09-21T06:35:13.498262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.284523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234197+0000","last_change":"2024-09-21T06:34:42.893554+0000","last_active":"2024-09-21T06:35:13.234197+0000","last_peered":"2024-09-21T06:35:13.234197+0000","last_clean":"2024-09-21T06:35:13.234197+0000","last_became_active":"2024-09-21T06:34:42.892949+0000","last_became_peered":"2024-09-21T06:34:42.892949+0000","last_unstale":"2024-09-21T06:35:13.234197+0000","last_undegraded":"2024-09-21T06:35:13.234197+0000","last_fullsized":"2024-09-21T06:35:13.234197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:57.107590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234415+0000","last_change":"2024-09-21T06:34:42.894574+0000","last_active":"2024-09-21T06:35:13.234415+0000","last_peered":"2024-09-21T06:35:13.234415+0000","last_clean":"2024-09-21T06:35:13.234415+0000","last_became_active":"2024-09-21T06:34:42.894027+0000","last_became_peered":"2024-09-21T06:34:42.894027+0000","last_unstale":"2024-09-21T06:35:13.234415+0000","last_undegraded":"2024-09-21T06:35:13.234415+0000","last_fullsized":"2024-09-21T06:35:13.234415+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:58.425792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.499832+0000","last_change":"2024-09-21T06:35:13.499715+0000","last_active":"2024-09-21T06:35:13.499832+0000","last_peered":"2024-09-21T06:35:13.499832+0000","last_clean":"2024-09-21T06:35:13.499832+0000","last_became_active":"2024-09-21T06:35:13.499171+0000","last_became_peered":"2024-09-21T06:35:13.499171+0000","last_unstale":"2024-09-21T06:35:13.499832+0000","last_undegraded":"2024-09-21T06:35:13.499832+0000","last_fullsized":"2024-09-21T06:35:13.499832+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:35.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.499580+0000","last_change":"2024-09-21T06:35:13.499458+0000","last_active":"2024-09-21T06:35:13.499580+0000","last_peered":"2024-09-21T06:35:13.499580+0000","last_clean":"2024-09-21T06:35:13.499580+0000","last_became_active":"2024-09-21T06:35:13.498984+0000","last_became_peered":"2024-09-21T06:35:13.498984+0000","last_unstale":"2024-09-21T06:35:13.499580+0000","last_undegraded":"2024-09-21T06:35:13.499580+0000","last_fullsized":"2024-09-21T06:35:13.499580+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:10.871658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.236419+0000","last_change":"2024-09-21T06:34:42.888826+0000","last_active":"2024-09-21T06:35:13.236419+0000","last_peered":"2024-09-21T06:35:13.236419+0000","last_clean":"2024-09-21T06:35:13.236419+0000","last_became_active":"2024-09-21T06:34:42.888447+0000","last_became_peered":"2024-09-21T06:34:42.888447+0000","last_unstale":"2024-09-21T06:35:13.236419+0000","last_undegraded":"2024-09-21T06:35:13.236419+0000","last_fullsized":"2024-09-21T06:35:13.236419+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:52.634516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232176+0000","last_change":"2024-09-21T06:34:42.889377+0000","last_active":"2024-09-21T06:35:13.232176+0000","last_peered":"2024-09-21T06:35:13.232176+0000","last_clean":"2024-09-21T06:35:13.232176+0000","last_became_active":"2024-09-21T06:34:42.888978+0000","last_became_peered":"2024-09-21T06:34:42.888978+0000","last_unstale":"2024-09-21T06:35:13.232176+0000","last_undegraded":"2024-09-21T06:35:13.232176+0000","last_fullsized":"2024-09-21T06:35:13.232176+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:34.734283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498353+0000","last_change":"2024-09-21T06:34:42.878128+0000","last_active":"2024-09-21T06:35:13.498353+0000","last_peered":"2024-09-21T06:35:13.498353+0000","last_clean":"2024-09-21T06:35:13.498353+0000","last_became_active":"2024-09-21T06:34:42.877742+0000","last_became_peered":"2024-09-21T06:34:42.877742+0000","last_unstale":"2024-09-21T06:35:13.498353+0000","last_undegraded":"2024-09-21T06:35:13.498353+0000","last_fullsized":"2024-09-21T06:35:13.498353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:04.992402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497138+0000","last_change":"2024-09-21T06:34:42.882659+0000","last_active":"2024-09-21T06:35:13.497138+0000","last_peered":"2024-09-21T06:35:13.497138+0000","last_clean":"2024-09-21T06:35:13.497138+0000","last_became_active":"2024-09-21T06:34:42.882306+0000","last_became_peered":"2024-09-21T06:34:42.882306+0000","last_unstale":"2024-09-21T06:35:13.497138+0000","last_undegraded":"2024-09-21T06:35:13.497138+0000","last_fullsized":"2024-09-21T06:35:13.497138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:31.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.235558+0000","last_change":"2024-09-21T06:34:42.890089+0000","last_active":"2024-09-21T06:35:13.235558+0000","last_peered":"2024-09-21T06:35:13.235558+0000","last_clean":"2024-09-21T06:35:13.235558+0000","last_became_active":"2024-09-21T06:34:42.889739+0000","last_became_peered":"2024-09-21T06:34:42.889739+0000","last_unstale":"2024-09-21T06:35:13.235558+0000","last_undegraded":"2024-09-21T06:35:13.235558+0000","last_fullsized":"2024-09-21T06:35:13.235558+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.212760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.290729+0000","last_change":"2024-09-21T06:35:13.290617+0000","last_active":"2024-09-21T06:35:13.290729+0000","last_peered":"2024-09-21T06:35:13.290729+0000","last_clean":"2024-09-21T06:35:13.290729+0000","last_became_active":"2024-09-21T06:35:13.290005+0000","last_became_peered":"2024-09-21T06:35:13.290005+0000","last_unstale":"2024-09-21T06:35:13.290729+0000","last_undegraded":"2024-09-21T06:35:13.290729+0000","last_fullsized":"2024-09-21T06:35:13.290729+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:39.490034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231667+0000","last_change":"2024-09-21T06:34:42.893859+0000","last_active":"2024-09-21T06:35:13.231667+0000","last_peered":"2024-09-21T06:35:13.231667+0000","last_clean":"2024-09-21T06:35:13.231667+0000","last_became_active":"2024-09-21T06:34:42.893485+0000","last_became_peered":"2024-09-21T06:34:42.893485+0000","last_unstale":"2024-09-21T06:35:13.231667+0000","last_undegraded":"2024-09-21T06:35:13.231667+0000","last_fullsized":"2024-09-21T06:35:13.231667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:59.936750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497987+0000","last_change":"2024-09-21T06:34:42.887164+0000","last_active":"2024-09-21T06:35:13.497987+0000","last_peered":"2024-09-21T06:35:13.497987+0000","last_clean":"2024-09-21T06:35:13.497987+0000","last_became_active":"2024-09-21T06:34:42.886314+0000","last_became_peered":"2024-09-21T06:34:42.886314+0000","last_unstale":"2024-09-21T06:35:13.497987+0000","last_undegraded":"2024-09-21T06:35:13.497987+0000","last_fullsized":"2024-09-21T06:35:13.497987+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:09.529922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"74'6","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:46.053198+0000","last_change":"2024-09-21T06:34:40.883170+0000","last_active":"2024-09-21T06:35:46.053198+0000","last_peered":"2024-09-21T06:35:46.053198+0000","last_clean":"2024-09-21T06:35:46.053198+0000","last_became_active":"2024-09-21T06:34:40.882760+0000","last_became_peered":"2024-09-21T06:34:40.882760+0000","last_unstale":"2024-09-21T06:35:46.053198+0000","last_undegraded":"2024-09-21T06:35:46.053198+0000","last_fullsized":"2024-09-21T06:35:46.053198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:41.388275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233824+0000","last_change":"2024-09-21T06:34:42.893842+0000","last_active":"2024-09-21T06:35:13.233824+0000","last_peered":"2024-09-21T06:35:13.233824+0000","last_clean":"2024-09-21T06:35:13.233824+0000","last_became_active":"2024-09-21T06:34:42.893501+0000","last_became_peered":"2024-09-21T06:34:42.893501+0000","last_unstale":"2024-09-21T06:35:13.233824+0000","last_undegraded":"2024-09-21T06:35:13.233824+0000","last_fullsized":"2024-09-21T06:35:13.233824+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.610084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.232236+0000","last_change":"2024-09-21T06:34:40.878685+0000","last_active":"2024-09-21T06:35:13.232236+0000","last_peered":"2024-09-21T06:35:13.232236+0000","last_clean":"2024-09-21T06:35:13.232236+0000","last_became_active":"2024-09-21T06:34:40.878279+0000","last_became_peered":"2024-09-21T06:34:40.878279+0000","last_unstale":"2024-09-21T06:35:13.232236+0000","last_undegraded":"2024-09-21T06:35:13.232236+0000","last_fullsized":"2024-09-21T06:35:13.232236+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:11.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498113+0000","last_change":"2024-09-21T06:34:40.872074+0000","last_active":"2024-09-21T06:35:13.498113+0000","last_peered":"2024-09-21T06:35:13.498113+0000","last_clean":"2024-09-21T06:35:13.498113+0000","last_became_active":"2024-09-21T06:34:40.871637+0000","last_became_peered":"2024-09-21T06:34:40.871637+0000","last_unstale":"2024-09-21T06:35:13.498113+0000","last_undegraded":"2024-09-21T06:35:13.498113+0000","last_fullsized":"2024-09-21T06:35:13.498113+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234507+0000","last_change":"2024-09-21T06:34:42.882803+0000","last_active":"2024-09-21T06:35:13.234507+0000","last_peered":"2024-09-21T06:35:13.234507+0000","last_clean":"2024-09-21T06:35:13.234507+0000","last_became_active":"2024-09-21T06:34:42.881509+0000","last_became_peered":"2024-09-21T06:34:42.881509+0000","last_unstale":"2024-09-21T06:35:13.234507+0000","last_undegraded":"2024-09-21T06:35:13.234507+0000","last_fullsized":"2024-09-21T06:35:13.234507+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233917+0000","last_change":"2024-09-21T06:34:40.883054+0000","last_active":"2024-09-21T06:35:13.233917+0000","last_peered":"2024-09-21T06:35:13.233917+0000","last_clean":"2024-09-21T06:35:13.233917+0000","last_became_active":"2024-09-21T06:34:40.882299+0000","last_became_peered":"2024-09-21T06:34:40.882299+0000","last_unstale":"2024-09-21T06:35:13.233917+0000","last_undegraded":"2024-09-21T06:35:13.233917+0000","last_fullsized":"2024-09-21T06:35:13.233917+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:17.813744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.230626+0000","last_change":"2024-09-21T06:34:42.886437+0000","last_active":"2024-09-21T06:35:13.230626+0000","last_peered":"2024-09-21T06:35:13.230626+0000","last_clean":"2024-09-21T06:35:13.230626+0000","last_became_active":"2024-09-21T06:34:42.886075+0000","last_became_peered":"2024-09-21T06:34:42.886075+0000","last_unstale":"2024-09-21T06:35:13.230626+0000","last_undegraded":"2024-09-21T06:35:13.230626+0000","last_fullsized":"2024-09-21T06:35:13.230626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.179323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"74'3","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:45.050614+0000","last_change":"2024-09-21T06:34:40.880931+0000","last_active":"2024-09-21T06:35:45.050614+0000","last_peered":"2024-09-21T06:35:45.050614+0000","last_clean":"2024-09-21T06:35:45.050614+0000","last_became_active":"2024-09-21T06:34:40.880555+0000","last_became_peered":"2024-09-21T06:34:40.880555+0000","last_unstale":"2024-09-21T06:35:45.050614+0000","last_undegraded":"2024-09-21T06:35:45.050614+0000","last_fullsized":"2024-09-21T06:35:45.050614+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:29.304297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234518+0000","last_change":"2024-09-21T06:34:42.899618+0000","last_active":"2024-09-21T06:35:13.234518+0000","last_peered":"2024-09-21T06:35:13.234518+0000","last_clean":"2024-09-21T06:35:13.234518+0000","last_became_active":"2024-09-21T06:34:42.899230+0000","last_became_peered":"2024-09-21T06:34:42.899230+0000","last_unstale":"2024-09-21T06:35:13.234518+0000","last_undegraded":"2024-09-21T06:35:13.234518+0000","last_fullsized":"2024-09-21T06:35:13.234518+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:27.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289319+0000","last_change":"2024-09-21T06:34:40.882988+0000","last_active":"2024-09-21T06:35:13.289319+0000","last_peered":"2024-09-21T06:35:13.289319+0000","last_clean":"2024-09-21T06:35:13.289319+0000","last_became_active":"2024-09-21T06:34:40.882533+0000","last_became_peered":"2024-09-21T06:34:40.882533+0000","last_unstale":"2024-09-21T06:35:13.289319+0000","last_undegraded":"2024-09-21T06:35:13.289319+0000","last_fullsized":"2024-09-21T06:35:13.289319+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:23.220540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497233+0000","last_change":"2024-09-21T06:34:42.889556+0000","last_active":"2024-09-21T06:35:13.497233+0000","last_peered":"2024-09-21T06:35:13.497233+0000","last_clean":"2024-09-21T06:35:13.497233+0000","last_became_active":"2024-09-21T06:34:42.888853+0000","last_became_peered":"2024-09-21T06:34:42.888853+0000","last_unstale":"2024-09-21T06:35:13.497233+0000","last_undegraded":"2024-09-21T06:35:13.497233+0000","last_fullsized":"2024-09-21T06:35:13.497233+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:24.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234209+0000","last_change":"2024-09-21T06:34:40.891450+0000","last_active":"2024-09-21T06:35:13.234209+0000","last_peered":"2024-09-21T06:35:13.234209+0000","last_clean":"2024-09-21T06:35:13.234209+0000","last_became_active":"2024-09-21T06:34:40.890892+0000","last_became_peered":"2024-09-21T06:34:40.890892+0000","last_unstale":"2024-09-21T06:35:13.234209+0000","last_undegraded":"2024-09-21T06:35:13.234209+0000","last_fullsized":"2024-09-21T06:35:13.234209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.975342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234403+0000","last_change":"2024-09-21T06:34:42.893122+0000","last_active":"2024-09-21T06:35:13.234403+0000","last_peered":"2024-09-21T06:35:13.234403+0000","last_clean":"2024-09-21T06:35:13.234403+0000","last_became_active":"2024-09-21T06:34:42.892730+0000","last_became_peered":"2024-09-21T06:34:42.892730+0000","last_unstale":"2024-09-21T06:35:13.234403+0000","last_undegraded":"2024-09-21T06:35:13.234403+0000","last_fullsized":"2024-09-21T06:35:13.234403+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:06.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'28","reported_seq":184,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:45.561359+0000","last_change":"2024-09-21T06:35:13.509359+0000","last_active":"2024-09-21T06:35:45.561359+0000","last_peered":"2024-09-21T06:35:45.561359+0000","last_clean":"2024-09-21T06:35:45.561359+0000","last_became_active":"2024-09-21T06:35:13.499621+0000","last_became_peered":"2024-09-21T06:35:13.499621+0000","last_unstale":"2024-09-21T06:35:45.561359+0000","last_undegraded":"2024-09-21T06:35:45.561359+0000","last_fullsized":"2024-09-21T06:35:45.561359+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:52.396964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65890,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":108,"num_write":29,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":64752,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498425+0000","last_change":"2024-09-21T06:34:42.890487+0000","last_active":"2024-09-21T06:35:13.498425+0000","last_peered":"2024-09-21T06:35:13.498425+0000","last_clean":"2024-09-21T06:35:13.498425+0000","last_became_active":"2024-09-21T06:34:42.890100+0000","last_became_peered":"2024-09-21T06:34:42.890100+0000","last_unstale":"2024-09-21T06:35:13.498425+0000","last_undegraded":"2024-09-21T06:35:13.498425+0000","last_fullsized":"2024-09-21T06:35:13.498425+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.206869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.236142+0000","last_change":"2024-09-21T06:34:40.876187+0000","last_active":"2024-09-21T06:35:13.236142+0000","last_peered":"2024-09-21T06:35:13.236142+0000","last_clean":"2024-09-21T06:35:13.236142+0000","last_became_active":"2024-09-21T06:34:40.875687+0000","last_became_peered":"2024-09-21T06:34:40.875687+0000","last_unstale":"2024-09-21T06:35:13.236142+0000","last_undegraded":"2024-09-21T06:35:13.236142+0000","last_fullsized":"2024-09-21T06:35:13.236142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:51.758625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498115+0000","last_change":"2024-09-21T06:34:42.895900+0000","last_active":"2024-09-21T06:35:13.498115+0000","last_peered":"2024-09-21T06:35:13.498115+0000","last_clean":"2024-09-21T06:35:13.498115+0000","last_became_active":"2024-09-21T06:34:42.895504+0000","last_became_peered":"2024-09-21T06:34:42.895504+0000","last_unstale":"2024-09-21T06:35:13.498115+0000","last_undegraded":"2024-09-21T06:35:13.498115+0000","last_fullsized":"2024-09-21T06:35:13.498115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:28.414017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233328+0000","last_change":"2024-09-21T06:34:40.882856+0000","last_active":"2024-09-21T06:35:13.233328+0000","last_peered":"2024-09-21T06:35:13.233328+0000","last_clean":"2024-09-21T06:35:13.233328+0000","last_became_active":"2024-09-21T06:34:40.882424+0000","last_became_peered":"2024-09-21T06:34:40.882424+0000","last_unstale":"2024-09-21T06:35:13.233328+0000","last_undegraded":"2024-09-21T06:35:13.233328+0000","last_fullsized":"2024-09-21T06:35:13.233328+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:38.815928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288742+0000","last_change":"2024-09-21T06:34:42.890611+0000","last_active":"2024-09-21T06:35:13.288742+0000","last_peered":"2024-09-21T06:35:13.288742+0000","last_clean":"2024-09-21T06:35:13.288742+0000","last_became_active":"2024-09-21T06:34:42.890246+0000","last_became_peered":"2024-09-21T06:34:42.890246+0000","last_unstale":"2024-09-21T06:35:13.288742+0000","last_undegraded":"2024-09-21T06:35:13.288742+0000","last_fullsized":"2024-09-21T06:35:13.288742+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:05.074903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:45.050818+0000","last_change":"2024-09-21T06:34:40.877003+0000","last_active":"2024-09-21T06:35:45.050818+0000","last_peered":"2024-09-21T06:35:45.050818+0000","last_clean":"2024-09-21T06:35:45.050818+0000","last_became_active":"2024-09-21T06:34:40.876516+0000","last_became_peered":"2024-09-21T06:34:40.876516+0000","last_unstale":"2024-09-21T06:35:45.050818+0000","last_undegraded":"2024-09-21T06:35:45.050818+0000","last_fullsized":"2024-09-21T06:35:45.050818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:14.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288432+0000","last_change":"2024-09-21T06:34:42.896816+0000","last_active":"2024-09-21T06:35:13.288432+0000","last_peered":"2024-09-21T06:35:13.288432+0000","last_clean":"2024-09-21T06:35:13.288432+0000","last_became_active":"2024-09-21T06:34:42.896329+0000","last_became_peered":"2024-09-21T06:34:42.896329+0000","last_unstale":"2024-09-21T06:35:13.288432+0000","last_undegraded":"2024-09-21T06:35:13.288432+0000","last_fullsized":"2024-09-21T06:35:13.288432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.462498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497893+0000","last_change":"2024-09-21T06:34:40.892809+0000","last_active":"2024-09-21T06:35:13.497893+0000","last_peered":"2024-09-21T06:35:13.497893+0000","last_clean":"2024-09-21T06:35:13.497893+0000","last_became_active":"2024-09-21T06:34:40.892433+0000","last_became_peered":"2024-09-21T06:34:40.892433+0000","last_unstale":"2024-09-21T06:35:13.497893+0000","last_undegraded":"2024-09-21T06:35:13.497893+0000","last_fullsized":"2024-09-21T06:35:13.497893+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:43.744202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.500652+0000","last_change":"2024-09-21T06:35:13.500503+0000","last_active":"2024-09-21T06:35:13.500652+0000","last_peered":"2024-09-21T06:35:13.500652+0000","last_clean":"2024-09-21T06:35:13.500652+0000","last_became_active":"2024-09-21T06:35:13.499704+0000","last_became_peered":"2024-09-21T06:35:13.499704+0000","last_unstale":"2024-09-21T06:35:13.500652+0000","last_undegraded":"2024-09-21T06:35:13.500652+0000","last_fullsized":"2024-09-21T06:35:13.500652+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:45.469909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498658+0000","last_change":"2024-09-21T06:34:40.876791+0000","last_active":"2024-09-21T06:35:13.498658+0000","last_peered":"2024-09-21T06:35:13.498658+0000","last_clean":"2024-09-21T06:35:13.498658+0000","last_became_active":"2024-09-21T06:34:40.876323+0000","last_became_peered":"2024-09-21T06:34:40.876323+0000","last_unstale":"2024-09-21T06:35:13.498658+0000","last_undegraded":"2024-09-21T06:35:13.498658+0000","last_fullsized":"2024-09-21T06:35:13.498658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:20.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.499366+0000","last_change":"2024-09-21T06:35:13.499258+0000","last_active":"2024-09-21T06:35:13.499366+0000","last_peered":"2024-09-21T06:35:13.499366+0000","last_clean":"2024-09-21T06:35:13.499366+0000","last_became_active":"2024-09-21T06:35:13.498747+0000","last_became_peered":"2024-09-21T06:35:13.498747+0000","last_unstale":"2024-09-21T06:35:13.499366+0000","last_undegraded":"2024-09-21T06:35:13.499366+0000","last_fullsized":"2024-09-21T06:35:13.499366+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:23.977754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498517+0000","last_change":"2024-09-21T06:34:40.877644+0000","last_active":"2024-09-21T06:35:13.498517+0000","last_peered":"2024-09-21T06:35:13.498517+0000","last_clean":"2024-09-21T06:35:13.498517+0000","last_became_active":"2024-09-21T06:34:40.877238+0000","last_became_peered":"2024-09-21T06:34:40.877238+0000","last_unstale":"2024-09-21T06:35:13.498517+0000","last_undegraded":"2024-09-21T06:35:13.498517+0000","last_fullsized":"2024-09-21T06:35:13.498517+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:21.055801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289360+0000","last_change":"2024-09-21T06:34:42.892399+0000","last_active":"2024-09-21T06:35:13.289360+0000","last_peered":"2024-09-21T06:35:13.289360+0000","last_clean":"2024-09-21T06:35:13.289360+0000","last_became_active":"2024-09-21T06:34:42.891873+0000","last_became_peered":"2024-09-21T06:34:42.891873+0000","last_unstale":"2024-09-21T06:35:13.289360+0000","last_undegraded":"2024-09-21T06:35:13.289360+0000","last_fullsized":"2024-09-21T06:35:13.289360+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:09.684516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234408+0000","last_change":"2024-09-21T06:34:40.881603+0000","last_active":"2024-09-21T06:35:13.234408+0000","last_peered":"2024-09-21T06:35:13.234408+0000","last_clean":"2024-09-21T06:35:13.234408+0000","last_became_active":"2024-09-21T06:34:40.881226+0000","last_became_peered":"2024-09-21T06:34:40.881226+0000","last_unstale":"2024-09-21T06:35:13.234408+0000","last_undegraded":"2024-09-21T06:35:13.234408+0000","last_fullsized":"2024-09-21T06:35:13.234408+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:09.252102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289062+0000","last_change":"2024-09-21T06:34:42.897354+0000","last_active":"2024-09-21T06:35:13.289062+0000","last_peered":"2024-09-21T06:35:13.289062+0000","last_clean":"2024-09-21T06:35:13.289062+0000","last_became_active":"2024-09-21T06:34:42.896981+0000","last_became_peered":"2024-09-21T06:34:42.896981+0000","last_unstale":"2024-09-21T06:35:13.289062+0000","last_undegraded":"2024-09-21T06:35:13.289062+0000","last_fullsized":"2024-09-21T06:35:13.289062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:07.598107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.236419+0000","last_change":"2024-09-21T06:34:40.890831+0000","last_active":"2024-09-21T06:35:13.236419+0000","last_peered":"2024-09-21T06:35:13.236419+0000","last_clean":"2024-09-21T06:35:13.236419+0000","last_became_active":"2024-09-21T06:34:40.890420+0000","last_became_peered":"2024-09-21T06:34:40.890420+0000","last_unstale":"2024-09-21T06:35:13.236419+0000","last_undegraded":"2024-09-21T06:35:13.236419+0000","last_fullsized":"2024-09-21T06:35:13.236419+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:17:17.822323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289284+0000","last_change":"2024-09-21T06:34:42.894825+0000","last_active":"2024-09-21T06:35:13.289284+0000","last_peered":"2024-09-21T06:35:13.289284+0000","last_clean":"2024-09-21T06:35:13.289284+0000","last_became_active":"2024-09-21T06:34:42.893347+0000","last_became_peered":"2024-09-21T06:34:42.893347+0000","last_unstale":"2024-09-21T06:35:13.289284+0000","last_undegraded":"2024-09-21T06:35:13.289284+0000","last_fullsized":"2024-09-21T06:35:13.289284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:14.946035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288659+0000","last_change":"2024-09-21T06:33:33.165773+0000","last_active":"2024-09-21T06:35:13.288659+0000","last_peered":"2024-09-21T06:35:13.288659+0000","last_clean":"2024-09-21T06:35:13.288659+0000","last_became_active":"2024-09-21T06:33:33.159754+0000","last_became_peered":"2024-09-21T06:33:33.159754+0000","last_unstale":"2024-09-21T06:35:13.288659+0000","last_undegraded":"2024-09-21T06:35:13.288659+0000","last_fullsized":"2024-09-21T06:35:13.288659+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_clean_scrub_stamp":"2024-09-21T06:30:10.865158+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:15.953330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498235+0000","last_change":"2024-09-21T06:34:40.876091+0000","last_active":"2024-09-21T06:35:13.498235+0000","last_peered":"2024-09-21T06:35:13.498235+0000","last_clean":"2024-09-21T06:35:13.498235+0000","last_became_active":"2024-09-21T06:34:40.875576+0000","last_became_peered":"2024-09-21T06:34:40.875576+0000","last_unstale":"2024-09-21T06:35:13.498235+0000","last_undegraded":"2024-09-21T06:35:13.498235+0000","last_fullsized":"2024-09-21T06:35:13.498235+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:34.392145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234623+0000","last_change":"2024-09-21T06:34:42.892283+0000","last_active":"2024-09-21T06:35:13.234623+0000","last_peered":"2024-09-21T06:35:13.234623+0000","last_clean":"2024-09-21T06:35:13.234623+0000","last_became_active":"2024-09-21T06:34:42.891839+0000","last_became_peered":"2024-09-21T06:34:42.891839+0000","last_unstale":"2024-09-21T06:35:13.234623+0000","last_undegraded":"2024-09-21T06:35:13.234623+0000","last_fullsized":"2024-09-21T06:35:13.234623+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:10.202352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288727+0000","last_change":"2024-09-21T06:34:40.880967+0000","last_active":"2024-09-21T06:35:13.288727+0000","last_peered":"2024-09-21T06:35:13.288727+0000","last_clean":"2024-09-21T06:35:13.288727+0000","last_became_active":"2024-09-21T06:34:40.880351+0000","last_became_peered":"2024-09-21T06:34:40.880351+0000","last_unstale":"2024-09-21T06:35:13.288727+0000","last_undegraded":"2024-09-21T06:35:13.288727+0000","last_fullsized":"2024-09-21T06:35:13.288727+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:52.694732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497967+0000","last_change":"2024-09-21T06:34:42.876102+0000","last_active":"2024-09-21T06:35:13.497967+0000","last_peered":"2024-09-21T06:35:13.497967+0000","last_clean":"2024-09-21T06:35:13.497967+0000","last_became_active":"2024-09-21T06:34:42.875065+0000","last_became_peered":"2024-09-21T06:34:42.875065+0000","last_unstale":"2024-09-21T06:35:13.497967+0000","last_undegraded":"2024-09-21T06:35:13.497967+0000","last_fullsized":"2024-09-21T06:35:13.497967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:23.867180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:47.053103+0000","last_change":"2024-09-21T06:34:40.890355+0000","last_active":"2024-09-21T06:35:47.053103+0000","last_peered":"2024-09-21T06:35:47.053103+0000","last_clean":"2024-09-21T06:35:47.053103+0000","last_became_active":"2024-09-21T06:34:40.889974+0000","last_became_peered":"2024-09-21T06:34:40.889974+0000","last_unstale":"2024-09-21T06:35:47.053103+0000","last_undegraded":"2024-09-21T06:35:47.053103+0000","last_fullsized":"2024-09-21T06:35:47.053103+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:58.349625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.233638+0000","last_change":"2024-09-21T06:34:42.899831+0000","last_active":"2024-09-21T06:35:13.233638+0000","last_peered":"2024-09-21T06:35:13.233638+0000","last_clean":"2024-09-21T06:35:13.233638+0000","last_became_active":"2024-09-21T06:34:42.899372+0000","last_became_peered":"2024-09-21T06:34:42.899372+0000","last_unstale":"2024-09-21T06:35:13.233638+0000","last_undegraded":"2024-09-21T06:35:13.233638+0000","last_fullsized":"2024-09-21T06:35:13.233638+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:50.165222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288940+0000","last_change":"2024-09-21T06:34:40.882380+0000","last_active":"2024-09-21T06:35:13.288940+0000","last_peered":"2024-09-21T06:35:13.288940+0000","last_clean":"2024-09-21T06:35:13.288940+0000","last_became_active":"2024-09-21T06:34:40.881463+0000","last_became_peered":"2024-09-21T06:34:40.881463+0000","last_unstale":"2024-09-21T06:35:13.288940+0000","last_undegraded":"2024-09-21T06:35:13.288940+0000","last_fullsized":"2024-09-21T06:35:13.288940+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:25.620174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231661+0000","last_change":"2024-09-21T06:34:42.897205+0000","last_active":"2024-09-21T06:35:13.231661+0000","last_peered":"2024-09-21T06:35:13.231661+0000","last_clean":"2024-09-21T06:35:13.231661+0000","last_became_active":"2024-09-21T06:34:42.896705+0000","last_became_peered":"2024-09-21T06:34:42.896705+0000","last_unstale":"2024-09-21T06:35:13.231661+0000","last_undegraded":"2024-09-21T06:35:13.231661+0000","last_fullsized":"2024-09-21T06:35:13.231661+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.333176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.230820+0000","last_change":"2024-09-21T06:34:40.890356+0000","last_active":"2024-09-21T06:35:13.230820+0000","last_peered":"2024-09-21T06:35:13.230820+0000","last_clean":"2024-09-21T06:35:13.230820+0000","last_became_active":"2024-09-21T06:34:40.889963+0000","last_became_peered":"2024-09-21T06:34:40.889963+0000","last_unstale":"2024-09-21T06:35:13.230820+0000","last_undegraded":"2024-09-21T06:35:13.230820+0000","last_fullsized":"2024-09-21T06:35:13.230820+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:09.621779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"74'1","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231671+0000","last_change":"2024-09-21T06:34:42.884933+0000","last_active":"2024-09-21T06:35:13.231671+0000","last_peered":"2024-09-21T06:35:13.231671+0000","last_clean":"2024-09-21T06:35:13.231671+0000","last_became_active":"2024-09-21T06:34:42.884506+0000","last_became_peered":"2024-09-21T06:34:42.884506+0000","last_unstale":"2024-09-21T06:35:13.231671+0000","last_undegraded":"2024-09-21T06:35:13.231671+0000","last_fullsized":"2024-09-21T06:35:13.231671+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:14.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498566+0000","last_change":"2024-09-21T06:34:40.891408+0000","last_active":"2024-09-21T06:35:13.498566+0000","last_peered":"2024-09-21T06:35:13.498566+0000","last_clean":"2024-09-21T06:35:13.498566+0000","last_became_active":"2024-09-21T06:34:40.891016+0000","last_became_peered":"2024-09-21T06:34:40.891016+0000","last_unstale":"2024-09-21T06:35:13.498566+0000","last_undegraded":"2024-09-21T06:35:13.498566+0000","last_fullsized":"2024-09-21T06:35:13.498566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:44:51.712869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498387+0000","last_change":"2024-09-21T06:34:42.880047+0000","last_active":"2024-09-21T06:35:13.498387+0000","last_peered":"2024-09-21T06:35:13.498387+0000","last_clean":"2024-09-21T06:35:13.498387+0000","last_became_active":"2024-09-21T06:34:42.879664+0000","last_became_peered":"2024-09-21T06:34:42.879664+0000","last_unstale":"2024-09-21T06:35:13.498387+0000","last_undegraded":"2024-09-21T06:35:13.498387+0000","last_fullsized":"2024-09-21T06:35:13.498387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:03.621493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"74'10","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.230979+0000","last_change":"2024-09-21T06:34:40.877199+0000","last_active":"2024-09-21T06:35:13.230979+0000","last_peered":"2024-09-21T06:35:13.230979+0000","last_clean":"2024-09-21T06:35:13.230979+0000","last_became_active":"2024-09-21T06:34:40.876811+0000","last_became_peered":"2024-09-21T06:34:40.876811+0000","last_unstale":"2024-09-21T06:35:13.230979+0000","last_undegraded":"2024-09-21T06:35:13.230979+0000","last_fullsized":"2024-09-21T06:35:13.230979+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:03.917619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.289411+0000","last_change":"2024-09-21T06:35:13.289318+0000","last_active":"2024-09-21T06:35:13.289411+0000","last_peered":"2024-09-21T06:35:13.289411+0000","last_clean":"2024-09-21T06:35:13.289411+0000","last_became_active":"2024-09-21T06:35:13.288961+0000","last_became_peered":"2024-09-21T06:35:13.288961+0000","last_unstale":"2024-09-21T06:35:13.289411+0000","last_undegraded":"2024-09-21T06:35:13.289411+0000","last_fullsized":"2024-09-21T06:35:13.289411+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:05.659772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498332+0000","last_change":"2024-09-21T06:34:40.869754+0000","last_active":"2024-09-21T06:35:13.498332+0000","last_peered":"2024-09-21T06:35:13.498332+0000","last_clean":"2024-09-21T06:35:13.498332+0000","last_became_active":"2024-09-21T06:34:40.869311+0000","last_became_peered":"2024-09-21T06:34:40.869311+0000","last_unstale":"2024-09-21T06:35:13.498332+0000","last_undegraded":"2024-09-21T06:35:13.498332+0000","last_fullsized":"2024-09-21T06:35:13.498332+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:10.959880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497041+0000","last_change":"2024-09-21T06:34:42.889198+0000","last_active":"2024-09-21T06:35:13.497041+0000","last_peered":"2024-09-21T06:35:13.497041+0000","last_clean":"2024-09-21T06:35:13.497041+0000","last_became_active":"2024-09-21T06:34:42.888813+0000","last_became_peered":"2024-09-21T06:34:42.888813+0000","last_unstale":"2024-09-21T06:35:13.497041+0000","last_undegraded":"2024-09-21T06:35:13.497041+0000","last_fullsized":"2024-09-21T06:35:13.497041+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:25.270225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234099+0000","last_change":"2024-09-21T06:34:40.892267+0000","last_active":"2024-09-21T06:35:13.234099+0000","last_peered":"2024-09-21T06:35:13.234099+0000","last_clean":"2024-09-21T06:35:13.234099+0000","last_became_active":"2024-09-21T06:34:40.891791+0000","last_became_peered":"2024-09-21T06:34:40.891791+0000","last_unstale":"2024-09-21T06:35:13.234099+0000","last_undegraded":"2024-09-21T06:35:13.234099+0000","last_fullsized":"2024-09-21T06:35:13.234099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:07.864647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498203+0000","last_change":"2024-09-21T06:34:42.894361+0000","last_active":"2024-09-21T06:35:13.498203+0000","last_peered":"2024-09-21T06:35:13.498203+0000","last_clean":"2024-09-21T06:35:13.498203+0000","last_became_active":"2024-09-21T06:34:42.893976+0000","last_became_peered":"2024-09-21T06:34:42.893976+0000","last_unstale":"2024-09-21T06:35:13.498203+0000","last_undegraded":"2024-09-21T06:35:13.498203+0000","last_fullsized":"2024-09-21T06:35:13.498203+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:32.741495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234544+0000","last_change":"2024-09-21T06:34:40.875952+0000","last_active":"2024-09-21T06:35:13.234544+0000","last_peered":"2024-09-21T06:35:13.234544+0000","last_clean":"2024-09-21T06:35:13.234544+0000","last_became_active":"2024-09-21T06:34:40.875598+0000","last_became_peered":"2024-09-21T06:34:40.875598+0000","last_unstale":"2024-09-21T06:35:13.234544+0000","last_undegraded":"2024-09-21T06:35:13.234544+0000","last_fullsized":"2024-09-21T06:35:13.234544+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:29.873037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231692+0000","last_change":"2024-09-21T06:34:42.887639+0000","last_active":"2024-09-21T06:35:13.231692+0000","last_peered":"2024-09-21T06:35:13.231692+0000","last_clean":"2024-09-21T06:35:13.231692+0000","last_became_active":"2024-09-21T06:34:42.887201+0000","last_became_peered":"2024-09-21T06:34:42.887201+0000","last_unstale":"2024-09-21T06:35:13.231692+0000","last_undegraded":"2024-09-21T06:35:13.231692+0000","last_fullsized":"2024-09-21T06:35:13.231692+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:59.431007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.235713+0000","last_change":"2024-09-21T06:34:40.880145+0000","last_active":"2024-09-21T06:35:13.235713+0000","last_peered":"2024-09-21T06:35:13.235713+0000","last_clean":"2024-09-21T06:35:13.235713+0000","last_became_active":"2024-09-21T06:34:40.879480+0000","last_became_peered":"2024-09-21T06:34:40.879480+0000","last_unstale":"2024-09-21T06:35:13.235713+0000","last_undegraded":"2024-09-21T06:35:13.235713+0000","last_fullsized":"2024-09-21T06:35:13.235713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.551228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.235151+0000","last_change":"2024-09-21T06:34:42.882455+0000","last_active":"2024-09-21T06:35:13.235151+0000","last_peered":"2024-09-21T06:35:13.235151+0000","last_clean":"2024-09-21T06:35:13.235151+0000","last_became_active":"2024-09-21T06:34:42.880714+0000","last_became_peered":"2024-09-21T06:34:42.880714+0000","last_unstale":"2024-09-21T06:35:13.235151+0000","last_undegraded":"2024-09-21T06:35:13.235151+0000","last_fullsized":"2024-09-21T06:35:13.235151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:39.264152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498289+0000","last_change":"2024-09-21T06:34:40.879560+0000","last_active":"2024-09-21T06:35:13.498289+0000","last_peered":"2024-09-21T06:35:13.498289+0000","last_clean":"2024-09-21T06:35:13.498289+0000","last_became_active":"2024-09-21T06:34:40.878433+0000","last_became_peered":"2024-09-21T06:34:40.878433+0000","last_unstale":"2024-09-21T06:35:13.498289+0000","last_undegraded":"2024-09-21T06:35:13.498289+0000","last_fullsized":"2024-09-21T06:35:13.498289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:07.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.288729+0000","last_change":"2024-09-21T06:34:42.896193+0000","last_active":"2024-09-21T06:35:13.288729+0000","last_peered":"2024-09-21T06:35:13.288729+0000","last_clean":"2024-09-21T06:35:13.288729+0000","last_became_active":"2024-09-21T06:34:42.895753+0000","last_became_peered":"2024-09-21T06:34:42.895753+0000","last_unstale":"2024-09-21T06:35:13.288729+0000","last_undegraded":"2024-09-21T06:35:13.288729+0000","last_fullsized":"2024-09-21T06:35:13.288729+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:47.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.290529+0000","last_change":"2024-09-21T06:35:13.290402+0000","last_active":"2024-09-21T06:35:13.290529+0000","last_peered":"2024-09-21T06:35:13.290529+0000","last_clean":"2024-09-21T06:35:13.290529+0000","last_became_active":"2024-09-21T06:35:13.289718+0000","last_became_peered":"2024-09-21T06:35:13.289718+0000","last_unstale":"2024-09-21T06:35:13.290529+0000","last_undegraded":"2024-09-21T06:35:13.290529+0000","last_fullsized":"2024-09-21T06:35:13.290529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:06.684007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498453+0000","last_change":"2024-09-21T06:34:40.879386+0000","last_active":"2024-09-21T06:35:13.498453+0000","last_peered":"2024-09-21T06:35:13.498453+0000","last_clean":"2024-09-21T06:35:13.498453+0000","last_became_active":"2024-09-21T06:34:40.879001+0000","last_became_peered":"2024-09-21T06:34:40.879001+0000","last_unstale":"2024-09-21T06:35:13.498453+0000","last_undegraded":"2024-09-21T06:35:13.498453+0000","last_fullsized":"2024-09-21T06:35:13.498453+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:48.438361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234122+0000","last_change":"2024-09-21T06:34:42.901595+0000","last_active":"2024-09-21T06:35:13.234122+0000","last_peered":"2024-09-21T06:35:13.234122+0000","last_clean":"2024-09-21T06:35:13.234122+0000","last_became_active":"2024-09-21T06:34:42.901200+0000","last_became_peered":"2024-09-21T06:34:42.901200+0000","last_unstale":"2024-09-21T06:35:13.234122+0000","last_undegraded":"2024-09-21T06:35:13.234122+0000","last_fullsized":"2024-09-21T06:35:13.234122+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:12.044528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.498519+0000","last_change":"2024-09-21T06:34:40.878959+0000","last_active":"2024-09-21T06:35:13.498519+0000","last_peered":"2024-09-21T06:35:13.498519+0000","last_clean":"2024-09-21T06:35:13.498519+0000","last_became_active":"2024-09-21T06:34:40.878343+0000","last_became_peered":"2024-09-21T06:34:40.878343+0000","last_unstale":"2024-09-21T06:35:13.498519+0000","last_undegraded":"2024-09-21T06:35:13.498519+0000","last_fullsized":"2024-09-21T06:35:13.498519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:54.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.497230+0000","last_change":"2024-09-21T06:34:42.887868+0000","last_active":"2024-09-21T06:35:13.497230+0000","last_peered":"2024-09-21T06:35:13.497230+0000","last_clean":"2024-09-21T06:35:13.497230+0000","last_became_active":"2024-09-21T06:34:42.887268+0000","last_became_peered":"2024-09-21T06:34:42.887268+0000","last_unstale":"2024-09-21T06:35:13.497230+0000","last_undegraded":"2024-09-21T06:35:13.497230+0000","last_fullsized":"2024-09-21T06:35:13.497230+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:41.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.235006+0000","last_change":"2024-09-21T06:34:40.890363+0000","last_active":"2024-09-21T06:35:13.235006+0000","last_peered":"2024-09-21T06:35:13.235006+0000","last_clean":"2024-09-21T06:35:13.235006+0000","last_became_active":"2024-09-21T06:34:40.889967+0000","last_became_peered":"2024-09-21T06:34:40.889967+0000","last_unstale":"2024-09-21T06:35:13.235006+0000","last_undegraded":"2024-09-21T06:35:13.235006+0000","last_fullsized":"2024-09-21T06:35:13.235006+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:01.806399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.234793+0000","last_change":"2024-09-21T06:34:42.891211+0000","last_active":"2024-09-21T06:35:13.234793+0000","last_peered":"2024-09-21T06:35:13.234793+0000","last_clean":"2024-09-21T06:35:13.234793+0000","last_became_active":"2024-09-21T06:34:42.890813+0000","last_became_peered":"2024-09-21T06:34:42.890813+0000","last_unstale":"2024-09-21T06:35:13.234793+0000","last_undegraded":"2024-09-21T06:35:13.234793+0000","last_fullsized":"2024-09-21T06:35:13.234793+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-09-21T06:35:13.231483+0000","last_change":"2024-09-21T06:34:40.878074+0000","last_active":"2024-09-21T06:35:13.231483+0000","last_peered":"2024-09-21T06:35:13.231483+0000","last_clean":"2024-09-21T06:35:13.231483+0000","last_became_active":"2024-09-21T06:34:40.877688+0000","last_became_peered":"2024-09-21T06:34:40.877688+0000","last_unstale":"2024-09-21T06:35:13.231483+0000","last_undegraded":"2024-09-21T06:35:13.231483+0000","last_fullsized":"2024-09-21T06:35:13.231483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:01.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69891,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":343,"num_read_kb":237,"num_write":161,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":64752,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":209673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776154,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":831488,"data_stored":409355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1066726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070500,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":409591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266728,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":847872,"data_stored":409511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430254,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32600,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712552,"statfs":{"total":95995035648,"available":95961653248,"internally_reserved":0,"allocated":1441792,"data_stored":1001441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":408980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822712,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28448,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716704,"statfs":{"total":95995035648,"available":95965904896,"internally_reserved":0,"allocated":1454080,"data_stored":1001125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986237,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":913408,"data_stored":475307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":851968,"data_stored":409291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378695,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":410514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542220,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":474663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705745,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":856064,"data_stored":410251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":65890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:35:49.885 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:35:49.885 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T06:35:49.885 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T06:35:49.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T06:35:50.145 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:50.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:49 smithi049 ceph-mon[31177]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:35:50.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:49 smithi098 ceph-mon[34704]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:35:50.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:49 smithi079 ceph-mon[34346]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:35:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.601+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/2987650589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d981084d0 msgr2=0x7f1d9810ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.601+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/2987650589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d981084d0 0x7f1d9810ed00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009ca0 tx=0x7f1d9002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.601+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/2987650589 shutdown_connections 2024-09-21T06:35:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.601+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/2987650589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d981084d0 0x7f1d9810ed00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.601+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/2987650589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d98107b80 0x7f1d98107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.601+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/2987650589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d98102240 0x7f1d98102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.601+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/2987650589 >> 172.21.15.49:0/2987650589 conn(0x7f1d98079f90 msgr2=0x7f1d9807a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.601+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/2987650589 shutdown_connections 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.601+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/2987650589 wait complete. 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9f5ca640 1 Processor -- start 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9f5ca640 1 -- start start 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9f5ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d98102240 0x7f1d9819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9f5ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d98107b80 0x7f1d9819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9f5ca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d981084d0 0x7f1d9819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9f5ca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d98113b90 con 0x7f1d98102240 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9f5ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d98113a10 con 0x7f1d98107b80 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9f5ca640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1d98113d10 con 0x7f1d981084d0 2024-09-21T06:35:50.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9d366640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d98102240 0x7f1d9819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9d366640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d98102240 0x7f1d9819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51546/0 (socket says 172.21.15.49:51546) 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.602+0000 7f1d9d366640 1 -- 172.21.15.49:0/1327764533 learned_addr learned my addr 172.21.15.49:0/1327764533 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9cb65640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d98107b80 0x7f1d9819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9db67640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d981084d0 0x7f1d9819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9d366640 1 -- 172.21.15.49:0/1327764533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d981084d0 msgr2=0x7f1d9819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9d366640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d981084d0 0x7f1d9819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9d366640 1 -- 172.21.15.49:0/1327764533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d98107b80 msgr2=0x7f1d9819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9d366640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d98107b80 0x7f1d9819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9d366640 1 -- 172.21.15.49:0/1327764533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d981a0390 con 0x7f1d98102240 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9d366640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d98102240 0x7f1d9819a4e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400b4a0 tx=0x7f1d9400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d8e7fc640 1 -- 172.21.15.49:0/1327764533 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d94015020 con 0x7f1d98102240 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d8e7fc640 1 -- 172.21.15.49:0/1327764533 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d94011ce0 con 0x7f1d98102240 2024-09-21T06:35:50.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d8e7fc640 1 -- 172.21.15.49:0/1327764533 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d94010dc0 con 0x7f1d98102240 2024-09-21T06:35:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d981a0680 con 0x7f1d98102240 2024-09-21T06:35:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.603+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d981a6ea0 con 0x7f1d98102240 2024-09-21T06:35:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.604+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d98102650 con 0x7f1d98102240 2024-09-21T06:35:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.606+0000 7f1d8e7fc640 1 -- 172.21.15.49:0/1327764533 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f1d94018020 con 0x7f1d98102240 2024-09-21T06:35:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.607+0000 7f1d8e7fc640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d840b6620 0x7f1d840b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.607+0000 7f1d9cb65640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d840b6620 0x7f1d840b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.607+0000 7f1d8e7fc640 1 -- 172.21.15.49:0/1327764533 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f1d940e7390 con 0x7f1d98102240 2024-09-21T06:35:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.607+0000 7f1d9cb65640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d840b6620 0x7f1d840b8b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1d98107650 tx=0x7f1d8800a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:50.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.610+0000 7f1d8e7fc640 1 -- 172.21.15.49:0/1327764533 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d9401f020 con 0x7f1d98102240 2024-09-21T06:35:50.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.839+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1d9819b610 con 0x7f1d98102240 2024-09-21T06:35:50.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.839+0000 7f1d8e7fc640 1 -- 172.21.15.49:0/1327764533 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1d9819b610 con 0x7f1d98102240 2024-09-21T06:35:50.841 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:50.841 INFO:teuthology.orchestra.run.smithi049.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T06:35:50.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d840b6620 msgr2=0x7f1d840b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:50.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d840b6620 0x7f1d840b8b30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1d98107650 tx=0x7f1d8800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d98102240 msgr2=0x7f1d9819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:50.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d98102240 0x7f1d9819a4e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400b4a0 tx=0x7f1d9400b8a0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 shutdown_connections 2024-09-21T06:35:50.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d840b6620 0x7f1d840b8b30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d981084d0 0x7f1d9819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d98107b80 0x7f1d9819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.843 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 --2- 172.21.15.49:0/1327764533 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d98102240 0x7f1d9819a4e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 >> 172.21.15.49:0/1327764533 conn(0x7f1d98079f90 msgr2=0x7f1d98105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:50.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 shutdown_connections 2024-09-21T06:35:50.844 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:50.841+0000 7f1d9f5ca640 1 -- 172.21.15.49:0/1327764533 wait complete. 2024-09-21T06:35:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:50 smithi049 ceph-mon[31177]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:50 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1327764533' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:35:51.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:50 smithi098 ceph-mon[34704]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:50 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1327764533' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:35:51.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:50 smithi079 ceph-mon[34346]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:51.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:50 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1327764533' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:35:51.506 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T06:35:51.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:51.765 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:52.196 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:51 smithi049 ceph-mon[31177]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:52.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.213+0000 7fb199c91640 1 -- 172.21.15.49:0/1525839851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 msgr2=0x7fb194102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.213+0000 7fb199c91640 1 --2- 172.21.15.49:0/1525839851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 0x7fb194102e70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fb184009900 tx=0x7fb18402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:52.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.213+0000 7fb199c91640 1 -- 172.21.15.49:0/1525839851 shutdown_connections 2024-09-21T06:35:52.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.213+0000 7fb199c91640 1 --2- 172.21.15.49:0/1525839851 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb194108cf0 0x7fb19410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.213+0000 7fb199c91640 1 --2- 172.21.15.49:0/1525839851 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1941083a0 0x7fb1941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.213+0000 7fb199c91640 1 --2- 172.21.15.49:0/1525839851 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 0x7fb194102e70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.213+0000 7fb199c91640 1 -- 172.21.15.49:0/1525839851 >> 172.21.15.49:0/1525839851 conn(0x7fb194079730 msgr2=0x7fb194079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:52.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.213+0000 7fb199c91640 1 -- 172.21.15.49:0/1525839851 shutdown_connections 2024-09-21T06:35:52.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.213+0000 7fb199c91640 1 -- 172.21.15.49:0/1525839851 wait complete. 2024-09-21T06:35:52.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.214+0000 7fb199c91640 1 Processor -- start 2024-09-21T06:35:52.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.214+0000 7fb199c91640 1 -- start start 2024-09-21T06:35:52.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb199c91640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 0x7fb194199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb199c91640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1941083a0 0x7fb1941998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb199c91640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb194108cf0 0x7fb19419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb199c91640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb194112960 con 0x7fb194102a60 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb199c91640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb1941127e0 con 0x7fb194108cf0 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb199c91640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb194112ae0 con 0x7fb1941083a0 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb1937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 0x7fb194199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb1937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 0x7fb194199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51570/0 (socket says 172.21.15.49:51570) 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb1937fe640 1 -- 172.21.15.49:0/2489271451 learned_addr learned my addr 172.21.15.49:0/2489271451 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb192ffd640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1941083a0 0x7fb1941998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb193fff640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb194108cf0 0x7fb19419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb1937fe640 1 -- 172.21.15.49:0/2489271451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1941083a0 msgr2=0x7fb1941998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb1937fe640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1941083a0 0x7fb1941998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb1937fe640 1 -- 172.21.15.49:0/2489271451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb194108cf0 msgr2=0x7fb19419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb1937fe640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb194108cf0 0x7fb19419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb1937fe640 1 -- 172.21.15.49:0/2489271451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19419f2c0 con 0x7fb194102a60 2024-09-21T06:35:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.215+0000 7fb1937fe640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 0x7fb194199350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb184005940 tx=0x7fb1840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.216+0000 7fb190ff9640 1 -- 172.21.15.49:0/2489271451 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18403f030 con 0x7fb194102a60 2024-09-21T06:35:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.216+0000 7fb190ff9640 1 -- 172.21.15.49:0/2489271451 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb184003cb0 con 0x7fb194102a60 2024-09-21T06:35:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.216+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19419f550 con 0x7fb194102a60 2024-09-21T06:35:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.216+0000 7fb190ff9640 1 -- 172.21.15.49:0/2489271451 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb184035070 con 0x7fb194102a60 2024-09-21T06:35:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.216+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1941a5d10 con 0x7fb194102a60 2024-09-21T06:35:52.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.217+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb194102e70 con 0x7fb194102a60 2024-09-21T06:35:52.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.220+0000 7fb190ff9640 1 -- 172.21.15.49:0/2489271451 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fb184042030 con 0x7fb194102a60 2024-09-21T06:35:52.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.220+0000 7fb190ff9640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb17c0b65f0 0x7fb17c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:52.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.220+0000 7fb192ffd640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb17c0b65f0 0x7fb17c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:52.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.220+0000 7fb190ff9640 1 -- 172.21.15.49:0/2489271451 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fb1841080e0 con 0x7fb194102a60 2024-09-21T06:35:52.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.221+0000 7fb192ffd640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb17c0b65f0 0x7fb17c0b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb194100c50 tx=0x7fb18800a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:52.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.224+0000 7fb190ff9640 1 -- 172.21.15.49:0/2489271451 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb1840d2b10 con 0x7fb194102a60 2024-09-21T06:35:52.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:51 smithi098 ceph-mon[34704]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:52.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:51 smithi079 ceph-mon[34346]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:52.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.451+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb19419a480 con 0x7fb194102a60 2024-09-21T06:35:52.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.452+0000 7fb190ff9640 1 -- 172.21.15.49:0/2489271451 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7fb1840d7a50 con 0x7fb194102a60 2024-09-21T06:35:52.454 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:52.455 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"btime":"2024-09-21T06:34:54:962997+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:34:54.645934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:35:52.455 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2024-09-21T06:35:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb17c0b65f0 msgr2=0x7fb17c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb17c0b65f0 0x7fb17c0b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb194100c50 tx=0x7fb18800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 msgr2=0x7fb194199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 0x7fb194199350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb184005940 tx=0x7fb1840042f0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 shutdown_connections 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb17c0b65f0 0x7fb17c0b8b00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb194108cf0 0x7fb19419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb1941083a0 0x7fb1941998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 --2- 172.21.15.49:0/2489271451 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb194102a60 0x7fb194199350 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 >> 172.21.15.49:0/2489271451 conn(0x7fb194079730 msgr2=0x7fb1941013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 shutdown_connections 2024-09-21T06:35:52.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:52.455+0000 7fb199c91640 1 -- 172.21.15.49:0/2489271451 wait complete. 2024-09-21T06:35:53.076 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:52 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2489271451' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:53.105 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:53.197 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:52 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2489271451' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:52 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2489271451' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:53.369 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.887+0000 7fd855921640 1 -- 172.21.15.49:0/1564345536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8501083c0 msgr2=0x7fd8501087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.887+0000 7fd855921640 1 --2- 172.21.15.49:0/1564345536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8501083c0 0x7fd8501087d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd838009900 tx=0x7fd83802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:35:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.887+0000 7fd855921640 1 -- 172.21.15.49:0/1564345536 shutdown_connections 2024-09-21T06:35:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.887+0000 7fd855921640 1 --2- 172.21.15.49:0/1564345536 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd850108d10 0x7fd85010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.887+0000 7fd855921640 1 --2- 172.21.15.49:0/1564345536 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd8501083c0 0x7fd8501087d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.887+0000 7fd855921640 1 --2- 172.21.15.49:0/1564345536 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd850102a80 0x7fd850102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.887+0000 7fd855921640 1 -- 172.21.15.49:0/1564345536 >> 172.21.15.49:0/1564345536 conn(0x7fd850079740 msgr2=0x7fd850079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.888+0000 7fd855921640 1 -- 172.21.15.49:0/1564345536 shutdown_connections 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.888+0000 7fd855921640 1 -- 172.21.15.49:0/1564345536 wait complete. 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.888+0000 7fd855921640 1 Processor -- start 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.888+0000 7fd855921640 1 -- start start 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd855921640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd850102a80 0x7fd85019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd855921640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8501083c0 0x7fd85019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd855921640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850108d10 0x7fd8501a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd855921640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd850113aa0 con 0x7fd850108d10 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd855921640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd850113920 con 0x7fd8501083c0 2024-09-21T06:35:53.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd855921640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd850113c20 con 0x7fd850102a80 2024-09-21T06:35:53.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850108d10 0x7fd8501a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850108d10 0x7fd8501a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51592/0 (socket says 172.21.15.49:51592) 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84f7fe640 1 -- 172.21.15.49:0/520617279 learned_addr learned my addr 172.21.15.49:0/520617279 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84e7fc640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8501083c0 0x7fd85019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84effd640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd850102a80 0x7fd85019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84f7fe640 1 -- 172.21.15.49:0/520617279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd850102a80 msgr2=0x7fd85019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84f7fe640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd850102a80 0x7fd85019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84f7fe640 1 -- 172.21.15.49:0/520617279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8501083c0 msgr2=0x7fd85019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84f7fe640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8501083c0 0x7fd85019cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84f7fe640 1 -- 172.21.15.49:0/520617279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8501a2500 con 0x7fd850108d10 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd84f7fe640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850108d10 0x7fd8501a1e90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd84000cce0 tx=0x7fd84000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.889+0000 7fd85491f640 1 -- 172.21.15.49:0/520617279 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84000f450 con 0x7fd850108d10 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.890+0000 7fd85491f640 1 -- 172.21.15.49:0/520617279 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd84000faa0 con 0x7fd850108d10 2024-09-21T06:35:53.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.890+0000 7fd85491f640 1 -- 172.21.15.49:0/520617279 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840018b70 con 0x7fd850108d10 2024-09-21T06:35:53.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.890+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8501a27f0 con 0x7fd850108d10 2024-09-21T06:35:53.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.890+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8501a9010 con 0x7fd850108d10 2024-09-21T06:35:53.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.891+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd850103d00 con 0x7fd850108d10 2024-09-21T06:35:53.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.892+0000 7fd85491f640 1 -- 172.21.15.49:0/520617279 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fd840018d10 con 0x7fd850108d10 2024-09-21T06:35:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.893+0000 7fd85491f640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd83c0b66a0 0x7fd83c0b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.893+0000 7fd84effd640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd83c0b66a0 0x7fd83c0b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.893+0000 7fd85491f640 1 -- 172.21.15.49:0/520617279 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fd8400e7a50 con 0x7fd850108d10 2024-09-21T06:35:53.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.894+0000 7fd84effd640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd83c0b66a0 0x7fd83c0b8bb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd848005e10 tx=0x7fd848005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:53.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:53.896+0000 7fd85491f640 1 -- 172.21.15.49:0/520617279 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd840014030 con 0x7fd850108d10 2024-09-21T06:35:54.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.120+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd850102e90 con 0x7fd850108d10 2024-09-21T06:35:54.122 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:53 smithi049 ceph-mon[31177]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:35:54.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.121+0000 7fd85491f640 1 -- 172.21.15.49:0/520617279 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7fd850102e90 con 0x7fd850108d10 2024-09-21T06:35:54.123 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:54.123 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"btime":"2024-09-21T06:34:54:962997+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:34:54.645934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:35:54.124 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2024-09-21T06:35:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd83c0b66a0 msgr2=0x7fd83c0b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd83c0b66a0 0x7fd83c0b8bb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd848005e10 tx=0x7fd848005da0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850108d10 msgr2=0x7fd8501a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850108d10 0x7fd8501a1e90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd84000cce0 tx=0x7fd84000a620 comp rx=0 tx=0).stop 2024-09-21T06:35:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 shutdown_connections 2024-09-21T06:35:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd83c0b66a0 0x7fd83c0b8bb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd850108d10 0x7fd8501a1e90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd8501083c0 0x7fd85019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 --2- 172.21.15.49:0/520617279 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd850102a80 0x7fd85019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.123+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 >> 172.21.15.49:0/520617279 conn(0x7fd850079740 msgr2=0x7fd85010feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.124+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 shutdown_connections 2024-09-21T06:35:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:54.124+0000 7fd855921640 1 -- 172.21.15.49:0/520617279 wait complete. 2024-09-21T06:35:54.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:53 smithi098 ceph-mon[34704]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:35:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:53 smithi079 ceph-mon[34346]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:35:54.752 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:35:55.014 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:55.136 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:54 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/520617279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:55.136 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:54 smithi049 ceph-mon[31177]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:55.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:54 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/520617279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:54 smithi098 ceph-mon[34704]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:54 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/520617279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:54 smithi079 ceph-mon[34346]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.529+0000 7f4e726d9640 1 -- 172.21.15.49:0/2198443420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 msgr2=0x7f4e6c103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.529+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2198443420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 0x7f4e6c103f70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009900 tx=0x7f4e5c02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.529+0000 7f4e726d9640 1 -- 172.21.15.49:0/2198443420 shutdown_connections 2024-09-21T06:35:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.529+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2198443420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e6c109df0 0x7f4e6c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.529+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2198443420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e6c1094a0 0x7f4e6c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.529+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2198443420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 0x7f4e6c103f70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.529+0000 7f4e726d9640 1 -- 172.21.15.49:0/2198443420 >> 172.21.15.49:0/2198443420 conn(0x7f4e6c07b850 msgr2=0x7f4e6c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.529+0000 7f4e726d9640 1 -- 172.21.15.49:0/2198443420 shutdown_connections 2024-09-21T06:35:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.529+0000 7f4e726d9640 1 -- 172.21.15.49:0/2198443420 wait complete. 2024-09-21T06:35:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e726d9640 1 Processor -- start 2024-09-21T06:35:55.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e726d9640 1 -- start start 2024-09-21T06:35:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e726d9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 0x7f4e6c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e726d9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e6c1094a0 0x7f4e6c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e726d9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e6c109df0 0x7f4e6c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e726d9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c113ab0 con 0x7f4e6c103b60 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e726d9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c113930 con 0x7f4e6c109df0 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e726d9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c113c30 con 0x7f4e6c1094a0 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 0x7f4e6c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 0x7f4e6c19a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:51610/0 (socket says 172.21.15.49:51610) 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.530+0000 7f4e6bfff640 1 -- 172.21.15.49:0/2401265213 learned_addr learned my addr 172.21.15.49:0/2401265213 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e70c76640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e6c109df0 0x7f4e6c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e6b7fe640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e6c1094a0 0x7f4e6c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e6bfff640 1 -- 172.21.15.49:0/2401265213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e6c1094a0 msgr2=0x7f4e6c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e6bfff640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e6c1094a0 0x7f4e6c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e6bfff640 1 -- 172.21.15.49:0/2401265213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e6c109df0 msgr2=0x7f4e6c19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e6bfff640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e6c109df0 0x7f4e6c19fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e6bfff640 1 -- 172.21.15.49:0/2401265213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c1a0310 con 0x7f4e6c103b60 2024-09-21T06:35:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e6b7fe640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e6c1094a0 0x7f4e6c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e6bfff640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 0x7f4e6c19a460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c006010 tx=0x7f4e5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e697fa640 1 -- 172.21.15.49:0/2401265213 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c03f030 con 0x7f4e6c103b60 2024-09-21T06:35:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e697fa640 1 -- 172.21.15.49:0/2401265213 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e5c003800 con 0x7f4e6c103b60 2024-09-21T06:35:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e697fa640 1 -- 172.21.15.49:0/2401265213 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c035070 con 0x7f4e6c103b60 2024-09-21T06:35:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c1a05a0 con 0x7f4e6c103b60 2024-09-21T06:35:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.531+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c1a0a80 con 0x7f4e6c103b60 2024-09-21T06:35:55.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.532+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6c103f70 con 0x7f4e6c103b60 2024-09-21T06:35:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.535+0000 7f4e697fa640 1 -- 172.21.15.49:0/2401265213 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f4e5c003cb0 con 0x7f4e6c103b60 2024-09-21T06:35:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.535+0000 7f4e697fa640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4e540b6620 0x7f4e540b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.536+0000 7f4e6b7fe640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4e540b6620 0x7f4e540b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:55.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.536+0000 7f4e697fa640 1 -- 172.21.15.49:0/2401265213 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f4e5c1080d0 con 0x7f4e6c103b60 2024-09-21T06:35:55.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.536+0000 7f4e6b7fe640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4e540b6620 0x7f4e540b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c106450 tx=0x7f4e6000a5c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:55.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.539+0000 7f4e697fa640 1 -- 172.21.15.49:0/2401265213 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e5c0ce7c0 con 0x7f4e6c103b60 2024-09-21T06:35:55.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.727+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e6c19b590 con 0x7f4e6c103b60 2024-09-21T06:35:55.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.728+0000 7f4e697fa640 1 -- 172.21.15.49:0/2401265213 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22926 (secure 0 0 0) 0x7f4e6c19b590 con 0x7f4e6c103b60 2024-09-21T06:35:55.731 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:55.731 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":76,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:35:13.227165+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9},{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4e540b6620 msgr2=0x7f4e540b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4e540b6620 0x7f4e540b8b30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c106450 tx=0x7f4e6000a5c0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 msgr2=0x7f4e6c19a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 0x7f4e6c19a460 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c006010 tx=0x7f4e5c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 shutdown_connections 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4e540b6620 0x7f4e540b8b30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4e6c109df0 0x7f4e6c19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4e6c1094a0 0x7f4e6c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 --2- 172.21.15.49:0/2401265213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4e6c103b60 0x7f4e6c19a460 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 >> 172.21.15.49:0/2401265213 conn(0x7f4e6c07b850 msgr2=0x7f4e6c107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:55.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 shutdown_connections 2024-09-21T06:35:55.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:55.731+0000 7f4e726d9640 1 -- 172.21.15.49:0/2401265213 wait complete. 2024-09-21T06:35:56.024 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:55 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2401265213' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:55 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2401265213' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:55 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2401265213' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:56.330 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:56.587 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:56.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:56 smithi049 ceph-mon[31177]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:57.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.093+0000 7f8229c78640 1 -- 172.21.15.49:0/3567328159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8224103b60 msgr2=0x7f8224103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.093+0000 7f8229c78640 1 --2- 172.21.15.49:0/3567328159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8224103b60 0x7f8224103f70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8214009900 tx=0x7f821402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:57.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.093+0000 7f8229c78640 1 -- 172.21.15.49:0/3567328159 shutdown_connections 2024-09-21T06:35:57.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.093+0000 7f8229c78640 1 --2- 172.21.15.49:0/3567328159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109df0 0x7f8224110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.093+0000 7f8229c78640 1 --2- 172.21.15.49:0/3567328159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82241094a0 0x7f82241098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.093+0000 7f8229c78640 1 --2- 172.21.15.49:0/3567328159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8224103b60 0x7f8224103f70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.093+0000 7f8229c78640 1 -- 172.21.15.49:0/3567328159 >> 172.21.15.49:0/3567328159 conn(0x7f822407b850 msgr2=0x7f822407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:57.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.093+0000 7f8229c78640 1 -- 172.21.15.49:0/3567328159 shutdown_connections 2024-09-21T06:35:57.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.093+0000 7f8229c78640 1 -- 172.21.15.49:0/3567328159 wait complete. 2024-09-21T06:35:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.094+0000 7f8229c78640 1 Processor -- start 2024-09-21T06:35:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.094+0000 7f8229c78640 1 -- start start 2024-09-21T06:35:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.094+0000 7f8229c78640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8224103b60 0x7f822419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.094+0000 7f8229c78640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82241094a0 0x7f822419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.094+0000 7f8229c78640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109df0 0x7f822419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8229c78640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8224113b60 con 0x7f82241094a0 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8229c78640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82241139e0 con 0x7f8224103b60 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8229c78640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8224113ce0 con 0x7f8224109df0 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8222ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82241094a0 0x7f822419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8222ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82241094a0 0x7f822419ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34496/0 (socket says 172.21.15.49:34496) 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8222ffd640 1 -- 172.21.15.49:0/2006154384 learned_addr learned my addr 172.21.15.49:0/2006154384 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f82237fe640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8224103b60 0x7f822419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8223fff640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109df0 0x7f822419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8222ffd640 1 -- 172.21.15.49:0/2006154384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109df0 msgr2=0x7f822419fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8222ffd640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109df0 0x7f822419fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8222ffd640 1 -- 172.21.15.49:0/2006154384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8224103b60 msgr2=0x7f822419a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8222ffd640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8224103b60 0x7f822419a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8222ffd640 1 -- 172.21.15.49:0/2006154384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82241a04e0 con 0x7f82241094a0 2024-09-21T06:35:57.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8223fff640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109df0 0x7f822419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8222ffd640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82241094a0 0x7f822419ab10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f821800cce0 tx=0x7f821800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8220ff9640 1 -- 172.21.15.49:0/2006154384 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8218004b20 con 0x7f82241094a0 2024-09-21T06:35:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8220ff9640 1 -- 172.21.15.49:0/2006154384 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8218004cc0 con 0x7f82241094a0 2024-09-21T06:35:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82241a07d0 con 0x7f82241094a0 2024-09-21T06:35:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.095+0000 7f8220ff9640 1 -- 172.21.15.49:0/2006154384 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821800f6b0 con 0x7f82241094a0 2024-09-21T06:35:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.096+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82241a6f30 con 0x7f82241094a0 2024-09-21T06:35:57.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.096+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8224103f70 con 0x7f82241094a0 2024-09-21T06:35:57.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.098+0000 7f8220ff9640 1 -- 172.21.15.49:0/2006154384 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f821800f850 con 0x7f82241094a0 2024-09-21T06:35:57.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.099+0000 7f8220ff9640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f820c0b65f0 0x7f820c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.099+0000 7f82237fe640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f820c0b65f0 0x7f820c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.100+0000 7f8220ff9640 1 -- 172.21.15.49:0/2006154384 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f82180e7a00 con 0x7f82241094a0 2024-09-21T06:35:57.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.100+0000 7f82237fe640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f820c0b65f0 0x7f820c0b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8214005ab0 tx=0x7f8214005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:57.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.103+0000 7f8220ff9640 1 -- 172.21.15.49:0/2006154384 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8218014030 con 0x7f82241094a0 2024-09-21T06:35:57.220 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:56 smithi079 ceph-mon[34346]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:57.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:56 smithi098 ceph-mon[34704]: pgmap v296: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:57.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.330+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f822419b6a0 con 0x7f82241094a0 2024-09-21T06:35:57.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.331+0000 7f8220ff9640 1 -- 172.21.15.49:0/2006154384 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7f82180ae050 con 0x7f82241094a0 2024-09-21T06:35:57.333 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:35:57.333 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"btime":"2024-09-21T06:34:54:962997+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:34:54.645934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:35:57.333 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2024-09-21T06:35:57.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.333+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f820c0b65f0 msgr2=0x7f820c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.333+0000 7f8229c78640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f820c0b65f0 0x7f820c0b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8214005ab0 tx=0x7f8214005a20 comp rx=0 tx=0).stop 2024-09-21T06:35:57.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.333+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82241094a0 msgr2=0x7f822419ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.333+0000 7f8229c78640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82241094a0 0x7f822419ab10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f821800cce0 tx=0x7f821800a620 comp rx=0 tx=0).stop 2024-09-21T06:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.334+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 shutdown_connections 2024-09-21T06:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.334+0000 7f8229c78640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f820c0b65f0 0x7f820c0b8b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.334+0000 7f8229c78640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8224109df0 0x7f822419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.334+0000 7f8229c78640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82241094a0 0x7f822419ab10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.334+0000 7f8229c78640 1 --2- 172.21.15.49:0/2006154384 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8224103b60 0x7f822419a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.334+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 >> 172.21.15.49:0/2006154384 conn(0x7f822407b850 msgr2=0x7f8224107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.334+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 shutdown_connections 2024-09-21T06:35:57.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:57.334+0000 7f8229c78640 1 -- 172.21.15.49:0/2006154384 wait complete. 2024-09-21T06:35:57.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:34:43.531339+0000', 'modified': '2024-09-21T06:34:54.645934+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24686, 'mds_1': 24685, 'mds_2': 24676}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24638': {'gid': 24638, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6835/1332274866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 1332274866}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 1332274866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/1540546438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 1540546438}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 1540546438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24664': {'gid': 24664, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6835/1874380420', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 1874380420}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 1874380420}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24676': {'gid': 24676, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.98:6837/883661759', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 883661759}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 883661759}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24685': {'gid': 24685, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.98:6839/2833694716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2833694716}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2833694716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24686': {'gid': 24686, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6839/1831508343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6838', 'nonce': 1831508343}, {'type': 'v1', 'addr': '172.21.15.79:6839', 'nonce': 1831508343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24686, 'qdb_cluster': [24676, 24685, 24686]} 2024-09-21T06:35:57.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T06:35:57.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T06:35:58.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:57 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2006154384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:58.262 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:58.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:57 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2006154384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:58.321 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:57 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2006154384' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.727+0000 7fae26dc3640 1 -- 172.21.15.49:0/68913713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae201052f0 msgr2=0x7fae2010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.727+0000 7fae26dc3640 1 --2- 172.21.15.49:0/68913713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae201052f0 0x7fae2010d930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fae10009ca0 tx=0x7fae1002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.727+0000 7fae26dc3640 1 -- 172.21.15.49:0/68913713 shutdown_connections 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.727+0000 7fae26dc3640 1 --2- 172.21.15.49:0/68913713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae2010de70 0x7fae20110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.727+0000 7fae26dc3640 1 --2- 172.21.15.49:0/68913713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae201052f0 0x7fae2010d930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.727+0000 7fae26dc3640 1 --2- 172.21.15.49:0/68913713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae201048c0 0x7fae20104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.727+0000 7fae26dc3640 1 -- 172.21.15.49:0/68913713 >> 172.21.15.49:0/68913713 conn(0x7fae20079770 msgr2=0x7fae20079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.727+0000 7fae26dc3640 1 -- 172.21.15.49:0/68913713 shutdown_connections 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.727+0000 7fae26dc3640 1 -- 172.21.15.49:0/68913713 wait complete. 2024-09-21T06:35:58.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.728+0000 7fae26dc3640 1 Processor -- start 2024-09-21T06:35:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.728+0000 7fae26dc3640 1 -- start start 2024-09-21T06:35:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.728+0000 7fae26dc3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae201048c0 0x7fae2019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.728+0000 7fae26dc3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae201052f0 0x7fae2019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.728+0000 7fae26dc3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2010de70 0x7fae2019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.728+0000 7fae26dc3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fae20113af0 con 0x7fae2010de70 2024-09-21T06:35:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.728+0000 7fae26dc3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fae20113970 con 0x7fae201048c0 2024-09-21T06:35:58.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.728+0000 7fae26dc3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fae20113c70 con 0x7fae201052f0 2024-09-21T06:35:58.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae25360640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2010de70 0x7fae2019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae25360640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2010de70 0x7fae2019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34516/0 (socket says 172.21.15.49:34516) 2024-09-21T06:35:58.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae25360640 1 -- 172.21.15.49:0/3348819781 learned_addr learned my addr 172.21.15.49:0/3348819781 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:58.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae1ffff640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae201052f0 0x7fae2019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae24b5f640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae201048c0 0x7fae2019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae25360640 1 -- 172.21.15.49:0/3348819781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae201052f0 msgr2=0x7fae2019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae25360640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae201052f0 0x7fae2019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae25360640 1 -- 172.21.15.49:0/3348819781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae201048c0 msgr2=0x7fae2019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae25360640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae201048c0 0x7fae2019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae25360640 1 -- 172.21.15.49:0/3348819781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae201a0470 con 0x7fae2010de70 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae25360640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2010de70 0x7fae2019fd40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fae1800d750 tx=0x7fae1800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae1dffb640 1 -- 172.21.15.49:0/3348819781 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18017070 con 0x7fae2010de70 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae26dc3640 1 -- 172.21.15.49:0/3348819781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae201a0760 con 0x7fae2010de70 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae1dffb640 1 -- 172.21.15.49:0/3348819781 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae180054d0 con 0x7fae2010de70 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.729+0000 7fae1dffb640 1 -- 172.21.15.49:0/3348819781 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae18004c60 con 0x7fae2010de70 2024-09-21T06:35:58.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.730+0000 7fae26dc3640 1 -- 172.21.15.49:0/3348819781 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae201a6ec0 con 0x7fae2010de70 2024-09-21T06:35:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.732+0000 7fae1dffb640 1 -- 172.21.15.49:0/3348819781 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fae18009bd0 con 0x7fae2010de70 2024-09-21T06:35:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.732+0000 7fae2d337740 1 Processor -- start 2024-09-21T06:35:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.732+0000 7fae2d337740 1 -- start start 2024-09-21T06:35:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.732+0000 7fae2d337740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef8e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.732+0000 7fae2d337740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8ea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.732+0000 7fae2d337740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef8ea980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.732+0000 7fae2d337740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef861c10 con 0x55f4ef51b0a0 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.732+0000 7fae2d337740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef851040 con 0x55f4ef543f60 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.732+0000 7fae2d337740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef854e50 con 0x55f4ef523280 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae24b5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8ea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae24b5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8ea440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34524/0 (socket says 172.21.15.49:34524) 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae24b5f640 1 -- 172.21.15.49:0/4125154213 learned_addr learned my addr 172.21.15.49:0/4125154213 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae1ffff640 1 --2- 172.21.15.49:0/4125154213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef8e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae1ffff640 1 --2- 172.21.15.49:0/4125154213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef8ea980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae1dffb640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fae0c0b65f0 0x7fae0c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae24b5f640 1 -- 172.21.15.49:0/4125154213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 msgr2=0x55f4ef8ea980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae24b5f640 1 --2- 172.21.15.49:0/4125154213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef8ea980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae24b5f640 1 -- 172.21.15.49:0/4125154213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 msgr2=0x55f4ef8e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae24b5f640 1 --2- 172.21.15.49:0/4125154213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef8e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae24b5f640 1 -- 172.21.15.49:0/4125154213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ef5af540 con 0x55f4ef51b0a0 2024-09-21T06:35:58.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae25360640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fae0c0b65f0 0x7fae0c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae1dffb640 1 -- 172.21.15.49:0/3348819781 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fae180e6f00 con 0x7fae2010de70 2024-09-21T06:35:58.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.733+0000 7fae24b5f640 1 --2- 172.21.15.49:0/4125154213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8ea440 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fae0800b760 tx=0x7fae0800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5e4e051532e109 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae16ffd640 1 -- 172.21.15.49:0/4125154213 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08003d50 con 0x55f4ef51b0a0 2024-09-21T06:35:58.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae16ffd640 1 -- 172.21.15.49:0/4125154213 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae08015070 con 0x55f4ef51b0a0 2024-09-21T06:35:58.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae16ffd640 1 -- 172.21.15.49:0/4125154213 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae08004cd0 con 0x55f4ef51b0a0 2024-09-21T06:35:58.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae2d337740 1 -- 172.21.15.49:0/4125154213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 msgr2=0x55f4ef8ea440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae2d337740 1 --2- 172.21.15.49:0/4125154213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8ea440 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fae0800b760 tx=0x7fae0800bc20 comp rx=0 tx=0).stop 2024-09-21T06:35:58.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae25360640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fae0c0b65f0 0x7fae0c0b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fae180acc00 tx=0x7fae18079bb0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae2d337740 1 -- 172.21.15.49:0/4125154213 shutdown_connections 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae2d337740 1 --2- 172.21.15.49:0/4125154213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef8ea980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae2d337740 1 --2- 172.21.15.49:0/4125154213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8ea440 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.734+0000 7fae2d337740 1 --2- 172.21.15.49:0/4125154213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef8e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.735+0000 7fae2d337740 1 -- 172.21.15.49:0/4125154213 >> 172.21.15.49:0/4125154213 conn(0x55f4ef538350 msgr2=0x55f4ef8e7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.735+0000 7fae2d337740 1 -- 172.21.15.49:0/4125154213 shutdown_connections 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.735+0000 7fae2d337740 1 -- 172.21.15.49:0/4125154213 wait complete. 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.735+0000 7fae2d337740 1 -- start start 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.735+0000 7fae2d337740 1 Processor -- start 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae2d337740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae2d337740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef8f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae2d337740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef901a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae2d337740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef6b25f0 con 0x55f4ef51b0a0 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae2d337740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef7ec010 con 0x55f4ef543f60 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae2d337740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef8f86e0 con 0x55f4ef523280 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae2d337740 10 client.0 _ll_register_callbacks cb 0x55f4ef84b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34532/0 (socket says 172.21.15.49:34532) 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 -- 172.21.15.49:0/3006044657 learned_addr learned my addr 172.21.15.49:0/3006044657 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae24b5f640 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef8f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef901a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 -- 172.21.15.49:0/3006044657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 msgr2=0x55f4ef8f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef8f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 -- 172.21.15.49:0/3006044657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 msgr2=0x55f4ef901a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef901a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 -- 172.21.15.49:0/3006044657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ef819a00 con 0x55f4ef51b0a0 2024-09-21T06:35:58.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae1ffff640 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f5a20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fae10005e30 tx=0x7fae1002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161ad7439fea1c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fadfffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fadfffff640 1 -- 172.21.15.49:0/3006044657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10031660 con 0x55f4ef51b0a0 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fadfffff640 1 -- 172.21.15.49:0/3006044657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fae10031800 con 0x55f4ef51b0a0 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.736+0000 7fae2d337740 1 -- 172.21.15.49:0/3006044657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae08015070 con 0x55f4ef51b0a0 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fadfffff640 1 -- 172.21.15.49:0/3006044657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fae10003970 con 0x55f4ef51b0a0 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fae2d337740 10 client.15198 fetch_fsmap learned FSMap version 24 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fae2d337740 1 -- 172.21.15.49:0/3006044657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f4ef904630 con 0x55f4ef51b0a0 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fadfffff640 1 -- 172.21.15.49:0/3006044657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae08015070 con 0x55f4ef51b0a0 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fadfffff640 1 -- 172.21.15.49:0/3006044657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fae10049070 con 0x55f4ef51b0a0 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fae2d337740 10 client.15198 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fae2d337740 10 client.15198 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fae2d337740 20 client.15198 populate_metadata read hostname 'smithi049' 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fae2d337740 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55f4ef5028e0 0x55f4ef908060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fae2d337740 4 client.15198 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.737+0000 7fae2d337740 1 -- 172.21.15.49:0/3006044657 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f4ef863b60 con 0x55f4ef5028e0 2024-09-21T06:35:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.738+0000 7fae24b5f640 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55f4ef5028e0 0x55f4ef908060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.738+0000 7fadfffff640 10 client.15198 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:35:58.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.738+0000 7fae24b5f640 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55f4ef5028e0 0x55f4ef908060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a47a9d6dca03400e server_cookie=637403d01d7e3862 in_seq=0 out_seq=0 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fadfffff640 1 -- 172.21.15.49:0/3006044657 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f4ef863b60 con 0x55f4ef5028e0 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fadfffff640 10 client.15198 handle_command_reply: tid=0 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 client.15198 shutdown 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 -- 172.21.15.49:0/3006044657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 msgr2=0x55f4ef8f5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f5a20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fae10005e30 tx=0x7fae1002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 -- 172.21.15.49:0/3006044657 shutdown_connections 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55f4ef5028e0 0x55f4ef908060 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef901a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef8f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fadfffff640 0 client.15198 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:35:58.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 --2- 172.21.15.49:0/3006044657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f5a20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 -- 172.21.15.49:0/3006044657 >> 172.21.15.49:0/3006044657 conn(0x55f4ef538350 msgr2=0x55f4ef8ed090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 -- 172.21.15.49:0/3006044657 shutdown_connections 2024-09-21T06:35:58.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 1 -- 172.21.15.49:0/3006044657 wait complete. 2024-09-21T06:35:58.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.739+0000 7fae2d337740 20 client.15198 trim_cache size 0 max 16384 2024-09-21T06:35:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.757+0000 7fae2d337740 1 Processor -- start 2024-09-21T06:35:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.757+0000 7fae2d337740 1 -- start start 2024-09-21T06:35:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae2d337740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae2d337740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef523280 0x55f4ef8f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae2d337740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef543f60 0x55f4ef901970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae2d337740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef9063a0 con 0x55f4ef51b0a0 2024-09-21T06:35:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae2d337740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef906a70 con 0x55f4ef523280 2024-09-21T06:35:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae2d337740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef907140 con 0x55f4ef543f60 2024-09-21T06:35:58.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34540/0 (socket says 172.21.15.49:34540) 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae1ffff640 1 -- 172.21.15.49:0/158768841 learned_addr learned my addr 172.21.15.49:0/158768841 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae24b5f640 1 --2- 172.21.15.49:0/158768841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef523280 0x55f4ef8f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae1ffff640 1 -- 172.21.15.49:0/158768841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef543f60 msgr2=0x55f4ef901970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae1ffff640 1 --2- 172.21.15.49:0/158768841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef543f60 0x55f4ef901970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae1ffff640 1 -- 172.21.15.49:0/158768841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef523280 msgr2=0x55f4ef8f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae1ffff640 1 --2- 172.21.15.49:0/158768841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef523280 0x55f4ef8f0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae1ffff640 1 -- 172.21.15.49:0/158768841 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4ef8e2080 con 0x55f4ef51b0a0 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae24b5f640 1 --2- 172.21.15.49:0/158768841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef523280 0x55f4ef8f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae1ffff640 1 --2- 172.21.15.49:0/158768841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f09d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae10009bf0 tx=0x7fae10000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57088fd60a1575bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae167fc640 1 -- 172.21.15.49:0/158768841 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10009360 con 0x55f4ef51b0a0 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae167fc640 1 -- 172.21.15.49:0/158768841 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1005b020 con 0x55f4ef51b0a0 2024-09-21T06:35:58.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.758+0000 7fae167fc640 1 -- 172.21.15.49:0/158768841 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10030920 con 0x55f4ef51b0a0 2024-09-21T06:35:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.759+0000 7fae2d337740 1 -- 172.21.15.49:0/158768841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 msgr2=0x55f4ef8f09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.759+0000 7fae2d337740 1 --2- 172.21.15.49:0/158768841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f09d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae10009bf0 tx=0x7fae10000f40 comp rx=0 tx=0).stop 2024-09-21T06:35:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.759+0000 7fae2d337740 1 -- 172.21.15.49:0/158768841 shutdown_connections 2024-09-21T06:35:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.759+0000 7fae2d337740 1 --2- 172.21.15.49:0/158768841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef543f60 0x55f4ef901970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.759+0000 7fae2d337740 1 --2- 172.21.15.49:0/158768841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef523280 0x55f4ef8f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.759+0000 7fae2d337740 1 --2- 172.21.15.49:0/158768841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef8f09d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.759+0000 7fae2d337740 1 -- 172.21.15.49:0/158768841 >> 172.21.15.49:0/158768841 conn(0x55f4ef538350 msgr2=0x55f4ef905980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.759+0000 7fae2d337740 1 -- 172.21.15.49:0/158768841 shutdown_connections 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.759+0000 7fae2d337740 1 -- 172.21.15.49:0/158768841 wait complete. 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae2d337740 1 -- start start 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae2d337740 1 Processor -- start 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae2d337740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef910ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae2d337740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef909f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae2d337740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef90a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae2d337740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef907ee0 con 0x55f4ef51b0a0 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae2d337740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef907810 con 0x55f4ef543f60 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae2d337740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f4ef9085b0 con 0x55f4ef523280 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae2d337740 10 client.0 _ll_register_callbacks cb 0x7fae10031c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef910ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae1ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef910ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34548/0 (socket says 172.21.15.49:34548) 2024-09-21T06:35:58.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae1ffff640 1 -- 172.21.15.49:0/1556292285 learned_addr learned my addr 172.21.15.49:0/1556292285 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:35:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae1ffff640 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef90a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.760+0000 7fae24b5f640 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef909f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fae1ffff640 1 -- 172.21.15.49:0/1556292285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 msgr2=0x55f4ef909f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fae1ffff640 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef909f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fae1ffff640 1 -- 172.21.15.49:0/1556292285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 msgr2=0x55f4ef90a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fae1ffff640 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef90a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fae1ffff640 1 -- 172.21.15.49:0/1556292285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f4ef90ac20 con 0x55f4ef51b0a0 2024-09-21T06:35:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fae1ffff640 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef910ac0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fae10030800 tx=0x7fae10030700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4cd959b7735374 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:58.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fadfffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:35:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fadfffff640 1 -- 172.21.15.49:0/1556292285 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae10069060 con 0x55f4ef51b0a0 2024-09-21T06:35:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fadfffff640 1 -- 172.21.15.49:0/1556292285 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fae1002fc70 con 0x55f4ef51b0a0 2024-09-21T06:35:58.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fae2d337740 1 -- 172.21.15.49:0/1556292285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae1005b020 con 0x55f4ef51b0a0 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fadfffff640 1 -- 172.21.15.49:0/1556292285 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fae1002fe70 con 0x55f4ef51b0a0 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fae2d337740 10 client.15204 fetch_fsmap learned FSMap version 24 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fae2d337740 1 -- 172.21.15.49:0/1556292285 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f4ef973530 con 0x55f4ef51b0a0 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.761+0000 7fadfffff640 1 -- 172.21.15.49:0/1556292285 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae1005b020 con 0x55f4ef51b0a0 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fadfffff640 1 -- 172.21.15.49:0/1556292285 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fae10049050 con 0x55f4ef51b0a0 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fae2d337740 10 client.15204 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fae2d337740 10 client.15204 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fae2d337740 20 client.15204 populate_metadata read hostname 'smithi049' 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fae2d337740 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55f4ef4d7c90 0x55f4ef9769f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fae2d337740 4 client.15204 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:35:58.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fae2d337740 1 -- 172.21.15.49:0/1556292285 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "status"}) -- 0x55f4ef85f610 con 0x55f4ef4d7c90 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fae24b5f640 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55f4ef4d7c90 0x55f4ef9769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fae24b5f640 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55f4ef4d7c90 0x55f4ef9769f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e62232ad05d4eb34 server_cookie=7687e4734d30e5b7 in_seq=0 out_seq=0 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fadfffff640 10 client.15204 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fadfffff640 1 -- 172.21.15.49:0/1556292285 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f4ef85f610 con 0x55f4ef4d7c90 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.762+0000 7fadfffff640 10 client.15204 handle_command_reply: tid=0 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 client.15204 shutdown 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 -- 172.21.15.49:0/1556292285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 msgr2=0x55f4ef910ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef910ac0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fae10030800 tx=0x7fae10030700 comp rx=0 tx=0).stop 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 -- 172.21.15.49:0/1556292285 shutdown_connections 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55f4ef4d7c90 0x55f4ef9769f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f4ef543f60 0x55f4ef90a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f4ef523280 0x55f4ef909f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 --2- 172.21.15.49:0/1556292285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f4ef51b0a0 0x55f4ef910ac0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 -- 172.21.15.49:0/1556292285 >> 172.21.15.49:0/1556292285 conn(0x55f4ef538350 msgr2=0x55f4ef905980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fadfffff640 0 client.15204 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 -- 172.21.15.49:0/1556292285 shutdown_connections 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 1 -- 172.21.15.49:0/1556292285 wait complete. 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae2d337740 20 client.15204 trim_cache size 0 max 16384 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4a3fd104-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 2, 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24676, 2024-09-21T06:35:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-09-21T06:35:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-09-21T06:35:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-09-21T06:35:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 66.808362955000007, 2024-09-21T06:35:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 24, 2024-09-21T06:35:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 76, 2024-09-21T06:35:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T06:35:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 98.709844024000006 2024-09-21T06:35:58.773 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae26dc3640 1 -- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fae0c0b65f0 msgr2=0x7fae0c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae26dc3640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fae0c0b65f0 0x7fae0c0b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fae180acc00 tx=0x7fae18079bb0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae26dc3640 1 -- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2010de70 msgr2=0x7fae2019fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.763+0000 7fae26dc3640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2010de70 0x7fae2019fd40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fae1800d750 tx=0x7fae1800dc10 comp rx=0 tx=0).stop 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.764+0000 7fae26dc3640 1 -- 172.21.15.49:0/3348819781 shutdown_connections 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.764+0000 7fae26dc3640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fae0c0b65f0 0x7fae0c0b8b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.764+0000 7fae26dc3640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fae2010de70 0x7fae2019fd40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.764+0000 7fae26dc3640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fae201052f0 0x7fae2019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.764+0000 7fae26dc3640 1 --2- 172.21.15.49:0/3348819781 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fae201048c0 0x7fae2019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.764+0000 7fae26dc3640 1 -- 172.21.15.49:0/3348819781 >> 172.21.15.49:0/3348819781 conn(0x7fae20079770 msgr2=0x7fae20100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.764+0000 7fae26dc3640 1 -- 172.21.15.49:0/3348819781 shutdown_connections 2024-09-21T06:35:58.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:35:58.764+0000 7fae26dc3640 1 -- 172.21.15.49:0/3348819781 wait complete. 2024-09-21T06:35:59.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:35:58 smithi049 ceph-mon[31177]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:35:59.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:35:58 smithi098 ceph-mon[34704]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:35:59.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:35:58 smithi079 ceph-mon[34346]: pgmap v297: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:35:59.437 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:35:59.695 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:00.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.125+0000 7f0010887640 1 -- 172.21.15.49:0/1237865652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c1052b0 msgr2=0x7f000c10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.125+0000 7f0010887640 1 --2- 172.21.15.49:0/1237865652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c1052b0 0x7f000c10d8f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0000009900 tx=0x7f000002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:00.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.125+0000 7f0010887640 1 -- 172.21.15.49:0/1237865652 shutdown_connections 2024-09-21T06:36:00.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.125+0000 7f0010887640 1 --2- 172.21.15.49:0/1237865652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f000c10de30 0x7f000c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.125+0000 7f0010887640 1 --2- 172.21.15.49:0/1237865652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c1052b0 0x7f000c10d8f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.125+0000 7f0010887640 1 --2- 172.21.15.49:0/1237865652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f000c104880 0x7f000c104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.125+0000 7f0010887640 1 -- 172.21.15.49:0/1237865652 >> 172.21.15.49:0/1237865652 conn(0x7f000c079730 msgr2=0x7f000c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.125+0000 7f0010887640 1 -- 172.21.15.49:0/1237865652 shutdown_connections 2024-09-21T06:36:00.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.125+0000 7f0010887640 1 -- 172.21.15.49:0/1237865652 wait complete. 2024-09-21T06:36:00.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.126+0000 7f0010887640 1 Processor -- start 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.126+0000 7f0010887640 1 -- start start 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f0010887640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c104880 0x7f000c102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f0010887640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f000c1052b0 0x7f000c102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f0010887640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f000c10de30 0x7f000c103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f0010887640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f000c113a70 con 0x7f000c104880 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f0010887640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f000c1138f0 con 0x7f000c10de30 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f0010887640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f000c113bf0 con 0x7f000c1052b0 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c104880 0x7f000c102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c104880 0x7f000c102790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34562/0 (socket says 172.21.15.49:34562) 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000a59c640 1 -- 172.21.15.49:0/553130922 learned_addr learned my addr 172.21.15.49:0/553130922 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f0009d9b640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f000c1052b0 0x7f000c102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000ad9d640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f000c10de30 0x7f000c103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000a59c640 1 -- 172.21.15.49:0/553130922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f000c1052b0 msgr2=0x7f000c102cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000a59c640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f000c1052b0 0x7f000c102cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000a59c640 1 -- 172.21.15.49:0/553130922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f000c10de30 msgr2=0x7f000c103210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000a59c640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f000c10de30 0x7f000c103210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000a59c640 1 -- 172.21.15.49:0/553130922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000c1a86f0 con 0x7f000c104880 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7f000a59c640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c104880 0x7f000c102790 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c970 tx=0x7efffc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.127+0000 7efffb7fe640 1 -- 172.21.15.49:0/553130922 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc007c10 con 0x7f000c104880 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.128+0000 7f0010887640 1 -- 172.21.15.49:0/553130922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f000c1a89e0 con 0x7f000c104880 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.128+0000 7efffb7fe640 1 -- 172.21.15.49:0/553130922 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efffc007db0 con 0x7f000c104880 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.128+0000 7efffb7fe640 1 -- 172.21.15.49:0/553130922 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc00f7d0 con 0x7f000c104880 2024-09-21T06:36:00.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.128+0000 7f0010887640 1 -- 172.21.15.49:0/553130922 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f000c1a8f40 con 0x7f000c104880 2024-09-21T06:36:00.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.130+0000 7f0016dfb740 1 Processor -- start 2024-09-21T06:36:00.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f0016dfb740 1 -- start start 2024-09-21T06:36:00.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7efffb7fe640 1 -- 172.21.15.49:0/553130922 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7efffc00fa70 con 0x7f000c104880 2024-09-21T06:36:00.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e13f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e14440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e14980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f0016dfb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559704d8bc10 con 0x559704a450a0 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f0016dfb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559704d7b040 con 0x559704a6df60 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f0016dfb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559704d7ee50 con 0x559704a4d280 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f000a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e14440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f000a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e14440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34578/0 (socket says 172.21.15.49:34578) 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f000a59c640 1 -- 172.21.15.49:0/1708061345 learned_addr learned my addr 172.21.15.49:0/1708061345 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f000ad9d640 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e13f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.131+0000 7f0009d9b640 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e14980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7f000a59c640 1 -- 172.21.15.49:0/1708061345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 msgr2=0x559704e14980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7f000a59c640 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e14980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7f000a59c640 1 -- 172.21.15.49:0/1708061345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 msgr2=0x559704e13f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7f000a59c640 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e13f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7f000a59c640 1 -- 172.21.15.49:0/1708061345 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559704ad9540 con 0x559704a450a0 2024-09-21T06:36:00.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7f000ad9d640 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e13f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:00.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7f0009d9b640 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e14980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:00.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7f000a59c640 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e14440 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efffc0e50b0 tx=0x7efffc0edcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587f8adf58efe47b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7efffb7fe640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efff40b65f0 0x7efff40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7f000ad9d640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efff40b65f0 0x7efff40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7efff8ff9640 1 -- 172.21.15.49:0/1708061345 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc0f6070 con 0x559704a450a0 2024-09-21T06:36:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7efffb7fe640 1 -- 172.21.15.49:0/553130922 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7efffc0e78a0 con 0x7f000c104880 2024-09-21T06:36:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7efff8ff9640 1 -- 172.21.15.49:0/1708061345 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efffc0ad390 con 0x559704a450a0 2024-09-21T06:36:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.132+0000 7efff8ff9640 1 -- 172.21.15.49:0/1708061345 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc0a9ed0 con 0x559704a450a0 2024-09-21T06:36:00.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.133+0000 7f0016dfb740 1 -- 172.21.15.49:0/1708061345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 msgr2=0x559704e14440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.133+0000 7f000ad9d640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efff40b65f0 0x7efff40b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0004005fd0 tx=0x7f00040096a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.133+0000 7f0016dfb740 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e14440 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7efffc0e50b0 tx=0x7efffc0edcb0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.133+0000 7f0016dfb740 1 -- 172.21.15.49:0/1708061345 shutdown_connections 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.133+0000 7f0016dfb740 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e14980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.133+0000 7f0016dfb740 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e14440 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.133+0000 7f0016dfb740 1 --2- 172.21.15.49:0/1708061345 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e13f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.133+0000 7f0016dfb740 1 -- 172.21.15.49:0/1708061345 >> 172.21.15.49:0/1708061345 conn(0x559704a62350 msgr2=0x559704e11df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 -- 172.21.15.49:0/1708061345 shutdown_connections 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 -- 172.21.15.49:0/1708061345 wait complete. 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 -- start start 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 Processor -- start 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e1fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e2ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559704bdc5f0 con 0x559704a450a0 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559704d16010 con 0x559704a6df60 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559704e226e0 con 0x559704a4d280 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f0016dfb740 10 client.0 _ll_register_callbacks cb 0x559704d75340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f000a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f000a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34586/0 (socket says 172.21.15.49:34586) 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.134+0000 7f000a59c640 1 -- 172.21.15.49:0/728281064 learned_addr learned my addr 172.21.15.49:0/728281064 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f000ad9d640 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e2ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f0009d9b640 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e1fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f000a59c640 1 -- 172.21.15.49:0/728281064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 msgr2=0x559704e1fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f000a59c640 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e1fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f000a59c640 1 -- 172.21.15.49:0/728281064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 msgr2=0x559704e2ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f000a59c640 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e2ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f000a59c640 1 -- 172.21.15.49:0/728281064 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559704d43a00 con 0x559704a450a0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f000a59c640 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1f7d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efffc018e60 tx=0x7efffc0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e922ac9e2267fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7efff1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7efff1ffb640 1 -- 172.21.15.49:0/728281064 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc0f6070 con 0x559704a450a0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7efff1ffb640 1 -- 172.21.15.49:0/728281064 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7efffc00fd60 con 0x559704a450a0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f0016dfb740 1 -- 172.21.15.49:0/728281064 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efffc0ad390 con 0x559704a450a0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7efff1ffb640 1 -- 172.21.15.49:0/728281064 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efffc0acff0 con 0x559704a450a0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f0016dfb740 10 client.15216 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.135+0000 7f0016dfb740 1 -- 172.21.15.49:0/728281064 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559704e2e5d0 con 0x559704a450a0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.136+0000 7efff1ffb640 1 -- 172.21.15.49:0/728281064 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efffc0ad390 con 0x559704a450a0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.136+0000 7efff1ffb640 1 -- 172.21.15.49:0/728281064 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7efffc0b6d80 con 0x559704a450a0 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.136+0000 7f0016dfb740 10 client.15216 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.136+0000 7f0016dfb740 10 client.15216 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:36:00.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.136+0000 7f0016dfb740 20 client.15216 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:00.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.136+0000 7f0016dfb740 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559704a2c8e0 0x559704e2f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.136+0000 7f0016dfb740 4 client.15216 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:00.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.136+0000 7f0016dfb740 1 -- 172.21.15.49:0/728281064 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559704d8db60 con 0x559704a2c8e0 2024-09-21T06:36:00.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.136+0000 7f0009d9b640 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559704a2c8e0 0x559704e2f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.137+0000 7f0009d9b640 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559704a2c8e0 0x559704e2f920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=73a78f72acd8cd79 server_cookie=55d1e8e238da979a in_seq=0 out_seq=0 2024-09-21T06:36:00.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.137+0000 7efff1ffb640 10 client.15216 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:36:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.137+0000 7efff1ffb640 1 -- 172.21.15.49:0/728281064 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559704d8db60 con 0x559704a2c8e0 2024-09-21T06:36:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.137+0000 7efff1ffb640 10 client.15216 handle_command_reply: tid=0 2024-09-21T06:36:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.137+0000 7f0016dfb740 1 client.15216 shutdown 2024-09-21T06:36:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 -- 172.21.15.49:0/728281064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 msgr2=0x559704e1f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1f7d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efffc018e60 tx=0x7efffc0058b0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 -- 172.21.15.49:0/728281064 shutdown_connections 2024-09-21T06:36:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559704a2c8e0 0x559704e2f920 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e2ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e1fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 --2- 172.21.15.49:0/728281064 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1f7d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 -- 172.21.15.49:0/728281064 >> 172.21.15.49:0/728281064 conn(0x559704a62350 msgr2=0x559704e17090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7efff1ffb640 0 client.15216 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:36:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 -- 172.21.15.49:0/728281064 shutdown_connections 2024-09-21T06:36:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 1 -- 172.21.15.49:0/728281064 wait complete. 2024-09-21T06:36:00.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.138+0000 7f0016dfb740 20 client.15216 trim_cache size 0 max 16384 2024-09-21T06:36:00.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f0016dfb740 1 Processor -- start 2024-09-21T06:36:00.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f0016dfb740 1 -- start start 2024-09-21T06:36:00.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e2b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e2beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f0016dfb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559704e2fe70 con 0x559704a450a0 2024-09-21T06:36:00.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f0016dfb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559704e30540 con 0x559704a6df60 2024-09-21T06:36:00.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f0016dfb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559704e30c10 con 0x559704a4d280 2024-09-21T06:36:00.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f000a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f000a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34596/0 (socket says 172.21.15.49:34596) 2024-09-21T06:36:00.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.156+0000 7f000a59c640 1 -- 172.21.15.49:0/1853362187 learned_addr learned my addr 172.21.15.49:0/1853362187 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:00.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f000a59c640 1 -- 172.21.15.49:0/1853362187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 msgr2=0x559704e2b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f000ad9d640 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e2beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f0009d9b640 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e2b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f000a59c640 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e2b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f000a59c640 1 -- 172.21.15.49:0/1853362187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 msgr2=0x559704e2beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f000a59c640 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e2beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f000a59c640 1 -- 172.21.15.49:0/1853362187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559704e16d60 con 0x559704a450a0 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f000ad9d640 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e2beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f0009d9b640 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e2b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7f000a59c640 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1fc90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c940 tx=0x7efffc0edcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d179fc07f940ea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7efff3fff640 1 -- 172.21.15.49:0/1853362187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc0f6030 con 0x559704a450a0 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7efff3fff640 1 -- 172.21.15.49:0/1853362187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efffc0ad390 con 0x559704a450a0 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.157+0000 7efff3fff640 1 -- 172.21.15.49:0/1853362187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efffc0ad1d0 con 0x559704a450a0 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 -- 172.21.15.49:0/1853362187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 msgr2=0x559704e1fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1fc90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c940 tx=0x7efffc0edcb0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 -- 172.21.15.49:0/1853362187 shutdown_connections 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a6df60 0x559704e2beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a4d280 0x559704e2b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 --2- 172.21.15.49:0/1853362187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a450a0 0x559704e1fc90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 -- 172.21.15.49:0/1853362187 >> 172.21.15.49:0/1853362187 conn(0x559704a62350 msgr2=0x559704e1f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 -- 172.21.15.49:0/1853362187 shutdown_connections 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 -- 172.21.15.49:0/1853362187 wait complete. 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 -- start start 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.158+0000 7f0016dfb740 1 Processor -- start 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a450a0 0x559704e38e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a4d280 0x559704e39470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0016dfb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a6df60 0x559704e33400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0016dfb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559704e319b0 con 0x559704a4d280 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0016dfb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559704e312e0 con 0x559704a450a0 2024-09-21T06:36:00.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0016dfb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559704e32080 con 0x559704a6df60 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0009d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a4d280 0x559704e39470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0016dfb740 10 client.0 _ll_register_callbacks cb 0x7f0004009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0009d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a4d280 0x559704e39470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34608/0 (socket says 172.21.15.49:34608) 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0009d9b640 1 -- 172.21.15.49:0/4120150295 learned_addr learned my addr 172.21.15.49:0/4120150295 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f000a59c640 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a450a0 0x559704e38e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f000ad9d640 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a6df60 0x559704e33400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0009d9b640 1 -- 172.21.15.49:0/4120150295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a6df60 msgr2=0x559704e33400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0009d9b640 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a6df60 0x559704e33400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0009d9b640 1 -- 172.21.15.49:0/4120150295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a450a0 msgr2=0x559704e38e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0009d9b640 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a450a0 0x559704e38e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.159+0000 7f0009d9b640 1 -- 172.21.15.49:0/4120150295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559704e33af0 con 0x559704a4d280 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7f0009d9b640 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a4d280 0x559704e39470 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0000000c00 tx=0x7f0000004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d228e51fad168d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7efff1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:00.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7efff1ffb640 1 -- 172.21.15.49:0/4120150295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000035040 con 0x559704a4d280 2024-09-21T06:36:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7efff1ffb640 1 -- 172.21.15.49:0/4120150295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f0000004340 con 0x559704a4d280 2024-09-21T06:36:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7f0016dfb740 1 -- 172.21.15.49:0/4120150295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efffc0ad390 con 0x559704a4d280 2024-09-21T06:36:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7efff1ffb640 1 -- 172.21.15.49:0/4120150295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0000005040 con 0x559704a4d280 2024-09-21T06:36:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7f0016dfb740 10 client.15222 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:00.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7f0016dfb740 1 -- 172.21.15.49:0/4120150295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559704e38310 con 0x559704a4d280 2024-09-21T06:36:00.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7efff1ffb640 1 -- 172.21.15.49:0/4120150295 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efffc0ad390 con 0x559704a4d280 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7efff1ffb640 1 -- 172.21.15.49:0/4120150295 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f00000035f0 con 0x559704a4d280 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7f0016dfb740 10 client.15222 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7f0016dfb740 10 client.15222 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.160+0000 7f0016dfb740 20 client.15222 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.161+0000 7f0016dfb740 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559704a01c90 0x559704ea0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.161+0000 7f0016dfb740 4 client.15222 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.161+0000 7f0016dfb740 1 -- 172.21.15.49:0/4120150295 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "status"}) -- 0x559704d89610 con 0x559704a01c90 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.161+0000 7f000a59c640 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559704a01c90 0x559704ea0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.161+0000 7f000a59c640 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559704a01c90 0x559704ea0130 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7963e28bb3cee53b server_cookie=b3980455342bc6a0 in_seq=0 out_seq=0 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.161+0000 7efff1ffb640 10 client.15222 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.161+0000 7efff1ffb640 1 -- 172.21.15.49:0/4120150295 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559704d89610 con 0x559704a01c90 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.161+0000 7efff1ffb640 10 client.15222 handle_command_reply: tid=0 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.161+0000 7f0016dfb740 1 client.15222 shutdown 2024-09-21T06:36:00.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 -- 172.21.15.49:0/4120150295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a4d280 msgr2=0x559704e39470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a4d280 0x559704e39470 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0000000c00 tx=0x7f0000004040 comp rx=0 tx=0).stop 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 -- 172.21.15.49:0/4120150295 shutdown_connections 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559704a01c90 0x559704ea0130 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7efff1ffb640 0 client.15222 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559704a6df60 0x559704e33400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559704a4d280 0x559704e39470 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 --2- 172.21.15.49:0/4120150295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559704a450a0 0x559704e38e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 -- 172.21.15.49:0/4120150295 >> 172.21.15.49:0/4120150295 conn(0x559704a62350 msgr2=0x559704e11600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 -- 172.21.15.49:0/4120150295 shutdown_connections 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 1 -- 172.21.15.49:0/4120150295 wait complete. 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0016dfb740 20 client.15222 trim_cache size 0 max 16384 2024-09-21T06:36:00.168 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4a3fd104-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 1, 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24685, 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 69.214762386999993, 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 24, 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 76, 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 95.178909286999996 2024-09-21T06:36:00.169 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:36:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0010887640 1 -- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efff40b65f0 msgr2=0x7efff40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0010887640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efff40b65f0 0x7efff40b8b00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0004005fd0 tx=0x7f00040096a0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0010887640 1 -- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c104880 msgr2=0x7f000c102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0010887640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c104880 0x7f000c102790 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efffc00c970 tx=0x7efffc00ce30 comp rx=0 tx=0).stop 2024-09-21T06:36:00.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0010887640 1 -- 172.21.15.49:0/553130922 shutdown_connections 2024-09-21T06:36:00.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.162+0000 7f0010887640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efff40b65f0 0x7efff40b8b00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.163+0000 7f0010887640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f000c10de30 0x7f000c103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.163+0000 7f0010887640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f000c1052b0 0x7f000c102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.163+0000 7f0010887640 1 --2- 172.21.15.49:0/553130922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f000c104880 0x7f000c102790 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:00.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.163+0000 7f0010887640 1 -- 172.21.15.49:0/553130922 >> 172.21.15.49:0/553130922 conn(0x7f000c079730 msgr2=0x7f000c1008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:00.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.163+0000 7f0010887640 1 -- 172.21.15.49:0/553130922 shutdown_connections 2024-09-21T06:36:00.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:00.163+0000 7f0010887640 1 -- 172.21.15.49:0/553130922 wait complete. 2024-09-21T06:36:00.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:36:01.128 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:01.430 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:01 smithi049 ceph-mon[31177]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:36:01.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:01 smithi098 ceph-mon[34704]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:36:01.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:01 smithi079 ceph-mon[34346]: pgmap v298: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:36:01.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 -- 172.21.15.49:0/3387565968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 msgr2=0x7f8984109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 --2- 172.21.15.49:0/3387565968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 0x7f8984109980 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8978009900 tx=0x7f897802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 -- 172.21.15.49:0/3387565968 shutdown_connections 2024-09-21T06:36:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 --2- 172.21.15.49:0/3387565968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8984109ec0 0x7f8984110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 --2- 172.21.15.49:0/3387565968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 0x7f8984109980 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 --2- 172.21.15.49:0/3387565968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984101ba0 0x7f8984101fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 -- 172.21.15.49:0/3387565968 >> 172.21.15.49:0/3387565968 conn(0x7f8984077800 msgr2=0x7f8984077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 -- 172.21.15.49:0/3387565968 shutdown_connections 2024-09-21T06:36:01.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 -- 172.21.15.49:0/3387565968 wait complete. 2024-09-21T06:36:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.635+0000 7f898c37c640 1 Processor -- start 2024-09-21T06:36:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f898c37c640 1 -- start start 2024-09-21T06:36:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f898c37c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8984101ba0 0x7f898419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f898c37c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 0x7f898419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f898c37c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984109ec0 0x7f898419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f898c37c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8984113ab0 con 0x7f8984109570 2024-09-21T06:36:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f898c37c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8984113930 con 0x7f8984109ec0 2024-09-21T06:36:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f898c37c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8984113c30 con 0x7f8984101ba0 2024-09-21T06:36:01.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f8989917640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 0x7f898419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f8989917640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 0x7f898419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34634/0 (socket says 172.21.15.49:34634) 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f8989917640 1 -- 172.21.15.49:0/3522529783 learned_addr learned my addr 172.21.15.49:0/3522529783 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f898a118640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8984101ba0 0x7f898419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f898a919640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984109ec0 0x7f898419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f8989917640 1 -- 172.21.15.49:0/3522529783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8984101ba0 msgr2=0x7f898419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f8989917640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8984101ba0 0x7f898419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f8989917640 1 -- 172.21.15.49:0/3522529783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984109ec0 msgr2=0x7f898419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f8989917640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984109ec0 0x7f898419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.636+0000 7f8989917640 1 -- 172.21.15.49:0/3522529783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89841a0410 con 0x7f8984109570 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.637+0000 7f8989917640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 0x7f898419aa40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f897802a930 tx=0x7f8978004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.637+0000 7f89837fe640 1 -- 172.21.15.49:0/3522529783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897803f030 con 0x7f8984109570 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.637+0000 7f898c37c640 1 -- 172.21.15.49:0/3522529783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89841a06a0 con 0x7f8984109570 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.637+0000 7f89837fe640 1 -- 172.21.15.49:0/3522529783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8978003aa0 con 0x7f8984109570 2024-09-21T06:36:01.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.637+0000 7f89837fe640 1 -- 172.21.15.49:0/3522529783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978035070 con 0x7f8984109570 2024-09-21T06:36:01.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.637+0000 7f898c37c640 1 -- 172.21.15.49:0/3522529783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89841a6e60 con 0x7f8984109570 2024-09-21T06:36:01.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.639+0000 7f89837fe640 1 -- 172.21.15.49:0/3522529783 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f8978042030 con 0x7f8984109570 2024-09-21T06:36:01.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f89928f0740 1 Processor -- start 2024-09-21T06:36:01.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f89928f0740 1 -- start start 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f89928f0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed5cf60 0x558c5f102f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f89928f0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 0x558c5f103440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f89928f0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed3c280 0x558c5f103980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f89928f0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558c5f07ac10 con 0x558c5ed5cf60 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f89928f0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558c5f06a040 con 0x558c5ed3c280 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f89928f0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558c5f06de50 con 0x558c5ed340a0 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f898a919640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed5cf60 0x558c5f102f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f898a919640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed5cf60 0x558c5f102f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34644/0 (socket says 172.21.15.49:34644) 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f898a919640 1 -- 172.21.15.49:0/2226202909 learned_addr learned my addr 172.21.15.49:0/2226202909 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:01.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.640+0000 7f898a118640 1 --2- 172.21.15.49:0/2226202909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 0x558c5f103440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f8989917640 1 --2- 172.21.15.49:0/2226202909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed3c280 0x558c5f103980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f898a919640 1 -- 172.21.15.49:0/2226202909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 msgr2=0x558c5f103440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f898a919640 1 --2- 172.21.15.49:0/2226202909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 0x558c5f103440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f898a919640 1 -- 172.21.15.49:0/2226202909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed3c280 msgr2=0x558c5f103980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f898a919640 1 --2- 172.21.15.49:0/2226202909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed3c280 0x558c5f103980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f89837fe640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f896c0b65f0 0x7f896c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f898a919640 1 -- 172.21.15.49:0/2226202909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c5edc8540 con 0x558c5ed5cf60 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f898a118640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f896c0b65f0 0x7f896c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f89837fe640 1 -- 172.21.15.49:0/3522529783 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f8978107c10 con 0x7f8984109570 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f898a919640 1 --2- 172.21.15.49:0/2226202909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed5cf60 0x558c5f102f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b700 tx=0x7f897c00bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5bd9c4c6ff2fed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f8980d9a640 1 -- 172.21.15.49:0/2226202909 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c003dd0 con 0x558c5ed5cf60 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f8980d9a640 1 -- 172.21.15.49:0/2226202909 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f897c015070 con 0x558c5ed5cf60 2024-09-21T06:36:01.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.641+0000 7f8980d9a640 1 -- 172.21.15.49:0/2226202909 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897c010680 con 0x558c5ed5cf60 2024-09-21T06:36:01.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f89928f0740 1 -- 172.21.15.49:0/2226202909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed5cf60 msgr2=0x558c5f102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f898a118640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f896c0b65f0 0x7f896c0b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x558c5f101b80 tx=0x7f8974009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f89928f0740 1 --2- 172.21.15.49:0/2226202909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed5cf60 0x558c5f102f00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f897c00b700 tx=0x7f897c00bbc0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f89928f0740 1 -- 172.21.15.49:0/2226202909 shutdown_connections 2024-09-21T06:36:01.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f89928f0740 1 --2- 172.21.15.49:0/2226202909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed3c280 0x558c5f103980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f89928f0740 1 --2- 172.21.15.49:0/2226202909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 0x558c5f103440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.647 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f89928f0740 1 --2- 172.21.15.49:0/2226202909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed5cf60 0x558c5f102f00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f89928f0740 1 -- 172.21.15.49:0/2226202909 >> 172.21.15.49:0/2226202909 conn(0x558c5ed51350 msgr2=0x558c5f100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f89928f0740 1 -- 172.21.15.49:0/2226202909 shutdown_connections 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.642+0000 7f89928f0740 1 -- 172.21.15.49:0/2226202909 wait complete. 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f89928f0740 1 -- start start 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f89928f0740 1 Processor -- start 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f89928f0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 0x558c5f10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f89928f0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed3c280 0x558c5f10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f89928f0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f11aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f89928f0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558c5eecb5f0 con 0x558c5ed3c280 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f89928f0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558c5f005010 con 0x558c5ed5cf60 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f89928f0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558c5f1116e0 con 0x558c5ed340a0 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f89928f0740 10 client.0 _ll_register_callbacks cb 0x558c5f064340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f8989917640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed3c280 0x558c5f10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.648 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f8989917640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed3c280 0x558c5f10ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34660/0 (socket says 172.21.15.49:34660) 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f8989917640 1 -- 172.21.15.49:0/2131131435 learned_addr learned my addr 172.21.15.49:0/2131131435 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.643+0000 7f898a919640 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f11aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f898a118640 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 0x558c5f10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8989917640 1 -- 172.21.15.49:0/2131131435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 msgr2=0x558c5f10ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8989917640 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 0x558c5f10ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8989917640 1 -- 172.21.15.49:0/2131131435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 msgr2=0x558c5f11aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8989917640 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f11aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8989917640 1 -- 172.21.15.49:0/2131131435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c5f032a00 con 0x558c5ed3c280 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8989917640 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed3c280 0x558c5f10ef50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f89780ca1e0 tx=0x7f897802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a49d2fc80558c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8969ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8969ffb640 1 -- 172.21.15.49:0/2131131435 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978049030 con 0x558c5ed3c280 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8969ffb640 1 -- 172.21.15.49:0/2131131435 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f89780f10b0 con 0x558c5ed3c280 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f89928f0740 1 -- 172.21.15.49:0/2131131435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f897c015070 con 0x558c5ed3c280 2024-09-21T06:36:01.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8969ffb640 1 -- 172.21.15.49:0/2131131435 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f89780cd560 con 0x558c5ed3c280 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f89928f0740 10 client.15234 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f89928f0740 1 -- 172.21.15.49:0/2131131435 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558c5f11d610 con 0x558c5ed3c280 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.644+0000 7f8969ffb640 1 -- 172.21.15.49:0/2131131435 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f897c015070 con 0x558c5ed3c280 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f8969ffb640 1 -- 172.21.15.49:0/2131131435 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f89780c9e80 con 0x558c5ed3c280 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f89928f0740 10 client.15234 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f89928f0740 10 client.15234 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f89928f0740 20 client.15234 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f89928f0740 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558c5ed1b8e0 0x558c5f1210f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f89928f0740 4 client.15234 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f89928f0740 1 -- 172.21.15.49:0/2131131435 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c5f07cb60 con 0x558c5ed1b8e0 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f898a118640 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558c5ed1b8e0 0x558c5f1210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f898a118640 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558c5ed1b8e0 0x558c5f1210f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a75b9c98c1a00670 server_cookie=74de56e28ebcc518 in_seq=0 out_seq=0 2024-09-21T06:36:01.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.645+0000 7f8969ffb640 10 client.15234 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.646+0000 7f8969ffb640 1 -- 172.21.15.49:0/2131131435 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558c5f07cb60 con 0x558c5ed1b8e0 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.646+0000 7f8969ffb640 10 client.15234 handle_command_reply: tid=0 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.646+0000 7f89928f0740 1 client.15234 shutdown 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.646+0000 7f89928f0740 1 -- 172.21.15.49:0/2131131435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed3c280 msgr2=0x558c5f10ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.646+0000 7f89928f0740 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed3c280 0x558c5f10ef50 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f89780ca1e0 tx=0x7f897802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f89928f0740 1 -- 172.21.15.49:0/2131131435 shutdown_connections 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f89928f0740 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558c5ed1b8e0 0x558c5f1210f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f89928f0740 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f11aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f89928f0740 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed3c280 0x558c5f10ef50 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f89928f0740 1 --2- 172.21.15.49:0/2131131435 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed340a0 0x558c5f10ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f89928f0740 1 -- 172.21.15.49:0/2131131435 >> 172.21.15.49:0/2131131435 conn(0x558c5ed51350 msgr2=0x558c5f1060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f8969ffb640 0 client.15234 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:01.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f89928f0740 1 -- 172.21.15.49:0/2131131435 shutdown_connections 2024-09-21T06:36:01.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f89928f0740 1 -- 172.21.15.49:0/2131131435 wait complete. 2024-09-21T06:36:01.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.647+0000 7f89928f0740 20 client.15234 trim_cache size 0 max 16384 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f89928f0740 1 Processor -- start 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f89928f0740 1 -- start start 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f89928f0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f109a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f89928f0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 0x558c5f109f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f89928f0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f11a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f89928f0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558c5f11f430 con 0x558c5ed340a0 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f89928f0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558c5f11fb00 con 0x558c5ed5cf60 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f89928f0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558c5f1201d0 con 0x558c5ed3c280 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f898a118640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f109a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f898a118640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f109a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34674/0 (socket says 172.21.15.49:34674) 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.665+0000 7f898a118640 1 -- 172.21.15.49:0/582998796 learned_addr learned my addr 172.21.15.49:0/582998796 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:01.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f8989917640 1 --2- 172.21.15.49:0/582998796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 0x558c5f109f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f898a118640 1 -- 172.21.15.49:0/582998796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 msgr2=0x558c5f109f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f898a118640 1 --2- 172.21.15.49:0/582998796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 0x558c5f109f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f898a118640 1 -- 172.21.15.49:0/582998796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 msgr2=0x558c5f11a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f898a118640 1 --2- 172.21.15.49:0/582998796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f11a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f898a118640 1 -- 172.21.15.49:0/582998796 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c5f10f4b0 con 0x558c5ed340a0 2024-09-21T06:36:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f898a118640 1 --2- 172.21.15.49:0/582998796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f109a30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8974005fd0 tx=0x7f8974016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13f9fd9cb338605 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f896bfff640 1 -- 172.21.15.49:0/582998796 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8974004d20 con 0x558c5ed340a0 2024-09-21T06:36:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f896bfff640 1 -- 172.21.15.49:0/582998796 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f897401da20 con 0x558c5ed340a0 2024-09-21T06:36:01.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.666+0000 7f896bfff640 1 -- 172.21.15.49:0/582998796 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89740054c0 con 0x558c5ed340a0 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 -- 172.21.15.49:0/582998796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 msgr2=0x558c5f109a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 --2- 172.21.15.49:0/582998796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f109a30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8974005fd0 tx=0x7f8974016000 comp rx=0 tx=0).stop 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 -- 172.21.15.49:0/582998796 shutdown_connections 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 --2- 172.21.15.49:0/582998796 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f11a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 --2- 172.21.15.49:0/582998796 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 0x558c5f109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 --2- 172.21.15.49:0/582998796 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f109a30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 -- 172.21.15.49:0/582998796 >> 172.21.15.49:0/582998796 conn(0x558c5ed51350 msgr2=0x558c5f10e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 -- 172.21.15.49:0/582998796 shutdown_connections 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 -- 172.21.15.49:0/582998796 wait complete. 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 -- start start 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.667+0000 7f89928f0740 1 Processor -- start 2024-09-21T06:36:01.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f89928f0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f1232e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f89928f0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 0x558c5f123820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f89928f0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f123d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f89928f0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558c5f120f70 con 0x558c5ed340a0 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f89928f0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558c5f1208a0 con 0x558c5ed5cf60 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f89928f0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558c5f121640 con 0x558c5ed3c280 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f89928f0740 10 client.0 _ll_register_callbacks cb 0x7f8978005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a118640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f1232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a118640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f1232e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34678/0 (socket says 172.21.15.49:34678) 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a118640 1 -- 172.21.15.49:0/1196716444 learned_addr learned my addr 172.21.15.49:0/1196716444 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f8989917640 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 0x558c5f123820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a919640 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f123d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a118640 1 -- 172.21.15.49:0/1196716444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 msgr2=0x558c5f123820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a118640 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 0x558c5f123820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a118640 1 -- 172.21.15.49:0/1196716444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 msgr2=0x558c5f123d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a118640 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f123d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a118640 1 -- 172.21.15.49:0/1196716444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c5f128a70 con 0x558c5ed340a0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f898a118640 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f1232e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8974004fa0 tx=0x7f897401fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5db5a5310a400d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f8969ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f8969ffb640 1 -- 172.21.15.49:0/1196716444 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897401d570 con 0x558c5ed340a0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f8969ffb640 1 -- 172.21.15.49:0/1196716444 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f897401d710 con 0x558c5ed340a0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.668+0000 7f89928f0740 1 -- 172.21.15.49:0/1196716444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f897401da20 con 0x558c5ed340a0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f8969ffb640 1 -- 172.21.15.49:0/1196716444 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f89740049e0 con 0x558c5ed340a0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f89928f0740 10 client.15240 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f89928f0740 1 -- 172.21.15.49:0/1196716444 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x558c5f18c7a0 con 0x558c5ed340a0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f8969ffb640 1 -- 172.21.15.49:0/1196716444 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f897401da20 con 0x558c5ed340a0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f8969ffb640 1 -- 172.21.15.49:0/1196716444 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f897401a040 con 0x558c5ed340a0 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f89928f0740 10 client.15240 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:01.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f89928f0740 10 client.15240 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f89928f0740 20 client.15240 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f89928f0740 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558c5ecf0c90 0x558c5f18fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f89928f0740 4 client.15240 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.669+0000 7f89928f0740 1 -- 172.21.15.49:0/1196716444 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "status"}) -- 0x558c5f078610 con 0x558c5ecf0c90 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f8989917640 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558c5ecf0c90 0x558c5f18fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f8969ffb640 10 client.15240 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f8989917640 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558c5ecf0c90 0x558c5f18fd30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e08e53aabdf82742 server_cookie=c8daf8f41cb4310c in_seq=0 out_seq=0 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f8969ffb640 1 -- 172.21.15.49:0/1196716444 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x558c5f078610 con 0x558c5ecf0c90 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f8969ffb640 10 client.15240 handle_command_reply: tid=0 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f89928f0740 1 client.15240 shutdown 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f89928f0740 1 -- 172.21.15.49:0/1196716444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 msgr2=0x558c5f1232e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f89928f0740 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f1232e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8974004fa0 tx=0x7f897401fc80 comp rx=0 tx=0).stop 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f89928f0740 1 -- 172.21.15.49:0/1196716444 shutdown_connections 2024-09-21T06:36:01.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f89928f0740 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558c5ecf0c90 0x558c5f18fd30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f89928f0740 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558c5ed5cf60 0x558c5f123d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f89928f0740 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558c5ed3c280 0x558c5f123820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f89928f0740 1 --2- 172.21.15.49:0/1196716444 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558c5ed340a0 0x558c5f1232e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f89928f0740 1 -- 172.21.15.49:0/1196716444 >> 172.21.15.49:0/1196716444 conn(0x558c5ed51350 msgr2=0x558c5f11e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.670+0000 7f8969ffb640 0 client.15240 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f89928f0740 1 -- 172.21.15.49:0/1196716444 shutdown_connections 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f89928f0740 1 -- 172.21.15.49:0/1196716444 wait complete. 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f89928f0740 20 client.15240 trim_cache size 0 max 16384 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4a3fd104-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:36:01.677 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24686, 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 77.767103332000005, 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 24, 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 76, 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 88.125938215000005 2024-09-21T06:36:01.678 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 -- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f896c0b65f0 msgr2=0x7f896c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f896c0b65f0 0x7f896c0b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x558c5f101b80 tx=0x7f8974009680 comp rx=0 tx=0).stop 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 -- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 msgr2=0x7f898419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 0x7f898419aa40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f897802a930 tx=0x7f8978004270 comp rx=0 tx=0).stop 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 -- 172.21.15.49:0/3522529783 shutdown_connections 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f896c0b65f0 0x7f896c0b8b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8984109ec0 0x7f898419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8984109570 0x7f898419aa40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 --2- 172.21.15.49:0/3522529783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8984101ba0 0x7f898419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 -- 172.21.15.49:0/3522529783 >> 172.21.15.49:0/3522529783 conn(0x7f8984077800 msgr2=0x7f8984100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 -- 172.21.15.49:0/3522529783 shutdown_connections 2024-09-21T06:36:01.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:01.671+0000 7f898c37c640 1 -- 172.21.15.49:0/3522529783 wait complete. 2024-09-21T06:36:02.410 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T06:36:02.410 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:36:02.419 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:36:02.419 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T06:36:02.675 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:03.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.169+0000 7f654c0fd640 1 -- 172.21.15.49:0/681084150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 msgr2=0x7f6544110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.169+0000 7f654c0fd640 1 --2- 172.21.15.49:0/681084150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 0x7f6544110330 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f653c009ca0 tx=0x7f653c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.169+0000 7f654c0fd640 1 -- 172.21.15.49:0/681084150 shutdown_connections 2024-09-21T06:36:03.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.169+0000 7f654c0fd640 1 --2- 172.21.15.49:0/681084150 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 0x7f6544110330 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.169+0000 7f654c0fd640 1 --2- 172.21.15.49:0/681084150 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65441052a0 0x7f654410d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.169+0000 7f654c0fd640 1 --2- 172.21.15.49:0/681084150 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6544104870 0x7f6544104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.169+0000 7f654c0fd640 1 -- 172.21.15.49:0/681084150 >> 172.21.15.49:0/681084150 conn(0x7f6544079750 msgr2=0x7f6544079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:03.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.169+0000 7f654c0fd640 1 -- 172.21.15.49:0/681084150 shutdown_connections 2024-09-21T06:36:03.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.170+0000 7f654c0fd640 1 -- 172.21.15.49:0/681084150 wait complete. 2024-09-21T06:36:03.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.170+0000 7f654c0fd640 1 Processor -- start 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.170+0000 7f654c0fd640 1 -- start start 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654c0fd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6544104870 0x7f654419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654c0fd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65441052a0 0x7f654419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654c0fd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 0x7f654419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654c0fd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6544113aa0 con 0x7f654410de20 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654c0fd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6544113920 con 0x7f6544104870 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654c0fd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6544113c20 con 0x7f65441052a0 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654a69a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 0x7f654419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654a69a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 0x7f654419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34688/0 (socket says 172.21.15.49:34688) 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654a69a640 1 -- 172.21.15.49:0/2724298859 learned_addr learned my addr 172.21.15.49:0/2724298859 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:03.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f6549e99640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6544104870 0x7f654419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f6549698640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65441052a0 0x7f654419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654a69a640 1 -- 172.21.15.49:0/2724298859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65441052a0 msgr2=0x7f654419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654a69a640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65441052a0 0x7f654419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654a69a640 1 -- 172.21.15.49:0/2724298859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6544104870 msgr2=0x7f654419a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654a69a640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6544104870 0x7f654419a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.171+0000 7f654a69a640 1 -- 172.21.15.49:0/2724298859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65441a0380 con 0x7f654410de20 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.172+0000 7f654a69a640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 0x7f654419fd10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f653c005cc0 tx=0x7f653c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.172+0000 7f653affd640 1 -- 172.21.15.49:0/2724298859 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c003cf0 con 0x7f654410de20 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.172+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65441a0610 con 0x7f654410de20 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.172+0000 7f653affd640 1 -- 172.21.15.49:0/2724298859 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f653c0044f0 con 0x7f654410de20 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.172+0000 7f653affd640 1 -- 172.21.15.49:0/2724298859 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653c02fc30 con 0x7f654410de20 2024-09-21T06:36:03.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.172+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65441a6e90 con 0x7f654410de20 2024-09-21T06:36:03.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.173+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f654406c220 con 0x7f654410de20 2024-09-21T06:36:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.175+0000 7f653affd640 1 -- 172.21.15.49:0/2724298859 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f653c0046a0 con 0x7f654410de20 2024-09-21T06:36:03.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.176+0000 7f653affd640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65300b6620 0x7f65300b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.176+0000 7f6549e99640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65300b6620 0x7f65300b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.176+0000 7f653affd640 1 -- 172.21.15.49:0/2724298859 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f653c108ba0 con 0x7f654410de20 2024-09-21T06:36:03.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.177+0000 7f6549e99640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65300b6620 0x7f65300b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f654406c920 tx=0x7f654000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:03.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.179+0000 7f653affd640 1 -- 172.21.15.49:0/2724298859 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f653c0cf1f0 con 0x7f654410de20 2024-09-21T06:36:03.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.388+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f6544108040 con 0x7f65300b6620 2024-09-21T06:36:03.391 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:03 smithi049 ceph-mon[31177]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:36:03.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.390+0000 7f653affd640 1 -- 172.21.15.49:0/2724298859 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f6544108040 con 0x7f65300b6620 2024-09-21T06:36:03.391 INFO:teuthology.orchestra.run.smithi049.stdout:Backend: cephadm 2024-09-21T06:36:03.392 INFO:teuthology.orchestra.run.smithi049.stdout:Available: Yes 2024-09-21T06:36:03.392 INFO:teuthology.orchestra.run.smithi049.stdout:Paused: No 2024-09-21T06:36:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.392+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65300b6620 msgr2=0x7f65300b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.392+0000 7f654c0fd640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65300b6620 0x7f65300b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f654406c920 tx=0x7f654000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.392+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 msgr2=0x7f654419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.392+0000 7f654c0fd640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 0x7f654419fd10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f653c005cc0 tx=0x7f653c02f470 comp rx=0 tx=0).stop 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.393+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 shutdown_connections 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.393+0000 7f654c0fd640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65300b6620 0x7f65300b8b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.393+0000 7f654c0fd640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f654410de20 0x7f654419fd10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.393+0000 7f654c0fd640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f65441052a0 0x7f654419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.393+0000 7f654c0fd640 1 --2- 172.21.15.49:0/2724298859 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6544104870 0x7f654419a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.393+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 >> 172.21.15.49:0/2724298859 conn(0x7f6544079750 msgr2=0x7f6544107930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.393+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 shutdown_connections 2024-09-21T06:36:03.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:03.393+0000 7f654c0fd640 1 -- 172.21.15.49:0/2724298859 wait complete. 2024-09-21T06:36:03.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:03 smithi098 ceph-mon[34704]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:36:03.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:03 smithi079 ceph-mon[34346]: pgmap v299: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:36:04.069 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T06:36:04.327 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:04.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:04 smithi049 ceph-mon[31177]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:04.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:04 smithi098 ceph-mon[34704]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:04.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:04 smithi079 ceph-mon[34346]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.744+0000 7f6c289cf640 1 -- 172.21.15.49:0/1765969677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c241094c0 msgr2=0x7f6c241098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.744+0000 7f6c289cf640 1 --2- 172.21.15.49:0/1765969677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c241094c0 0x7f6c241098d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009900 tx=0x7f6c0c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.745+0000 7f6c289cf640 1 -- 172.21.15.49:0/1765969677 shutdown_connections 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.745+0000 7f6c289cf640 1 --2- 172.21.15.49:0/1765969677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c24109e10 0x7f6c24110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.745+0000 7f6c289cf640 1 --2- 172.21.15.49:0/1765969677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c241094c0 0x7f6c241098d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.745+0000 7f6c289cf640 1 --2- 172.21.15.49:0/1765969677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c24103b80 0x7f6c24103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.745+0000 7f6c289cf640 1 -- 172.21.15.49:0/1765969677 >> 172.21.15.49:0/1765969677 conn(0x7f6c240ff5d0 msgr2=0x7f6c24101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.745+0000 7f6c289cf640 1 -- 172.21.15.49:0/1765969677 shutdown_connections 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.745+0000 7f6c289cf640 1 -- 172.21.15.49:0/1765969677 wait complete. 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.745+0000 7f6c289cf640 1 Processor -- start 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.745+0000 7f6c289cf640 1 -- start start 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c289cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c24103b80 0x7f6c2419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c289cf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c241094c0 0x7f6c2419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c289cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c24109e10 0x7f6c2419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c289cf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6c24113b20 con 0x7f6c24103b80 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c289cf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6c241139a0 con 0x7f6c24109e10 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c289cf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6c24113ca0 con 0x7f6c241094c0 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c24103b80 0x7f6c2419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c2259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c24103b80 0x7f6c2419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34700/0 (socket says 172.21.15.49:34700) 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c2259c640 1 -- 172.21.15.49:0/2668488586 learned_addr learned my addr 172.21.15.49:0/2668488586 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c21d9b640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c241094c0 0x7f6c2419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c22d9d640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c24109e10 0x7f6c2419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c2259c640 1 -- 172.21.15.49:0/2668488586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c241094c0 msgr2=0x7f6c2419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c2259c640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c241094c0 0x7f6c2419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c2259c640 1 -- 172.21.15.49:0/2668488586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c24109e10 msgr2=0x7f6c2419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c2259c640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c24109e10 0x7f6c2419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c2259c640 1 -- 172.21.15.49:0/2668488586 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c241a0380 con 0x7f6c24103b80 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.746+0000 7f6c2259c640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c24103b80 0x7f6c2419a4d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00cce0 tx=0x7f6c1c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.747+0000 7f6c1b7fe640 1 -- 172.21.15.49:0/2668488586 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c004b20 con 0x7f6c24103b80 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.747+0000 7f6c1b7fe640 1 -- 172.21.15.49:0/2668488586 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c1c004cc0 con 0x7f6c24103b80 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.747+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c241a0670 con 0x7f6c24103b80 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.747+0000 7f6c1b7fe640 1 -- 172.21.15.49:0/2668488586 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c00f6b0 con 0x7f6c24103b80 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.747+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c240755f0 con 0x7f6c24103b80 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.748+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c24104e00 con 0x7f6c24103b80 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.749+0000 7f6c1b7fe640 1 -- 172.21.15.49:0/2668488586 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f6c1c00f850 con 0x7f6c24103b80 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.750+0000 7f6c1b7fe640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6c100b6620 0x7f6c100b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.750+0000 7f6c21d9b640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6c100b6620 0x7f6c100b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.750+0000 7f6c1b7fe640 1 -- 172.21.15.49:0/2668488586 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f6c1c0e7a00 con 0x7f6c24103b80 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.751+0000 7f6c21d9b640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6c100b6620 0x7f6c100b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c02a9e0 tx=0x7f6c0c005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:04.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.753+0000 7f6c1b7fe640 1 -- 172.21.15.49:0/2668488586 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c1c014030 con 0x7f6c24103b80 2024-09-21T06:36:04.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.949+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6c24063800 con 0x7f6c100b6620 2024-09-21T06:36:04.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.962+0000 7f6c1b7fe640 1 -- 172.21.15.49:0/2668488586 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f6c24063800 con 0x7f6c100b6620 2024-09-21T06:36:04.963 INFO:teuthology.orchestra.run.smithi049.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.a smithi049 running (94s) 17s ago 93s 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 f33742388f73 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.b smithi079 running (91s) 23s ago 91s 94.1M - 19.3.0-5120-g18432218 ddce307e1f32 5b485a5417c9 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.c smithi098 running (105s) 24s ago 104s 85.1M - 19.3.0-5120-g18432218 ddce307e1f32 21d70cb7e6a7 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.d smithi049 running (113s) 17s ago 112s 82.4M - 19.3.0-5120-g18432218 ddce307e1f32 abe6e30bd3f3 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.e smithi079 running (110s) 23s ago 109s 84.7M - 19.3.0-5120-g18432218 ddce307e1f32 38046e04c28e 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.f smithi098 running (107s) 24s ago 107s 85.2M - 19.3.0-5120-g18432218 ddce307e1f32 8dc5e4d6d215 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.g smithi049 running (97s) 17s ago 96s 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 047847e5223e 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.h smithi079 running (102s) 23s ago 102s 84.2M - 19.3.0-5120-g18432218 ddce307e1f32 80337552f03d 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.i smithi098 running (100s) 24s ago 99s 87.9M - 19.3.0-5120-g18432218 ddce307e1f32 4f7bf42b82f7 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.j smithi049 running (116s) 17s ago 115s 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 7dc3a2b44995 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.k smithi079 running (118s) 23s ago 118s 82.3M - 19.3.0-5120-g18432218 ddce307e1f32 5a3ae4097bae 2024-09-21T06:36:04.964 INFO:teuthology.orchestra.run.smithi049.stdout:mds.l smithi098 running (2m) 24s ago 2m 81.6M - 19.3.0-5120-g18432218 ddce307e1f32 1aaf4aeb560c 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.x smithi049 *:9283,8765 running (9m) 17s ago 9m 584M - 19.3.0-5120-g18432218 ddce307e1f32 ceece99d7dcb 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.y smithi079 *:8443,8765 running (7m) 23s ago 7m 524M - 19.3.0-5120-g18432218 ddce307e1f32 6a90bda024dd 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:mgr.z smithi098 *:8443,8765 running (7m) 24s ago 7m 524M - 19.3.0-5120-g18432218 ddce307e1f32 50c71a99bb54 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:mon.a smithi049 running (9m) 17s ago 9m 121M 2048M 19.3.0-5120-g18432218 ddce307e1f32 df426c7319b6 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:mon.b smithi079 running (8m) 23s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 c1d1b9372ce3 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:mon.c smithi098 running (8m) 24s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 5193bec175e8 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 smithi049 running (6m) 17s ago 6m 115M 4272M 19.3.0-5120-g18432218 ddce307e1f32 55d2959a3811 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 smithi079 running (6m) 23s ago 6m 116M 4272M 19.3.0-5120-g18432218 ddce307e1f32 21983f6b7b14 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 smithi098 running (6m) 24s ago 6m 115M 4272M 19.3.0-5120-g18432218 ddce307e1f32 557c85ac0c1d 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 smithi049 running (5m) 17s ago 5m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 a04e3df349bf 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 smithi079 running (5m) 23s ago 5m 116M 4272M 19.3.0-5120-g18432218 ddce307e1f32 c9f188b9adce 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 smithi098 running (4m) 24s ago 4m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 8a2e2585ff2a 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:osd.6 smithi049 running (4m) 17s ago 4m 112M 4272M 19.3.0-5120-g18432218 ddce307e1f32 e3f2994bd31b 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:osd.7 smithi079 running (3m) 23s ago 3m 122M 4272M 19.3.0-5120-g18432218 ddce307e1f32 8c0aa88e88a0 2024-09-21T06:36:04.965 INFO:teuthology.orchestra.run.smithi049.stdout:osd.8 smithi098 running (3m) 24s ago 3m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b2a68c1f6a59 2024-09-21T06:36:04.966 INFO:teuthology.orchestra.run.smithi049.stdout:osd.9 smithi049 running (3m) 17s ago 3m 117M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ec269e96a715 2024-09-21T06:36:04.966 INFO:teuthology.orchestra.run.smithi049.stdout:osd.10 smithi079 running (2m) 23s ago 2m 113M 4272M 19.3.0-5120-g18432218 ddce307e1f32 9abb33a9d61b 2024-09-21T06:36:04.966 INFO:teuthology.orchestra.run.smithi049.stdout:osd.11 smithi098 running (2m) 24s ago 2m 114M 4272M 19.3.0-5120-g18432218 ddce307e1f32 58d9df12dee5 2024-09-21T06:36:04.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6c100b6620 msgr2=0x7f6c100b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6c100b6620 0x7f6c100b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c02a9e0 tx=0x7f6c0c005a20 comp rx=0 tx=0).stop 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c24103b80 msgr2=0x7f6c2419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c24103b80 0x7f6c2419a4d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00cce0 tx=0x7f6c1c00a620 comp rx=0 tx=0).stop 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 shutdown_connections 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6c100b6620 0x7f6c100b8b30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6c24109e10 0x7f6c2419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6c241094c0 0x7f6c2419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 --2- 172.21.15.49:0/2668488586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6c24103b80 0x7f6c2419a4d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 >> 172.21.15.49:0/2668488586 conn(0x7f6c240ff5d0 msgr2=0x7f6c241019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 shutdown_connections 2024-09-21T06:36:04.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:04.964+0000 7f6c289cf640 1 -- 172.21.15.49:0/2668488586 wait complete. 2024-09-21T06:36:05.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:05 smithi049 ceph-mon[31177]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:36:05.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:05 smithi098 ceph-mon[34704]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:36:05.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:05 smithi079 ceph-mon[34346]: pgmap v300: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:36:05.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T06:36:05.929 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:06.311 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:06 smithi049 ceph-mon[31177]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:06.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1954555411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac81049b0 msgr2=0x7f5ac8104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:06.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1954555411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac81049b0 0x7f5ac8104dc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009900 tx=0x7f5ab802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:06.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1954555411 shutdown_connections 2024-09-21T06:36:06.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1954555411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac810de10 0x7f5ac8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1954555411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac8105300 0x7f5ac810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1954555411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac81049b0 0x7f5ac8104dc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1954555411 >> 172.21.15.49:0/1954555411 conn(0x7f5ac8079730 msgr2=0x7f5ac8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:06.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1954555411 shutdown_connections 2024-09-21T06:36:06.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1954555411 wait complete. 2024-09-21T06:36:06.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 Processor -- start 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.403+0000 7f5ace4d6640 1 -- start start 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5ace4d6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac81049b0 0x7f5ac81026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5ace4d6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac8105300 0x7f5ac8102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5ace4d6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac810de10 0x7f5ac8103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5ace4d6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8113a90 con 0x7f5ac810de10 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5ace4d6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8113910 con 0x7f5ac81049b0 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5ace4d6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac8113c10 con 0x7f5ac8105300 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5acca73640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac810de10 0x7f5ac8103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5acca73640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac810de10 0x7f5ac8103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47906/0 (socket says 172.21.15.49:47906) 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5acca73640 1 -- 172.21.15.49:0/1214380423 learned_addr learned my addr 172.21.15.49:0/1214380423 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5ac77fe640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac8105300 0x7f5ac8102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5ac7fff640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac81049b0 0x7f5ac81026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:06.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5acca73640 1 -- 172.21.15.49:0/1214380423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac8105300 msgr2=0x7f5ac8102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5acca73640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac8105300 0x7f5ac8102c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5acca73640 1 -- 172.21.15.49:0/1214380423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac81049b0 msgr2=0x7f5ac81026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5acca73640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac81049b0 0x7f5ac81026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.404+0000 7f5acca73640 1 -- 172.21.15.49:0/1214380423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac81a86d0 con 0x7f5ac810de10 2024-09-21T06:36:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.405+0000 7f5acca73640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac810de10 0x7f5ac8103170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000eaa0 tx=0x7f5ac000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.405+0000 7f5ac57fa640 1 -- 172.21.15.49:0/1214380423 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0004d20 con 0x7f5ac810de10 2024-09-21T06:36:06.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.405+0000 7f5ac57fa640 1 -- 172.21.15.49:0/1214380423 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ac0005020 con 0x7f5ac810de10 2024-09-21T06:36:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.405+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac81a89c0 con 0x7f5ac810de10 2024-09-21T06:36:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.405+0000 7f5ac57fa640 1 -- 172.21.15.49:0/1214380423 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00116b0 con 0x7f5ac810de10 2024-09-21T06:36:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.405+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac81a8f00 con 0x7f5ac810de10 2024-09-21T06:36:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.406+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac8104dc0 con 0x7f5ac810de10 2024-09-21T06:36:06.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.407+0000 7f5ac57fa640 1 -- 172.21.15.49:0/1214380423 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f5ac00051d0 con 0x7f5ac810de10 2024-09-21T06:36:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.408+0000 7f5ac57fa640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5ab00b65f0 0x7f5ab00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.408+0000 7f5ac7fff640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5ab00b65f0 0x7f5ab00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.408+0000 7f5ac57fa640 1 -- 172.21.15.49:0/1214380423 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f5ac00e7740 con 0x7f5ac810de10 2024-09-21T06:36:06.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.409+0000 7f5ac7fff640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5ab00b65f0 0x7f5ab00b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009230 tx=0x7f5ab8031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:06.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.413+0000 7f5ac57fa640 1 -- 172.21.15.49:0/1214380423 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ac0016030 con 0x7f5ac810de10 2024-09-21T06:36:06.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:06 smithi098 ceph-mon[34704]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:06.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:06 smithi079 ceph-mon[34346]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:06.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.614+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f5ac8063800 con 0x7f5ab00b65f0 2024-09-21T06:36:06.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.621+0000 7f5ac57fa640 1 -- 172.21.15.49:0/1214380423 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f5ac8063800 con 0x7f5ab00b65f0 2024-09-21T06:36:06.622 INFO:teuthology.orchestra.run.smithi049.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T06:36:06.623 INFO:teuthology.orchestra.run.smithi049.stdout:mds.all 12/12 25s ago 2m smithi049=a;smithi049=d;smithi049=g;smithi049=j;smithi079=b;smithi079=e;smithi079=h;smithi079=k;smithi098=c;smithi098=f;smithi098=i;smithi098=l;count:12 2024-09-21T06:36:06.623 INFO:teuthology.orchestra.run.smithi049.stdout:mgr 3/3 25s ago 7m smithi049=x;smithi079=y;smithi098=z;count:3 2024-09-21T06:36:06.623 INFO:teuthology.orchestra.run.smithi049.stdout:mon 3/3 25s ago 8m smithi049:172.21.15.49=a;smithi079:172.21.15.79=b;smithi098:172.21.15.98=c;count:3 2024-09-21T06:36:06.623 INFO:teuthology.orchestra.run.smithi049.stdout:osd 12 25s ago - 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5ab00b65f0 msgr2=0x7f5ab00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5ab00b65f0 0x7f5ab00b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8009230 tx=0x7f5ab8031400 comp rx=0 tx=0).stop 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac810de10 msgr2=0x7f5ac8103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac810de10 0x7f5ac8103170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000eaa0 tx=0x7f5ac000eea0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 shutdown_connections 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5ab00b65f0 0x7f5ab00b8b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5ac810de10 0x7f5ac8103170 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5ac8105300 0x7f5ac8102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 --2- 172.21.15.49:0/1214380423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5ac81049b0 0x7f5ac81026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:06.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 >> 172.21.15.49:0/1214380423 conn(0x7f5ac8079730 msgr2=0x7f5ac8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:06.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 shutdown_connections 2024-09-21T06:36:06.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:06.623+0000 7f5ace4d6640 1 -- 172.21.15.49:0/1214380423 wait complete. 2024-09-21T06:36:07.211 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T06:36:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:07 smithi049 ceph-mon[31177]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T06:36:07.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:07 smithi049 ceph-mon[31177]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:07.479 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:07.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:07 smithi098 ceph-mon[34704]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T06:36:07.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:07 smithi098 ceph-mon[34704]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:07.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:07 smithi079 ceph-mon[34346]: pgmap v301: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T06:36:07.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:07 smithi079 ceph-mon[34346]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:07.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.954+0000 7f608ca30640 1 -- 172.21.15.49:0/373842088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 msgr2=0x7f6088110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.954+0000 7f608ca30640 1 --2- 172.21.15.49:0/373842088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 0x7f6088110620 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6080009ca0 tx=0x7f608002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.954+0000 7f608ca30640 1 -- 172.21.15.49:0/373842088 shutdown_connections 2024-09-21T06:36:07.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.954+0000 7f608ca30640 1 --2- 172.21.15.49:0/373842088 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 0x7f6088110620 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.954+0000 7f608ca30640 1 --2- 172.21.15.49:0/373842088 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f60881094a0 0x7f60881098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.954+0000 7f608ca30640 1 --2- 172.21.15.49:0/373842088 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6088103b60 0x7f6088103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.954+0000 7f608ca30640 1 -- 172.21.15.49:0/373842088 >> 172.21.15.49:0/373842088 conn(0x7f608807b850 msgr2=0x7f608807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:07.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.955+0000 7f608ca30640 1 -- 172.21.15.49:0/373842088 shutdown_connections 2024-09-21T06:36:07.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.955+0000 7f608ca30640 1 -- 172.21.15.49:0/373842088 wait complete. 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.955+0000 7f608ca30640 1 Processor -- start 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.955+0000 7f608ca30640 1 -- start start 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f608ca30640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6088103b60 0x7f6088075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f608ca30640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60881094a0 0x7f6088075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f608ca30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 0x7f6088076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f608ca30640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6088113bc0 con 0x7f6088109df0 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f608ca30640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6088113a40 con 0x7f6088103b60 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f608ca30640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6088113d40 con 0x7f60881094a0 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f6086d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 0x7f6088076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f6086d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 0x7f6088076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47924/0 (socket says 172.21.15.49:47924) 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f6086d9d640 1 -- 172.21.15.49:0/3286583666 learned_addr learned my addr 172.21.15.49:0/3286583666 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f608659c640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6088103b60 0x7f6088075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f6085d9b640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60881094a0 0x7f6088075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f6086d9d640 1 -- 172.21.15.49:0/3286583666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60881094a0 msgr2=0x7f6088075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f6086d9d640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60881094a0 0x7f6088075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f6086d9d640 1 -- 172.21.15.49:0/3286583666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6088103b60 msgr2=0x7f6088075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f6086d9d640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6088103b60 0x7f6088075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.956+0000 7f6086d9d640 1 -- 172.21.15.49:0/3286583666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60881a8890 con 0x7f6088109df0 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.957+0000 7f6086d9d640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 0x7f6088076190 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6080003bd0 tx=0x7f6080003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.957+0000 7f607f7fe640 1 -- 172.21.15.49:0/3286583666 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080004240 con 0x7f6088109df0 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.957+0000 7f607f7fe640 1 -- 172.21.15.49:0/3286583666 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6080003e20 con 0x7f6088109df0 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.957+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60881a8b20 con 0x7f6088109df0 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.957+0000 7f607f7fe640 1 -- 172.21.15.49:0/3286583666 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6080030eb0 con 0x7f6088109df0 2024-09-21T06:36:07.960 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.957+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60881a90b0 con 0x7f6088109df0 2024-09-21T06:36:07.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.958+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6088103ff0 con 0x7f6088109df0 2024-09-21T06:36:07.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.959+0000 7f607f7fe640 1 -- 172.21.15.49:0/3286583666 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f60800305e0 con 0x7f6088109df0 2024-09-21T06:36:07.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.960+0000 7f607f7fe640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f60740b6670 0x7f60740b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.961+0000 7f608659c640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f60740b6670 0x7f60740b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.961+0000 7f607f7fe640 1 -- 172.21.15.49:0/3286583666 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f60801089b0 con 0x7f6088109df0 2024-09-21T06:36:07.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.961+0000 7f608659c640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f60740b6670 0x7f60740b8b80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6088077160 tx=0x7f6070009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:07.964+0000 7f607f7fe640 1 -- 172.21.15.49:0/3286583666 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60800cf000 con 0x7f6088109df0 2024-09-21T06:36:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.160+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f6088063800 con 0x7f60740b6670 2024-09-21T06:36:08.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.161+0000 7f607f7fe640 1 -- 172.21.15.49:0/3286583666 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7f6088063800 con 0x7f60740b6670 2024-09-21T06:36:08.163 INFO:teuthology.orchestra.run.smithi049.stdout:HOST ADDR LABELS STATUS 2024-09-21T06:36:08.163 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 172.21.15.49 2024-09-21T06:36:08.163 INFO:teuthology.orchestra.run.smithi049.stdout:smithi079 172.21.15.79 2024-09-21T06:36:08.163 INFO:teuthology.orchestra.run.smithi049.stdout:smithi098 172.21.15.98 2024-09-21T06:36:08.163 INFO:teuthology.orchestra.run.smithi049.stdout:3 hosts in cluster 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f60740b6670 msgr2=0x7f60740b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f60740b6670 0x7f60740b8b80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6088077160 tx=0x7f6070009110 comp rx=0 tx=0).stop 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 msgr2=0x7f6088076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 0x7f6088076190 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6080003bd0 tx=0x7f6080003c00 comp rx=0 tx=0).stop 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 shutdown_connections 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f60740b6670 0x7f60740b8b80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6088109df0 0x7f6088076190 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f60881094a0 0x7f6088075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 --2- 172.21.15.49:0/3286583666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6088103b60 0x7f6088075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 >> 172.21.15.49:0/3286583666 conn(0x7f608807b850 msgr2=0x7f6088107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 shutdown_connections 2024-09-21T06:36:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:08.164+0000 7f608ca30640 1 -- 172.21.15.49:0/3286583666 wait complete. 2024-09-21T06:36:08.944 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T06:36:09.202 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:09.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:09 smithi098 ceph-mon[34704]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:36:09.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:09 smithi098 ceph-mon[34704]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:09.561 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:09 smithi049 ceph-mon[31177]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:36:09.561 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:09 smithi049 ceph-mon[31177]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:09.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:09 smithi079 ceph-mon[34346]: pgmap v302: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-21T06:36:09.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:09 smithi079 ceph-mon[34346]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:09.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.655+0000 7f3ea6422640 1 -- 172.21.15.49:0/3361644493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0104920 msgr2=0x7f3ea0104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.655+0000 7f3ea6422640 1 --2- 172.21.15.49:0/3361644493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0104920 0x7f3ea0104d30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009900 tx=0x7f3e9002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:09.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.655+0000 7f3ea6422640 1 -- 172.21.15.49:0/3361644493 shutdown_connections 2024-09-21T06:36:09.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.655+0000 7f3ea6422640 1 --2- 172.21.15.49:0/3361644493 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea010ded0 0x7f3ea0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.655+0000 7f3ea6422640 1 --2- 172.21.15.49:0/3361644493 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0105270 0x7f3ea010d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.655+0000 7f3ea6422640 1 --2- 172.21.15.49:0/3361644493 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0104920 0x7f3ea0104d30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.655+0000 7f3ea6422640 1 -- 172.21.15.49:0/3361644493 >> 172.21.15.49:0/3361644493 conn(0x7f3ea0079760 msgr2=0x7f3ea0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.655+0000 7f3ea6422640 1 -- 172.21.15.49:0/3361644493 shutdown_connections 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.655+0000 7f3ea6422640 1 -- 172.21.15.49:0/3361644493 wait complete. 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3ea6422640 1 Processor -- start 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3ea6422640 1 -- start start 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3ea6422640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0104920 0x7f3ea019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3ea6422640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0105270 0x7f3ea019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3ea6422640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea010ded0 0x7f3ea019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3ea6422640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea0113aa0 con 0x7f3ea0105270 2024-09-21T06:36:09.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3ea6422640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea0113920 con 0x7f3ea010ded0 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3ea6422640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea0113c20 con 0x7f3ea0104920 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3e9f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0105270 0x7f3ea019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3e9f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0105270 0x7f3ea019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47944/0 (socket says 172.21.15.49:47944) 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.656+0000 7f3e9f7fe640 1 -- 172.21.15.49:0/1513529710 learned_addr learned my addr 172.21.15.49:0/1513529710 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9ffff640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0104920 0x7f3ea019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3ea49bf640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea010ded0 0x7f3ea019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9f7fe640 1 -- 172.21.15.49:0/1513529710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0104920 msgr2=0x7f3ea019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9f7fe640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0104920 0x7f3ea019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9f7fe640 1 -- 172.21.15.49:0/1513529710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea010ded0 msgr2=0x7f3ea019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9f7fe640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea010ded0 0x7f3ea019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9f7fe640 1 -- 172.21.15.49:0/1513529710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea01a0460 con 0x7f3ea0105270 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3ea49bf640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea010ded0 0x7f3ea019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9f7fe640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0105270 0x7f3ea019aa90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3e94005fd0 tx=0x7f3e9400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:09.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9d7fa640 1 -- 172.21.15.49:0/1513529710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94017070 con 0x7f3ea0105270 2024-09-21T06:36:09.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9d7fa640 1 -- 172.21.15.49:0/1513529710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e94009c30 con 0x7f3ea0105270 2024-09-21T06:36:09.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea01a0750 con 0x7f3ea0105270 2024-09-21T06:36:09.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3e9d7fa640 1 -- 172.21.15.49:0/1513529710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94003d30 con 0x7f3ea0105270 2024-09-21T06:36:09.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.657+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea01a6eb0 con 0x7f3ea0105270 2024-09-21T06:36:09.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.658+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ea006c130 con 0x7f3ea0105270 2024-09-21T06:36:09.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.660+0000 7f3e9d7fa640 1 -- 172.21.15.49:0/1513529710 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7f3e94003ed0 con 0x7f3ea0105270 2024-09-21T06:36:09.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.661+0000 7f3e9d7fa640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3e880b6670 0x7f3e880b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:09.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.661+0000 7f3e9ffff640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3e880b6670 0x7f3e880b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:09.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.661+0000 7f3e9d7fa640 1 -- 172.21.15.49:0/1513529710 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7f3e940e7ae0 con 0x7f3ea0105270 2024-09-21T06:36:09.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.661+0000 7f3e9ffff640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3e880b6670 0x7f3e880b8b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3e90000c00 tx=0x7f3e90031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:09.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.664+0000 7f3e9d7fa640 1 -- 172.21.15.49:0/1513529710 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e94020030 con 0x7f3ea0105270 2024-09-21T06:36:09.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.857+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f3ea0063800 con 0x7f3e880b6670 2024-09-21T06:36:09.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.860+0000 7f3e9d7fa640 1 -- 172.21.15.49:0/1513529710 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f3ea0063800 con 0x7f3e880b6670 2024-09-21T06:36:09.861 INFO:teuthology.orchestra.run.smithi049.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T06:36:09.861 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747500D2480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T06:36:09.862 INFO:teuthology.orchestra.run.smithi049.stdout:smithi079 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204013G400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T06:36:09.862 INFO:teuthology.orchestra.run.smithi049.stdout:smithi098 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010H400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3e880b6670 msgr2=0x7f3e880b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3e880b6670 0x7f3e880b8b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3e90000c00 tx=0x7f3e90031400 comp rx=0 tx=0).stop 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0105270 msgr2=0x7f3ea019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0105270 0x7f3ea019aa90 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3e94005fd0 tx=0x7f3e9400dde0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 shutdown_connections 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3e880b6670 0x7f3e880b8b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3ea010ded0 0x7f3ea019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3ea0105270 0x7f3ea019aa90 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 --2- 172.21.15.49:0/1513529710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3ea0104920 0x7f3ea019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:09.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 >> 172.21.15.49:0/1513529710 conn(0x7f3ea0079760 msgr2=0x7f3ea0100900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:09.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 shutdown_connections 2024-09-21T06:36:09.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:09.862+0000 7f3ea6422640 1 -- 172.21.15.49:0/1513529710 wait complete. 2024-09-21T06:36:10.431 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:10 smithi049 ceph-mon[31177]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:10.459 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:36:10.468 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:36:10.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T06:36:10.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:10 smithi098 ceph-mon[34704]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:10.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:10 smithi079 ceph-mon[34346]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:10.727 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.142+0000 7fa9add3a640 1 -- 172.21.15.49:0/2938929526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a81094a0 msgr2=0x7fa9a81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.142+0000 7fa9add3a640 1 --2- 172.21.15.49:0/2938929526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a81094a0 0x7fa9a81098b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa990009900 tx=0x7fa99002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.142+0000 7fa9add3a640 1 -- 172.21.15.49:0/2938929526 shutdown_connections 2024-09-21T06:36:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.142+0000 7fa9add3a640 1 --2- 172.21.15.49:0/2938929526 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a8109df0 0x7fa9a8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.142+0000 7fa9add3a640 1 --2- 172.21.15.49:0/2938929526 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a81094a0 0x7fa9a81098b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.142+0000 7fa9add3a640 1 --2- 172.21.15.49:0/2938929526 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9a8103b60 0x7fa9a8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.142+0000 7fa9add3a640 1 -- 172.21.15.49:0/2938929526 >> 172.21.15.49:0/2938929526 conn(0x7fa9a807b850 msgr2=0x7fa9a807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:11.144 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.142+0000 7fa9add3a640 1 -- 172.21.15.49:0/2938929526 shutdown_connections 2024-09-21T06:36:11.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.142+0000 7fa9add3a640 1 -- 172.21.15.49:0/2938929526 wait complete. 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.143+0000 7fa9add3a640 1 Processor -- start 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.143+0000 7fa9add3a640 1 -- start start 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9add3a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8103b60 0x7fa9a819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9add3a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a81094a0 0x7fa9a819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9add3a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9a8109df0 0x7fa9a819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9add3a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8113ab0 con 0x7fa9a8103b60 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9add3a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8113930 con 0x7fa9a81094a0 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9add3a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a8113c30 con 0x7fa9a8109df0 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8103b60 0x7fa9a819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8103b60 0x7fa9a819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47960/0 (socket says 172.21.15.49:47960) 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a77fe640 1 -- 172.21.15.49:0/289717709 learned_addr learned my addr 172.21.15.49:0/289717709 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a7fff640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9a8109df0 0x7fa9a819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a6ffd640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a81094a0 0x7fa9a819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a77fe640 1 -- 172.21.15.49:0/289717709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9a8109df0 msgr2=0x7fa9a819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a77fe640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9a8109df0 0x7fa9a819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a77fe640 1 -- 172.21.15.49:0/289717709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a81094a0 msgr2=0x7fa9a819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a77fe640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a81094a0 0x7fa9a819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a77fe640 1 -- 172.21.15.49:0/289717709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a81a0410 con 0x7fa9a8103b60 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a7fff640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9a8109df0 0x7fa9a819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a6ffd640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a81094a0 0x7fa9a819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.144+0000 7fa9a77fe640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8103b60 0x7fa9a819a560 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c920 tx=0x7fa99800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.145+0000 7fa9a4ff9640 1 -- 172.21.15.49:0/289717709 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998007c70 con 0x7fa9a8103b60 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.145+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a81a0700 con 0x7fa9a8103b60 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.145+0000 7fa9a4ff9640 1 -- 172.21.15.49:0/289717709 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa998007e10 con 0x7fa9a8103b60 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.145+0000 7fa9a4ff9640 1 -- 172.21.15.49:0/289717709 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998018820 con 0x7fa9a8103b60 2024-09-21T06:36:11.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.145+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a81a6f20 con 0x7fa9a8103b60 2024-09-21T06:36:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.146+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a8103f70 con 0x7fa9a8103b60 2024-09-21T06:36:11.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.147+0000 7fa9a4ff9640 1 -- 172.21.15.49:0/289717709 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa99800f450 con 0x7fa9a8103b60 2024-09-21T06:36:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.148+0000 7fa9a4ff9640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9940b6620 0x7fa9940b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.148+0000 7fa9a6ffd640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9940b6620 0x7fa9940b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.149+0000 7fa9a4ff9640 1 -- 172.21.15.49:0/289717709 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fa9980e77e0 con 0x7fa9a8103b60 2024-09-21T06:36:11.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.149+0000 7fa9a6ffd640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9940b6620 0x7fa9940b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa990000c00 tx=0x7fa990031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.153+0000 7fa9a4ff9640 1 -- 172.21.15.49:0/289717709 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa998014030 con 0x7fa9a8103b60 2024-09-21T06:36:11.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.380+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa9a802e640 con 0x7fa9a8103b60 2024-09-21T06:36:11.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.381+0000 7fa9a4ff9640 1 -- 172.21.15.49:0/289717709 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3074 (secure 0 0 0) 0x7fa9980ade30 con 0x7fa9a8103b60 2024-09-21T06:36:11.383 INFO:teuthology.orchestra.run.smithi049.stdout:e24 2024-09-21T06:36:11.383 INFO:teuthology.orchestra.run.smithi049.stdout:btime 2024-09-21T06:34:54:962997+0000 2024-09-21T06:36:11.383 INFO:teuthology.orchestra.run.smithi049.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:36:11.383 INFO:teuthology.orchestra.run.smithi049.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:36:11.383 INFO:teuthology.orchestra.run.smithi049.stdout:legacy client fscid: 1 2024-09-21T06:36:11.383 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:11.383 INFO:teuthology.orchestra.run.smithi049.stdout:Filesystem 'cephfs' (1) 2024-09-21T06:36:11.383 INFO:teuthology.orchestra.run.smithi049.stdout:fs_name cephfs 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 24 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-21T06:34:43.531339+0000 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-21T06:34:54.645934+0000 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:tableserver 0 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:root 0 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:session_timeout 300 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:session_autoclose 300 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:max_file_size 1099511627776 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:max_xattr_size 65536 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:required_client_features {} 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure 0 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:last_failure_osd_epoch 0 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:36:11.384 INFO:teuthology.orchestra.run.smithi049.stdout:max_mds 3 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:in 0,1,2 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:up {0=24686,1=24685,2=24676} 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:failed 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:damaged 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:stopped 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:data_pools [3] 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:metadata_pool 2 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:inline_data disabled 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:balancer 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:bal_rank_mask -1 2024-09-21T06:36:11.385 INFO:teuthology.orchestra.run.smithi049.stdout:standby_count_wanted 0 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout:qdb_cluster leader: 24686 members: 24676,24685,24686 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.b{0:24686} state up:active seq 4 addr [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.f{0:24664} state up:standby-replay seq 1 addr [v2:172.21.15.98:6834/1874380420,v1:172.21.15.98:6835/1874380420] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.i{1:24685} state up:active seq 8 addr [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.h{1:24656} state up:standby-replay seq 1 addr [v2:172.21.15.79:6836/1540546438,v1:172.21.15.79:6837/1540546438] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.c{2:24676} state up:active seq 9 addr [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.e{2:24638} state up:standby-replay seq 1 addr [v2:172.21.15.79:6834/1332274866,v1:172.21.15.79:6835/1332274866] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout:Standby daemons: 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:11.386 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.j{-1:14766} state up:standby seq 1 addr [v2:172.21.15.49:6834/3345748950,v1:172.21.15.49:6835/3345748950] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.387 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.d{-1:14778} state up:standby seq 1 addr [v2:172.21.15.49:6836/3068546594,v1:172.21.15.49:6837/3068546594] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.387 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.g{-1:14826} state up:standby seq 1 addr [v2:172.21.15.49:6838/649653683,v1:172.21.15.49:6839/649653683] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.387 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.a{-1:14832} state up:standby seq 1 addr [v2:172.21.15.49:6840/3262402873,v1:172.21.15.49:6841/3262402873] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.387 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.k{-1:24617} state up:standby seq 1 addr [v2:172.21.15.79:6832/3655012367,v1:172.21.15.79:6833/3655012367] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.387 INFO:teuthology.orchestra.run.smithi049.stdout:[mds.l{-1:24622} state up:standby seq 1 addr [v2:172.21.15.98:6832/144176304,v1:172.21.15.98:6833/144176304] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:36:11.387 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2024-09-21T06:36:11.387 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:11 smithi049 ceph-mon[31177]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T06:36:11.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9940b6620 msgr2=0x7fa9940b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9940b6620 0x7fa9940b8b30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa990000c00 tx=0x7fa990031400 comp rx=0 tx=0).stop 2024-09-21T06:36:11.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8103b60 msgr2=0x7fa9a819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8103b60 0x7fa9a819a560 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa99800c920 tx=0x7fa99800cde0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 shutdown_connections 2024-09-21T06:36:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9940b6620 0x7fa9940b8b30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9a8109df0 0x7fa9a819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa9a81094a0 0x7fa9a819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 --2- 172.21.15.49:0/289717709 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9a8103b60 0x7fa9a819a560 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 >> 172.21.15.49:0/289717709 conn(0x7fa9a807b850 msgr2=0x7fa9a81075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 shutdown_connections 2024-09-21T06:36:11.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:11.383+0000 7fa9add3a640 1 -- 172.21.15.49:0/289717709 wait complete. 2024-09-21T06:36:11.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:11 smithi098 ceph-mon[34704]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T06:36:11.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:11 smithi079 ceph-mon[34346]: pgmap v303: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T06:36:12.068 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T06:36:12.329 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:12.447 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:12 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/289717709' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:36:12.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:12 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/289717709' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:36:12.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:12 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/289717709' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:36:12.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.789+0000 7fa66f560640 1 -- 172.21.15.49:0/1751791352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668102080 msgr2=0x7fa668102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:12.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.789+0000 7fa66f560640 1 --2- 172.21.15.49:0/1751791352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668102080 0x7fa668102490 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa664009ca0 tx=0x7fa66402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.789+0000 7fa66f560640 1 -- 172.21.15.49:0/1751791352 shutdown_connections 2024-09-21T06:36:12.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.789+0000 7fa66f560640 1 --2- 172.21.15.49:0/1751791352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa668109eb0 0x7fa6681106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.789+0000 7fa66f560640 1 --2- 172.21.15.49:0/1751791352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa668109560 0x7fa668109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.789+0000 7fa66f560640 1 --2- 172.21.15.49:0/1751791352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668102080 0x7fa668102490 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.789+0000 7fa66f560640 1 -- 172.21.15.49:0/1751791352 >> 172.21.15.49:0/1751791352 conn(0x7fa668079ec0 msgr2=0x7fa66807a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:12.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.789+0000 7fa66f560640 1 -- 172.21.15.49:0/1751791352 shutdown_connections 2024-09-21T06:36:12.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.789+0000 7fa66f560640 1 -- 172.21.15.49:0/1751791352 wait complete. 2024-09-21T06:36:12.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.790+0000 7fa66f560640 1 Processor -- start 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.790+0000 7fa66f560640 1 -- start start 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66f560640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa668102080 0x7fa66819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66f560640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668109560 0x7fa66819ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66f560640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa668109eb0 0x7fa66819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66f560640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa668113b70 con 0x7fa668109560 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66f560640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa6681139f0 con 0x7fa668109eb0 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66f560640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa668113cf0 con 0x7fa668102080 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66cafb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668109560 0x7fa66819ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66cafb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668109560 0x7fa66819ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47974/0 (socket says 172.21.15.49:47974) 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66cafb640 1 -- 172.21.15.49:0/1999233138 learned_addr learned my addr 172.21.15.49:0/1999233138 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66dafd640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa668109eb0 0x7fa66819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66d2fc640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa668102080 0x7fa66819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:12.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66cafb640 1 -- 172.21.15.49:0/1999233138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa668102080 msgr2=0x7fa66819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66cafb640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa668102080 0x7fa66819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66cafb640 1 -- 172.21.15.49:0/1999233138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa668109eb0 msgr2=0x7fa66819fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66cafb640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa668109eb0 0x7fa66819fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66cafb640 1 -- 172.21.15.49:0/1999233138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6681a0510 con 0x7fa668109560 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66cafb640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668109560 0x7fa66819ab40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00d950 tx=0x7fa65c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa65a7fc640 1 -- 172.21.15.49:0/1999233138 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c017070 con 0x7fa668109560 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.791+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6681a0800 con 0x7fa668109560 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.792+0000 7fa65a7fc640 1 -- 172.21.15.49:0/1999233138 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa65c009c30 con 0x7fa668109560 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.792+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6681a6f60 con 0x7fa668109560 2024-09-21T06:36:12.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.792+0000 7fa65a7fc640 1 -- 172.21.15.49:0/1999233138 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa65c0047a0 con 0x7fa668109560 2024-09-21T06:36:12.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.793+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa668102490 con 0x7fa668109560 2024-09-21T06:36:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.794+0000 7fa65a7fc640 1 -- 172.21.15.49:0/1999233138 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 21) ==== 154580+0+0 (secure 0 0 0) 0x7fa65c004020 con 0x7fa668109560 2024-09-21T06:36:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.795+0000 7fa65a7fc640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6540b65f0 0x7fa6540b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.795+0000 7fa66d2fc640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6540b65f0 0x7fa6540b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.795+0000 7fa65a7fc640 1 -- 172.21.15.49:0/1999233138 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 8463+0+0 (secure 0 0 0) 0x7fa65c0e7280 con 0x7fa668109560 2024-09-21T06:36:12.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.796+0000 7fa66d2fc640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6540b65f0 0x7fa6540b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa664000f80 tx=0x7fa664009360 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:12.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.799+0000 7fa65a7fc640 1 -- 172.21.15.49:0/1999233138 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa65c020020 con 0x7fa668109560 2024-09-21T06:36:12.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.994+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fa66810bce0 con 0x7fa668109560 2024-09-21T06:36:12.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.995+0000 7fa65a7fc640 1 -- 172.21.15.49:0/1999233138 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v76) ==== 56+0+5656 (secure 0 0 0) 0x7fa65c0ad8d0 con 0x7fa668109560 2024-09-21T06:36:12.998 INFO:teuthology.orchestra.run.smithi049.stdout:epoch 76 2024-09-21T06:36:12.998 INFO:teuthology.orchestra.run.smithi049.stdout:fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:36:12.998 INFO:teuthology.orchestra.run.smithi049.stdout:created 2024-09-21T06:26:23.438487+0000 2024-09-21T06:36:12.998 INFO:teuthology.orchestra.run.smithi049.stdout:modified 2024-09-21T06:35:13.227165+0000 2024-09-21T06:36:12.998 INFO:teuthology.orchestra.run.smithi049.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T06:36:12.998 INFO:teuthology.orchestra.run.smithi049.stdout:crush_version 26 2024-09-21T06:36:12.998 INFO:teuthology.orchestra.run.smithi049.stdout:full_ratio 0.95 2024-09-21T06:36:12.998 INFO:teuthology.orchestra.run.smithi049.stdout:backfillfull_ratio 0.9 2024-09-21T06:36:12.998 INFO:teuthology.orchestra.run.smithi049.stdout:nearfull_ratio 0.85 2024-09-21T06:36:12.999 INFO:teuthology.orchestra.run.smithi049.stdout:require_min_compat_client luminous 2024-09-21T06:36:12.999 INFO:teuthology.orchestra.run.smithi049.stdout:min_compat_client luminous 2024-09-21T06:36:12.999 INFO:teuthology.orchestra.run.smithi049.stdout:require_osd_release squid 2024-09-21T06:36:12.999 INFO:teuthology.orchestra.run.smithi049.stdout:stretch_mode_enabled false 2024-09-21T06:36:12.999 INFO:teuthology.orchestra.run.smithi049.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T06:36:12.999 INFO:teuthology.orchestra.run.smithi049.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-21T06:36:12.999 INFO:teuthology.orchestra.run.smithi049.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T06:36:12.999 INFO:teuthology.orchestra.run.smithi049.stdout:max_osd 12 2024-09-21T06:36:12.999 INFO:teuthology.orchestra.run.smithi049.stdout:osd.0 up in weight 1 up_from 9 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6802/3210538796,v1:172.21.15.49:6803/3210538796] [v2:172.21.15.49:6804/3210538796,v1:172.21.15.49:6805/3210538796] exists,up f7e75c04-e943-49d1-b755-eea63952deac 2024-09-21T06:36:13.000 INFO:teuthology.orchestra.run.smithi049.stdout:osd.1 up in weight 1 up_from 14 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/2324008814,v1:172.21.15.79:6801/2324008814] [v2:172.21.15.79:6802/2324008814,v1:172.21.15.79:6803/2324008814] exists,up fda4851b-7967-4ce0-8ddc-0535145fd111 2024-09-21T06:36:13.000 INFO:teuthology.orchestra.run.smithi049.stdout:osd.2 up in weight 1 up_from 19 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6800/2078306584,v1:172.21.15.98:6801/2078306584] [v2:172.21.15.98:6802/2078306584,v1:172.21.15.98:6803/2078306584] exists,up 4f748692-8431-4e81-8762-0e92b80ede11 2024-09-21T06:36:13.000 INFO:teuthology.orchestra.run.smithi049.stdout:osd.3 up in weight 1 up_from 25 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6810/2305435073,v1:172.21.15.49:6811/2305435073] [v2:172.21.15.49:6812/2305435073,v1:172.21.15.49:6813/2305435073] exists,up 0e648fc9-af23-4980-8379-692e4ca5548f 2024-09-21T06:36:13.000 INFO:teuthology.orchestra.run.smithi049.stdout:osd.4 up in weight 1 up_from 31 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6808/302730711,v1:172.21.15.79:6809/302730711] [v2:172.21.15.79:6810/302730711,v1:172.21.15.79:6811/302730711] exists,up 55463d33-e576-4e98-ac6b-62c264d1efac 2024-09-21T06:36:13.000 INFO:teuthology.orchestra.run.smithi049.stdout:osd.5 up in weight 1 up_from 36 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6808/497453656,v1:172.21.15.98:6809/497453656] [v2:172.21.15.98:6810/497453656,v1:172.21.15.98:6811/497453656] exists,up db652115-165f-4226-aec4-f0d0971e8395 2024-09-21T06:36:13.000 INFO:teuthology.orchestra.run.smithi049.stdout:osd.6 up in weight 1 up_from 42 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6818/306059620,v1:172.21.15.49:6819/306059620] [v2:172.21.15.49:6820/306059620,v1:172.21.15.49:6821/306059620] exists,up 889a9a6d-e3ad-4d6e-931c-b20e0e47c84e 2024-09-21T06:36:13.000 INFO:teuthology.orchestra.run.smithi049.stdout:osd.7 up in weight 1 up_from 48 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6816/3688302425,v1:172.21.15.79:6817/3688302425] [v2:172.21.15.79:6818/3688302425,v1:172.21.15.79:6819/3688302425] exists,up a34b10e4-7b61-4d29-aed8-1c18e98dc8ae 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:osd.8 up in weight 1 up_from 53 up_thru 72 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6816/415055064,v1:172.21.15.98:6817/415055064] [v2:172.21.15.98:6818/415055064,v1:172.21.15.98:6819/415055064] exists,up 1f6bee13-9c82-4580-824f-db812385bbbe 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:osd.9 up in weight 1 up_from 59 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.49:6826/3971172806,v1:172.21.15.49:6827/3971172806] [v2:172.21.15.49:6828/3971172806,v1:172.21.15.49:6829/3971172806] exists,up d40c6e35-9aac-4e01-bcdf-fbdf15e06099 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:osd.10 up in weight 1 up_from 63 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6824/194415108,v1:172.21.15.79:6825/194415108] [v2:172.21.15.79:6826/194415108,v1:172.21.15.79:6827/194415108] exists,up add766c1-16ba-4411-ab43-7acaf3d5c480 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:osd.11 up in weight 1 up_from 68 up_thru 75 down_at 0 last_clean_interval [0,0) [v2:172.21.15.98:6824/4262170082,v1:172.21.15.98:6825/4262170082] [v2:172.21.15.98:6826/4262170082,v1:172.21.15.98:6827/4262170082] exists,up b2ccde96-c178-4fb1-8bb9-6c0093978251 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 2.14 [2,4] 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.7 [3,9] 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.e [5,9] 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.11 [4,8] 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.1d [4,7] 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.21 [4,7] 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.27 [4,6] 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.28 [3,6] 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:pg_upmap_items 3.37 [1,9,5,8] 2024-09-21T06:36:13.001 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/3036880811 expires 2024-09-22T06:28:12.020916+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/913847396 expires 2024-09-22T06:28:12.020916+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6800/679391324 expires 2024-09-22T06:27:11.553726+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6801/679391324 expires 2024-09-22T06:27:11.553726+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/1476806315 expires 2024-09-22T06:27:11.553726+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/4148430613 expires 2024-09-22T06:26:45.038217+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/2496147530 expires 2024-09-22T06:28:12.020916+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6800/1732676845 expires 2024-09-22T06:26:45.038217+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/4271034131 expires 2024-09-22T06:26:45.038217+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6801/4218148883 expires 2024-09-22T06:28:12.020916+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6801/1732676845 expires 2024-09-22T06:26:45.038217+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/1947753988 expires 2024-09-22T06:27:11.553726+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/136334353 expires 2024-09-22T06:27:11.553726+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:0/2741549070 expires 2024-09-22T06:26:45.038217+0000 2024-09-21T06:36:13.002 INFO:teuthology.orchestra.run.smithi049.stdout:blocklist 172.21.15.49:6800/4218148883 expires 2024-09-22T06:28:12.020916+0000 2024-09-21T06:36:13.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6540b65f0 msgr2=0x7fa6540b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:13.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6540b65f0 0x7fa6540b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa664000f80 tx=0x7fa664009360 comp rx=0 tx=0).stop 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668109560 msgr2=0x7fa66819ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668109560 0x7fa66819ab40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00d950 tx=0x7fa65c00de10 comp rx=0 tx=0).stop 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 shutdown_connections 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6540b65f0 0x7fa6540b8b00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa668109eb0 0x7fa66819fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa668109560 0x7fa66819ab40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 --2- 172.21.15.49:0/1999233138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa668102080 0x7fa66819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 >> 172.21.15.49:0/1999233138 conn(0x7fa668079ec0 msgr2=0x7fa668107650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 shutdown_connections 2024-09-21T06:36:13.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:12.997+0000 7fa66f560640 1 -- 172.21.15.49:0/1999233138 wait complete. 2024-09-21T06:36:13.450 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:13 smithi049 ceph-mon[31177]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:36:13.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T06:36:13.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T06:36:13.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:13 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]} : dispatch 2024-09-21T06:36:13.451 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:13 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1999233138' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:36:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:13 smithi098 ceph-mon[34704]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:36:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T06:36:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T06:36:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:13 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]} : dispatch 2024-09-21T06:36:13.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:13 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1999233138' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:36:13.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:13 smithi079 ceph-mon[34346]: pgmap v304: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:36:13.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-09-21T06:36:13.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T06:36:13.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:13 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]} : dispatch 2024-09-21T06:36:13.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:13 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1999233138' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:36:13.700 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T06:36:13.711 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:36:13.966 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:14.359 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T06:36:14.359 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T06:36:14.359 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:14 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-21T06:36:14.359 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:14 smithi049 ceph-mon[31177]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:36:14.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.449+0000 7f7fe30a3640 1 -- 172.21.15.49:0/1154498145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc102a80 msgr2=0x7f7fdc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.449+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/1154498145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc102a80 0x7f7fdc102e90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4009900 tx=0x7f7fc402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:14.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.449+0000 7f7fe30a3640 1 -- 172.21.15.49:0/1154498145 shutdown_connections 2024-09-21T06:36:14.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.449+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/1154498145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fdc108d10 0x7f7fdc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.449+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/1154498145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fdc1083c0 0x7f7fdc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.449+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/1154498145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc102a80 0x7f7fdc102e90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.449+0000 7f7fe30a3640 1 -- 172.21.15.49:0/1154498145 >> 172.21.15.49:0/1154498145 conn(0x7f7fdc079740 msgr2=0x7f7fdc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:14.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.449+0000 7f7fe30a3640 1 -- 172.21.15.49:0/1154498145 shutdown_connections 2024-09-21T06:36:14.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.449+0000 7f7fe30a3640 1 -- 172.21.15.49:0/1154498145 wait complete. 2024-09-21T06:36:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe30a3640 1 Processor -- start 2024-09-21T06:36:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe30a3640 1 -- start start 2024-09-21T06:36:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe30a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fdc102a80 0x7f7fdc19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe30a3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc1083c0 0x7f7fdc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe30a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fdc108d10 0x7f7fdc19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe30a3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc112980 con 0x7f7fdc1083c0 2024-09-21T06:36:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe30a3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc112800 con 0x7f7fdc102a80 2024-09-21T06:36:14.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe30a3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7fdc112b00 con 0x7f7fdc108d10 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fdbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc1083c0 0x7f7fdc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fdbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc1083c0 0x7f7fdc19ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47986/0 (socket says 172.21.15.49:47986) 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fdbfff640 1 -- 172.21.15.49:0/580335916 learned_addr learned my addr 172.21.15.49:0/580335916 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe0e3f640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fdc102a80 0x7f7fdc19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fe1640640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fdc108d10 0x7f7fdc19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fdbfff640 1 -- 172.21.15.49:0/580335916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fdc108d10 msgr2=0x7f7fdc19fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fdbfff640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fdc108d10 0x7f7fdc19fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fdbfff640 1 -- 172.21.15.49:0/580335916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fdc102a80 msgr2=0x7f7fdc19a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fdbfff640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fdc102a80 0x7f7fdc19a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.450+0000 7f7fdbfff640 1 -- 172.21.15.49:0/580335916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fdc1a04f0 con 0x7f7fdc1083c0 2024-09-21T06:36:14.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.451+0000 7f7fdbfff640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc1083c0 0x7f7fdc19ab20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00ea50 tx=0x7f7fcc00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.451+0000 7f7fd9ffb640 1 -- 172.21.15.49:0/580335916 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc00cdc0 con 0x7f7fdc1083c0 2024-09-21T06:36:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.451+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fdc1a07e0 con 0x7f7fdc1083c0 2024-09-21T06:36:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.451+0000 7f7fd9ffb640 1 -- 172.21.15.49:0/580335916 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fcc005020 con 0x7f7fdc1083c0 2024-09-21T06:36:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.451+0000 7f7fd9ffb640 1 -- 172.21.15.49:0/580335916 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc0116b0 con 0x7f7fdc1083c0 2024-09-21T06:36:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.451+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fdc1a6f40 con 0x7f7fdc1083c0 2024-09-21T06:36:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.452+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fdc103d00 con 0x7f7fdc1083c0 2024-09-21T06:36:14.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.454+0000 7f7fd9ffb640 1 -- 172.21.15.49:0/580335916 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f7fcc0051d0 con 0x7f7fdc1083c0 2024-09-21T06:36:14.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.454+0000 7f7fd9ffb640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7fc80b65e0 0x7f7fc80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.454+0000 7f7fe0e3f640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7fc80b65e0 0x7f7fc80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.454+0000 7f7fd9ffb640 1 -- 172.21.15.49:0/580335916 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f7fcc0e7600 con 0x7f7fdc1083c0 2024-09-21T06:36:14.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.455+0000 7f7fe0e3f640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7fc80b65e0 0x7f7fc80b8af0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4031440 tx=0x7f7fc4009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:14.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.459+0000 7f7fd9ffb640 1 -- 172.21.15.49:0/580335916 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fcc016030 con 0x7f7fdc1083c0 2024-09-21T06:36:14.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T06:36:14.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T06:36:14.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:14 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-21T06:36:14.547 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:14 smithi098 ceph-mon[34704]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:36:14.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-21T06:36:14.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T06:36:14.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:14 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 1]}]': finished 2024-09-21T06:36:14.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:14 smithi079 ceph-mon[34346]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:36:14.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.683+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fdc1a7260 con 0x7f7fdc1083c0 2024-09-21T06:36:14.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.683+0000 7f7fd9ffb640 1 -- 172.21.15.49:0/580335916 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7f7fcc0b2130 con 0x7f7fdc1083c0 2024-09-21T06:36:14.687 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:14.691 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"btime":"2024-09-21T06:34:54:962997+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:34:54.645934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:36:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2024-09-21T06:36:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7fc80b65e0 msgr2=0x7f7fc80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7fc80b65e0 0x7f7fc80b8af0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4031440 tx=0x7f7fc4009560 comp rx=0 tx=0).stop 2024-09-21T06:36:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc1083c0 msgr2=0x7f7fdc19ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc1083c0 0x7f7fdc19ab20 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00ea50 tx=0x7f7fcc00ef10 comp rx=0 tx=0).stop 2024-09-21T06:36:14.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 shutdown_connections 2024-09-21T06:36:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7fc80b65e0 0x7f7fc80b8af0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7fdc108d10 0x7f7fdc19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7fdc1083c0 0x7f7fdc19ab20 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 --2- 172.21.15.49:0/580335916 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7fdc102a80 0x7f7fdc19a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 >> 172.21.15.49:0/580335916 conn(0x7f7fdc079740 msgr2=0x7f7fdc1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 shutdown_connections 2024-09-21T06:36:14.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:14.686+0000 7f7fe30a3640 1 -- 172.21.15.49:0/580335916 wait complete. 2024-09-21T06:36:15.350 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:36:15.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:15 smithi098 ceph-mon[34704]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:36:15.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:15 smithi098 ceph-mon[34704]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T06:36:15.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:15 smithi098 ceph-mon[34704]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:36:15.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:15 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/580335916' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:15.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:15 smithi079 ceph-mon[34346]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:36:15.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:15 smithi079 ceph-mon[34346]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T06:36:15.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:15 smithi079 ceph-mon[34346]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:36:15.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:15 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/580335916' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:15.607 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:15.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:15 smithi049 ceph-mon[31177]: pgmap v306: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:36:15.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:15 smithi049 ceph-mon[31177]: mgrmap e22: x(active, since 8m), standbys: z, y 2024-09-21T06:36:15.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:15 smithi049 ceph-mon[31177]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:36:15.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:15 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/580335916' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:16.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 -- 172.21.15.49:0/4194830126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6341083c0 msgr2=0x7fd6341087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:16.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 --2- 172.21.15.49:0/4194830126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6341083c0 0x7fd6341087d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd628009900 tx=0x7fd62802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:16.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 -- 172.21.15.49:0/4194830126 shutdown_connections 2024-09-21T06:36:16.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 --2- 172.21.15.49:0/4194830126 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd634108d10 0x7fd63410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 --2- 172.21.15.49:0/4194830126 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6341083c0 0x7fd6341087d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 --2- 172.21.15.49:0/4194830126 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd634102a80 0x7fd634102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 -- 172.21.15.49:0/4194830126 >> 172.21.15.49:0/4194830126 conn(0x7fd634079740 msgr2=0x7fd634079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:16.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 -- 172.21.15.49:0/4194830126 shutdown_connections 2024-09-21T06:36:16.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 -- 172.21.15.49:0/4194830126 wait complete. 2024-09-21T06:36:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.090+0000 7fd63bde7640 1 Processor -- start 2024-09-21T06:36:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd63bde7640 1 -- start start 2024-09-21T06:36:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd63bde7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd634102a80 0x7fd63419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd63bde7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6341083c0 0x7fd63419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:16.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd63bde7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd634108d10 0x7fd63419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd63bde7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd634112980 con 0x7fd634102a80 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd63bde7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd634112800 con 0x7fd6341083c0 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd63bde7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd634112b00 con 0x7fd634108d10 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639b83640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd634102a80 0x7fd63419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639b83640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd634102a80 0x7fd63419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48010/0 (socket says 172.21.15.49:48010) 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639b83640 1 -- 172.21.15.49:0/3383536587 learned_addr learned my addr 172.21.15.49:0/3383536587 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639382640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6341083c0 0x7fd63419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd63a384640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd634108d10 0x7fd63419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639b83640 1 -- 172.21.15.49:0/3383536587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd634108d10 msgr2=0x7fd63419bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639b83640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd634108d10 0x7fd63419bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639b83640 1 -- 172.21.15.49:0/3383536587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6341083c0 msgr2=0x7fd63419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639b83640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6341083c0 0x7fd63419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639b83640 1 -- 172.21.15.49:0/3383536587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6341a65e0 con 0x7fd634102a80 2024-09-21T06:36:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd63a384640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd634108d10 0x7fd63419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639382640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6341083c0 0x7fd63419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.091+0000 7fd639b83640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd634102a80 0x7fd63419b350 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd63000e9f0 tx=0x7fd63000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.092+0000 7fd626ffd640 1 -- 172.21.15.49:0/3383536587 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63000cd80 con 0x7fd634102a80 2024-09-21T06:36:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.092+0000 7fd626ffd640 1 -- 172.21.15.49:0/3383536587 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6300108e0 con 0x7fd634102a80 2024-09-21T06:36:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.092+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6341a68d0 con 0x7fd634102a80 2024-09-21T06:36:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.092+0000 7fd626ffd640 1 -- 172.21.15.49:0/3383536587 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd630018980 con 0x7fd634102a80 2024-09-21T06:36:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.092+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6341a6de0 con 0x7fd634102a80 2024-09-21T06:36:16.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.093+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd634103d00 con 0x7fd634102a80 2024-09-21T06:36:16.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.094+0000 7fd626ffd640 1 -- 172.21.15.49:0/3383536587 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fd630010430 con 0x7fd634102a80 2024-09-21T06:36:16.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.095+0000 7fd626ffd640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6200b6590 0x7fd6200b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:16.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.095+0000 7fd639382640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6200b6590 0x7fd6200b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:16.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.095+0000 7fd626ffd640 1 -- 172.21.15.49:0/3383536587 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd6300e7d90 con 0x7fd634102a80 2024-09-21T06:36:16.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.096+0000 7fd639382640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6200b6590 0x7fd6200b8aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd628032cc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:16.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.098+0000 7fd626ffd640 1 -- 172.21.15.49:0/3383536587 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6300ae4e0 con 0x7fd634102a80 2024-09-21T06:36:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.324+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd63406bf50 con 0x7fd634102a80 2024-09-21T06:36:16.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.325+0000 7fd626ffd640 1 -- 172.21.15.49:0/3383536587 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11893 (secure 0 0 0) 0x7fd6300b28c0 con 0x7fd634102a80 2024-09-21T06:36:16.328 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:16.328 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":24,"btime":"2024-09-21T06:34:54:962997+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:34:54.645934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:36:16.328 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 24 2024-09-21T06:36:16.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6200b6590 msgr2=0x7fd6200b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6200b6590 0x7fd6200b8aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd628000c00 tx=0x7fd628032cc0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd634102a80 msgr2=0x7fd63419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd634102a80 0x7fd63419b350 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd63000e9f0 tx=0x7fd63000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 shutdown_connections 2024-09-21T06:36:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6200b6590 0x7fd6200b8aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd634108d10 0x7fd63419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6341083c0 0x7fd63419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 --2- 172.21.15.49:0/3383536587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd634102a80 0x7fd63419b350 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 >> 172.21.15.49:0/3383536587 conn(0x7fd634079740 msgr2=0x7fd6341044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:16.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 shutdown_connections 2024-09-21T06:36:16.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:16.327+0000 7fd63bde7640 1 -- 172.21.15.49:0/3383536587 wait complete. 2024-09-21T06:36:16.976 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:36:17.233 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:17.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:17 smithi098 ceph-mon[34704]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 127 B/s wr, 3 op/s; 75 B/s, 0 objects/s recovering 2024-09-21T06:36:17.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:17 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3383536587' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:17.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:17 smithi079 ceph-mon[34346]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 127 B/s wr, 3 op/s; 75 B/s, 0 objects/s recovering 2024-09-21T06:36:17.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:17 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3383536587' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:17.583 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:17 smithi049 ceph-mon[31177]: pgmap v308: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 127 B/s wr, 3 op/s; 75 B/s, 0 objects/s recovering 2024-09-21T06:36:17.583 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:17 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3383536587' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.713+0000 7fcaab3a3640 1 -- 172.21.15.49:0/4253123202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 msgr2=0x7fcaa41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.713+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/4253123202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 0x7fcaa41087b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fca98009900 tx=0x7fca9802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.713+0000 7fcaab3a3640 1 -- 172.21.15.49:0/4253123202 shutdown_connections 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.713+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/4253123202 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa4108cf0 0x7fcaa410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.713+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/4253123202 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 0x7fcaa41087b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.713+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/4253123202 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaa4102a60 0x7fcaa4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.713+0000 7fcaab3a3640 1 -- 172.21.15.49:0/4253123202 >> 172.21.15.49:0/4253123202 conn(0x7fcaa4079730 msgr2=0x7fcaa4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.713+0000 7fcaab3a3640 1 -- 172.21.15.49:0/4253123202 shutdown_connections 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.713+0000 7fcaab3a3640 1 -- 172.21.15.49:0/4253123202 wait complete. 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaab3a3640 1 Processor -- start 2024-09-21T06:36:17.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaab3a3640 1 -- start start 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaab3a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa4102a60 0x7fcaa419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaab3a3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 0x7fcaa419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaab3a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaa4108cf0 0x7fcaa419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaab3a3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4112960 con 0x7fcaa41083a0 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaab3a3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa41127e0 con 0x7fcaa4102a60 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaab3a3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcaa4112ae0 con 0x7fcaa4108cf0 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaa893e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 0x7fcaa419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaa893e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 0x7fcaa419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47820/0 (socket says 172.21.15.49:47820) 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.714+0000 7fcaa893e640 1 -- 172.21.15.49:0/248174853 learned_addr learned my addr 172.21.15.49:0/248174853 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa913f640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa4102a60 0x7fcaa419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa9940640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaa4108cf0 0x7fcaa419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa893e640 1 -- 172.21.15.49:0/248174853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaa4108cf0 msgr2=0x7fcaa419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa893e640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaa4108cf0 0x7fcaa419bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa893e640 1 -- 172.21.15.49:0/248174853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa4102a60 msgr2=0x7fcaa419b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa893e640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa4102a60 0x7fcaa419b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa893e640 1 -- 172.21.15.49:0/248174853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa41a6550 con 0x7fcaa41083a0 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa893e640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 0x7fcaa419b810 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fca98031a90 tx=0x7fca98004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa27fc640 1 -- 172.21.15.49:0/248174853 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9803f030 con 0x7fcaa41083a0 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa27fc640 1 -- 172.21.15.49:0/248174853 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca98003cb0 con 0x7fcaa41083a0 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaa41a67e0 con 0x7fcaa41083a0 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaa27fc640 1 -- 172.21.15.49:0/248174853 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca98035070 con 0x7fcaa41083a0 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.715+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaa41a6cc0 con 0x7fcaa41083a0 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.716+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaa4102e70 con 0x7fcaa41083a0 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.718+0000 7fcaa27fc640 1 -- 172.21.15.49:0/248174853 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fca98042030 con 0x7fcaa41083a0 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.718+0000 7fcaa27fc640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca8c0b6560 0x7fca8c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:17.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.719+0000 7fcaa913f640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca8c0b6560 0x7fca8c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:17.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.719+0000 7fcaa27fc640 1 -- 172.21.15.49:0/248174853 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fca98107b50 con 0x7fcaa41083a0 2024-09-21T06:36:17.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.719+0000 7fcaa913f640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca8c0b6560 0x7fca8c0b8a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fca94005c40 tx=0x7fca9400a390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:17.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.723+0000 7fcaa27fc640 1 -- 172.21.15.49:0/248174853 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca980ce2a0 con 0x7fcaa41083a0 2024-09-21T06:36:17.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.912+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcaa410a530 con 0x7fcaa41083a0 2024-09-21T06:36:17.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.913+0000 7fcaa27fc640 1 -- 172.21.15.49:0/248174853 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+23122 (secure 0 0 0) 0x7fca980d2680 con 0x7fcaa41083a0 2024-09-21T06:36:17.916 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:17.916 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":78,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:36:14.252235+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9},{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:36:17.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca8c0b6560 msgr2=0x7fca8c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca8c0b6560 0x7fca8c0b8a70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fca94005c40 tx=0x7fca9400a390 comp rx=0 tx=0).stop 2024-09-21T06:36:17.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 msgr2=0x7fcaa419b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 0x7fcaa419b810 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fca98031a90 tx=0x7fca98004270 comp rx=0 tx=0).stop 2024-09-21T06:36:17.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 shutdown_connections 2024-09-21T06:36:17.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca8c0b6560 0x7fca8c0b8a70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcaa4108cf0 0x7fcaa419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcaa41083a0 0x7fcaa419b810 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 --2- 172.21.15.49:0/248174853 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcaa4102a60 0x7fcaa419b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.915+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 >> 172.21.15.49:0/248174853 conn(0x7fcaa4079730 msgr2=0x7fcaa41044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:17.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.916+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 shutdown_connections 2024-09-21T06:36:17.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:17.916+0000 7fcaab3a3640 1 -- 172.21.15.49:0/248174853 wait complete. 2024-09-21T06:36:18.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:18 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/248174853' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:18.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:18 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/248174853' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:18.551 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:34:43.531339+0000', 'modified': '2024-09-21T06:34:54.645934+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24686, 'mds_1': 24685, 'mds_2': 24676}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24638': {'gid': 24638, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6835/1332274866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6834', 'nonce': 1332274866}, {'type': 'v1', 'addr': '172.21.15.79:6835', 'nonce': 1332274866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.79:6837/1540546438', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6836', 'nonce': 1540546438}, {'type': 'v1', 'addr': '172.21.15.79:6837', 'nonce': 1540546438}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24664': {'gid': 24664, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.98:6835/1874380420', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6834', 'nonce': 1874380420}, {'type': 'v1', 'addr': '172.21.15.98:6835', 'nonce': 1874380420}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24676': {'gid': 24676, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.98:6837/883661759', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6836', 'nonce': 883661759}, {'type': 'v1', 'addr': '172.21.15.98:6837', 'nonce': 883661759}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24685': {'gid': 24685, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.98:6839/2833694716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.98:6838', 'nonce': 2833694716}, {'type': 'v1', 'addr': '172.21.15.98:6839', 'nonce': 2833694716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24686': {'gid': 24686, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.79:6839/1831508343', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6838', 'nonce': 1831508343}, {'type': 'v1', 'addr': '172.21.15.79:6839', 'nonce': 1831508343}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24686, 'qdb_cluster': [24676, 24685, 24686]} 2024-09-21T06:36:18.551 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T06:36:18.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T06:36:18.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:18 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/248174853' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.349+0000 7f206e5ec640 1 -- 172.21.15.49:0/2357898133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068105270 msgr2=0x7f206810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.349+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2357898133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068105270 0x7f206810d8b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f205c009900 tx=0x7f205c02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.349+0000 7f206e5ec640 1 -- 172.21.15.49:0/2357898133 shutdown_connections 2024-09-21T06:36:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.349+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2357898133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f206810ddf0 0x7f2068110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.349+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2357898133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068105270 0x7f206810d8b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.349+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2357898133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2068104840 0x7f2068104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.349+0000 7f206e5ec640 1 -- 172.21.15.49:0/2357898133 >> 172.21.15.49:0/2357898133 conn(0x7f2068079730 msgr2=0x7f2068079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.349+0000 7f206e5ec640 1 -- 172.21.15.49:0/2357898133 shutdown_connections 2024-09-21T06:36:19.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.349+0000 7f206e5ec640 1 -- 172.21.15.49:0/2357898133 wait complete. 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f206e5ec640 1 Processor -- start 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f206e5ec640 1 -- start start 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f206e5ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068104840 0x7f206819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f206e5ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2068105270 0x7f206819ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f206e5ec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206810ddf0 0x7f206819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f206e5ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2068113a70 con 0x7f2068104840 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f206e5ec640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20681138f0 con 0x7f2068105270 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f206e5ec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2068113bf0 con 0x7f206810ddf0 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f2067fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068104840 0x7f206819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f2067fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068104840 0x7f206819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47838/0 (socket says 172.21.15.49:47838) 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.350+0000 7f2067fff640 1 -- 172.21.15.49:0/2623615869 learned_addr learned my addr 172.21.15.49:0/2623615869 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f2067fff640 1 -- 172.21.15.49:0/2623615869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206810ddf0 msgr2=0x7f206819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f20677fe640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2068105270 0x7f206819ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f206cb89640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206810ddf0 0x7f206819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f2067fff640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206810ddf0 0x7f206819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f2067fff640 1 -- 172.21.15.49:0/2623615869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2068105270 msgr2=0x7f206819ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f2067fff640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2068105270 0x7f206819ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f2067fff640 1 -- 172.21.15.49:0/2623615869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20681a04d0 con 0x7f2068104840 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f20677fe640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2068105270 0x7f206819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f2067fff640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068104840 0x7f206819a560 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f205800d950 tx=0x7f205800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f20657fa640 1 -- 172.21.15.49:0/2623615869 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058017070 con 0x7f2068104840 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f20657fa640 1 -- 172.21.15.49:0/2623615869 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2058009c30 con 0x7f2068104840 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f206e5ec640 1 -- 172.21.15.49:0/2623615869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20681a07c0 con 0x7f2068104840 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f20657fa640 1 -- 172.21.15.49:0/2623615869 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205800f620 con 0x7f2068104840 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.351+0000 7f206e5ec640 1 -- 172.21.15.49:0/2623615869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20681a6f20 con 0x7f2068104840 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f2074b60740 1 Processor -- start 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f2074b60740 1 -- start start 2024-09-21T06:36:19.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f20657fa640 1 -- 172.21.15.49:0/2623615869 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f205801a070 con 0x7f2068104840 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f2074b60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af7ebf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f2074b60740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 0x5593af7ec440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f2074b60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af7ec980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f2074b60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5593af763c10 con 0x5593af425280 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f2074b60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593af753040 con 0x5593af445f60 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f2074b60740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5593af756e50 con 0x5593af41d0a0 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f20677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af7ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f20677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af7ec980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47842/0 (socket says 172.21.15.49:47842) 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f20677fe640 1 -- 172.21.15.49:0/2790917419 learned_addr learned my addr 172.21.15.49:0/2790917419 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.354+0000 7f206cb89640 1 --2- 172.21.15.49:0/2790917419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af7ebf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f2067fff640 1 --2- 172.21.15.49:0/2790917419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 0x5593af7ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f20677fe640 1 -- 172.21.15.49:0/2790917419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 msgr2=0x5593af7ec440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f20677fe640 1 --2- 172.21.15.49:0/2790917419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 0x5593af7ec440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f20677fe640 1 -- 172.21.15.49:0/2790917419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 msgr2=0x5593af7ebf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f20677fe640 1 --2- 172.21.15.49:0/2790917419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af7ebf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f20677fe640 1 -- 172.21.15.49:0/2790917419 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593af4b1540 con 0x5593af425280 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f20657fa640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f20500b65e0 0x7f20500b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f20677fe640 1 --2- 172.21.15.49:0/2790917419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af7ec980 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f205c000c00 tx=0x7f205c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abaac80103b91091 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f206cb89640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f20500b65e0 0x7f20500b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f20657fa640 1 -- 172.21.15.49:0/2623615869 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f20580e6f80 con 0x7f2068104840 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f204e7fc640 1 -- 172.21.15.49:0/2790917419 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c03f070 con 0x5593af425280 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f204e7fc640 1 -- 172.21.15.49:0/2790917419 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c0316a0 con 0x5593af425280 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.355+0000 7f204e7fc640 1 -- 172.21.15.49:0/2790917419 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c035070 con 0x5593af425280 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f2074b60740 1 -- 172.21.15.49:0/2790917419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 msgr2=0x5593af7ec980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f2074b60740 1 --2- 172.21.15.49:0/2790917419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af7ec980 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f205c000c00 tx=0x7f205c032ce0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f206cb89640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f20500b65e0 0x7f20500b8af0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2060005fd0 tx=0x7f2060009640 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f2074b60740 1 -- 172.21.15.49:0/2790917419 shutdown_connections 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f2074b60740 1 --2- 172.21.15.49:0/2790917419 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af7ec980 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f2074b60740 1 --2- 172.21.15.49:0/2790917419 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 0x5593af7ec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f2074b60740 1 --2- 172.21.15.49:0/2790917419 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af7ebf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f2074b60740 1 -- 172.21.15.49:0/2790917419 >> 172.21.15.49:0/2790917419 conn(0x5593af43a350 msgr2=0x5593af7e9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f2074b60740 1 -- 172.21.15.49:0/2790917419 shutdown_connections 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.356+0000 7f2074b60740 1 -- 172.21.15.49:0/2790917419 wait complete. 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.357+0000 7f2074b60740 1 -- start start 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.357+0000 7f2074b60740 1 Processor -- start 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.357+0000 7f2074b60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af41d0a0 0x5593af7f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.357+0000 7f2074b60740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 0x5593af7f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.357+0000 7f2074b60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af445f60 0x5593af8039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.357+0000 7f2074b60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5593af5b45f0 con 0x5593af445f60 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.357+0000 7f2074b60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593af6ee010 con 0x5593af41d0a0 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.357+0000 7f2074b60740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5593af7fa680 con 0x5593af425280 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f2074b60740 10 client.0 _ll_register_callbacks cb 0x5593af74d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f206cb89640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af445f60 0x5593af8039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f206cb89640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af445f60 0x5593af8039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47844/0 (socket says 172.21.15.49:47844) 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f206cb89640 1 -- 172.21.15.49:0/3298452602 learned_addr learned my addr 172.21.15.49:0/3298452602 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f2067fff640 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af41d0a0 0x5593af7f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f20677fe640 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 0x5593af7f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f206cb89640 1 -- 172.21.15.49:0/3298452602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 msgr2=0x5593af7f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f206cb89640 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 0x5593af7f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f206cb89640 1 -- 172.21.15.49:0/3298452602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af41d0a0 msgr2=0x5593af7f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f206cb89640 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af41d0a0 0x5593af7f7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f206cb89640 1 -- 172.21.15.49:0/3298452602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593af71ba00 con 0x5593af445f60 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f206cb89640 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af445f60 0x5593af8039a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f20600127a0 tx=0x7f2060004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25935bf0c4a54edc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f20477fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f20477fe640 1 -- 172.21.15.49:0/3298452602 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206000ea60 con 0x5593af445f60 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f20477fe640 1 -- 172.21.15.49:0/3298452602 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f206000ec00 con 0x5593af445f60 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f2074b60740 1 -- 172.21.15.49:0/3298452602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f205c0316a0 con 0x5593af445f60 2024-09-21T06:36:19.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.358+0000 7f20477fe640 1 -- 172.21.15.49:0/3298452602 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f206000ee00 con 0x5593af445f60 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f2074b60740 10 client.15312 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f2074b60740 1 -- 172.21.15.49:0/3298452602 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5593af8066c0 con 0x5593af445f60 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f20477fe640 1 -- 172.21.15.49:0/3298452602 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c0316a0 con 0x5593af445f60 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f20477fe640 1 -- 172.21.15.49:0/3298452602 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f206000f040 con 0x5593af445f60 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f2074b60740 10 client.15312 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f2074b60740 10 client.15312 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f2074b60740 20 client.15312 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f2074b60740 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5593af4048e0 0x5593af80a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f2074b60740 4 client.15312 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f2074b60740 1 -- 172.21.15.49:0/3298452602 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593af765b60 con 0x5593af4048e0 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.359+0000 7f2067fff640 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5593af4048e0 0x5593af80a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.360+0000 7f20477fe640 10 client.15312 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.360+0000 7f2067fff640 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5593af4048e0 0x5593af80a140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=80ba145fee3911b0 server_cookie=3099f1b5d330b5c3 in_seq=0 out_seq=0 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.360+0000 7f20477fe640 1 -- 172.21.15.49:0/3298452602 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5593af765b60 con 0x5593af4048e0 2024-09-21T06:36:19.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f20477fe640 10 client.15312 handle_command_reply: tid=0 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 client.15312 shutdown 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 -- 172.21.15.49:0/3298452602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af445f60 msgr2=0x5593af8039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af445f60 0x5593af8039a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f20600127a0 tx=0x7f2060004a40 comp rx=0 tx=0).stop 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 -- 172.21.15.49:0/3298452602 shutdown_connections 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5593af4048e0 0x5593af80a140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af445f60 0x5593af8039a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 0x5593af7f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 --2- 172.21.15.49:0/3298452602 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af41d0a0 0x5593af7f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f20477fe640 0 client.15312 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 -- 172.21.15.49:0/3298452602 >> 172.21.15.49:0/3298452602 conn(0x5593af43a350 msgr2=0x5593af7ef090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 -- 172.21.15.49:0/3298452602 shutdown_connections 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 1 -- 172.21.15.49:0/3298452602 wait complete. 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.361+0000 7f2074b60740 20 client.15312 trim_cache size 0 max 16384 2024-09-21T06:36:19.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f2074b60740 1 Processor -- start 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f2074b60740 1 -- start start 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f2074b60740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 0x5593af7f2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f2074b60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af803910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f2074b60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af803e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f2074b60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5593af808480 con 0x5593af425280 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f2074b60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593af808b50 con 0x5593af445f60 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f2074b60740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5593af809220 con 0x5593af41d0a0 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f20677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af803910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f20677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af803910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47850/0 (socket says 172.21.15.49:47850) 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f20677fe640 1 -- 172.21.15.49:0/1171718127 learned_addr learned my addr 172.21.15.49:0/1171718127 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.379+0000 7f206cb89640 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af803e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f2067fff640 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 0x5593af7f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f20677fe640 1 -- 172.21.15.49:0/1171718127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 msgr2=0x5593af7f2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f20677fe640 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 0x5593af7f2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f20677fe640 1 -- 172.21.15.49:0/1171718127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 msgr2=0x5593af803e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f20677fe640 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af803e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f20677fe640 1 -- 172.21.15.49:0/1171718127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593af7eed60 con 0x5593af425280 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f2067fff640 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 0x5593af7f2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f206cb89640 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af803e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f20677fe640 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af803910 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f205c006010 tx=0x7f205c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6d6985aaa2e02e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f204dffb640 1 -- 172.21.15.49:0/1171718127 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c03f070 con 0x5593af425280 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f204dffb640 1 -- 172.21.15.49:0/1171718127 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c005440 con 0x5593af425280 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.380+0000 7f204dffb640 1 -- 172.21.15.49:0/1171718127 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f205c035040 con 0x5593af425280 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 -- 172.21.15.49:0/1171718127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 msgr2=0x5593af803910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af803910 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f205c006010 tx=0x7f205c005dc0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 -- 172.21.15.49:0/1171718127 shutdown_connections 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af803e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af425280 0x5593af803910 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 --2- 172.21.15.49:0/1171718127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af41d0a0 0x5593af7f2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 -- 172.21.15.49:0/1171718127 >> 172.21.15.49:0/1171718127 conn(0x5593af43a350 msgr2=0x5593af7f29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 -- 172.21.15.49:0/1171718127 shutdown_connections 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 -- 172.21.15.49:0/1171718127 wait complete. 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.381+0000 7f2074b60740 1 -- start start 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2074b60740 1 Processor -- start 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2074b60740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af41d0a0 0x5593af80c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2074b60740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 0x5593af80c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2074b60740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af80ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2074b60740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5593af809fc0 con 0x5593af41d0a0 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2074b60740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5593af8098f0 con 0x5593af445f60 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2074b60740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5593af80a690 con 0x5593af425280 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2074b60740 10 client.0 _ll_register_callbacks cb 0x7f2060012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2067fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af41d0a0 0x5593af80c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2067fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af41d0a0 0x5593af80c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47854/0 (socket says 172.21.15.49:47854) 2024-09-21T06:36:19.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2067fff640 1 -- 172.21.15.49:0/3354234863 learned_addr learned my addr 172.21.15.49:0/3354234863 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f206cb89640 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af80ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f20677fe640 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 0x5593af80c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2067fff640 1 -- 172.21.15.49:0/3354234863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 msgr2=0x5593af80c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2067fff640 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 0x5593af80c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2067fff640 1 -- 172.21.15.49:0/3354234863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 msgr2=0x5593af80ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2067fff640 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af80ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2067fff640 1 -- 172.21.15.49:0/3354234863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593af811c10 con 0x5593af41d0a0 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f206cb89640 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af80ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.382+0000 7f2067fff640 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af41d0a0 0x5593af80c400 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f20580acf60 tx=0x7f2058005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13dd4875fa388aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f20477fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f20477fe640 1 -- 172.21.15.49:0/3354234863 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2058021040 con 0x5593af41d0a0 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f20477fe640 1 -- 172.21.15.49:0/3354234863 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f20580e90b0 con 0x5593af41d0a0 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f2074b60740 1 -- 172.21.15.49:0/3354234863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f205c005440 con 0x5593af41d0a0 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f20477fe640 1 -- 172.21.15.49:0/3354234863 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f20580e92b0 con 0x5593af41d0a0 2024-09-21T06:36:19.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f2074b60740 10 client.15318 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f2074b60740 1 -- 172.21.15.49:0/3354234863 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5593af8758a0 con 0x5593af41d0a0 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f20477fe640 1 -- 172.21.15.49:0/3354234863 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f205c005440 con 0x5593af41d0a0 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f20477fe640 1 -- 172.21.15.49:0/3354234863 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f2058098080 con 0x5593af41d0a0 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f2074b60740 10 client.15318 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f2074b60740 10 client.15318 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f2074b60740 20 client.15318 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f2074b60740 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5593af3d9c90 0x5593af8791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f2074b60740 4 client.15318 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.383+0000 7f2074b60740 1 -- 172.21.15.49:0/3354234863 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "status"}) -- 0x5593af761610 con 0x5593af3d9c90 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f20677fe640 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5593af3d9c90 0x5593af8791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f20677fe640 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5593af3d9c90 0x5593af8791c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1ec30a12b2c2b6a server_cookie=ef6f0b1a08cb4b40 in_seq=0 out_seq=0 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f20477fe640 10 client.15318 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f20477fe640 1 -- 172.21.15.49:0/3354234863 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5593af761610 con 0x5593af3d9c90 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f20477fe640 10 client.15318 handle_command_reply: tid=0 2024-09-21T06:36:19.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f2074b60740 1 client.15318 shutdown 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f2074b60740 1 -- 172.21.15.49:0/3354234863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af41d0a0 msgr2=0x5593af80c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f2074b60740 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af41d0a0 0x5593af80c400 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f20580acf60 tx=0x7f2058005f30 comp rx=0 tx=0).stop 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f2074b60740 1 -- 172.21.15.49:0/3354234863 shutdown_connections 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f2074b60740 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5593af3d9c90 0x5593af8791c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f2074b60740 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5593af445f60 0x5593af80ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f2074b60740 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5593af425280 0x5593af80c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f20477fe640 0 client.15318 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f2074b60740 1 --2- 172.21.15.49:0/3354234863 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5593af41d0a0 0x5593af80c400 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.384+0000 7f2074b60740 1 -- 172.21.15.49:0/3354234863 >> 172.21.15.49:0/3354234863 conn(0x5593af43a350 msgr2=0x5593af7e9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f2074b60740 1 -- 172.21.15.49:0/3354234863 shutdown_connections 2024-09-21T06:36:19.406 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4a3fd104-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 2, 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24676, 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 87.431069026000003, 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 24, 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 78, 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 119.332551154 2024-09-21T06:36:19.407 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f2074b60740 1 -- 172.21.15.49:0/3354234863 wait complete. 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f2074b60740 20 client.15318 trim_cache size 0 max 16384 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 -- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f20500b65e0 msgr2=0x7f20500b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f20500b65e0 0x7f20500b8af0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2060005fd0 tx=0x7f2060009640 comp rx=0 tx=0).stop 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 -- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068104840 msgr2=0x7f206819a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068104840 0x7f206819a560 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f205800d950 tx=0x7f205800de10 comp rx=0 tx=0).stop 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 -- 172.21.15.49:0/2623615869 shutdown_connections 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f20500b65e0 0x7f20500b8af0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f206810ddf0 0x7f206819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2068105270 0x7f206819ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 --2- 172.21.15.49:0/2623615869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2068104840 0x7f206819a560 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 -- 172.21.15.49:0/2623615869 >> 172.21.15.49:0/2623615869 conn(0x7f2068079730 msgr2=0x7f20680ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 -- 172.21.15.49:0/2623615869 shutdown_connections 2024-09-21T06:36:19.409 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:19.385+0000 7f206e5ec640 1 -- 172.21.15.49:0/2623615869 wait complete. 2024-09-21T06:36:19.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:19 smithi098 ceph-mon[34704]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 639 B/s wr, 8 op/s; 75 B/s, 0 objects/s recovering 2024-09-21T06:36:19.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:19 smithi079 ceph-mon[34346]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 639 B/s wr, 8 op/s; 75 B/s, 0 objects/s recovering 2024-09-21T06:36:19.685 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:19 smithi049 ceph-mon[31177]: pgmap v309: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 639 B/s wr, 8 op/s; 75 B/s, 0 objects/s recovering 2024-09-21T06:36:20.223 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:36:20.480 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.948+0000 7fd0654c1640 1 -- 172.21.15.49:0/2799436291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060108d10 msgr2=0x7fd06010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.948+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2799436291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060108d10 0x7fd06010f540 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd058009ca0 tx=0x7fd05802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.948+0000 7fd0654c1640 1 -- 172.21.15.49:0/2799436291 shutdown_connections 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.948+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2799436291 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060108d10 0x7fd06010f540 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.948+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2799436291 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0601083c0 0x7fd0601087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.948+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2799436291 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd060102a80 0x7fd060102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.948+0000 7fd0654c1640 1 -- 172.21.15.49:0/2799436291 >> 172.21.15.49:0/2799436291 conn(0x7fd060079740 msgr2=0x7fd060079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.948+0000 7fd0654c1640 1 -- 172.21.15.49:0/2799436291 shutdown_connections 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.949+0000 7fd0654c1640 1 -- 172.21.15.49:0/2799436291 wait complete. 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.949+0000 7fd0654c1640 1 Processor -- start 2024-09-21T06:36:20.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.949+0000 7fd0654c1640 1 -- start start 2024-09-21T06:36:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd0654c1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060102a80 0x7fd06019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd0654c1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0601083c0 0x7fd06019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd0654c1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd060108d10 0x7fd06019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd0654c1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd060112980 con 0x7fd060102a80 2024-09-21T06:36:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd0654c1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd060112800 con 0x7fd060108d10 2024-09-21T06:36:20.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd0654c1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd060112b00 con 0x7fd0601083c0 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060102a80 0x7fd06019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060102a80 0x7fd06019a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47874/0 (socket says 172.21.15.49:47874) 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05effd640 1 -- 172.21.15.49:0/2773354798 learned_addr learned my addr 172.21.15.49:0/2773354798 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0601083c0 0x7fd06019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd060108d10 0x7fd06019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05effd640 1 -- 172.21.15.49:0/2773354798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0601083c0 msgr2=0x7fd06019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05effd640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0601083c0 0x7fd06019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05effd640 1 -- 172.21.15.49:0/2773354798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd060108d10 msgr2=0x7fd06019fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05effd640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd060108d10 0x7fd06019fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05effd640 1 -- 172.21.15.49:0/2773354798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0601a02d0 con 0x7fd060102a80 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0601083c0 0x7fd06019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.950+0000 7fd05effd640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060102a80 0x7fd06019a420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd05000d950 tx=0x7fd05000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.951+0000 7fd047fff640 1 -- 172.21.15.49:0/2773354798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd050017030 con 0x7fd060102a80 2024-09-21T06:36:20.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.951+0000 7fd0654c1640 1 -- 172.21.15.49:0/2773354798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0601a05c0 con 0x7fd060102a80 2024-09-21T06:36:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.951+0000 7fd047fff640 1 -- 172.21.15.49:0/2773354798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd050004020 con 0x7fd060102a80 2024-09-21T06:36:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.951+0000 7fd047fff640 1 -- 172.21.15.49:0/2773354798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0500047a0 con 0x7fd060102a80 2024-09-21T06:36:20.955 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.951+0000 7fd0654c1640 1 -- 172.21.15.49:0/2773354798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0601a6de0 con 0x7fd060102a80 2024-09-21T06:36:20.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.953+0000 7fd06ba35740 1 Processor -- start 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.953+0000 7fd06ba35740 1 -- start start 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd047fff640 1 -- 172.21.15.49:0/2773354798 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fd050009a30 con 0x7fd060102a80 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 0x55f2a5330f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a5331440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a5331980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd06ba35740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f2a52a8c10 con 0x55f2a4f6a280 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd06ba35740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2a5298040 con 0x55f2a4f8af60 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd06ba35740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f2a529be50 con 0x55f2a4f620a0 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a5331980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a5331980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47878/0 (socket says 172.21.15.49:47878) 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05e7fc640 1 -- 172.21.15.49:0/1302824227 learned_addr learned my addr 172.21.15.49:0/1302824227 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:20.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05effd640 1 --2- 172.21.15.49:0/1302824227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a5331440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/1302824227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 0x55f2a5330f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05e7fc640 1 -- 172.21.15.49:0/1302824227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 msgr2=0x55f2a5331440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/1302824227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a5331440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05e7fc640 1 -- 172.21.15.49:0/1302824227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 msgr2=0x55f2a5330f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/1302824227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 0x55f2a5330f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.954+0000 7fd05e7fc640 1 -- 172.21.15.49:0/1302824227 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a4ff6540 con 0x55f2a4f6a280 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.955+0000 7fd047fff640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0480b6590 0x7fd0480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.955+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/1302824227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a5331980 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd054008bb0 tx=0x7fd05400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd27631fd51ed677 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.955+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0480b6590 0x7fd0480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.955+0000 7fd047fff640 1 -- 172.21.15.49:0/2773354798 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd0500e7040 con 0x7fd060102a80 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.955+0000 7fd0457fa640 1 -- 172.21.15.49:0/1302824227 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054014070 con 0x55f2a4f6a280 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.955+0000 7fd0457fa640 1 -- 172.21.15.49:0/1302824227 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0540047a0 con 0x55f2a4f6a280 2024-09-21T06:36:20.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.955+0000 7fd0457fa640 1 -- 172.21.15.49:0/1302824227 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054010690 con 0x55f2a4f6a280 2024-09-21T06:36:20.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd06ba35740 1 -- 172.21.15.49:0/1302824227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 msgr2=0x55f2a5331980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.961 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0480b6590 0x7fd0480b8aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd058005cc0 tx=0x7fd058005c30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd06ba35740 1 --2- 172.21.15.49:0/1302824227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a5331980 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd054008bb0 tx=0x7fd05400e720 comp rx=0 tx=0).stop 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd06ba35740 1 -- 172.21.15.49:0/1302824227 shutdown_connections 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd06ba35740 1 --2- 172.21.15.49:0/1302824227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a5331980 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd06ba35740 1 --2- 172.21.15.49:0/1302824227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a5331440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd06ba35740 1 --2- 172.21.15.49:0/1302824227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 0x55f2a5330f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd06ba35740 1 -- 172.21.15.49:0/1302824227 >> 172.21.15.49:0/1302824227 conn(0x55f2a4f7f350 msgr2=0x55f2a532edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd06ba35740 1 -- 172.21.15.49:0/1302824227 shutdown_connections 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.956+0000 7fd06ba35740 1 -- 172.21.15.49:0/1302824227 wait complete. 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd06ba35740 1 -- start start 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd06ba35740 1 Processor -- start 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a5340b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a53410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 0x55f2a534cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd06ba35740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f2a50f95f0 con 0x55f2a4f6a280 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd06ba35740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2a5233010 con 0x55f2a4f8af60 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd06ba35740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f2a5343a10 con 0x55f2a4f620a0 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd05e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a53410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd06ba35740 10 client.0 _ll_register_callbacks cb 0x55f2a5292340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd05e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a53410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47898/0 (socket says 172.21.15.49:47898) 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd05e7fc640 1 -- 172.21.15.49:0/2683875438 learned_addr learned my addr 172.21.15.49:0/2683875438 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 0x55f2a534cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.957+0000 7fd05effd640 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a5340b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd05e7fc640 1 -- 172.21.15.49:0/2683875438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 msgr2=0x55f2a5340b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a5340b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd05e7fc640 1 -- 172.21.15.49:0/2683875438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 msgr2=0x55f2a534cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 0x55f2a534cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd05e7fc640 1 -- 172.21.15.49:0/2683875438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a5260a00 con 0x55f2a4f6a280 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a53410e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd054005210 tx=0x7fd054005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b900415e1b88ca20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd042ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd042ff5640 1 -- 172.21.15.49:0/2683875438 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054027060 con 0x55f2a4f6a280 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd042ff5640 1 -- 172.21.15.49:0/2683875438 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd054022660 con 0x55f2a4f6a280 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd06ba35740 1 -- 172.21.15.49:0/2683875438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0540047a0 con 0x55f2a4f6a280 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd042ff5640 1 -- 172.21.15.49:0/2683875438 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd054014070 con 0x55f2a4f6a280 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd06ba35740 10 client.15330 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd06ba35740 1 -- 172.21.15.49:0/2683875438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f2a534f8e0 con 0x55f2a4f6a280 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.958+0000 7fd042ff5640 1 -- 172.21.15.49:0/2683875438 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0540047a0 con 0x55f2a4f6a280 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd042ff5640 1 -- 172.21.15.49:0/2683875438 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd054010430 con 0x55f2a4f6a280 2024-09-21T06:36:20.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd06ba35740 10 client.15330 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd06ba35740 10 client.15330 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:36:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd06ba35740 20 client.15330 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd06ba35740 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55f2a4f498e0 0x55f2a5352f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd06ba35740 4 client.15330 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd06ba35740 1 -- 172.21.15.49:0/2683875438 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2a52aab60 con 0x55f2a4f498e0 2024-09-21T06:36:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd05effd640 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55f2a4f498e0 0x55f2a5352f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd05effd640 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55f2a4f498e0 0x55f2a5352f20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=51f6ec610c59e24 server_cookie=231287591e9e5200 in_seq=0 out_seq=0 2024-09-21T06:36:20.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.959+0000 7fd042ff5640 10 client.15330 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:36:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.960+0000 7fd042ff5640 1 -- 172.21.15.49:0/2683875438 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2a52aab60 con 0x55f2a4f498e0 2024-09-21T06:36:20.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.960+0000 7fd042ff5640 10 client.15330 handle_command_reply: tid=0 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.960+0000 7fd06ba35740 1 client.15330 shutdown 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 -- 172.21.15.49:0/2683875438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 msgr2=0x55f2a53410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a53410e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd054005210 tx=0x7fd054005240 comp rx=0 tx=0).stop 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 -- 172.21.15.49:0/2683875438 shutdown_connections 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55f2a4f498e0 0x55f2a5352f20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f8af60 0x55f2a534cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f6a280 0x55f2a53410e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 --2- 172.21.15.49:0/2683875438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a5340b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd042ff5640 0 client.15330 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 -- 172.21.15.49:0/2683875438 >> 172.21.15.49:0/2683875438 conn(0x55f2a4f7f350 msgr2=0x55f2a5334050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 -- 172.21.15.49:0/2683875438 shutdown_connections 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 1 -- 172.21.15.49:0/2683875438 wait complete. 2024-09-21T06:36:20.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.961+0000 7fd06ba35740 20 client.15330 trim_cache size 0 max 16384 2024-09-21T06:36:20.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd06ba35740 1 Processor -- start 2024-09-21T06:36:20.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd06ba35740 1 -- start start 2024-09-21T06:36:20.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a532e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f6a280 0x55f2a532ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a533f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd06ba35740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f2a5351260 con 0x55f2a4f8af60 2024-09-21T06:36:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd06ba35740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2a5351930 con 0x55f2a4f6a280 2024-09-21T06:36:20.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd06ba35740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f2a5352000 con 0x55f2a4f620a0 2024-09-21T06:36:20.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a533f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a533f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47900/0 (socket says 172.21.15.49:47900) 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05f7fe640 1 -- 172.21.15.49:0/1036915515 learned_addr learned my addr 172.21.15.49:0/1036915515 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05effd640 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a532e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f6a280 0x55f2a532ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05f7fe640 1 -- 172.21.15.49:0/1036915515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 msgr2=0x55f2a532e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a532e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05f7fe640 1 -- 172.21.15.49:0/1036915515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f6a280 msgr2=0x55f2a532ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f6a280 0x55f2a532ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05f7fe640 1 -- 172.21.15.49:0/1036915515 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a5341e00 con 0x55f2a4f8af60 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.979+0000 7fd05effd640 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a532e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.980+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a533f3c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd058032fb0 tx=0x7fd058044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e4590e7795896b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.980+0000 7fd044ff9640 1 -- 172.21.15.49:0/1036915515 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd058003af0 con 0x55f2a4f8af60 2024-09-21T06:36:20.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.980+0000 7fd044ff9640 1 -- 172.21.15.49:0/1036915515 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd058036040 con 0x55f2a4f8af60 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.980+0000 7fd044ff9640 1 -- 172.21.15.49:0/1036915515 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05802f990 con 0x55f2a4f8af60 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 -- 172.21.15.49:0/1036915515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 msgr2=0x55f2a533f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a533f3c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd058032fb0 tx=0x7fd058044000 comp rx=0 tx=0).stop 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 -- 172.21.15.49:0/1036915515 shutdown_connections 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a533f3c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f6a280 0x55f2a532ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 --2- 172.21.15.49:0/1036915515 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f620a0 0x55f2a532e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 -- 172.21.15.49:0/1036915515 >> 172.21.15.49:0/1036915515 conn(0x55f2a4f7f350 msgr2=0x55f2a533bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 -- 172.21.15.49:0/1036915515 shutdown_connections 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 -- 172.21.15.49:0/1036915515 wait complete. 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 -- start start 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 Processor -- start 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f620a0 0x55f2a535bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f6a280 0x55f2a5358680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.981+0000 7fd06ba35740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a5358d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd06ba35740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f2a5352da0 con 0x55f2a4f8af60 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd06ba35740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2a53526d0 con 0x55f2a4f620a0 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd06ba35740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f2a5353470 con 0x55f2a4f6a280 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd06ba35740 10 client.0 _ll_register_callbacks cb 0x7fd058009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a5358d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a5358d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47910/0 (socket says 172.21.15.49:47910) 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05f7fe640 1 -- 172.21.15.49:0/3916150059 learned_addr learned my addr 172.21.15.49:0/3916150059 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05effd640 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f620a0 0x55f2a535bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05e7fc640 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f6a280 0x55f2a5358680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05f7fe640 1 -- 172.21.15.49:0/3916150059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f6a280 msgr2=0x55f2a5358680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f6a280 0x55f2a5358680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05f7fe640 1 -- 172.21.15.49:0/3916150059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f620a0 msgr2=0x55f2a535bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:20.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f620a0 0x55f2a535bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05f7fe640 1 -- 172.21.15.49:0/3916150059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a53565a0 con 0x55f2a4f8af60 2024-09-21T06:36:20.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd05f7fe640 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a5358d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd058032f80 tx=0x7fd058032fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af715a0137d54870 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:20.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd042ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:20.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd042ff5640 1 -- 172.21.15.49:0/3916150059 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd05805b030 con 0x55f2a4f8af60 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd06ba35740 1 -- 172.21.15.49:0/3916150059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd058036040 con 0x55f2a4f8af60 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.982+0000 7fd042ff5640 1 -- 172.21.15.49:0/3916150059 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd058004040 con 0x55f2a4f8af60 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd042ff5640 1 -- 172.21.15.49:0/3916150059 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd058004240 con 0x55f2a4f8af60 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd06ba35740 10 client.15336 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd06ba35740 1 -- 172.21.15.49:0/3916150059 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f2a53be590 con 0x55f2a4f8af60 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd042ff5640 1 -- 172.21.15.49:0/3916150059 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd058036040 con 0x55f2a4f8af60 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd042ff5640 1 -- 172.21.15.49:0/3916150059 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fd0580305c0 con 0x55f2a4f8af60 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd06ba35740 10 client.15336 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd06ba35740 10 client.15336 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd06ba35740 20 client.15336 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd06ba35740 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55f2a4f1ec90 0x55f2a53c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd06ba35740 4 client.15336 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd06ba35740 1 -- 172.21.15.49:0/3916150059 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "status"}) -- 0x55f2a52a6610 con 0x55f2a4f1ec90 2024-09-21T06:36:20.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.983+0000 7fd05effd640 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55f2a4f1ec90 0x55f2a53c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd05effd640 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55f2a4f1ec90 0x55f2a53c1920 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7a1fac7f826ee0de server_cookie=97b6ca6e64728a7 in_seq=0 out_seq=0 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd042ff5640 10 client.15336 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd042ff5640 1 -- 172.21.15.49:0/3916150059 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f2a52a6610 con 0x55f2a4f1ec90 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd042ff5640 10 client.15336 handle_command_reply: tid=0 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 client.15336 shutdown 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 -- 172.21.15.49:0/3916150059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 msgr2=0x55f2a5358d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a5358d90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd058032f80 tx=0x7fd058032fe0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 -- 172.21.15.49:0/3916150059 shutdown_connections 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55f2a4f1ec90 0x55f2a53c1920 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2a4f8af60 0x55f2a5358d90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2a4f6a280 0x55f2a5358680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd042ff5640 0 client.15336 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 --2- 172.21.15.49:0/3916150059 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2a4f620a0 0x55f2a535bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 -- 172.21.15.49:0/3916150059 >> 172.21.15.49:0/3916150059 conn(0x55f2a4f7f350 msgr2=0x55f2a532e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 -- 172.21.15.49:0/3916150059 shutdown_connections 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 1 -- 172.21.15.49:0/3916150059 wait complete. 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.984+0000 7fd06ba35740 20 client.15336 trim_cache size 0 max 16384 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4a3fd104-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 1, 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24685, 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-09-21T06:36:20.991 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 90.037229714999995, 2024-09-21T06:36:20.992 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 24, 2024-09-21T06:36:20.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 78, 2024-09-21T06:36:20.992 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T06:36:20.992 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 116.001376791 2024-09-21T06:36:20.992 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:36:20.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 -- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0480b6590 msgr2=0x7fd0480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0480b6590 0x7fd0480b8aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd058005cc0 tx=0x7fd058005c30 comp rx=0 tx=0).stop 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 -- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060102a80 msgr2=0x7fd06019a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060102a80 0x7fd06019a420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd05000d950 tx=0x7fd05000de10 comp rx=0 tx=0).stop 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 -- 172.21.15.49:0/2773354798 shutdown_connections 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0480b6590 0x7fd0480b8aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd060108d10 0x7fd06019fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0601083c0 0x7fd06019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 --2- 172.21.15.49:0/2773354798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd060102a80 0x7fd06019a420 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 -- 172.21.15.49:0/2773354798 >> 172.21.15.49:0/2773354798 conn(0x7fd060079740 msgr2=0x7fd06006be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:20.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 -- 172.21.15.49:0/2773354798 shutdown_connections 2024-09-21T06:36:20.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:20.985+0000 7fd0654c1640 1 -- 172.21.15.49:0/2773354798 wait complete. 2024-09-21T06:36:21.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:21 smithi098 ceph-mon[34704]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 639 B/s wr, 5 op/s; 75 B/s, 0 objects/s recovering 2024-09-21T06:36:21.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:21 smithi079 ceph-mon[34346]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 639 B/s wr, 5 op/s; 75 B/s, 0 objects/s recovering 2024-09-21T06:36:21.570 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:21 smithi049 ceph-mon[31177]: pgmap v310: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 639 B/s wr, 5 op/s; 75 B/s, 0 objects/s recovering 2024-09-21T06:36:21.600 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:36:21.857 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.382+0000 7f393fee9640 1 -- 172.21.15.49:0/1052199912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938104a30 msgr2=0x7f3938104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.382+0000 7f393fee9640 1 --2- 172.21.15.49:0/1052199912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938104a30 0x7f3938104e40 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3934009900 tx=0x7f393402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.382+0000 7f393fee9640 1 -- 172.21.15.49:0/1052199912 shutdown_connections 2024-09-21T06:36:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.382+0000 7f393fee9640 1 --2- 172.21.15.49:0/1052199912 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f393810de60 0x7f3938110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.382+0000 7f393fee9640 1 --2- 172.21.15.49:0/1052199912 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3938105380 0x7f393810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.382+0000 7f393fee9640 1 --2- 172.21.15.49:0/1052199912 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938104a30 0x7f3938104e40 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.382+0000 7f393fee9640 1 -- 172.21.15.49:0/1052199912 >> 172.21.15.49:0/1052199912 conn(0x7f3938079760 msgr2=0x7f3938079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.382+0000 7f393fee9640 1 -- 172.21.15.49:0/1052199912 shutdown_connections 2024-09-21T06:36:22.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.382+0000 7f393fee9640 1 -- 172.21.15.49:0/1052199912 wait complete. 2024-09-21T06:36:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393fee9640 1 Processor -- start 2024-09-21T06:36:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393fee9640 1 -- start start 2024-09-21T06:36:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393fee9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3938104a30 0x7f3938102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393fee9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938105380 0x7f3938102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393fee9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f393810de60 0x7f39381031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393fee9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3938113aa0 con 0x7f3938105380 2024-09-21T06:36:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393fee9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3938113920 con 0x7f3938104a30 2024-09-21T06:36:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393fee9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3938113c20 con 0x7f393810de60 2024-09-21T06:36:22.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393d484640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938105380 0x7f3938102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393d484640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938105380 0x7f3938102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47926/0 (socket says 172.21.15.49:47926) 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393d484640 1 -- 172.21.15.49:0/2022652787 learned_addr learned my addr 172.21.15.49:0/2022652787 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393e486640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f393810de60 0x7f39381031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393dc85640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3938104a30 0x7f3938102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393d484640 1 -- 172.21.15.49:0/2022652787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f393810de60 msgr2=0x7f39381031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.383+0000 7f393d484640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f393810de60 0x7f39381031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f393d484640 1 -- 172.21.15.49:0/2022652787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3938104a30 msgr2=0x7f3938102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f393d484640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3938104a30 0x7f3938102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f393d484640 1 -- 172.21.15.49:0/2022652787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39381a8790 con 0x7f3938105380 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f393e486640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f393810de60 0x7f39381031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f393d484640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938105380 0x7f3938102cb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f392800d740 tx=0x7f392800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f392effd640 1 -- 172.21.15.49:0/2022652787 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928017070 con 0x7f3938105380 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f392effd640 1 -- 172.21.15.49:0/2022652787 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f392800de50 con 0x7f3938105380 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f393fee9640 1 -- 172.21.15.49:0/2022652787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39381a8a80 con 0x7f3938105380 2024-09-21T06:36:22.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f392effd640 1 -- 172.21.15.49:0/2022652787 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f392800f620 con 0x7f3938105380 2024-09-21T06:36:22.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.384+0000 7f393fee9640 1 -- 172.21.15.49:0/2022652787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39381a8fc0 con 0x7f3938105380 2024-09-21T06:36:22.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f394645d740 1 Processor -- start 2024-09-21T06:36:22.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f394645d740 1 -- start start 2024-09-21T06:36:22.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f392effd640 1 -- 172.21.15.49:0/2022652787 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f392801a070 con 0x7f3938105380 2024-09-21T06:36:22.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f394645d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176740f60 0x55a176ae6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f394645d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176ae7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f394645d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176720280 0x55a176ae7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f394645d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a176a5ec10 con 0x55a1767180a0 2024-09-21T06:36:22.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f394645d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a176a4e040 con 0x55a176740f60 2024-09-21T06:36:22.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f394645d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a176a51e50 con 0x55a176720280 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f393dc85640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176ae7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f393dc85640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176ae7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47928/0 (socket says 172.21.15.49:47928) 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f393dc85640 1 -- 172.21.15.49:0/423936207 learned_addr learned my addr 172.21.15.49:0/423936207 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.387+0000 7f393e486640 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176740f60 0x55a176ae6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f393d484640 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176720280 0x55a176ae7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f393dc85640 1 -- 172.21.15.49:0/423936207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176720280 msgr2=0x55a176ae7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f393dc85640 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176720280 0x55a176ae7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f393dc85640 1 -- 172.21.15.49:0/423936207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176740f60 msgr2=0x55a176ae6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f393dc85640 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176740f60 0x55a176ae6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f393dc85640 1 -- 172.21.15.49:0/423936207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1767ac540 con 0x55a1767180a0 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f393d484640 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176720280 0x55a176ae7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f392effd640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f39240b6560 0x7f39240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f393dc85640 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176ae7440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3934000c00 tx=0x7f3934032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8391aa05121e06f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:22.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f393e486640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f39240b6560 0x7f39240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f392effd640 1 -- 172.21.15.49:0/2022652787 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f39280e6f60 con 0x7f3938105380 2024-09-21T06:36:22.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f3923fff640 1 -- 172.21.15.49:0/423936207 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393403f070 con 0x55a1767180a0 2024-09-21T06:36:22.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f3923fff640 1 -- 172.21.15.49:0/423936207 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3934032e40 con 0x55a1767180a0 2024-09-21T06:36:22.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.388+0000 7f3923fff640 1 -- 172.21.15.49:0/423936207 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934035070 con 0x55a1767180a0 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f394645d740 1 -- 172.21.15.49:0/423936207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 msgr2=0x55a176ae7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f393e486640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f39240b6560 0x7f39240b8a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3930005fd0 tx=0x7f3930009700 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f394645d740 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176ae7440 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3934000c00 tx=0x7f3934032c50 comp rx=0 tx=0).stop 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f394645d740 1 -- 172.21.15.49:0/423936207 shutdown_connections 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f394645d740 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176720280 0x55a176ae7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f394645d740 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176ae7440 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f394645d740 1 --2- 172.21.15.49:0/423936207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176740f60 0x55a176ae6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f394645d740 1 -- 172.21.15.49:0/423936207 >> 172.21.15.49:0/423936207 conn(0x55a176735350 msgr2=0x55a176ae4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f394645d740 1 -- 172.21.15.49:0/423936207 shutdown_connections 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.389+0000 7f394645d740 1 -- 172.21.15.49:0/423936207 wait complete. 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f394645d740 1 -- start start 2024-09-21T06:36:22.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f394645d740 1 Processor -- start 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f394645d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176af27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f394645d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 0x55a176af2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f394645d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176740f60 0x55a176afe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f394645d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a1768af5f0 con 0x55a1767180a0 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f394645d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a1769e9010 con 0x55a176720280 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f394645d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a176af5680 con 0x55a176740f60 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f394645d740 10 client.0 _ll_register_callbacks cb 0x55a176a48340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f393dc85640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176af27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f393dc85640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176af27b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47950/0 (socket says 172.21.15.49:47950) 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.390+0000 7f393dc85640 1 -- 172.21.15.49:0/1603619180 learned_addr learned my addr 172.21.15.49:0/1603619180 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f393d484640 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 0x55a176af2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f393dc85640 1 -- 172.21.15.49:0/1603619180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176740f60 msgr2=0x55a176afe9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f393dc85640 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176740f60 0x55a176afe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f393dc85640 1 -- 172.21.15.49:0/1603619180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 msgr2=0x55a176af2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:22.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f393dc85640 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 0x55a176af2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f393dc85640 1 -- 172.21.15.49:0/1603619180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a176a16a00 con 0x55a1767180a0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f393dc85640 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176af27b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3934006010 tx=0x7f39340316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b99fc8ac6be7f25 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f39217fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f39217fa640 1 -- 172.21.15.49:0/1603619180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393403f070 con 0x55a1767180a0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f39217fa640 1 -- 172.21.15.49:0/1603619180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f3934004440 con 0x55a1767180a0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f394645d740 1 -- 172.21.15.49:0/1603619180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a176a60b60 con 0x55a1767180a0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f39217fa640 1 -- 172.21.15.49:0/1603619180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3934054050 con 0x55a1767180a0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f394645d740 10 client.15348 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.391+0000 7f394645d740 1 -- 172.21.15.49:0/1603619180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a176b014f0 con 0x55a1767180a0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.392+0000 7f39217fa640 1 -- 172.21.15.49:0/1603619180 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a176a60b60 con 0x55a1767180a0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.392+0000 7f39217fa640 1 -- 172.21.15.49:0/1603619180 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f393403b660 con 0x55a1767180a0 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.392+0000 7f394645d740 10 client.15348 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.392+0000 7f394645d740 10 client.15348 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.392+0000 7f394645d740 20 client.15348 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.392+0000 7f394645d740 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1766ff8e0 0x55a176b04ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.392+0000 7f394645d740 4 client.15348 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.392+0000 7f394645d740 1 -- 172.21.15.49:0/1603619180 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a176a5c610 con 0x55a1766ff8e0 2024-09-21T06:36:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.392+0000 7f393d484640 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1766ff8e0 0x55a176b04ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.393+0000 7f393d484640 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1766ff8e0 0x55a176b04ad0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df74eee36e0eedf6 server_cookie=254273afc668e8bf in_seq=0 out_seq=0 2024-09-21T06:36:22.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.393+0000 7f39217fa640 10 client.15348 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.393+0000 7f39217fa640 1 -- 172.21.15.49:0/1603619180 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a176a5c610 con 0x55a1766ff8e0 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.393+0000 7f39217fa640 10 client.15348 handle_command_reply: tid=0 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 client.15348 shutdown 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 -- 172.21.15.49:0/1603619180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 msgr2=0x55a176af27b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176af27b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3934006010 tx=0x7f39340316d0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 -- 172.21.15.49:0/1603619180 shutdown_connections 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1766ff8e0 0x55a176b04ad0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a176740f60 0x55a176afe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 0x55a176af2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f39217fa640 0 client.15348 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 --2- 172.21.15.49:0/1603619180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176af27b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 -- 172.21.15.49:0/1603619180 >> 172.21.15.49:0/1603619180 conn(0x55a176735350 msgr2=0x55a176aea090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:22.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 -- 172.21.15.49:0/1603619180 shutdown_connections 2024-09-21T06:36:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 1 -- 172.21.15.49:0/1603619180 wait complete. 2024-09-21T06:36:22.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.394+0000 7f394645d740 20 client.15348 trim_cache size 0 max 16384 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.412+0000 7f394645d740 1 Processor -- start 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.412+0000 7f394645d740 1 -- start start 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.412+0000 7f394645d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 0x55a176b04400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.412+0000 7f394645d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176aed020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.412+0000 7f394645d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 0x55a176afe940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.412+0000 7f394645d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a176b02e10 con 0x55a1767180a0 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.412+0000 7f394645d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a176b034e0 con 0x55a176720280 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.412+0000 7f394645d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a176b03bb0 con 0x55a1766ff8e0 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393d484640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176aed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393d484640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176aed020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47956/0 (socket says 172.21.15.49:47956) 2024-09-21T06:36:22.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393d484640 1 -- 172.21.15.49:0/3491769258 learned_addr learned my addr 172.21.15.49:0/3491769258 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393e486640 1 --2- 172.21.15.49:0/3491769258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 0x55a176afe940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393dc85640 1 --2- 172.21.15.49:0/3491769258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 0x55a176b04400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393d484640 1 -- 172.21.15.49:0/3491769258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 msgr2=0x55a176b04400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393d484640 1 --2- 172.21.15.49:0/3491769258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 0x55a176b04400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393d484640 1 -- 172.21.15.49:0/3491769258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 msgr2=0x55a176afe940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393d484640 1 --2- 172.21.15.49:0/3491769258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 0x55a176afe940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393d484640 1 -- 172.21.15.49:0/3491769258 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a176aee040 con 0x55a1767180a0 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f393d484640 1 --2- 172.21.15.49:0/3491769258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176aed020 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f39280accb0 tx=0x7f39280d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b182055ed87215e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f39237fe640 1 -- 172.21.15.49:0/3491769258 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928021040 con 0x55a1767180a0 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f39237fe640 1 -- 172.21.15.49:0/3491769258 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39280b1a90 con 0x55a1767180a0 2024-09-21T06:36:22.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.413+0000 7f39237fe640 1 -- 172.21.15.49:0/3491769258 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39280e90e0 con 0x55a1767180a0 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 -- 172.21.15.49:0/3491769258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 msgr2=0x55a176aed020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 --2- 172.21.15.49:0/3491769258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176aed020 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f39280accb0 tx=0x7f39280d0040 comp rx=0 tx=0).stop 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 -- 172.21.15.49:0/3491769258 shutdown_connections 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 --2- 172.21.15.49:0/3491769258 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a176720280 0x55a176afe940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 --2- 172.21.15.49:0/3491769258 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1767180a0 0x55a176aed020 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 --2- 172.21.15.49:0/3491769258 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 0x55a176b04400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 -- 172.21.15.49:0/3491769258 >> 172.21.15.49:0/3491769258 conn(0x55a176735350 msgr2=0x55a176af2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 -- 172.21.15.49:0/3491769258 shutdown_connections 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 -- 172.21.15.49:0/3491769258 wait complete. 2024-09-21T06:36:22.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.414+0000 7f394645d740 1 -- start start 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f394645d740 1 Processor -- start 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f394645d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 0x55a176b0d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f394645d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1767180a0 0x55a176b06990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f394645d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a176720280 0x55a176b06ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f394645d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a176b04950 con 0x55a176720280 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f394645d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a176b04280 con 0x55a1767180a0 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f394645d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a176b05020 con 0x55a1766ff8e0 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f394645d740 10 client.0 _ll_register_callbacks cb 0x7f39300095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f393e486640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a176720280 0x55a176b06ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f393e486640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a176720280 0x55a176b06ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47966/0 (socket says 172.21.15.49:47966) 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f393d484640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1767180a0 0x55a176b06990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f393e486640 1 -- 172.21.15.49:0/3529019138 learned_addr learned my addr 172.21.15.49:0/3529019138 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.415+0000 7f393dc85640 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 0x55a176b0d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f393e486640 1 -- 172.21.15.49:0/3529019138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 msgr2=0x55a176b0d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f393e486640 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 0x55a176b0d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f393e486640 1 -- 172.21.15.49:0/3529019138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1767180a0 msgr2=0x55a176b06990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f393e486640 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1767180a0 0x55a176b06990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f393e486640 1 -- 172.21.15.49:0/3529019138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a176b075e0 con 0x55a176720280 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f393d484640 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1767180a0 0x55a176b06990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f393e486640 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a176720280 0x55a176b06ed0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3930010960 tx=0x7f3930004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abb5edf1bb6282e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f39217fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f39217fa640 1 -- 172.21.15.49:0/3529019138 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393002c060 con 0x55a176720280 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f39217fa640 1 -- 172.21.15.49:0/3529019138 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f393001e620 con 0x55a176720280 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f394645d740 1 -- 172.21.15.49:0/3529019138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f39280b1a90 con 0x55a176720280 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f39217fa640 1 -- 172.21.15.49:0/3529019138 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f393001e860 con 0x55a176720280 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f394645d740 10 client.15354 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.416+0000 7f394645d740 1 -- 172.21.15.49:0/3529019138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a176b6ffa0 con 0x55a176720280 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.417+0000 7f39217fa640 1 -- 172.21.15.49:0/3529019138 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39280b1a90 con 0x55a176720280 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.417+0000 7f39217fa640 1 -- 172.21.15.49:0/3529019138 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f3930027b20 con 0x55a176720280 2024-09-21T06:36:22.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.417+0000 7f394645d740 10 client.15354 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.417+0000 7f394645d740 10 client.15354 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.417+0000 7f394645d740 20 client.15354 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.417+0000 7f394645d740 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a176740f60 0x55a176b73820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.417+0000 7f394645d740 4 client.15354 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.417+0000 7f394645d740 1 -- 172.21.15.49:0/3529019138 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "status"}) -- 0x55a176a59a40 con 0x55a176740f60 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.417+0000 7f393dc85640 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a176740f60 0x55a176b73820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f39217fa640 10 client.15354 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f393dc85640 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a176740f60 0x55a176b73820 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8495024a93411c93 server_cookie=ba6174ad3ee34f06 in_seq=0 out_seq=0 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f39217fa640 1 -- 172.21.15.49:0/3529019138 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a176a59a40 con 0x55a176740f60 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f39217fa640 10 client.15354 handle_command_reply: tid=0 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 client.15354 shutdown 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 -- 172.21.15.49:0/3529019138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a176720280 msgr2=0x55a176b06ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a176720280 0x55a176b06ed0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3930010960 tx=0x7f3930004ab0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 -- 172.21.15.49:0/3529019138 shutdown_connections 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a176740f60 0x55a176b73820 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a176720280 0x55a176b06ed0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1767180a0 0x55a176b06990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 --2- 172.21.15.49:0/3529019138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1766ff8e0 0x55a176b0d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f39217fa640 0 client.15354 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 -- 172.21.15.49:0/3529019138 >> 172.21.15.49:0/3529019138 conn(0x55a176735350 msgr2=0x55a176ae4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 -- 172.21.15.49:0/3529019138 shutdown_connections 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 1 -- 172.21.15.49:0/3529019138 wait complete. 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.418+0000 7f394645d740 20 client.15354 trim_cache size 0 max 16384 2024-09-21T06:36:22.424 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "cluster_fsid": "4a3fd104-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "whoami": 0, 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "id": 24686, 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "want_state": "up:active", 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "state": "up:active", 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "fs_name": "cephfs", 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "rank_uptime": 98.514706684000004, 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "mdsmap_epoch": 24, 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch": 78, 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_epoch_barrier": 74, 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout: "uptime": 108.873541252 2024-09-21T06:36:22.425 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:36:22.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 -- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f39240b6560 msgr2=0x7f39240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:22.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f39240b6560 0x7f39240b8a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3930005fd0 tx=0x7f3930009700 comp rx=0 tx=0).stop 2024-09-21T06:36:22.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 -- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938105380 msgr2=0x7f3938102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:22.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938105380 0x7f3938102cb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f392800d740 tx=0x7f392800dc00 comp rx=0 tx=0).stop 2024-09-21T06:36:22.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 -- 172.21.15.49:0/2022652787 shutdown_connections 2024-09-21T06:36:22.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f39240b6560 0x7f39240b8a70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f393810de60 0x7f39381031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.426 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3938105380 0x7f3938102cb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 --2- 172.21.15.49:0/2022652787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3938104a30 0x7f3938102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:22.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 -- 172.21.15.49:0/2022652787 >> 172.21.15.49:0/2022652787 conn(0x7f3938079760 msgr2=0x7f3938100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:22.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 -- 172.21.15.49:0/2022652787 shutdown_connections 2024-09-21T06:36:22.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:22.419+0000 7f393fee9640 1 -- 172.21.15.49:0/2022652787 wait complete. 2024-09-21T06:36:23.126 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T06:36:23.156 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T06:36:23.156 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T06:36:23.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:23.156 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T06:36:23.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:23.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-09-21T06:36:23.243 INFO:teuthology.orchestra.run.smithi049.stderr:Cannot find device "ceph-brx" 2024-09-21T06:36:23.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:36:23.245 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-21T06:36:23.245 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:36:23.245 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:23.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T06:36:23.401 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:23 smithi049 ceph-mon[31177]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 461 B/s wr, 6 op/s; 68 B/s, 0 objects/s recovering 2024-09-21T06:36:23.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:23 smithi098 ceph-mon[34704]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 461 B/s wr, 6 op/s; 68 B/s, 0 objects/s recovering 2024-09-21T06:36:23.547 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:23.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:23 smithi079 ceph-mon[34346]: pgmap v311: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 461 B/s wr, 6 op/s; 68 B/s, 0 objects/s recovering 2024-09-21T06:36:24.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.058+0000 7f33d168d640 1 -- 172.21.15.49:0/2403317982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc1083b0 msgr2=0x7f33cc1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:24.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.058+0000 7f33d168d640 1 --2- 172.21.15.49:0/2403317982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc1083b0 0x7f33cc1087c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009900 tx=0x7f33b402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:24.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.058+0000 7f33d168d640 1 -- 172.21.15.49:0/2403317982 shutdown_connections 2024-09-21T06:36:24.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.058+0000 7f33d168d640 1 --2- 172.21.15.49:0/2403317982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc108d00 0x7f33cc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:24.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.058+0000 7f33d168d640 1 --2- 172.21.15.49:0/2403317982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc1083b0 0x7f33cc1087c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:24.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.058+0000 7f33d168d640 1 --2- 172.21.15.49:0/2403317982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33cc102a70 0x7f33cc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:24.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.058+0000 7f33d168d640 1 -- 172.21.15.49:0/2403317982 >> 172.21.15.49:0/2403317982 conn(0x7f33cc079730 msgr2=0x7f33cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:24.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.058+0000 7f33d168d640 1 -- 172.21.15.49:0/2403317982 shutdown_connections 2024-09-21T06:36:24.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.058+0000 7f33d168d640 1 -- 172.21.15.49:0/2403317982 wait complete. 2024-09-21T06:36:24.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.059+0000 7f33d168d640 1 Processor -- start 2024-09-21T06:36:24.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.059+0000 7f33d168d640 1 -- start start 2024-09-21T06:36:24.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.059+0000 7f33d168d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc102a70 0x7f33cc19b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:24.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.059+0000 7f33d168d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33cc1083b0 0x7f33cc19b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.059+0000 7f33d168d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc108d00 0x7f33cc19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.059+0000 7f33d168d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc112970 con 0x7f33cc102a70 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.059+0000 7f33d168d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc1127f0 con 0x7f33cc1083b0 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.059+0000 7f33d168d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f33cc112af0 con 0x7f33cc108d00 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33caffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc102a70 0x7f33cc19b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33caffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc102a70 0x7f33cc19b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:47992/0 (socket says 172.21.15.49:47992) 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33caffd640 1 -- 172.21.15.49:0/3420072015 learned_addr learned my addr 172.21.15.49:0/3420072015 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33cb7fe640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc108d00 0x7f33cc19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33ca7fc640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33cc1083b0 0x7f33cc19b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33caffd640 1 -- 172.21.15.49:0/3420072015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc108d00 msgr2=0x7f33cc19bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33caffd640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc108d00 0x7f33cc19bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33caffd640 1 -- 172.21.15.49:0/3420072015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33cc1083b0 msgr2=0x7f33cc19b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:24.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33caffd640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33cc1083b0 0x7f33cc19b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:24.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33caffd640 1 -- 172.21.15.49:0/3420072015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33cc1a6560 con 0x7f33cc102a70 2024-09-21T06:36:24.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33ca7fc640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33cc1083b0 0x7f33cc19b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:24.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33caffd640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc102a70 0x7f33cc19b2a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00c890 tx=0x7f33bc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:24.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33c3fff640 1 -- 172.21.15.49:0/3420072015 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc004220 con 0x7f33cc102a70 2024-09-21T06:36:24.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33c3fff640 1 -- 172.21.15.49:0/3420072015 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33bc0043c0 con 0x7f33cc102a70 2024-09-21T06:36:24.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33cc1a6850 con 0x7f33cc102a70 2024-09-21T06:36:24.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.060+0000 7f33c3fff640 1 -- 172.21.15.49:0/3420072015 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33bc004a00 con 0x7f33cc102a70 2024-09-21T06:36:24.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.061+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33cc1a6d60 con 0x7f33cc102a70 2024-09-21T06:36:24.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.062+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33cc103cf0 con 0x7f33cc102a70 2024-09-21T06:36:24.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.063+0000 7f33c3fff640 1 -- 172.21.15.49:0/3420072015 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f33bc0079b0 con 0x7f33cc102a70 2024-09-21T06:36:24.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.064+0000 7f33c3fff640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f33b80b6560 0x7f33b80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:24.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.064+0000 7f33ca7fc640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f33b80b6560 0x7f33b80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:24.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.064+0000 7f33c3fff640 1 -- 172.21.15.49:0/3420072015 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f33bc0e7230 con 0x7f33cc102a70 2024-09-21T06:36:24.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.065+0000 7f33ca7fc640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f33b80b6560 0x7f33b80b8a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f33b4000c00 tx=0x7f33b4031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:24.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.069+0000 7f33c3fff640 1 -- 172.21.15.49:0/3420072015 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f33bc014030 con 0x7f33cc102a70 2024-09-21T06:36:24.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.305+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f33cc102e80 con 0x7f33cc102a70 2024-09-21T06:36:24.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.305+0000 7f33c3fff640 1 -- 172.21.15.49:0/3420072015 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f33bc0ad980 con 0x7f33cc102a70 2024-09-21T06:36:24.307 INFO:teuthology.orchestra.run.smithi049.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f33b80b6560 msgr2=0x7f33b80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f33b80b6560 0x7f33b80b8a70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f33b4000c00 tx=0x7f33b4031400 comp rx=0 tx=0).stop 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc102a70 msgr2=0x7f33cc19b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc102a70 0x7f33cc19b2a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00c890 tx=0x7f33bc00cd50 comp rx=0 tx=0).stop 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 shutdown_connections 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f33b80b6560 0x7f33b80b8a70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f33cc108d00 0x7f33cc19bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f33cc1083b0 0x7f33cc19b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 --2- 172.21.15.49:0/3420072015 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f33cc102a70 0x7f33cc19b2a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:24.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 >> 172.21.15.49:0/3420072015 conn(0x7f33cc079730 msgr2=0x7f33cc104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:24.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 shutdown_connections 2024-09-21T06:36:24.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:24.308+0000 7f33d168d640 1 -- 172.21.15.49:0/3420072015 wait complete. 2024-09-21T06:36:25.124 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:36:25.125 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:36:25.125 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi049.front.sepia.ceph.com 2024-09-21T06:36:25.125 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:36:25.125 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:25.125 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:36:25.125 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:36:25.125 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:36:25.125 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:36:25.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:25.125 DEBUG:teuthology.orchestra.run.smithi049:> ip addr 2024-09-21T06:36:25.142 INFO:teuthology.orchestra.run.smithi049.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:36:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:36:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:36:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:36:25.142 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 ::1/128 scope host 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:84 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f0 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:6b:ff:85 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp7s0f1 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:66 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f0 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: inet 172.21.15.49/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft 42178sec preferred_lft 42178sec 2024-09-21T06:36:25.143 INFO:teuthology.orchestra.run.smithi049.stdout: inet6 fe80::ec4:7aff:febd:1566/64 scope link 2024-09-21T06:36:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:36:25.144 INFO:teuthology.orchestra.run.smithi049.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:36:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: link/ether 0c:c4:7a:bd:15:67 brd ff:ff:ff:ff:ff:ff 2024-09-21T06:36:25.144 INFO:teuthology.orchestra.run.smithi049.stdout: altname enp1s0f1 2024-09-21T06:36:25.144 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:36:25.144 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:25.144 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T06:36:25.144 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:36:25.144 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr flush dev ceph-brx 2024-09-21T06:36:25.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set ceph-brx up 2024-09-21T06:36:25.145 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:36:25.145 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T06:36:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:25.346 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:25 smithi049 ceph-mon[31177]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 409 B/s wr, 6 op/s; 60 B/s, 0 objects/s recovering 2024-09-21T06:36:25.347 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:25 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3420072015' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:36:25.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:25.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:25.356 DEBUG:teuthology.orchestra.run.smithi049:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:36:25.381 INFO:teuthology.orchestra.run.smithi049.stdout:1 2024-09-21T06:36:25.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:25.386 DEBUG:teuthology.orchestra.run.smithi049:> route 2024-09-21T06:36:25.454 INFO:teuthology.orchestra.run.smithi049.stdout:Kernel IP routing table 2024-09-21T06:36:25.454 INFO:teuthology.orchestra.run.smithi049.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:36:25.454 INFO:teuthology.orchestra.run.smithi049.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T06:36:25.455 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T06:36:25.455 INFO:teuthology.orchestra.run.smithi049.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:36:25.455 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:25.455 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T06:36:25.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T06:36:25.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T06:36:25.455 DEBUG:teuthology.orchestra.run.smithi049:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T06:36:25.455 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T06:36:25.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:25.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:25 smithi098 ceph-mon[34704]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 409 B/s wr, 6 op/s; 60 B/s, 0 objects/s recovering 2024-09-21T06:36:25.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:25 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3420072015' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:36:25.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:25 smithi079 ceph-mon[34346]: pgmap v312: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 409 B/s wr, 6 op/s; 60 B/s, 0 objects/s recovering 2024-09-21T06:36:25.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:25 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3420072015' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:36:25.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:25.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:25.754 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T06:36:25.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:25.770 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list-id 2024-09-21T06:36:25.827 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:25.827 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T06:36:25.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:36:25.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T06:36:25.827 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T06:36:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:25.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:25.947 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T06:36:25.947 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:25.947 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T06:36:25.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T06:36:25.947 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:36:25.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T06:36:25.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T06:36:25.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T06:36:25.948 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T06:36:25.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:26.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:26.079 DEBUG:teuthology.orchestra.run.smithi049:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:26.079 DEBUG:teuthology.orchestra.run.smithi049:> set -e 2024-09-21T06:36:26.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set brx.0 up 2024-09-21T06:36:26.079 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:36:26.079 DEBUG:teuthology.orchestra.run.smithi049:> ') 2024-09-21T06:36:26.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:26.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:26.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:36:26.158 DEBUG:teuthology.orchestra.run.smithi049:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:26.174 INFO:teuthology.orchestra.run.smithi049.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:36:26.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:36:26.174 DEBUG:teuthology.orchestra.run.smithi049:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:26.230 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T06:36:26.230 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T06:36:26.230 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/2e65a34b-3b13-4412-8f21-6f1c5a1359aa 2024-09-21T06:36:26.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:26.230 DEBUG:teuthology.orchestra.run.smithi049:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/2e65a34b-3b13-4412-8f21-6f1c5a1359aa /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T06:36:26.348 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T06:36:26.348 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-21T06:36:26.348 INFO:teuthology.orchestra.run.smithi049.stdout:invalid new device string format 2024-09-21T06:36:26.500 INFO:teuthology.orchestra.run.smithi049.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-09-21T06:36:26.500 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-09-21T06:36:26.500 INFO:teuthology.orchestra.run.smithi049.stdout:invalid new device string format 2024-09-21T06:36:26.500 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: resolved to: "172.21.15.49:3300,172.21.15.79:3300,172.21.15.98:3300" 2024-09-21T06:36:26.500 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.49:3300,172.21.15.79:3300,172.21.15.98:3300:/volumes/qa/sv_1/2e65a34b-3b13-4412-8f21-6f1c5a1359aa 2024-09-21T06:36:26.500 INFO:teuthology.orchestra.run.smithi049.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=4a3fd104-77e2-11ef-baf5-efdc52797490" will pass to kernel 2024-09-21T06:36:26.501 INFO:teuthology.orchestra.run.smithi049.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:36:26.501 INFO:teuthology.orchestra.run.smithi049.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:36:26.501 INFO:teuthology.orchestra.run.smithi049.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:36:26.501 INFO:teuthology.orchestra.run.smithi049.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:36:26.501 INFO:teuthology.orchestra.run.smithi049.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:36:26.503 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:36:26.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:26.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:26.530 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:36:26.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:36:26.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:26.629 INFO:teuthology.orchestra.run.smithi049.stdout:client15363 2024-09-21T06:36:26.629 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:36:26.629 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:36:26.647 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:36:26.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:36:26.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:26.745 INFO:teuthology.orchestra.run.smithi049.stdout:client15363 2024-09-21T06:36:26.745 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:36:26.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:36:26.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:26.803 INFO:teuthology.orchestra.run.smithi049.stdout:client15363 2024-09-21T06:36:26.803 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490.client15363/status') 2024-09-21T06:36:26.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:26.863 INFO:teuthology.orchestra.run.smithi049.stdout:instance: client.15363 (3)192.168.0.1:0/2726936719 2024-09-21T06:36:26.863 INFO:teuthology.orchestra.run.smithi049.stdout:blocklisted: false 2024-09-21T06:36:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records in 2024-09-21T06:36:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:0+1 records out 2024-09-21T06:36:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:70 bytes copied, 2.539e-05 s, 2.8 MB/s 2024-09-21T06:36:26.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:26.871 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T06:36:26.880 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:36:26.880 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:36:26.880 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T06:36:26.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.996+0000 7fbb14720640 1 -- 172.21.15.49:0/2275434631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 msgr2=0x7fbb0c10f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:26.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.996+0000 7fbb14720640 1 --2- 172.21.15.49:0/2275434631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 0x7fbb0c10f480 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbb04009ca0 tx=0x7fbb0402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:26.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.996+0000 7fbb14720640 1 -- 172.21.15.49:0/2275434631 shutdown_connections 2024-09-21T06:36:26.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.996+0000 7fbb14720640 1 --2- 172.21.15.49:0/2275434631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 0x7fbb0c10f480 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:26.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.996+0000 7fbb14720640 1 --2- 172.21.15.49:0/2275434631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c108300 0x7fbb0c108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:26.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.996+0000 7fbb14720640 1 --2- 172.21.15.49:0/2275434631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c1029d0 0x7fbb0c102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:26.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.996+0000 7fbb14720640 1 -- 172.21.15.49:0/2275434631 >> 172.21.15.49:0/2275434631 conn(0x7fbb0c07a710 msgr2=0x7fbb0c07ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:26.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.996+0000 7fbb14720640 1 -- 172.21.15.49:0/2275434631 shutdown_connections 2024-09-21T06:36:26.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.996+0000 7fbb14720640 1 -- 172.21.15.49:0/2275434631 wait complete. 2024-09-21T06:36:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.997+0000 7fbb14720640 1 Processor -- start 2024-09-21T06:36:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.997+0000 7fbb14720640 1 -- start start 2024-09-21T06:36:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.997+0000 7fbb14720640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1029d0 0x7fbb0c199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.997+0000 7fbb14720640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c108300 0x7fbb0c199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.997+0000 7fbb14720640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 0x7fbb0c19eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.997+0000 7fbb14720640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c112910 con 0x7fbb0c108c50 2024-09-21T06:36:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.997+0000 7fbb14720640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c112790 con 0x7fbb0c108300 2024-09-21T06:36:27.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.997+0000 7fbb14720640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c112a90 con 0x7fbb0c1029d0 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb12cbd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 0x7fbb0c19eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb12cbd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 0x7fbb0c19eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56828/0 (socket says 172.21.15.49:56828) 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb12cbd640 1 -- 172.21.15.49:0/4154174672 learned_addr learned my addr 172.21.15.49:0/4154174672 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb124bc640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1029d0 0x7fbb0c199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb11cbb640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c108300 0x7fbb0c199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb12cbd640 1 -- 172.21.15.49:0/4154174672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1029d0 msgr2=0x7fbb0c199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb12cbd640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1029d0 0x7fbb0c199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb12cbd640 1 -- 172.21.15.49:0/4154174672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c108300 msgr2=0x7fbb0c199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb12cbd640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c108300 0x7fbb0c199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb12cbd640 1 -- 172.21.15.49:0/4154174672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0c19f110 con 0x7fbb0c108c50 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb124bc640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1029d0 0x7fbb0c199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb11cbb640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c108300 0x7fbb0c199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb12cbd640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 0x7fbb0c19eaa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbb04005cc0 tx=0x7fbb0402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:27.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb037fe640 1 -- 172.21.15.49:0/4154174672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb04003bf0 con 0x7fbb0c108c50 2024-09-21T06:36:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0c19f3a0 con 0x7fbb0c108c50 2024-09-21T06:36:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb037fe640 1 -- 172.21.15.49:0/4154174672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb04003d90 con 0x7fbb0c108c50 2024-09-21T06:36:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb037fe640 1 -- 172.21.15.49:0/4154174672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0402fbc0 con 0x7fbb0c108c50 2024-09-21T06:36:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.998+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0c1a5c20 con 0x7fbb0c108c50 2024-09-21T06:36:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:26.999+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0c103c40 con 0x7fbb0c108c50 2024-09-21T06:36:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.001+0000 7fbb037fe640 1 -- 172.21.15.49:0/4154174672 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fbb0402fd60 con 0x7fbb0c108c50 2024-09-21T06:36:27.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.002+0000 7fbb037fe640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf80b6560 0x7fbaf80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.002+0000 7fbb124bc640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf80b6560 0x7fbaf80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.002+0000 7fbb037fe640 1 -- 172.21.15.49:0/4154174672 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fbb04108b50 con 0x7fbb0c108c50 2024-09-21T06:36:27.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.002+0000 7fbb124bc640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf80b6560 0x7fbaf80b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb080058c0 tx=0x7fbb08005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:27.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.006+0000 7fbb037fe640 1 -- 172.21.15.49:0/4154174672 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbb040cf2a0 con 0x7fbb0c108c50 2024-09-21T06:36:27.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.232+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fbb0c19a390 con 0x7fbb0c108c50 2024-09-21T06:36:27.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.299+0000 7fbb037fe640 1 -- 172.21.15.49:0/4154174672 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7fbb040098b0 con 0x7fbb0c108c50 2024-09-21T06:36:27.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.301+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf80b6560 msgr2=0x7fbaf80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.301+0000 7fbb14720640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf80b6560 0x7fbaf80b8a70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb080058c0 tx=0x7fbb08005850 comp rx=0 tx=0).stop 2024-09-21T06:36:27.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.301+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 msgr2=0x7fbb0c19eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.301+0000 7fbb14720640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 0x7fbb0c19eaa0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbb04005cc0 tx=0x7fbb0402f380 comp rx=0 tx=0).stop 2024-09-21T06:36:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.302+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 shutdown_connections 2024-09-21T06:36:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.302+0000 7fbb14720640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf80b6560 0x7fbaf80b8a70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.302+0000 7fbb14720640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c108c50 0x7fbb0c19eaa0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.302+0000 7fbb14720640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c108300 0x7fbb0c199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.302+0000 7fbb14720640 1 --2- 172.21.15.49:0/4154174672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1029d0 0x7fbb0c199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.302+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 >> 172.21.15.49:0/4154174672 conn(0x7fbb0c07a710 msgr2=0x7fbb0c104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.302+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 shutdown_connections 2024-09-21T06:36:27.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.302+0000 7fbb14720640 1 -- 172.21.15.49:0/4154174672 wait complete. 2024-09-21T06:36:27.314 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T06:36:27.331 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T06:36:27.368 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:36:27.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.482+0000 7f63499cf640 1 -- 172.21.15.49:0/2354686722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 msgr2=0x7f6344108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.482+0000 7f63499cf640 1 --2- 172.21.15.49:0/2354686722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 0x7f6344108730 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f632c009900 tx=0x7f632c02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:27.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.482+0000 7f63499cf640 1 -- 172.21.15.49:0/2354686722 shutdown_connections 2024-09-21T06:36:27.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.482+0000 7f63499cf640 1 --2- 172.21.15.49:0/2354686722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6344108c70 0x7f634410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.482+0000 7f63499cf640 1 --2- 172.21.15.49:0/2354686722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 0x7f6344108730 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.482+0000 7f63499cf640 1 --2- 172.21.15.49:0/2354686722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63441029f0 0x7f6344102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.482+0000 7f63499cf640 1 -- 172.21.15.49:0/2354686722 >> 172.21.15.49:0/2354686722 conn(0x7f634407a780 msgr2=0x7f634407ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:27.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.482+0000 7f63499cf640 1 -- 172.21.15.49:0/2354686722 shutdown_connections 2024-09-21T06:36:27.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.482+0000 7f63499cf640 1 -- 172.21.15.49:0/2354686722 wait complete. 2024-09-21T06:36:27.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63499cf640 1 Processor -- start 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63499cf640 1 -- start start 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63499cf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63441029f0 0x7f634419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63499cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 0x7f634419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63499cf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6344108c70 0x7f634419bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63499cf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6344112930 con 0x7f6344108320 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63499cf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f63441127b0 con 0x7f63441029f0 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63499cf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6344112ab0 con 0x7f6344108c70 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63427fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 0x7f634419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63427fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 0x7f634419b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56838/0 (socket says 172.21.15.49:56838) 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63427fc640 1 -- 172.21.15.49:0/2101013537 learned_addr learned my addr 172.21.15.49:0/2101013537 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f63437fe640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6344108c70 0x7f634419bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.483+0000 7f6342ffd640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63441029f0 0x7f634419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63427fc640 1 -- 172.21.15.49:0/2101013537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6344108c70 msgr2=0x7f634419bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63427fc640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6344108c70 0x7f634419bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63427fc640 1 -- 172.21.15.49:0/2101013537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63441029f0 msgr2=0x7f634419b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63427fc640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63441029f0 0x7f634419b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63427fc640 1 -- 172.21.15.49:0/2101013537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63441a63e0 con 0x7f6344108320 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63427fc640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 0x7f634419b720 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f632c02a930 tx=0x7f632c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63489cd640 1 -- 172.21.15.49:0/2101013537 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c03f030 con 0x7f6344108320 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63489cd640 1 -- 172.21.15.49:0/2101013537 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f632c003aa0 con 0x7f6344108320 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63441a6670 con 0x7f6344108320 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63489cd640 1 -- 172.21.15.49:0/2101013537 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c035070 con 0x7f6344108320 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.484+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63441a6b60 con 0x7f6344108320 2024-09-21T06:36:27.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.485+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6344102e00 con 0x7f6344108320 2024-09-21T06:36:27.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.487+0000 7f63489cd640 1 -- 172.21.15.49:0/2101013537 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f632c042030 con 0x7f6344108320 2024-09-21T06:36:27.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.487+0000 7f63489cd640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f63300b6560 0x7f63300b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.488+0000 7f6342ffd640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f63300b6560 0x7f63300b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.488+0000 7f63489cd640 1 -- 172.21.15.49:0/2101013537 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f632c1077a0 con 0x7f6344108320 2024-09-21T06:36:27.490 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.488+0000 7f6342ffd640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f63300b6560 0x7f63300b8a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f634406c0d0 tx=0x7f633c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:27.493 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.492+0000 7f63489cd640 1 -- 172.21.15.49:0/2101013537 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f632c0cdef0 con 0x7f6344108320 2024-09-21T06:36:27.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:27 smithi098 ceph-mon[34704]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 345 B/s wr, 5 op/s; 50 B/s, 0 objects/s recovering 2024-09-21T06:36:27.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:27 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4154174672' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:36:27.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:27 smithi079 ceph-mon[34346]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 345 B/s wr, 5 op/s; 50 B/s, 0 objects/s recovering 2024-09-21T06:36:27.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:27 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4154174672' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:36:27.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.680+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f634410a4d0 con 0x7f6344108320 2024-09-21T06:36:27.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.682+0000 7f63489cd640 1 -- 172.21.15.49:0/2101013537 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+23122 (secure 0 0 0) 0x7f632c0d22d0 con 0x7f6344108320 2024-09-21T06:36:27.684 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:27.684 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":78,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:36:14.252235+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9},{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:36:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f63300b6560 msgr2=0x7f63300b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f63300b6560 0x7f63300b8a70 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f634406c0d0 tx=0x7f633c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 msgr2=0x7f634419b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 0x7f634419b720 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f632c02a930 tx=0x7f632c004270 comp rx=0 tx=0).stop 2024-09-21T06:36:27.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 shutdown_connections 2024-09-21T06:36:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f63300b6560 0x7f63300b8a70 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6344108c70 0x7f634419bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6344108320 0x7f634419b720 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 --2- 172.21.15.49:0/2101013537 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f63441029f0 0x7f634419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 >> 172.21.15.49:0/2101013537 conn(0x7f634407a780 msgr2=0x7f6344106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 shutdown_connections 2024-09-21T06:36:27.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.684+0000 7f63499cf640 1 -- 172.21.15.49:0/2101013537 wait complete. 2024-09-21T06:36:27.696 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:27 smithi049 ceph-mon[31177]: pgmap v313: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 345 B/s wr, 5 op/s; 50 B/s, 0 objects/s recovering 2024-09-21T06:36:27.696 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:27 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4154174672' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:36:27.697 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:30:10.495246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:34:39.428290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:34:41.517864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:36:27.698 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:36:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.813+0000 7f992b830640 1 -- 172.21.15.49:0/2237591272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99241082d0 msgr2=0x7f99241086e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.813+0000 7f992b830640 1 --2- 172.21.15.49:0/2237591272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99241082d0 0x7f99241086e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9914009900 tx=0x7f991402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.813+0000 7f992b830640 1 -- 172.21.15.49:0/2237591272 shutdown_connections 2024-09-21T06:36:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.813+0000 7f992b830640 1 --2- 172.21.15.49:0/2237591272 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9924108c20 0x7f992410f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.813+0000 7f992b830640 1 --2- 172.21.15.49:0/2237591272 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99241082d0 0x7f99241086e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.813+0000 7f992b830640 1 --2- 172.21.15.49:0/2237591272 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f99241029a0 0x7f9924102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.813+0000 7f992b830640 1 -- 172.21.15.49:0/2237591272 >> 172.21.15.49:0/2237591272 conn(0x7f99240fe3e0 msgr2=0x7f9924100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:27.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.813+0000 7f992b830640 1 -- 172.21.15.49:0/2237591272 shutdown_connections 2024-09-21T06:36:27.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.813+0000 7f992b830640 1 -- 172.21.15.49:0/2237591272 wait complete. 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f992b830640 1 Processor -- start 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f992b830640 1 -- start start 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f992b830640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99241029a0 0x7f9924199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f992b830640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99241082d0 0x7f99241998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f992b830640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924108c20 0x7f992419eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f992b830640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f99241128e0 con 0x7f99241082d0 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f992b830640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9924112760 con 0x7f99241029a0 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f992b830640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9924112a60 con 0x7f9924108c20 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f9928dcb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99241082d0 0x7f99241998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f9928dcb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99241082d0 0x7f99241998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56862/0 (socket says 172.21.15.49:56862) 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f9928dcb640 1 -- 172.21.15.49:0/1570061750 learned_addr learned my addr 172.21.15.49:0/1570061750 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f9929dcd640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924108c20 0x7f992419eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.814+0000 7f99295cc640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99241029a0 0x7f9924199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f9928dcb640 1 -- 172.21.15.49:0/1570061750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924108c20 msgr2=0x7f992419eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f9928dcb640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924108c20 0x7f992419eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f9928dcb640 1 -- 172.21.15.49:0/1570061750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99241029a0 msgr2=0x7f9924199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f9928dcb640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99241029a0 0x7f9924199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f9928dcb640 1 -- 172.21.15.49:0/1570061750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f992419f270 con 0x7f99241082d0 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f99295cc640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99241029a0 0x7f9924199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f9928dcb640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99241082d0 0x7f99241998e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f991402a930 tx=0x7f9914031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f991a7fc640 1 -- 172.21.15.49:0/1570061750 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991403f030 con 0x7f99241082d0 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f992419f500 con 0x7f99241082d0 2024-09-21T06:36:27.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f991a7fc640 1 -- 172.21.15.49:0/1570061750 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99140043d0 con 0x7f99241082d0 2024-09-21T06:36:27.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f991a7fc640 1 -- 172.21.15.49:0/1570061750 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914035070 con 0x7f99241082d0 2024-09-21T06:36:27.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.815+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99241a5cf0 con 0x7f99241082d0 2024-09-21T06:36:27.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.816+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9924103c10 con 0x7f99241082d0 2024-09-21T06:36:27.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.819+0000 7f991a7fc640 1 -- 172.21.15.49:0/1570061750 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f9914042030 con 0x7f99241082d0 2024-09-21T06:36:27.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.819+0000 7f991a7fc640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99100b6560 0x7f99100b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:27.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.819+0000 7f99295cc640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99100b6560 0x7f99100b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:27.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.819+0000 7f991a7fc640 1 -- 172.21.15.49:0/1570061750 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9914107c70 con 0x7f99241082d0 2024-09-21T06:36:27.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.820+0000 7f99295cc640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99100b6560 0x7f99100b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9920009c20 tx=0x7f9920005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:27.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:27.823+0000 7f991a7fc640 1 -- 172.21.15.49:0/1570061750 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99140ce360 con 0x7f99241082d0 2024-09-21T06:36:28.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.010+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f992410aa40 con 0x7f99241082d0 2024-09-21T06:36:28.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.010+0000 7f991a7fc640 1 -- 172.21.15.49:0/1570061750 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f99140d2740 con 0x7f99241082d0 2024-09-21T06:36:28.012 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-09-21T06:36:28.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99100b6560 msgr2=0x7f99100b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99100b6560 0x7f99100b8a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9920009c20 tx=0x7f9920005f90 comp rx=0 tx=0).stop 2024-09-21T06:36:28.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99241082d0 msgr2=0x7f99241998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99241082d0 0x7f99241998e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f991402a930 tx=0x7f9914031a20 comp rx=0 tx=0).stop 2024-09-21T06:36:28.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 shutdown_connections 2024-09-21T06:36:28.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f99100b6560 0x7f99100b8a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9924108c20 0x7f992419eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f99241082d0 0x7f99241998e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 --2- 172.21.15.49:0/1570061750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f99241029a0 0x7f9924199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 >> 172.21.15.49:0/1570061750 conn(0x7f99240fe3e0 msgr2=0x7f9924100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:28.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 shutdown_connections 2024-09-21T06:36:28.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.013+0000 7f992b830640 1 -- 172.21.15.49:0/1570061750 wait complete. 2024-09-21T06:36:28.026 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:36:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.140+0000 7f757bd6a640 1 -- 172.21.15.49:0/3661233569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574107160 msgr2=0x7f7574107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.142 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.140+0000 7f757bd6a640 1 --2- 172.21.15.49:0/3661233569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574107160 0x7f7574107570 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f756c009ca0 tx=0x7f756c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.141+0000 7f757bd6a640 1 -- 172.21.15.49:0/3661233569 shutdown_connections 2024-09-21T06:36:28.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.141+0000 7f757bd6a640 1 --2- 172.21.15.49:0/3661233569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7574107160 0x7f7574107570 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.141+0000 7f757bd6a640 1 --2- 172.21.15.49:0/3661233569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f757406c000 0x7f757406c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.141+0000 7f757bd6a640 1 --2- 172.21.15.49:0/3661233569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f75741085e0 0x7f757406bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.141+0000 7f757bd6a640 1 -- 172.21.15.49:0/3661233569 >> 172.21.15.49:0/3661233569 conn(0x7f7574079570 msgr2=0x7f7574079980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:28.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.141+0000 7f757bd6a640 1 -- 172.21.15.49:0/3661233569 shutdown_connections 2024-09-21T06:36:28.143 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.141+0000 7f757bd6a640 1 -- 172.21.15.49:0/3661233569 wait complete. 2024-09-21T06:36:28.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.141+0000 7f757bd6a640 1 Processor -- start 2024-09-21T06:36:28.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.141+0000 7f757bd6a640 1 -- start start 2024-09-21T06:36:28.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f757bd6a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f757406c000 0x7f75741a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:28.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f757bd6a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7574107160 0x7f75741a0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:28.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f757bd6a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75741085e0 0x7f75741a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f757bd6a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7574119fe0 con 0x7f757406c000 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f757bd6a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7574119e60 con 0x7f75741085e0 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f757bd6a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f757411a160 con 0x7f7574107160 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579b06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f757406c000 0x7f75741a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579b06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f757406c000 0x7f75741a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56882/0 (socket says 172.21.15.49:56882) 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579b06640 1 -- 172.21.15.49:0/528880486 learned_addr learned my addr 172.21.15.49:0/528880486 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579305640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7574107160 0x7f75741a0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579b06640 1 -- 172.21.15.49:0/528880486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7574107160 msgr2=0x7f75741a0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579b06640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7574107160 0x7f75741a0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579b06640 1 -- 172.21.15.49:0/528880486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75741085e0 msgr2=0x7f75741a61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f757a307640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75741085e0 0x7f75741a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579b06640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75741085e0 0x7f75741a61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579b06640 1 -- 172.21.15.49:0/528880486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75741a68a0 con 0x7f757406c000 2024-09-21T06:36:28.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579305640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7574107160 0x7f75741a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:28.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f7579b06640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f757406c000 0x7f75741a0970 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f757000c890 tx=0x7f757000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:28.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.142+0000 7f756affd640 1 -- 172.21.15.49:0/528880486 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570004220 con 0x7f757406c000 2024-09-21T06:36:28.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.143+0000 7f756affd640 1 -- 172.21.15.49:0/528880486 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75700043c0 con 0x7f757406c000 2024-09-21T06:36:28.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.143+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75741a6b90 con 0x7f757406c000 2024-09-21T06:36:28.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.143+0000 7f756affd640 1 -- 172.21.15.49:0/528880486 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570004a00 con 0x7f757406c000 2024-09-21T06:36:28.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.143+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75741ad320 con 0x7f757406c000 2024-09-21T06:36:28.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.143+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7574107570 con 0x7f757406c000 2024-09-21T06:36:28.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.145+0000 7f756affd640 1 -- 172.21.15.49:0/528880486 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f75700079b0 con 0x7f757406c000 2024-09-21T06:36:28.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.146+0000 7f756affd640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75600b6560 0x7f75600b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:28.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.146+0000 7f7579305640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75600b6560 0x7f75600b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:28.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.146+0000 7f756affd640 1 -- 172.21.15.49:0/528880486 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f75700e76a0 con 0x7f757406c000 2024-09-21T06:36:28.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.146+0000 7f7579305640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75600b6560 0x7f75600b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7564005d00 tx=0x7f7564005c70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:28.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.149+0000 7f756affd640 1 -- 172.21.15.49:0/528880486 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7570014030 con 0x7f757406c000 2024-09-21T06:36:28.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.340+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f75741ad770 con 0x7f757406c000 2024-09-21T06:36:28.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.341+0000 7f756affd640 1 -- 172.21.15.49:0/528880486 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) ==== 104+0+11 (secure 0 0 0) 0x7f75700addf0 con 0x7f757406c000 2024-09-21T06:36:28.343 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-09-21T06:36:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75600b6560 msgr2=0x7f75600b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75600b6560 0x7f75600b8a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7564005d00 tx=0x7f7564005c70 comp rx=0 tx=0).stop 2024-09-21T06:36:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f757406c000 msgr2=0x7f75741a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f757406c000 0x7f75741a0970 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f757000c890 tx=0x7f757000cd50 comp rx=0 tx=0).stop 2024-09-21T06:36:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 shutdown_connections 2024-09-21T06:36:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f75600b6560 0x7f75600b8a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f75741085e0 0x7f75741a61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7574107160 0x7f75741a0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 --2- 172.21.15.49:0/528880486 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f757406c000 0x7f75741a0970 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 >> 172.21.15.49:0/528880486 conn(0x7f7574079570 msgr2=0x7f7574101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 shutdown_connections 2024-09-21T06:36:28.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.343+0000 7f757bd6a640 1 -- 172.21.15.49:0/528880486 wait complete. 2024-09-21T06:36:28.356 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:36:28.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.471+0000 7f149298b640 1 -- 172.21.15.49:0/1532590266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c108c30 msgr2=0x7f148c10f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.471+0000 7f149298b640 1 --2- 172.21.15.49:0/1532590266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c108c30 0x7f148c10f460 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1484009ca0 tx=0x7f148402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.472+0000 7f149298b640 1 -- 172.21.15.49:0/1532590266 shutdown_connections 2024-09-21T06:36:28.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.472+0000 7f149298b640 1 --2- 172.21.15.49:0/1532590266 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c108c30 0x7f148c10f460 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.472+0000 7f149298b640 1 --2- 172.21.15.49:0/1532590266 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f148c1082e0 0x7f148c1086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.472+0000 7f149298b640 1 --2- 172.21.15.49:0/1532590266 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148c1029b0 0x7f148c102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.472+0000 7f149298b640 1 -- 172.21.15.49:0/1532590266 >> 172.21.15.49:0/1532590266 conn(0x7f148c0fe390 msgr2=0x7f148c1007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:28.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.472+0000 7f149298b640 1 -- 172.21.15.49:0/1532590266 shutdown_connections 2024-09-21T06:36:28.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.472+0000 7f149298b640 1 -- 172.21.15.49:0/1532590266 wait complete. 2024-09-21T06:36:28.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.472+0000 7f149298b640 1 Processor -- start 2024-09-21T06:36:28.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.472+0000 7f149298b640 1 -- start start 2024-09-21T06:36:28.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f149298b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c1029b0 0x7f148c199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:28.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f149298b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148c1082e0 0x7f148c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:28.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f149298b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f148c108c30 0x7f148c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:28.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f149298b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f148c1128f0 con 0x7f148c1029b0 2024-09-21T06:36:28.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f149298b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f148c112770 con 0x7f148c108c30 2024-09-21T06:36:28.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f149298b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f148c112a70 con 0x7f148c1082e0 2024-09-21T06:36:28.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c1029b0 0x7f148c199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:28.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c1029b0 0x7f148c199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56906/0 (socket says 172.21.15.49:56906) 2024-09-21T06:36:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148bfff640 1 -- 172.21.15.49:0/381926656 learned_addr learned my addr 172.21.15.49:0/381926656 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148b7fe640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148c1082e0 0x7f148c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f1490f28640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f148c108c30 0x7f148c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148bfff640 1 -- 172.21.15.49:0/381926656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148c1082e0 msgr2=0x7f148c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.484 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148bfff640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148c1082e0 0x7f148c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148bfff640 1 -- 172.21.15.49:0/381926656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f148c108c30 msgr2=0x7f148c19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148bfff640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f148c108c30 0x7f148c19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148bfff640 1 -- 172.21.15.49:0/381926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148c19f240 con 0x7f148c1029b0 2024-09-21T06:36:28.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148b7fe640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148c1082e0 0x7f148c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:28.485 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.473+0000 7f148bfff640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c1029b0 0x7f148c199310 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f147c00d770 tx=0x7f147c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:28.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.474+0000 7f14897fa640 1 -- 172.21.15.49:0/381926656 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c017070 con 0x7f148c1029b0 2024-09-21T06:36:28.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.474+0000 7f14897fa640 1 -- 172.21.15.49:0/381926656 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f147c0054d0 con 0x7f148c1029b0 2024-09-21T06:36:28.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.474+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148c19f530 con 0x7f148c1029b0 2024-09-21T06:36:28.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.474+0000 7f14897fa640 1 -- 172.21.15.49:0/381926656 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c004c30 con 0x7f148c1029b0 2024-09-21T06:36:28.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.474+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148c1a5cc0 con 0x7f148c1029b0 2024-09-21T06:36:28.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.475+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f148c102dc0 con 0x7f148c1029b0 2024-09-21T06:36:28.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.476+0000 7f14897fa640 1 -- 172.21.15.49:0/381926656 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f147c004dd0 con 0x7f148c1029b0 2024-09-21T06:36:28.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.477+0000 7f14897fa640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14740b6560 0x7f14740b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:28.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.477+0000 7f148b7fe640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14740b6560 0x7f14740b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:28.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.477+0000 7f14897fa640 1 -- 172.21.15.49:0/381926656 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f147c0e7460 con 0x7f148c1029b0 2024-09-21T06:36:28.487 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.477+0000 7f148b7fe640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14740b6560 0x7f14740b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1480005fd0 tx=0x7f1480005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:28.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.480+0000 7f14897fa640 1 -- 172.21.15.49:0/381926656 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f147c0adbb0 con 0x7f148c1029b0 2024-09-21T06:36:28.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:28 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4154174672' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:36:28.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:28 smithi079 ceph-mon[34346]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:36:28.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:28 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2101013537' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:28.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:28 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1570061750' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:36:28.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.669+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f148c02e640 con 0x7f148c1029b0 2024-09-21T06:36:28.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.669+0000 7f14897fa640 1 -- 172.21.15.49:0/381926656 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) ==== 100+0+11 (secure 0 0 0) 0x7f147c0b1f90 con 0x7f148c1029b0 2024-09-21T06:36:28.671 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-09-21T06:36:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14740b6560 msgr2=0x7f14740b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14740b6560 0x7f14740b8a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1480005fd0 tx=0x7f1480005850 comp rx=0 tx=0).stop 2024-09-21T06:36:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c1029b0 msgr2=0x7f148c199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c1029b0 0x7f148c199310 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f147c00d770 tx=0x7f147c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:36:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 shutdown_connections 2024-09-21T06:36:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14740b6560 0x7f14740b8a70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f148c108c30 0x7f148c19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f148c1082e0 0x7f148c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 --2- 172.21.15.49:0/381926656 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f148c1029b0 0x7f148c199310 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:28.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.671+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 >> 172.21.15.49:0/381926656 conn(0x7f148c0fe390 msgr2=0x7f148c06a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:28.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.672+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 shutdown_connections 2024-09-21T06:36:28.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:28.672+0000 7f149298b640 1 -- 172.21.15.49:0/381926656 wait complete. 2024-09-21T06:36:28.683 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:28 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4154174672' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:36:28.683 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:28 smithi049 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:36:28.683 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:28 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2101013537' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:28.684 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:28 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1570061750' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:36:28.685 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T06:36:28.685 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:36:28.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:28 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4154174672' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:36:28.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:28 smithi098 ceph-mon[34704]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:36:28.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:28 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2101013537' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:28.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:28 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1570061750' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:36:28.943 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:29.394 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:29 smithi049 ceph-mon[31177]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:36:29.394 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:29 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/528880486' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:36:29.395 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:29 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/381926656' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:36:29.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.486+0000 7f3c41249640 1 -- 172.21.15.49:0/2951405230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 msgr2=0x7f3c3c10f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.486+0000 7f3c41249640 1 --2- 172.21.15.49:0/2951405230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 0x7f3c3c10f580 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009ca0 tx=0x7f3c3402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.486+0000 7f3c41249640 1 -- 172.21.15.49:0/2951405230 shutdown_connections 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.486+0000 7f3c41249640 1 --2- 172.21.15.49:0/2951405230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 0x7f3c3c10f580 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.486+0000 7f3c41249640 1 --2- 172.21.15.49:0/2951405230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c3c1051c0 0x7f3c3c1055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.486+0000 7f3c41249640 1 --2- 172.21.15.49:0/2951405230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c3c1031b0 0x7f3c3c1035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.486+0000 7f3c41249640 1 -- 172.21.15.49:0/2951405230 >> 172.21.15.49:0/2951405230 conn(0x7f3c3c079f90 msgr2=0x7f3c3c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.486+0000 7f3c41249640 1 -- 172.21.15.49:0/2951405230 shutdown_connections 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.486+0000 7f3c41249640 1 -- 172.21.15.49:0/2951405230 wait complete. 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c41249640 1 Processor -- start 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c41249640 1 -- start start 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c41249640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c3c1031b0 0x7f3c3c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c41249640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c3c1051c0 0x7f3c3c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:29.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c41249640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 0x7f3c3c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c41249640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c112a10 con 0x7f3c3c105b10 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c41249640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c112890 con 0x7f3c3c1051c0 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c41249640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3c3c112b90 con 0x7f3c3c1031b0 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c3b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 0x7f3c3c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c3b59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 0x7f3c3c19fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56922/0 (socket says 172.21.15.49:56922) 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c3b59e640 1 -- 172.21.15.49:0/3032647598 learned_addr learned my addr 172.21.15.49:0/3032647598 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c3ad9d640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c3c1031b0 0x7f3c3c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.487+0000 7f3c3a59c640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c3c1051c0 0x7f3c3c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c3b59e640 1 -- 172.21.15.49:0/3032647598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c3c1031b0 msgr2=0x7f3c3c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c3b59e640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c3c1031b0 0x7f3c3c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c3b59e640 1 -- 172.21.15.49:0/3032647598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c3c1051c0 msgr2=0x7f3c3c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c3b59e640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c3c1051c0 0x7f3c3c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c3b59e640 1 -- 172.21.15.49:0/3032647598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c3c1a0400 con 0x7f3c3c105b10 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c3b59e640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 0x7f3c3c19fcd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3c34005cc0 tx=0x7f3c3402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:29.496 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c23fff640 1 -- 172.21.15.49:0/3032647598 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c34003bf0 con 0x7f3c3c105b10 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c3c1a0690 con 0x7f3c3c105b10 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c23fff640 1 -- 172.21.15.49:0/3032647598 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c34003d90 con 0x7f3c3c105b10 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c23fff640 1 -- 172.21.15.49:0/3032647598 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3402fbc0 con 0x7f3c3c105b10 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.488+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c3c1a6e50 con 0x7f3c3c105b10 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.489+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c3c103f30 con 0x7f3c3c105b10 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.491+0000 7f3c23fff640 1 -- 172.21.15.49:0/3032647598 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f3c3402fd60 con 0x7f3c3c105b10 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.492+0000 7f3c23fff640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c240b6560 0x7f3c240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.492+0000 7f3c3ad9d640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c240b6560 0x7f3c240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.492+0000 7f3c23fff640 1 -- 172.21.15.49:0/3032647598 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f3c34108b50 con 0x7f3c3c105b10 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.493+0000 7f3c3ad9d640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c240b6560 0x7f3c240b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0058c0 tx=0x7f3c2c00a250 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:29.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.496+0000 7f3c23fff640 1 -- 172.21.15.49:0/3032647598 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c340cf2a0 con 0x7f3c3c105b10 2024-09-21T06:36:29.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:29 smithi079 ceph-mon[34346]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:36:29.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:29 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/528880486' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:36:29.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:29 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/381926656' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:36:29.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.727+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c3c1035c0 con 0x7f3c3c105b10 2024-09-21T06:36:29.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.728+0000 7f3c23fff640 1 -- 172.21.15.49:0/3032647598 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f3c3c1035c0 con 0x7f3c3c105b10 2024-09-21T06:36:29.729 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:29.730 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"btime":"2024-09-21T06:36:27:292026+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:36:27.233682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:36:29.730 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-09-21T06:36:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c240b6560 msgr2=0x7f3c240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c240b6560 0x7f3c240b8a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c0058c0 tx=0x7f3c2c00a250 comp rx=0 tx=0).stop 2024-09-21T06:36:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 msgr2=0x7f3c3c19fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 0x7f3c3c19fcd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3c34005cc0 tx=0x7f3c3402f380 comp rx=0 tx=0).stop 2024-09-21T06:36:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 shutdown_connections 2024-09-21T06:36:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3c240b6560 0x7f3c240b8a70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3c3c105b10 0x7f3c3c19fcd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3c3c1051c0 0x7f3c3c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 --2- 172.21.15.49:0/3032647598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3c3c1031b0 0x7f3c3c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 >> 172.21.15.49:0/3032647598 conn(0x7f3c3c079f90 msgr2=0x7f3c3c1011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 shutdown_connections 2024-09-21T06:36:29.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:29.730+0000 7f3c41249640 1 -- 172.21.15.49:0/3032647598 wait complete. 2024-09-21T06:36:29.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:29 smithi098 ceph-mon[34704]: pgmap v314: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 426 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T06:36:29.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:29 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/528880486' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:36:29.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:29 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/381926656' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:36:30.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:30 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3032647598' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:30.542 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T06:36:30.542 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T06:36:30.542 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:36:30.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:30 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3032647598' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.663+0000 7f0edcbba640 1 -- 172.21.15.49:0/3855460329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed8106b20 msgr2=0x7f0ed8110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.663+0000 7f0edcbba640 1 --2- 172.21.15.49:0/3855460329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed8106b20 0x7f0ed8110590 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009ca0 tx=0x7f0ed002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.663+0000 7f0edcbba640 1 -- 172.21.15.49:0/3855460329 shutdown_connections 2024-09-21T06:36:30.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.663+0000 7f0edcbba640 1 --2- 172.21.15.49:0/3855460329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed8106b20 0x7f0ed8110590 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.663+0000 7f0edcbba640 1 --2- 172.21.15.49:0/3855460329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ed81061d0 0x7f0ed81065e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.663+0000 7f0edcbba640 1 --2- 172.21.15.49:0/3855460329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ed806bc80 0x7f0ed806c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.663+0000 7f0edcbba640 1 -- 172.21.15.49:0/3855460329 >> 172.21.15.49:0/3855460329 conn(0x7f0ed8078740 msgr2=0x7f0ed8078b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:30.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.663+0000 7f0edcbba640 1 -- 172.21.15.49:0/3855460329 shutdown_connections 2024-09-21T06:36:30.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.663+0000 7f0edcbba640 1 -- 172.21.15.49:0/3855460329 wait complete. 2024-09-21T06:36:30.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.664+0000 7f0edcbba640 1 Processor -- start 2024-09-21T06:36:30.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.664+0000 7f0edcbba640 1 -- start start 2024-09-21T06:36:30.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.664+0000 7f0edcbba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ed806bc80 0x7f0ed819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:30.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0edcbba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed81061d0 0x7f0ed819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:30.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0edcbba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ed8106b20 0x7f0ed819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:30.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0edcbba640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8113a20 con 0x7f0ed81061d0 2024-09-21T06:36:30.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0edcbba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed81138a0 con 0x7f0ed806bc80 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0edcbba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed8113ba0 con 0x7f0ed8106b20 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed81061d0 0x7f0ed819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed5d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed81061d0 0x7f0ed819a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56936/0 (socket says 172.21.15.49:56936) 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed5d9b640 1 -- 172.21.15.49:0/79349406 learned_addr learned my addr 172.21.15.49:0/79349406 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed6d9d640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ed8106b20 0x7f0ed819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed659c640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ed806bc80 0x7f0ed819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed5d9b640 1 -- 172.21.15.49:0/79349406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ed8106b20 msgr2=0x7f0ed819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed5d9b640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ed8106b20 0x7f0ed819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed5d9b640 1 -- 172.21.15.49:0/79349406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ed806bc80 msgr2=0x7f0ed819a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed5d9b640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ed806bc80 0x7f0ed819a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed5d9b640 1 -- 172.21.15.49:0/79349406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed81a02c0 con 0x7f0ed81061d0 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ed5d9b640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed81061d0 0x7f0ed819a9c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00d750 tx=0x7f0ecc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ec77fe640 1 -- 172.21.15.49:0/79349406 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc017070 con 0x7f0ed81061d0 2024-09-21T06:36:30.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ec77fe640 1 -- 172.21.15.49:0/79349406 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ecc0054d0 con 0x7f0ed81061d0 2024-09-21T06:36:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed81a05b0 con 0x7f0ed81061d0 2024-09-21T06:36:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0ec77fe640 1 -- 172.21.15.49:0/79349406 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc004c30 con 0x7f0ed81061d0 2024-09-21T06:36:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.665+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed81a6dd0 con 0x7f0ed81061d0 2024-09-21T06:36:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.667+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed806c090 con 0x7f0ed81061d0 2024-09-21T06:36:30.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.668+0000 7f0ec77fe640 1 -- 172.21.15.49:0/79349406 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f0ecc004dd0 con 0x7f0ed81061d0 2024-09-21T06:36:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.669+0000 7f0ec77fe640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ec00b65e0 0x7f0ec00b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.670+0000 7f0ed659c640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ec00b65e0 0x7f0ec00b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.670+0000 7f0ec77fe640 1 -- 172.21.15.49:0/79349406 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0ecc0e71f0 con 0x7f0ed81061d0 2024-09-21T06:36:30.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.670+0000 7f0ed659c640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ec00b65e0 0x7f0ec00b8af0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005e10 tx=0x7f0ec8005da0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:30.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.673+0000 7f0ec77fe640 1 -- 172.21.15.49:0/79349406 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ecc0ad9c0 con 0x7f0ed81061d0 2024-09-21T06:36:30.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:30 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3032647598' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:30.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.858+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ed8063800 con 0x7f0ec00b65e0 2024-09-21T06:36:30.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.863+0000 7f0ec77fe640 1 -- 172.21.15.49:0/79349406 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258802 (secure 0 0 0) 0x7f0ed8063800 con 0x7f0ec00b65e0 2024-09-21T06:36:30.867 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:30.868 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ec00b65e0 msgr2=0x7f0ec00b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ec00b65e0 0x7f0ec00b8af0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8005e10 tx=0x7f0ec8005da0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed81061d0 msgr2=0x7f0ed819a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed81061d0 0x7f0ed819a9c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00d750 tx=0x7f0ecc00dc10 comp rx=0 tx=0).stop 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 shutdown_connections 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ec00b65e0 0x7f0ec00b8af0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ed8106b20 0x7f0ed819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ed81061d0 0x7f0ed819a9c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 --2- 172.21.15.49:0/79349406 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ed806bc80 0x7f0ed819a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 >> 172.21.15.49:0/79349406 conn(0x7f0ed8078740 msgr2=0x7f0ed81074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:30.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 shutdown_connections 2024-09-21T06:36:30.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:30.866+0000 7f0edcbba640 1 -- 172.21.15.49:0/79349406 wait complete. 2024-09-21T06:36:30.879 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-21T06:36:30.132034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660883,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":663,"num_read_kb":425,"num_write":295,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":3017196,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":738,"ondisk_log_size":738,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357416,"kb_used_data":12264,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584408,"statfs":{"total":1151940427776,"available":1151574433792,"internally_reserved":0,"allocated":12558336,"data_stored":7099257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003370"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276569+0000","last_change":"2024-09-21T06:34:42.895466+0000","last_active":"2024-09-21T06:36:14.276569+0000","last_peered":"2024-09-21T06:36:14.276569+0000","last_clean":"2024-09-21T06:36:14.276569+0000","last_became_active":"2024-09-21T06:34:42.895084+0000","last_became_peered":"2024-09-21T06:34:42.895084+0000","last_unstale":"2024-09-21T06:36:14.276569+0000","last_undegraded":"2024-09-21T06:36:14.276569+0000","last_fullsized":"2024-09-21T06:36:14.276569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.513107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.285962+0000","last_change":"2024-09-21T06:34:42.888307+0000","last_active":"2024-09-21T06:36:14.285962+0000","last_peered":"2024-09-21T06:36:14.285962+0000","last_clean":"2024-09-21T06:36:14.285962+0000","last_became_active":"2024-09-21T06:34:42.886106+0000","last_became_peered":"2024-09-21T06:34:42.886106+0000","last_unstale":"2024-09-21T06:36:14.285962+0000","last_undegraded":"2024-09-21T06:36:14.285962+0000","last_fullsized":"2024-09-21T06:36:14.285962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:57.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286005+0000","last_change":"2024-09-21T06:34:42.897217+0000","last_active":"2024-09-21T06:36:14.286005+0000","last_peered":"2024-09-21T06:36:14.286005+0000","last_clean":"2024-09-21T06:36:14.286005+0000","last_became_active":"2024-09-21T06:34:42.896849+0000","last_became_peered":"2024-09-21T06:34:42.896849+0000","last_unstale":"2024-09-21T06:36:14.286005+0000","last_undegraded":"2024-09-21T06:36:14.286005+0000","last_fullsized":"2024-09-21T06:36:14.286005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:28.749566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275509+0000","last_change":"2024-09-21T06:34:42.887236+0000","last_active":"2024-09-21T06:36:14.275509+0000","last_peered":"2024-09-21T06:36:14.275509+0000","last_clean":"2024-09-21T06:36:14.275509+0000","last_became_active":"2024-09-21T06:34:42.886137+0000","last_became_peered":"2024-09-21T06:34:42.886137+0000","last_unstale":"2024-09-21T06:36:14.275509+0000","last_undegraded":"2024-09-21T06:36:14.275509+0000","last_fullsized":"2024-09-21T06:36:14.275509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:23.728433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275250+0000","last_change":"2024-09-21T06:34:42.885792+0000","last_active":"2024-09-21T06:36:14.275250+0000","last_peered":"2024-09-21T06:36:14.275250+0000","last_clean":"2024-09-21T06:36:14.275250+0000","last_became_active":"2024-09-21T06:34:42.885372+0000","last_became_peered":"2024-09-21T06:34:42.885372+0000","last_unstale":"2024-09-21T06:36:14.275250+0000","last_undegraded":"2024-09-21T06:36:14.275250+0000","last_fullsized":"2024-09-21T06:36:14.275250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:29.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613320+0000","last_change":"2024-09-21T06:34:42.896814+0000","last_active":"2024-09-21T06:36:14.613320+0000","last_peered":"2024-09-21T06:36:14.613320+0000","last_clean":"2024-09-21T06:36:14.613320+0000","last_became_active":"2024-09-21T06:34:42.896147+0000","last_became_peered":"2024-09-21T06:34:42.896147+0000","last_unstale":"2024-09-21T06:36:14.613320+0000","last_undegraded":"2024-09-21T06:36:14.613320+0000","last_fullsized":"2024-09-21T06:36:14.613320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:49.037539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720733+0000","last_change":"2024-09-21T06:34:42.896264+0000","last_active":"2024-09-21T06:36:14.720733+0000","last_peered":"2024-09-21T06:36:14.720733+0000","last_clean":"2024-09-21T06:36:14.720733+0000","last_became_active":"2024-09-21T06:34:42.895793+0000","last_became_peered":"2024-09-21T06:34:42.895793+0000","last_unstale":"2024-09-21T06:36:14.720733+0000","last_undegraded":"2024-09-21T06:36:14.720733+0000","last_fullsized":"2024-09-21T06:36:14.720733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:06.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.274942+0000","last_change":"2024-09-21T06:34:42.892538+0000","last_active":"2024-09-21T06:36:14.274942+0000","last_peered":"2024-09-21T06:36:14.274942+0000","last_clean":"2024-09-21T06:36:14.274942+0000","last_became_active":"2024-09-21T06:34:42.892139+0000","last_became_peered":"2024-09-21T06:34:42.892139+0000","last_unstale":"2024-09-21T06:36:14.274942+0000","last_undegraded":"2024-09-21T06:36:14.274942+0000","last_fullsized":"2024-09-21T06:36:14.274942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:51.808969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272795+0000","last_change":"2024-09-21T06:35:13.499797+0000","last_active":"2024-09-21T06:36:14.272795+0000","last_peered":"2024-09-21T06:36:14.272795+0000","last_clean":"2024-09-21T06:36:14.272795+0000","last_became_active":"2024-09-21T06:35:13.499380+0000","last_became_peered":"2024-09-21T06:35:13.499380+0000","last_unstale":"2024-09-21T06:36:14.272795+0000","last_undegraded":"2024-09-21T06:36:14.272795+0000","last_fullsized":"2024-09-21T06:36:14.272795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:21.809657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11],"acting":[9,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":38,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613693+0000","last_change":"2024-09-21T06:34:42.895533+0000","last_active":"2024-09-21T06:36:14.613693+0000","last_peered":"2024-09-21T06:36:14.613693+0000","last_clean":"2024-09-21T06:36:14.613693+0000","last_became_active":"2024-09-21T06:34:42.895162+0000","last_became_peered":"2024-09-21T06:34:42.895162+0000","last_unstale":"2024-09-21T06:36:14.613693+0000","last_undegraded":"2024-09-21T06:36:14.613693+0000","last_fullsized":"2024-09-21T06:36:14.613693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:25.495493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721181+0000","last_change":"2024-09-21T06:34:42.894173+0000","last_active":"2024-09-21T06:36:14.721181+0000","last_peered":"2024-09-21T06:36:14.721181+0000","last_clean":"2024-09-21T06:36:14.721181+0000","last_became_active":"2024-09-21T06:34:42.893817+0000","last_became_peered":"2024-09-21T06:34:42.893817+0000","last_unstale":"2024-09-21T06:36:14.721181+0000","last_undegraded":"2024-09-21T06:36:14.721181+0000","last_fullsized":"2024-09-21T06:36:14.721181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:31.580564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275513+0000","last_change":"2024-09-21T06:34:42.886536+0000","last_active":"2024-09-21T06:36:14.275513+0000","last_peered":"2024-09-21T06:36:14.275513+0000","last_clean":"2024-09-21T06:36:14.275513+0000","last_became_active":"2024-09-21T06:34:42.885636+0000","last_became_peered":"2024-09-21T06:34:42.885636+0000","last_unstale":"2024-09-21T06:36:14.275513+0000","last_undegraded":"2024-09-21T06:36:14.275513+0000","last_fullsized":"2024-09-21T06:36:14.275513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:11.074850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721016+0000","last_change":"2024-09-21T06:34:42.882665+0000","last_active":"2024-09-21T06:36:14.721016+0000","last_peered":"2024-09-21T06:36:14.721016+0000","last_clean":"2024-09-21T06:36:14.721016+0000","last_became_active":"2024-09-21T06:34:42.882254+0000","last_became_peered":"2024-09-21T06:34:42.882254+0000","last_unstale":"2024-09-21T06:36:14.721016+0000","last_undegraded":"2024-09-21T06:36:14.721016+0000","last_fullsized":"2024-09-21T06:36:14.721016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:01.203542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.285809+0000","last_change":"2024-09-21T06:34:42.884034+0000","last_active":"2024-09-21T06:36:14.285809+0000","last_peered":"2024-09-21T06:36:14.285809+0000","last_clean":"2024-09-21T06:36:14.285809+0000","last_became_active":"2024-09-21T06:34:42.883685+0000","last_became_peered":"2024-09-21T06:34:42.883685+0000","last_unstale":"2024-09-21T06:36:14.285809+0000","last_undegraded":"2024-09-21T06:36:14.285809+0000","last_fullsized":"2024-09-21T06:36:14.285809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:00.124019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.285548+0000","last_change":"2024-09-21T06:34:42.894686+0000","last_active":"2024-09-21T06:36:14.285548+0000","last_peered":"2024-09-21T06:36:14.285548+0000","last_clean":"2024-09-21T06:36:14.285548+0000","last_became_active":"2024-09-21T06:34:42.893980+0000","last_became_peered":"2024-09-21T06:34:42.893980+0000","last_unstale":"2024-09-21T06:36:14.285548+0000","last_undegraded":"2024-09-21T06:36:14.285548+0000","last_fullsized":"2024-09-21T06:36:14.285548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:00.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278132+0000","last_change":"2024-09-21T06:34:42.891462+0000","last_active":"2024-09-21T06:36:14.278132+0000","last_peered":"2024-09-21T06:36:14.278132+0000","last_clean":"2024-09-21T06:36:14.278132+0000","last_became_active":"2024-09-21T06:34:42.891085+0000","last_became_peered":"2024-09-21T06:34:42.891085+0000","last_unstale":"2024-09-21T06:36:14.278132+0000","last_undegraded":"2024-09-21T06:36:14.278132+0000","last_fullsized":"2024-09-21T06:36:14.278132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:03.942909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276607+0000","last_change":"2024-09-21T06:34:42.897049+0000","last_active":"2024-09-21T06:36:14.276607+0000","last_peered":"2024-09-21T06:36:14.276607+0000","last_clean":"2024-09-21T06:36:14.276607+0000","last_became_active":"2024-09-21T06:34:42.896131+0000","last_became_peered":"2024-09-21T06:34:42.896131+0000","last_unstale":"2024-09-21T06:36:14.276607+0000","last_undegraded":"2024-09-21T06:36:14.276607+0000","last_fullsized":"2024-09-21T06:36:14.276607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:47.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.273016+0000","last_change":"2024-09-21T06:34:42.887894+0000","last_active":"2024-09-21T06:36:14.273016+0000","last_peered":"2024-09-21T06:36:14.273016+0000","last_clean":"2024-09-21T06:36:14.273016+0000","last_became_active":"2024-09-21T06:34:42.887436+0000","last_became_peered":"2024-09-21T06:34:42.887436+0000","last_unstale":"2024-09-21T06:36:14.273016+0000","last_undegraded":"2024-09-21T06:36:14.273016+0000","last_fullsized":"2024-09-21T06:36:14.273016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:22.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282032+0000","last_change":"2024-09-21T06:34:42.888071+0000","last_active":"2024-09-21T06:36:14.282032+0000","last_peered":"2024-09-21T06:36:14.282032+0000","last_clean":"2024-09-21T06:36:14.282032+0000","last_became_active":"2024-09-21T06:34:42.887295+0000","last_became_peered":"2024-09-21T06:34:42.887295+0000","last_unstale":"2024-09-21T06:36:14.282032+0000","last_undegraded":"2024-09-21T06:36:14.282032+0000","last_fullsized":"2024-09-21T06:36:14.282032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:49.937367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275863+0000","last_change":"2024-09-21T06:34:42.891963+0000","last_active":"2024-09-21T06:36:14.275863+0000","last_peered":"2024-09-21T06:36:14.275863+0000","last_clean":"2024-09-21T06:36:14.275863+0000","last_became_active":"2024-09-21T06:34:42.891603+0000","last_became_peered":"2024-09-21T06:34:42.891603+0000","last_unstale":"2024-09-21T06:36:14.275863+0000","last_undegraded":"2024-09-21T06:36:14.275863+0000","last_fullsized":"2024-09-21T06:36:14.275863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:47.608523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721088+0000","last_change":"2024-09-21T06:34:42.895909+0000","last_active":"2024-09-21T06:36:14.721088+0000","last_peered":"2024-09-21T06:36:14.721088+0000","last_clean":"2024-09-21T06:36:14.721088+0000","last_became_active":"2024-09-21T06:34:42.895477+0000","last_became_peered":"2024-09-21T06:34:42.895477+0000","last_unstale":"2024-09-21T06:36:14.721088+0000","last_undegraded":"2024-09-21T06:36:14.721088+0000","last_fullsized":"2024-09-21T06:36:14.721088+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.284523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278719+0000","last_change":"2024-09-21T06:34:42.893554+0000","last_active":"2024-09-21T06:36:14.278719+0000","last_peered":"2024-09-21T06:36:14.278719+0000","last_clean":"2024-09-21T06:36:14.278719+0000","last_became_active":"2024-09-21T06:34:42.892949+0000","last_became_peered":"2024-09-21T06:34:42.892949+0000","last_unstale":"2024-09-21T06:36:14.278719+0000","last_undegraded":"2024-09-21T06:36:14.278719+0000","last_fullsized":"2024-09-21T06:36:14.278719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:57.107590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275055+0000","last_change":"2024-09-21T06:34:42.894574+0000","last_active":"2024-09-21T06:36:14.275055+0000","last_peered":"2024-09-21T06:36:14.275055+0000","last_clean":"2024-09-21T06:36:14.275055+0000","last_became_active":"2024-09-21T06:34:42.894027+0000","last_became_peered":"2024-09-21T06:34:42.894027+0000","last_unstale":"2024-09-21T06:36:14.275055+0000","last_undegraded":"2024-09-21T06:36:14.275055+0000","last_fullsized":"2024-09-21T06:36:14.275055+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:58.425792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616251+0000","last_change":"2024-09-21T06:35:13.499715+0000","last_active":"2024-09-21T06:36:14.616251+0000","last_peered":"2024-09-21T06:36:14.616251+0000","last_clean":"2024-09-21T06:36:14.616251+0000","last_became_active":"2024-09-21T06:35:13.499171+0000","last_became_peered":"2024-09-21T06:35:13.499171+0000","last_unstale":"2024-09-21T06:36:14.616251+0000","last_undegraded":"2024-09-21T06:36:14.616251+0000","last_fullsized":"2024-09-21T06:36:14.616251+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:35.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275221+0000","last_change":"2024-09-21T06:35:13.499458+0000","last_active":"2024-09-21T06:36:14.275221+0000","last_peered":"2024-09-21T06:36:14.275221+0000","last_clean":"2024-09-21T06:36:14.275221+0000","last_became_active":"2024-09-21T06:35:13.498984+0000","last_became_peered":"2024-09-21T06:35:13.498984+0000","last_unstale":"2024-09-21T06:36:14.275221+0000","last_undegraded":"2024-09-21T06:36:14.275221+0000","last_fullsized":"2024-09-21T06:36:14.275221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:10.871658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.283069+0000","last_change":"2024-09-21T06:34:42.888826+0000","last_active":"2024-09-21T06:36:14.283069+0000","last_peered":"2024-09-21T06:36:14.283069+0000","last_clean":"2024-09-21T06:36:14.283069+0000","last_became_active":"2024-09-21T06:34:42.888447+0000","last_became_peered":"2024-09-21T06:34:42.888447+0000","last_unstale":"2024-09-21T06:36:14.283069+0000","last_undegraded":"2024-09-21T06:36:14.283069+0000","last_fullsized":"2024-09-21T06:36:14.283069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:52.634516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276951+0000","last_change":"2024-09-21T06:34:42.889377+0000","last_active":"2024-09-21T06:36:14.276951+0000","last_peered":"2024-09-21T06:36:14.276951+0000","last_clean":"2024-09-21T06:36:14.276951+0000","last_became_active":"2024-09-21T06:34:42.888978+0000","last_became_peered":"2024-09-21T06:34:42.888978+0000","last_unstale":"2024-09-21T06:36:14.276951+0000","last_undegraded":"2024-09-21T06:36:14.276951+0000","last_fullsized":"2024-09-21T06:36:14.276951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:34.734283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721000+0000","last_change":"2024-09-21T06:34:42.878128+0000","last_active":"2024-09-21T06:36:14.721000+0000","last_peered":"2024-09-21T06:36:14.721000+0000","last_clean":"2024-09-21T06:36:14.721000+0000","last_became_active":"2024-09-21T06:34:42.877742+0000","last_became_peered":"2024-09-21T06:34:42.877742+0000","last_unstale":"2024-09-21T06:36:14.721000+0000","last_undegraded":"2024-09-21T06:36:14.721000+0000","last_fullsized":"2024-09-21T06:36:14.721000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:04.992402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286162+0000","last_change":"2024-09-21T06:34:42.882659+0000","last_active":"2024-09-21T06:36:14.286162+0000","last_peered":"2024-09-21T06:36:14.286162+0000","last_clean":"2024-09-21T06:36:14.286162+0000","last_became_active":"2024-09-21T06:34:42.882306+0000","last_became_peered":"2024-09-21T06:34:42.882306+0000","last_unstale":"2024-09-21T06:36:14.286162+0000","last_undegraded":"2024-09-21T06:36:14.286162+0000","last_fullsized":"2024-09-21T06:36:14.286162+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:31.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282347+0000","last_change":"2024-09-21T06:34:42.890089+0000","last_active":"2024-09-21T06:36:14.282347+0000","last_peered":"2024-09-21T06:36:14.282347+0000","last_clean":"2024-09-21T06:36:14.282347+0000","last_became_active":"2024-09-21T06:34:42.889739+0000","last_became_peered":"2024-09-21T06:34:42.889739+0000","last_unstale":"2024-09-21T06:36:14.282347+0000","last_undegraded":"2024-09-21T06:36:14.282347+0000","last_fullsized":"2024-09-21T06:36:14.282347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.212760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.283358+0000","last_change":"2024-09-21T06:35:13.290617+0000","last_active":"2024-09-21T06:36:14.283358+0000","last_peered":"2024-09-21T06:36:14.283358+0000","last_clean":"2024-09-21T06:36:14.283358+0000","last_became_active":"2024-09-21T06:35:13.290005+0000","last_became_peered":"2024-09-21T06:35:13.290005+0000","last_unstale":"2024-09-21T06:36:14.283358+0000","last_undegraded":"2024-09-21T06:36:14.283358+0000","last_fullsized":"2024-09-21T06:36:14.283358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:39.490034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276810+0000","last_change":"2024-09-21T06:34:42.893859+0000","last_active":"2024-09-21T06:36:14.276810+0000","last_peered":"2024-09-21T06:36:14.276810+0000","last_clean":"2024-09-21T06:36:14.276810+0000","last_became_active":"2024-09-21T06:34:42.893485+0000","last_became_peered":"2024-09-21T06:34:42.893485+0000","last_unstale":"2024-09-21T06:36:14.276810+0000","last_undegraded":"2024-09-21T06:36:14.276810+0000","last_fullsized":"2024-09-21T06:36:14.276810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:59.936750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.274979+0000","last_change":"2024-09-21T06:34:42.887164+0000","last_active":"2024-09-21T06:36:14.274979+0000","last_peered":"2024-09-21T06:36:14.274979+0000","last_clean":"2024-09-21T06:36:14.274979+0000","last_became_active":"2024-09-21T06:34:42.886314+0000","last_became_peered":"2024-09-21T06:34:42.886314+0000","last_unstale":"2024-09-21T06:36:14.274979+0000","last_undegraded":"2024-09-21T06:36:14.274979+0000","last_fullsized":"2024-09-21T06:36:14.274979+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:09.529922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'7","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:26.115414+0000","last_change":"2024-09-21T06:34:40.883170+0000","last_active":"2024-09-21T06:36:26.115414+0000","last_peered":"2024-09-21T06:36:26.115414+0000","last_clean":"2024-09-21T06:36:26.115414+0000","last_became_active":"2024-09-21T06:34:40.882760+0000","last_became_peered":"2024-09-21T06:34:40.882760+0000","last_unstale":"2024-09-21T06:36:26.115414+0000","last_undegraded":"2024-09-21T06:36:26.115414+0000","last_fullsized":"2024-09-21T06:36:26.115414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:41.388275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616511+0000","last_change":"2024-09-21T06:34:42.893842+0000","last_active":"2024-09-21T06:36:14.616511+0000","last_peered":"2024-09-21T06:36:14.616511+0000","last_clean":"2024-09-21T06:36:14.616511+0000","last_became_active":"2024-09-21T06:34:42.893501+0000","last_became_peered":"2024-09-21T06:34:42.893501+0000","last_unstale":"2024-09-21T06:36:14.616511+0000","last_undegraded":"2024-09-21T06:36:14.616511+0000","last_fullsized":"2024-09-21T06:36:14.616511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.610084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613413+0000","last_change":"2024-09-21T06:34:40.878685+0000","last_active":"2024-09-21T06:36:14.613413+0000","last_peered":"2024-09-21T06:36:14.613413+0000","last_clean":"2024-09-21T06:36:14.613413+0000","last_became_active":"2024-09-21T06:34:40.878279+0000","last_became_peered":"2024-09-21T06:34:40.878279+0000","last_unstale":"2024-09-21T06:36:14.613413+0000","last_undegraded":"2024-09-21T06:36:14.613413+0000","last_fullsized":"2024-09-21T06:36:14.613413+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:11.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720677+0000","last_change":"2024-09-21T06:34:40.872074+0000","last_active":"2024-09-21T06:36:14.720677+0000","last_peered":"2024-09-21T06:36:14.720677+0000","last_clean":"2024-09-21T06:36:14.720677+0000","last_became_active":"2024-09-21T06:34:40.871637+0000","last_became_peered":"2024-09-21T06:34:40.871637+0000","last_unstale":"2024-09-21T06:36:14.720677+0000","last_undegraded":"2024-09-21T06:36:14.720677+0000","last_fullsized":"2024-09-21T06:36:14.720677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275067+0000","last_change":"2024-09-21T06:34:42.882803+0000","last_active":"2024-09-21T06:36:14.275067+0000","last_peered":"2024-09-21T06:36:14.275067+0000","last_clean":"2024-09-21T06:36:14.275067+0000","last_became_active":"2024-09-21T06:34:42.881509+0000","last_became_peered":"2024-09-21T06:34:42.881509+0000","last_unstale":"2024-09-21T06:36:14.275067+0000","last_undegraded":"2024-09-21T06:36:14.275067+0000","last_fullsized":"2024-09-21T06:36:14.275067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616519+0000","last_change":"2024-09-21T06:34:40.883054+0000","last_active":"2024-09-21T06:36:14.616519+0000","last_peered":"2024-09-21T06:36:14.616519+0000","last_clean":"2024-09-21T06:36:14.616519+0000","last_became_active":"2024-09-21T06:34:40.882299+0000","last_became_peered":"2024-09-21T06:34:40.882299+0000","last_unstale":"2024-09-21T06:36:14.616519+0000","last_undegraded":"2024-09-21T06:36:14.616519+0000","last_fullsized":"2024-09-21T06:36:14.616519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:17.813744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272581+0000","last_change":"2024-09-21T06:34:42.886437+0000","last_active":"2024-09-21T06:36:14.272581+0000","last_peered":"2024-09-21T06:36:14.272581+0000","last_clean":"2024-09-21T06:36:14.272581+0000","last_became_active":"2024-09-21T06:34:42.886075+0000","last_became_peered":"2024-09-21T06:34:42.886075+0000","last_unstale":"2024-09-21T06:36:14.272581+0000","last_undegraded":"2024-09-21T06:36:14.272581+0000","last_fullsized":"2024-09-21T06:36:14.272581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.179323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:25.113267+0000","last_change":"2024-09-21T06:34:40.880931+0000","last_active":"2024-09-21T06:36:25.113267+0000","last_peered":"2024-09-21T06:36:25.113267+0000","last_clean":"2024-09-21T06:36:25.113267+0000","last_became_active":"2024-09-21T06:34:40.880555+0000","last_became_peered":"2024-09-21T06:34:40.880555+0000","last_unstale":"2024-09-21T06:36:25.113267+0000","last_undegraded":"2024-09-21T06:36:25.113267+0000","last_fullsized":"2024-09-21T06:36:25.113267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:29.304297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278477+0000","last_change":"2024-09-21T06:34:42.899618+0000","last_active":"2024-09-21T06:36:14.278477+0000","last_peered":"2024-09-21T06:36:14.278477+0000","last_clean":"2024-09-21T06:36:14.278477+0000","last_became_active":"2024-09-21T06:34:42.899230+0000","last_became_peered":"2024-09-21T06:34:42.899230+0000","last_unstale":"2024-09-21T06:36:14.278477+0000","last_undegraded":"2024-09-21T06:36:14.278477+0000","last_fullsized":"2024-09-21T06:36:14.278477+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:27.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721020+0000","last_change":"2024-09-21T06:34:40.882988+0000","last_active":"2024-09-21T06:36:14.721020+0000","last_peered":"2024-09-21T06:36:14.721020+0000","last_clean":"2024-09-21T06:36:14.721020+0000","last_became_active":"2024-09-21T06:34:40.882533+0000","last_became_peered":"2024-09-21T06:34:40.882533+0000","last_unstale":"2024-09-21T06:36:14.721020+0000","last_undegraded":"2024-09-21T06:36:14.721020+0000","last_fullsized":"2024-09-21T06:36:14.721020+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:23.220540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286367+0000","last_change":"2024-09-21T06:34:42.889556+0000","last_active":"2024-09-21T06:36:14.286367+0000","last_peered":"2024-09-21T06:36:14.286367+0000","last_clean":"2024-09-21T06:36:14.286367+0000","last_became_active":"2024-09-21T06:34:42.888853+0000","last_became_peered":"2024-09-21T06:34:42.888853+0000","last_unstale":"2024-09-21T06:36:14.286367+0000","last_undegraded":"2024-09-21T06:36:14.286367+0000","last_fullsized":"2024-09-21T06:36:14.286367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:24.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616668+0000","last_change":"2024-09-21T06:34:40.891450+0000","last_active":"2024-09-21T06:36:14.616668+0000","last_peered":"2024-09-21T06:36:14.616668+0000","last_clean":"2024-09-21T06:36:14.616668+0000","last_became_active":"2024-09-21T06:34:40.890892+0000","last_became_peered":"2024-09-21T06:34:40.890892+0000","last_unstale":"2024-09-21T06:36:14.616668+0000","last_undegraded":"2024-09-21T06:36:14.616668+0000","last_fullsized":"2024-09-21T06:36:14.616668+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.975342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.279539+0000","last_change":"2024-09-21T06:34:42.893122+0000","last_active":"2024-09-21T06:36:14.279539+0000","last_peered":"2024-09-21T06:36:14.279539+0000","last_clean":"2024-09-21T06:36:14.279539+0000","last_became_active":"2024-09-21T06:34:42.892730+0000","last_became_peered":"2024-09-21T06:34:42.892730+0000","last_unstale":"2024-09-21T06:36:14.279539+0000","last_undegraded":"2024-09-21T06:36:14.279539+0000","last_fullsized":"2024-09-21T06:36:14.279539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:06.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'31","reported_seq":272,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:25.635741+0000","last_change":"2024-09-21T06:35:13.509359+0000","last_active":"2024-09-21T06:36:25.635741+0000","last_peered":"2024-09-21T06:36:25.635741+0000","last_clean":"2024-09-21T06:36:25.635741+0000","last_became_active":"2024-09-21T06:35:13.499621+0000","last_became_peered":"2024-09-21T06:35:13.499621+0000","last_unstale":"2024-09-21T06:36:25.635741+0000","last_undegraded":"2024-09-21T06:36:25.635741+0000","last_fullsized":"2024-09-21T06:36:25.635741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:52.396964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66139,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":149,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":64752,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275256+0000","last_change":"2024-09-21T06:34:42.890487+0000","last_active":"2024-09-21T06:36:14.275256+0000","last_peered":"2024-09-21T06:36:14.275256+0000","last_clean":"2024-09-21T06:36:14.275256+0000","last_became_active":"2024-09-21T06:34:42.890100+0000","last_became_peered":"2024-09-21T06:34:42.890100+0000","last_unstale":"2024-09-21T06:36:14.275256+0000","last_undegraded":"2024-09-21T06:36:14.275256+0000","last_fullsized":"2024-09-21T06:36:14.275256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.206869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282371+0000","last_change":"2024-09-21T06:34:40.876187+0000","last_active":"2024-09-21T06:36:14.282371+0000","last_peered":"2024-09-21T06:36:14.282371+0000","last_clean":"2024-09-21T06:36:14.282371+0000","last_became_active":"2024-09-21T06:34:40.875687+0000","last_became_peered":"2024-09-21T06:34:40.875687+0000","last_unstale":"2024-09-21T06:36:14.282371+0000","last_undegraded":"2024-09-21T06:36:14.282371+0000","last_fullsized":"2024-09-21T06:36:14.282371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:51.758625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720726+0000","last_change":"2024-09-21T06:34:42.895900+0000","last_active":"2024-09-21T06:36:14.720726+0000","last_peered":"2024-09-21T06:36:14.720726+0000","last_clean":"2024-09-21T06:36:14.720726+0000","last_became_active":"2024-09-21T06:34:42.895504+0000","last_became_peered":"2024-09-21T06:34:42.895504+0000","last_unstale":"2024-09-21T06:36:14.720726+0000","last_undegraded":"2024-09-21T06:36:14.720726+0000","last_fullsized":"2024-09-21T06:36:14.720726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:28.414017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616473+0000","last_change":"2024-09-21T06:34:40.882856+0000","last_active":"2024-09-21T06:36:14.616473+0000","last_peered":"2024-09-21T06:36:14.616473+0000","last_clean":"2024-09-21T06:36:14.616473+0000","last_became_active":"2024-09-21T06:34:40.882424+0000","last_became_peered":"2024-09-21T06:34:40.882424+0000","last_unstale":"2024-09-21T06:36:14.616473+0000","last_undegraded":"2024-09-21T06:36:14.616473+0000","last_fullsized":"2024-09-21T06:36:14.616473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:38.815928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721217+0000","last_change":"2024-09-21T06:34:42.890611+0000","last_active":"2024-09-21T06:36:14.721217+0000","last_peered":"2024-09-21T06:36:14.721217+0000","last_clean":"2024-09-21T06:36:14.721217+0000","last_became_active":"2024-09-21T06:34:42.890246+0000","last_became_peered":"2024-09-21T06:34:42.890246+0000","last_unstale":"2024-09-21T06:36:14.721217+0000","last_undegraded":"2024-09-21T06:36:14.721217+0000","last_fullsized":"2024-09-21T06:36:14.721217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:05.074903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:25.113429+0000","last_change":"2024-09-21T06:34:40.877003+0000","last_active":"2024-09-21T06:36:25.113429+0000","last_peered":"2024-09-21T06:36:25.113429+0000","last_clean":"2024-09-21T06:36:25.113429+0000","last_became_active":"2024-09-21T06:34:40.876516+0000","last_became_peered":"2024-09-21T06:34:40.876516+0000","last_unstale":"2024-09-21T06:36:25.113429+0000","last_undegraded":"2024-09-21T06:36:25.113429+0000","last_fullsized":"2024-09-21T06:36:25.113429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:14.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720667+0000","last_change":"2024-09-21T06:34:42.896816+0000","last_active":"2024-09-21T06:36:14.720667+0000","last_peered":"2024-09-21T06:36:14.720667+0000","last_clean":"2024-09-21T06:36:14.720667+0000","last_became_active":"2024-09-21T06:34:42.896329+0000","last_became_peered":"2024-09-21T06:34:42.896329+0000","last_unstale":"2024-09-21T06:36:14.720667+0000","last_undegraded":"2024-09-21T06:36:14.720667+0000","last_fullsized":"2024-09-21T06:36:14.720667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.462498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.274831+0000","last_change":"2024-09-21T06:34:40.892809+0000","last_active":"2024-09-21T06:36:14.274831+0000","last_peered":"2024-09-21T06:36:14.274831+0000","last_clean":"2024-09-21T06:36:14.274831+0000","last_became_active":"2024-09-21T06:34:40.892433+0000","last_became_peered":"2024-09-21T06:34:40.892433+0000","last_unstale":"2024-09-21T06:36:14.274831+0000","last_undegraded":"2024-09-21T06:36:14.274831+0000","last_fullsized":"2024-09-21T06:36:14.274831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:43.744202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616525+0000","last_change":"2024-09-21T06:35:13.500503+0000","last_active":"2024-09-21T06:36:14.616525+0000","last_peered":"2024-09-21T06:36:14.616525+0000","last_clean":"2024-09-21T06:36:14.616525+0000","last_became_active":"2024-09-21T06:35:13.499704+0000","last_became_peered":"2024-09-21T06:35:13.499704+0000","last_unstale":"2024-09-21T06:36:14.616525+0000","last_undegraded":"2024-09-21T06:36:14.616525+0000","last_fullsized":"2024-09-21T06:36:14.616525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:45.469909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275256+0000","last_change":"2024-09-21T06:34:40.876791+0000","last_active":"2024-09-21T06:36:14.275256+0000","last_peered":"2024-09-21T06:36:14.275256+0000","last_clean":"2024-09-21T06:36:14.275256+0000","last_became_active":"2024-09-21T06:34:40.876323+0000","last_became_peered":"2024-09-21T06:34:40.876323+0000","last_unstale":"2024-09-21T06:36:14.275256+0000","last_undegraded":"2024-09-21T06:36:14.275256+0000","last_fullsized":"2024-09-21T06:36:14.275256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:20.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276272+0000","last_change":"2024-09-21T06:35:13.499258+0000","last_active":"2024-09-21T06:36:14.276272+0000","last_peered":"2024-09-21T06:36:14.276272+0000","last_clean":"2024-09-21T06:36:14.276272+0000","last_became_active":"2024-09-21T06:35:13.498747+0000","last_became_peered":"2024-09-21T06:35:13.498747+0000","last_unstale":"2024-09-21T06:36:14.276272+0000","last_undegraded":"2024-09-21T06:36:14.276272+0000","last_fullsized":"2024-09-21T06:36:14.276272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:23.977754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721058+0000","last_change":"2024-09-21T06:34:40.877644+0000","last_active":"2024-09-21T06:36:14.721058+0000","last_peered":"2024-09-21T06:36:14.721058+0000","last_clean":"2024-09-21T06:36:14.721058+0000","last_became_active":"2024-09-21T06:34:40.877238+0000","last_became_peered":"2024-09-21T06:34:40.877238+0000","last_unstale":"2024-09-21T06:36:14.721058+0000","last_undegraded":"2024-09-21T06:36:14.721058+0000","last_fullsized":"2024-09-21T06:36:14.721058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:21.055801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721125+0000","last_change":"2024-09-21T06:34:42.892399+0000","last_active":"2024-09-21T06:36:14.721125+0000","last_peered":"2024-09-21T06:36:14.721125+0000","last_clean":"2024-09-21T06:36:14.721125+0000","last_became_active":"2024-09-21T06:34:42.891873+0000","last_became_peered":"2024-09-21T06:34:42.891873+0000","last_unstale":"2024-09-21T06:36:14.721125+0000","last_undegraded":"2024-09-21T06:36:14.721125+0000","last_fullsized":"2024-09-21T06:36:14.721125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:09.684516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616752+0000","last_change":"2024-09-21T06:34:40.881603+0000","last_active":"2024-09-21T06:36:14.616752+0000","last_peered":"2024-09-21T06:36:14.616752+0000","last_clean":"2024-09-21T06:36:14.616752+0000","last_became_active":"2024-09-21T06:34:40.881226+0000","last_became_peered":"2024-09-21T06:34:40.881226+0000","last_unstale":"2024-09-21T06:36:14.616752+0000","last_undegraded":"2024-09-21T06:36:14.616752+0000","last_fullsized":"2024-09-21T06:36:14.616752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:09.252102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720922+0000","last_change":"2024-09-21T06:34:42.897354+0000","last_active":"2024-09-21T06:36:14.720922+0000","last_peered":"2024-09-21T06:36:14.720922+0000","last_clean":"2024-09-21T06:36:14.720922+0000","last_became_active":"2024-09-21T06:34:42.896981+0000","last_became_peered":"2024-09-21T06:34:42.896981+0000","last_unstale":"2024-09-21T06:36:14.720922+0000","last_undegraded":"2024-09-21T06:36:14.720922+0000","last_fullsized":"2024-09-21T06:36:14.720922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:07.598107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.294697+0000","last_change":"2024-09-21T06:36:14.294203+0000","last_active":"2024-09-21T06:36:14.294697+0000","last_peered":"2024-09-21T06:36:14.294697+0000","last_clean":"2024-09-21T06:36:14.294697+0000","last_became_active":"2024-09-21T06:36:14.287271+0000","last_became_peered":"2024-09-21T06:36:14.287271+0000","last_unstale":"2024-09-21T06:36:14.294697+0000","last_undegraded":"2024-09-21T06:36:14.294697+0000","last_fullsized":"2024-09-21T06:36:14.294697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:58.586517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721179+0000","last_change":"2024-09-21T06:34:42.894825+0000","last_active":"2024-09-21T06:36:14.721179+0000","last_peered":"2024-09-21T06:36:14.721179+0000","last_clean":"2024-09-21T06:36:14.721179+0000","last_became_active":"2024-09-21T06:34:42.893347+0000","last_became_peered":"2024-09-21T06:34:42.893347+0000","last_unstale":"2024-09-21T06:36:14.721179+0000","last_undegraded":"2024-09-21T06:36:14.721179+0000","last_fullsized":"2024-09-21T06:36:14.721179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:14.946035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721061+0000","last_change":"2024-09-21T06:33:33.165773+0000","last_active":"2024-09-21T06:36:14.721061+0000","last_peered":"2024-09-21T06:36:14.721061+0000","last_clean":"2024-09-21T06:36:14.721061+0000","last_became_active":"2024-09-21T06:33:33.159754+0000","last_became_peered":"2024-09-21T06:33:33.159754+0000","last_unstale":"2024-09-21T06:36:14.721061+0000","last_undegraded":"2024-09-21T06:36:14.721061+0000","last_fullsized":"2024-09-21T06:36:14.721061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_clean_scrub_stamp":"2024-09-21T06:30:10.865158+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:15.953330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275384+0000","last_change":"2024-09-21T06:34:40.876091+0000","last_active":"2024-09-21T06:36:14.275384+0000","last_peered":"2024-09-21T06:36:14.275384+0000","last_clean":"2024-09-21T06:36:14.275384+0000","last_became_active":"2024-09-21T06:34:40.875576+0000","last_became_peered":"2024-09-21T06:34:40.875576+0000","last_unstale":"2024-09-21T06:36:14.275384+0000","last_undegraded":"2024-09-21T06:36:14.275384+0000","last_fullsized":"2024-09-21T06:36:14.275384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:34.392145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275736+0000","last_change":"2024-09-21T06:34:42.892283+0000","last_active":"2024-09-21T06:36:14.275736+0000","last_peered":"2024-09-21T06:36:14.275736+0000","last_clean":"2024-09-21T06:36:14.275736+0000","last_became_active":"2024-09-21T06:34:42.891839+0000","last_became_peered":"2024-09-21T06:34:42.891839+0000","last_unstale":"2024-09-21T06:36:14.275736+0000","last_undegraded":"2024-09-21T06:36:14.275736+0000","last_fullsized":"2024-09-21T06:36:14.275736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:10.202352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720907+0000","last_change":"2024-09-21T06:34:40.880967+0000","last_active":"2024-09-21T06:36:14.720907+0000","last_peered":"2024-09-21T06:36:14.720907+0000","last_clean":"2024-09-21T06:36:14.720907+0000","last_became_active":"2024-09-21T06:34:40.880351+0000","last_became_peered":"2024-09-21T06:34:40.880351+0000","last_unstale":"2024-09-21T06:36:14.720907+0000","last_undegraded":"2024-09-21T06:36:14.720907+0000","last_fullsized":"2024-09-21T06:36:14.720907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:52.694732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720675+0000","last_change":"2024-09-21T06:34:42.876102+0000","last_active":"2024-09-21T06:36:14.720675+0000","last_peered":"2024-09-21T06:36:14.720675+0000","last_clean":"2024-09-21T06:36:14.720675+0000","last_became_active":"2024-09-21T06:34:42.875065+0000","last_became_peered":"2024-09-21T06:34:42.875065+0000","last_unstale":"2024-09-21T06:36:14.720675+0000","last_undegraded":"2024-09-21T06:36:14.720675+0000","last_fullsized":"2024-09-21T06:36:14.720675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:23.867180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:26.114289+0000","last_change":"2024-09-21T06:34:40.890355+0000","last_active":"2024-09-21T06:36:26.114289+0000","last_peered":"2024-09-21T06:36:26.114289+0000","last_clean":"2024-09-21T06:36:26.114289+0000","last_became_active":"2024-09-21T06:34:40.889974+0000","last_became_peered":"2024-09-21T06:34:40.889974+0000","last_unstale":"2024-09-21T06:36:26.114289+0000","last_undegraded":"2024-09-21T06:36:26.114289+0000","last_fullsized":"2024-09-21T06:36:26.114289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:58.349625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616293+0000","last_change":"2024-09-21T06:34:42.899831+0000","last_active":"2024-09-21T06:36:14.616293+0000","last_peered":"2024-09-21T06:36:14.616293+0000","last_clean":"2024-09-21T06:36:14.616293+0000","last_became_active":"2024-09-21T06:34:42.899372+0000","last_became_peered":"2024-09-21T06:34:42.899372+0000","last_unstale":"2024-09-21T06:36:14.616293+0000","last_undegraded":"2024-09-21T06:36:14.616293+0000","last_fullsized":"2024-09-21T06:36:14.616293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:50.165222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721265+0000","last_change":"2024-09-21T06:34:40.882380+0000","last_active":"2024-09-21T06:36:14.721265+0000","last_peered":"2024-09-21T06:36:14.721265+0000","last_clean":"2024-09-21T06:36:14.721265+0000","last_became_active":"2024-09-21T06:34:40.881463+0000","last_became_peered":"2024-09-21T06:34:40.881463+0000","last_unstale":"2024-09-21T06:36:14.721265+0000","last_undegraded":"2024-09-21T06:36:14.721265+0000","last_fullsized":"2024-09-21T06:36:14.721265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:25.620174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613626+0000","last_change":"2024-09-21T06:34:42.897205+0000","last_active":"2024-09-21T06:36:14.613626+0000","last_peered":"2024-09-21T06:36:14.613626+0000","last_clean":"2024-09-21T06:36:14.613626+0000","last_became_active":"2024-09-21T06:34:42.896705+0000","last_became_peered":"2024-09-21T06:34:42.896705+0000","last_unstale":"2024-09-21T06:36:14.613626+0000","last_undegraded":"2024-09-21T06:36:14.613626+0000","last_fullsized":"2024-09-21T06:36:14.613626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.333176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272745+0000","last_change":"2024-09-21T06:34:40.890356+0000","last_active":"2024-09-21T06:36:14.272745+0000","last_peered":"2024-09-21T06:36:14.272745+0000","last_clean":"2024-09-21T06:36:14.272745+0000","last_became_active":"2024-09-21T06:34:40.889963+0000","last_became_peered":"2024-09-21T06:34:40.889963+0000","last_unstale":"2024-09-21T06:36:14.272745+0000","last_undegraded":"2024-09-21T06:36:14.272745+0000","last_fullsized":"2024-09-21T06:36:14.272745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:09.621779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613505+0000","last_change":"2024-09-21T06:34:42.884933+0000","last_active":"2024-09-21T06:36:14.613505+0000","last_peered":"2024-09-21T06:36:14.613505+0000","last_clean":"2024-09-21T06:36:14.613505+0000","last_became_active":"2024-09-21T06:34:42.884506+0000","last_became_peered":"2024-09-21T06:34:42.884506+0000","last_unstale":"2024-09-21T06:36:14.613505+0000","last_undegraded":"2024-09-21T06:36:14.613505+0000","last_fullsized":"2024-09-21T06:36:14.613505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:14.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.290755+0000","last_change":"2024-09-21T06:36:14.290260+0000","last_active":"2024-09-21T06:36:14.290755+0000","last_peered":"2024-09-21T06:36:14.290755+0000","last_clean":"2024-09-21T06:36:14.290755+0000","last_became_active":"2024-09-21T06:36:14.287215+0000","last_became_peered":"2024-09-21T06:36:14.287215+0000","last_unstale":"2024-09-21T06:36:14.290755+0000","last_undegraded":"2024-09-21T06:36:14.290755+0000","last_fullsized":"2024-09-21T06:36:14.290755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:31.344496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721065+0000","last_change":"2024-09-21T06:34:42.880047+0000","last_active":"2024-09-21T06:36:14.721065+0000","last_peered":"2024-09-21T06:36:14.721065+0000","last_clean":"2024-09-21T06:36:14.721065+0000","last_became_active":"2024-09-21T06:34:42.879664+0000","last_became_peered":"2024-09-21T06:34:42.879664+0000","last_unstale":"2024-09-21T06:36:14.721065+0000","last_undegraded":"2024-09-21T06:36:14.721065+0000","last_fullsized":"2024-09-21T06:36:14.721065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:03.621493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'12","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.289520+0000","last_change":"2024-09-21T06:36:14.289110+0000","last_active":"2024-09-21T06:36:14.289520+0000","last_peered":"2024-09-21T06:36:14.289520+0000","last_clean":"2024-09-21T06:36:14.289520+0000","last_became_active":"2024-09-21T06:36:14.279222+0000","last_became_peered":"2024-09-21T06:36:14.279222+0000","last_unstale":"2024-09-21T06:36:14.289520+0000","last_undegraded":"2024-09-21T06:36:14.289520+0000","last_fullsized":"2024-09-21T06:36:14.289520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:40.738475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272942+0000","last_change":"2024-09-21T06:35:13.289318+0000","last_active":"2024-09-21T06:36:14.272942+0000","last_peered":"2024-09-21T06:36:14.272942+0000","last_clean":"2024-09-21T06:36:14.272942+0000","last_became_active":"2024-09-21T06:35:13.288961+0000","last_became_peered":"2024-09-21T06:35:13.288961+0000","last_unstale":"2024-09-21T06:36:14.272942+0000","last_undegraded":"2024-09-21T06:36:14.272942+0000","last_fullsized":"2024-09-21T06:36:14.272942+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:05.659772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275622+0000","last_change":"2024-09-21T06:34:40.869754+0000","last_active":"2024-09-21T06:36:14.275622+0000","last_peered":"2024-09-21T06:36:14.275622+0000","last_clean":"2024-09-21T06:36:14.275622+0000","last_became_active":"2024-09-21T06:34:40.869311+0000","last_became_peered":"2024-09-21T06:34:40.869311+0000","last_unstale":"2024-09-21T06:36:14.275622+0000","last_undegraded":"2024-09-21T06:36:14.275622+0000","last_fullsized":"2024-09-21T06:36:14.275622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:10.959880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286081+0000","last_change":"2024-09-21T06:34:42.889198+0000","last_active":"2024-09-21T06:36:14.286081+0000","last_peered":"2024-09-21T06:36:14.286081+0000","last_clean":"2024-09-21T06:36:14.286081+0000","last_became_active":"2024-09-21T06:34:42.888813+0000","last_became_peered":"2024-09-21T06:34:42.888813+0000","last_unstale":"2024-09-21T06:36:14.286081+0000","last_undegraded":"2024-09-21T06:36:14.286081+0000","last_fullsized":"2024-09-21T06:36:14.286081+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:25.270225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278356+0000","last_change":"2024-09-21T06:34:40.892267+0000","last_active":"2024-09-21T06:36:14.278356+0000","last_peered":"2024-09-21T06:36:14.278356+0000","last_clean":"2024-09-21T06:36:14.278356+0000","last_became_active":"2024-09-21T06:34:40.891791+0000","last_became_peered":"2024-09-21T06:34:40.891791+0000","last_unstale":"2024-09-21T06:36:14.278356+0000","last_undegraded":"2024-09-21T06:36:14.278356+0000","last_fullsized":"2024-09-21T06:36:14.278356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:07.864647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275359+0000","last_change":"2024-09-21T06:34:42.894361+0000","last_active":"2024-09-21T06:36:14.275359+0000","last_peered":"2024-09-21T06:36:14.275359+0000","last_clean":"2024-09-21T06:36:14.275359+0000","last_became_active":"2024-09-21T06:34:42.893976+0000","last_became_peered":"2024-09-21T06:34:42.893976+0000","last_unstale":"2024-09-21T06:36:14.275359+0000","last_undegraded":"2024-09-21T06:36:14.275359+0000","last_fullsized":"2024-09-21T06:36:14.275359+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:32.741495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275262+0000","last_change":"2024-09-21T06:34:40.875952+0000","last_active":"2024-09-21T06:36:14.275262+0000","last_peered":"2024-09-21T06:36:14.275262+0000","last_clean":"2024-09-21T06:36:14.275262+0000","last_became_active":"2024-09-21T06:34:40.875598+0000","last_became_peered":"2024-09-21T06:34:40.875598+0000","last_unstale":"2024-09-21T06:36:14.275262+0000","last_undegraded":"2024-09-21T06:36:14.275262+0000","last_fullsized":"2024-09-21T06:36:14.275262+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:29.873037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276436+0000","last_change":"2024-09-21T06:34:42.887639+0000","last_active":"2024-09-21T06:36:14.276436+0000","last_peered":"2024-09-21T06:36:14.276436+0000","last_clean":"2024-09-21T06:36:14.276436+0000","last_became_active":"2024-09-21T06:34:42.887201+0000","last_became_peered":"2024-09-21T06:34:42.887201+0000","last_unstale":"2024-09-21T06:36:14.276436+0000","last_undegraded":"2024-09-21T06:36:14.276436+0000","last_fullsized":"2024-09-21T06:36:14.276436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:59.431007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282456+0000","last_change":"2024-09-21T06:34:40.880145+0000","last_active":"2024-09-21T06:36:14.282456+0000","last_peered":"2024-09-21T06:36:14.282456+0000","last_clean":"2024-09-21T06:36:14.282456+0000","last_became_active":"2024-09-21T06:34:40.879480+0000","last_became_peered":"2024-09-21T06:34:40.879480+0000","last_unstale":"2024-09-21T06:36:14.282456+0000","last_undegraded":"2024-09-21T06:36:14.282456+0000","last_fullsized":"2024-09-21T06:36:14.282456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.551228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276161+0000","last_change":"2024-09-21T06:34:42.882455+0000","last_active":"2024-09-21T06:36:14.276161+0000","last_peered":"2024-09-21T06:36:14.276161+0000","last_clean":"2024-09-21T06:36:14.276161+0000","last_became_active":"2024-09-21T06:34:42.880714+0000","last_became_peered":"2024-09-21T06:34:42.880714+0000","last_unstale":"2024-09-21T06:36:14.276161+0000","last_undegraded":"2024-09-21T06:36:14.276161+0000","last_fullsized":"2024-09-21T06:36:14.276161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:39.264152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275389+0000","last_change":"2024-09-21T06:34:40.879560+0000","last_active":"2024-09-21T06:36:14.275389+0000","last_peered":"2024-09-21T06:36:14.275389+0000","last_clean":"2024-09-21T06:36:14.275389+0000","last_became_active":"2024-09-21T06:34:40.878433+0000","last_became_peered":"2024-09-21T06:34:40.878433+0000","last_unstale":"2024-09-21T06:36:14.275389+0000","last_undegraded":"2024-09-21T06:36:14.275389+0000","last_fullsized":"2024-09-21T06:36:14.275389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:07.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720928+0000","last_change":"2024-09-21T06:34:42.896193+0000","last_active":"2024-09-21T06:36:14.720928+0000","last_peered":"2024-09-21T06:36:14.720928+0000","last_clean":"2024-09-21T06:36:14.720928+0000","last_became_active":"2024-09-21T06:34:42.895753+0000","last_became_peered":"2024-09-21T06:34:42.895753+0000","last_unstale":"2024-09-21T06:36:14.720928+0000","last_undegraded":"2024-09-21T06:36:14.720928+0000","last_fullsized":"2024-09-21T06:36:14.720928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:47.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616659+0000","last_change":"2024-09-21T06:35:13.290402+0000","last_active":"2024-09-21T06:36:14.616659+0000","last_peered":"2024-09-21T06:36:14.616659+0000","last_clean":"2024-09-21T06:36:14.616659+0000","last_became_active":"2024-09-21T06:35:13.289718+0000","last_became_peered":"2024-09-21T06:35:13.289718+0000","last_unstale":"2024-09-21T06:36:14.616659+0000","last_undegraded":"2024-09-21T06:36:14.616659+0000","last_fullsized":"2024-09-21T06:36:14.616659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:06.684007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275203+0000","last_change":"2024-09-21T06:34:40.879386+0000","last_active":"2024-09-21T06:36:14.275203+0000","last_peered":"2024-09-21T06:36:14.275203+0000","last_clean":"2024-09-21T06:36:14.275203+0000","last_became_active":"2024-09-21T06:34:40.879001+0000","last_became_peered":"2024-09-21T06:34:40.879001+0000","last_unstale":"2024-09-21T06:36:14.275203+0000","last_undegraded":"2024-09-21T06:36:14.275203+0000","last_fullsized":"2024-09-21T06:36:14.275203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:48.438361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.279411+0000","last_change":"2024-09-21T06:34:42.901595+0000","last_active":"2024-09-21T06:36:14.279411+0000","last_peered":"2024-09-21T06:36:14.279411+0000","last_clean":"2024-09-21T06:36:14.279411+0000","last_became_active":"2024-09-21T06:34:42.901200+0000","last_became_peered":"2024-09-21T06:34:42.901200+0000","last_unstale":"2024-09-21T06:36:14.279411+0000","last_undegraded":"2024-09-21T06:36:14.279411+0000","last_fullsized":"2024-09-21T06:36:14.279411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:12.044528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275360+0000","last_change":"2024-09-21T06:34:40.878959+0000","last_active":"2024-09-21T06:36:14.275360+0000","last_peered":"2024-09-21T06:36:14.275360+0000","last_clean":"2024-09-21T06:36:14.275360+0000","last_became_active":"2024-09-21T06:34:40.878343+0000","last_became_peered":"2024-09-21T06:34:40.878343+0000","last_unstale":"2024-09-21T06:36:14.275360+0000","last_undegraded":"2024-09-21T06:36:14.275360+0000","last_fullsized":"2024-09-21T06:36:14.275360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:54.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286293+0000","last_change":"2024-09-21T06:34:42.887868+0000","last_active":"2024-09-21T06:36:14.286293+0000","last_peered":"2024-09-21T06:36:14.286293+0000","last_clean":"2024-09-21T06:36:14.286293+0000","last_became_active":"2024-09-21T06:34:42.887268+0000","last_became_peered":"2024-09-21T06:34:42.887268+0000","last_unstale":"2024-09-21T06:36:14.286293+0000","last_undegraded":"2024-09-21T06:36:14.286293+0000","last_fullsized":"2024-09-21T06:36:14.286293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:41.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275566+0000","last_change":"2024-09-21T06:34:40.890363+0000","last_active":"2024-09-21T06:36:14.275566+0000","last_peered":"2024-09-21T06:36:14.275566+0000","last_clean":"2024-09-21T06:36:14.275566+0000","last_became_active":"2024-09-21T06:34:40.889967+0000","last_became_peered":"2024-09-21T06:34:40.889967+0000","last_unstale":"2024-09-21T06:36:14.275566+0000","last_undegraded":"2024-09-21T06:36:14.275566+0000","last_fullsized":"2024-09-21T06:36:14.275566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:01.806399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275350+0000","last_change":"2024-09-21T06:34:42.891211+0000","last_active":"2024-09-21T06:36:14.275350+0000","last_peered":"2024-09-21T06:36:14.275350+0000","last_clean":"2024-09-21T06:36:14.275350+0000","last_became_active":"2024-09-21T06:34:42.890813+0000","last_became_peered":"2024-09-21T06:34:42.890813+0000","last_unstale":"2024-09-21T06:36:14.275350+0000","last_undegraded":"2024-09-21T06:36:14.275350+0000","last_fullsized":"2024-09-21T06:36:14.275350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.273073+0000","last_change":"2024-09-21T06:34:40.878074+0000","last_active":"2024-09-21T06:36:14.273073+0000","last_peered":"2024-09-21T06:36:14.273073+0000","last_clean":"2024-09-21T06:36:14.273073+0000","last_became_active":"2024-09-21T06:34:40.877688+0000","last_became_peered":"2024-09-21T06:34:40.877688+0000","last_unstale":"2024-09-21T06:36:14.273073+0000","last_undegraded":"2024-09-21T06:36:14.273073+0000","last_fullsized":"2024-09-21T06:36:14.273073+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:01.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70281,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":582,"num_read_kb":356,"num_write":170,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":65356,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":211151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":426988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1564672,"data_stored":1084586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":880640,"data_stored":427202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":427100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712524,"statfs":{"total":95995035648,"available":95961624576,"internally_reserved":0,"allocated":1474560,"data_stored":1019193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":426591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1486848,"data_stored":1018877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":493167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":426902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":427684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":493105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":427862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:36:30.883 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:36:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.031+0000 7f6e08713640 1 -- 172.21.15.49:0/3896360534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 msgr2=0x7f6e00104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.031+0000 7f6e08713640 1 --2- 172.21.15.49:0/3896360534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 0x7f6e00104d90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc009900 tx=0x7f6dfc02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.031+0000 7f6e08713640 1 -- 172.21.15.49:0/3896360534 shutdown_connections 2024-09-21T06:36:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.031+0000 7f6e08713640 1 --2- 172.21.15.49:0/3896360534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e0010dda0 0x7f6e00110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.031+0000 7f6e08713640 1 --2- 172.21.15.49:0/3896360534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e001052d0 0x7f6e0010d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.031+0000 7f6e08713640 1 --2- 172.21.15.49:0/3896360534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 0x7f6e00104d90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.031+0000 7f6e08713640 1 -- 172.21.15.49:0/3896360534 >> 172.21.15.49:0/3896360534 conn(0x7f6e000fe3b0 msgr2=0x7f6e00100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.031+0000 7f6e08713640 1 -- 172.21.15.49:0/3896360534 shutdown_connections 2024-09-21T06:36:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.031+0000 7f6e08713640 1 -- 172.21.15.49:0/3896360534 wait complete. 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e08713640 1 Processor -- start 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e08713640 1 -- start start 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e08713640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 0x7f6e0019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e08713640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e001052d0 0x7f6e0019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e08713640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e0010dda0 0x7f6e0019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e08713640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6e00113a60 con 0x7f6e00104980 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e08713640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e001138e0 con 0x7f6e0010dda0 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e08713640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e00113be0 con 0x7f6e001052d0 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e064af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 0x7f6e0019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e064af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 0x7f6e0019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56952/0 (socket says 172.21.15.49:56952) 2024-09-21T06:36:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e064af640 1 -- 172.21.15.49:0/2892664522 learned_addr learned my addr 172.21.15.49:0/2892664522 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e06cb0640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e0010dda0 0x7f6e0019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.032+0000 7f6e05cae640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e001052d0 0x7f6e0019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6e064af640 1 -- 172.21.15.49:0/2892664522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e001052d0 msgr2=0x7f6e0019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6e064af640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e001052d0 0x7f6e0019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6e064af640 1 -- 172.21.15.49:0/2892664522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e0010dda0 msgr2=0x7f6e0019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6e064af640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e0010dda0 0x7f6e0019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6e064af640 1 -- 172.21.15.49:0/2892664522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e001a0330 con 0x7f6e00104980 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6e05cae640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e001052d0 0x7f6e0019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6e064af640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 0x7f6e0019a400 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc005ab0 tx=0x7f6dfc003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6df77fe640 1 -- 172.21.15.49:0/2892664522 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc03f070 con 0x7f6e00104980 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6df77fe640 1 -- 172.21.15.49:0/2892664522 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dfc031d60 con 0x7f6e00104980 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e001a05c0 con 0x7f6e00104980 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6df77fe640 1 -- 172.21.15.49:0/2892664522 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc035030 con 0x7f6e00104980 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.033+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e001a6db0 con 0x7f6e00104980 2024-09-21T06:36:31.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.034+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e00104d90 con 0x7f6e00104980 2024-09-21T06:36:31.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.036+0000 7f6df77fe640 1 -- 172.21.15.49:0/2892664522 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f6dfc042070 con 0x7f6e00104980 2024-09-21T06:36:31.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.037+0000 7f6df77fe640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dec0b6560 0x7f6dec0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:31.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.037+0000 7f6e05cae640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dec0b6560 0x7f6dec0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:31.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.037+0000 7f6df77fe640 1 -- 172.21.15.49:0/2892664522 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6dfc108390 con 0x7f6e00104980 2024-09-21T06:36:31.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.038+0000 7f6e05cae640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dec0b6560 0x7f6dec0b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6df00058c0 tx=0x7f6df0005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:31.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.041+0000 7f6df77fe640 1 -- 172.21.15.49:0/2892664522 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6dfc0ceae0 con 0x7f6e00104980 2024-09-21T06:36:31.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.226+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6e00107f70 con 0x7f6dec0b6560 2024-09-21T06:36:31.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.230+0000 7f6df77fe640 1 -- 172.21.15.49:0/2892664522 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258802 (secure 0 0 0) 0x7f6e00107f70 con 0x7f6dec0b6560 2024-09-21T06:36:31.234 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:31.235 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dec0b6560 msgr2=0x7f6dec0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dec0b6560 0x7f6dec0b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6df00058c0 tx=0x7f6df0005850 comp rx=0 tx=0).stop 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 msgr2=0x7f6e0019a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 0x7f6e0019a400 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc005ab0 tx=0x7f6dfc003cd0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 shutdown_connections 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dec0b6560 0x7f6dec0b8a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e0010dda0 0x7f6e0019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e001052d0 0x7f6e0019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 --2- 172.21.15.49:0/2892664522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e00104980 0x7f6e0019a400 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 >> 172.21.15.49:0/2892664522 conn(0x7f6e000fe3b0 msgr2=0x7f6e00107860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:31.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 shutdown_connections 2024-09-21T06:36:31.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.233+0000 7f6e08713640 1 -- 172.21.15.49:0/2892664522 wait complete. 2024-09-21T06:36:31.246 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-21T06:36:30.132034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660883,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":663,"num_read_kb":425,"num_write":295,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":3017196,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":738,"ondisk_log_size":738,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357416,"kb_used_data":12264,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584408,"statfs":{"total":1151940427776,"available":1151574433792,"internally_reserved":0,"allocated":12558336,"data_stored":7099257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003370"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276569+0000","last_change":"2024-09-21T06:34:42.895466+0000","last_active":"2024-09-21T06:36:14.276569+0000","last_peered":"2024-09-21T06:36:14.276569+0000","last_clean":"2024-09-21T06:36:14.276569+0000","last_became_active":"2024-09-21T06:34:42.895084+0000","last_became_peered":"2024-09-21T06:34:42.895084+0000","last_unstale":"2024-09-21T06:36:14.276569+0000","last_undegraded":"2024-09-21T06:36:14.276569+0000","last_fullsized":"2024-09-21T06:36:14.276569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.513107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.285962+0000","last_change":"2024-09-21T06:34:42.888307+0000","last_active":"2024-09-21T06:36:14.285962+0000","last_peered":"2024-09-21T06:36:14.285962+0000","last_clean":"2024-09-21T06:36:14.285962+0000","last_became_active":"2024-09-21T06:34:42.886106+0000","last_became_peered":"2024-09-21T06:34:42.886106+0000","last_unstale":"2024-09-21T06:36:14.285962+0000","last_undegraded":"2024-09-21T06:36:14.285962+0000","last_fullsized":"2024-09-21T06:36:14.285962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:57.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286005+0000","last_change":"2024-09-21T06:34:42.897217+0000","last_active":"2024-09-21T06:36:14.286005+0000","last_peered":"2024-09-21T06:36:14.286005+0000","last_clean":"2024-09-21T06:36:14.286005+0000","last_became_active":"2024-09-21T06:34:42.896849+0000","last_became_peered":"2024-09-21T06:34:42.896849+0000","last_unstale":"2024-09-21T06:36:14.286005+0000","last_undegraded":"2024-09-21T06:36:14.286005+0000","last_fullsized":"2024-09-21T06:36:14.286005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:28.749566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275509+0000","last_change":"2024-09-21T06:34:42.887236+0000","last_active":"2024-09-21T06:36:14.275509+0000","last_peered":"2024-09-21T06:36:14.275509+0000","last_clean":"2024-09-21T06:36:14.275509+0000","last_became_active":"2024-09-21T06:34:42.886137+0000","last_became_peered":"2024-09-21T06:34:42.886137+0000","last_unstale":"2024-09-21T06:36:14.275509+0000","last_undegraded":"2024-09-21T06:36:14.275509+0000","last_fullsized":"2024-09-21T06:36:14.275509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:23.728433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275250+0000","last_change":"2024-09-21T06:34:42.885792+0000","last_active":"2024-09-21T06:36:14.275250+0000","last_peered":"2024-09-21T06:36:14.275250+0000","last_clean":"2024-09-21T06:36:14.275250+0000","last_became_active":"2024-09-21T06:34:42.885372+0000","last_became_peered":"2024-09-21T06:34:42.885372+0000","last_unstale":"2024-09-21T06:36:14.275250+0000","last_undegraded":"2024-09-21T06:36:14.275250+0000","last_fullsized":"2024-09-21T06:36:14.275250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:29.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613320+0000","last_change":"2024-09-21T06:34:42.896814+0000","last_active":"2024-09-21T06:36:14.613320+0000","last_peered":"2024-09-21T06:36:14.613320+0000","last_clean":"2024-09-21T06:36:14.613320+0000","last_became_active":"2024-09-21T06:34:42.896147+0000","last_became_peered":"2024-09-21T06:34:42.896147+0000","last_unstale":"2024-09-21T06:36:14.613320+0000","last_undegraded":"2024-09-21T06:36:14.613320+0000","last_fullsized":"2024-09-21T06:36:14.613320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:49.037539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720733+0000","last_change":"2024-09-21T06:34:42.896264+0000","last_active":"2024-09-21T06:36:14.720733+0000","last_peered":"2024-09-21T06:36:14.720733+0000","last_clean":"2024-09-21T06:36:14.720733+0000","last_became_active":"2024-09-21T06:34:42.895793+0000","last_became_peered":"2024-09-21T06:34:42.895793+0000","last_unstale":"2024-09-21T06:36:14.720733+0000","last_undegraded":"2024-09-21T06:36:14.720733+0000","last_fullsized":"2024-09-21T06:36:14.720733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:06.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.274942+0000","last_change":"2024-09-21T06:34:42.892538+0000","last_active":"2024-09-21T06:36:14.274942+0000","last_peered":"2024-09-21T06:36:14.274942+0000","last_clean":"2024-09-21T06:36:14.274942+0000","last_became_active":"2024-09-21T06:34:42.892139+0000","last_became_peered":"2024-09-21T06:34:42.892139+0000","last_unstale":"2024-09-21T06:36:14.274942+0000","last_undegraded":"2024-09-21T06:36:14.274942+0000","last_fullsized":"2024-09-21T06:36:14.274942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:51.808969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272795+0000","last_change":"2024-09-21T06:35:13.499797+0000","last_active":"2024-09-21T06:36:14.272795+0000","last_peered":"2024-09-21T06:36:14.272795+0000","last_clean":"2024-09-21T06:36:14.272795+0000","last_became_active":"2024-09-21T06:35:13.499380+0000","last_became_peered":"2024-09-21T06:35:13.499380+0000","last_unstale":"2024-09-21T06:36:14.272795+0000","last_undegraded":"2024-09-21T06:36:14.272795+0000","last_fullsized":"2024-09-21T06:36:14.272795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:21.809657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11],"acting":[9,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":38,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613693+0000","last_change":"2024-09-21T06:34:42.895533+0000","last_active":"2024-09-21T06:36:14.613693+0000","last_peered":"2024-09-21T06:36:14.613693+0000","last_clean":"2024-09-21T06:36:14.613693+0000","last_became_active":"2024-09-21T06:34:42.895162+0000","last_became_peered":"2024-09-21T06:34:42.895162+0000","last_unstale":"2024-09-21T06:36:14.613693+0000","last_undegraded":"2024-09-21T06:36:14.613693+0000","last_fullsized":"2024-09-21T06:36:14.613693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:25.495493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721181+0000","last_change":"2024-09-21T06:34:42.894173+0000","last_active":"2024-09-21T06:36:14.721181+0000","last_peered":"2024-09-21T06:36:14.721181+0000","last_clean":"2024-09-21T06:36:14.721181+0000","last_became_active":"2024-09-21T06:34:42.893817+0000","last_became_peered":"2024-09-21T06:34:42.893817+0000","last_unstale":"2024-09-21T06:36:14.721181+0000","last_undegraded":"2024-09-21T06:36:14.721181+0000","last_fullsized":"2024-09-21T06:36:14.721181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:31.580564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275513+0000","last_change":"2024-09-21T06:34:42.886536+0000","last_active":"2024-09-21T06:36:14.275513+0000","last_peered":"2024-09-21T06:36:14.275513+0000","last_clean":"2024-09-21T06:36:14.275513+0000","last_became_active":"2024-09-21T06:34:42.885636+0000","last_became_peered":"2024-09-21T06:34:42.885636+0000","last_unstale":"2024-09-21T06:36:14.275513+0000","last_undegraded":"2024-09-21T06:36:14.275513+0000","last_fullsized":"2024-09-21T06:36:14.275513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:11.074850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721016+0000","last_change":"2024-09-21T06:34:42.882665+0000","last_active":"2024-09-21T06:36:14.721016+0000","last_peered":"2024-09-21T06:36:14.721016+0000","last_clean":"2024-09-21T06:36:14.721016+0000","last_became_active":"2024-09-21T06:34:42.882254+0000","last_became_peered":"2024-09-21T06:34:42.882254+0000","last_unstale":"2024-09-21T06:36:14.721016+0000","last_undegraded":"2024-09-21T06:36:14.721016+0000","last_fullsized":"2024-09-21T06:36:14.721016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:01.203542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.285809+0000","last_change":"2024-09-21T06:34:42.884034+0000","last_active":"2024-09-21T06:36:14.285809+0000","last_peered":"2024-09-21T06:36:14.285809+0000","last_clean":"2024-09-21T06:36:14.285809+0000","last_became_active":"2024-09-21T06:34:42.883685+0000","last_became_peered":"2024-09-21T06:34:42.883685+0000","last_unstale":"2024-09-21T06:36:14.285809+0000","last_undegraded":"2024-09-21T06:36:14.285809+0000","last_fullsized":"2024-09-21T06:36:14.285809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:00.124019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.285548+0000","last_change":"2024-09-21T06:34:42.894686+0000","last_active":"2024-09-21T06:36:14.285548+0000","last_peered":"2024-09-21T06:36:14.285548+0000","last_clean":"2024-09-21T06:36:14.285548+0000","last_became_active":"2024-09-21T06:34:42.893980+0000","last_became_peered":"2024-09-21T06:34:42.893980+0000","last_unstale":"2024-09-21T06:36:14.285548+0000","last_undegraded":"2024-09-21T06:36:14.285548+0000","last_fullsized":"2024-09-21T06:36:14.285548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:00.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278132+0000","last_change":"2024-09-21T06:34:42.891462+0000","last_active":"2024-09-21T06:36:14.278132+0000","last_peered":"2024-09-21T06:36:14.278132+0000","last_clean":"2024-09-21T06:36:14.278132+0000","last_became_active":"2024-09-21T06:34:42.891085+0000","last_became_peered":"2024-09-21T06:34:42.891085+0000","last_unstale":"2024-09-21T06:36:14.278132+0000","last_undegraded":"2024-09-21T06:36:14.278132+0000","last_fullsized":"2024-09-21T06:36:14.278132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:03.942909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276607+0000","last_change":"2024-09-21T06:34:42.897049+0000","last_active":"2024-09-21T06:36:14.276607+0000","last_peered":"2024-09-21T06:36:14.276607+0000","last_clean":"2024-09-21T06:36:14.276607+0000","last_became_active":"2024-09-21T06:34:42.896131+0000","last_became_peered":"2024-09-21T06:34:42.896131+0000","last_unstale":"2024-09-21T06:36:14.276607+0000","last_undegraded":"2024-09-21T06:36:14.276607+0000","last_fullsized":"2024-09-21T06:36:14.276607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:47.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.273016+0000","last_change":"2024-09-21T06:34:42.887894+0000","last_active":"2024-09-21T06:36:14.273016+0000","last_peered":"2024-09-21T06:36:14.273016+0000","last_clean":"2024-09-21T06:36:14.273016+0000","last_became_active":"2024-09-21T06:34:42.887436+0000","last_became_peered":"2024-09-21T06:34:42.887436+0000","last_unstale":"2024-09-21T06:36:14.273016+0000","last_undegraded":"2024-09-21T06:36:14.273016+0000","last_fullsized":"2024-09-21T06:36:14.273016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:22.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282032+0000","last_change":"2024-09-21T06:34:42.888071+0000","last_active":"2024-09-21T06:36:14.282032+0000","last_peered":"2024-09-21T06:36:14.282032+0000","last_clean":"2024-09-21T06:36:14.282032+0000","last_became_active":"2024-09-21T06:34:42.887295+0000","last_became_peered":"2024-09-21T06:34:42.887295+0000","last_unstale":"2024-09-21T06:36:14.282032+0000","last_undegraded":"2024-09-21T06:36:14.282032+0000","last_fullsized":"2024-09-21T06:36:14.282032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:49.937367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275863+0000","last_change":"2024-09-21T06:34:42.891963+0000","last_active":"2024-09-21T06:36:14.275863+0000","last_peered":"2024-09-21T06:36:14.275863+0000","last_clean":"2024-09-21T06:36:14.275863+0000","last_became_active":"2024-09-21T06:34:42.891603+0000","last_became_peered":"2024-09-21T06:34:42.891603+0000","last_unstale":"2024-09-21T06:36:14.275863+0000","last_undegraded":"2024-09-21T06:36:14.275863+0000","last_fullsized":"2024-09-21T06:36:14.275863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:47.608523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721088+0000","last_change":"2024-09-21T06:34:42.895909+0000","last_active":"2024-09-21T06:36:14.721088+0000","last_peered":"2024-09-21T06:36:14.721088+0000","last_clean":"2024-09-21T06:36:14.721088+0000","last_became_active":"2024-09-21T06:34:42.895477+0000","last_became_peered":"2024-09-21T06:34:42.895477+0000","last_unstale":"2024-09-21T06:36:14.721088+0000","last_undegraded":"2024-09-21T06:36:14.721088+0000","last_fullsized":"2024-09-21T06:36:14.721088+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.284523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278719+0000","last_change":"2024-09-21T06:34:42.893554+0000","last_active":"2024-09-21T06:36:14.278719+0000","last_peered":"2024-09-21T06:36:14.278719+0000","last_clean":"2024-09-21T06:36:14.278719+0000","last_became_active":"2024-09-21T06:34:42.892949+0000","last_became_peered":"2024-09-21T06:34:42.892949+0000","last_unstale":"2024-09-21T06:36:14.278719+0000","last_undegraded":"2024-09-21T06:36:14.278719+0000","last_fullsized":"2024-09-21T06:36:14.278719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:57.107590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275055+0000","last_change":"2024-09-21T06:34:42.894574+0000","last_active":"2024-09-21T06:36:14.275055+0000","last_peered":"2024-09-21T06:36:14.275055+0000","last_clean":"2024-09-21T06:36:14.275055+0000","last_became_active":"2024-09-21T06:34:42.894027+0000","last_became_peered":"2024-09-21T06:34:42.894027+0000","last_unstale":"2024-09-21T06:36:14.275055+0000","last_undegraded":"2024-09-21T06:36:14.275055+0000","last_fullsized":"2024-09-21T06:36:14.275055+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:58.425792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616251+0000","last_change":"2024-09-21T06:35:13.499715+0000","last_active":"2024-09-21T06:36:14.616251+0000","last_peered":"2024-09-21T06:36:14.616251+0000","last_clean":"2024-09-21T06:36:14.616251+0000","last_became_active":"2024-09-21T06:35:13.499171+0000","last_became_peered":"2024-09-21T06:35:13.499171+0000","last_unstale":"2024-09-21T06:36:14.616251+0000","last_undegraded":"2024-09-21T06:36:14.616251+0000","last_fullsized":"2024-09-21T06:36:14.616251+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:35.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275221+0000","last_change":"2024-09-21T06:35:13.499458+0000","last_active":"2024-09-21T06:36:14.275221+0000","last_peered":"2024-09-21T06:36:14.275221+0000","last_clean":"2024-09-21T06:36:14.275221+0000","last_became_active":"2024-09-21T06:35:13.498984+0000","last_became_peered":"2024-09-21T06:35:13.498984+0000","last_unstale":"2024-09-21T06:36:14.275221+0000","last_undegraded":"2024-09-21T06:36:14.275221+0000","last_fullsized":"2024-09-21T06:36:14.275221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:10.871658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.283069+0000","last_change":"2024-09-21T06:34:42.888826+0000","last_active":"2024-09-21T06:36:14.283069+0000","last_peered":"2024-09-21T06:36:14.283069+0000","last_clean":"2024-09-21T06:36:14.283069+0000","last_became_active":"2024-09-21T06:34:42.888447+0000","last_became_peered":"2024-09-21T06:34:42.888447+0000","last_unstale":"2024-09-21T06:36:14.283069+0000","last_undegraded":"2024-09-21T06:36:14.283069+0000","last_fullsized":"2024-09-21T06:36:14.283069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:52.634516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276951+0000","last_change":"2024-09-21T06:34:42.889377+0000","last_active":"2024-09-21T06:36:14.276951+0000","last_peered":"2024-09-21T06:36:14.276951+0000","last_clean":"2024-09-21T06:36:14.276951+0000","last_became_active":"2024-09-21T06:34:42.888978+0000","last_became_peered":"2024-09-21T06:34:42.888978+0000","last_unstale":"2024-09-21T06:36:14.276951+0000","last_undegraded":"2024-09-21T06:36:14.276951+0000","last_fullsized":"2024-09-21T06:36:14.276951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:34.734283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721000+0000","last_change":"2024-09-21T06:34:42.878128+0000","last_active":"2024-09-21T06:36:14.721000+0000","last_peered":"2024-09-21T06:36:14.721000+0000","last_clean":"2024-09-21T06:36:14.721000+0000","last_became_active":"2024-09-21T06:34:42.877742+0000","last_became_peered":"2024-09-21T06:34:42.877742+0000","last_unstale":"2024-09-21T06:36:14.721000+0000","last_undegraded":"2024-09-21T06:36:14.721000+0000","last_fullsized":"2024-09-21T06:36:14.721000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:04.992402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286162+0000","last_change":"2024-09-21T06:34:42.882659+0000","last_active":"2024-09-21T06:36:14.286162+0000","last_peered":"2024-09-21T06:36:14.286162+0000","last_clean":"2024-09-21T06:36:14.286162+0000","last_became_active":"2024-09-21T06:34:42.882306+0000","last_became_peered":"2024-09-21T06:34:42.882306+0000","last_unstale":"2024-09-21T06:36:14.286162+0000","last_undegraded":"2024-09-21T06:36:14.286162+0000","last_fullsized":"2024-09-21T06:36:14.286162+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:31.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282347+0000","last_change":"2024-09-21T06:34:42.890089+0000","last_active":"2024-09-21T06:36:14.282347+0000","last_peered":"2024-09-21T06:36:14.282347+0000","last_clean":"2024-09-21T06:36:14.282347+0000","last_became_active":"2024-09-21T06:34:42.889739+0000","last_became_peered":"2024-09-21T06:34:42.889739+0000","last_unstale":"2024-09-21T06:36:14.282347+0000","last_undegraded":"2024-09-21T06:36:14.282347+0000","last_fullsized":"2024-09-21T06:36:14.282347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.212760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.283358+0000","last_change":"2024-09-21T06:35:13.290617+0000","last_active":"2024-09-21T06:36:14.283358+0000","last_peered":"2024-09-21T06:36:14.283358+0000","last_clean":"2024-09-21T06:36:14.283358+0000","last_became_active":"2024-09-21T06:35:13.290005+0000","last_became_peered":"2024-09-21T06:35:13.290005+0000","last_unstale":"2024-09-21T06:36:14.283358+0000","last_undegraded":"2024-09-21T06:36:14.283358+0000","last_fullsized":"2024-09-21T06:36:14.283358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:39.490034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276810+0000","last_change":"2024-09-21T06:34:42.893859+0000","last_active":"2024-09-21T06:36:14.276810+0000","last_peered":"2024-09-21T06:36:14.276810+0000","last_clean":"2024-09-21T06:36:14.276810+0000","last_became_active":"2024-09-21T06:34:42.893485+0000","last_became_peered":"2024-09-21T06:34:42.893485+0000","last_unstale":"2024-09-21T06:36:14.276810+0000","last_undegraded":"2024-09-21T06:36:14.276810+0000","last_fullsized":"2024-09-21T06:36:14.276810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:59.936750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.274979+0000","last_change":"2024-09-21T06:34:42.887164+0000","last_active":"2024-09-21T06:36:14.274979+0000","last_peered":"2024-09-21T06:36:14.274979+0000","last_clean":"2024-09-21T06:36:14.274979+0000","last_became_active":"2024-09-21T06:34:42.886314+0000","last_became_peered":"2024-09-21T06:34:42.886314+0000","last_unstale":"2024-09-21T06:36:14.274979+0000","last_undegraded":"2024-09-21T06:36:14.274979+0000","last_fullsized":"2024-09-21T06:36:14.274979+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:09.529922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'7","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:26.115414+0000","last_change":"2024-09-21T06:34:40.883170+0000","last_active":"2024-09-21T06:36:26.115414+0000","last_peered":"2024-09-21T06:36:26.115414+0000","last_clean":"2024-09-21T06:36:26.115414+0000","last_became_active":"2024-09-21T06:34:40.882760+0000","last_became_peered":"2024-09-21T06:34:40.882760+0000","last_unstale":"2024-09-21T06:36:26.115414+0000","last_undegraded":"2024-09-21T06:36:26.115414+0000","last_fullsized":"2024-09-21T06:36:26.115414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:41.388275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616511+0000","last_change":"2024-09-21T06:34:42.893842+0000","last_active":"2024-09-21T06:36:14.616511+0000","last_peered":"2024-09-21T06:36:14.616511+0000","last_clean":"2024-09-21T06:36:14.616511+0000","last_became_active":"2024-09-21T06:34:42.893501+0000","last_became_peered":"2024-09-21T06:34:42.893501+0000","last_unstale":"2024-09-21T06:36:14.616511+0000","last_undegraded":"2024-09-21T06:36:14.616511+0000","last_fullsized":"2024-09-21T06:36:14.616511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.610084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613413+0000","last_change":"2024-09-21T06:34:40.878685+0000","last_active":"2024-09-21T06:36:14.613413+0000","last_peered":"2024-09-21T06:36:14.613413+0000","last_clean":"2024-09-21T06:36:14.613413+0000","last_became_active":"2024-09-21T06:34:40.878279+0000","last_became_peered":"2024-09-21T06:34:40.878279+0000","last_unstale":"2024-09-21T06:36:14.613413+0000","last_undegraded":"2024-09-21T06:36:14.613413+0000","last_fullsized":"2024-09-21T06:36:14.613413+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:11.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720677+0000","last_change":"2024-09-21T06:34:40.872074+0000","last_active":"2024-09-21T06:36:14.720677+0000","last_peered":"2024-09-21T06:36:14.720677+0000","last_clean":"2024-09-21T06:36:14.720677+0000","last_became_active":"2024-09-21T06:34:40.871637+0000","last_became_peered":"2024-09-21T06:34:40.871637+0000","last_unstale":"2024-09-21T06:36:14.720677+0000","last_undegraded":"2024-09-21T06:36:14.720677+0000","last_fullsized":"2024-09-21T06:36:14.720677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275067+0000","last_change":"2024-09-21T06:34:42.882803+0000","last_active":"2024-09-21T06:36:14.275067+0000","last_peered":"2024-09-21T06:36:14.275067+0000","last_clean":"2024-09-21T06:36:14.275067+0000","last_became_active":"2024-09-21T06:34:42.881509+0000","last_became_peered":"2024-09-21T06:34:42.881509+0000","last_unstale":"2024-09-21T06:36:14.275067+0000","last_undegraded":"2024-09-21T06:36:14.275067+0000","last_fullsized":"2024-09-21T06:36:14.275067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616519+0000","last_change":"2024-09-21T06:34:40.883054+0000","last_active":"2024-09-21T06:36:14.616519+0000","last_peered":"2024-09-21T06:36:14.616519+0000","last_clean":"2024-09-21T06:36:14.616519+0000","last_became_active":"2024-09-21T06:34:40.882299+0000","last_became_peered":"2024-09-21T06:34:40.882299+0000","last_unstale":"2024-09-21T06:36:14.616519+0000","last_undegraded":"2024-09-21T06:36:14.616519+0000","last_fullsized":"2024-09-21T06:36:14.616519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:17.813744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272581+0000","last_change":"2024-09-21T06:34:42.886437+0000","last_active":"2024-09-21T06:36:14.272581+0000","last_peered":"2024-09-21T06:36:14.272581+0000","last_clean":"2024-09-21T06:36:14.272581+0000","last_became_active":"2024-09-21T06:34:42.886075+0000","last_became_peered":"2024-09-21T06:34:42.886075+0000","last_unstale":"2024-09-21T06:36:14.272581+0000","last_undegraded":"2024-09-21T06:36:14.272581+0000","last_fullsized":"2024-09-21T06:36:14.272581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.179323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:25.113267+0000","last_change":"2024-09-21T06:34:40.880931+0000","last_active":"2024-09-21T06:36:25.113267+0000","last_peered":"2024-09-21T06:36:25.113267+0000","last_clean":"2024-09-21T06:36:25.113267+0000","last_became_active":"2024-09-21T06:34:40.880555+0000","last_became_peered":"2024-09-21T06:34:40.880555+0000","last_unstale":"2024-09-21T06:36:25.113267+0000","last_undegraded":"2024-09-21T06:36:25.113267+0000","last_fullsized":"2024-09-21T06:36:25.113267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:29.304297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278477+0000","last_change":"2024-09-21T06:34:42.899618+0000","last_active":"2024-09-21T06:36:14.278477+0000","last_peered":"2024-09-21T06:36:14.278477+0000","last_clean":"2024-09-21T06:36:14.278477+0000","last_became_active":"2024-09-21T06:34:42.899230+0000","last_became_peered":"2024-09-21T06:34:42.899230+0000","last_unstale":"2024-09-21T06:36:14.278477+0000","last_undegraded":"2024-09-21T06:36:14.278477+0000","last_fullsized":"2024-09-21T06:36:14.278477+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:27.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721020+0000","last_change":"2024-09-21T06:34:40.882988+0000","last_active":"2024-09-21T06:36:14.721020+0000","last_peered":"2024-09-21T06:36:14.721020+0000","last_clean":"2024-09-21T06:36:14.721020+0000","last_became_active":"2024-09-21T06:34:40.882533+0000","last_became_peered":"2024-09-21T06:34:40.882533+0000","last_unstale":"2024-09-21T06:36:14.721020+0000","last_undegraded":"2024-09-21T06:36:14.721020+0000","last_fullsized":"2024-09-21T06:36:14.721020+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:23.220540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286367+0000","last_change":"2024-09-21T06:34:42.889556+0000","last_active":"2024-09-21T06:36:14.286367+0000","last_peered":"2024-09-21T06:36:14.286367+0000","last_clean":"2024-09-21T06:36:14.286367+0000","last_became_active":"2024-09-21T06:34:42.888853+0000","last_became_peered":"2024-09-21T06:34:42.888853+0000","last_unstale":"2024-09-21T06:36:14.286367+0000","last_undegraded":"2024-09-21T06:36:14.286367+0000","last_fullsized":"2024-09-21T06:36:14.286367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:24.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616668+0000","last_change":"2024-09-21T06:34:40.891450+0000","last_active":"2024-09-21T06:36:14.616668+0000","last_peered":"2024-09-21T06:36:14.616668+0000","last_clean":"2024-09-21T06:36:14.616668+0000","last_became_active":"2024-09-21T06:34:40.890892+0000","last_became_peered":"2024-09-21T06:34:40.890892+0000","last_unstale":"2024-09-21T06:36:14.616668+0000","last_undegraded":"2024-09-21T06:36:14.616668+0000","last_fullsized":"2024-09-21T06:36:14.616668+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.975342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.279539+0000","last_change":"2024-09-21T06:34:42.893122+0000","last_active":"2024-09-21T06:36:14.279539+0000","last_peered":"2024-09-21T06:36:14.279539+0000","last_clean":"2024-09-21T06:36:14.279539+0000","last_became_active":"2024-09-21T06:34:42.892730+0000","last_became_peered":"2024-09-21T06:34:42.892730+0000","last_unstale":"2024-09-21T06:36:14.279539+0000","last_undegraded":"2024-09-21T06:36:14.279539+0000","last_fullsized":"2024-09-21T06:36:14.279539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:06.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'31","reported_seq":272,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:25.635741+0000","last_change":"2024-09-21T06:35:13.509359+0000","last_active":"2024-09-21T06:36:25.635741+0000","last_peered":"2024-09-21T06:36:25.635741+0000","last_clean":"2024-09-21T06:36:25.635741+0000","last_became_active":"2024-09-21T06:35:13.499621+0000","last_became_peered":"2024-09-21T06:35:13.499621+0000","last_unstale":"2024-09-21T06:36:25.635741+0000","last_undegraded":"2024-09-21T06:36:25.635741+0000","last_fullsized":"2024-09-21T06:36:25.635741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:52.396964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66139,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":149,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":64752,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275256+0000","last_change":"2024-09-21T06:34:42.890487+0000","last_active":"2024-09-21T06:36:14.275256+0000","last_peered":"2024-09-21T06:36:14.275256+0000","last_clean":"2024-09-21T06:36:14.275256+0000","last_became_active":"2024-09-21T06:34:42.890100+0000","last_became_peered":"2024-09-21T06:34:42.890100+0000","last_unstale":"2024-09-21T06:36:14.275256+0000","last_undegraded":"2024-09-21T06:36:14.275256+0000","last_fullsized":"2024-09-21T06:36:14.275256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.206869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282371+0000","last_change":"2024-09-21T06:34:40.876187+0000","last_active":"2024-09-21T06:36:14.282371+0000","last_peered":"2024-09-21T06:36:14.282371+0000","last_clean":"2024-09-21T06:36:14.282371+0000","last_became_active":"2024-09-21T06:34:40.875687+0000","last_became_peered":"2024-09-21T06:34:40.875687+0000","last_unstale":"2024-09-21T06:36:14.282371+0000","last_undegraded":"2024-09-21T06:36:14.282371+0000","last_fullsized":"2024-09-21T06:36:14.282371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:51.758625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720726+0000","last_change":"2024-09-21T06:34:42.895900+0000","last_active":"2024-09-21T06:36:14.720726+0000","last_peered":"2024-09-21T06:36:14.720726+0000","last_clean":"2024-09-21T06:36:14.720726+0000","last_became_active":"2024-09-21T06:34:42.895504+0000","last_became_peered":"2024-09-21T06:34:42.895504+0000","last_unstale":"2024-09-21T06:36:14.720726+0000","last_undegraded":"2024-09-21T06:36:14.720726+0000","last_fullsized":"2024-09-21T06:36:14.720726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:28.414017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616473+0000","last_change":"2024-09-21T06:34:40.882856+0000","last_active":"2024-09-21T06:36:14.616473+0000","last_peered":"2024-09-21T06:36:14.616473+0000","last_clean":"2024-09-21T06:36:14.616473+0000","last_became_active":"2024-09-21T06:34:40.882424+0000","last_became_peered":"2024-09-21T06:34:40.882424+0000","last_unstale":"2024-09-21T06:36:14.616473+0000","last_undegraded":"2024-09-21T06:36:14.616473+0000","last_fullsized":"2024-09-21T06:36:14.616473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:38.815928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721217+0000","last_change":"2024-09-21T06:34:42.890611+0000","last_active":"2024-09-21T06:36:14.721217+0000","last_peered":"2024-09-21T06:36:14.721217+0000","last_clean":"2024-09-21T06:36:14.721217+0000","last_became_active":"2024-09-21T06:34:42.890246+0000","last_became_peered":"2024-09-21T06:34:42.890246+0000","last_unstale":"2024-09-21T06:36:14.721217+0000","last_undegraded":"2024-09-21T06:36:14.721217+0000","last_fullsized":"2024-09-21T06:36:14.721217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:05.074903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:25.113429+0000","last_change":"2024-09-21T06:34:40.877003+0000","last_active":"2024-09-21T06:36:25.113429+0000","last_peered":"2024-09-21T06:36:25.113429+0000","last_clean":"2024-09-21T06:36:25.113429+0000","last_became_active":"2024-09-21T06:34:40.876516+0000","last_became_peered":"2024-09-21T06:34:40.876516+0000","last_unstale":"2024-09-21T06:36:25.113429+0000","last_undegraded":"2024-09-21T06:36:25.113429+0000","last_fullsized":"2024-09-21T06:36:25.113429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:14.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720667+0000","last_change":"2024-09-21T06:34:42.896816+0000","last_active":"2024-09-21T06:36:14.720667+0000","last_peered":"2024-09-21T06:36:14.720667+0000","last_clean":"2024-09-21T06:36:14.720667+0000","last_became_active":"2024-09-21T06:34:42.896329+0000","last_became_peered":"2024-09-21T06:34:42.896329+0000","last_unstale":"2024-09-21T06:36:14.720667+0000","last_undegraded":"2024-09-21T06:36:14.720667+0000","last_fullsized":"2024-09-21T06:36:14.720667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.462498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.274831+0000","last_change":"2024-09-21T06:34:40.892809+0000","last_active":"2024-09-21T06:36:14.274831+0000","last_peered":"2024-09-21T06:36:14.274831+0000","last_clean":"2024-09-21T06:36:14.274831+0000","last_became_active":"2024-09-21T06:34:40.892433+0000","last_became_peered":"2024-09-21T06:34:40.892433+0000","last_unstale":"2024-09-21T06:36:14.274831+0000","last_undegraded":"2024-09-21T06:36:14.274831+0000","last_fullsized":"2024-09-21T06:36:14.274831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:43.744202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616525+0000","last_change":"2024-09-21T06:35:13.500503+0000","last_active":"2024-09-21T06:36:14.616525+0000","last_peered":"2024-09-21T06:36:14.616525+0000","last_clean":"2024-09-21T06:36:14.616525+0000","last_became_active":"2024-09-21T06:35:13.499704+0000","last_became_peered":"2024-09-21T06:35:13.499704+0000","last_unstale":"2024-09-21T06:36:14.616525+0000","last_undegraded":"2024-09-21T06:36:14.616525+0000","last_fullsized":"2024-09-21T06:36:14.616525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:45.469909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275256+0000","last_change":"2024-09-21T06:34:40.876791+0000","last_active":"2024-09-21T06:36:14.275256+0000","last_peered":"2024-09-21T06:36:14.275256+0000","last_clean":"2024-09-21T06:36:14.275256+0000","last_became_active":"2024-09-21T06:34:40.876323+0000","last_became_peered":"2024-09-21T06:34:40.876323+0000","last_unstale":"2024-09-21T06:36:14.275256+0000","last_undegraded":"2024-09-21T06:36:14.275256+0000","last_fullsized":"2024-09-21T06:36:14.275256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:20.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276272+0000","last_change":"2024-09-21T06:35:13.499258+0000","last_active":"2024-09-21T06:36:14.276272+0000","last_peered":"2024-09-21T06:36:14.276272+0000","last_clean":"2024-09-21T06:36:14.276272+0000","last_became_active":"2024-09-21T06:35:13.498747+0000","last_became_peered":"2024-09-21T06:35:13.498747+0000","last_unstale":"2024-09-21T06:36:14.276272+0000","last_undegraded":"2024-09-21T06:36:14.276272+0000","last_fullsized":"2024-09-21T06:36:14.276272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:23.977754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721058+0000","last_change":"2024-09-21T06:34:40.877644+0000","last_active":"2024-09-21T06:36:14.721058+0000","last_peered":"2024-09-21T06:36:14.721058+0000","last_clean":"2024-09-21T06:36:14.721058+0000","last_became_active":"2024-09-21T06:34:40.877238+0000","last_became_peered":"2024-09-21T06:34:40.877238+0000","last_unstale":"2024-09-21T06:36:14.721058+0000","last_undegraded":"2024-09-21T06:36:14.721058+0000","last_fullsized":"2024-09-21T06:36:14.721058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:21.055801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721125+0000","last_change":"2024-09-21T06:34:42.892399+0000","last_active":"2024-09-21T06:36:14.721125+0000","last_peered":"2024-09-21T06:36:14.721125+0000","last_clean":"2024-09-21T06:36:14.721125+0000","last_became_active":"2024-09-21T06:34:42.891873+0000","last_became_peered":"2024-09-21T06:34:42.891873+0000","last_unstale":"2024-09-21T06:36:14.721125+0000","last_undegraded":"2024-09-21T06:36:14.721125+0000","last_fullsized":"2024-09-21T06:36:14.721125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:09.684516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616752+0000","last_change":"2024-09-21T06:34:40.881603+0000","last_active":"2024-09-21T06:36:14.616752+0000","last_peered":"2024-09-21T06:36:14.616752+0000","last_clean":"2024-09-21T06:36:14.616752+0000","last_became_active":"2024-09-21T06:34:40.881226+0000","last_became_peered":"2024-09-21T06:34:40.881226+0000","last_unstale":"2024-09-21T06:36:14.616752+0000","last_undegraded":"2024-09-21T06:36:14.616752+0000","last_fullsized":"2024-09-21T06:36:14.616752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:09.252102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720922+0000","last_change":"2024-09-21T06:34:42.897354+0000","last_active":"2024-09-21T06:36:14.720922+0000","last_peered":"2024-09-21T06:36:14.720922+0000","last_clean":"2024-09-21T06:36:14.720922+0000","last_became_active":"2024-09-21T06:34:42.896981+0000","last_became_peered":"2024-09-21T06:34:42.896981+0000","last_unstale":"2024-09-21T06:36:14.720922+0000","last_undegraded":"2024-09-21T06:36:14.720922+0000","last_fullsized":"2024-09-21T06:36:14.720922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:07.598107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.294697+0000","last_change":"2024-09-21T06:36:14.294203+0000","last_active":"2024-09-21T06:36:14.294697+0000","last_peered":"2024-09-21T06:36:14.294697+0000","last_clean":"2024-09-21T06:36:14.294697+0000","last_became_active":"2024-09-21T06:36:14.287271+0000","last_became_peered":"2024-09-21T06:36:14.287271+0000","last_unstale":"2024-09-21T06:36:14.294697+0000","last_undegraded":"2024-09-21T06:36:14.294697+0000","last_fullsized":"2024-09-21T06:36:14.294697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:58.586517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721179+0000","last_change":"2024-09-21T06:34:42.894825+0000","last_active":"2024-09-21T06:36:14.721179+0000","last_peered":"2024-09-21T06:36:14.721179+0000","last_clean":"2024-09-21T06:36:14.721179+0000","last_became_active":"2024-09-21T06:34:42.893347+0000","last_became_peered":"2024-09-21T06:34:42.893347+0000","last_unstale":"2024-09-21T06:36:14.721179+0000","last_undegraded":"2024-09-21T06:36:14.721179+0000","last_fullsized":"2024-09-21T06:36:14.721179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:14.946035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721061+0000","last_change":"2024-09-21T06:33:33.165773+0000","last_active":"2024-09-21T06:36:14.721061+0000","last_peered":"2024-09-21T06:36:14.721061+0000","last_clean":"2024-09-21T06:36:14.721061+0000","last_became_active":"2024-09-21T06:33:33.159754+0000","last_became_peered":"2024-09-21T06:33:33.159754+0000","last_unstale":"2024-09-21T06:36:14.721061+0000","last_undegraded":"2024-09-21T06:36:14.721061+0000","last_fullsized":"2024-09-21T06:36:14.721061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_clean_scrub_stamp":"2024-09-21T06:30:10.865158+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:15.953330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275384+0000","last_change":"2024-09-21T06:34:40.876091+0000","last_active":"2024-09-21T06:36:14.275384+0000","last_peered":"2024-09-21T06:36:14.275384+0000","last_clean":"2024-09-21T06:36:14.275384+0000","last_became_active":"2024-09-21T06:34:40.875576+0000","last_became_peered":"2024-09-21T06:34:40.875576+0000","last_unstale":"2024-09-21T06:36:14.275384+0000","last_undegraded":"2024-09-21T06:36:14.275384+0000","last_fullsized":"2024-09-21T06:36:14.275384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:34.392145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275736+0000","last_change":"2024-09-21T06:34:42.892283+0000","last_active":"2024-09-21T06:36:14.275736+0000","last_peered":"2024-09-21T06:36:14.275736+0000","last_clean":"2024-09-21T06:36:14.275736+0000","last_became_active":"2024-09-21T06:34:42.891839+0000","last_became_peered":"2024-09-21T06:34:42.891839+0000","last_unstale":"2024-09-21T06:36:14.275736+0000","last_undegraded":"2024-09-21T06:36:14.275736+0000","last_fullsized":"2024-09-21T06:36:14.275736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:10.202352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720907+0000","last_change":"2024-09-21T06:34:40.880967+0000","last_active":"2024-09-21T06:36:14.720907+0000","last_peered":"2024-09-21T06:36:14.720907+0000","last_clean":"2024-09-21T06:36:14.720907+0000","last_became_active":"2024-09-21T06:34:40.880351+0000","last_became_peered":"2024-09-21T06:34:40.880351+0000","last_unstale":"2024-09-21T06:36:14.720907+0000","last_undegraded":"2024-09-21T06:36:14.720907+0000","last_fullsized":"2024-09-21T06:36:14.720907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:52.694732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720675+0000","last_change":"2024-09-21T06:34:42.876102+0000","last_active":"2024-09-21T06:36:14.720675+0000","last_peered":"2024-09-21T06:36:14.720675+0000","last_clean":"2024-09-21T06:36:14.720675+0000","last_became_active":"2024-09-21T06:34:42.875065+0000","last_became_peered":"2024-09-21T06:34:42.875065+0000","last_unstale":"2024-09-21T06:36:14.720675+0000","last_undegraded":"2024-09-21T06:36:14.720675+0000","last_fullsized":"2024-09-21T06:36:14.720675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:23.867180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:26.114289+0000","last_change":"2024-09-21T06:34:40.890355+0000","last_active":"2024-09-21T06:36:26.114289+0000","last_peered":"2024-09-21T06:36:26.114289+0000","last_clean":"2024-09-21T06:36:26.114289+0000","last_became_active":"2024-09-21T06:34:40.889974+0000","last_became_peered":"2024-09-21T06:34:40.889974+0000","last_unstale":"2024-09-21T06:36:26.114289+0000","last_undegraded":"2024-09-21T06:36:26.114289+0000","last_fullsized":"2024-09-21T06:36:26.114289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:58.349625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616293+0000","last_change":"2024-09-21T06:34:42.899831+0000","last_active":"2024-09-21T06:36:14.616293+0000","last_peered":"2024-09-21T06:36:14.616293+0000","last_clean":"2024-09-21T06:36:14.616293+0000","last_became_active":"2024-09-21T06:34:42.899372+0000","last_became_peered":"2024-09-21T06:34:42.899372+0000","last_unstale":"2024-09-21T06:36:14.616293+0000","last_undegraded":"2024-09-21T06:36:14.616293+0000","last_fullsized":"2024-09-21T06:36:14.616293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:50.165222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721265+0000","last_change":"2024-09-21T06:34:40.882380+0000","last_active":"2024-09-21T06:36:14.721265+0000","last_peered":"2024-09-21T06:36:14.721265+0000","last_clean":"2024-09-21T06:36:14.721265+0000","last_became_active":"2024-09-21T06:34:40.881463+0000","last_became_peered":"2024-09-21T06:34:40.881463+0000","last_unstale":"2024-09-21T06:36:14.721265+0000","last_undegraded":"2024-09-21T06:36:14.721265+0000","last_fullsized":"2024-09-21T06:36:14.721265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:25.620174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613626+0000","last_change":"2024-09-21T06:34:42.897205+0000","last_active":"2024-09-21T06:36:14.613626+0000","last_peered":"2024-09-21T06:36:14.613626+0000","last_clean":"2024-09-21T06:36:14.613626+0000","last_became_active":"2024-09-21T06:34:42.896705+0000","last_became_peered":"2024-09-21T06:34:42.896705+0000","last_unstale":"2024-09-21T06:36:14.613626+0000","last_undegraded":"2024-09-21T06:36:14.613626+0000","last_fullsized":"2024-09-21T06:36:14.613626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.333176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272745+0000","last_change":"2024-09-21T06:34:40.890356+0000","last_active":"2024-09-21T06:36:14.272745+0000","last_peered":"2024-09-21T06:36:14.272745+0000","last_clean":"2024-09-21T06:36:14.272745+0000","last_became_active":"2024-09-21T06:34:40.889963+0000","last_became_peered":"2024-09-21T06:34:40.889963+0000","last_unstale":"2024-09-21T06:36:14.272745+0000","last_undegraded":"2024-09-21T06:36:14.272745+0000","last_fullsized":"2024-09-21T06:36:14.272745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:09.621779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613505+0000","last_change":"2024-09-21T06:34:42.884933+0000","last_active":"2024-09-21T06:36:14.613505+0000","last_peered":"2024-09-21T06:36:14.613505+0000","last_clean":"2024-09-21T06:36:14.613505+0000","last_became_active":"2024-09-21T06:34:42.884506+0000","last_became_peered":"2024-09-21T06:34:42.884506+0000","last_unstale":"2024-09-21T06:36:14.613505+0000","last_undegraded":"2024-09-21T06:36:14.613505+0000","last_fullsized":"2024-09-21T06:36:14.613505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:14.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.290755+0000","last_change":"2024-09-21T06:36:14.290260+0000","last_active":"2024-09-21T06:36:14.290755+0000","last_peered":"2024-09-21T06:36:14.290755+0000","last_clean":"2024-09-21T06:36:14.290755+0000","last_became_active":"2024-09-21T06:36:14.287215+0000","last_became_peered":"2024-09-21T06:36:14.287215+0000","last_unstale":"2024-09-21T06:36:14.290755+0000","last_undegraded":"2024-09-21T06:36:14.290755+0000","last_fullsized":"2024-09-21T06:36:14.290755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:31.344496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721065+0000","last_change":"2024-09-21T06:34:42.880047+0000","last_active":"2024-09-21T06:36:14.721065+0000","last_peered":"2024-09-21T06:36:14.721065+0000","last_clean":"2024-09-21T06:36:14.721065+0000","last_became_active":"2024-09-21T06:34:42.879664+0000","last_became_peered":"2024-09-21T06:34:42.879664+0000","last_unstale":"2024-09-21T06:36:14.721065+0000","last_undegraded":"2024-09-21T06:36:14.721065+0000","last_fullsized":"2024-09-21T06:36:14.721065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:03.621493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'12","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.289520+0000","last_change":"2024-09-21T06:36:14.289110+0000","last_active":"2024-09-21T06:36:14.289520+0000","last_peered":"2024-09-21T06:36:14.289520+0000","last_clean":"2024-09-21T06:36:14.289520+0000","last_became_active":"2024-09-21T06:36:14.279222+0000","last_became_peered":"2024-09-21T06:36:14.279222+0000","last_unstale":"2024-09-21T06:36:14.289520+0000","last_undegraded":"2024-09-21T06:36:14.289520+0000","last_fullsized":"2024-09-21T06:36:14.289520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:40.738475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272942+0000","last_change":"2024-09-21T06:35:13.289318+0000","last_active":"2024-09-21T06:36:14.272942+0000","last_peered":"2024-09-21T06:36:14.272942+0000","last_clean":"2024-09-21T06:36:14.272942+0000","last_became_active":"2024-09-21T06:35:13.288961+0000","last_became_peered":"2024-09-21T06:35:13.288961+0000","last_unstale":"2024-09-21T06:36:14.272942+0000","last_undegraded":"2024-09-21T06:36:14.272942+0000","last_fullsized":"2024-09-21T06:36:14.272942+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:05.659772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275622+0000","last_change":"2024-09-21T06:34:40.869754+0000","last_active":"2024-09-21T06:36:14.275622+0000","last_peered":"2024-09-21T06:36:14.275622+0000","last_clean":"2024-09-21T06:36:14.275622+0000","last_became_active":"2024-09-21T06:34:40.869311+0000","last_became_peered":"2024-09-21T06:34:40.869311+0000","last_unstale":"2024-09-21T06:36:14.275622+0000","last_undegraded":"2024-09-21T06:36:14.275622+0000","last_fullsized":"2024-09-21T06:36:14.275622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:10.959880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286081+0000","last_change":"2024-09-21T06:34:42.889198+0000","last_active":"2024-09-21T06:36:14.286081+0000","last_peered":"2024-09-21T06:36:14.286081+0000","last_clean":"2024-09-21T06:36:14.286081+0000","last_became_active":"2024-09-21T06:34:42.888813+0000","last_became_peered":"2024-09-21T06:34:42.888813+0000","last_unstale":"2024-09-21T06:36:14.286081+0000","last_undegraded":"2024-09-21T06:36:14.286081+0000","last_fullsized":"2024-09-21T06:36:14.286081+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:25.270225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278356+0000","last_change":"2024-09-21T06:34:40.892267+0000","last_active":"2024-09-21T06:36:14.278356+0000","last_peered":"2024-09-21T06:36:14.278356+0000","last_clean":"2024-09-21T06:36:14.278356+0000","last_became_active":"2024-09-21T06:34:40.891791+0000","last_became_peered":"2024-09-21T06:34:40.891791+0000","last_unstale":"2024-09-21T06:36:14.278356+0000","last_undegraded":"2024-09-21T06:36:14.278356+0000","last_fullsized":"2024-09-21T06:36:14.278356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:07.864647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275359+0000","last_change":"2024-09-21T06:34:42.894361+0000","last_active":"2024-09-21T06:36:14.275359+0000","last_peered":"2024-09-21T06:36:14.275359+0000","last_clean":"2024-09-21T06:36:14.275359+0000","last_became_active":"2024-09-21T06:34:42.893976+0000","last_became_peered":"2024-09-21T06:34:42.893976+0000","last_unstale":"2024-09-21T06:36:14.275359+0000","last_undegraded":"2024-09-21T06:36:14.275359+0000","last_fullsized":"2024-09-21T06:36:14.275359+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:32.741495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275262+0000","last_change":"2024-09-21T06:34:40.875952+0000","last_active":"2024-09-21T06:36:14.275262+0000","last_peered":"2024-09-21T06:36:14.275262+0000","last_clean":"2024-09-21T06:36:14.275262+0000","last_became_active":"2024-09-21T06:34:40.875598+0000","last_became_peered":"2024-09-21T06:34:40.875598+0000","last_unstale":"2024-09-21T06:36:14.275262+0000","last_undegraded":"2024-09-21T06:36:14.275262+0000","last_fullsized":"2024-09-21T06:36:14.275262+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:29.873037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276436+0000","last_change":"2024-09-21T06:34:42.887639+0000","last_active":"2024-09-21T06:36:14.276436+0000","last_peered":"2024-09-21T06:36:14.276436+0000","last_clean":"2024-09-21T06:36:14.276436+0000","last_became_active":"2024-09-21T06:34:42.887201+0000","last_became_peered":"2024-09-21T06:34:42.887201+0000","last_unstale":"2024-09-21T06:36:14.276436+0000","last_undegraded":"2024-09-21T06:36:14.276436+0000","last_fullsized":"2024-09-21T06:36:14.276436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:59.431007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282456+0000","last_change":"2024-09-21T06:34:40.880145+0000","last_active":"2024-09-21T06:36:14.282456+0000","last_peered":"2024-09-21T06:36:14.282456+0000","last_clean":"2024-09-21T06:36:14.282456+0000","last_became_active":"2024-09-21T06:34:40.879480+0000","last_became_peered":"2024-09-21T06:34:40.879480+0000","last_unstale":"2024-09-21T06:36:14.282456+0000","last_undegraded":"2024-09-21T06:36:14.282456+0000","last_fullsized":"2024-09-21T06:36:14.282456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.551228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276161+0000","last_change":"2024-09-21T06:34:42.882455+0000","last_active":"2024-09-21T06:36:14.276161+0000","last_peered":"2024-09-21T06:36:14.276161+0000","last_clean":"2024-09-21T06:36:14.276161+0000","last_became_active":"2024-09-21T06:34:42.880714+0000","last_became_peered":"2024-09-21T06:34:42.880714+0000","last_unstale":"2024-09-21T06:36:14.276161+0000","last_undegraded":"2024-09-21T06:36:14.276161+0000","last_fullsized":"2024-09-21T06:36:14.276161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:39.264152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275389+0000","last_change":"2024-09-21T06:34:40.879560+0000","last_active":"2024-09-21T06:36:14.275389+0000","last_peered":"2024-09-21T06:36:14.275389+0000","last_clean":"2024-09-21T06:36:14.275389+0000","last_became_active":"2024-09-21T06:34:40.878433+0000","last_became_peered":"2024-09-21T06:34:40.878433+0000","last_unstale":"2024-09-21T06:36:14.275389+0000","last_undegraded":"2024-09-21T06:36:14.275389+0000","last_fullsized":"2024-09-21T06:36:14.275389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:07.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720928+0000","last_change":"2024-09-21T06:34:42.896193+0000","last_active":"2024-09-21T06:36:14.720928+0000","last_peered":"2024-09-21T06:36:14.720928+0000","last_clean":"2024-09-21T06:36:14.720928+0000","last_became_active":"2024-09-21T06:34:42.895753+0000","last_became_peered":"2024-09-21T06:34:42.895753+0000","last_unstale":"2024-09-21T06:36:14.720928+0000","last_undegraded":"2024-09-21T06:36:14.720928+0000","last_fullsized":"2024-09-21T06:36:14.720928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:47.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616659+0000","last_change":"2024-09-21T06:35:13.290402+0000","last_active":"2024-09-21T06:36:14.616659+0000","last_peered":"2024-09-21T06:36:14.616659+0000","last_clean":"2024-09-21T06:36:14.616659+0000","last_became_active":"2024-09-21T06:35:13.289718+0000","last_became_peered":"2024-09-21T06:35:13.289718+0000","last_unstale":"2024-09-21T06:36:14.616659+0000","last_undegraded":"2024-09-21T06:36:14.616659+0000","last_fullsized":"2024-09-21T06:36:14.616659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:06.684007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275203+0000","last_change":"2024-09-21T06:34:40.879386+0000","last_active":"2024-09-21T06:36:14.275203+0000","last_peered":"2024-09-21T06:36:14.275203+0000","last_clean":"2024-09-21T06:36:14.275203+0000","last_became_active":"2024-09-21T06:34:40.879001+0000","last_became_peered":"2024-09-21T06:34:40.879001+0000","last_unstale":"2024-09-21T06:36:14.275203+0000","last_undegraded":"2024-09-21T06:36:14.275203+0000","last_fullsized":"2024-09-21T06:36:14.275203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:48.438361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.279411+0000","last_change":"2024-09-21T06:34:42.901595+0000","last_active":"2024-09-21T06:36:14.279411+0000","last_peered":"2024-09-21T06:36:14.279411+0000","last_clean":"2024-09-21T06:36:14.279411+0000","last_became_active":"2024-09-21T06:34:42.901200+0000","last_became_peered":"2024-09-21T06:34:42.901200+0000","last_unstale":"2024-09-21T06:36:14.279411+0000","last_undegraded":"2024-09-21T06:36:14.279411+0000","last_fullsized":"2024-09-21T06:36:14.279411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:12.044528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275360+0000","last_change":"2024-09-21T06:34:40.878959+0000","last_active":"2024-09-21T06:36:14.275360+0000","last_peered":"2024-09-21T06:36:14.275360+0000","last_clean":"2024-09-21T06:36:14.275360+0000","last_became_active":"2024-09-21T06:34:40.878343+0000","last_became_peered":"2024-09-21T06:34:40.878343+0000","last_unstale":"2024-09-21T06:36:14.275360+0000","last_undegraded":"2024-09-21T06:36:14.275360+0000","last_fullsized":"2024-09-21T06:36:14.275360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:54.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286293+0000","last_change":"2024-09-21T06:34:42.887868+0000","last_active":"2024-09-21T06:36:14.286293+0000","last_peered":"2024-09-21T06:36:14.286293+0000","last_clean":"2024-09-21T06:36:14.286293+0000","last_became_active":"2024-09-21T06:34:42.887268+0000","last_became_peered":"2024-09-21T06:34:42.887268+0000","last_unstale":"2024-09-21T06:36:14.286293+0000","last_undegraded":"2024-09-21T06:36:14.286293+0000","last_fullsized":"2024-09-21T06:36:14.286293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:41.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275566+0000","last_change":"2024-09-21T06:34:40.890363+0000","last_active":"2024-09-21T06:36:14.275566+0000","last_peered":"2024-09-21T06:36:14.275566+0000","last_clean":"2024-09-21T06:36:14.275566+0000","last_became_active":"2024-09-21T06:34:40.889967+0000","last_became_peered":"2024-09-21T06:34:40.889967+0000","last_unstale":"2024-09-21T06:36:14.275566+0000","last_undegraded":"2024-09-21T06:36:14.275566+0000","last_fullsized":"2024-09-21T06:36:14.275566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:01.806399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275350+0000","last_change":"2024-09-21T06:34:42.891211+0000","last_active":"2024-09-21T06:36:14.275350+0000","last_peered":"2024-09-21T06:36:14.275350+0000","last_clean":"2024-09-21T06:36:14.275350+0000","last_became_active":"2024-09-21T06:34:42.890813+0000","last_became_peered":"2024-09-21T06:34:42.890813+0000","last_unstale":"2024-09-21T06:36:14.275350+0000","last_undegraded":"2024-09-21T06:36:14.275350+0000","last_fullsized":"2024-09-21T06:36:14.275350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.273073+0000","last_change":"2024-09-21T06:34:40.878074+0000","last_active":"2024-09-21T06:36:14.273073+0000","last_peered":"2024-09-21T06:36:14.273073+0000","last_clean":"2024-09-21T06:36:14.273073+0000","last_became_active":"2024-09-21T06:34:40.877688+0000","last_became_peered":"2024-09-21T06:34:40.877688+0000","last_unstale":"2024-09-21T06:36:14.273073+0000","last_undegraded":"2024-09-21T06:36:14.273073+0000","last_fullsized":"2024-09-21T06:36:14.273073+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:01.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70281,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":582,"num_read_kb":356,"num_write":170,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":65356,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":211151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":426988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1564672,"data_stored":1084586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":880640,"data_stored":427202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":427100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712524,"statfs":{"total":95995035648,"available":95961624576,"internally_reserved":0,"allocated":1474560,"data_stored":1019193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":426591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1486848,"data_stored":1018877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":493167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":426902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":427684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":493105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":427862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:36:31.250 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T06:36:31.250 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:36:31.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.400+0000 7f7026346640 1 -- 172.21.15.49:0/1017495075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7020108120 msgr2=0x7f7020108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.400+0000 7f7026346640 1 --2- 172.21.15.49:0/1017495075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7020108120 0x7f7020108530 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7014009900 tx=0x7f701402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:31.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.400+0000 7f7026346640 1 -- 172.21.15.49:0/1017495075 shutdown_connections 2024-09-21T06:36:31.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.400+0000 7f7026346640 1 --2- 172.21.15.49:0/1017495075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7020108a70 0x7f702010f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.400+0000 7f7026346640 1 --2- 172.21.15.49:0/1017495075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7020108120 0x7f7020108530 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.400+0000 7f7026346640 1 --2- 172.21.15.49:0/1017495075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f70201027f0 0x7f7020102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.400+0000 7f7026346640 1 -- 172.21.15.49:0/1017495075 >> 172.21.15.49:0/1017495075 conn(0x7f70200fe1f0 msgr2=0x7f7020100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.400+0000 7f7026346640 1 -- 172.21.15.49:0/1017495075 shutdown_connections 2024-09-21T06:36:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.400+0000 7f7026346640 1 -- 172.21.15.49:0/1017495075 wait complete. 2024-09-21T06:36:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7026346640 1 Processor -- start 2024-09-21T06:36:31.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7026346640 1 -- start start 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7026346640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70201027f0 0x7f702010fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7026346640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7020108120 0x7f70201102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7026346640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020108a70 0x7f7020110800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7026346640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7020113850 con 0x7f70201027f0 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7026346640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f70201136d0 con 0x7f7020108a70 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7026346640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f70201139d0 con 0x7f7020108120 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7025344640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70201027f0 0x7f702010fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7025344640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70201027f0 0x7f702010fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56962/0 (socket says 172.21.15.49:56962) 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7025344640 1 -- 172.21.15.49:0/2193089943 learned_addr learned my addr 172.21.15.49:0/2193089943 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7025b45640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020108a70 0x7f7020110800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7024b43640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7020108120 0x7f70201102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7025344640 1 -- 172.21.15.49:0/2193089943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7020108120 msgr2=0x7f70201102c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7025344640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7020108120 0x7f70201102c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7025344640 1 -- 172.21.15.49:0/2193089943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020108a70 msgr2=0x7f7020110800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7025344640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020108a70 0x7f7020110800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7025344640 1 -- 172.21.15.49:0/2193089943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70201a8500 con 0x7f70201027f0 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.401+0000 7f7024b43640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7020108120 0x7f70201102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.402+0000 7f7025344640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70201027f0 0x7f702010fd80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f701800c890 tx=0x7f701800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.402+0000 7f701e7fc640 1 -- 172.21.15.49:0/2193089943 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018004220 con 0x7f70201027f0 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.402+0000 7f701e7fc640 1 -- 172.21.15.49:0/2193089943 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70180043c0 con 0x7f70201027f0 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.402+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70201a87f0 con 0x7f70201027f0 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.402+0000 7f701e7fc640 1 -- 172.21.15.49:0/2193089943 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018004a00 con 0x7f70201027f0 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.402+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70201a8d90 con 0x7f70201027f0 2024-09-21T06:36:31.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.403+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7020102c00 con 0x7f70201027f0 2024-09-21T06:36:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.405+0000 7f701e7fc640 1 -- 172.21.15.49:0/2193089943 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f70180079b0 con 0x7f70201027f0 2024-09-21T06:36:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.406+0000 7f701e7fc640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70080b65e0 0x7f70080b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.406+0000 7f7024b43640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70080b65e0 0x7f70080b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:31.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.406+0000 7f701e7fc640 1 -- 172.21.15.49:0/2193089943 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f70180e7650 con 0x7f70201027f0 2024-09-21T06:36:31.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.407+0000 7f7024b43640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70080b65e0 0x7f70080b8af0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7014000c00 tx=0x7f7014031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:31.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.409+0000 7f701e7fc640 1 -- 172.21.15.49:0/2193089943 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7018014030 con 0x7f70201027f0 2024-09-21T06:36:31.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:31 smithi079 ceph-mon[34346]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:36:31.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:31 smithi079 ceph-mon[34346]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:31.597 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.596+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7020063800 con 0x7f70080b65e0 2024-09-21T06:36:31.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.600+0000 7f701e7fc640 1 -- 172.21.15.49:0/2193089943 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258802 (secure 0 0 0) 0x7f7020063800 con 0x7f70080b65e0 2024-09-21T06:36:31.604 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:31.605 INFO:teuthology.orchestra.run.smithi049.stderr:dumped all 2024-09-21T06:36:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.603+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70080b65e0 msgr2=0x7f70080b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.603+0000 7f7026346640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70080b65e0 0x7f70080b8af0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7014000c00 tx=0x7f7014031400 comp rx=0 tx=0).stop 2024-09-21T06:36:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.603+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70201027f0 msgr2=0x7f702010fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.603+0000 7f7026346640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70201027f0 0x7f702010fd80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f701800c890 tx=0x7f701800cd50 comp rx=0 tx=0).stop 2024-09-21T06:36:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.603+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 shutdown_connections 2024-09-21T06:36:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.603+0000 7f7026346640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f70080b65e0 0x7f70080b8af0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.603+0000 7f7026346640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7020108a70 0x7f7020110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.603+0000 7f7026346640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7020108120 0x7f70201102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.603+0000 7f7026346640 1 --2- 172.21.15.49:0/2193089943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f70201027f0 0x7f702010fd80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:31.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.604+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 >> 172.21.15.49:0/2193089943 conn(0x7f70200fe1f0 msgr2=0x7f7020105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:31.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.604+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 shutdown_connections 2024-09-21T06:36:31.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:31.604+0000 7f7026346640 1 -- 172.21.15.49:0/2193089943 wait complete. 2024-09-21T06:36:31.615 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:31 smithi049 ceph-mon[31177]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:36:31.616 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:31 smithi049 ceph-mon[31177]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:31.617 INFO:teuthology.orchestra.run.smithi049.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-21T06:36:30.132034+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660883,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":663,"num_read_kb":425,"num_write":295,"num_write_kb":2273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":3017196,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":738,"ondisk_log_size":738,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":357416,"kb_used_data":12264,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124584408,"statfs":{"total":1151940427776,"available":1151574433792,"internally_reserved":0,"allocated":12558336,"data_stored":7099257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":353154363},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003370"},"pg_stats":[{"pgid":"3.3f","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276569+0000","last_change":"2024-09-21T06:34:42.895466+0000","last_active":"2024-09-21T06:36:14.276569+0000","last_peered":"2024-09-21T06:36:14.276569+0000","last_clean":"2024-09-21T06:36:14.276569+0000","last_became_active":"2024-09-21T06:34:42.895084+0000","last_became_peered":"2024-09-21T06:34:42.895084+0000","last_unstale":"2024-09-21T06:36:14.276569+0000","last_undegraded":"2024-09-21T06:36:14.276569+0000","last_fullsized":"2024-09-21T06:36:14.276569+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:54.513107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"76'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.285962+0000","last_change":"2024-09-21T06:34:42.888307+0000","last_active":"2024-09-21T06:36:14.285962+0000","last_peered":"2024-09-21T06:36:14.285962+0000","last_clean":"2024-09-21T06:36:14.285962+0000","last_became_active":"2024-09-21T06:34:42.886106+0000","last_became_peered":"2024-09-21T06:34:42.886106+0000","last_unstale":"2024-09-21T06:36:14.285962+0000","last_undegraded":"2024-09-21T06:36:14.285962+0000","last_fullsized":"2024-09-21T06:36:14.285962+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:38:57.206743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286005+0000","last_change":"2024-09-21T06:34:42.897217+0000","last_active":"2024-09-21T06:36:14.286005+0000","last_peered":"2024-09-21T06:36:14.286005+0000","last_clean":"2024-09-21T06:36:14.286005+0000","last_became_active":"2024-09-21T06:34:42.896849+0000","last_became_peered":"2024-09-21T06:34:42.896849+0000","last_unstale":"2024-09-21T06:36:14.286005+0000","last_undegraded":"2024-09-21T06:36:14.286005+0000","last_fullsized":"2024-09-21T06:36:14.286005+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:28.749566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275509+0000","last_change":"2024-09-21T06:34:42.887236+0000","last_active":"2024-09-21T06:36:14.275509+0000","last_peered":"2024-09-21T06:36:14.275509+0000","last_clean":"2024-09-21T06:36:14.275509+0000","last_became_active":"2024-09-21T06:34:42.886137+0000","last_became_peered":"2024-09-21T06:34:42.886137+0000","last_unstale":"2024-09-21T06:36:14.275509+0000","last_undegraded":"2024-09-21T06:36:14.275509+0000","last_fullsized":"2024-09-21T06:36:14.275509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:05:23.728433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275250+0000","last_change":"2024-09-21T06:34:42.885792+0000","last_active":"2024-09-21T06:36:14.275250+0000","last_peered":"2024-09-21T06:36:14.275250+0000","last_clean":"2024-09-21T06:36:14.275250+0000","last_became_active":"2024-09-21T06:34:42.885372+0000","last_became_peered":"2024-09-21T06:34:42.885372+0000","last_unstale":"2024-09-21T06:36:14.275250+0000","last_undegraded":"2024-09-21T06:36:14.275250+0000","last_fullsized":"2024-09-21T06:36:14.275250+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:16:29.550373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613320+0000","last_change":"2024-09-21T06:34:42.896814+0000","last_active":"2024-09-21T06:36:14.613320+0000","last_peered":"2024-09-21T06:36:14.613320+0000","last_clean":"2024-09-21T06:36:14.613320+0000","last_became_active":"2024-09-21T06:34:42.896147+0000","last_became_peered":"2024-09-21T06:34:42.896147+0000","last_unstale":"2024-09-21T06:36:14.613320+0000","last_undegraded":"2024-09-21T06:36:14.613320+0000","last_fullsized":"2024-09-21T06:36:14.613320+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:58:49.037539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720733+0000","last_change":"2024-09-21T06:34:42.896264+0000","last_active":"2024-09-21T06:36:14.720733+0000","last_peered":"2024-09-21T06:36:14.720733+0000","last_clean":"2024-09-21T06:36:14.720733+0000","last_became_active":"2024-09-21T06:34:42.895793+0000","last_became_peered":"2024-09-21T06:34:42.895793+0000","last_unstale":"2024-09-21T06:36:14.720733+0000","last_undegraded":"2024-09-21T06:36:14.720733+0000","last_fullsized":"2024-09-21T06:36:14.720733+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:49:06.600230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.274942+0000","last_change":"2024-09-21T06:34:42.892538+0000","last_active":"2024-09-21T06:36:14.274942+0000","last_peered":"2024-09-21T06:36:14.274942+0000","last_clean":"2024-09-21T06:36:14.274942+0000","last_became_active":"2024-09-21T06:34:42.892139+0000","last_became_peered":"2024-09-21T06:34:42.892139+0000","last_unstale":"2024-09-21T06:36:14.274942+0000","last_undegraded":"2024-09-21T06:36:14.274942+0000","last_fullsized":"2024-09-21T06:36:14.274942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:12:51.808969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'11","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272795+0000","last_change":"2024-09-21T06:35:13.499797+0000","last_active":"2024-09-21T06:36:14.272795+0000","last_peered":"2024-09-21T06:36:14.272795+0000","last_clean":"2024-09-21T06:36:14.272795+0000","last_became_active":"2024-09-21T06:35:13.499380+0000","last_became_peered":"2024-09-21T06:35:13.499380+0000","last_unstale":"2024-09-21T06:36:14.272795+0000","last_undegraded":"2024-09-21T06:36:14.272795+0000","last_fullsized":"2024-09-21T06:36:14.272795+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:21.809657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11],"acting":[9,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.36","version":"76'16","reported_seq":38,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613693+0000","last_change":"2024-09-21T06:34:42.895533+0000","last_active":"2024-09-21T06:36:14.613693+0000","last_peered":"2024-09-21T06:36:14.613693+0000","last_clean":"2024-09-21T06:36:14.613693+0000","last_became_active":"2024-09-21T06:34:42.895162+0000","last_became_peered":"2024-09-21T06:34:42.895162+0000","last_unstale":"2024-09-21T06:36:14.613693+0000","last_undegraded":"2024-09-21T06:36:14.613693+0000","last_fullsized":"2024-09-21T06:36:14.613693+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:25.495493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721181+0000","last_change":"2024-09-21T06:34:42.894173+0000","last_active":"2024-09-21T06:36:14.721181+0000","last_peered":"2024-09-21T06:36:14.721181+0000","last_clean":"2024-09-21T06:36:14.721181+0000","last_became_active":"2024-09-21T06:34:42.893817+0000","last_became_peered":"2024-09-21T06:34:42.893817+0000","last_unstale":"2024-09-21T06:36:14.721181+0000","last_undegraded":"2024-09-21T06:36:14.721181+0000","last_fullsized":"2024-09-21T06:36:14.721181+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:13:31.580564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275513+0000","last_change":"2024-09-21T06:34:42.886536+0000","last_active":"2024-09-21T06:36:14.275513+0000","last_peered":"2024-09-21T06:36:14.275513+0000","last_clean":"2024-09-21T06:36:14.275513+0000","last_became_active":"2024-09-21T06:34:42.885636+0000","last_became_peered":"2024-09-21T06:34:42.885636+0000","last_unstale":"2024-09-21T06:36:14.275513+0000","last_undegraded":"2024-09-21T06:36:14.275513+0000","last_fullsized":"2024-09-21T06:36:14.275513+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:46:11.074850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721016+0000","last_change":"2024-09-21T06:34:42.882665+0000","last_active":"2024-09-21T06:36:14.721016+0000","last_peered":"2024-09-21T06:36:14.721016+0000","last_clean":"2024-09-21T06:36:14.721016+0000","last_became_active":"2024-09-21T06:34:42.882254+0000","last_became_peered":"2024-09-21T06:34:42.882254+0000","last_unstale":"2024-09-21T06:36:14.721016+0000","last_undegraded":"2024-09-21T06:36:14.721016+0000","last_fullsized":"2024-09-21T06:36:14.721016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:43:01.203542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.285809+0000","last_change":"2024-09-21T06:34:42.884034+0000","last_active":"2024-09-21T06:36:14.285809+0000","last_peered":"2024-09-21T06:36:14.285809+0000","last_clean":"2024-09-21T06:36:14.285809+0000","last_became_active":"2024-09-21T06:34:42.883685+0000","last_became_peered":"2024-09-21T06:34:42.883685+0000","last_unstale":"2024-09-21T06:36:14.285809+0000","last_undegraded":"2024-09-21T06:36:14.285809+0000","last_fullsized":"2024-09-21T06:36:14.285809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:05:00.124019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.285548+0000","last_change":"2024-09-21T06:34:42.894686+0000","last_active":"2024-09-21T06:36:14.285548+0000","last_peered":"2024-09-21T06:36:14.285548+0000","last_clean":"2024-09-21T06:36:14.285548+0000","last_became_active":"2024-09-21T06:34:42.893980+0000","last_became_peered":"2024-09-21T06:34:42.893980+0000","last_unstale":"2024-09-21T06:36:14.285548+0000","last_undegraded":"2024-09-21T06:36:14.285548+0000","last_fullsized":"2024-09-21T06:36:14.285548+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:23:00.524890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278132+0000","last_change":"2024-09-21T06:34:42.891462+0000","last_active":"2024-09-21T06:36:14.278132+0000","last_peered":"2024-09-21T06:36:14.278132+0000","last_clean":"2024-09-21T06:36:14.278132+0000","last_became_active":"2024-09-21T06:34:42.891085+0000","last_became_peered":"2024-09-21T06:34:42.891085+0000","last_unstale":"2024-09-21T06:36:14.278132+0000","last_undegraded":"2024-09-21T06:36:14.278132+0000","last_fullsized":"2024-09-21T06:36:14.278132+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:08:03.942909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276607+0000","last_change":"2024-09-21T06:34:42.897049+0000","last_active":"2024-09-21T06:36:14.276607+0000","last_peered":"2024-09-21T06:36:14.276607+0000","last_clean":"2024-09-21T06:36:14.276607+0000","last_became_active":"2024-09-21T06:34:42.896131+0000","last_became_peered":"2024-09-21T06:34:42.896131+0000","last_unstale":"2024-09-21T06:36:14.276607+0000","last_undegraded":"2024-09-21T06:36:14.276607+0000","last_fullsized":"2024-09-21T06:36:14.276607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:21:47.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.273016+0000","last_change":"2024-09-21T06:34:42.887894+0000","last_active":"2024-09-21T06:36:14.273016+0000","last_peered":"2024-09-21T06:36:14.273016+0000","last_clean":"2024-09-21T06:36:14.273016+0000","last_became_active":"2024-09-21T06:34:42.887436+0000","last_became_peered":"2024-09-21T06:34:42.887436+0000","last_unstale":"2024-09-21T06:36:14.273016+0000","last_undegraded":"2024-09-21T06:36:14.273016+0000","last_fullsized":"2024-09-21T06:36:14.273016+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:17:22.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282032+0000","last_change":"2024-09-21T06:34:42.888071+0000","last_active":"2024-09-21T06:36:14.282032+0000","last_peered":"2024-09-21T06:36:14.282032+0000","last_clean":"2024-09-21T06:36:14.282032+0000","last_became_active":"2024-09-21T06:34:42.887295+0000","last_became_peered":"2024-09-21T06:34:42.887295+0000","last_unstale":"2024-09-21T06:36:14.282032+0000","last_undegraded":"2024-09-21T06:36:14.282032+0000","last_fullsized":"2024-09-21T06:36:14.282032+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:05:49.937367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275863+0000","last_change":"2024-09-21T06:34:42.891963+0000","last_active":"2024-09-21T06:36:14.275863+0000","last_peered":"2024-09-21T06:36:14.275863+0000","last_clean":"2024-09-21T06:36:14.275863+0000","last_became_active":"2024-09-21T06:34:42.891603+0000","last_became_peered":"2024-09-21T06:34:42.891603+0000","last_unstale":"2024-09-21T06:36:14.275863+0000","last_undegraded":"2024-09-21T06:36:14.275863+0000","last_fullsized":"2024-09-21T06:36:14.275863+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:32:47.608523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"76'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721088+0000","last_change":"2024-09-21T06:34:42.895909+0000","last_active":"2024-09-21T06:36:14.721088+0000","last_peered":"2024-09-21T06:36:14.721088+0000","last_clean":"2024-09-21T06:36:14.721088+0000","last_became_active":"2024-09-21T06:34:42.895477+0000","last_became_peered":"2024-09-21T06:34:42.895477+0000","last_unstale":"2024-09-21T06:36:14.721088+0000","last_undegraded":"2024-09-21T06:36:14.721088+0000","last_fullsized":"2024-09-21T06:36:14.721088+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:06:33.284523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278719+0000","last_change":"2024-09-21T06:34:42.893554+0000","last_active":"2024-09-21T06:36:14.278719+0000","last_peered":"2024-09-21T06:36:14.278719+0000","last_clean":"2024-09-21T06:36:14.278719+0000","last_became_active":"2024-09-21T06:34:42.892949+0000","last_became_peered":"2024-09-21T06:34:42.892949+0000","last_unstale":"2024-09-21T06:36:14.278719+0000","last_undegraded":"2024-09-21T06:36:14.278719+0000","last_fullsized":"2024-09-21T06:36:14.278719+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:57.107590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275055+0000","last_change":"2024-09-21T06:34:42.894574+0000","last_active":"2024-09-21T06:36:14.275055+0000","last_peered":"2024-09-21T06:36:14.275055+0000","last_clean":"2024-09-21T06:36:14.275055+0000","last_became_active":"2024-09-21T06:34:42.894027+0000","last_became_peered":"2024-09-21T06:34:42.894027+0000","last_unstale":"2024-09-21T06:36:14.275055+0000","last_undegraded":"2024-09-21T06:36:14.275055+0000","last_fullsized":"2024-09-21T06:36:14.275055+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:56:58.425792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"76'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616251+0000","last_change":"2024-09-21T06:35:13.499715+0000","last_active":"2024-09-21T06:36:14.616251+0000","last_peered":"2024-09-21T06:36:14.616251+0000","last_clean":"2024-09-21T06:36:14.616251+0000","last_became_active":"2024-09-21T06:35:13.499171+0000","last_became_peered":"2024-09-21T06:35:13.499171+0000","last_unstale":"2024-09-21T06:36:14.616251+0000","last_undegraded":"2024-09-21T06:36:14.616251+0000","last_fullsized":"2024-09-21T06:36:14.616251+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:35.666867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"76'2","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275221+0000","last_change":"2024-09-21T06:35:13.499458+0000","last_active":"2024-09-21T06:36:14.275221+0000","last_peered":"2024-09-21T06:36:14.275221+0000","last_clean":"2024-09-21T06:36:14.275221+0000","last_became_active":"2024-09-21T06:35:13.498984+0000","last_became_peered":"2024-09-21T06:35:13.498984+0000","last_unstale":"2024-09-21T06:36:14.275221+0000","last_undegraded":"2024-09-21T06:36:14.275221+0000","last_fullsized":"2024-09-21T06:36:14.275221+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:36:10.871658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"76'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.283069+0000","last_change":"2024-09-21T06:34:42.888826+0000","last_active":"2024-09-21T06:36:14.283069+0000","last_peered":"2024-09-21T06:36:14.283069+0000","last_clean":"2024-09-21T06:36:14.283069+0000","last_became_active":"2024-09-21T06:34:42.888447+0000","last_became_peered":"2024-09-21T06:34:42.888447+0000","last_unstale":"2024-09-21T06:36:14.283069+0000","last_undegraded":"2024-09-21T06:36:14.283069+0000","last_fullsized":"2024-09-21T06:36:14.283069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:52.634516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276951+0000","last_change":"2024-09-21T06:34:42.889377+0000","last_active":"2024-09-21T06:36:14.276951+0000","last_peered":"2024-09-21T06:36:14.276951+0000","last_clean":"2024-09-21T06:36:14.276951+0000","last_became_active":"2024-09-21T06:34:42.888978+0000","last_became_peered":"2024-09-21T06:34:42.888978+0000","last_unstale":"2024-09-21T06:36:14.276951+0000","last_undegraded":"2024-09-21T06:36:14.276951+0000","last_fullsized":"2024-09-21T06:36:14.276951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:00:34.734283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"76'4","reported_seq":26,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721000+0000","last_change":"2024-09-21T06:34:42.878128+0000","last_active":"2024-09-21T06:36:14.721000+0000","last_peered":"2024-09-21T06:36:14.721000+0000","last_clean":"2024-09-21T06:36:14.721000+0000","last_became_active":"2024-09-21T06:34:42.877742+0000","last_became_peered":"2024-09-21T06:34:42.877742+0000","last_unstale":"2024-09-21T06:36:14.721000+0000","last_undegraded":"2024-09-21T06:36:14.721000+0000","last_fullsized":"2024-09-21T06:36:14.721000+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:55:04.992402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286162+0000","last_change":"2024-09-21T06:34:42.882659+0000","last_active":"2024-09-21T06:36:14.286162+0000","last_peered":"2024-09-21T06:36:14.286162+0000","last_clean":"2024-09-21T06:36:14.286162+0000","last_became_active":"2024-09-21T06:34:42.882306+0000","last_became_peered":"2024-09-21T06:34:42.882306+0000","last_unstale":"2024-09-21T06:36:14.286162+0000","last_undegraded":"2024-09-21T06:36:14.286162+0000","last_fullsized":"2024-09-21T06:36:14.286162+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:07:31.560012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282347+0000","last_change":"2024-09-21T06:34:42.890089+0000","last_active":"2024-09-21T06:36:14.282347+0000","last_peered":"2024-09-21T06:36:14.282347+0000","last_clean":"2024-09-21T06:36:14.282347+0000","last_became_active":"2024-09-21T06:34:42.889739+0000","last_became_peered":"2024-09-21T06:34:42.889739+0000","last_unstale":"2024-09-21T06:36:14.282347+0000","last_undegraded":"2024-09-21T06:36:14.282347+0000","last_fullsized":"2024-09-21T06:36:14.282347+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:42:38.212760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"76'12","reported_seq":41,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.283358+0000","last_change":"2024-09-21T06:35:13.290617+0000","last_active":"2024-09-21T06:36:14.283358+0000","last_peered":"2024-09-21T06:36:14.283358+0000","last_clean":"2024-09-21T06:36:14.283358+0000","last_became_active":"2024-09-21T06:35:13.290005+0000","last_became_peered":"2024-09-21T06:35:13.290005+0000","last_unstale":"2024-09-21T06:36:14.283358+0000","last_undegraded":"2024-09-21T06:36:14.283358+0000","last_fullsized":"2024-09-21T06:36:14.283358+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:01:39.490034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276810+0000","last_change":"2024-09-21T06:34:42.893859+0000","last_active":"2024-09-21T06:36:14.276810+0000","last_peered":"2024-09-21T06:36:14.276810+0000","last_clean":"2024-09-21T06:36:14.276810+0000","last_became_active":"2024-09-21T06:34:42.893485+0000","last_became_peered":"2024-09-21T06:34:42.893485+0000","last_unstale":"2024-09-21T06:36:14.276810+0000","last_undegraded":"2024-09-21T06:36:14.276810+0000","last_fullsized":"2024-09-21T06:36:14.276810+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:59.936750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.274979+0000","last_change":"2024-09-21T06:34:42.887164+0000","last_active":"2024-09-21T06:36:14.274979+0000","last_peered":"2024-09-21T06:36:14.274979+0000","last_clean":"2024-09-21T06:36:14.274979+0000","last_became_active":"2024-09-21T06:34:42.886314+0000","last_became_peered":"2024-09-21T06:34:42.886314+0000","last_unstale":"2024-09-21T06:36:14.274979+0000","last_undegraded":"2024-09-21T06:36:14.274979+0000","last_fullsized":"2024-09-21T06:36:14.274979+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:02:09.529922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'7","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:26.115414+0000","last_change":"2024-09-21T06:34:40.883170+0000","last_active":"2024-09-21T06:36:26.115414+0000","last_peered":"2024-09-21T06:36:26.115414+0000","last_clean":"2024-09-21T06:36:26.115414+0000","last_became_active":"2024-09-21T06:34:40.882760+0000","last_became_peered":"2024-09-21T06:34:40.882760+0000","last_unstale":"2024-09-21T06:36:26.115414+0000","last_undegraded":"2024-09-21T06:36:26.115414+0000","last_fullsized":"2024-09-21T06:36:26.115414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:30:41.388275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616511+0000","last_change":"2024-09-21T06:34:42.893842+0000","last_active":"2024-09-21T06:36:14.616511+0000","last_peered":"2024-09-21T06:36:14.616511+0000","last_clean":"2024-09-21T06:36:14.616511+0000","last_became_active":"2024-09-21T06:34:42.893501+0000","last_became_peered":"2024-09-21T06:34:42.893501+0000","last_unstale":"2024-09-21T06:36:14.616511+0000","last_undegraded":"2024-09-21T06:36:14.616511+0000","last_fullsized":"2024-09-21T06:36:14.616511+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:36.610084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613413+0000","last_change":"2024-09-21T06:34:40.878685+0000","last_active":"2024-09-21T06:36:14.613413+0000","last_peered":"2024-09-21T06:36:14.613413+0000","last_clean":"2024-09-21T06:36:14.613413+0000","last_became_active":"2024-09-21T06:34:40.878279+0000","last_became_peered":"2024-09-21T06:34:40.878279+0000","last_unstale":"2024-09-21T06:36:14.613413+0000","last_undegraded":"2024-09-21T06:36:14.613413+0000","last_fullsized":"2024-09-21T06:36:14.613413+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:19:11.846938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720677+0000","last_change":"2024-09-21T06:34:40.872074+0000","last_active":"2024-09-21T06:36:14.720677+0000","last_peered":"2024-09-21T06:36:14.720677+0000","last_clean":"2024-09-21T06:36:14.720677+0000","last_became_active":"2024-09-21T06:34:40.871637+0000","last_became_peered":"2024-09-21T06:34:40.871637+0000","last_unstale":"2024-09-21T06:36:14.720677+0000","last_undegraded":"2024-09-21T06:36:14.720677+0000","last_fullsized":"2024-09-21T06:36:14.720677+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:55:03.216707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275067+0000","last_change":"2024-09-21T06:34:42.882803+0000","last_active":"2024-09-21T06:36:14.275067+0000","last_peered":"2024-09-21T06:36:14.275067+0000","last_clean":"2024-09-21T06:36:14.275067+0000","last_became_active":"2024-09-21T06:34:42.881509+0000","last_became_peered":"2024-09-21T06:34:42.881509+0000","last_unstale":"2024-09-21T06:36:14.275067+0000","last_undegraded":"2024-09-21T06:36:14.275067+0000","last_fullsized":"2024-09-21T06:36:14.275067+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:50:09.688149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"74'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616519+0000","last_change":"2024-09-21T06:34:40.883054+0000","last_active":"2024-09-21T06:36:14.616519+0000","last_peered":"2024-09-21T06:36:14.616519+0000","last_clean":"2024-09-21T06:36:14.616519+0000","last_became_active":"2024-09-21T06:34:40.882299+0000","last_became_peered":"2024-09-21T06:34:40.882299+0000","last_unstale":"2024-09-21T06:36:14.616519+0000","last_undegraded":"2024-09-21T06:36:14.616519+0000","last_fullsized":"2024-09-21T06:36:14.616519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:52:17.813744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"76'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272581+0000","last_change":"2024-09-21T06:34:42.886437+0000","last_active":"2024-09-21T06:36:14.272581+0000","last_peered":"2024-09-21T06:36:14.272581+0000","last_clean":"2024-09-21T06:36:14.272581+0000","last_became_active":"2024-09-21T06:34:42.886075+0000","last_became_peered":"2024-09-21T06:34:42.886075+0000","last_unstale":"2024-09-21T06:36:14.272581+0000","last_undegraded":"2024-09-21T06:36:14.272581+0000","last_fullsized":"2024-09-21T06:36:14.272581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.179323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:25.113267+0000","last_change":"2024-09-21T06:34:40.880931+0000","last_active":"2024-09-21T06:36:25.113267+0000","last_peered":"2024-09-21T06:36:25.113267+0000","last_clean":"2024-09-21T06:36:25.113267+0000","last_became_active":"2024-09-21T06:34:40.880555+0000","last_became_peered":"2024-09-21T06:34:40.880555+0000","last_unstale":"2024-09-21T06:36:25.113267+0000","last_undegraded":"2024-09-21T06:36:25.113267+0000","last_fullsized":"2024-09-21T06:36:25.113267+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:32:29.304297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":94,"num_read_kb":94,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"76'10","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278477+0000","last_change":"2024-09-21T06:34:42.899618+0000","last_active":"2024-09-21T06:36:14.278477+0000","last_peered":"2024-09-21T06:36:14.278477+0000","last_clean":"2024-09-21T06:36:14.278477+0000","last_became_active":"2024-09-21T06:34:42.899230+0000","last_became_peered":"2024-09-21T06:34:42.899230+0000","last_unstale":"2024-09-21T06:36:14.278477+0000","last_undegraded":"2024-09-21T06:36:14.278477+0000","last_fullsized":"2024-09-21T06:36:14.278477+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:10:27.296197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721020+0000","last_change":"2024-09-21T06:34:40.882988+0000","last_active":"2024-09-21T06:36:14.721020+0000","last_peered":"2024-09-21T06:36:14.721020+0000","last_clean":"2024-09-21T06:36:14.721020+0000","last_became_active":"2024-09-21T06:34:40.882533+0000","last_became_peered":"2024-09-21T06:34:40.882533+0000","last_unstale":"2024-09-21T06:36:14.721020+0000","last_undegraded":"2024-09-21T06:36:14.721020+0000","last_fullsized":"2024-09-21T06:36:14.721020+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:21:23.220540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286367+0000","last_change":"2024-09-21T06:34:42.889556+0000","last_active":"2024-09-21T06:36:14.286367+0000","last_peered":"2024-09-21T06:36:14.286367+0000","last_clean":"2024-09-21T06:36:14.286367+0000","last_became_active":"2024-09-21T06:34:42.888853+0000","last_became_peered":"2024-09-21T06:34:42.888853+0000","last_unstale":"2024-09-21T06:36:14.286367+0000","last_undegraded":"2024-09-21T06:36:14.286367+0000","last_fullsized":"2024-09-21T06:36:14.286367+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:13:24.908618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"74'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616668+0000","last_change":"2024-09-21T06:34:40.891450+0000","last_active":"2024-09-21T06:36:14.616668+0000","last_peered":"2024-09-21T06:36:14.616668+0000","last_clean":"2024-09-21T06:36:14.616668+0000","last_became_active":"2024-09-21T06:34:40.890892+0000","last_became_peered":"2024-09-21T06:34:40.890892+0000","last_unstale":"2024-09-21T06:36:14.616668+0000","last_undegraded":"2024-09-21T06:36:14.616668+0000","last_fullsized":"2024-09-21T06:36:14.616668+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:49.975342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"76'11","reported_seq":33,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.279539+0000","last_change":"2024-09-21T06:34:42.893122+0000","last_active":"2024-09-21T06:36:14.279539+0000","last_peered":"2024-09-21T06:36:14.279539+0000","last_clean":"2024-09-21T06:36:14.279539+0000","last_became_active":"2024-09-21T06:34:42.892730+0000","last_became_peered":"2024-09-21T06:34:42.892730+0000","last_unstale":"2024-09-21T06:36:14.279539+0000","last_undegraded":"2024-09-21T06:36:14.279539+0000","last_fullsized":"2024-09-21T06:36:14.279539+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:01:06.822547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'31","reported_seq":272,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:25.635741+0000","last_change":"2024-09-21T06:35:13.509359+0000","last_active":"2024-09-21T06:36:25.635741+0000","last_peered":"2024-09-21T06:36:25.635741+0000","last_clean":"2024-09-21T06:36:25.635741+0000","last_became_active":"2024-09-21T06:35:13.499621+0000","last_became_peered":"2024-09-21T06:35:13.499621+0000","last_unstale":"2024-09-21T06:36:25.635741+0000","last_undegraded":"2024-09-21T06:36:25.635741+0000","last_fullsized":"2024-09-21T06:36:25.635741+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:04:52.396964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66139,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":186,"num_read_kb":149,"num_write":32,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":64752,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275256+0000","last_change":"2024-09-21T06:34:42.890487+0000","last_active":"2024-09-21T06:36:14.275256+0000","last_peered":"2024-09-21T06:36:14.275256+0000","last_clean":"2024-09-21T06:36:14.275256+0000","last_became_active":"2024-09-21T06:34:42.890100+0000","last_became_peered":"2024-09-21T06:34:42.890100+0000","last_unstale":"2024-09-21T06:36:14.275256+0000","last_undegraded":"2024-09-21T06:36:14.275256+0000","last_fullsized":"2024-09-21T06:36:14.275256+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:45:59.206869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"74'6","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282371+0000","last_change":"2024-09-21T06:34:40.876187+0000","last_active":"2024-09-21T06:36:14.282371+0000","last_peered":"2024-09-21T06:36:14.282371+0000","last_clean":"2024-09-21T06:36:14.282371+0000","last_became_active":"2024-09-21T06:34:40.875687+0000","last_became_peered":"2024-09-21T06:34:40.875687+0000","last_unstale":"2024-09-21T06:36:14.282371+0000","last_undegraded":"2024-09-21T06:36:14.282371+0000","last_fullsized":"2024-09-21T06:36:14.282371+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:03:51.758625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720726+0000","last_change":"2024-09-21T06:34:42.895900+0000","last_active":"2024-09-21T06:36:14.720726+0000","last_peered":"2024-09-21T06:36:14.720726+0000","last_clean":"2024-09-21T06:36:14.720726+0000","last_became_active":"2024-09-21T06:34:42.895504+0000","last_became_peered":"2024-09-21T06:34:42.895504+0000","last_unstale":"2024-09-21T06:36:14.720726+0000","last_undegraded":"2024-09-21T06:36:14.720726+0000","last_fullsized":"2024-09-21T06:36:14.720726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:48:28.414017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616473+0000","last_change":"2024-09-21T06:34:40.882856+0000","last_active":"2024-09-21T06:36:14.616473+0000","last_peered":"2024-09-21T06:36:14.616473+0000","last_clean":"2024-09-21T06:36:14.616473+0000","last_became_active":"2024-09-21T06:34:40.882424+0000","last_became_peered":"2024-09-21T06:34:40.882424+0000","last_unstale":"2024-09-21T06:36:14.616473+0000","last_undegraded":"2024-09-21T06:36:14.616473+0000","last_fullsized":"2024-09-21T06:36:14.616473+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:38.815928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"76'15","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721217+0000","last_change":"2024-09-21T06:34:42.890611+0000","last_active":"2024-09-21T06:36:14.721217+0000","last_peered":"2024-09-21T06:36:14.721217+0000","last_clean":"2024-09-21T06:36:14.721217+0000","last_became_active":"2024-09-21T06:34:42.890246+0000","last_became_peered":"2024-09-21T06:34:42.890246+0000","last_unstale":"2024-09-21T06:36:14.721217+0000","last_undegraded":"2024-09-21T06:36:14.721217+0000","last_fullsized":"2024-09-21T06:36:14.721217+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:05.074903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"74'3","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:25.113429+0000","last_change":"2024-09-21T06:34:40.877003+0000","last_active":"2024-09-21T06:36:25.113429+0000","last_peered":"2024-09-21T06:36:25.113429+0000","last_clean":"2024-09-21T06:36:25.113429+0000","last_became_active":"2024-09-21T06:34:40.876516+0000","last_became_peered":"2024-09-21T06:34:40.876516+0000","last_unstale":"2024-09-21T06:36:25.113429+0000","last_undegraded":"2024-09-21T06:36:25.113429+0000","last_fullsized":"2024-09-21T06:36:25.113429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:14.499270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":97,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720667+0000","last_change":"2024-09-21T06:34:42.896816+0000","last_active":"2024-09-21T06:36:14.720667+0000","last_peered":"2024-09-21T06:36:14.720667+0000","last_clean":"2024-09-21T06:36:14.720667+0000","last_became_active":"2024-09-21T06:34:42.896329+0000","last_became_peered":"2024-09-21T06:34:42.896329+0000","last_unstale":"2024-09-21T06:36:14.720667+0000","last_undegraded":"2024-09-21T06:36:14.720667+0000","last_fullsized":"2024-09-21T06:36:14.720667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:40.462498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"74'15","reported_seq":43,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.274831+0000","last_change":"2024-09-21T06:34:40.892809+0000","last_active":"2024-09-21T06:36:14.274831+0000","last_peered":"2024-09-21T06:36:14.274831+0000","last_clean":"2024-09-21T06:36:14.274831+0000","last_became_active":"2024-09-21T06:34:40.892433+0000","last_became_peered":"2024-09-21T06:34:40.892433+0000","last_unstale":"2024-09-21T06:36:14.274831+0000","last_undegraded":"2024-09-21T06:36:14.274831+0000","last_fullsized":"2024-09-21T06:36:14.274831+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:01:43.744202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"76'6","reported_seq":35,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616525+0000","last_change":"2024-09-21T06:35:13.500503+0000","last_active":"2024-09-21T06:36:14.616525+0000","last_peered":"2024-09-21T06:36:14.616525+0000","last_clean":"2024-09-21T06:36:14.616525+0000","last_became_active":"2024-09-21T06:35:13.499704+0000","last_became_peered":"2024-09-21T06:35:13.499704+0000","last_unstale":"2024-09-21T06:36:14.616525+0000","last_undegraded":"2024-09-21T06:36:14.616525+0000","last_fullsized":"2024-09-21T06:36:14.616525+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:45.469909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"74'2","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275256+0000","last_change":"2024-09-21T06:34:40.876791+0000","last_active":"2024-09-21T06:36:14.275256+0000","last_peered":"2024-09-21T06:36:14.275256+0000","last_clean":"2024-09-21T06:36:14.275256+0000","last_became_active":"2024-09-21T06:34:40.876323+0000","last_became_peered":"2024-09-21T06:34:40.876323+0000","last_unstale":"2024-09-21T06:36:14.275256+0000","last_undegraded":"2024-09-21T06:36:14.275256+0000","last_fullsized":"2024-09-21T06:36:14.275256+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:28:20.685881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"76'5","reported_seq":34,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276272+0000","last_change":"2024-09-21T06:35:13.499258+0000","last_active":"2024-09-21T06:36:14.276272+0000","last_peered":"2024-09-21T06:36:14.276272+0000","last_clean":"2024-09-21T06:36:14.276272+0000","last_became_active":"2024-09-21T06:35:13.498747+0000","last_became_peered":"2024-09-21T06:35:13.498747+0000","last_unstale":"2024-09-21T06:36:14.276272+0000","last_undegraded":"2024-09-21T06:36:14.276272+0000","last_fullsized":"2024-09-21T06:36:14.276272+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:23.977754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721058+0000","last_change":"2024-09-21T06:34:40.877644+0000","last_active":"2024-09-21T06:36:14.721058+0000","last_peered":"2024-09-21T06:36:14.721058+0000","last_clean":"2024-09-21T06:36:14.721058+0000","last_became_active":"2024-09-21T06:34:40.877238+0000","last_became_peered":"2024-09-21T06:34:40.877238+0000","last_unstale":"2024-09-21T06:36:14.721058+0000","last_undegraded":"2024-09-21T06:36:14.721058+0000","last_fullsized":"2024-09-21T06:36:14.721058+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:22:21.055801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721125+0000","last_change":"2024-09-21T06:34:42.892399+0000","last_active":"2024-09-21T06:36:14.721125+0000","last_peered":"2024-09-21T06:36:14.721125+0000","last_clean":"2024-09-21T06:36:14.721125+0000","last_became_active":"2024-09-21T06:34:42.891873+0000","last_became_peered":"2024-09-21T06:34:42.891873+0000","last_unstale":"2024-09-21T06:36:14.721125+0000","last_undegraded":"2024-09-21T06:36:14.721125+0000","last_fullsized":"2024-09-21T06:36:14.721125+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:46:09.684516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"74'1","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616752+0000","last_change":"2024-09-21T06:34:40.881603+0000","last_active":"2024-09-21T06:36:14.616752+0000","last_peered":"2024-09-21T06:36:14.616752+0000","last_clean":"2024-09-21T06:36:14.616752+0000","last_became_active":"2024-09-21T06:34:40.881226+0000","last_became_peered":"2024-09-21T06:34:40.881226+0000","last_unstale":"2024-09-21T06:36:14.616752+0000","last_undegraded":"2024-09-21T06:36:14.616752+0000","last_fullsized":"2024-09-21T06:36:14.616752+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:12:09.252102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720922+0000","last_change":"2024-09-21T06:34:42.897354+0000","last_active":"2024-09-21T06:36:14.720922+0000","last_peered":"2024-09-21T06:36:14.720922+0000","last_clean":"2024-09-21T06:36:14.720922+0000","last_became_active":"2024-09-21T06:34:42.896981+0000","last_became_peered":"2024-09-21T06:34:42.896981+0000","last_unstale":"2024-09-21T06:36:14.720922+0000","last_undegraded":"2024-09-21T06:36:14.720922+0000","last_fullsized":"2024-09-21T06:36:14.720922+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:21:07.598107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"74'3","reported_seq":18,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.294697+0000","last_change":"2024-09-21T06:36:14.294203+0000","last_active":"2024-09-21T06:36:14.294697+0000","last_peered":"2024-09-21T06:36:14.294697+0000","last_clean":"2024-09-21T06:36:14.294697+0000","last_became_active":"2024-09-21T06:36:14.287271+0000","last_became_peered":"2024-09-21T06:36:14.287271+0000","last_unstale":"2024-09-21T06:36:14.294697+0000","last_undegraded":"2024-09-21T06:36:14.294697+0000","last_fullsized":"2024-09-21T06:36:14.294697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:01:58.586517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":582,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721179+0000","last_change":"2024-09-21T06:34:42.894825+0000","last_active":"2024-09-21T06:36:14.721179+0000","last_peered":"2024-09-21T06:36:14.721179+0000","last_clean":"2024-09-21T06:36:14.721179+0000","last_became_active":"2024-09-21T06:34:42.893347+0000","last_became_peered":"2024-09-21T06:34:42.893347+0000","last_unstale":"2024-09-21T06:36:14.721179+0000","last_undegraded":"2024-09-21T06:36:14.721179+0000","last_fullsized":"2024-09-21T06:36:14.721179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:33:14.946035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721061+0000","last_change":"2024-09-21T06:33:33.165773+0000","last_active":"2024-09-21T06:36:14.721061+0000","last_peered":"2024-09-21T06:36:14.721061+0000","last_clean":"2024-09-21T06:36:14.721061+0000","last_became_active":"2024-09-21T06:33:33.159754+0000","last_became_peered":"2024-09-21T06:33:33.159754+0000","last_unstale":"2024-09-21T06:36:14.721061+0000","last_undegraded":"2024-09-21T06:36:14.721061+0000","last_fullsized":"2024-09-21T06:36:14.721061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:30:10.865158+0000","last_clean_scrub_stamp":"2024-09-21T06:30:10.865158+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:32:15.953330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"74'3","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275384+0000","last_change":"2024-09-21T06:34:40.876091+0000","last_active":"2024-09-21T06:36:14.275384+0000","last_peered":"2024-09-21T06:36:14.275384+0000","last_clean":"2024-09-21T06:36:14.275384+0000","last_became_active":"2024-09-21T06:34:40.875576+0000","last_became_peered":"2024-09-21T06:34:40.875576+0000","last_unstale":"2024-09-21T06:36:14.275384+0000","last_undegraded":"2024-09-21T06:36:14.275384+0000","last_fullsized":"2024-09-21T06:36:14.275384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:47:34.392145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275736+0000","last_change":"2024-09-21T06:34:42.892283+0000","last_active":"2024-09-21T06:36:14.275736+0000","last_peered":"2024-09-21T06:36:14.275736+0000","last_clean":"2024-09-21T06:36:14.275736+0000","last_became_active":"2024-09-21T06:34:42.891839+0000","last_became_peered":"2024-09-21T06:34:42.891839+0000","last_unstale":"2024-09-21T06:36:14.275736+0000","last_undegraded":"2024-09-21T06:36:14.275736+0000","last_fullsized":"2024-09-21T06:36:14.275736+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:10.202352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720907+0000","last_change":"2024-09-21T06:34:40.880967+0000","last_active":"2024-09-21T06:36:14.720907+0000","last_peered":"2024-09-21T06:36:14.720907+0000","last_clean":"2024-09-21T06:36:14.720907+0000","last_became_active":"2024-09-21T06:34:40.880351+0000","last_became_peered":"2024-09-21T06:34:40.880351+0000","last_unstale":"2024-09-21T06:36:14.720907+0000","last_undegraded":"2024-09-21T06:36:14.720907+0000","last_fullsized":"2024-09-21T06:36:14.720907+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:52.694732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720675+0000","last_change":"2024-09-21T06:34:42.876102+0000","last_active":"2024-09-21T06:36:14.720675+0000","last_peered":"2024-09-21T06:36:14.720675+0000","last_clean":"2024-09-21T06:36:14.720675+0000","last_became_active":"2024-09-21T06:34:42.875065+0000","last_became_peered":"2024-09-21T06:34:42.875065+0000","last_unstale":"2024-09-21T06:36:14.720675+0000","last_undegraded":"2024-09-21T06:36:14.720675+0000","last_fullsized":"2024-09-21T06:36:14.720675+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:04:23.867180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"74'4","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:26.114289+0000","last_change":"2024-09-21T06:34:40.890355+0000","last_active":"2024-09-21T06:36:26.114289+0000","last_peered":"2024-09-21T06:36:26.114289+0000","last_clean":"2024-09-21T06:36:26.114289+0000","last_became_active":"2024-09-21T06:34:40.889974+0000","last_became_peered":"2024-09-21T06:34:40.889974+0000","last_unstale":"2024-09-21T06:36:26.114289+0000","last_undegraded":"2024-09-21T06:36:26.114289+0000","last_fullsized":"2024-09-21T06:36:26.114289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:58.349625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616293+0000","last_change":"2024-09-21T06:34:42.899831+0000","last_active":"2024-09-21T06:36:14.616293+0000","last_peered":"2024-09-21T06:36:14.616293+0000","last_clean":"2024-09-21T06:36:14.616293+0000","last_became_active":"2024-09-21T06:34:42.899372+0000","last_became_peered":"2024-09-21T06:34:42.899372+0000","last_unstale":"2024-09-21T06:36:14.616293+0000","last_undegraded":"2024-09-21T06:36:14.616293+0000","last_fullsized":"2024-09-21T06:36:14.616293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:38:50.165222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"74'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721265+0000","last_change":"2024-09-21T06:34:40.882380+0000","last_active":"2024-09-21T06:36:14.721265+0000","last_peered":"2024-09-21T06:36:14.721265+0000","last_clean":"2024-09-21T06:36:14.721265+0000","last_became_active":"2024-09-21T06:34:40.881463+0000","last_became_peered":"2024-09-21T06:34:40.881463+0000","last_unstale":"2024-09-21T06:36:14.721265+0000","last_undegraded":"2024-09-21T06:36:14.721265+0000","last_fullsized":"2024-09-21T06:36:14.721265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:25:25.620174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613626+0000","last_change":"2024-09-21T06:34:42.897205+0000","last_active":"2024-09-21T06:36:14.613626+0000","last_peered":"2024-09-21T06:36:14.613626+0000","last_clean":"2024-09-21T06:36:14.613626+0000","last_became_active":"2024-09-21T06:34:42.896705+0000","last_became_peered":"2024-09-21T06:34:42.896705+0000","last_unstale":"2024-09-21T06:36:14.613626+0000","last_undegraded":"2024-09-21T06:36:14.613626+0000","last_fullsized":"2024-09-21T06:36:14.613626+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.333176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272745+0000","last_change":"2024-09-21T06:34:40.890356+0000","last_active":"2024-09-21T06:36:14.272745+0000","last_peered":"2024-09-21T06:36:14.272745+0000","last_clean":"2024-09-21T06:36:14.272745+0000","last_became_active":"2024-09-21T06:34:40.889963+0000","last_became_peered":"2024-09-21T06:34:40.889963+0000","last_unstale":"2024-09-21T06:36:14.272745+0000","last_undegraded":"2024-09-21T06:36:14.272745+0000","last_fullsized":"2024-09-21T06:36:14.272745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:09:09.621779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.613505+0000","last_change":"2024-09-21T06:34:42.884933+0000","last_active":"2024-09-21T06:36:14.613505+0000","last_peered":"2024-09-21T06:36:14.613505+0000","last_clean":"2024-09-21T06:36:14.613505+0000","last_became_active":"2024-09-21T06:34:42.884506+0000","last_became_peered":"2024-09-21T06:34:42.884506+0000","last_unstale":"2024-09-21T06:36:14.613505+0000","last_undegraded":"2024-09-21T06:36:14.613505+0000","last_fullsized":"2024-09-21T06:36:14.613505+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:29:14.741786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"74'1","reported_seq":16,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.290755+0000","last_change":"2024-09-21T06:36:14.290260+0000","last_active":"2024-09-21T06:36:14.290755+0000","last_peered":"2024-09-21T06:36:14.290755+0000","last_clean":"2024-09-21T06:36:14.290755+0000","last_became_active":"2024-09-21T06:36:14.287215+0000","last_became_peered":"2024-09-21T06:36:14.287215+0000","last_unstale":"2024-09-21T06:36:14.290755+0000","last_undegraded":"2024-09-21T06:36:14.290755+0000","last_fullsized":"2024-09-21T06:36:14.290755+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:43:31.344496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.721065+0000","last_change":"2024-09-21T06:34:42.880047+0000","last_active":"2024-09-21T06:36:14.721065+0000","last_peered":"2024-09-21T06:36:14.721065+0000","last_clean":"2024-09-21T06:36:14.721065+0000","last_became_active":"2024-09-21T06:34:42.879664+0000","last_became_peered":"2024-09-21T06:34:42.879664+0000","last_unstale":"2024-09-21T06:36:14.721065+0000","last_undegraded":"2024-09-21T06:36:14.721065+0000","last_fullsized":"2024-09-21T06:36:14.721065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:30:03.621493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"78'12","reported_seq":52,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.289520+0000","last_change":"2024-09-21T06:36:14.289110+0000","last_active":"2024-09-21T06:36:14.289520+0000","last_peered":"2024-09-21T06:36:14.289520+0000","last_clean":"2024-09-21T06:36:14.289520+0000","last_became_active":"2024-09-21T06:36:14.279222+0000","last_became_peered":"2024-09-21T06:36:14.279222+0000","last_unstale":"2024-09-21T06:36:14.289520+0000","last_undegraded":"2024-09-21T06:36:14.289520+0000","last_fullsized":"2024-09-21T06:36:14.289520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:29:40.738475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"76'5","reported_seq":21,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.272942+0000","last_change":"2024-09-21T06:35:13.289318+0000","last_active":"2024-09-21T06:36:14.272942+0000","last_peered":"2024-09-21T06:36:14.272942+0000","last_clean":"2024-09-21T06:36:14.272942+0000","last_became_active":"2024-09-21T06:35:13.288961+0000","last_became_peered":"2024-09-21T06:35:13.288961+0000","last_unstale":"2024-09-21T06:36:14.272942+0000","last_undegraded":"2024-09-21T06:36:14.272942+0000","last_fullsized":"2024-09-21T06:36:14.272942+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:55:05.659772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,7],"acting":[9,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.7","version":"74'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275622+0000","last_change":"2024-09-21T06:34:40.869754+0000","last_active":"2024-09-21T06:36:14.275622+0000","last_peered":"2024-09-21T06:36:14.275622+0000","last_clean":"2024-09-21T06:36:14.275622+0000","last_became_active":"2024-09-21T06:34:40.869311+0000","last_became_peered":"2024-09-21T06:34:40.869311+0000","last_unstale":"2024-09-21T06:36:14.275622+0000","last_undegraded":"2024-09-21T06:36:14.275622+0000","last_fullsized":"2024-09-21T06:36:14.275622+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:10.959880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"76'7","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286081+0000","last_change":"2024-09-21T06:34:42.889198+0000","last_active":"2024-09-21T06:36:14.286081+0000","last_peered":"2024-09-21T06:36:14.286081+0000","last_clean":"2024-09-21T06:36:14.286081+0000","last_became_active":"2024-09-21T06:34:42.888813+0000","last_became_peered":"2024-09-21T06:34:42.888813+0000","last_unstale":"2024-09-21T06:36:14.286081+0000","last_undegraded":"2024-09-21T06:36:14.286081+0000","last_fullsized":"2024-09-21T06:36:14.286081+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:49:25.270225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.278356+0000","last_change":"2024-09-21T06:34:40.892267+0000","last_active":"2024-09-21T06:36:14.278356+0000","last_peered":"2024-09-21T06:36:14.278356+0000","last_clean":"2024-09-21T06:36:14.278356+0000","last_became_active":"2024-09-21T06:34:40.891791+0000","last_became_peered":"2024-09-21T06:34:40.891791+0000","last_unstale":"2024-09-21T06:36:14.278356+0000","last_undegraded":"2024-09-21T06:36:14.278356+0000","last_fullsized":"2024-09-21T06:36:14.278356+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:07.864647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"76'2","reported_seq":24,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275359+0000","last_change":"2024-09-21T06:34:42.894361+0000","last_active":"2024-09-21T06:36:14.275359+0000","last_peered":"2024-09-21T06:36:14.275359+0000","last_clean":"2024-09-21T06:36:14.275359+0000","last_became_active":"2024-09-21T06:34:42.893976+0000","last_became_peered":"2024-09-21T06:34:42.893976+0000","last_unstale":"2024-09-21T06:36:14.275359+0000","last_undegraded":"2024-09-21T06:36:14.275359+0000","last_fullsized":"2024-09-21T06:36:14.275359+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:12:32.741495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"74'3","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275262+0000","last_change":"2024-09-21T06:34:40.875952+0000","last_active":"2024-09-21T06:36:14.275262+0000","last_peered":"2024-09-21T06:36:14.275262+0000","last_clean":"2024-09-21T06:36:14.275262+0000","last_became_active":"2024-09-21T06:34:40.875598+0000","last_became_peered":"2024-09-21T06:34:40.875598+0000","last_unstale":"2024-09-21T06:36:14.275262+0000","last_undegraded":"2024-09-21T06:36:14.275262+0000","last_fullsized":"2024-09-21T06:36:14.275262+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:30:29.873037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276436+0000","last_change":"2024-09-21T06:34:42.887639+0000","last_active":"2024-09-21T06:36:14.276436+0000","last_peered":"2024-09-21T06:36:14.276436+0000","last_clean":"2024-09-21T06:36:14.276436+0000","last_became_active":"2024-09-21T06:34:42.887201+0000","last_became_peered":"2024-09-21T06:34:42.887201+0000","last_unstale":"2024-09-21T06:36:14.276436+0000","last_undegraded":"2024-09-21T06:36:14.276436+0000","last_fullsized":"2024-09-21T06:36:14.276436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:03:59.431007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"74'1","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.282456+0000","last_change":"2024-09-21T06:34:40.880145+0000","last_active":"2024-09-21T06:36:14.282456+0000","last_peered":"2024-09-21T06:36:14.282456+0000","last_clean":"2024-09-21T06:36:14.282456+0000","last_became_active":"2024-09-21T06:34:40.879480+0000","last_became_peered":"2024-09-21T06:34:40.879480+0000","last_unstale":"2024-09-21T06:36:14.282456+0000","last_undegraded":"2024-09-21T06:36:14.282456+0000","last_fullsized":"2024-09-21T06:36:14.282456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:58:05.551228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"76'8","reported_seq":30,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.276161+0000","last_change":"2024-09-21T06:34:42.882455+0000","last_active":"2024-09-21T06:36:14.276161+0000","last_peered":"2024-09-21T06:36:14.276161+0000","last_clean":"2024-09-21T06:36:14.276161+0000","last_became_active":"2024-09-21T06:34:42.880714+0000","last_became_peered":"2024-09-21T06:34:42.880714+0000","last_unstale":"2024-09-21T06:36:14.276161+0000","last_undegraded":"2024-09-21T06:36:14.276161+0000","last_fullsized":"2024-09-21T06:36:14.276161+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:11:39.264152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"74'4","reported_seq":32,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275389+0000","last_change":"2024-09-21T06:34:40.879560+0000","last_active":"2024-09-21T06:36:14.275389+0000","last_peered":"2024-09-21T06:36:14.275389+0000","last_clean":"2024-09-21T06:36:14.275389+0000","last_became_active":"2024-09-21T06:34:40.878433+0000","last_became_peered":"2024-09-21T06:34:40.878433+0000","last_unstale":"2024-09-21T06:36:14.275389+0000","last_undegraded":"2024-09-21T06:36:14.275389+0000","last_fullsized":"2024-09-21T06:36:14.275389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:37:07.548099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.720928+0000","last_change":"2024-09-21T06:34:42.896193+0000","last_active":"2024-09-21T06:36:14.720928+0000","last_peered":"2024-09-21T06:36:14.720928+0000","last_clean":"2024-09-21T06:36:14.720928+0000","last_became_active":"2024-09-21T06:34:42.895753+0000","last_became_peered":"2024-09-21T06:34:42.895753+0000","last_unstale":"2024-09-21T06:36:14.720928+0000","last_undegraded":"2024-09-21T06:36:14.720928+0000","last_fullsized":"2024-09-21T06:36:14.720928+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:47.982644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"76'15","reported_seq":44,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.616659+0000","last_change":"2024-09-21T06:35:13.290402+0000","last_active":"2024-09-21T06:36:14.616659+0000","last_peered":"2024-09-21T06:36:14.616659+0000","last_clean":"2024-09-21T06:36:14.616659+0000","last_became_active":"2024-09-21T06:35:13.289718+0000","last_became_peered":"2024-09-21T06:35:13.289718+0000","last_unstale":"2024-09-21T06:36:14.616659+0000","last_undegraded":"2024-09-21T06:36:14.616659+0000","last_fullsized":"2024-09-21T06:36:14.616659+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:11:06.684007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275203+0000","last_change":"2024-09-21T06:34:40.879386+0000","last_active":"2024-09-21T06:36:14.275203+0000","last_peered":"2024-09-21T06:36:14.275203+0000","last_clean":"2024-09-21T06:36:14.275203+0000","last_became_active":"2024-09-21T06:34:40.879001+0000","last_became_peered":"2024-09-21T06:34:40.879001+0000","last_unstale":"2024-09-21T06:36:14.275203+0000","last_undegraded":"2024-09-21T06:36:14.275203+0000","last_fullsized":"2024-09-21T06:36:14.275203+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:51:48.438361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"76'9","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.279411+0000","last_change":"2024-09-21T06:34:42.901595+0000","last_active":"2024-09-21T06:36:14.279411+0000","last_peered":"2024-09-21T06:36:14.279411+0000","last_clean":"2024-09-21T06:36:14.279411+0000","last_became_active":"2024-09-21T06:34:42.901200+0000","last_became_peered":"2024-09-21T06:34:42.901200+0000","last_unstale":"2024-09-21T06:36:14.279411+0000","last_undegraded":"2024-09-21T06:36:14.279411+0000","last_fullsized":"2024-09-21T06:36:14.279411+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:30:12.044528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"74'4","reported_seq":31,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275360+0000","last_change":"2024-09-21T06:34:40.878959+0000","last_active":"2024-09-21T06:36:14.275360+0000","last_peered":"2024-09-21T06:36:14.275360+0000","last_clean":"2024-09-21T06:36:14.275360+0000","last_became_active":"2024-09-21T06:34:40.878343+0000","last_became_peered":"2024-09-21T06:34:40.878343+0000","last_unstale":"2024-09-21T06:36:14.275360+0000","last_undegraded":"2024-09-21T06:36:14.275360+0000","last_fullsized":"2024-09-21T06:36:14.275360+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:24:54.589802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":28,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.286293+0000","last_change":"2024-09-21T06:34:42.887868+0000","last_active":"2024-09-21T06:36:14.286293+0000","last_peered":"2024-09-21T06:36:14.286293+0000","last_clean":"2024-09-21T06:36:14.286293+0000","last_became_active":"2024-09-21T06:34:42.887268+0000","last_became_peered":"2024-09-21T06:34:42.887268+0000","last_unstale":"2024-09-21T06:36:14.286293+0000","last_undegraded":"2024-09-21T06:36:14.286293+0000","last_fullsized":"2024-09-21T06:36:14.286293+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:22:41.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"74'2","reported_seq":29,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275566+0000","last_change":"2024-09-21T06:34:40.890363+0000","last_active":"2024-09-21T06:36:14.275566+0000","last_peered":"2024-09-21T06:36:14.275566+0000","last_clean":"2024-09-21T06:36:14.275566+0000","last_became_active":"2024-09-21T06:34:40.889967+0000","last_became_peered":"2024-09-21T06:34:40.889967+0000","last_unstale":"2024-09-21T06:36:14.275566+0000","last_undegraded":"2024-09-21T06:36:14.275566+0000","last_fullsized":"2024-09-21T06:36:14.275566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:51:01.806399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"76'5","reported_seq":27,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.275350+0000","last_change":"2024-09-21T06:34:42.891211+0000","last_active":"2024-09-21T06:36:14.275350+0000","last_peered":"2024-09-21T06:36:14.275350+0000","last_clean":"2024-09-21T06:36:14.275350+0000","last_became_active":"2024-09-21T06:34:42.890813+0000","last_became_peered":"2024-09-21T06:34:42.890813+0000","last_unstale":"2024-09-21T06:36:14.275350+0000","last_undegraded":"2024-09-21T06:36:14.275350+0000","last_fullsized":"2024-09-21T06:36:14.275350+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:41.863969+0000","last_clean_scrub_stamp":"2024-09-21T06:34:41.863969+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:23:47.361193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"74'9","reported_seq":37,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-21T06:36:14.273073+0000","last_change":"2024-09-21T06:34:40.878074+0000","last_active":"2024-09-21T06:36:14.273073+0000","last_peered":"2024-09-21T06:36:14.273073+0000","last_clean":"2024-09-21T06:36:14.273073+0000","last_became_active":"2024-09-21T06:34:40.877688+0000","last_became_peered":"2024-09-21T06:34:40.877688+0000","last_unstale":"2024-09-21T06:36:14.273073+0000","last_undegraded":"2024-09-21T06:36:14.273073+0000","last_fullsized":"2024-09-21T06:36:14.273073+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:39.851135+0000","last_clean_scrub_stamp":"2024-09-21T06:34:39.851135+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:33:01.358481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70281,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":582,"num_read_kb":356,"num_write":170,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":65356,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":211151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776162,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":426988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939686,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28556,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716596,"statfs":{"total":95995035648,"available":95965794304,"internally_reserved":0,"allocated":1564672,"data_stored":1084586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070508,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36212,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708940,"statfs":{"total":95995035648,"available":95957954560,"internally_reserved":0,"allocated":880640,"data_stored":427202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266736,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36208,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708944,"statfs":{"total":95995035648,"available":95957958656,"internally_reserved":0,"allocated":876544,"data_stored":427100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32628,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712524,"statfs":{"total":95995035648,"available":95961624576,"internally_reserved":0,"allocated":1474560,"data_stored":1019193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":868352,"data_stored":426591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28484,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716668,"statfs":{"total":95995035648,"available":95965868032,"internally_reserved":0,"allocated":1486848,"data_stored":1018877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986245,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":946176,"data_stored":493167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":884736,"data_stored":426902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378703,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":880640,"data_stored":427684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":937984,"data_stored":493105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705753,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":888832,"data_stored":427862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":66721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":67091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":67717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:36:31.621 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:36:31.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:31 smithi098 ceph-mon[34704]: pgmap v315: 97 pgs: 97 active+clean; 645 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:36:31.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:31 smithi098 ceph-mon[34704]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:31.915 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.419+0000 7fd68037c640 1 -- 172.21.15.49:0/699296335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6781083b0 msgr2=0x7fd6781087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.419+0000 7fd68037c640 1 --2- 172.21.15.49:0/699296335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6781083b0 0x7fd6781087c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd668009900 tx=0x7fd66802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.419+0000 7fd68037c640 1 -- 172.21.15.49:0/699296335 shutdown_connections 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.419+0000 7fd68037c640 1 --2- 172.21.15.49:0/699296335 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd678108d00 0x7fd67810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.419+0000 7fd68037c640 1 --2- 172.21.15.49:0/699296335 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd6781083b0 0x7fd6781087c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.419+0000 7fd68037c640 1 --2- 172.21.15.49:0/699296335 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678102a70 0x7fd678102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.419+0000 7fd68037c640 1 -- 172.21.15.49:0/699296335 >> 172.21.15.49:0/699296335 conn(0x7fd678079730 msgr2=0x7fd678079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.419+0000 7fd68037c640 1 -- 172.21.15.49:0/699296335 shutdown_connections 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.419+0000 7fd68037c640 1 -- 172.21.15.49:0/699296335 wait complete. 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd68037c640 1 Processor -- start 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd68037c640 1 -- start start 2024-09-21T06:36:32.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd68037c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678102a70 0x7fd6780ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd68037c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6781083b0 0x7fd6780ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd68037c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678108d00 0x7fd678100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd68037c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd678112970 con 0x7fd678102a70 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd68037c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd6781127f0 con 0x7fd6781083b0 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd68037c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd678112af0 con 0x7fd678108d00 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd67e118640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678102a70 0x7fd6780ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd67e118640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678102a70 0x7fd6780ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56970/0 (socket says 172.21.15.49:56970) 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd67e118640 1 -- 172.21.15.49:0/1491667275 learned_addr learned my addr 172.21.15.49:0/1491667275 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd67d917640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6781083b0 0x7fd6780ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.420+0000 7fd67e919640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678108d00 0x7fd678100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd67e118640 1 -- 172.21.15.49:0/1491667275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678108d00 msgr2=0x7fd678100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd67e118640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678108d00 0x7fd678100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd67e118640 1 -- 172.21.15.49:0/1491667275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6781083b0 msgr2=0x7fd6780ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:32.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd67e118640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6781083b0 0x7fd6780ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd67e118640 1 -- 172.21.15.49:0/1491667275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6781a8810 con 0x7fd678102a70 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd67e919640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678108d00 0x7fd678100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd67e118640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678102a70 0x7fd6780ff5f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd67400e9f0 tx=0x7fd67400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd66f7fe640 1 -- 172.21.15.49:0/1491667275 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67400cd80 con 0x7fd678102a70 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6781a8b00 con 0x7fd678102a70 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd66f7fe640 1 -- 172.21.15.49:0/1491667275 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd6740054d0 con 0x7fd678102a70 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd66f7fe640 1 -- 172.21.15.49:0/1491667275 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674010690 con 0x7fd678102a70 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.421+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6781a8fc0 con 0x7fd678102a70 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.422+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd678103cf0 con 0x7fd678102a70 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.424+0000 7fd66f7fe640 1 -- 172.21.15.49:0/1491667275 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fd674004e90 con 0x7fd678102a70 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.424+0000 7fd66f7fe640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6640b6560 0x7fd6640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.425+0000 7fd67d917640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6640b6560 0x7fd6640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.425+0000 7fd66f7fe640 1 -- 172.21.15.49:0/1491667275 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd6740e7a40 con 0x7fd678102a70 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.425+0000 7fd67d917640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6640b6560 0x7fd6640b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd668000c00 tx=0x7fd668031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:32.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.429+0000 7fd66f7fe640 1 -- 172.21.15.49:0/1491667275 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6740ae190 con 0x7fd678102a70 2024-09-21T06:36:32.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.654+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd67802e640 con 0x7fd678102a70 2024-09-21T06:36:32.656 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:32 smithi049 ceph-mon[31177]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:32.656 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:32 smithi049 ceph-mon[31177]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.655+0000 7fd66f7fe640 1 -- 172.21.15.49:0/1491667275 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7fd6740b2570 con 0x7fd678102a70 2024-09-21T06:36:32.657 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:32.657 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"btime":"2024-09-21T06:36:27:292026+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:36:27.233682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:36:32.657 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6640b6560 msgr2=0x7fd6640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6640b6560 0x7fd6640b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd668000c00 tx=0x7fd668031400 comp rx=0 tx=0).stop 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678102a70 msgr2=0x7fd6780ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678102a70 0x7fd6780ff5f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd67400e9f0 tx=0x7fd67400edf0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 shutdown_connections 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd6640b6560 0x7fd6640b8a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd678108d00 0x7fd678100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd6781083b0 0x7fd6780ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 --2- 172.21.15.49:0/1491667275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd678102a70 0x7fd6780ff5f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:32.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 >> 172.21.15.49:0/1491667275 conn(0x7fd678079730 msgr2=0x7fd678101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:32.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 shutdown_connections 2024-09-21T06:36:32.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:32.657+0000 7fd68037c640 1 -- 172.21.15.49:0/1491667275 wait complete. 2024-09-21T06:36:32.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:32 smithi098 ceph-mon[34704]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:32.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:32 smithi098 ceph-mon[34704]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:32.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:32 smithi079 ceph-mon[34346]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:32.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:32 smithi079 ceph-mon[34346]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:33.212 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:36:33.469 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:33.590 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:33 smithi049 ceph-mon[31177]: pgmap v316: 97 pgs: 97 active+clean; 651 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:36:33.591 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:33 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1491667275' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:33.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:33 smithi098 ceph-mon[34704]: pgmap v316: 97 pgs: 97 active+clean; 651 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:36:33.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:33 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1491667275' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:33.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:33 smithi079 ceph-mon[34346]: pgmap v316: 97 pgs: 97 active+clean; 651 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-21T06:36:33.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:33 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1491667275' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:33.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.975+0000 7f09992cd640 1 -- 172.21.15.49:0/2623577681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 msgr2=0x7f0994103490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.975+0000 7f09992cd640 1 --2- 172.21.15.49:0/2623577681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 0x7f0994103490 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f098c009900 tx=0x7f098c02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:33.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.975+0000 7f09992cd640 1 -- 172.21.15.49:0/2623577681 shutdown_connections 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.975+0000 7f09992cd640 1 --2- 172.21.15.49:0/2623577681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0994105ac0 0x7f099410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.975+0000 7f09992cd640 1 --2- 172.21.15.49:0/2623577681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0994105170 0x7f0994105580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.975+0000 7f09992cd640 1 --2- 172.21.15.49:0/2623577681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 0x7f0994103490 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.975+0000 7f09992cd640 1 -- 172.21.15.49:0/2623577681 >> 172.21.15.49:0/2623577681 conn(0x7f0994077c60 msgr2=0x7f09940780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.975+0000 7f09992cd640 1 -- 172.21.15.49:0/2623577681 shutdown_connections 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.975+0000 7f09992cd640 1 -- 172.21.15.49:0/2623577681 wait complete. 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f09992cd640 1 Processor -- start 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f09992cd640 1 -- start start 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f09992cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 0x7f0994199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f09992cd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0994105170 0x7f0994199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f09992cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0994105ac0 0x7f099419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f09992cd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09941129c0 con 0x7f0994103080 2024-09-21T06:36:33.994 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f09992cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0994112840 con 0x7f0994105ac0 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f09992cd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0994112b40 con 0x7f0994105170 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f0992ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 0x7f0994199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f0992ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 0x7f0994199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56984/0 (socket says 172.21.15.49:56984) 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.976+0000 7f0992ffd640 1 -- 172.21.15.49:0/3626857516 learned_addr learned my addr 172.21.15.49:0/3626857516 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f09927fc640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0994105170 0x7f0994199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f09937fe640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0994105ac0 0x7f099419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f0992ffd640 1 -- 172.21.15.49:0/3626857516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0994105170 msgr2=0x7f0994199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f0992ffd640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0994105170 0x7f0994199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f0992ffd640 1 -- 172.21.15.49:0/3626857516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0994105ac0 msgr2=0x7f099419ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f0992ffd640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0994105ac0 0x7f099419ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f0992ffd640 1 -- 172.21.15.49:0/3626857516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099419f240 con 0x7f0994103080 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f0992ffd640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 0x7f0994199390 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f098c005940 tx=0x7f098c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f098bfff640 1 -- 172.21.15.49:0/3626857516 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c03f030 con 0x7f0994103080 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f098bfff640 1 -- 172.21.15.49:0/3626857516 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f098c003cb0 con 0x7f0994103080 2024-09-21T06:36:33.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099419f4d0 con 0x7f0994103080 2024-09-21T06:36:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f098bfff640 1 -- 172.21.15.49:0/3626857516 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c035070 con 0x7f0994103080 2024-09-21T06:36:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.977+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099419f9b0 con 0x7f0994103080 2024-09-21T06:36:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.979+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0994103490 con 0x7f0994103080 2024-09-21T06:36:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.980+0000 7f098bfff640 1 -- 172.21.15.49:0/3626857516 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f098c042030 con 0x7f0994103080 2024-09-21T06:36:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.981+0000 7f098bfff640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09800b6590 0x7f09800b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.981+0000 7f09927fc640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09800b6590 0x7f09800b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.981+0000 7f098bfff640 1 -- 172.21.15.49:0/3626857516 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f098c107a80 con 0x7f0994103080 2024-09-21T06:36:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.981+0000 7f09927fc640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09800b6590 0x7f09800b8aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f097c005d00 tx=0x7f097c005c50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:33.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:33.985+0000 7f098bfff640 1 -- 172.21.15.49:0/3626857516 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f098c0ce1d0 con 0x7f0994103080 2024-09-21T06:36:34.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.174+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f099410a4d0 con 0x7f0994103080 2024-09-21T06:36:34.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.176+0000 7f098bfff640 1 -- 172.21.15.49:0/3626857516 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+23122 (secure 0 0 0) 0x7f098c0d25b0 con 0x7f0994103080 2024-09-21T06:36:34.177 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:36:34.178 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":78,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:36:14.252235+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9},{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09800b6590 msgr2=0x7f09800b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09800b6590 0x7f09800b8aa0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f097c005d00 tx=0x7f097c005c50 comp rx=0 tx=0).stop 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 msgr2=0x7f0994199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 0x7f0994199390 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f098c005940 tx=0x7f098c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 shutdown_connections 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09800b6590 0x7f09800b8aa0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0994105ac0 0x7f099419ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0994105170 0x7f0994199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 --2- 172.21.15.49:0/3626857516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0994103080 0x7f0994199390 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 >> 172.21.15.49:0/3626857516 conn(0x7f0994077c60 msgr2=0x7f0994106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 shutdown_connections 2024-09-21T06:36:34.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:34.178+0000 7f09992cd640 1 -- 172.21.15.49:0/3626857516 wait complete. 2024-09-21T06:36:34.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:34 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3626857516' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:34.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:34 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3626857516' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:34.870 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:34 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3626857516' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:34.901 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T06:36:34.902 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T06:36:34.911 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:36:34.911 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:36:34.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T06:36:34.912 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T06:36:34.912 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:36:34.912 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:36:35.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.029+0000 7f19854ec640 1 -- 172.21.15.49:0/420782023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19801082f0 msgr2=0x7f1980108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.029+0000 7f19854ec640 1 --2- 172.21.15.49:0/420782023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19801082f0 0x7f1980108700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1970009900 tx=0x7f197002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:35.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.029+0000 7f19854ec640 1 -- 172.21.15.49:0/420782023 shutdown_connections 2024-09-21T06:36:35.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.029+0000 7f19854ec640 1 --2- 172.21.15.49:0/420782023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1980108c40 0x7f198010f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.029+0000 7f19854ec640 1 --2- 172.21.15.49:0/420782023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f19801082f0 0x7f1980108700 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.029+0000 7f19854ec640 1 --2- 172.21.15.49:0/420782023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19801029c0 0x7f1980102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.029+0000 7f19854ec640 1 -- 172.21.15.49:0/420782023 >> 172.21.15.49:0/420782023 conn(0x7f19800fe3c0 msgr2=0x7f1980100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.029+0000 7f19854ec640 1 -- 172.21.15.49:0/420782023 shutdown_connections 2024-09-21T06:36:35.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.029+0000 7f19854ec640 1 -- 172.21.15.49:0/420782023 wait complete. 2024-09-21T06:36:35.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.030+0000 7f19854ec640 1 Processor -- start 2024-09-21T06:36:35.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.030+0000 7f19854ec640 1 -- start start 2024-09-21T06:36:35.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f19854ec640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19801029c0 0x7f198019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f19854ec640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19801082f0 0x7f198019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f19854ec640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1980108c40 0x7f198019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f19854ec640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1980112900 con 0x7f1980108c40 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f19854ec640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1980112780 con 0x7f19801082f0 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f19854ec640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1980112a80 con 0x7f19801029c0 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1980108c40 0x7f198019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1980108c40 0x7f198019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57008/0 (socket says 172.21.15.49:57008) 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197f7fe640 1 -- 172.21.15.49:0/2710865212 learned_addr learned my addr 172.21.15.49:0/2710865212 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197effd640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19801029c0 0x7f198019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197e7fc640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19801082f0 0x7f198019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197f7fe640 1 -- 172.21.15.49:0/2710865212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19801029c0 msgr2=0x7f198019b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197f7fe640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19801029c0 0x7f198019b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197f7fe640 1 -- 172.21.15.49:0/2710865212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19801082f0 msgr2=0x7f198019b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197f7fe640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19801082f0 0x7f198019b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197f7fe640 1 -- 172.21.15.49:0/2710865212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19801a6520 con 0x7f1980108c40 2024-09-21T06:36:35.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197effd640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19801029c0 0x7f198019b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.031+0000 7f197f7fe640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1980108c40 0x7f198019bd10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f197800eb10 tx=0x7f197800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.032+0000 7f1967fff640 1 -- 172.21.15.49:0/2710865212 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978004b20 con 0x7f1980108c40 2024-09-21T06:36:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.032+0000 7f1967fff640 1 -- 172.21.15.49:0/2710865212 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1978004cc0 con 0x7f1980108c40 2024-09-21T06:36:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.032+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19801a6810 con 0x7f1980108c40 2024-09-21T06:36:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.032+0000 7f1967fff640 1 -- 172.21.15.49:0/2710865212 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978010670 con 0x7f1980108c40 2024-09-21T06:36:35.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.032+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19801a6d30 con 0x7f1980108c40 2024-09-21T06:36:35.899 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:35 smithi079 ceph-mon[34346]: pgmap v317: 97 pgs: 97 active+clean; 651 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T06:36:35.899 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:35 smithi098 ceph-mon[34704]: pgmap v317: 97 pgs: 97 active+clean; 651 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T06:36:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.033+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1980103c30 con 0x7f1980108c40 2024-09-21T06:36:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.035+0000 7f1967fff640 1 -- 172.21.15.49:0/2710865212 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f1978005000 con 0x7f1980108c40 2024-09-21T06:36:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.036+0000 7f1967fff640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f19680b65e0 0x7f19680b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.036+0000 7f1967fff640 1 -- 172.21.15.49:0/2710865212 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f19780e7be0 con 0x7f1980108c40 2024-09-21T06:36:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.036+0000 7f197effd640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f19680b65e0 0x7f19680b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.037+0000 7f197effd640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f19680b65e0 0x7f19680b8af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f198006b8b0 tx=0x7f1974005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.038+0000 7f1967fff640 1 -- 172.21.15.49:0/2710865212 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1978056710 con 0x7f1980108c40 2024-09-21T06:36:35.900 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:35.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.259+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f1980063800 con 0x7f19680b65e0 2024-09-21T06:36:35.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.426+0000 7f1967fff640 1 -- 172.21.15.49:0/2710865212 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1980063800 con 0x7f19680b65e0 2024-09-21T06:36:35.901 INFO:teuthology.orchestra.run.smithi049.stdout:Schedule set for path / 2024-09-21T06:36:35.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.428+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f19680b65e0 msgr2=0x7f19680b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.428+0000 7f19854ec640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f19680b65e0 0x7f19680b8af0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f198006b8b0 tx=0x7f1974005f90 comp rx=0 tx=0).stop 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.428+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1980108c40 msgr2=0x7f198019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.428+0000 7f19854ec640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1980108c40 0x7f198019bd10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f197800eb10 tx=0x7f197800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.429+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 shutdown_connections 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.429+0000 7f19854ec640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f19680b65e0 0x7f19680b8af0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.429+0000 7f19854ec640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1980108c40 0x7f198019bd10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.429+0000 7f19854ec640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f19801082f0 0x7f198019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.429+0000 7f19854ec640 1 --2- 172.21.15.49:0/2710865212 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f19801029c0 0x7f198019b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.429+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 >> 172.21.15.49:0/2710865212 conn(0x7f19800fe3c0 msgr2=0x7f1980105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.429+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 shutdown_connections 2024-09-21T06:36:35.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.429+0000 7f19854ec640 1 -- 172.21.15.49:0/2710865212 wait complete. 2024-09-21T06:36:35.903 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.687+0000 7f76968a9640 1 -- 172.21.15.49:0/1326851173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76901083a0 msgr2=0x7f76901087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.687+0000 7f76968a9640 1 --2- 172.21.15.49:0/1326851173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76901083a0 0x7f76901087b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7684009900 tx=0x7f768402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.687+0000 7f76968a9640 1 -- 172.21.15.49:0/1326851173 shutdown_connections 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.687+0000 7f76968a9640 1 --2- 172.21.15.49:0/1326851173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7690108cf0 0x7f769010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.687+0000 7f76968a9640 1 --2- 172.21.15.49:0/1326851173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76901083a0 0x7f76901087b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.687+0000 7f76968a9640 1 --2- 172.21.15.49:0/1326851173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7690102a60 0x7f7690102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.687+0000 7f76968a9640 1 -- 172.21.15.49:0/1326851173 >> 172.21.15.49:0/1326851173 conn(0x7f7690079730 msgr2=0x7f7690079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.687+0000 7f76968a9640 1 -- 172.21.15.49:0/1326851173 shutdown_connections 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.687+0000 7f76968a9640 1 -- 172.21.15.49:0/1326851173 wait complete. 2024-09-21T06:36:35.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f76968a9640 1 Processor -- start 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f76968a9640 1 -- start start 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f76968a9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7690102a60 0x7f76900ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f76968a9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76901083a0 0x7f76900ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f76968a9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7690108cf0 0x7f76901000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f76968a9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7690112960 con 0x7f7690108cf0 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f76968a9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76901127e0 con 0x7f7690102a60 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f76968a9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7690112ae0 con 0x7f76901083a0 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f7694e46640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7690108cf0 0x7f76901000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f7694e46640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7690108cf0 0x7f76901000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57038/0 (socket says 172.21.15.49:57038) 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.688+0000 7f7694e46640 1 -- 172.21.15.49:0/3271625957 learned_addr learned my addr 172.21.15.49:0/3271625957 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f768ffff640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7690102a60 0x7f76900ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f768f7fe640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76901083a0 0x7f76900ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f7694e46640 1 -- 172.21.15.49:0/3271625957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76901083a0 msgr2=0x7f76900ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.915 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f7694e46640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76901083a0 0x7f76900ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f7694e46640 1 -- 172.21.15.49:0/3271625957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7690102a60 msgr2=0x7f76900ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f7694e46640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7690102a60 0x7f76900ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f7694e46640 1 -- 172.21.15.49:0/3271625957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76901a8740 con 0x7f7690108cf0 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f768f7fe640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76901083a0 0x7f76900ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f7694e46640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7690108cf0 0x7f76901000f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f768800cad0 tx=0x7f768800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f768d7fa640 1 -- 172.21.15.49:0/3271625957 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768800ae20 con 0x7f7690108cf0 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f76968a9640 1 -- 172.21.15.49:0/3271625957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76901a8a30 con 0x7f7690108cf0 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f768d7fa640 1 -- 172.21.15.49:0/3271625957 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7688005020 con 0x7f7690108cf0 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f768d7fa640 1 -- 172.21.15.49:0/3271625957 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f768800f6b0 con 0x7f7690108cf0 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.689+0000 7f76968a9640 1 -- 172.21.15.49:0/3271625957 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76901a8ef0 con 0x7f7690108cf0 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.692+0000 7f769ce1d740 1 Processor -- start 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.692+0000 7f768d7fa640 1 -- 172.21.15.49:0/3271625957 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f76880051d0 con 0x7f7690108cf0 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.692+0000 7f769ce1d740 1 -- start start 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.692+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.692+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 0x5651bc6b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f769ce1d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5651bc627e60 con 0x5651bc2e1490 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f769ce1d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5651bc617290 con 0x5651bc2e9670 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f769ce1d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5651bc61b0a0 con 0x5651bc30a350 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57044/0 (socket says 172.21.15.49:57044) 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768ffff640 1 -- 172.21.15.49:0/33953951 learned_addr learned my addr 172.21.15.49:0/33953951 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768f7fe640 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768f7fe640 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 0x5651bc6b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768d7fa640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76780b6560 0x7f76780b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768ffff640 1 -- 172.21.15.49:0/33953951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 msgr2=0x5651bc6b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768ffff640 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768ffff640 1 -- 172.21.15.49:0/33953951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 msgr2=0x5651bc6b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768ffff640 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 0x5651bc6b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768ffff640 1 -- 172.21.15.49:0/33953951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651bc375930 con 0x5651bc2e1490 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768f7fe640 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768d7fa640 1 -- 172.21.15.49:0/3271625957 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f76880e7520 con 0x7f7690108cf0 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f7694e46640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76780b6560 0x7f76780b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.693+0000 7f768ffff640 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b1970 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7680009c90 tx=0x7f7680011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d788086ae9a49d80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.694+0000 7f76767fc640 1 -- 172.21.15.49:0/33953951 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680005220 con 0x5651bc2e1490 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.694+0000 7f76767fc640 1 -- 172.21.15.49:0/33953951 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7680004c50 con 0x5651bc2e1490 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.694+0000 7f76767fc640 1 -- 172.21.15.49:0/33953951 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680019690 con 0x5651bc2e1490 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.694+0000 7f769ce1d740 1 -- 172.21.15.49:0/33953951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 msgr2=0x5651bc6b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.694+0000 7f7694e46640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76780b6560 0x7f76780b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f76880ad270 tx=0x7f768800a890 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.694+0000 7f769ce1d740 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b1970 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f7680009c90 tx=0x7f7680011810 comp rx=0 tx=0).stop 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.695+0000 7f769ce1d740 1 -- 172.21.15.49:0/33953951 shutdown_connections 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.695+0000 7f769ce1d740 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 0x5651bc6b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.695+0000 7f769ce1d740 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b1970 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.695+0000 7f769ce1d740 1 --2- 172.21.15.49:0/33953951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.695+0000 7f769ce1d740 1 -- 172.21.15.49:0/33953951 >> 172.21.15.49:0/33953951 conn(0x5651bc2fe740 msgr2=0x5651bc6af320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.695+0000 7f769ce1d740 1 -- 172.21.15.49:0/33953951 shutdown_connections 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.695+0000 7f769ce1d740 1 -- 172.21.15.49:0/33953951 wait complete. 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.695+0000 7f769ce1d740 1 -- start start 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.695+0000 7f769ce1d740 1 Processor -- start 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 0x5651bc6bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc2e9670 0x5651bc6bd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc30a350 0x5651bc6c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f769ce1d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5651bc478890 con 0x5651bc30a350 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f769ce1d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5651bc5b1d40 con 0x5651bc2e1490 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f769ce1d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5651bc6bfc10 con 0x5651bc2e9670 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f769ce1d740 10 client.0 _ll_register_callbacks cb 0x5651bc615c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc30a350 0x5651bc6c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc30a350 0x5651bc6c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57052/0 (socket says 172.21.15.49:57052) 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 -- 172.21.15.49:0/1024123657 learned_addr learned my addr 172.21.15.49:0/1024123657 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:35.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 0x5651bc6bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768ffff640 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc2e9670 0x5651bc6bd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 -- 172.21.15.49:0/1024123657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc2e9670 msgr2=0x5651bc6bd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc2e9670 0x5651bc6bd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 -- 172.21.15.49:0/1024123657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 msgr2=0x5651bc6bcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 0x5651bc6bcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 -- 172.21.15.49:0/1024123657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651bc6c9490 con 0x5651bc30a350 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f768f7fe640 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc30a350 0x5651bc6c8f00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7684005f70 tx=0x7f7684031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e49fab89cb08bcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.696+0000 7f766f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f766f7fe640 1 -- 172.21.15.49:0/1024123657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7684035040 con 0x5651bc30a350 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f766f7fe640 1 -- 172.21.15.49:0/1024123657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f7684031d20 con 0x5651bc30a350 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f769ce1d740 1 -- 172.21.15.49:0/1024123657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7680004c50 con 0x5651bc30a350 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f766f7fe640 1 -- 172.21.15.49:0/1024123657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7684052050 con 0x5651bc30a350 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f769ce1d740 10 client.15453 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:35.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f769ce1d740 1 -- 172.21.15.49:0/1024123657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5651bc6cbd30 con 0x5651bc30a350 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f766f7fe640 1 -- 172.21.15.49:0/1024123657 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7680004c50 con 0x5651bc30a350 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f766f7fe640 1 -- 172.21.15.49:0/1024123657 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7684003bc0 con 0x5651bc30a350 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f769ce1d740 10 client.15453 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f769ce1d740 10 client.15453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f769ce1d740 20 client.15453 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f769ce1d740 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5651bc2c8cd0 0x5651bc6cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f769ce1d740 4 client.15453 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.697+0000 7f769ce1d740 1 -- 172.21.15.49:0/1024123657 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651bc629db0 con 0x5651bc2c8cd0 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.698+0000 7f768ffff640 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5651bc2c8cd0 0x5651bc6cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.698+0000 7f768ffff640 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5651bc2c8cd0 0x5651bc6cf1d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b47441cda74e504 server_cookie=c7e630149327c0f6 in_seq=0 out_seq=0 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.698+0000 7f766f7fe640 10 client.15453 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f766f7fe640 1 -- 172.21.15.49:0/1024123657 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5651bc629db0 con 0x5651bc2c8cd0 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f766f7fe640 10 client.15453 handle_command_reply: tid=0 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 client.15453 shutdown 2024-09-21T06:36:35.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 -- 172.21.15.49:0/1024123657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc30a350 msgr2=0x5651bc6c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc30a350 0x5651bc6c8f00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7684005f70 tx=0x7f7684031400 comp rx=0 tx=0).stop 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 -- 172.21.15.49:0/1024123657 shutdown_connections 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5651bc2c8cd0 0x5651bc6cf1d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc30a350 0x5651bc6c8f00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc2e9670 0x5651bc6bd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 --2- 172.21.15.49:0/1024123657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 0x5651bc6bcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 -- 172.21.15.49:0/1024123657 >> 172.21.15.49:0/1024123657 conn(0x5651bc2fe740 msgr2=0x5651bc6b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f766f7fe640 0 client.15453 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 -- 172.21.15.49:0/1024123657 shutdown_connections 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 1 -- 172.21.15.49:0/1024123657 wait complete. 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.699+0000 7f769ce1d740 20 client.15453 trim_cache size 0 max 16384 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.717+0000 7f769ce1d740 1 Processor -- start 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.717+0000 7f769ce1d740 1 -- start start 2024-09-21T06:36:35.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.717+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.717+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 0x5651bc6bc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.717+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6be9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.717+0000 7f769ce1d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76901b4360 con 0x5651bc2e1490 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.717+0000 7f769ce1d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76901b1c30 con 0x5651bc2e9670 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.717+0000 7f769ce1d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f76901afaa0 con 0x5651bc30a350 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.717+0000 7f768f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57058/0 (socket says 172.21.15.49:57058) 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768f7fe640 1 -- 172.21.15.49:0/2703655020 learned_addr learned my addr 172.21.15.49:0/2703655020 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768f7fe640 1 -- 172.21.15.49:0/2703655020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 msgr2=0x5651bc6be9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768f7fe640 1 --2- 172.21.15.49:0/2703655020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6be9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768f7fe640 1 -- 172.21.15.49:0/2703655020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 msgr2=0x5651bc6bc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768ffff640 1 --2- 172.21.15.49:0/2703655020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 0x5651bc6bc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768f7fe640 1 --2- 172.21.15.49:0/2703655020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 0x5651bc6bc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768f7fe640 1 -- 172.21.15.49:0/2703655020 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651bc6be070 con 0x5651bc2e1490 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768ffff640 1 --2- 172.21.15.49:0/2703655020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 0x5651bc6bc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f768f7fe640 1 --2- 172.21.15.49:0/2703655020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b7550 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7684000c00 tx=0x7f7684032e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92565b8d7dd2410d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f7675ffb640 1 -- 172.21.15.49:0/2703655020 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7684035070 con 0x5651bc2e1490 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f7675ffb640 1 -- 172.21.15.49:0/2703655020 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f768403d610 con 0x5651bc2e1490 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.718+0000 7f7675ffb640 1 -- 172.21.15.49:0/2703655020 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76840035f0 con 0x5651bc2e1490 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 -- 172.21.15.49:0/2703655020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 msgr2=0x5651bc6b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 --2- 172.21.15.49:0/2703655020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b7550 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7684000c00 tx=0x7f7684032e30 comp rx=0 tx=0).stop 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 -- 172.21.15.49:0/2703655020 shutdown_connections 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 --2- 172.21.15.49:0/2703655020 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6be9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 --2- 172.21.15.49:0/2703655020 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e9670 0x5651bc6bc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 --2- 172.21.15.49:0/2703655020 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e1490 0x5651bc6b7550 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 -- 172.21.15.49:0/2703655020 >> 172.21.15.49:0/2703655020 conn(0x5651bc2fe740 msgr2=0x5651bc6be2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 -- 172.21.15.49:0/2703655020 shutdown_connections 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 -- 172.21.15.49:0/2703655020 wait complete. 2024-09-21T06:36:35.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.719+0000 7f769ce1d740 1 -- start start 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f769ce1d740 1 Processor -- start 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 0x5651bc6c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e9670 0x5651bc6c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f769ce1d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6c2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f769ce1d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76901b00f0 con 0x5651bc2e9670 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f769ce1d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76901b1560 con 0x5651bc2e1490 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f769ce1d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f76901b07c0 con 0x5651bc30a350 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f769ce1d740 10 client.0 _ll_register_callbacks cb 0x7f7680005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f768ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e9670 0x5651bc6c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f768ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e9670 0x5651bc6c1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57062/0 (socket says 172.21.15.49:57062) 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f768ffff640 1 -- 172.21.15.49:0/958800826 learned_addr learned my addr 172.21.15.49:0/958800826 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f768f7fe640 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.720+0000 7f768f7fe640 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 0x5651bc6c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f768ffff640 1 -- 172.21.15.49:0/958800826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 msgr2=0x5651bc6c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f768ffff640 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f768ffff640 1 -- 172.21.15.49:0/958800826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 msgr2=0x5651bc6c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f768ffff640 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 0x5651bc6c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f768ffff640 1 -- 172.21.15.49:0/958800826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651bc6c2ab0 con 0x5651bc2e9670 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f768ffff640 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e9670 0x5651bc6c1ca0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7680005620 tx=0x7f7680005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c02d0264955a614 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f766f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f766f7fe640 1 -- 172.21.15.49:0/958800826 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7680005100 con 0x5651bc2e9670 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f766f7fe640 1 -- 172.21.15.49:0/958800826 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f76800052a0 con 0x5651bc2e9670 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f769ce1d740 1 -- 172.21.15.49:0/958800826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f768403d610 con 0x5651bc2e9670 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f766f7fe640 1 -- 172.21.15.49:0/958800826 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f76800035f0 con 0x5651bc2e9670 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f769ce1d740 10 client.15459 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f769ce1d740 1 -- 172.21.15.49:0/958800826 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5651bc73abd0 con 0x5651bc2e9670 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.721+0000 7f766f7fe640 1 -- 172.21.15.49:0/958800826 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f768403d610 con 0x5651bc2e9670 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f766f7fe640 1 -- 172.21.15.49:0/958800826 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f768002c6e0 con 0x5651bc2e9670 2024-09-21T06:36:35.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f769ce1d740 10 client.15459 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f769ce1d740 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f769ce1d740 20 client.15459 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f769ce1d740 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5651bc29e080 0x5651bc73d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f769ce1d740 4 client.15459 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f769ce1d740 1 -- 172.21.15.49:0/958800826 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5651bc625860 con 0x5651bc29e080 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f768f7fe640 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5651bc29e080 0x5651bc73d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f766f7fe640 10 client.15459 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.722+0000 7f768f7fe640 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5651bc29e080 0x5651bc73d200 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bee1bd76313738be server_cookie=2bcdb2d66bfa25bc in_seq=0 out_seq=0 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f766f7fe640 1 -- 172.21.15.49:0/958800826 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5651bc625860 con 0x5651bc29e080 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f766f7fe640 10 client.15459 handle_command_reply: tid=0 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f769ce1d740 1 client.15459 shutdown 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f769ce1d740 1 -- 172.21.15.49:0/958800826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e9670 msgr2=0x5651bc6c1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f769ce1d740 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e9670 0x5651bc6c1ca0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7680005620 tx=0x7f7680005c50 comp rx=0 tx=0).stop 2024-09-21T06:36:35.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f769ce1d740 1 -- 172.21.15.49:0/958800826 shutdown_connections 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f769ce1d740 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5651bc29e080 0x5651bc73d200 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f769ce1d740 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5651bc30a350 0x5651bc6c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f769ce1d740 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5651bc2e9670 0x5651bc6c1ca0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f769ce1d740 1 --2- 172.21.15.49:0/958800826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5651bc2e1490 0x5651bc6c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f769ce1d740 1 -- 172.21.15.49:0/958800826 >> 172.21.15.49:0/958800826 conn(0x5651bc2fe740 msgr2=0x5651bc6bb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.724+0000 7f766f7fe640 0 client.15459 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f769ce1d740 1 -- 172.21.15.49:0/958800826 shutdown_connections 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f769ce1d740 1 -- 172.21.15.49:0/958800826 wait complete. 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f769ce1d740 20 client.15459 trim_cache size 0 max 16384 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:36:35.928 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:36:35.929 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "9055b0bf-8dc8-4645-bf7b-fc2d221f9228", 2024-09-21T06:36:35.929 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:36:35.929 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:36:35.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 -- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76780b6560 msgr2=0x7f76780b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76780b6560 0x7f76780b8a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f76880ad270 tx=0x7f768800a890 comp rx=0 tx=0).stop 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 -- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7690108cf0 msgr2=0x7f76901000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7690108cf0 0x7f76901000f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f768800cad0 tx=0x7f768800cf90 comp rx=0 tx=0).stop 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 -- 172.21.15.49:0/3271625957 shutdown_connections 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76780b6560 0x7f76780b8a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7690108cf0 0x7f76901000f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76901083a0 0x7f76900ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 --2- 172.21.15.49:0/3271625957 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7690102a60 0x7f76900ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 -- 172.21.15.49:0/3271625957 >> 172.21.15.49:0/3271625957 conn(0x7f7690079730 msgr2=0x7f769006b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 -- 172.21.15.49:0/3271625957 shutdown_connections 2024-09-21T06:36:35.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:35.725+0000 7f76968a9640 1 -- 172.21.15.49:0/3271625957 wait complete. 2024-09-21T06:36:35.953 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:35 smithi049 ceph-mon[31177]: pgmap v317: 97 pgs: 97 active+clean; 651 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-21T06:36:36.051 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.049+0000 7fc4764f2640 1 -- 172.21.15.49:0/785150351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4701049a0 msgr2=0x7fc470104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.049+0000 7fc4764f2640 1 --2- 172.21.15.49:0/785150351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4701049a0 0x7fc470104db0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc460009900 tx=0x7fc46002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.050+0000 7fc4764f2640 1 -- 172.21.15.49:0/785150351 shutdown_connections 2024-09-21T06:36:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.050+0000 7fc4764f2640 1 --2- 172.21.15.49:0/785150351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc47010ddc0 0x7fc4701102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.050+0000 7fc4764f2640 1 --2- 172.21.15.49:0/785150351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4701052f0 0x7fc47010d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.050+0000 7fc4764f2640 1 --2- 172.21.15.49:0/785150351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4701049a0 0x7fc470104db0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.050+0000 7fc4764f2640 1 -- 172.21.15.49:0/785150351 >> 172.21.15.49:0/785150351 conn(0x7fc4700fe3b0 msgr2=0x7fc470100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.050+0000 7fc4764f2640 1 -- 172.21.15.49:0/785150351 shutdown_connections 2024-09-21T06:36:36.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.050+0000 7fc4764f2640 1 -- 172.21.15.49:0/785150351 wait complete. 2024-09-21T06:36:36.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc4764f2640 1 Processor -- start 2024-09-21T06:36:36.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc4764f2640 1 -- start start 2024-09-21T06:36:36.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc4764f2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4701049a0 0x7fc47019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc4764f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4701052f0 0x7fc47019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc4764f2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47010ddc0 0x7fc47019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc4764f2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc470113a30 con 0x7fc47010ddc0 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc4764f2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc4701138b0 con 0x7fc4701052f0 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc4764f2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc470113bb0 con 0x7fc4701049a0 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc474a8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47010ddc0 0x7fc47019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc474a8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47010ddc0 0x7fc47019fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57082/0 (socket says 172.21.15.49:57082) 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc474a8f640 1 -- 172.21.15.49:0/774004480 learned_addr learned my addr 172.21.15.49:0/774004480 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc46f7fe640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4701052f0 0x7fc47019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.051+0000 7fc46ffff640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4701049a0 0x7fc47019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc474a8f640 1 -- 172.21.15.49:0/774004480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4701049a0 msgr2=0x7fc47019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc474a8f640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4701049a0 0x7fc47019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc474a8f640 1 -- 172.21.15.49:0/774004480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4701052f0 msgr2=0x7fc47019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc474a8f640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4701052f0 0x7fc47019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc474a8f640 1 -- 172.21.15.49:0/774004480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4701a02f0 con 0x7fc47010ddc0 2024-09-21T06:36:36.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc474a8f640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47010ddc0 0x7fc47019fc80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc46800eb10 tx=0x7fc46800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:36.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc46d7fa640 1 -- 172.21.15.49:0/774004480 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46800ce20 con 0x7fc47010ddc0 2024-09-21T06:36:36.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc46d7fa640 1 -- 172.21.15.49:0/774004480 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc468005020 con 0x7fc47010ddc0 2024-09-21T06:36:36.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4701a05e0 con 0x7fc47010ddc0 2024-09-21T06:36:36.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc46d7fa640 1 -- 172.21.15.49:0/774004480 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc468010690 con 0x7fc47010ddc0 2024-09-21T06:36:36.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.052+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4701a6e00 con 0x7fc47010ddc0 2024-09-21T06:36:36.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.053+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc470104db0 con 0x7fc47010ddc0 2024-09-21T06:36:36.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.055+0000 7fc46d7fa640 1 -- 172.21.15.49:0/774004480 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7fc468005510 con 0x7fc47010ddc0 2024-09-21T06:36:36.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.056+0000 7fc46d7fa640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4580b6560 0x7fc4580b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.056+0000 7fc46ffff640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4580b6560 0x7fc4580b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.056+0000 7fc46d7fa640 1 -- 172.21.15.49:0/774004480 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fc4680e7fe0 con 0x7fc47010ddc0 2024-09-21T06:36:36.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.057+0000 7fc46ffff640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4580b6560 0x7fc4580b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc460031440 tx=0x7fc460005d50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:36.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.059+0000 7fc46d7fa640 1 -- 172.21.15.49:0/774004480 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc4680ae730 con 0x7fc47010ddc0 2024-09-21T06:36:36.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.275+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fc470108020 con 0x7fc4580b6560 2024-09-21T06:36:36.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.342+0000 7fc46d7fa640 1 -- 172.21.15.49:0/774004480 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fc470108020 con 0x7fc4580b6560 2024-09-21T06:36:36.344 INFO:teuthology.orchestra.run.smithi049.stdout:Retention added to path / 2024-09-21T06:36:36.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4580b6560 msgr2=0x7fc4580b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4580b6560 0x7fc4580b8a70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc460031440 tx=0x7fc460005d50 comp rx=0 tx=0).stop 2024-09-21T06:36:36.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47010ddc0 msgr2=0x7fc47019fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47010ddc0 0x7fc47019fc80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc46800eb10 tx=0x7fc46800ef10 comp rx=0 tx=0).stop 2024-09-21T06:36:36.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 shutdown_connections 2024-09-21T06:36:36.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4580b6560 0x7fc4580b8a70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc47010ddc0 0x7fc47019fc80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4701052f0 0x7fc47019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 --2- 172.21.15.49:0/774004480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc4701049a0 0x7fc47019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 >> 172.21.15.49:0/774004480 conn(0x7fc4700fe3b0 msgr2=0x7fc470107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:36.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 shutdown_connections 2024-09-21T06:36:36.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.344+0000 7fc4764f2640 1 -- 172.21.15.49:0/774004480 wait complete. 2024-09-21T06:36:36.357 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T06:36:36.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.513+0000 7f060710b640 1 -- 172.21.15.49:0/2181652923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06001029c0 msgr2=0x7f0600102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.513+0000 7f060710b640 1 --2- 172.21.15.49:0/2181652923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06001029c0 0x7f0600102dd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f05f0009900 tx=0x7f05f002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:36.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.513+0000 7f060710b640 1 -- 172.21.15.49:0/2181652923 shutdown_connections 2024-09-21T06:36:36.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.513+0000 7f060710b640 1 --2- 172.21.15.49:0/2181652923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0600108c40 0x7f060010f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.513+0000 7f060710b640 1 --2- 172.21.15.49:0/2181652923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06001082f0 0x7f0600108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.513+0000 7f060710b640 1 --2- 172.21.15.49:0/2181652923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f06001029c0 0x7f0600102dd0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.513+0000 7f060710b640 1 -- 172.21.15.49:0/2181652923 >> 172.21.15.49:0/2181652923 conn(0x7f06000fe3c0 msgr2=0x7f0600100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.513+0000 7f060710b640 1 -- 172.21.15.49:0/2181652923 shutdown_connections 2024-09-21T06:36:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.513+0000 7f060710b640 1 -- 172.21.15.49:0/2181652923 wait complete. 2024-09-21T06:36:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f060710b640 1 Processor -- start 2024-09-21T06:36:36.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f060710b640 1 -- start start 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f060710b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06001029c0 0x7f06000fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f060710b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001082f0 0x7f06000fee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f060710b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600108c40 0x7f06000ff370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f060710b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0600112900 con 0x7f0600108c40 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f060710b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0600112780 con 0x7f06001082f0 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f060710b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0600112a80 con 0x7f06001029c0 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f06056a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600108c40 0x7f06000ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f06056a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600108c40 0x7f06000ff370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54218/0 (socket says 172.21.15.49:54218) 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f06056a8640 1 -- 172.21.15.49:0/3198660737 learned_addr learned my addr 172.21.15.49:0/3198660737 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f0604ea7640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06001029c0 0x7f06000fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.514+0000 7f05fffff640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001082f0 0x7f06000fee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f06056a8640 1 -- 172.21.15.49:0/3198660737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06001029c0 msgr2=0x7f06000fe8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f06056a8640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06001029c0 0x7f06000fe8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f06056a8640 1 -- 172.21.15.49:0/3198660737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001082f0 msgr2=0x7f06000fee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f06056a8640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001082f0 0x7f06000fee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f06056a8640 1 -- 172.21.15.49:0/3198660737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06001a8700 con 0x7f0600108c40 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f06056a8640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600108c40 0x7f06000ff370 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f05f800eb10 tx=0x7f05f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f05fdffb640 1 -- 172.21.15.49:0/3198660737 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8004b20 con 0x7f0600108c40 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f05fdffb640 1 -- 172.21.15.49:0/3198660737 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f8004cc0 con 0x7f0600108c40 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06001a89f0 con 0x7f0600108c40 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.515+0000 7f05fdffb640 1 -- 172.21.15.49:0/3198660737 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f8010670 con 0x7f0600108c40 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.516+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06001a8f40 con 0x7f0600108c40 2024-09-21T06:36:36.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.517+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0600102dd0 con 0x7f0600108c40 2024-09-21T06:36:36.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.519+0000 7f05fdffb640 1 -- 172.21.15.49:0/3198660737 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 22) ==== 154529+0+0 (secure 0 0 0) 0x7f05f8005000 con 0x7f0600108c40 2024-09-21T06:36:36.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.519+0000 7f05fdffb640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6610 0x7f05ec0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.520+0000 7f05fdffb640 1 -- 172.21.15.49:0/3198660737 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f05f80e79a0 con 0x7f0600108c40 2024-09-21T06:36:36.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.520+0000 7f0604ea7640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6610 0x7f05ec0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.520+0000 7f0604ea7640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6610 0x7f05ec0b8b20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c00 tx=0x7f05f0031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:36.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.524+0000 7f05fdffb640 1 -- 172.21.15.49:0/3198660737 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05f80ae0f0 con 0x7f0600108c40 2024-09-21T06:36:36.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:36:36.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.564+0000 7f05fdffb640 1 -- 172.21.15.49:0/3198660737 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mgrmap(e 23) ==== 154586+0+0 (secure 0 0 0) 0x7f05f80a9c60 con 0x7f0600108c40 2024-09-21T06:36:36.650 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:36 smithi049 ceph-mon[31177]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:36.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.748+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f0600063800 con 0x7f05ec0b6610 2024-09-21T06:36:36.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.756+0000 7f05fdffb640 1 -- 172.21.15.49:0/3198660737 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f0600063800 con 0x7f05ec0b6610 2024-09-21T06:36:36.758 INFO:teuthology.orchestra.run.smithi049.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T06:36:35", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T06:36:36.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.758+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6610 msgr2=0x7f05ec0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.758+0000 7f060710b640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6610 0x7f05ec0b8b20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f05f0000c00 tx=0x7f05f0031400 comp rx=0 tx=0).stop 2024-09-21T06:36:36.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.758+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600108c40 msgr2=0x7f06000ff370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.758+0000 7f060710b640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600108c40 0x7f06000ff370 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f05f800eb10 tx=0x7f05f800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.759+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 shutdown_connections 2024-09-21T06:36:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.759+0000 7f060710b640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05ec0b6610 0x7f05ec0b8b20 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.759+0000 7f060710b640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0600108c40 0x7f06000ff370 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.759+0000 7f060710b640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f06001082f0 0x7f06000fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.759+0000 7f060710b640 1 --2- 172.21.15.49:0/3198660737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f06001029c0 0x7f06000fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.759+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 >> 172.21.15.49:0/3198660737 conn(0x7f06000fe3c0 msgr2=0x7f060006b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.759+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 shutdown_connections 2024-09-21T06:36:36.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.759+0000 7f060710b640 1 -- 172.21.15.49:0/3198660737 wait complete. 2024-09-21T06:36:36.774 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T06:36:36.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:36 smithi079 ceph-mon[34346]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:36.822 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.940+0000 7f2830edc640 1 -- 172.21.15.49:0/936730619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109420 msgr2=0x7f282c109830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.940+0000 7f2830edc640 1 --2- 172.21.15.49:0/936730619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109420 0x7f282c109830 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2820009900 tx=0x7f282002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.940+0000 7f2830edc640 1 -- 172.21.15.49:0/936730619 shutdown_connections 2024-09-21T06:36:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.940+0000 7f2830edc640 1 --2- 172.21.15.49:0/936730619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c109d70 0x7f282c1105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.940+0000 7f2830edc640 1 --2- 172.21.15.49:0/936730619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109420 0x7f282c109830 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.940+0000 7f2830edc640 1 --2- 172.21.15.49:0/936730619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c103af0 0x7f282c103f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.940+0000 7f2830edc640 1 -- 172.21.15.49:0/936730619 >> 172.21.15.49:0/936730619 conn(0x7f282c0ff570 msgr2=0x7f282c1019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.940+0000 7f2830edc640 1 -- 172.21.15.49:0/936730619 shutdown_connections 2024-09-21T06:36:36.942 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.940+0000 7f2830edc640 1 -- 172.21.15.49:0/936730619 wait complete. 2024-09-21T06:36:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f2830edc640 1 Processor -- start 2024-09-21T06:36:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f2830edc640 1 -- start start 2024-09-21T06:36:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f2830edc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c103af0 0x7f282c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f2830edc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c109420 0x7f282c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f2830edc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109d70 0x7f282c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f2830edc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f282c113a30 con 0x7f282c109d70 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f2830edc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f282c1138b0 con 0x7f282c109420 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f2830edc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f282c113bb0 con 0x7f282c103af0 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f282ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109d70 0x7f282c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f282ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109d70 0x7f282c19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54238/0 (socket says 172.21.15.49:54238) 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f282ad9d640 1 -- 172.21.15.49:0/4053198883 learned_addr learned my addr 172.21.15.49:0/4053198883 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f2829d9b640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c109420 0x7f282c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.941+0000 7f282a59c640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c103af0 0x7f282c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f282ad9d640 1 -- 172.21.15.49:0/4053198883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c103af0 msgr2=0x7f282c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f282ad9d640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c103af0 0x7f282c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f282ad9d640 1 -- 172.21.15.49:0/4053198883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c109420 msgr2=0x7f282c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f282ad9d640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c109420 0x7f282c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f282ad9d640 1 -- 172.21.15.49:0/4053198883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c1a0400 con 0x7f282c109d70 2024-09-21T06:36:36.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f282ad9d640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109d70 0x7f282c19fd00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2824009fd0 tx=0x7f282400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f281b7fe640 1 -- 172.21.15.49:0/4053198883 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824017070 con 0x7f282c109d70 2024-09-21T06:36:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282c1a06f0 con 0x7f282c109d70 2024-09-21T06:36:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f281b7fe640 1 -- 172.21.15.49:0/4053198883 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2824003e20 con 0x7f282c109d70 2024-09-21T06:36:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f281b7fe640 1 -- 172.21.15.49:0/4053198883 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824010460 con 0x7f282c109d70 2024-09-21T06:36:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.942+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282c1a6e80 con 0x7f282c109d70 2024-09-21T06:36:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.943+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282c104d60 con 0x7f282c109d70 2024-09-21T06:36:36.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.945+0000 7f281b7fe640 1 -- 172.21.15.49:0/4053198883 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) ==== 154586+0+0 (secure 0 0 0) 0x7f2824003970 con 0x7f282c109d70 2024-09-21T06:36:36.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.946+0000 7f281b7fe640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28140b65f0 0x7f28140b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:36.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.946+0000 7f282a59c640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28140b65f0 0x7f28140b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:36.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.946+0000 7f281b7fe640 1 -- 172.21.15.49:0/4053198883 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f28240e7640 con 0x7f282c109d70 2024-09-21T06:36:36.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.946+0000 7f282a59c640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28140b65f0 0x7f28140b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f281c00bbe0 tx=0x7f281c00b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:36.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:36.953+0000 7f281b7fe640 1 -- 172.21.15.49:0/4053198883 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28240b2010 con 0x7f282c109d70 2024-09-21T06:36:37.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:36 smithi098 ceph-mon[34704]: from='client.15435 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:37.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.170+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f282c063800 con 0x7f28140b65f0 2024-09-21T06:36:37.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.178+0000 7f281b7fe640 1 -- 172.21.15.49:0/4053198883 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f282c063800 con 0x7f28140b65f0 2024-09-21T06:36:37.180 INFO:teuthology.orchestra.run.smithi049.stdout:/ 1m 6m3h 2024-09-21T06:36:37.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28140b65f0 msgr2=0x7f28140b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28140b65f0 0x7f28140b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f281c00bbe0 tx=0x7f281c00b390 comp rx=0 tx=0).stop 2024-09-21T06:36:37.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109d70 msgr2=0x7f282c19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109d70 0x7f282c19fd00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2824009fd0 tx=0x7f282400b260 comp rx=0 tx=0).stop 2024-09-21T06:36:37.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 shutdown_connections 2024-09-21T06:36:37.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28140b65f0 0x7f28140b8b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c109d70 0x7f282c19fd00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c109420 0x7f282c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 --2- 172.21.15.49:0/4053198883 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c103af0 0x7f282c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 >> 172.21.15.49:0/4053198883 conn(0x7f282c0ff570 msgr2=0x7f282c101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:37.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.180+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 shutdown_connections 2024-09-21T06:36:37.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.181+0000 7f2830edc640 1 -- 172.21.15.49:0/4053198883 wait complete. 2024-09-21T06:36:37.197 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T06:36:37.268 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T06:36:37.278 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T06:36:37.289 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:36:37.289 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T06:36:37.311 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T06:36:37.327 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:36:37.327 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T06:36:37.327 INFO:tasks.workunit:timeout=3h 2024-09-21T06:36:37.327 INFO:tasks.workunit:cleanup=True 2024-09-21T06:36:37.328 DEBUG:teuthology.orchestra.run.smithi049:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:37.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.342+0000 7f8b698fb640 1 -- 172.21.15.49:0/3984245698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 msgr2=0x7f8b64102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.342+0000 7f8b698fb640 1 --2- 172.21.15.49:0/3984245698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 0x7f8b64102a60 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009900 tx=0x7f8b5402a480 comp rx=0 tx=0).stop 2024-09-21T06:36:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.342+0000 7f8b698fb640 1 -- 172.21.15.49:0/3984245698 shutdown_connections 2024-09-21T06:36:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.342+0000 7f8b698fb640 1 --2- 172.21.15.49:0/3984245698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64110200 0x7f8b64112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.342+0000 7f8b698fb640 1 --2- 172.21.15.49:0/3984245698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64102fa0 0x7f8b6410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.342+0000 7f8b698fb640 1 --2- 172.21.15.49:0/3984245698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 0x7f8b64102a60 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.342+0000 7f8b698fb640 1 -- 172.21.15.49:0/3984245698 >> 172.21.15.49:0/3984245698 conn(0x7f8b64079730 msgr2=0x7f8b64079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.342+0000 7f8b698fb640 1 -- 172.21.15.49:0/3984245698 shutdown_connections 2024-09-21T06:36:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.342+0000 7f8b698fb640 1 -- 172.21.15.49:0/3984245698 wait complete. 2024-09-21T06:36:37.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.343+0000 7f8b698fb640 1 Processor -- start 2024-09-21T06:36:37.346 INFO:teuthology.orchestra.run.smithi049.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:37.346 INFO:teuthology.orchestra.run.smithi049.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T06:36:37.346 INFO:teuthology.orchestra.run.smithi049.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T06:36:37.346 INFO:teuthology.orchestra.run.smithi049.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:36:37.346 INFO:teuthology.orchestra.run.smithi049.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T06:36:37.346 INFO:teuthology.orchestra.run.smithi049.stdout:Access: 2024-09-21 06:35:01.492565515 +0000 2024-09-21T06:36:37.346 INFO:teuthology.orchestra.run.smithi049.stdout:Modify: 2024-09-21 06:35:01.492565515 +0000 2024-09-21T06:36:37.346 INFO:teuthology.orchestra.run.smithi049.stdout:Change: 2024-09-21 06:36:26.525589878 +0000 2024-09-21T06:36:37.347 INFO:teuthology.orchestra.run.smithi049.stdout: Birth: 2024-09-21 06:35:01.492565515 +0000 2024-09-21T06:36:37.347 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:37.347 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T06:36:37.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.343+0000 7f8b698fb640 1 -- start start 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b698fb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 0x7f8b6419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b698fb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64102fa0 0x7f8b6419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b698fb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64110200 0x7f8b641a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b698fb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64115c70 con 0x7f8b64102650 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b698fb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64115af0 con 0x7f8b64102fa0 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b698fb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64115df0 con 0x7f8b64110200 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b62ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 0x7f8b6419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b62ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 0x7f8b6419c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54260/0 (socket says 172.21.15.49:54260) 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b62ffd640 1 -- 172.21.15.49:0/1242209620 learned_addr learned my addr 172.21.15.49:0/1242209620 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b637fe640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64110200 0x7f8b641a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b627fc640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64102fa0 0x7f8b6419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b637fe640 1 -- 172.21.15.49:0/1242209620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64102fa0 msgr2=0x7f8b6419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b637fe640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64102fa0 0x7f8b6419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b637fe640 1 -- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 msgr2=0x7f8b6419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b637fe640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 0x7f8b6419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b637fe640 1 -- 172.21.15.49:0/1242209620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b641a25b0 con 0x7f8b64110200 2024-09-21T06:36:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 0x7f8b6419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.344+0000 7f8b627fc640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64102fa0 0x7f8b6419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.345+0000 7f8b637fe640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64110200 0x7f8b641a1e80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009fd0 tx=0x7f8b5c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.345+0000 7f8b688f9640 1 -- 172.21.15.49:0/1242209620 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c00ce20 con 0x7f8b64110200 2024-09-21T06:36:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.345+0000 7f8b698fb640 1 -- 172.21.15.49:0/1242209620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b641a28a0 con 0x7f8b64110200 2024-09-21T06:36:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.345+0000 7f8b698fb640 1 -- 172.21.15.49:0/1242209620 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b641a9000 con 0x7f8b64110200 2024-09-21T06:36:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.345+0000 7f8b688f9640 1 -- 172.21.15.49:0/1242209620 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b5c005020 con 0x7f8b64110200 2024-09-21T06:36:37.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.345+0000 7f8b688f9640 1 -- 172.21.15.49:0/1242209620 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c010690 con 0x7f8b64110200 2024-09-21T06:36:37.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.348+0000 7f8b6fe6f740 1 Processor -- start 2024-09-21T06:36:37.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.349+0000 7f8b688f9640 1 -- 172.21.15.49:0/1242209620 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 23) ==== 154586+0+0 (secure 0 0 0) 0x7f8b5c004b20 con 0x7f8b64110200 2024-09-21T06:36:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.349+0000 7f8b6fe6f740 1 -- start start 2024-09-21T06:36:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.350+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8b2070 0x55961cc59650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.350+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 0x55961cc59b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.350+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c891390 0x55961cc5a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.350+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55961cbcfe50 con 0x55961c8b2070 2024-09-21T06:36:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.350+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55961cbbf280 con 0x55961c8891b0 2024-09-21T06:36:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.350+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55961cbc3090 con 0x55961c891390 2024-09-21T06:36:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.350+0000 7f8b688f9640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8b4c0b6670 0x7f8b4c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.350+0000 7f8b627fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8b2070 0x55961cc59650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b627fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8b2070 0x55961cc59650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54274/0 (socket says 172.21.15.49:54274) 2024-09-21T06:36:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b627fc640 1 -- 172.21.15.49:0/628718086 learned_addr learned my addr 172.21.15.49:0/628718086 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/628718086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 0x55961cc59b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b637fe640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8b4c0b6670 0x7f8b4c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b688f9640 1 -- 172.21.15.49:0/1242209620 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8b5c0e7c50 con 0x7f8b64110200 2024-09-21T06:36:37.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b627fc640 1 -- 172.21.15.49:0/628718086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c891390 msgr2=0x55961cc5a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b627fc640 1 --2- 172.21.15.49:0/628718086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c891390 0x55961cc5a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b627fc640 1 -- 172.21.15.49:0/628718086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 msgr2=0x55961cc59b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b627fc640 1 --2- 172.21.15.49:0/628718086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 0x55961cc59b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b627fc640 1 -- 172.21.15.49:0/628718086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961c91d650 con 0x55961c8b2070 2024-09-21T06:36:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b637fe640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8b4c0b6670 0x7f8b4c0b8b80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c000f80 tx=0x7f8b5c005f70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.351+0000 7f8b627fc640 1 --2- 172.21.15.49:0/628718086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8b2070 0x55961cc59650 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800bdc0 tx=0x7f8b580117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948608c4853d7a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.352+0000 7f8b49ffb640 1 -- 172.21.15.49:0/628718086 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58005220 con 0x55961c8b2070 2024-09-21T06:36:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.352+0000 7f8b49ffb640 1 -- 172.21.15.49:0/628718086 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b58016070 con 0x55961c8b2070 2024-09-21T06:36:37.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.352+0000 7f8b49ffb640 1 -- 172.21.15.49:0/628718086 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b580126b0 con 0x55961c8b2070 2024-09-21T06:36:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/628718086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8b2070 msgr2=0x55961cc59650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/628718086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8b2070 0x55961cc59650 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8b5800bdc0 tx=0x7f8b580117b0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/628718086 shutdown_connections 2024-09-21T06:36:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/628718086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c891390 0x55961cc5a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/628718086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 0x55961cc59b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/628718086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8b2070 0x55961cc59650 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/628718086 >> 172.21.15.49:0/628718086 conn(0x55961c8a6460 msgr2=0x55961cc57540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/628718086 shutdown_connections 2024-09-21T06:36:37.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/628718086 wait complete. 2024-09-21T06:36:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.353+0000 7f8b6fe6f740 1 -- start start 2024-09-21T06:36:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.354+0000 7f8b6fe6f740 1 Processor -- start 2024-09-21T06:36:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.354+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 0x55961cc64ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.354+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c891390 0x55961cc65220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.354+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 0x55961cc657a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.354+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55961ca20700 con 0x55961c891390 2024-09-21T06:36:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.354+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55961cb5a110 con 0x55961c8891b0 2024-09-21T06:36:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.354+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55961cc67e30 con 0x55961c8b2070 2024-09-21T06:36:37.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b6fe6f740 10 client.0 _ll_register_callbacks cb 0x55961cb73990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b627fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 0x55961cc64ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b627fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 0x55961cc64ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:47228/0 (socket says 172.21.15.49:47228) 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b627fc640 1 -- 172.21.15.49:0/924843828 learned_addr learned my addr 172.21.15.49:0/924843828 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c891390 0x55961cc65220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b627fc640 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 0x55961cc657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b62ffd640 1 -- 172.21.15.49:0/924843828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 msgr2=0x55961cc657a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 0x55961cc657a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b62ffd640 1 -- 172.21.15.49:0/924843828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 msgr2=0x55961cc64ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 0x55961cc64ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.355+0000 7f8b62ffd640 1 -- 172.21.15.49:0/924843828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961cb87c40 con 0x55961c891390 2024-09-21T06:36:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.356+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c891390 0x55961cc65220 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b54004770 tx=0x7f8b54031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc346682f79e1d3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.356+0000 7f8b42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.356+0000 7f8b42ffd640 1 -- 172.21.15.49:0/924843828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54035040 con 0x55961c891390 2024-09-21T06:36:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.356+0000 7f8b42ffd640 1 -- 172.21.15.49:0/924843828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8b54004450 con 0x55961c891390 2024-09-21T06:36:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.356+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/924843828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b58016070 con 0x55961c891390 2024-09-21T06:36:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.357+0000 7f8b42ffd640 1 -- 172.21.15.49:0/924843828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b54005020 con 0x55961c891390 2024-09-21T06:36:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.357+0000 7f8b6fe6f740 10 client.15489 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:37.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.357+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/924843828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55961cc73ad0 con 0x55961c891390 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.357+0000 7f8b42ffd640 1 -- 172.21.15.49:0/924843828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b540047a0 con 0x55961c891390 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.357+0000 7f8b42ffd640 1 -- 172.21.15.49:0/924843828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8b540036a0 con 0x55961c891390 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.357+0000 7f8b6fe6f740 10 client.15489 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.357+0000 7f8b6fe6f740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.357+0000 7f8b6fe6f740 20 client.15489 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.358+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55961c8709f0 0x55961cc773a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.358+0000 7f8b6fe6f740 4 client.15489 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.358+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/924843828 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8b58016070 con 0x55961c8709f0 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.358+0000 7f8b627fc640 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55961c8709f0 0x55961cc773a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.358+0000 7f8b42ffd640 10 client.15489 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:37.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.358+0000 7f8b627fc640 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55961c8709f0 0x55961cc773a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a166724b941c5f12 server_cookie=5eab0406e08026ba in_seq=0 out_seq=0 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b42ffd640 1 -- 172.21.15.49:0/924843828 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8b58016070 con 0x55961c8709f0 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b42ffd640 10 client.15489 handle_command_reply: tid=0 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 client.15489 shutdown 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/924843828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c891390 msgr2=0x55961cc65220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c891390 0x55961cc65220 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b54004770 tx=0x7f8b54031810 comp rx=0 tx=0).stop 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/924843828 shutdown_connections 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55961c8709f0 0x55961cc773a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 0x55961cc657a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c891390 0x55961cc65220 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/924843828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8891b0 0x55961cc64ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b42ffd640 0 client.15489 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:37.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/924843828 >> 172.21.15.49:0/924843828 conn(0x55961c8a6460 msgr2=0x55961cc5c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:37.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/924843828 shutdown_connections 2024-09-21T06:36:37.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.360+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/924843828 wait complete. 2024-09-21T06:36:37.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.361+0000 7f8b6fe6f740 20 client.15489 trim_cache size 0 max 16384 2024-09-21T06:36:37.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b6fe6f740 1 Processor -- start 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b6fe6f740 1 -- start start 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc56b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8b2070 0x55961cc570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c845da0 0x55961cc61ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b4390 con 0x55961c8891b0 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b1c60 con 0x55961c8b2070 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641afad0 con 0x55961c845da0 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b627fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc56b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b627fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc56b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54288/0 (socket says 172.21.15.49:54288) 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b627fc640 1 -- 172.21.15.49:0/2367377309 learned_addr learned my addr 172.21.15.49:0/2367377309 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:37.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.379+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8b2070 0x55961cc570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b627fc640 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c845da0 0x55961cc61ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b627fc640 1 -- 172.21.15.49:0/2367377309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c845da0 msgr2=0x55961cc61ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b627fc640 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c845da0 0x55961cc61ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b627fc640 1 -- 172.21.15.49:0/2367377309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8b2070 msgr2=0x55961cc570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b627fc640 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8b2070 0x55961cc570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b627fc640 1 -- 172.21.15.49:0/2367377309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55961cc5a460 con 0x55961c8891b0 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8b2070 0x55961cc570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b627fc640 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc56b70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8b58011cb0 tx=0x7f8b5800beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18950ec8e1a77bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b497fa640 1 -- 172.21.15.49:0/2367377309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58023040 con 0x55961c8891b0 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b497fa640 1 -- 172.21.15.49:0/2367377309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b58016070 con 0x55961c8891b0 2024-09-21T06:36:37.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.380+0000 7f8b497fa640 1 -- 172.21.15.49:0/2367377309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b580298e0 con 0x55961c8891b0 2024-09-21T06:36:37.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.381+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/2367377309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 msgr2=0x55961cc56b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.381+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc56b70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8b58011cb0 tx=0x7f8b5800beb0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.385 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.381+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/2367377309 shutdown_connections 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.381+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c845da0 0x55961cc61ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.381+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c8b2070 0x55961cc570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.381+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/2367377309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc56b70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.381+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/2367377309 >> 172.21.15.49:0/2367377309 conn(0x55961c8a6460 msgr2=0x55961cc63560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.381+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/2367377309 shutdown_connections 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.381+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/2367377309 wait complete. 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b6fe6f740 1 -- start start 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b6fe6f740 1 Processor -- start 2024-09-21T06:36:37.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c845da0 0x55961cc7b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc7b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b6fe6f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 0x55961cce0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b0120 con 0x55961c8891b0 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b1590 con 0x55961c845da0 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b6fe6f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b07f0 con 0x55961c8b2070 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b6fe6f740 10 client.0 _ll_register_callbacks cb 0x7f8b54005e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b62ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc7b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b62ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc7b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:54296/0 (socket says 172.21.15.49:54296) 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b62ffd640 1 -- 172.21.15.49:0/3748821892 learned_addr learned my addr 172.21.15.49:0/3748821892 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.382+0000 7f8b627fc640 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c845da0 0x55961cc7b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b627fc640 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 0x55961cce0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b62ffd640 1 -- 172.21.15.49:0/3748821892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 msgr2=0x55961cce0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 0x55961cce0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b62ffd640 1 -- 172.21.15.49:0/3748821892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c845da0 msgr2=0x55961cc7b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c845da0 0x55961cc7b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b62ffd640 1 -- 172.21.15.49:0/3748821892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55961cce1200 con 0x55961c8891b0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b62ffd640 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc7b700 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8b5403d470 tx=0x7f8b54004460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8208f8582db1714 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b42ffd640 1 -- 172.21.15.49:0/3748821892 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54053070 con 0x55961c8891b0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b42ffd640 1 -- 172.21.15.49:0/3748821892 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8b540051c0 con 0x55961c8891b0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.383+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/3748821892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b58016070 con 0x55961c8891b0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b42ffd640 1 -- 172.21.15.49:0/3748821892 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b54035040 con 0x55961c8891b0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b6fe6f740 10 client.15495 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/3748821892 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55961cce2490 con 0x55961c8891b0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b42ffd640 1 -- 172.21.15.49:0/3748821892 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b58016070 con 0x55961c8891b0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b42ffd640 1 -- 172.21.15.49:0/3748821892 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8b54004bf0 con 0x55961c8891b0 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b6fe6f740 10 client.15495 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:37.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b6fe6f740 10 client.15495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b6fe6f740 20 client.15495 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55961cce2c00 0x55961cce5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b6fe6f740 4 client.15495 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/3748821892 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55961cbd1da0 con 0x55961cce2c00 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.384+0000 7f8b627fc640 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55961cce2c00 0x55961cce5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b42ffd640 10 client.15495 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b627fc640 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55961cce2c00 0x55961cce5020 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb2610a2b3875757 server_cookie=afa392f8f980a854 in_seq=0 out_seq=0 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b42ffd640 1 -- 172.21.15.49:0/3748821892 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x55961cbd1da0 con 0x55961cce2c00 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b42ffd640 10 client.15495 handle_command_reply: tid=0 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b6fe6f740 1 client.15495 shutdown 2024-09-21T06:36:37.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/3748821892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 msgr2=0x55961cc7b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc7b700 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8b5403d470 tx=0x7f8b54004460 comp rx=0 tx=0).stop 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/3748821892 shutdown_connections 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55961cce2c00 0x55961cce5020 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55961c8b2070 0x55961cce0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55961c8891b0 0x55961cc7b700 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b6fe6f740 1 --2- 172.21.15.49:0/3748821892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55961c845da0 0x55961cc7b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/3748821892 >> 172.21.15.49:0/3748821892 conn(0x55961c8a6460 msgr2=0x55961cc70080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.385+0000 7f8b42ffd640 0 client.15495 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.386+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/3748821892 shutdown_connections 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.386+0000 7f8b6fe6f740 1 -- 172.21.15.49:0/3748821892 wait complete. 2024-09-21T06:36:37.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.386+0000 7f8b6fe6f740 20 client.15495 trim_cache size 0 max 16384 2024-09-21T06:36:37.394 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:36:37.394 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:36:37.394 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:36:37.394 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:36:37.394 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:36:37.394 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "9055b0bf-8dc8-4645-bf7b-fc2d221f9228", 2024-09-21T06:36:37.394 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:36:37.394 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:36:37.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:36:37.395 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:36:37.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.386+0000 7f8b698fb640 1 -- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8b4c0b6670 msgr2=0x7f8b4c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.386+0000 7f8b698fb640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8b4c0b6670 0x7f8b4c0b8b80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c000f80 tx=0x7f8b5c005f70 comp rx=0 tx=0).stop 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.386+0000 7f8b698fb640 1 -- 172.21.15.49:0/1242209620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64110200 msgr2=0x7f8b641a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.386+0000 7f8b698fb640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64110200 0x7f8b641a1e80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009fd0 tx=0x7f8b5c00ef10 comp rx=0 tx=0).stop 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.387+0000 7f8b698fb640 1 -- 172.21.15.49:0/1242209620 shutdown_connections 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.387+0000 7f8b698fb640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8b4c0b6670 0x7f8b4c0b8b80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.387+0000 7f8b698fb640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8b64110200 0x7f8b641a1e80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.387+0000 7f8b698fb640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8b64102fa0 0x7f8b6419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.387+0000 7f8b698fb640 1 --2- 172.21.15.49:0/1242209620 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8b64102650 0x7f8b6419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.387+0000 7f8b698fb640 1 -- 172.21.15.49:0/1242209620 >> 172.21.15.49:0/1242209620 conn(0x7f8b64079730 msgr2=0x7f8b64108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.387+0000 7f8b698fb640 1 -- 172.21.15.49:0/1242209620 shutdown_connections 2024-09-21T06:36:37.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:36:37.387+0000 7f8b698fb640 1 -- 172.21.15.49:0/1242209620 wait complete. 2024-09-21T06:36:37.404 INFO:tasks.workunit.client.0.smithi049.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T06:36:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:37 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:36:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:37 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:37 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:36:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:37 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:37 smithi079 ceph-mon[34346]: pgmap v318: 97 pgs: 97 active+clean; 651 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-21T06:36:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:37 smithi079 ceph-mon[34346]: from='client.15465 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:37 smithi079 ceph-mon[34346]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:36:37.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:37 smithi079 ceph-mon[34346]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:37 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:36:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:37 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:37 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:36:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:37 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:37 smithi049 ceph-mon[31177]: pgmap v318: 97 pgs: 97 active+clean; 651 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-21T06:36:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:37 smithi049 ceph-mon[31177]: from='client.15465 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:37 smithi049 ceph-mon[31177]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:36:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:37 smithi049 ceph-mon[31177]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:37 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:36:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:37 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:37 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:36:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:37 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:37 smithi098 ceph-mon[34704]: pgmap v318: 97 pgs: 97 active+clean; 651 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-21T06:36:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:37 smithi098 ceph-mon[34704]: from='client.15465 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:37 smithi098 ceph-mon[34704]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:36:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:37 smithi098 ceph-mon[34704]: from='client.15471 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:38.117 INFO:tasks.cephfs.filesystem:scrub status for tag:9055b0bf-8dc8-4645-bf7b-fc2d221f9228 - {'path': '/', 'tag': '9055b0bf-8dc8-4645-bf7b-fc2d221f9228', 'options': 'recursive,force'} 2024-09-21T06:36:38.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:38 smithi079 ceph-mon[34346]: from='client.15477 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:38.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:38 smithi049 ceph-mon[31177]: from='client.15477 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:39.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:38 smithi098 ceph-mon[34704]: from='client.15477 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:39.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:39 smithi079 ceph-mon[34346]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:36:39.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:39 smithi049 ceph-mon[31177]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:36:40.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:39 smithi098 ceph-mon[34704]: pgmap v319: 97 pgs: 97 active+clean; 1.4 MiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:36:41.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:41 smithi079 ceph-mon[34346]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:36:41.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:41 smithi049 ceph-mon[31177]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:36:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:41 smithi098 ceph-mon[34704]: pgmap v320: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:36:43.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:43 smithi079 ceph-mon[34346]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T06:36:43.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:43 smithi049 ceph-mon[31177]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T06:36:44.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:43 smithi098 ceph-mon[34704]: pgmap v321: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 53 op/s 2024-09-21T06:36:45.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:45 smithi079 ceph-mon[34346]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:36:45.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:45 smithi049 ceph-mon[31177]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:36:46.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:45 smithi098 ceph-mon[34704]: pgmap v322: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:36:47.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:47 smithi049 ceph-mon[31177]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 51 op/s 2024-09-21T06:36:48.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:47 smithi098 ceph-mon[34704]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 51 op/s 2024-09-21T06:36:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:47 smithi079 ceph-mon[34346]: pgmap v323: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 175 KiB/s wr, 51 op/s 2024-09-21T06:36:48.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:48 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:36:48.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:48 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:36:49.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:48 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:36:49.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:48 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:36:49.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:48 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:36:49.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:48 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:36:49.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:49 smithi098 ceph-mon[34704]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:36:49.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:49 smithi049 ceph-mon[31177]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:36:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:49 smithi079 ceph-mon[34346]: pgmap v324: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:36:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.457+0000 7f89adfcc640 1 -- 172.21.15.49:0/1369403965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a81047d0 msgr2=0x7f89a8104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.457+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1369403965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a81047d0 0x7f89a8104be0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8998009900 tx=0x7f899802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.457+0000 7f89adfcc640 1 -- 172.21.15.49:0/1369403965 shutdown_connections 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.457+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1369403965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89a810dd80 0x7f89a8110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.457+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1369403965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a8105200 0x7f89a810d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.457+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1369403965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a81047d0 0x7f89a8104be0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.457+0000 7f89adfcc640 1 -- 172.21.15.49:0/1369403965 >> 172.21.15.49:0/1369403965 conn(0x7f89a80fe3c0 msgr2=0x7f89a8100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.457+0000 7f89adfcc640 1 -- 172.21.15.49:0/1369403965 shutdown_connections 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.457+0000 7f89adfcc640 1 -- 172.21.15.49:0/1369403965 wait complete. 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.458+0000 7f89adfcc640 1 Processor -- start 2024-09-21T06:36:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.458+0000 7f89adfcc640 1 -- start start 2024-09-21T06:36:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.458+0000 7f89adfcc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a81047d0 0x7f89a819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.458+0000 7f89adfcc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8105200 0x7f89a819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.458+0000 7f89adfcc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89a810dd80 0x7f89a819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89adfcc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f89a81139e0 con 0x7f89a8105200 2024-09-21T06:36:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89adfcc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89a8113860 con 0x7f89a81047d0 2024-09-21T06:36:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89adfcc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f89a8113b60 con 0x7f89a810dd80 2024-09-21T06:36:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f899effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8105200 0x7f89a819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89a77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a81047d0 0x7f89a819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f899effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8105200 0x7f89a819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56778/0 (socket says 172.21.15.49:56778) 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f899effd640 1 -- 172.21.15.49:0/1311052715 learned_addr learned my addr 172.21.15.49:0/1311052715 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89a7fff640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89a810dd80 0x7f89a819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f899effd640 1 -- 172.21.15.49:0/1311052715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89a810dd80 msgr2=0x7f89a819fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f899effd640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89a810dd80 0x7f89a819fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f899effd640 1 -- 172.21.15.49:0/1311052715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a81047d0 msgr2=0x7f89a819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f899effd640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a81047d0 0x7f89a819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f899effd640 1 -- 172.21.15.49:0/1311052715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a81a02f0 con 0x7f89a8105200 2024-09-21T06:36:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f899effd640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8105200 0x7f89a819a960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f899000e9f0 tx=0x7f899000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89a57fa640 1 -- 172.21.15.49:0/1311052715 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899000ccc0 con 0x7f89a8105200 2024-09-21T06:36:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89a57fa640 1 -- 172.21.15.49:0/1311052715 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89900035f0 con 0x7f89a8105200 2024-09-21T06:36:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89adfcc640 1 -- 172.21.15.49:0/1311052715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a81a05e0 con 0x7f89a8105200 2024-09-21T06:36:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89a57fa640 1 -- 172.21.15.49:0/1311052715 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899000ce60 con 0x7f89a8105200 2024-09-21T06:36:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.459+0000 7f89adfcc640 1 -- 172.21.15.49:0/1311052715 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a81a6d70 con 0x7f89a8105200 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89b5014740 1 Processor -- start 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89b5014740 1 -- start start 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89a57fa640 1 -- 172.21.15.49:0/1311052715 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 23) ==== 154586+0+0 (secure 0 0 0) 0x7f8990003aa0 con 0x7f89a8105200 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89b5014740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631feb9e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89b5014740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631feb9eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89b5014740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feb9f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89b5014740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5631feb136f0 con 0x5631fe7d84d0 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89b5014740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5631feb02b20 con 0x5631fe7d02f0 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89b5014740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5631feb06930 con 0x5631fe7f91b0 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f899effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feb9f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89a7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631feb9e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89a7fff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631feb9e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:59068/0 (socket says 172.21.15.49:59068) 2024-09-21T06:36:50.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f899effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feb9f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56786/0 (socket says 172.21.15.49:56786) 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.462+0000 7f89a7fff640 1 -- 172.21.15.49:0/2450880025 learned_addr learned my addr 172.21.15.49:0/2450880025 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a77fe640 1 --2- 172.21.15.49:0/2450880025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631feb9eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a7fff640 1 -- 172.21.15.49:0/2450880025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 msgr2=0x5631feb9eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a7fff640 1 --2- 172.21.15.49:0/2450880025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631feb9eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a7fff640 1 -- 172.21.15.49:0/2450880025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 msgr2=0x5631feb9f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a7fff640 1 --2- 172.21.15.49:0/2450880025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feb9f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a7fff640 1 -- 172.21.15.49:0/2450880025 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631feac8530 con 0x5631fe7f91b0 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a7fff640 1 --2- 172.21.15.49:0/2450880025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631feb9e9b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f89a0011440 tx=0x7f89a0011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=903a64b8126da4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a57fa640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f89940b65f0 0x7f89940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f899dffb640 1 -- 172.21.15.49:0/2450880025 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a0004d20 con 0x5631fe7f91b0 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f899dffb640 1 -- 172.21.15.49:0/2450880025 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89a0004050 con 0x5631fe7f91b0 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f899dffb640 1 -- 172.21.15.49:0/2450880025 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a000f7a0 con 0x5631fe7f91b0 2024-09-21T06:36:50.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a77fe640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f89940b65f0 0x7f89940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.463+0000 7f89a57fa640 1 -- 172.21.15.49:0/1311052715 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f89900e7940 con 0x7f89a8105200 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89a77fe640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f89940b65f0 0x7f89940b8b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8998031440 tx=0x7f8998009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89b5014740 1 -- 172.21.15.49:0/2450880025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 msgr2=0x5631feb9e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89b5014740 1 --2- 172.21.15.49:0/2450880025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631feb9e9b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f89a0011440 tx=0x7f89a0011900 comp rx=0 tx=0).stop 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89b5014740 1 -- 172.21.15.49:0/2450880025 shutdown_connections 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89b5014740 1 --2- 172.21.15.49:0/2450880025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feb9f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89b5014740 1 --2- 172.21.15.49:0/2450880025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631feb9eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89b5014740 1 --2- 172.21.15.49:0/2450880025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631feb9e9b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89b5014740 1 -- 172.21.15.49:0/2450880025 >> 172.21.15.49:0/2450880025 conn(0x5631fe7ed300 msgr2=0x5631feb9c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89b5014740 1 -- 172.21.15.49:0/2450880025 shutdown_connections 2024-09-21T06:36:50.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.464+0000 7f89b5014740 1 -- 172.21.15.49:0/2450880025 wait complete. 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89b5014740 1 -- start start 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89b5014740 1 Processor -- start 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89b5014740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89b5014740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631febae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89b5014740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631febba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89b5014740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5631fea3aab0 con 0x5631fe7d84d0 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89b5014740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5631feaa8730 con 0x5631fe7d02f0 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89b5014740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5631febb1510 con 0x5631fe7f91b0 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89b5014740 10 client.0 _ll_register_callbacks cb 0x5631feafc6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f899effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631febae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f899effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631febae9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56802/0 (socket says 172.21.15.49:56802) 2024-09-21T06:36:50.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f899effd640 1 -- 172.21.15.49:0/3044840095 learned_addr learned my addr 172.21.15.49:0/3044840095 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89a7fff640 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631febba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.465+0000 7f89a77fe640 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f899effd640 1 -- 172.21.15.49:0/3044840095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 msgr2=0x5631febba8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f899effd640 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631febba8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f899effd640 1 -- 172.21.15.49:0/3044840095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 msgr2=0x5631febae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f899effd640 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f899effd640 1 -- 172.21.15.49:0/3044840095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fe864790 con 0x5631fe7d84d0 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f899effd640 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631febae9d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f89900a9e00 tx=0x7f89900a9e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8432b130a7555caa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f8986ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f8986ffd640 1 -- 172.21.15.49:0/3044840095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89900ad600 con 0x5631fe7d84d0 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f8986ffd640 1 -- 172.21.15.49:0/3044840095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f89900aeb60 con 0x5631fe7d84d0 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f89b5014740 1 -- 172.21.15.49:0/3044840095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89a0004050 con 0x5631fe7d84d0 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f8986ffd640 1 -- 172.21.15.49:0/3044840095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f89900acfa0 con 0x5631fe7d84d0 2024-09-21T06:36:50.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f89b5014740 10 client.15507 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f89b5014740 1 -- 172.21.15.49:0/3044840095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631fe8dd620 con 0x5631fe7d84d0 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.466+0000 7f8986ffd640 1 -- 172.21.15.49:0/3044840095 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89a0004050 con 0x5631fe7d84d0 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f8986ffd640 1 -- 172.21.15.49:0/3044840095 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8990003fb0 con 0x5631fe7d84d0 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f89b5014740 10 client.15507 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f89b5014740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f89b5014740 20 client.15507 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f89b5014740 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631fe7b7d80 0x5631febc06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f89b5014740 4 client.15507 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f89b5014740 1 -- 172.21.15.49:0/3044840095 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631feb15640 con 0x5631fe7b7d80 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f89a77fe640 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631fe7b7d80 0x5631febc06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f8986ffd640 10 client.15507 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.467+0000 7f89a77fe640 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631fe7b7d80 0x5631febc06a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7f1eb2d17495f97 server_cookie=fffb4bb59665dd52 in_seq=0 out_seq=0 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f8986ffd640 1 -- 172.21.15.49:0/3044840095 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631feb15640 con 0x5631fe7b7d80 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f8986ffd640 10 client.15507 handle_command_reply: tid=0 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 client.15507 shutdown 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 -- 172.21.15.49:0/3044840095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 msgr2=0x5631febae9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631febae9d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f89900a9e00 tx=0x7f89900a9e80 comp rx=0 tx=0).stop 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 -- 172.21.15.49:0/3044840095 shutdown_connections 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631fe7b7d80 0x5631febc06a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7f91b0 0x5631febba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631febae9d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f8986ffd640 0 client.15507 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 --2- 172.21.15.49:0/3044840095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 -- 172.21.15.49:0/3044840095 >> 172.21.15.49:0/3044840095 conn(0x5631fe7ed300 msgr2=0x5631feb9aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 -- 172.21.15.49:0/3044840095 shutdown_connections 2024-09-21T06:36:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 1 -- 172.21.15.49:0/3044840095 wait complete. 2024-09-21T06:36:50.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.468+0000 7f89b5014740 20 client.15507 trim_cache size 0 max 16384 2024-09-21T06:36:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f89b5014740 1 Processor -- start 2024-09-21T06:36:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f89b5014740 1 -- start start 2024-09-21T06:36:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f89b5014740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d02f0 0x5631febb0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f89b5014740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feba9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f89b5014740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7f91b0 0x5631febba7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f89b5014740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f89a81afe60 con 0x5631fe7d84d0 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f89b5014740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89a81ad730 con 0x5631fe7f91b0 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f89b5014740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f89a81ab5a0 con 0x5631fe7d02f0 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f899effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feba9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f899effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feba9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56818/0 (socket says 172.21.15.49:56818) 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f899effd640 1 -- 172.21.15.49:0/2526847741 learned_addr learned my addr 172.21.15.49:0/2526847741 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.483+0000 7f89a77fe640 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d02f0 0x5631febb0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f89a7fff640 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7f91b0 0x5631febba7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f899effd640 1 -- 172.21.15.49:0/2526847741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d02f0 msgr2=0x5631febb0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f899effd640 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d02f0 0x5631febb0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f899effd640 1 -- 172.21.15.49:0/2526847741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7f91b0 msgr2=0x5631febba7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f899effd640 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7f91b0 0x5631febba7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f899effd640 1 -- 172.21.15.49:0/2526847741 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631febc0a10 con 0x5631fe7d84d0 2024-09-21T06:36:50.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f89a7fff640 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7f91b0 0x5631febba7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f899effd640 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feba9800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f89900aaaa0 tx=0x7f89900a9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6aae3b39fed6489 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f899d7fa640 1 -- 172.21.15.49:0/2526847741 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89900ad180 con 0x5631fe7d84d0 2024-09-21T06:36:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f899d7fa640 1 -- 172.21.15.49:0/2526847741 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89900b7250 con 0x5631fe7d84d0 2024-09-21T06:36:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.484+0000 7f899d7fa640 1 -- 172.21.15.49:0/2526847741 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89900b2310 con 0x5631fe7d84d0 2024-09-21T06:36:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 -- 172.21.15.49:0/2526847741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 msgr2=0x5631feba9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feba9800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f89900aaaa0 tx=0x7f89900a9fb0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 -- 172.21.15.49:0/2526847741 shutdown_connections 2024-09-21T06:36:50.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7f91b0 0x5631febba7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7d84d0 0x5631feba9800 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 --2- 172.21.15.49:0/2526847741 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d02f0 0x5631febb0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 -- 172.21.15.49:0/2526847741 >> 172.21.15.49:0/2526847741 conn(0x5631fe7ed300 msgr2=0x5631feba90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 -- 172.21.15.49:0/2526847741 shutdown_connections 2024-09-21T06:36:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 -- 172.21.15.49:0/2526847741 wait complete. 2024-09-21T06:36:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 -- start start 2024-09-21T06:36:50.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.485+0000 7f89b5014740 1 Processor -- start 2024-09-21T06:36:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89b5014740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febb6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89b5014740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d84d0 0x5631febc5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89b5014740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7f91b0 0x5631febc5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89b5014740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f89a81abbf0 con 0x5631fe7f91b0 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89b5014740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f89a81ad060 con 0x5631fe7d02f0 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89b5014740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f89a81ac2c0 con 0x5631fe7d84d0 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89b5014740 10 client.0 _ll_register_callbacks cb 0x7f89900046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89a77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febb6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f899effd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d84d0 0x5631febc5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89a77fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febb6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:50504/0 (socket says 172.21.15.49:50504) 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89a77fe640 1 -- 172.21.15.49:0/4219561057 learned_addr learned my addr 172.21.15.49:0/4219561057 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89a7fff640 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7f91b0 0x5631febc5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f899effd640 1 -- 172.21.15.49:0/4219561057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 msgr2=0x5631febb6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f899effd640 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febb6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f899effd640 1 -- 172.21.15.49:0/4219561057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7f91b0 msgr2=0x5631febc5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f899effd640 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7f91b0 0x5631febc5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f899effd640 1 -- 172.21.15.49:0/4219561057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631febc63a0 con 0x5631fe7d84d0 2024-09-21T06:36:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.486+0000 7f89a77fe640 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febb6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f899effd640 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d84d0 0x5631febc5850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5631feb8e6b0 tx=0x7f89900ed4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8d9ef485474c3cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f8986ffd640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T06:36:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f8986ffd640 1 -- 172.21.15.49:0/4219561057 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89900c7070 con 0x5631fe7d84d0 2024-09-21T06:36:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f8986ffd640 1 -- 172.21.15.49:0/4219561057 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f89900aed60 con 0x5631fe7d84d0 2024-09-21T06:36:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f89b5014740 1 -- 172.21.15.49:0/4219561057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89900b7250 con 0x5631fe7d84d0 2024-09-21T06:36:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f8986ffd640 1 -- 172.21.15.49:0/4219561057 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8990098070 con 0x5631fe7d84d0 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f89b5014740 10 client.25174 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f89b5014740 1 -- 172.21.15.49:0/4219561057 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5631febb3690 con 0x5631fe7d84d0 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f8986ffd640 1 -- 172.21.15.49:0/4219561057 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89900b7250 con 0x5631fe7d84d0 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f8986ffd640 1 -- 172.21.15.49:0/4219561057 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f89900cf380 con 0x5631fe7d84d0 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f89b5014740 10 client.25174 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f89b5014740 10 client.25174 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f89b5014740 20 client.25174 populate_metadata read hostname 'smithi049' 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f89b5014740 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631fe78d1c0 0x5631fec2d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f89b5014740 4 client.25174 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:36:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.487+0000 7f89b5014740 1 -- 172.21.15.49:0/4219561057 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5631feb110f0 con 0x5631fe78d1c0 2024-09-21T06:36:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.488+0000 7f89a77fe640 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631fe78d1c0 0x5631fec2d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.488+0000 7f8986ffd640 10 client.25174 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.488+0000 7f89a77fe640 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631fe78d1c0 0x5631fec2d230 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92c7252fd59ab1fa server_cookie=475977ace81b6ecb in_seq=0 out_seq=0 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f8986ffd640 1 -- 172.21.15.49:0/4219561057 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631feb110f0 con 0x5631fe78d1c0 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f8986ffd640 10 client.25174 handle_command_reply: tid=0 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 client.25174 shutdown 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 -- 172.21.15.49:0/4219561057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d84d0 msgr2=0x5631febc5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d84d0 0x5631febc5850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5631feb8e6b0 tx=0x7f89900ed4b0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 -- 172.21.15.49:0/4219561057 shutdown_connections 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631fe78d1c0 0x5631fec2d230 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fe7f91b0 0x5631febc5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f8986ffd640 0 client.25174 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:36:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fe7d84d0 0x5631febc5850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 --2- 172.21.15.49:0/4219561057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fe7d02f0 0x5631febb6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 -- 172.21.15.49:0/4219561057 >> 172.21.15.49:0/4219561057 conn(0x5631fe7ed300 msgr2=0x5631feba21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 -- 172.21.15.49:0/4219561057 shutdown_connections 2024-09-21T06:36:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 1 -- 172.21.15.49:0/4219561057 wait complete. 2024-09-21T06:36:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.498+0000 7f89b5014740 20 client.25174 trim_cache size 0 max 16384 2024-09-21T06:36:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:36:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:36:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:36:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:36:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 -- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f89940b65f0 msgr2=0x7f89940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f89940b65f0 0x7f89940b8b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8998031440 tx=0x7f8998009560 comp rx=0 tx=0).stop 2024-09-21T06:36:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 -- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8105200 msgr2=0x7f89a819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8105200 0x7f89a819a960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f899000e9f0 tx=0x7f899000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 -- 172.21.15.49:0/1311052715 shutdown_connections 2024-09-21T06:36:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f89940b65f0 0x7f89940b8b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f89a810dd80 0x7f89a819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f89a8105200 0x7f89a819a960 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 --2- 172.21.15.49:0/1311052715 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f89a81047d0 0x7f89a819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 -- 172.21.15.49:0/1311052715 >> 172.21.15.49:0/1311052715 conn(0x7f89a80fe3c0 msgr2=0x7f89a8107890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 -- 172.21.15.49:0/1311052715 shutdown_connections 2024-09-21T06:36:50.504 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:36:50.499+0000 7f89adfcc640 1 -- 172.21.15.49:0/1311052715 wait complete. 2024-09-21T06:36:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:50 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:50 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:50 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:50 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:50 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:50 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:50 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:36:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:50 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:36:51.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:50 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:50 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:50 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:50 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:50 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:50 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:50 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:50 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:36:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:50 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:36:51.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:50 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:50 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:50 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:50 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:50 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:50 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:50 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:51.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:50 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:36:51.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:50 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:36:51.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:50 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:36:52.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:51 smithi049 ceph-mon[31177]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:36:52.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:51 smithi098 ceph-mon[34704]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:36:52.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:51 smithi079 ceph-mon[34346]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:36:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:53 smithi049 ceph-mon[31177]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T06:36:54.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:53 smithi098 ceph-mon[34704]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T06:36:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:53 smithi079 ceph-mon[34346]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.6 KiB/s wr, 9 op/s 2024-09-21T06:36:56.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:55 smithi049 ceph-mon[31177]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-21T06:36:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:55 smithi098 ceph-mon[34704]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-21T06:36:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:55 smithi079 ceph-mon[34346]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-09-21T06:36:58.121 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:57 smithi079 ceph-mon[34346]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T06:36:58.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:57 smithi049 ceph-mon[31177]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T06:36:58.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:57 smithi098 ceph-mon[34704]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T06:37:00.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:36:59 smithi049 ceph-mon[31177]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T06:37:00.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:36:59 smithi098 ceph-mon[34704]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T06:37:00.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:36:59 smithi079 ceph-mon[34346]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-09-21T06:37:00.722 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:37:00 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:37:00.352+0000 7f396e06e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:00.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:37:00 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:37:00.352+0000 7f396e06e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:00.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:37:00 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:37:00.352+0000 7f396e06e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:00.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:37:00 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:37:00.352+0000 7f396e06e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:00.723 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:37:00 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:37:00.352+0000 7f396e06e640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:01 smithi049 ceph-mon[31177]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T06:37:02.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:01 smithi098 ceph-mon[34704]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T06:37:02.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:01 smithi079 ceph-mon[34346]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-09-21T06:37:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 -- 172.21.15.49:0/1784988199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 msgr2=0x7ffa2410f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/1784988199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 0x7ffa2410f470 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009ca0 tx=0x7ffa1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 -- 172.21.15.49:0/1784988199 shutdown_connections 2024-09-21T06:37:03.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/1784988199 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 0x7ffa2410f470 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/1784988199 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa241082f0 0x7ffa24108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/1784988199 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa241029c0 0x7ffa24102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 -- 172.21.15.49:0/1784988199 >> 172.21.15.49:0/1784988199 conn(0x7ffa240fe3c0 msgr2=0x7ffa24100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 -- 172.21.15.49:0/1784988199 shutdown_connections 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 -- 172.21.15.49:0/1784988199 wait complete. 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.605+0000 7ffa2c08b640 1 Processor -- start 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2c08b640 1 -- start start 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2c08b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa241029c0 0x7ffa2419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2c08b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa241082f0 0x7ffa2419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2c08b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 0x7ffa2419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2c08b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffa24112900 con 0x7ffa24108c40 2024-09-21T06:37:03.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2c08b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffa24112780 con 0x7ffa241082f0 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2c08b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffa24112a80 con 0x7ffa241029c0 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2a628640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 0x7ffa2419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2a628640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 0x7ffa2419fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60830/0 (socket says 172.21.15.49:60830) 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2a628640 1 -- 172.21.15.49:0/4097546008 learned_addr learned my addr 172.21.15.49:0/4097546008 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa29e27640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa241029c0 0x7ffa2419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa29626640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa241082f0 0x7ffa2419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2a628640 1 -- 172.21.15.49:0/4097546008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa241029c0 msgr2=0x7ffa2419a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2a628640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa241029c0 0x7ffa2419a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2a628640 1 -- 172.21.15.49:0/4097546008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa241082f0 msgr2=0x7ffa2419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2a628640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa241082f0 0x7ffa2419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.606+0000 7ffa2a628640 1 -- 172.21.15.49:0/4097546008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa241a0300 con 0x7ffa24108c40 2024-09-21T06:37:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.607+0000 7ffa2a628640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 0x7ffa2419fc00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c005cc0 tx=0x7ffa1c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.607+0000 7ffa1affd640 1 -- 172.21.15.49:0/4097546008 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c003bf0 con 0x7ffa24108c40 2024-09-21T06:37:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.607+0000 7ffa1affd640 1 -- 172.21.15.49:0/4097546008 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa1c003d90 con 0x7ffa24108c40 2024-09-21T06:37:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.607+0000 7ffa2c08b640 1 -- 172.21.15.49:0/4097546008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa241a0590 con 0x7ffa24108c40 2024-09-21T06:37:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.607+0000 7ffa1affd640 1 -- 172.21.15.49:0/4097546008 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c02fbc0 con 0x7ffa24108c40 2024-09-21T06:37:03.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.607+0000 7ffa2c08b640 1 -- 172.21.15.49:0/4097546008 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa241a6d80 con 0x7ffa24108c40 2024-09-21T06:37:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.610+0000 7ffa32ffd740 1 Processor -- start 2024-09-21T06:37:03.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.611+0000 7ffa1affd640 1 -- 172.21.15.49:0/4097546008 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ffa1c02fd60 con 0x7ffa24108c40 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa32ffd740 1 -- start start 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bcc459b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 0x5555bcc45ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 0x5555bcc46430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5555bcbba6f0 con 0x5555bc8a01b0 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5555bcba9b20 con 0x5555bc8772f0 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5555bcbad930 con 0x5555bc87f4d0 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa29626640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bcc459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa29626640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bcc459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60846/0 (socket says 172.21.15.49:60846) 2024-09-21T06:37:03.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa29626640 1 -- 172.21.15.49:0/2055701329 learned_addr learned my addr 172.21.15.49:0/2055701329 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa29626640 1 --2- 172.21.15.49:0/2055701329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 0x5555bcc46430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa29e27640 1 --2- 172.21.15.49:0/2055701329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 0x5555bcc45ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.612+0000 7ffa1affd640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffa100b6700 0x7ffa100b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa29626640 1 -- 172.21.15.49:0/2055701329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 msgr2=0x5555bcc46430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa29626640 1 --2- 172.21.15.49:0/2055701329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 0x5555bcc46430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa29626640 1 -- 172.21.15.49:0/2055701329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 msgr2=0x5555bcc45ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa29626640 1 --2- 172.21.15.49:0/2055701329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 0x5555bcc45ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa29626640 1 -- 172.21.15.49:0/2055701329 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555bcb6f530 con 0x5555bc8a01b0 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa2a628640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffa100b6700 0x7ffa100b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa1affd640 1 -- 172.21.15.49:0/4097546008 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ffa1c108b20 con 0x7ffa24108c40 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa29626640 1 --2- 172.21.15.49:0/2055701329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bcc459b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffa2406c960 tx=0x7ffa1400b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687d545ed668723d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:03.621 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa0ffff640 1 -- 172.21.15.49:0/2055701329 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14004020 con 0x5555bc8a01b0 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa0ffff640 1 -- 172.21.15.49:0/2055701329 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa14004c50 con 0x5555bc8a01b0 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.613+0000 7ffa0ffff640 1 -- 172.21.15.49:0/2055701329 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14005310 con 0x5555bc8a01b0 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa32ffd740 1 -- 172.21.15.49:0/2055701329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 msgr2=0x5555bcc459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa2a628640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffa100b6700 0x7ffa100b8c10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c106300 tx=0x7ffa1c02a8c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/2055701329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bcc459b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffa2406c960 tx=0x7ffa1400b650 comp rx=0 tx=0).stop 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa32ffd740 1 -- 172.21.15.49:0/2055701329 shutdown_connections 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/2055701329 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 0x5555bcc46430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/2055701329 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 0x5555bcc45ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/2055701329 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bcc459b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa32ffd740 1 -- 172.21.15.49:0/2055701329 >> 172.21.15.49:0/2055701329 conn(0x5555bc894300 msgr2=0x5555bcc438a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa32ffd740 1 -- 172.21.15.49:0/2055701329 shutdown_connections 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.614+0000 7ffa32ffd740 1 -- 172.21.15.49:0/2055701329 wait complete. 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa32ffd740 1 -- start start 2024-09-21T06:37:03.622 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa32ffd740 1 Processor -- start 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8772f0 0x5555bcc51020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc87f4d0 0x5555bcc51560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8a01b0 0x5555bcc5d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5555bcae1ab0 con 0x5555bc8772f0 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5555bcb4f730 con 0x5555bc87f4d0 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5555bcc54130 con 0x5555bc8a01b0 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa32ffd740 10 client.0 _ll_register_callbacks cb 0x5555bcba36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa29626640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8772f0 0x5555bcc51020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa29626640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8772f0 0x5555bcc51020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60862/0 (socket says 172.21.15.49:60862) 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.615+0000 7ffa29626640 1 -- 172.21.15.49:0/3702572040 learned_addr learned my addr 172.21.15.49:0/3702572040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa29626640 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8a01b0 0x5555bcc5d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa29e27640 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc87f4d0 0x5555bcc51560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa29626640 1 -- 172.21.15.49:0/3702572040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8a01b0 msgr2=0x5555bcc5d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa29626640 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8a01b0 0x5555bcc5d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa29626640 1 -- 172.21.15.49:0/3702572040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc87f4d0 msgr2=0x5555bcc51560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa29626640 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc87f4d0 0x5555bcc51560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa29626640 1 -- 172.21.15.49:0/3702572040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555bc90b790 con 0x5555bc8772f0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa29626640 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8772f0 0x5555bcc51020 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa14004610 tx=0x7ffa1400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb88b59b0aafc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3702572040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa14005090 con 0x5555bc8772f0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3702572040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ffa14005230 con 0x5555bc8772f0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3702572040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa14004c50 con 0x5555bc8772f0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3702572040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa14035050 con 0x5555bc8772f0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa32ffd740 10 client.15531 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.616+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3702572040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5555bc984620 con 0x5555bc8772f0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.617+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3702572040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa14004c50 con 0x5555bc8772f0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.617+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3702572040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa14010ab0 con 0x5555bc8772f0 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.617+0000 7ffa32ffd740 10 client.15531 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.617+0000 7ffa32ffd740 10 client.15531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.617+0000 7ffa32ffd740 20 client.15531 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.617+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5555bc85ed80 0x5555bcc63080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.617+0000 7ffa32ffd740 4 client.15531 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.617+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3702572040 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555bcbbc640 con 0x5555bc85ed80 2024-09-21T06:37:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.617+0000 7ffa29e27640 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5555bc85ed80 0x5555bcc63080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.618+0000 7ffa29e27640 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5555bc85ed80 0x5555bcc63080 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=599a713e6e991a13 server_cookie=e87a9e4e7277aecb in_seq=0 out_seq=0 2024-09-21T06:37:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.618+0000 7ffa0d7fa640 10 client.15531 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3702572040 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5555bcbbc640 con 0x5555bc85ed80 2024-09-21T06:37:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa0d7fa640 10 client.15531 handle_command_reply: tid=0 2024-09-21T06:37:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 client.15531 shutdown 2024-09-21T06:37:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3702572040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8772f0 msgr2=0x5555bcc51020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8772f0 0x5555bcc51020 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ffa14004610 tx=0x7ffa1400b410 comp rx=0 tx=0).stop 2024-09-21T06:37:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3702572040 shutdown_connections 2024-09-21T06:37:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5555bc85ed80 0x5555bcc63080 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8a01b0 0x5555bcc5d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa0d7fa640 0 client.15531 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc87f4d0 0x5555bcc51560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3702572040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8772f0 0x5555bcc51020 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3702572040 >> 172.21.15.49:0/3702572040 conn(0x5555bc894300 msgr2=0x5555bcc469e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3702572040 shutdown_connections 2024-09-21T06:37:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3702572040 wait complete. 2024-09-21T06:37:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.619+0000 7ffa32ffd740 20 client.15531 trim_cache size 0 max 16384 2024-09-21T06:37:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa32ffd740 1 Processor -- start 2024-09-21T06:37:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa32ffd740 1 -- start start 2024-09-21T06:37:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8772f0 0x5555bcc42970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc87f4d0 0x5555bcc52f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8a01b0 0x5555bcc5d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffa241b1ff0 con 0x5555bc87f4d0 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffa241af8c0 con 0x5555bc8a01b0 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffa241ad730 con 0x5555bc8772f0 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa29e27640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc87f4d0 0x5555bcc52f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa29e27640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc87f4d0 0x5555bcc52f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60876/0 (socket says 172.21.15.49:60876) 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa29e27640 1 -- 172.21.15.49:0/4129316662 learned_addr learned my addr 172.21.15.49:0/4129316662 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa29626640 1 --2- 172.21.15.49:0/4129316662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8a01b0 0x5555bcc5d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.647+0000 7ffa29626640 1 --2- 172.21.15.49:0/4129316662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8772f0 0x5555bcc42970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.648+0000 7ffa29e27640 1 -- 172.21.15.49:0/4129316662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8772f0 msgr2=0x5555bcc42970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.648+0000 7ffa29e27640 1 --2- 172.21.15.49:0/4129316662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8772f0 0x5555bcc42970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.648+0000 7ffa29e27640 1 -- 172.21.15.49:0/4129316662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8a01b0 msgr2=0x5555bcc5d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.648+0000 7ffa29e27640 1 --2- 172.21.15.49:0/4129316662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8a01b0 0x5555bcc5d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.648+0000 7ffa29e27640 1 -- 172.21.15.49:0/4129316662 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555bcc47cb0 con 0x5555bc87f4d0 2024-09-21T06:37:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.648+0000 7ffa29e27640 1 --2- 172.21.15.49:0/4129316662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc87f4d0 0x5555bcc52f00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x5555bcc63650 tx=0x7ffa2000bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce3afc87cc49fb58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.648+0000 7ffa0f7fe640 1 -- 172.21.15.49:0/4129316662 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20003d60 con 0x5555bc87f4d0 2024-09-21T06:37:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.648+0000 7ffa0f7fe640 1 -- 172.21.15.49:0/4129316662 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa2001d8d0 con 0x5555bc87f4d0 2024-09-21T06:37:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.648+0000 7ffa0f7fe640 1 -- 172.21.15.49:0/4129316662 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa200248b0 con 0x5555bc87f4d0 2024-09-21T06:37:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.649+0000 7ffa32ffd740 1 -- 172.21.15.49:0/4129316662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc87f4d0 msgr2=0x5555bcc52f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:03.657 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.649+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/4129316662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc87f4d0 0x5555bcc52f00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x5555bcc63650 tx=0x7ffa2000bd20 comp rx=0 tx=0).stop 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.649+0000 7ffa32ffd740 1 -- 172.21.15.49:0/4129316662 shutdown_connections 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.649+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/4129316662 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8a01b0 0x5555bcc5d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.649+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/4129316662 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc87f4d0 0x5555bcc52f00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.649+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/4129316662 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc8772f0 0x5555bcc42970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.649+0000 7ffa32ffd740 1 -- 172.21.15.49:0/4129316662 >> 172.21.15.49:0/4129316662 conn(0x5555bc894300 msgr2=0x5555bcc504f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.649+0000 7ffa32ffd740 1 -- 172.21.15.49:0/4129316662 shutdown_connections 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.650+0000 7ffa32ffd740 1 -- 172.21.15.49:0/4129316662 wait complete. 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.650+0000 7ffa32ffd740 1 -- start start 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.650+0000 7ffa32ffd740 1 Processor -- start 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.650+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 0x5555bcc56ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.650+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 0x5555bcc57480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.658 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.650+0000 7ffa32ffd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bccc48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.650+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffa241add80 con 0x5555bc8a01b0 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.650+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffa241af1f0 con 0x5555bc8772f0 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.650+0000 7ffa32ffd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffa241ae450 con 0x5555bc87f4d0 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa32ffd740 10 client.0 _ll_register_callbacks cb 0x7ffa140123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bccc48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bccc48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60886/0 (socket says 172.21.15.49:60886) 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 -- 172.21.15.49:0/3846114325 learned_addr learned my addr 172.21.15.49:0/3846114325 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 0x5555bcc56ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29e27640 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 0x5555bcc57480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 -- 172.21.15.49:0/3846114325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 msgr2=0x5555bcc57480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 0x5555bcc57480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 -- 172.21.15.49:0/3846114325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 msgr2=0x5555bcc56ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 0x5555bcc56ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 -- 172.21.15.49:0/3846114325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555bccc4f50 con 0x5555bc8a01b0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa29626640 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bccc48e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffa14004810 tx=0x7ffa1400b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b728254f7cb5408b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3846114325 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400f9c0 con 0x5555bc8a01b0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3846114325 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ffa1400fb60 con 0x5555bc8a01b0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.651+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3846114325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa2001d8d0 con 0x5555bc8a01b0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3846114325 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ffa14049050 con 0x5555bc8a01b0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa32ffd740 10 client.15537 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3846114325 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5555bcccd480 con 0x5555bc8a01b0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3846114325 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa2001d8d0 con 0x5555bc8a01b0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3846114325 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ffa14010460 con 0x5555bc8a01b0 2024-09-21T06:37:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa32ffd740 10 client.15537 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa32ffd740 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa32ffd740 20 client.15537 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5555bc8341c0 0x5555bcccfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa32ffd740 4 client.15537 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.652+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3846114325 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5555bcbb80f0 con 0x5555bc8341c0 2024-09-21T06:37:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.653+0000 7ffa29e27640 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5555bc8341c0 0x5555bcccfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.653+0000 7ffa29e27640 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5555bc8341c0 0x5555bcccfa90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d9b52a48a32bfe8 server_cookie=9006352ccf03c549 in_seq=0 out_seq=0 2024-09-21T06:37:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.653+0000 7ffa0d7fa640 10 client.15537 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa0d7fa640 1 -- 172.21.15.49:0/3846114325 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5555bcbb80f0 con 0x5555bc8341c0 2024-09-21T06:37:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa0d7fa640 10 client.15537 handle_command_reply: tid=0 2024-09-21T06:37:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 client.15537 shutdown 2024-09-21T06:37:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3846114325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 msgr2=0x5555bccc48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bccc48e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ffa14004810 tx=0x7ffa1400b410 comp rx=0 tx=0).stop 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3846114325 shutdown_connections 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5555bc8341c0 0x5555bcccfa90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5555bc8a01b0 0x5555bccc48e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5555bc87f4d0 0x5555bcc57480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa0d7fa640 0 client.15537 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 --2- 172.21.15.49:0/3846114325 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5555bc8772f0 0x5555bcc56ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3846114325 >> 172.21.15.49:0/3846114325 conn(0x5555bc894300 msgr2=0x5555bcc52c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3846114325 shutdown_connections 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.660+0000 7ffa32ffd740 1 -- 172.21.15.49:0/3846114325 wait complete. 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa32ffd740 20 client.15537 trim_cache size 0 max 16384 2024-09-21T06:37:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:37:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:37:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:37:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 -- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffa100b6700 msgr2=0x7ffa100b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffa100b6700 0x7ffa100b8c10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c106300 tx=0x7ffa1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 -- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 msgr2=0x7ffa2419fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 0x7ffa2419fc00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c005cc0 tx=0x7ffa1c02f380 comp rx=0 tx=0).stop 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 -- 172.21.15.49:0/4097546008 shutdown_connections 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffa100b6700 0x7ffa100b8c10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffa24108c40 0x7ffa2419fc00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffa241082f0 0x7ffa2419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 --2- 172.21.15.49:0/4097546008 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffa241029c0 0x7ffa2419a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 -- 172.21.15.49:0/4097546008 >> 172.21.15.49:0/4097546008 conn(0x7ffa240fe3c0 msgr2=0x7ffa2406b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:03.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 -- 172.21.15.49:0/4097546008 shutdown_connections 2024-09-21T06:37:03.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:03.661+0000 7ffa2c08b640 1 -- 172.21.15.49:0/4097546008 wait complete. 2024-09-21T06:37:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:03 smithi049 ceph-mon[31177]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-21T06:37:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:03 smithi049 ceph-mon[31177]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:37:04.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:03 smithi098 ceph-mon[34704]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-21T06:37:04.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:03 smithi098 ceph-mon[34704]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:37:04.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:03 smithi079 ceph-mon[34346]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.8 KiB/s wr, 11 op/s 2024-09-21T06:37:04.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:03 smithi079 ceph-mon[34346]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:37:06.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:05 smithi049 ceph-mon[31177]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-21T06:37:06.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:05 smithi098 ceph-mon[34704]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-21T06:37:06.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:05 smithi079 ceph-mon[34346]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-21T06:37:08.118 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:37:08.142 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:07 smithi049 ceph-mon[31177]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:37:08.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:07 smithi098 ceph-mon[34704]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:37:08.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:07 smithi079 ceph-mon[34346]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:37:08.448 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:08.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.955+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1225288466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78105310 msgr2=0x7fbf7810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:08.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.955+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1225288466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78105310 0x7fbf7810d860 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009900 tx=0x7fbf6c02a410 comp rx=0 tx=0).stop 2024-09-21T06:37:08.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.955+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1225288466 shutdown_connections 2024-09-21T06:37:08.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.955+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1225288466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf7810de20 0x7fbf78110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.955+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1225288466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf78105310 0x7fbf7810d860 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.955+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1225288466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf781049c0 0x7fbf78104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.955+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1225288466 >> 172.21.15.49:0/1225288466 conn(0x7fbf78079710 msgr2=0x7fbf78079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.955+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1225288466 shutdown_connections 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.955+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1225288466 wait complete. 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.956+0000 7fbf7d2e8640 1 Processor -- start 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf7d2e8640 1 -- start start 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf7d2e8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf781049c0 0x7fbf7819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf7d2e8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf78105310 0x7fbf7819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf7d2e8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7810de20 0x7fbf7819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf7d2e8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbf78113a40 con 0x7fbf7810de20 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf7d2e8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf781138c0 con 0x7fbf78105310 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf7d2e8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbf78113bc0 con 0x7fbf781049c0 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf76ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf781049c0 0x7fbf7819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf76ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf781049c0 0x7fbf7819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:32964/0 (socket says 172.21.15.49:32964) 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf76ffd640 1 -- 172.21.15.49:0/1861808305 learned_addr learned my addr 172.21.15.49:0/1861808305 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf777fe640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7810de20 0x7fbf7819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.957+0000 7fbf767fc640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf78105310 0x7fbf7819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf76ffd640 1 -- 172.21.15.49:0/1861808305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf78105310 msgr2=0x7fbf7819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf78105310 0x7fbf7819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf76ffd640 1 -- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7810de20 msgr2=0x7fbf7819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7810de20 0x7fbf7819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf76ffd640 1 -- 172.21.15.49:0/1861808305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf781a03e0 con 0x7fbf781049c0 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf767fc640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf78105310 0x7fbf7819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf781049c0 0x7fbf7819a470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800e9f0 tx=0x7fbf6800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf5ffff640 1 -- 172.21.15.49:0/1861808305 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6800cd80 con 0x7fbf781049c0 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1861808305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf781a06d0 con 0x7fbf781049c0 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1861808305 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf781a6e30 con 0x7fbf781049c0 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf5ffff640 1 -- 172.21.15.49:0/1861808305 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf680108e0 con 0x7fbf781049c0 2024-09-21T06:37:08.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.958+0000 7fbf5ffff640 1 -- 172.21.15.49:0/1861808305 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68018980 con 0x7fbf781049c0 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.961+0000 7fbf5ffff640 1 -- 172.21.15.49:0/1861808305 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fbf68010430 con 0x7fbf781049c0 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.962+0000 7fbf5ffff640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbf600b6780 0x7fbf600b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.962+0000 7fbf8385c740 1 Processor -- start 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.962+0000 7fbf8385c740 1 -- start start 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.962+0000 7fbf5ffff640 1 -- 172.21.15.49:0/1861808305 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fbf680e78c0 con 0x7fbf781049c0 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.962+0000 7fbf767fc640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbf600b6780 0x7fbf600b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d80650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 0x564d25d80b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf8385c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564d25cf6e50 con 0x564d259b8390 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf8385c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564d25ce6280 con 0x564d259b01b0 2024-09-21T06:37:08.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf8385c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564d25cea090 con 0x564d259d9070 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf76ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d80650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf76ffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d80650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:32968/0 (socket says 172.21.15.49:32968) 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf76ffd640 1 -- 172.21.15.49:0/2814584402 learned_addr learned my addr 172.21.15.49:0/2814584402 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf777fe640 1 --2- 172.21.15.49:0/2814584402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf76ffd640 1 -- 172.21.15.49:0/2814584402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 msgr2=0x564d25d80b90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/2814584402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 0x564d25d80b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf76ffd640 1 -- 172.21.15.49:0/2814584402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 msgr2=0x564d25d810d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/2814584402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d810d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf76ffd640 1 -- 172.21.15.49:0/2814584402 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d25a44650 con 0x564d259d9070 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.963+0000 7fbf777fe640 1 --2- 172.21.15.49:0/2814584402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.964+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/2814584402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d80650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800cf90 tx=0x7fbf680a96f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2359fc46441b65cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.964+0000 7fbf767fc640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbf600b6780 0x7fbf600b8c90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009230 tx=0x7fbf6c031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.964+0000 7fbf5d7fa640 1 -- 172.21.15.49:0/2814584402 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf680e5410 con 0x564d259d9070 2024-09-21T06:37:08.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.964+0000 7fbf5d7fa640 1 -- 172.21.15.49:0/2814584402 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf680b2170 con 0x564d259d9070 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.964+0000 7fbf5d7fa640 1 -- 172.21.15.49:0/2814584402 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf680b62a0 con 0x564d259d9070 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.965+0000 7fbf8385c740 1 -- 172.21.15.49:0/2814584402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 msgr2=0x564d25d80650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.965+0000 7fbf8385c740 1 --2- 172.21.15.49:0/2814584402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d80650 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800cf90 tx=0x7fbf680a96f0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.965+0000 7fbf8385c740 1 -- 172.21.15.49:0/2814584402 shutdown_connections 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.965+0000 7fbf8385c740 1 --2- 172.21.15.49:0/2814584402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.965+0000 7fbf8385c740 1 --2- 172.21.15.49:0/2814584402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 0x564d25d80b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.965+0000 7fbf8385c740 1 --2- 172.21.15.49:0/2814584402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d80650 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.965+0000 7fbf8385c740 1 -- 172.21.15.49:0/2814584402 >> 172.21.15.49:0/2814584402 conn(0x564d259cd460 msgr2=0x564d25d7e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.965+0000 7fbf8385c740 1 -- 172.21.15.49:0/2814584402 shutdown_connections 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.966+0000 7fbf8385c740 1 -- 172.21.15.49:0/2814584402 wait complete. 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.966+0000 7fbf8385c740 1 -- start start 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.966+0000 7fbf8385c740 1 Processor -- start 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 0x564d25d8bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d8c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d9c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf8385c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564d25b47700 con 0x564d259b8390 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf8385c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564d25c81110 con 0x564d259b01b0 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf8385c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564d25d93240 con 0x564d259d9070 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf767fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d8c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf8385c740 10 client.0 _ll_register_callbacks cb 0x564d25c9a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf767fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d8c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56870/0 (socket says 172.21.15.49:56870) 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf767fc640 1 -- 172.21.15.49:0/1399104840 learned_addr learned my addr 172.21.15.49:0/1399104840 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 0x564d25d8bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf777fe640 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d9c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf76ffd640 1 -- 172.21.15.49:0/1399104840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 msgr2=0x564d25d9c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d9c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf76ffd640 1 -- 172.21.15.49:0/1399104840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 msgr2=0x564d25d8c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d8c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf76ffd640 1 -- 172.21.15.49:0/1399104840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d25caec40 con 0x564d259b01b0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.967+0000 7fbf767fc640 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d8c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.968+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 0x564d25d8bd90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf68018fd0 tx=0x7fbf680e54c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa984aef3e74b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.968+0000 7fbf5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.968+0000 7fbf5aff5640 1 -- 172.21.15.49:0/1399104840 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf680a9410 con 0x564d259b01b0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.968+0000 7fbf5aff5640 1 -- 172.21.15.49:0/1399104840 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fbf680b6050 con 0x564d259b01b0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.968+0000 7fbf8385c740 1 -- 172.21.15.49:0/1399104840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf680b2170 con 0x564d259b01b0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.968+0000 7fbf5aff5640 1 -- 172.21.15.49:0/1399104840 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbf680b70b0 con 0x564d259b01b0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.968+0000 7fbf8385c740 10 client.25226 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.968+0000 7fbf8385c740 1 -- 172.21.15.49:0/1399104840 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564d25d9efe0 con 0x564d259b01b0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.969+0000 7fbf5aff5640 1 -- 172.21.15.49:0/1399104840 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf680b2170 con 0x564d259b01b0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.969+0000 7fbf5aff5640 1 -- 172.21.15.49:0/1399104840 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbf68010bb0 con 0x564d259b01b0 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.969+0000 7fbf8385c740 10 client.25226 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.969+0000 7fbf8385c740 10 client.25226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:08.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.969+0000 7fbf8385c740 20 client.25226 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.969+0000 7fbf8385c740 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564d259979f0 0x564d25da2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.969+0000 7fbf8385c740 4 client.25226 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.969+0000 7fbf8385c740 1 -- 172.21.15.49:0/1399104840 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d25cf8da0 con 0x564d259979f0 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.969+0000 7fbf767fc640 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564d259979f0 0x564d25da2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.970+0000 7fbf5aff5640 10 client.25226 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.970+0000 7fbf767fc640 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564d259979f0 0x564d25da2340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b39319ecaecc4940 server_cookie=637e7f5afdbe0f9b in_seq=0 out_seq=0 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf5aff5640 1 -- 172.21.15.49:0/1399104840 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d25cf8da0 con 0x564d259979f0 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf5aff5640 10 client.25226 handle_command_reply: tid=0 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 client.25226 shutdown 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 -- 172.21.15.49:0/1399104840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 msgr2=0x564d25d8bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 0x564d25d8bd90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbf68018fd0 tx=0x7fbf680e54c0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 -- 172.21.15.49:0/1399104840 shutdown_connections 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564d259979f0 0x564d25da2340 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf5aff5640 0 client.25226 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:08.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259d9070 0x564d25d9c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d8c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 --2- 172.21.15.49:0/1399104840 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259b01b0 0x564d25d8bd90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 -- 172.21.15.49:0/1399104840 >> 172.21.15.49:0/1399104840 conn(0x564d259cd460 msgr2=0x564d25d837e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 -- 172.21.15.49:0/1399104840 shutdown_connections 2024-09-21T06:37:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 1 -- 172.21.15.49:0/1399104840 wait complete. 2024-09-21T06:37:08.983 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:08.971+0000 7fbf8385c740 20 client.25226 trim_cache size 0 max 16384 2024-09-21T06:37:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf8385c740 1 Processor -- start 2024-09-21T06:37:09.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf8385c740 1 -- start start 2024-09-21T06:37:09.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 0x564d25d82160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:09.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b01b0 0x564d25d8d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:09.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d7db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf8385c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbf64011110 con 0x564d259b8390 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf8385c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6400e9e0 con 0x564d259979f0 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf8385c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6400c850 con 0x564d259b01b0 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d7db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d7db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56884/0 (socket says 172.21.15.49:56884) 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf777fe640 1 -- 172.21.15.49:0/277288800 learned_addr learned my addr 172.21.15.49:0/277288800 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf767fc640 1 --2- 172.21.15.49:0/277288800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b01b0 0x564d25d8d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.007+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/277288800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 0x564d25d82160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.008+0000 7fbf767fc640 1 -- 172.21.15.49:0/277288800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 msgr2=0x564d25d82160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.008+0000 7fbf767fc640 1 --2- 172.21.15.49:0/277288800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 0x564d25d82160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.008+0000 7fbf767fc640 1 -- 172.21.15.49:0/277288800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 msgr2=0x564d25d7db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.008+0000 7fbf767fc640 1 --2- 172.21.15.49:0/277288800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d7db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.008+0000 7fbf767fc640 1 -- 172.21.15.49:0/277288800 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d25d8a290 con 0x564d259b01b0 2024-09-21T06:37:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.008+0000 7fbf767fc640 1 --2- 172.21.15.49:0/277288800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b01b0 0x564d25d8d9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x564d25d932a0 tx=0x7fbf6c03d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff7dc62136d8503 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.008+0000 7fbf5cff9640 1 -- 172.21.15.49:0/277288800 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c055070 con 0x564d259b01b0 2024-09-21T06:37:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.008+0000 7fbf5cff9640 1 -- 172.21.15.49:0/277288800 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf6c005510 con 0x564d259b01b0 2024-09-21T06:37:09.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.009+0000 7fbf5cff9640 1 -- 172.21.15.49:0/277288800 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c035040 con 0x564d259b01b0 2024-09-21T06:37:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 -- 172.21.15.49:0/277288800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b01b0 msgr2=0x564d25d8d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 --2- 172.21.15.49:0/277288800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b01b0 0x564d25d8d9c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x564d25d932a0 tx=0x7fbf6c03d000 comp rx=0 tx=0).stop 2024-09-21T06:37:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 -- 172.21.15.49:0/277288800 shutdown_connections 2024-09-21T06:37:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 --2- 172.21.15.49:0/277288800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b8390 0x564d25d7db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 --2- 172.21.15.49:0/277288800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b01b0 0x564d25d8d9c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 --2- 172.21.15.49:0/277288800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 0x564d25d82160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 -- 172.21.15.49:0/277288800 >> 172.21.15.49:0/277288800 conn(0x564d259cd460 msgr2=0x564d25d8d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 -- 172.21.15.49:0/277288800 shutdown_connections 2024-09-21T06:37:09.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 -- 172.21.15.49:0/277288800 wait complete. 2024-09-21T06:37:09.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.010+0000 7fbf8385c740 1 -- start start 2024-09-21T06:37:09.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf8385c740 1 Processor -- start 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 0x564d25da5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b01b0 0x564d25da3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf8385c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b8390 0x564d25da3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf8385c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6400cea0 con 0x564d259b01b0 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf8385c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6400e310 con 0x564d259979f0 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf767fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b01b0 0x564d25da3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf767fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b01b0 0x564d25da3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56886/0 (socket says 172.21.15.49:56886) 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf767fc640 1 -- 172.21.15.49:0/616429862 learned_addr learned my addr 172.21.15.49:0/616429862 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.011+0000 7fbf777fe640 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b8390 0x564d25da3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 0x564d25da5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf8385c740 1 -- 172.21.15.49:0/616429862 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6400d570 con 0x564d259b8390 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf8385c740 10 client.0 _ll_register_callbacks cb 0x7fbf70009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:09.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf76ffd640 1 -- 172.21.15.49:0/616429862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b8390 msgr2=0x564d25da3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b8390 0x564d25da3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf76ffd640 1 -- 172.21.15.49:0/616429862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b01b0 msgr2=0x564d25da3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b01b0 0x564d25da3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf76ffd640 1 -- 172.21.15.49:0/616429862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d25da3f70 con 0x564d259979f0 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf8385c740 1 -- 172.21.15.49:0/616429862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf6c005510 con 0x564d259979f0 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.012+0000 7fbf767fc640 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b01b0 0x564d25da3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.013+0000 7fbf76ffd640 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 0x564d25da5c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbf68010f70 tx=0x7fbf680acd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41535dc38b156e9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.013+0000 7fbf5aff5640 10 client.25232 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.013+0000 7fbf5aff5640 1 -- 172.21.15.49:0/616429862 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf680b2170 con 0x564d259979f0 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.013+0000 7fbf5aff5640 1 -- 172.21.15.49:0/616429862 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fbf68010a90 con 0x564d259979f0 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.013+0000 7fbf5aff5640 1 -- 172.21.15.49:0/616429862 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbf68010cb0 con 0x564d259979f0 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.013+0000 7fbf8385c740 10 client.25232 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:09.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.013+0000 7fbf8385c740 1 -- 172.21.15.49:0/616429862 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=25}) -- 0x564d25e0ca50 con 0x564d259979f0 2024-09-21T06:37:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.013+0000 7fbf5aff5640 1 -- 172.21.15.49:0/616429862 <== mon.2 v2:172.21.15.79:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbf680c8ce0 con 0x564d259979f0 2024-09-21T06:37:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.013+0000 7fbf8385c740 10 client.25232 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.014+0000 7fbf8385c740 10 client.25232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.014+0000 7fbf8385c740 20 client.25232 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.014+0000 7fbf8385c740 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564d259d9070 0x564d25e0edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.014+0000 7fbf8385c740 4 client.25232 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:37:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.014+0000 7fbf8385c740 1 -- 172.21.15.49:0/616429862 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564d25cf4850 con 0x564d259d9070 2024-09-21T06:37:09.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.014+0000 7fbf767fc640 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564d259d9070 0x564d25e0edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.014+0000 7fbf5aff5640 10 client.25232 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.014+0000 7fbf767fc640 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564d259d9070 0x564d25e0edd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98b8f5344af326e0 server_cookie=fad0ecf569a9f2e0 in_seq=0 out_seq=0 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf5aff5640 1 -- 172.21.15.49:0/616429862 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x564d25cf4850 con 0x564d259d9070 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf5aff5640 10 client.25232 handle_command_reply: tid=0 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 client.25232 shutdown 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 -- 172.21.15.49:0/616429862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 msgr2=0x564d25da5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 0x564d25da5c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbf68010f70 tx=0x7fbf680acd70 comp rx=0 tx=0).stop 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 -- 172.21.15.49:0/616429862 shutdown_connections 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564d259d9070 0x564d25e0edd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf5aff5640 0 client.25232 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564d259b8390 0x564d25da3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564d259b01b0 0x564d25da3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 --2- 172.21.15.49:0/616429862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564d259979f0 0x564d25da5c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 -- 172.21.15.49:0/616429862 >> 172.21.15.49:0/616429862 conn(0x564d259cd460 msgr2=0x564d25d8c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 -- 172.21.15.49:0/616429862 shutdown_connections 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 1 -- 172.21.15.49:0/616429862 wait complete. 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.015+0000 7fbf8385c740 20 client.25232 trim_cache size 0 max 16384 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:37:09.020 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:37:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:37:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:37:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:37:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:37:09.021 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:37:09.021 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbf600b6780 msgr2=0x7fbf600b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbf600b6780 0x7fbf600b8c90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c009230 tx=0x7fbf6c031400 comp rx=0 tx=0).stop 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1861808305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf781049c0 msgr2=0x7fbf7819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf781049c0 0x7fbf7819a470 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf6800e9f0 tx=0x7fbf6800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1861808305 shutdown_connections 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbf600b6780 0x7fbf600b8c90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbf7810de20 0x7fbf7819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbf78105310 0x7fbf7819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 --2- 172.21.15.49:0/1861808305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbf781049c0 0x7fbf7819a470 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1861808305 >> 172.21.15.49:0/1861808305 conn(0x7fbf78079710 msgr2=0x7fbf78106850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1861808305 shutdown_connections 2024-09-21T06:37:09.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:09.016+0000 7fbf7d2e8640 1 -- 172.21.15.49:0/1861808305 wait complete. 2024-09-21T06:37:09.791 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:37:09.791 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:37:09.892 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:09 smithi049 ceph-mon[31177]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T06:37:10.151 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:10.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:09 smithi098 ceph-mon[34704]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T06:37:10.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:09 smithi079 ceph-mon[34346]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T06:37:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.654+0000 7fe27309a640 1 -- 172.21.15.49:0/346884382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c108d00 msgr2=0x7fe26c10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:10.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.654+0000 7fe27309a640 1 --2- 172.21.15.49:0/346884382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c108d00 0x7fe26c10f530 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe264009ca0 tx=0x7fe26402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.654+0000 7fe27309a640 1 -- 172.21.15.49:0/346884382 shutdown_connections 2024-09-21T06:37:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.654+0000 7fe27309a640 1 --2- 172.21.15.49:0/346884382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c108d00 0x7fe26c10f530 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.654+0000 7fe27309a640 1 --2- 172.21.15.49:0/346884382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c1083b0 0x7fe26c1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.654+0000 7fe27309a640 1 --2- 172.21.15.49:0/346884382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe26c102a70 0x7fe26c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.654+0000 7fe27309a640 1 -- 172.21.15.49:0/346884382 >> 172.21.15.49:0/346884382 conn(0x7fe26c079710 msgr2=0x7fe26c079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.654+0000 7fe27309a640 1 -- 172.21.15.49:0/346884382 shutdown_connections 2024-09-21T06:37:10.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.654+0000 7fe27309a640 1 -- 172.21.15.49:0/346884382 wait complete. 2024-09-21T06:37:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.655+0000 7fe27309a640 1 Processor -- start 2024-09-21T06:37:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.655+0000 7fe27309a640 1 -- start start 2024-09-21T06:37:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.656+0000 7fe27309a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe26c102a70 0x7fe26c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:10.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.656+0000 7fe27309a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c1083b0 0x7fe26c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.656+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c1083b0 0x7fe26c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.656+0000 7fe270e36640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe26c102a70 0x7fe26c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.656+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c1083b0 0x7fe26c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56902/0 (socket says 172.21.15.49:56902) 2024-09-21T06:37:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.656+0000 7fe26bfff640 1 -- 172.21.15.49:0/961016915 learned_addr learned my addr 172.21.15.49:0/961016915 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.656+0000 7fe27309a640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c108d00 0x7fe26c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.657+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c113ae0 con 0x7fe26c1083b0 2024-09-21T06:37:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.657+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c113960 con 0x7fe26c108d00 2024-09-21T06:37:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.657+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c113c60 con 0x7fe26c102a70 2024-09-21T06:37:10.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.657+0000 7fe271637640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c108d00 0x7fe26c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:10.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.657+0000 7fe271637640 1 -- 172.21.15.49:0/961016915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe26c102a70 msgr2=0x7fe26c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.657+0000 7fe271637640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe26c102a70 0x7fe26c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.657+0000 7fe271637640 1 -- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c1083b0 msgr2=0x7fe26c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.657+0000 7fe271637640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c1083b0 0x7fe26c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.657+0000 7fe271637640 1 -- 172.21.15.49:0/961016915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c1a03e0 con 0x7fe26c108d00 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.658+0000 7fe26bfff640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c1083b0 0x7fe26c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.658+0000 7fe271637640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c108d00 0x7fe26c19fcb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe26402ade0 tx=0x7fe2640316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.658+0000 7fe269ffb640 1 -- 172.21.15.49:0/961016915 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe264003b70 con 0x7fe26c108d00 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.658+0000 7fe269ffb640 1 -- 172.21.15.49:0/961016915 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe264003d10 con 0x7fe26c108d00 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.658+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26c1a0670 con 0x7fe26c108d00 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.658+0000 7fe269ffb640 1 -- 172.21.15.49:0/961016915 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe26402fa00 con 0x7fe26c108d00 2024-09-21T06:37:10.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.658+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26c10fef0 con 0x7fe26c108d00 2024-09-21T06:37:10.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.660+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26c103cf0 con 0x7fe26c108d00 2024-09-21T06:37:10.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.661+0000 7fe269ffb640 1 -- 172.21.15.49:0/961016915 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fe264004b40 con 0x7fe26c108d00 2024-09-21T06:37:10.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.663+0000 7fe269ffb640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe25c0b6700 0x7fe25c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.663+0000 7fe270e36640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe25c0b6700 0x7fe25c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.663+0000 7fe269ffb640 1 -- 172.21.15.49:0/961016915 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fe264108960 con 0x7fe26c108d00 2024-09-21T06:37:10.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.663+0000 7fe270e36640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe25c0b6700 0x7fe25c0b8c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe260005fd0 tx=0x7fe26000f7a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:10.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.666+0000 7fe269ffb640 1 -- 172.21.15.49:0/961016915 <== mon.2 v2:172.21.15.79:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2640cee90 con 0x7fe26c108d00 2024-09-21T06:37:10.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.943+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe26c102e80 con 0x7fe26c108d00 2024-09-21T06:37:10.946 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:37:10.946 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"btime":"2024-09-21T06:36:27:292026+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:36:27.233682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:37:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.944+0000 7fe269ffb640 1 -- 172.21.15.49:0/961016915 <== mon.2 v2:172.21.15.79:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7fe26c102e80 con 0x7fe26c108d00 2024-09-21T06:37:10.947 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe25c0b6700 msgr2=0x7fe25c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe25c0b6700 0x7fe25c0b8c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe260005fd0 tx=0x7fe26000f7a0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c108d00 msgr2=0x7fe26c19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c108d00 0x7fe26c19fcb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe26402ade0 tx=0x7fe2640316f0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 shutdown_connections 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe25c0b6700 0x7fe25c0b8c10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe26c108d00 0x7fe26c19fcb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe26c1083b0 0x7fe26c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 --2- 172.21.15.49:0/961016915 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe26c102a70 0x7fe26c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 >> 172.21.15.49:0/961016915 conn(0x7fe26c079710 msgr2=0x7fe26c106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:10.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.948+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 shutdown_connections 2024-09-21T06:37:10.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:10.949+0000 7fe27309a640 1 -- 172.21.15.49:0/961016915 wait complete. 2024-09-21T06:37:11.614 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:37:11.895 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:12.156 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:11 smithi049 ceph-mon[31177]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T06:37:12.157 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:11 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/961016915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:12.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:11 smithi098 ceph-mon[34704]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T06:37:12.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:11 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/961016915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:12.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:11 smithi079 ceph-mon[34346]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-09-21T06:37:12.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:11 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/961016915' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.419+0000 7f27e56b3640 1 -- 172.21.15.49:0/229305985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e0108d20 msgr2=0x7f27e010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.419+0000 7f27e56b3640 1 --2- 172.21.15.49:0/229305985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e0108d20 0x7f27e010f550 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009ca0 tx=0x7f27d802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.419+0000 7f27e56b3640 1 -- 172.21.15.49:0/229305985 shutdown_connections 2024-09-21T06:37:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.419+0000 7f27e56b3640 1 --2- 172.21.15.49:0/229305985 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e0108d20 0x7f27e010f550 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.419+0000 7f27e56b3640 1 --2- 172.21.15.49:0/229305985 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27e01083d0 0x7f27e01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.419+0000 7f27e56b3640 1 --2- 172.21.15.49:0/229305985 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e0102ae0 0x7f27e0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.419+0000 7f27e56b3640 1 -- 172.21.15.49:0/229305985 >> 172.21.15.49:0/229305985 conn(0x7f27e00797b0 msgr2=0x7f27e0079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.419+0000 7f27e56b3640 1 -- 172.21.15.49:0/229305985 shutdown_connections 2024-09-21T06:37:12.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.419+0000 7f27e56b3640 1 -- 172.21.15.49:0/229305985 wait complete. 2024-09-21T06:37:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.420+0000 7f27e56b3640 1 Processor -- start 2024-09-21T06:37:12.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.420+0000 7f27e56b3640 1 -- start start 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.420+0000 7f27e56b3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27e0102ae0 0x7f27e01981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27e56b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e01083d0 0x7f27e0198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27e56b3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e0108d20 0x7f27e019da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27e56b3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f27e01118e0 con 0x7f27e01083d0 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27e56b3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27e0111760 con 0x7f27e0108d20 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27e56b3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27e0111a60 con 0x7f27e0102ae0 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27de7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e01083d0 0x7f27e0198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27de7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e01083d0 0x7f27e0198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56920/0 (socket says 172.21.15.49:56920) 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27de7fc640 1 -- 172.21.15.49:0/2407589529 learned_addr learned my addr 172.21.15.49:0/2407589529 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27df7fe640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e0108d20 0x7f27e019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27deffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27e0102ae0 0x7f27e01981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27deffd640 1 -- 172.21.15.49:0/2407589529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e0108d20 msgr2=0x7f27e019da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:12.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.421+0000 7f27deffd640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e0108d20 0x7f27e019da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27deffd640 1 -- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e01083d0 msgr2=0x7f27e0198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:12.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27deffd640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e01083d0 0x7f27e0198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27deffd640 1 -- 172.21.15.49:0/2407589529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e019e150 con 0x7f27e0102ae0 2024-09-21T06:37:12.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27de7fc640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e01083d0 0x7f27e0198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:12.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27deffd640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27e0102ae0 0x7f27e01981e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f27d000e9f0 tx=0x7f27d000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:12.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27c7fff640 1 -- 172.21.15.49:0/2407589529 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d000ccc0 con 0x7f27e0102ae0 2024-09-21T06:37:12.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27e56b3640 1 -- 172.21.15.49:0/2407589529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e019e440 con 0x7f27e0102ae0 2024-09-21T06:37:12.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27e56b3640 1 -- 172.21.15.49:0/2407589529 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e01a4ba0 con 0x7f27e0102ae0 2024-09-21T06:37:12.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27c7fff640 1 -- 172.21.15.49:0/2407589529 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d00108e0 con 0x7f27e0102ae0 2024-09-21T06:37:12.425 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.422+0000 7f27c7fff640 1 -- 172.21.15.49:0/2407589529 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d0018880 con 0x7f27e0102ae0 2024-09-21T06:37:12.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.425+0000 7f27ebc27740 1 Processor -- start 2024-09-21T06:37:12.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.425+0000 7f27ebc27740 1 -- start start 2024-09-21T06:37:12.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.425+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e66100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.425+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928a981b0 0x561928e66680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.425+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e78a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.427 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.425+0000 7f27ebc27740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561928ddeea0 con 0x561928a981b0 2024-09-21T06:37:12.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27ebc27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561928dce2d0 con 0x561928aa0390 2024-09-21T06:37:12.428 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27ebc27740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561928dd20e0 con 0x561928ac1070 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e78a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27de7fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e78a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:46200/0 (socket says 172.21.15.49:46200) 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27de7fc640 1 -- 172.21.15.49:0/1923174767 learned_addr learned my addr 172.21.15.49:0/1923174767 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27df7fe640 1 --2- 172.21.15.49:0/1923174767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e66100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27df7fe640 1 -- 172.21.15.49:0/1923174767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 msgr2=0x561928e78a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27df7fe640 1 --2- 172.21.15.49:0/1923174767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e78a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27df7fe640 1 -- 172.21.15.49:0/1923174767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928a981b0 msgr2=0x561928e66680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27df7fe640 1 --2- 172.21.15.49:0/1923174767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928a981b0 0x561928e66680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27df7fe640 1 -- 172.21.15.49:0/1923174767 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561928b2c650 con 0x561928ac1070 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.426+0000 7f27de7fc640 1 --2- 172.21.15.49:0/1923174767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e78a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:12.429 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.427+0000 7f27df7fe640 1 --2- 172.21.15.49:0/1923174767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e66100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005e30 tx=0x7f27d802f410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b36ec1a00b1b9d7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:12.430 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.427+0000 7f27c57fa640 1 -- 172.21.15.49:0/1923174767 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8031cf0 con 0x561928ac1070 2024-09-21T06:37:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.427+0000 7f27c57fa640 1 -- 172.21.15.49:0/1923174767 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d8036030 con 0x561928ac1070 2024-09-21T06:37:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.427+0000 7f27c57fa640 1 -- 172.21.15.49:0/1923174767 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8004040 con 0x561928ac1070 2024-09-21T06:37:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.428+0000 7f27c7fff640 1 -- 172.21.15.49:0/2407589529 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f27d0010430 con 0x7f27e0102ae0 2024-09-21T06:37:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.428+0000 7f27ebc27740 1 -- 172.21.15.49:0/1923174767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 msgr2=0x561928e66100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.428+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1923174767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e66100 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005e30 tx=0x7f27d802f410 comp rx=0 tx=0).stop 2024-09-21T06:37:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.428+0000 7f27ebc27740 1 -- 172.21.15.49:0/1923174767 shutdown_connections 2024-09-21T06:37:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.428+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1923174767 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e78a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.428+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1923174767 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928a981b0 0x561928e66680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.428+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1923174767 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e66100 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.428+0000 7f27ebc27740 1 -- 172.21.15.49:0/1923174767 >> 172.21.15.49:0/1923174767 conn(0x561928ab5460 msgr2=0x561928e68620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:12.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.429+0000 7f27ebc27740 1 -- 172.21.15.49:0/1923174767 shutdown_connections 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.429+0000 7f27ebc27740 1 -- 172.21.15.49:0/1923174767 wait complete. 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.429+0000 7f27c7fff640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27c80b6610 0x7f27c80b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.429+0000 7f27ebc27740 1 -- start start 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.429+0000 7f27ebc27740 1 Processor -- start 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.429+0000 7f27de7fc640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27c80b6610 0x7f27c80b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.429+0000 7f27c7fff640 1 -- 172.21.15.49:0/2407589529 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f27d00e77e0 con 0x7f27e0102ae0 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928a981b0 0x561928e7cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e82290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27ebc27740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561928c2f700 con 0x561928aa0390 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27ebc27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561928d69160 con 0x561928a981b0 2024-09-21T06:37:12.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27ebc27740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561928e79370 con 0x561928ac1070 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27df7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e82290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27df7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e82290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:33038/0 (socket says 172.21.15.49:33038) 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27df7fe640 1 -- 172.21.15.49:0/1981614219 learned_addr learned my addr 172.21.15.49:0/1981614219 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27ebc27740 10 client.0 _ll_register_callbacks cb 0x561928d829e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27de7fc640 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27df7fe640 1 -- 172.21.15.49:0/1981614219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928a981b0 msgr2=0x561928e7cc70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27df7fe640 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928a981b0 0x561928e7cc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27df7fe640 1 -- 172.21.15.49:0/1981614219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 msgr2=0x561928e7d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27df7fe640 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27df7fe640 1 -- 172.21.15.49:0/1981614219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561928d96c90 con 0x561928ac1070 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.430+0000 7f27de7fc640 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.431+0000 7f27df7fe640 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e82290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27d8031fd0 tx=0x7f27d8009940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e41db24422d20fc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:12.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.431+0000 7f27c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T06:37:12.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.431+0000 7f27de7fc640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27c80b6610 0x7f27c80b8b20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f27d4012820 tx=0x7f27d4012c20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:12.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.431+0000 7f27c2ff5640 1 -- 172.21.15.49:0/1981614219 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d804a040 con 0x561928ac1070 2024-09-21T06:37:12.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.431+0000 7f27c2ff5640 1 -- 172.21.15.49:0/1981614219 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f27d8031710 con 0x561928ac1070 2024-09-21T06:37:12.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.431+0000 7f27ebc27740 1 -- 172.21.15.49:0/1981614219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27d8036030 con 0x561928ac1070 2024-09-21T06:37:12.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.431+0000 7f27c2ff5640 1 -- 172.21.15.49:0/1981614219 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27d8031910 con 0x561928ac1070 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.431+0000 7f27ebc27740 10 client.25234 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.431+0000 7f27ebc27740 1 -- 172.21.15.49:0/1981614219 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561928e8b180 con 0x561928ac1070 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.432+0000 7f27c2ff5640 1 -- 172.21.15.49:0/1981614219 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d8055070 con 0x561928ac1070 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.432+0000 7f27c2ff5640 1 -- 172.21.15.49:0/1981614219 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f27d804d030 con 0x561928ac1070 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.432+0000 7f27ebc27740 10 client.25234 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.432+0000 7f27ebc27740 10 client.25234 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.432+0000 7f27ebc27740 20 client.25234 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.432+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561928a7f9f0 0x561928e8e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.432+0000 7f27ebc27740 4 client.25234 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.432+0000 7f27ebc27740 1 -- 172.21.15.49:0/1981614219 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f27d8036030 con 0x561928a7f9f0 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.432+0000 7f27deffd640 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561928a7f9f0 0x561928e8e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.433+0000 7f27c2ff5640 10 client.25234 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.433+0000 7f27deffd640 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561928a7f9f0 0x561928e8e4e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8589b8e89370c13a server_cookie=29521fb477f7355c in_seq=0 out_seq=0 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27c2ff5640 1 -- 172.21.15.49:0/1981614219 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f27d8036030 con 0x561928a7f9f0 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27c2ff5640 10 client.25234 handle_command_reply: tid=0 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 client.25234 shutdown 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 -- 172.21.15.49:0/1981614219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 msgr2=0x561928e82290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e82290 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f27d8031fd0 tx=0x7f27d8009940 comp rx=0 tx=0).stop 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 -- 172.21.15.49:0/1981614219 shutdown_connections 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561928a7f9f0 0x561928e8e4e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928ac1070 0x561928e82290 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27c2ff5640 0 client.25234 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:37:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 --2- 172.21.15.49:0/1981614219 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928a981b0 0x561928e7cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 -- 172.21.15.49:0/1981614219 >> 172.21.15.49:0/1981614219 conn(0x561928ab5460 msgr2=0x561928e675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.434+0000 7f27ebc27740 1 -- 172.21.15.49:0/1981614219 shutdown_connections 2024-09-21T06:37:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.435+0000 7f27ebc27740 1 -- 172.21.15.49:0/1981614219 wait complete. 2024-09-21T06:37:12.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.435+0000 7f27ebc27740 20 client.25234 trim_cache size 0 max 16384 2024-09-21T06:37:12.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27ebc27740 1 Processor -- start 2024-09-21T06:37:12.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27ebc27740 1 -- start start 2024-09-21T06:37:12.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e7a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928ac1070 0x561928e7b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27ebc27740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc011160 con 0x561928aa0390 2024-09-21T06:37:12.454 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27ebc27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc00ea30 con 0x561928ac1070 2024-09-21T06:37:12.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27ebc27740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc00c8a0 con 0x561928a981b0 2024-09-21T06:37:12.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27de7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27de7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56944/0 (socket says 172.21.15.49:56944) 2024-09-21T06:37:12.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.452+0000 7f27de7fc640 1 -- 172.21.15.49:0/3467245426 learned_addr learned my addr 172.21.15.49:0/3467245426 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:12.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27deffd640 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e7a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27df7fe640 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928ac1070 0x561928e7b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27de7fc640 1 -- 172.21.15.49:0/3467245426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 msgr2=0x561928e7a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27de7fc640 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e7a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27de7fc640 1 -- 172.21.15.49:0/3467245426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928ac1070 msgr2=0x561928e7b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27de7fc640 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928ac1070 0x561928e7b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27de7fc640 1 -- 172.21.15.49:0/3467245426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561928e7afb0 con 0x561928aa0390 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27df7fe640 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928ac1070 0x561928e7b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27de7fc640 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7b330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f27d40121d0 tx=0x7f27d401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1674edb453a332d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27c4ff9640 1 -- 172.21.15.49:0/3467245426 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d40122c0 con 0x561928aa0390 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27c4ff9640 1 -- 172.21.15.49:0/3467245426 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d40208f0 con 0x561928aa0390 2024-09-21T06:37:12.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.453+0000 7f27c4ff9640 1 -- 172.21.15.49:0/3467245426 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4011910 con 0x561928aa0390 2024-09-21T06:37:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.454+0000 7f27ebc27740 1 -- 172.21.15.49:0/3467245426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 msgr2=0x561928e7b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7b330 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f27d40121d0 tx=0x7f27d401f000 comp rx=0 tx=0).stop 2024-09-21T06:37:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 -- 172.21.15.49:0/3467245426 shutdown_connections 2024-09-21T06:37:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928ac1070 0x561928e7b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928aa0390 0x561928e7b330 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 --2- 172.21.15.49:0/3467245426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e7a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 -- 172.21.15.49:0/3467245426 >> 172.21.15.49:0/3467245426 conn(0x561928ab5460 msgr2=0x561928e82290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:12.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 -- 172.21.15.49:0/3467245426 shutdown_connections 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 -- 172.21.15.49:0/3467245426 wait complete. 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 -- start start 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.455+0000 7f27ebc27740 1 Processor -- start 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e883b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e888f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27ebc27740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928ac1070 0x561928e85380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27ebc27740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc00cef0 con 0x561928ac1070 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27ebc27740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc00e360 con 0x561928aa0390 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27ebc27740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27cc00d5c0 con 0x561928a981b0 2024-09-21T06:37:12.462 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27ebc27740 10 client.0 _ll_register_callbacks cb 0x7f27d4009bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27df7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928ac1070 0x561928e85380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27deffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e883b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27deffd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e883b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:33048/0 (socket says 172.21.15.49:33048) 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27deffd640 1 -- 172.21.15.49:0/2618993641 learned_addr learned my addr 172.21.15.49:0/2618993641 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.456+0000 7f27de7fc640 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e888f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27de7fc640 1 -- 172.21.15.49:0/2618993641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 msgr2=0x561928e883b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27de7fc640 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e883b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27de7fc640 1 -- 172.21.15.49:0/2618993641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928ac1070 msgr2=0x561928e85380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27de7fc640 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928ac1070 0x561928e85380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27de7fc640 1 -- 172.21.15.49:0/2618993641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561928e890c0 con 0x561928aa0390 2024-09-21T06:37:12.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27deffd640 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27df7fe640 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928ac1070 0x561928e85380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27de7fc640 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e888f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27d400f790 tx=0x7f27d40206e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=557953a84ae2c67b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27c2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27c2ff5640 1 -- 172.21.15.49:0/2618993641 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d401b040 con 0x561928aa0390 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27c2ff5640 1 -- 172.21.15.49:0/2618993641 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f27d4005040 con 0x561928aa0390 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.457+0000 7f27ebc27740 1 -- 172.21.15.49:0/2618993641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27d40208f0 con 0x561928aa0390 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.458+0000 7f27c2ff5640 1 -- 172.21.15.49:0/2618993641 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f27d4005240 con 0x561928aa0390 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.458+0000 7f27ebc27740 10 client.25253 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.458+0000 7f27ebc27740 1 -- 172.21.15.49:0/2618993641 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561928ef9260 con 0x561928aa0390 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.458+0000 7f27c2ff5640 1 -- 172.21.15.49:0/2618993641 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d402e070 con 0x561928aa0390 2024-09-21T06:37:12.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.459+0000 7f27c2ff5640 1 -- 172.21.15.49:0/2618993641 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f27d4011550 con 0x561928aa0390 2024-09-21T06:37:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.459+0000 7f27ebc27740 10 client.25253 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.459+0000 7f27ebc27740 10 client.25253 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:37:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.459+0000 7f27ebc27740 20 client.25253 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.459+0000 7f27ebc27740 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561928a54da0 0x561928efb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.459+0000 7f27ebc27740 4 client.25253 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.459+0000 7f27ebc27740 1 -- 172.21.15.49:0/2618993641 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f27d40208f0 con 0x561928a54da0 2024-09-21T06:37:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.459+0000 7f27deffd640 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561928a54da0 0x561928efb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.459+0000 7f27c2ff5640 10 client.25253 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:37:12.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27deffd640 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561928a54da0 0x561928efb9c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f9739f4e460780f server_cookie=8de235d344f0e512 in_seq=0 out_seq=0 2024-09-21T06:37:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27c2ff5640 1 -- 172.21.15.49:0/2618993641 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f27d40208f0 con 0x561928a54da0 2024-09-21T06:37:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27c2ff5640 10 client.25253 handle_command_reply: tid=0 2024-09-21T06:37:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 client.25253 shutdown 2024-09-21T06:37:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 -- 172.21.15.49:0/2618993641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 msgr2=0x561928e888f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e888f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27d400f790 tx=0x7f27d40206e0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 -- 172.21.15.49:0/2618993641 shutdown_connections 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561928a54da0 0x561928efb9c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27c2ff5640 0 client.25253 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561928ac1070 0x561928e85380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561928aa0390 0x561928e888f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 --2- 172.21.15.49:0/2618993641 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561928a981b0 0x561928e883b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 -- 172.21.15.49:0/2618993641 >> 172.21.15.49:0/2618993641 conn(0x561928ab5460 msgr2=0x561928e660a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 -- 172.21.15.49:0/2618993641 shutdown_connections 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 1 -- 172.21.15.49:0/2618993641 wait complete. 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.460+0000 7f27ebc27740 20 client.25253 trim_cache size 0 max 16384 2024-09-21T06:37:12.467 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 -- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27c80b6610 msgr2=0x7f27c80b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27c80b6610 0x7f27c80b8b20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f27d4012820 tx=0x7f27d4012c20 comp rx=0 tx=0).stop 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 -- 172.21.15.49:0/2407589529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27e0102ae0 msgr2=0x7f27e01981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27e0102ae0 0x7f27e01981e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f27d000e9f0 tx=0x7f27d000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 -- 172.21.15.49:0/2407589529 shutdown_connections 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27c80b6610 0x7f27c80b8b20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f27e0108d20 0x7f27e019da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f27e01083d0 0x7f27e0198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 --2- 172.21.15.49:0/2407589529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27e0102ae0 0x7f27e01981e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:12.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 -- 172.21.15.49:0/2407589529 >> 172.21.15.49:0/2407589529 conn(0x7f27e00797b0 msgr2=0x7f27e0106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 -- 172.21.15.49:0/2407589529 shutdown_connections 2024-09-21T06:37:12.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:12.461+0000 7f27e56b3640 1 -- 172.21.15.49:0/2407589529 wait complete. 2024-09-21T06:37:13.182 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:37:13.538 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:13.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:13 smithi049 ceph-mon[31177]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-09-21T06:37:14.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.088+0000 7fa67bd73640 1 -- 172.21.15.49:0/3382274285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109e50 msgr2=0x7fa674110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.088+0000 7fa67bd73640 1 --2- 172.21.15.49:0/3382274285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109e50 0x7fa674110680 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009ca0 tx=0x7fa66c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.088+0000 7fa67bd73640 1 -- 172.21.15.49:0/3382274285 shutdown_connections 2024-09-21T06:37:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.088+0000 7fa67bd73640 1 --2- 172.21.15.49:0/3382274285 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109e50 0x7fa674110680 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.088+0000 7fa67bd73640 1 --2- 172.21.15.49:0/3382274285 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa674109500 0x7fa674109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.088+0000 7fa67bd73640 1 --2- 172.21.15.49:0/3382274285 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa674101fc0 0x7fa6741023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.088+0000 7fa67bd73640 1 -- 172.21.15.49:0/3382274285 >> 172.21.15.49:0/3382274285 conn(0x7fa674079f90 msgr2=0x7fa67407a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.089+0000 7fa67bd73640 1 -- 172.21.15.49:0/3382274285 shutdown_connections 2024-09-21T06:37:14.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.089+0000 7fa67bd73640 1 -- 172.21.15.49:0/3382274285 wait complete. 2024-09-21T06:37:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67bd73640 1 Processor -- start 2024-09-21T06:37:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67bd73640 1 -- start start 2024-09-21T06:37:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67bd73640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa674101fc0 0x7fa67419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67bd73640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109500 0x7fa67419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67bd73640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa674109e50 0x7fa67419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109500 0x7fa67419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67bd73640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa674113b10 con 0x7fa674109500 2024-09-21T06:37:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67bd73640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa674113990 con 0x7fa674109e50 2024-09-21T06:37:14.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67bd73640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa674113c90 con 0x7fa674101fc0 2024-09-21T06:37:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109500 0x7fa67419aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56972/0 (socket says 172.21.15.49:56972) 2024-09-21T06:37:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.090+0000 7fa67930e640 1 -- 172.21.15.49:0/1149592682 learned_addr learned my addr 172.21.15.49:0/1149592682 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa67a310640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa674109e50 0x7fa67419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa67930e640 1 -- 172.21.15.49:0/1149592682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa674101fc0 msgr2=0x7fa67419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa67930e640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa674101fc0 0x7fa67419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa67930e640 1 -- 172.21.15.49:0/1149592682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa674109e50 msgr2=0x7fa67419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa67930e640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa674109e50 0x7fa67419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa67930e640 1 -- 172.21.15.49:0/1149592682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6741a0470 con 0x7fa674109500 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa67930e640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109500 0x7fa67419aaa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa664009d80 tx=0x7fa66400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa66affd640 1 -- 172.21.15.49:0/1149592682 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66401f070 con 0x7fa674109500 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa66affd640 1 -- 172.21.15.49:0/1149592682 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa66401a8c0 con 0x7fa674109500 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa67bd73640 1 -- 172.21.15.49:0/1149592682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6741a0760 con 0x7fa674109500 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.091+0000 7fa66affd640 1 -- 172.21.15.49:0/1149592682 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664019870 con 0x7fa674109500 2024-09-21T06:37:14.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.092+0000 7fa67bd73640 1 -- 172.21.15.49:0/1149592682 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa674102e40 con 0x7fa674109500 2024-09-21T06:37:14.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.094+0000 7fa6822e7740 1 Processor -- start 2024-09-21T06:37:14.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.094+0000 7fa66affd640 1 -- 172.21.15.49:0/1149592682 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fa664022070 con 0x7fa674109500 2024-09-21T06:37:14.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa6822e7740 1 -- start start 2024-09-21T06:37:14.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 0x56149de97eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 0x56149de983f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149de98930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa6822e7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56149de05ea0 con 0x56149dac7390 2024-09-21T06:37:14.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa6822e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56149ddf52d0 con 0x56149dae8070 2024-09-21T06:37:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa6822e7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56149ddf90e0 con 0x56149dabf1b0 2024-09-21T06:37:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa67a310640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 0x56149de97eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149de98930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa67a310640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 0x56149de97eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:46248/0 (socket says 172.21.15.49:46248) 2024-09-21T06:37:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa67a310640 1 -- 172.21.15.49:0/3662481231 learned_addr learned my addr 172.21.15.49:0/3662481231 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149de98930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56978/0 (socket says 172.21.15.49:56978) 2024-09-21T06:37:14.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.095+0000 7fa679b0f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 0x56149de983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.096+0000 7fa679b0f640 1 -- 172.21.15.49:0/3662481231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 msgr2=0x56149de97eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.096+0000 7fa679b0f640 1 --2- 172.21.15.49:0/3662481231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 0x56149de97eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.096+0000 7fa679b0f640 1 -- 172.21.15.49:0/3662481231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 msgr2=0x56149de98930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.096+0000 7fa679b0f640 1 --2- 172.21.15.49:0/3662481231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149de98930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.096+0000 7fa66affd640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6600b6700 0x7fa6600b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.096+0000 7fa679b0f640 1 -- 172.21.15.49:0/3662481231 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149db53650 con 0x56149dabf1b0 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.096+0000 7fa66affd640 1 -- 172.21.15.49:0/1149592682 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa6640e6e60 con 0x7fa674109500 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.097+0000 7fa679b0f640 1 --2- 172.21.15.49:0/3662481231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 0x56149de983f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa670009b40 tx=0x7fa67000e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41548409a20050db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.097+0000 7fa67a310640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6600b6700 0x7fa6600b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.097+0000 7fa65ffff640 1 -- 172.21.15.49:0/3662481231 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67000ed80 con 0x56149dabf1b0 2024-09-21T06:37:14.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.097+0000 7fa65ffff640 1 -- 172.21.15.49:0/3662481231 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa670005020 con 0x56149dabf1b0 2024-09-21T06:37:14.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.097+0000 7fa65ffff640 1 -- 172.21.15.49:0/3662481231 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa670004aa0 con 0x56149dabf1b0 2024-09-21T06:37:14.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa6822e7740 1 -- 172.21.15.49:0/3662481231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 msgr2=0x56149de983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:14.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3662481231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 0x56149de983f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa670009b40 tx=0x7fa67000e350 comp rx=0 tx=0).stop 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa67a310640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6600b6700 0x7fa6600b8c10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0094e0 tx=0x7fa66c005c30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa6822e7740 1 -- 172.21.15.49:0/3662481231 shutdown_connections 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3662481231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149de98930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3662481231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 0x56149de983f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3662481231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 0x56149de97eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa6822e7740 1 -- 172.21.15.49:0/3662481231 >> 172.21.15.49:0/3662481231 conn(0x56149dadc460 msgr2=0x56149de95da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa6822e7740 1 -- 172.21.15.49:0/3662481231 shutdown_connections 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.098+0000 7fa6822e7740 1 -- 172.21.15.49:0/3662481231 wait complete. 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.099+0000 7fa6822e7740 1 -- start start 2024-09-21T06:37:14.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.099+0000 7fa6822e7740 1 Processor -- start 2024-09-21T06:37:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.099+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 0x56149dea3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.099+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149dea3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.099+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 0x56149deaf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.099+0000 7fa6822e7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56149dc56700 con 0x56149dac7390 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.099+0000 7fa6822e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56149dd90160 con 0x56149dae8070 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.099+0000 7fa6822e7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56149dea6690 con 0x56149dabf1b0 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.099+0000 7fa6822e7740 10 client.0 _ll_register_callbacks cb 0x56149dda99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149dea3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149dea3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56986/0 (socket says 172.21.15.49:56986) 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa67930e640 1 -- 172.21.15.49:0/1539692610 learned_addr learned my addr 172.21.15.49:0/1539692610 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa67a310640 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 0x56149deaf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa679b0f640 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 0x56149dea3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa67930e640 1 -- 172.21.15.49:0/1539692610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 msgr2=0x56149dea3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa67930e640 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 0x56149dea3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa67930e640 1 -- 172.21.15.49:0/1539692610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 msgr2=0x56149deaf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa67930e640 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 0x56149deaf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.100+0000 7fa67930e640 1 -- 172.21.15.49:0/1539692610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149ddbdc90 con 0x56149dac7390 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.101+0000 7fa67930e640 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149dea3ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa6640e45f0 tx=0x7fa664012760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a034370308f17d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.101+0000 7fa65d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.101+0000 7fa65d7fa640 1 -- 172.21.15.49:0/1539692610 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa664096e60 con 0x56149dac7390 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.101+0000 7fa65d7fa640 1 -- 172.21.15.49:0/1539692610 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa66401a610 con 0x56149dac7390 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.101+0000 7fa6822e7740 1 -- 172.21.15.49:0/1539692610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa670005020 con 0x56149dac7390 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.101+0000 7fa65d7fa640 1 -- 172.21.15.49:0/1539692610 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6640b0e60 con 0x56149dac7390 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.101+0000 7fa6822e7740 10 client.15585 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.101+0000 7fa6822e7740 1 -- 172.21.15.49:0/1539692610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56149deb2460 con 0x56149dac7390 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.101+0000 7fa65d7fa640 1 -- 172.21.15.49:0/1539692610 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa670005020 con 0x56149dac7390 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.102+0000 7fa65d7fa640 1 -- 172.21.15.49:0/1539692610 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa6640e4ce0 con 0x56149dac7390 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.102+0000 7fa6822e7740 10 client.15585 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.102+0000 7fa6822e7740 10 client.15585 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.102+0000 7fa6822e7740 20 client.15585 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:14.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.102+0000 7fa6822e7740 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x56149daa69f0 0x56149deb59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.102+0000 7fa6822e7740 4 client.15585 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:14.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.102+0000 7fa6822e7740 1 -- 172.21.15.49:0/1539692610 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56149de07df0 con 0x56149daa69f0 2024-09-21T06:37:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.102+0000 7fa679b0f640 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x56149daa69f0 0x56149deb59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.103+0000 7fa679b0f640 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x56149daa69f0 0x56149deb59c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef149d4ca87a78d server_cookie=7242da193cefd552 in_seq=0 out_seq=0 2024-09-21T06:37:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.103+0000 7fa65d7fa640 10 client.15585 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:37:14.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa65d7fa640 1 -- 172.21.15.49:0/1539692610 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56149de07df0 con 0x56149daa69f0 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa65d7fa640 10 client.15585 handle_command_reply: tid=0 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa6822e7740 1 client.15585 shutdown 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa6822e7740 1 -- 172.21.15.49:0/1539692610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 msgr2=0x56149dea3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa6822e7740 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149dea3ad0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa6640e45f0 tx=0x7fa664012760 comp rx=0 tx=0).stop 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa6822e7740 1 -- 172.21.15.49:0/1539692610 shutdown_connections 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa6822e7740 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x56149daa69f0 0x56149deb59c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa65d7fa640 0 client.15585 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa6822e7740 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149dae8070 0x56149deaf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa6822e7740 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dac7390 0x56149dea3ad0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa6822e7740 1 --2- 172.21.15.49:0/1539692610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dabf1b0 0x56149dea3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.104+0000 7fa6822e7740 1 -- 172.21.15.49:0/1539692610 >> 172.21.15.49:0/1539692610 conn(0x56149dadc460 msgr2=0x56149de9b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.105+0000 7fa6822e7740 1 -- 172.21.15.49:0/1539692610 shutdown_connections 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.105+0000 7fa6822e7740 1 -- 172.21.15.49:0/1539692610 wait complete. 2024-09-21T06:37:14.108 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.105+0000 7fa6822e7740 20 client.15585 trim_cache size 0 max 16384 2024-09-21T06:37:14.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.118+0000 7fa6822e7740 1 Processor -- start 2024-09-21T06:37:14.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.118+0000 7fa6822e7740 1 -- start start 2024-09-21T06:37:14.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.118+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.118+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149deaf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.118+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149dea0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.118+0000 7fa6822e7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa6741aff00 con 0x56149dabf1b0 2024-09-21T06:37:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.118+0000 7fa6822e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa6741ad7d0 con 0x56149daa69f0 2024-09-21T06:37:14.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa6822e7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa6741ab640 con 0x56149dac7390 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149deaf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149deaf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56998/0 (socket says 172.21.15.49:56998) 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67930e640 1 -- 172.21.15.49:0/845132909 learned_addr learned my addr 172.21.15.49:0/845132909 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa679b0f640 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67a310640 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149dea0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67a310640 1 -- 172.21.15.49:0/845132909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 msgr2=0x56149dea3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67a310640 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67a310640 1 -- 172.21.15.49:0/845132909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 msgr2=0x56149deaf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67a310640 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149deaf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67a310640 1 -- 172.21.15.49:0/845132909 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56149de9a1a0 con 0x56149dac7390 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa679b0f640 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:14.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.119+0000 7fa67930e640 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149deaf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.120+0000 7fa67a310640 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149dea0780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x56149dea6200 tx=0x7fa66c044000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a324f8ae13f3a0d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.120+0000 7fa65f7fe640 1 -- 172.21.15.49:0/845132909 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c003970 con 0x56149dac7390 2024-09-21T06:37:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.120+0000 7fa65f7fe640 1 -- 172.21.15.49:0/845132909 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa66c036040 con 0x56149dac7390 2024-09-21T06:37:14.123 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.120+0000 7fa65f7fe640 1 -- 172.21.15.49:0/845132909 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c004860 con 0x56149dac7390 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 -- 172.21.15.49:0/845132909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 msgr2=0x56149dea0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149dea0780 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x56149dea6200 tx=0x7fa66c044000 comp rx=0 tx=0).stop 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 -- 172.21.15.49:0/845132909 shutdown_connections 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149dea0780 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149deaf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 --2- 172.21.15.49:0/845132909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 -- 172.21.15.49:0/845132909 >> 172.21.15.49:0/845132909 conn(0x56149dadc460 msgr2=0x56149dea3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 -- 172.21.15.49:0/845132909 shutdown_connections 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 -- 172.21.15.49:0/845132909 wait complete. 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 -- start start 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.121+0000 7fa6822e7740 1 Processor -- start 2024-09-21T06:37:14.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149dea85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa6822e7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149df1f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa6822e7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa6741abc90 con 0x56149dabf1b0 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa6822e7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa6741ad100 con 0x56149daa69f0 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa6822e7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa6741ac360 con 0x56149dac7390 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa6822e7740 10 client.0 _ll_register_callbacks cb 0x7fa6640ea6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149dea85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa67930e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149dea85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57014/0 (socket says 172.21.15.49:57014) 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa67930e640 1 -- 172.21.15.49:0/3058223278 learned_addr learned my addr 172.21.15.49:0/3058223278 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.122+0000 7fa679b0f640 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa67a310640 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149df1f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa67930e640 1 -- 172.21.15.49:0/3058223278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 msgr2=0x56149df1f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:14.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa67930e640 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149df1f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa67930e640 1 -- 172.21.15.49:0/3058223278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 msgr2=0x56149dea8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa67930e640 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa67930e640 1 -- 172.21.15.49:0/3058223278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56149df1f8c0 con 0x56149dabf1b0 2024-09-21T06:37:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa679b0f640 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa67a310640 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149df1f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa67930e640 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149dea85b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa6640ad660 tx=0x7fa6640b0500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d141f9373fb63ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:14.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa65d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.123+0000 7fa65d7fa640 1 -- 172.21.15.49:0/3058223278 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6640b0800 con 0x56149dabf1b0 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa65d7fa640 1 -- 172.21.15.49:0/3058223278 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa6640afd60 con 0x56149dabf1b0 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa6822e7740 1 -- 172.21.15.49:0/3058223278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa66c036040 con 0x56149dabf1b0 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa65d7fa640 1 -- 172.21.15.49:0/3058223278 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa6640b09e0 con 0x56149dabf1b0 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa6822e7740 10 client.15591 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa6822e7740 1 -- 172.21.15.49:0/3058223278 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56149df20b40 con 0x56149dabf1b0 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa65d7fa640 1 -- 172.21.15.49:0/3058223278 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa6640b0ba0 con 0x56149dabf1b0 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa65d7fa640 1 -- 172.21.15.49:0/3058223278 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa6640e4ce0 con 0x56149dabf1b0 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa6822e7740 10 client.15591 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa6822e7740 10 client.15591 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa6822e7740 20 client.15591 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x56149dae8070 0x56149df23330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:14.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa6822e7740 4 client.15591 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.124+0000 7fa6822e7740 1 -- 172.21.15.49:0/3058223278 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fa66c036040 con 0x56149dae8070 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.125+0000 7fa679b0f640 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x56149dae8070 0x56149df23330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa65d7fa640 10 client.15591 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa679b0f640 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x56149dae8070 0x56149df23330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8e83868dffe1ecc6 server_cookie=458fcb2eb08ad4e4 in_seq=0 out_seq=0 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa65d7fa640 1 -- 172.21.15.49:0/3058223278 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fa66c036040 con 0x56149dae8070 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa65d7fa640 10 client.15591 handle_command_reply: tid=0 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa6822e7740 1 client.15591 shutdown 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa6822e7740 1 -- 172.21.15.49:0/3058223278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 msgr2=0x56149dea85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149dea85b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa6640ad660 tx=0x7fa6640b0500 comp rx=0 tx=0).stop 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa6822e7740 1 -- 172.21.15.49:0/3058223278 shutdown_connections 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x56149dae8070 0x56149df23330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56149dac7390 0x56149df1f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56149dabf1b0 0x56149dea85b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa6822e7740 1 --2- 172.21.15.49:0/3058223278 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56149daa69f0 0x56149dea8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa6822e7740 1 -- 172.21.15.49:0/3058223278 >> 172.21.15.49:0/3058223278 conn(0x56149dadc460 msgr2=0x56149dea1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:14.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.126+0000 7fa65d7fa640 0 client.15591 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:37:14.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.127+0000 7fa6822e7740 1 -- 172.21.15.49:0/3058223278 shutdown_connections 2024-09-21T06:37:14.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.127+0000 7fa6822e7740 1 -- 172.21.15.49:0/3058223278 wait complete. 2024-09-21T06:37:14.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.127+0000 7fa6822e7740 20 client.15591 trim_cache size 0 max 16384 2024-09-21T06:37:14.131 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.127+0000 7fa67bd73640 1 -- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6600b6700 msgr2=0x7fa6600b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.127+0000 7fa67bd73640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6600b6700 0x7fa6600b8c10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0094e0 tx=0x7fa66c005c30 comp rx=0 tx=0).stop 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.127+0000 7fa67bd73640 1 -- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109500 msgr2=0x7fa67419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.127+0000 7fa67bd73640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109500 0x7fa67419aaa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa664009d80 tx=0x7fa66400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.128+0000 7fa67bd73640 1 -- 172.21.15.49:0/1149592682 shutdown_connections 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.128+0000 7fa67bd73640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6600b6700 0x7fa6600b8c10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.128+0000 7fa67bd73640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa674109e50 0x7fa67419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.128+0000 7fa67bd73640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa674109500 0x7fa67419aaa0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.128+0000 7fa67bd73640 1 --2- 172.21.15.49:0/1149592682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa674101fc0 0x7fa67419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:14.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.128+0000 7fa67bd73640 1 -- 172.21.15.49:0/1149592682 >> 172.21.15.49:0/1149592682 conn(0x7fa674079f90 msgr2=0x7fa6741054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:14.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.128+0000 7fa67bd73640 1 -- 172.21.15.49:0/1149592682 shutdown_connections 2024-09-21T06:37:14.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:14.128+0000 7fa67bd73640 1 -- 172.21.15.49:0/1149592682 wait complete. 2024-09-21T06:37:14.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:13 smithi098 ceph-mon[34704]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-09-21T06:37:14.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:13 smithi079 ceph-mon[34346]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-09-21T06:37:14.869 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:37:15.162 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:15.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.676+0000 7fb83f9a7640 1 -- 172.21.15.49:0/742395838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb83810de30 msgr2=0x7fb838110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:15.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.676+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/742395838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb83810de30 0x7fb838110320 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb830009ca0 tx=0x7fb83002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.676+0000 7fb83f9a7640 1 -- 172.21.15.49:0/742395838 shutdown_connections 2024-09-21T06:37:15.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.676+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/742395838 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb83810de30 0x7fb838110320 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.676+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/742395838 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb838105320 0x7fb83810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.676+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/742395838 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8381049d0 0x7fb838104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.676+0000 7fb83f9a7640 1 -- 172.21.15.49:0/742395838 >> 172.21.15.49:0/742395838 conn(0x7fb838079740 msgr2=0x7fb838079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:15.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.676+0000 7fb83f9a7640 1 -- 172.21.15.49:0/742395838 shutdown_connections 2024-09-21T06:37:15.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.676+0000 7fb83f9a7640 1 -- 172.21.15.49:0/742395838 wait complete. 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.677+0000 7fb83f9a7640 1 Processor -- start 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.677+0000 7fb83f9a7640 1 -- start start 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83f9a7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8381049d0 0x7fb83819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83f9a7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb838105320 0x7fb83819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83cf42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb838105320 0x7fb83819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83cf42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb838105320 0x7fb83819aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57036/0 (socket says 172.21.15.49:57036) 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83d743640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8381049d0 0x7fb83819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83cf42640 1 -- 172.21.15.49:0/1792310819 learned_addr learned my addr 172.21.15.49:0/1792310819 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83810de30 0x7fb83819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb838113a90 con 0x7fb838105320 2024-09-21T06:37:15.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb838113910 con 0x7fb83810de30 2024-09-21T06:37:15.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.678+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb838113c10 con 0x7fb8381049d0 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83df44640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83810de30 0x7fb83819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83cf42640 1 -- 172.21.15.49:0/1792310819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8381049d0 msgr2=0x7fb83819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83cf42640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8381049d0 0x7fb83819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83cf42640 1 -- 172.21.15.49:0/1792310819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83810de30 msgr2=0x7fb83819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83cf42640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83810de30 0x7fb83819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83cf42640 1 -- 172.21.15.49:0/1792310819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8381a0470 con 0x7fb838105320 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83df44640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83810de30 0x7fb83819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83cf42640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb838105320 0x7fb83819aaa0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb82800e9f0 tx=0x7fb82800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb82e7fc640 1 -- 172.21.15.49:0/1792310819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb82800ccc0 con 0x7fb838105320 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8381a0760 con 0x7fb838105320 2024-09-21T06:37:15.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb82e7fc640 1 -- 172.21.15.49:0/1792310819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8280108e0 con 0x7fb838105320 2024-09-21T06:37:15.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb82e7fc640 1 -- 172.21.15.49:0/1792310819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8280188e0 con 0x7fb838105320 2024-09-21T06:37:15.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.679+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8381025f0 con 0x7fb838105320 2024-09-21T06:37:15.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.680+0000 7fb83d743640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8381049d0 0x7fb83819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:15.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.683+0000 7fb82e7fc640 1 -- 172.21.15.49:0/1792310819 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fb828010430 con 0x7fb838105320 2024-09-21T06:37:15.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb845f1b740 1 Processor -- start 2024-09-21T06:37:15.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb845f1b740 1 -- start start 2024-09-21T06:37:15.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f95070 0x55cc4233c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f6c1b0 0x55cc4233c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f74390 0x55cc4233cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb845f1b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cc422b2ea0 con 0x55cc41f6c1b0 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb845f1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cc422a22d0 con 0x55cc41f95070 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb845f1b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55cc422a60e0 con 0x55cc41f74390 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb83d743640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f6c1b0 0x55cc4233c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb83df44640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f95070 0x55cc4233c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb83d743640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f6c1b0 0x55cc4233c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57042/0 (socket says 172.21.15.49:57042) 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb83d743640 1 -- 172.21.15.49:0/1362834980 learned_addr learned my addr 172.21.15.49:0/1362834980 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.684+0000 7fb83df44640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f95070 0x55cc4233c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:46278/0 (socket says 172.21.15.49:46278) 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.685+0000 7fb83cf42640 1 --2- 172.21.15.49:0/1362834980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f74390 0x55cc4233cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.685+0000 7fb83df44640 1 -- 172.21.15.49:0/1362834980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f74390 msgr2=0x55cc4233cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.685+0000 7fb83df44640 1 --2- 172.21.15.49:0/1362834980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f74390 0x55cc4233cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.685+0000 7fb83df44640 1 -- 172.21.15.49:0/1362834980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f6c1b0 msgr2=0x55cc4233c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.685+0000 7fb83df44640 1 --2- 172.21.15.49:0/1362834980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f6c1b0 0x55cc4233c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.685+0000 7fb83df44640 1 -- 172.21.15.49:0/1362834980 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc42000650 con 0x55cc41f95070 2024-09-21T06:37:15.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.685+0000 7fb83df44640 1 --2- 172.21.15.49:0/1362834980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f95070 0x55cc4233c2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb830006010 tx=0x7fb830009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49c8253ebeeb11d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:15.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.685+0000 7fb8237fe640 1 -- 172.21.15.49:0/1362834980 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300316f0 con 0x55cc41f95070 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.686+0000 7fb8237fe640 1 -- 172.21.15.49:0/1362834980 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb830036040 con 0x55cc41f95070 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.686+0000 7fb8237fe640 1 -- 172.21.15.49:0/1362834980 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300043c0 con 0x55cc41f95070 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.686+0000 7fb82e7fc640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8240b6700 0x7fb8240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.686+0000 7fb82e7fc640 1 -- 172.21.15.49:0/1792310819 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb8280e7b30 con 0x7fb838105320 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.686+0000 7fb83d743640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8240b6700 0x7fb8240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.687+0000 7fb845f1b740 1 -- 172.21.15.49:0/1362834980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f95070 msgr2=0x55cc4233c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.687+0000 7fb845f1b740 1 --2- 172.21.15.49:0/1362834980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f95070 0x55cc4233c2c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb830006010 tx=0x7fb830009a20 comp rx=0 tx=0).stop 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.687+0000 7fb845f1b740 1 -- 172.21.15.49:0/1362834980 shutdown_connections 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.687+0000 7fb845f1b740 1 --2- 172.21.15.49:0/1362834980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f74390 0x55cc4233cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.687+0000 7fb845f1b740 1 --2- 172.21.15.49:0/1362834980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f6c1b0 0x55cc4233c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.687+0000 7fb845f1b740 1 --2- 172.21.15.49:0/1362834980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f95070 0x55cc4233c2c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.687+0000 7fb845f1b740 1 -- 172.21.15.49:0/1362834980 >> 172.21.15.49:0/1362834980 conn(0x55cc41f89460 msgr2=0x55cc4233a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:15.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.687+0000 7fb845f1b740 1 -- 172.21.15.49:0/1362834980 shutdown_connections 2024-09-21T06:37:15.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.688+0000 7fb83d743640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8240b6700 0x7fb8240b8c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55cc4233af40 tx=0x7fb834005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:15.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.688+0000 7fb845f1b740 1 -- 172.21.15.49:0/1362834980 wait complete. 2024-09-21T06:37:15.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.689+0000 7fb845f1b740 1 -- start start 2024-09-21T06:37:15.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.689+0000 7fb845f1b740 1 Processor -- start 2024-09-21T06:37:15.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.689+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 0x55cc42347970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.689+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc42347eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.689+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 0x55cc42353d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.689+0000 7fb845f1b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cc42103700 con 0x55cc41f74390 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.689+0000 7fb845f1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cc4223d160 con 0x55cc41f6c1b0 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.689+0000 7fb845f1b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55cc4234aa40 con 0x55cc41f95070 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb845f1b740 10 client.0 _ll_register_callbacks cb 0x55cc422569e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83cf42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc42347eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83cf42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc42347eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57048/0 (socket says 172.21.15.49:57048) 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83cf42640 1 -- 172.21.15.49:0/3447803131 learned_addr learned my addr 172.21.15.49:0/3447803131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83d743640 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 0x55cc42347970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83df44640 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 0x55cc42353d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83cf42640 1 -- 172.21.15.49:0/3447803131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 msgr2=0x55cc42353d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83cf42640 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 0x55cc42353d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83cf42640 1 -- 172.21.15.49:0/3447803131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 msgr2=0x55cc42347970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83cf42640 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 0x55cc42347970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.690+0000 7fb83cf42640 1 -- 172.21.15.49:0/3447803131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc4226ac90 con 0x55cc41f74390 2024-09-21T06:37:15.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.691+0000 7fb83cf42640 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc42347eb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb8280aab70 tx=0x7fb8280eb120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3f88d037630d15 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.691+0000 7fb820ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.691+0000 7fb820ff9640 1 -- 172.21.15.49:0/3447803131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8280ad6d0 con 0x55cc41f74390 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.691+0000 7fb820ff9640 1 -- 172.21.15.49:0/3447803131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb8280ac5d0 con 0x55cc41f74390 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.691+0000 7fb845f1b740 1 -- 172.21.15.49:0/3447803131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb830036040 con 0x55cc41f74390 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb820ff9640 1 -- 172.21.15.49:0/3447803131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8280ad070 con 0x55cc41f74390 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb845f1b740 10 client.15603 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb845f1b740 1 -- 172.21.15.49:0/3447803131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc42356720 con 0x55cc41f74390 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb820ff9640 1 -- 172.21.15.49:0/3447803131 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb830036040 con 0x55cc41f74390 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb820ff9640 1 -- 172.21.15.49:0/3447803131 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb8280ac7d0 con 0x55cc41f74390 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb845f1b740 10 client.15603 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb845f1b740 10 client.15603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb845f1b740 20 client.15603 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb845f1b740 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cc41f539f0 0x55cc42359c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb845f1b740 4 client.15603 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:15.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.692+0000 7fb845f1b740 1 -- 172.21.15.49:0/3447803131 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc422b4df0 con 0x55cc41f539f0 2024-09-21T06:37:15.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.693+0000 7fb83d743640 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cc41f539f0 0x55cc42359c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.693+0000 7fb83d743640 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cc41f539f0 0x55cc42359c10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b00dfa258b0e411e server_cookie=bf431fdfa2b9a821 in_seq=0 out_seq=0 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.693+0000 7fb820ff9640 10 client.15603 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb820ff9640 1 -- 172.21.15.49:0/3447803131 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc422b4df0 con 0x55cc41f539f0 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb820ff9640 10 client.15603 handle_command_reply: tid=0 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb845f1b740 1 client.15603 shutdown 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb845f1b740 1 -- 172.21.15.49:0/3447803131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 msgr2=0x55cc42347eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb845f1b740 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc42347eb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb8280aab70 tx=0x7fb8280eb120 comp rx=0 tx=0).stop 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb845f1b740 1 -- 172.21.15.49:0/3447803131 shutdown_connections 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb845f1b740 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cc41f539f0 0x55cc42359c10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb845f1b740 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 0x55cc42353d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb845f1b740 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc42347eb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb845f1b740 1 --2- 172.21.15.49:0/3447803131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 0x55cc42347970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.694+0000 7fb845f1b740 1 -- 172.21.15.49:0/3447803131 >> 172.21.15.49:0/3447803131 conn(0x55cc41f89460 msgr2=0x55cc4233f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:15.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.695+0000 7fb820ff9640 0 client.15603 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:15.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.695+0000 7fb845f1b740 1 -- 172.21.15.49:0/3447803131 shutdown_connections 2024-09-21T06:37:15.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.695+0000 7fb845f1b740 1 -- 172.21.15.49:0/3447803131 wait complete. 2024-09-21T06:37:15.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.695+0000 7fb845f1b740 20 client.15603 trim_cache size 0 max 16384 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb845f1b740 1 Processor -- start 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb845f1b740 1 -- start start 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f6c1b0 0x55cc4233da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f74390 0x55cc42339760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f95070 0x55cc42339ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb845f1b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb8381b0010 con 0x55cc41f95070 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb845f1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8381ad8e0 con 0x55cc41f74390 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb845f1b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb8381ab750 con 0x55cc41f6c1b0 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb83df44640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f95070 0x55cc42339ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb83df44640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f95070 0x55cc42339ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57054/0 (socket says 172.21.15.49:57054) 2024-09-21T06:37:15.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.709+0000 7fb83df44640 1 -- 172.21.15.49:0/280606158 learned_addr learned my addr 172.21.15.49:0/280606158 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:15.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb83d743640 1 --2- 172.21.15.49:0/280606158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f6c1b0 0x55cc4233da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb83cf42640 1 --2- 172.21.15.49:0/280606158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f74390 0x55cc42339760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb83df44640 1 -- 172.21.15.49:0/280606158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f6c1b0 msgr2=0x55cc4233da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:15.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb83df44640 1 --2- 172.21.15.49:0/280606158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f6c1b0 0x55cc4233da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb83df44640 1 -- 172.21.15.49:0/280606158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f74390 msgr2=0x55cc42339760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb83df44640 1 --2- 172.21.15.49:0/280606158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f74390 0x55cc42339760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb83df44640 1 -- 172.21.15.49:0/280606158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc4233e7e0 con 0x55cc41f95070 2024-09-21T06:37:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb83df44640 1 --2- 172.21.15.49:0/280606158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f95070 0x55cc42339ca0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb8300094e0 tx=0x7fb83002af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dad395a586c95d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb822ffd640 1 -- 172.21.15.49:0/280606158 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830051020 con 0x55cc41f95070 2024-09-21T06:37:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb822ffd640 1 -- 172.21.15.49:0/280606158 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb830036040 con 0x55cc41f95070 2024-09-21T06:37:15.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.710+0000 7fb822ffd640 1 -- 172.21.15.49:0/280606158 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830049040 con 0x55cc41f95070 2024-09-21T06:37:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.711+0000 7fb845f1b740 1 -- 172.21.15.49:0/280606158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f95070 msgr2=0x55cc42339ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.711+0000 7fb845f1b740 1 --2- 172.21.15.49:0/280606158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f95070 0x55cc42339ca0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb8300094e0 tx=0x7fb83002af60 comp rx=0 tx=0).stop 2024-09-21T06:37:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.711+0000 7fb845f1b740 1 -- 172.21.15.49:0/280606158 shutdown_connections 2024-09-21T06:37:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.711+0000 7fb845f1b740 1 --2- 172.21.15.49:0/280606158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f95070 0x55cc42339ca0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.711+0000 7fb845f1b740 1 --2- 172.21.15.49:0/280606158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f74390 0x55cc42339760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.711+0000 7fb845f1b740 1 --2- 172.21.15.49:0/280606158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f6c1b0 0x55cc4233da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.711+0000 7fb845f1b740 1 -- 172.21.15.49:0/280606158 >> 172.21.15.49:0/280606158 conn(0x55cc41f89460 msgr2=0x55cc4233d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:15.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.712+0000 7fb845f1b740 1 -- 172.21.15.49:0/280606158 shutdown_connections 2024-09-21T06:37:15.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.712+0000 7fb845f1b740 1 -- 172.21.15.49:0/280606158 wait complete. 2024-09-21T06:37:15.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.712+0000 7fb845f1b740 1 -- start start 2024-09-21T06:37:15.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.712+0000 7fb845f1b740 1 Processor -- start 2024-09-21T06:37:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.713+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 0x55cc42350500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.713+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc4234b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.713+0000 7fb845f1b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 0x55cc4234bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.713+0000 7fb845f1b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb8381abda0 con 0x55cc41f74390 2024-09-21T06:37:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.713+0000 7fb845f1b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8381ad210 con 0x55cc41f6c1b0 2024-09-21T06:37:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.713+0000 7fb845f1b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb8381ac470 con 0x55cc41f95070 2024-09-21T06:37:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.713+0000 7fb83cf42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc4234b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83cf42640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc4234b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57056/0 (socket says 172.21.15.49:57056) 2024-09-21T06:37:15.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83cf42640 1 -- 172.21.15.49:0/2729087284 learned_addr learned my addr 172.21.15.49:0/2729087284 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83df44640 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 0x55cc4234bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb845f1b740 10 client.0 _ll_register_callbacks cb 0x7fb8280a9f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83d743640 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 0x55cc42350500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83cf42640 1 -- 172.21.15.49:0/2729087284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 msgr2=0x55cc4234bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83cf42640 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 0x55cc4234bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83cf42640 1 -- 172.21.15.49:0/2729087284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 msgr2=0x55cc42350500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83cf42640 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 0x55cc42350500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83cf42640 1 -- 172.21.15.49:0/2729087284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc4234c6e0 con 0x55cc41f74390 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83df44640 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 0x55cc4234bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb83cf42640 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc4234b9b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb8280b23e0 tx=0x7fb8280b37a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1092e36474d27b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb820ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb820ff9640 1 -- 172.21.15.49:0/2729087284 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8280ad250 con 0x55cc41f74390 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.714+0000 7fb820ff9640 1 -- 172.21.15.49:0/2729087284 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb828018a80 con 0x55cc41f74390 2024-09-21T06:37:15.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb845f1b740 1 -- 172.21.15.49:0/2729087284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb830036040 con 0x55cc41f74390 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb820ff9640 1 -- 172.21.15.49:0/2729087284 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb8280ad6d0 con 0x55cc41f74390 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb845f1b740 10 client.15609 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb845f1b740 1 -- 172.21.15.49:0/2729087284 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc423c45d0 con 0x55cc41f74390 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb820ff9640 1 -- 172.21.15.49:0/2729087284 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb830036040 con 0x55cc41f74390 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb820ff9640 1 -- 172.21.15.49:0/2729087284 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb828018c80 con 0x55cc41f74390 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb845f1b740 10 client.15609 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb845f1b740 10 client.15609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb845f1b740 20 client.15609 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb845f1b740 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cc41f28da0 0x55cc423c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb845f1b740 4 client.15609 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:15.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.715+0000 7fb845f1b740 1 -- 172.21.15.49:0/2729087284 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc422b08a0 con 0x55cc41f28da0 2024-09-21T06:37:15.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.716+0000 7fb83d743640 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cc41f28da0 0x55cc423c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:15.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.716+0000 7fb820ff9640 10 client.15609 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:15.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb83d743640 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cc41f28da0 0x55cc423c6b50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaaa023554487e91 server_cookie=15d4046d4d8da832 in_seq=0 out_seq=0 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb820ff9640 1 -- 172.21.15.49:0/2729087284 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc422b08a0 con 0x55cc41f28da0 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb820ff9640 10 client.15609 handle_command_reply: tid=0 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb845f1b740 1 client.15609 shutdown 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb845f1b740 1 -- 172.21.15.49:0/2729087284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 msgr2=0x55cc4234b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb845f1b740 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc4234b9b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb8280b23e0 tx=0x7fb8280b37a0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb845f1b740 1 -- 172.21.15.49:0/2729087284 shutdown_connections 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb845f1b740 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cc41f28da0 0x55cc423c6b50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb845f1b740 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cc41f95070 0x55cc4234bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.717+0000 7fb820ff9640 0 client.15609 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.718+0000 7fb845f1b740 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cc41f74390 0x55cc4234b9b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.718+0000 7fb845f1b740 1 --2- 172.21.15.49:0/2729087284 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cc41f6c1b0 0x55cc42350500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.718+0000 7fb845f1b740 1 -- 172.21.15.49:0/2729087284 >> 172.21.15.49:0/2729087284 conn(0x55cc41f89460 msgr2=0x55cc42347eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.718+0000 7fb845f1b740 1 -- 172.21.15.49:0/2729087284 shutdown_connections 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.718+0000 7fb845f1b740 1 -- 172.21.15.49:0/2729087284 wait complete. 2024-09-21T06:37:15.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.718+0000 7fb845f1b740 20 client.15609 trim_cache size 0 max 16384 2024-09-21T06:37:15.722 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:37:15.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8240b6700 msgr2=0x7fb8240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:15.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8240b6700 0x7fb8240b8c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55cc4233af40 tx=0x7fb834005f90 comp rx=0 tx=0).stop 2024-09-21T06:37:15.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb838105320 msgr2=0x7fb83819aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb838105320 0x7fb83819aaa0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb82800e9f0 tx=0x7fb82800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 shutdown_connections 2024-09-21T06:37:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb8240b6700 0x7fb8240b8c10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb83810de30 0x7fb83819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb838105320 0x7fb83819aaa0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 --2- 172.21.15.49:0/1792310819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8381049d0 0x7fb83819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.719+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 >> 172.21.15.49:0/1792310819 conn(0x7fb838079740 msgr2=0x7fb838106270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.720+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 shutdown_connections 2024-09-21T06:37:15.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:15.720+0000 7fb83f9a7640 1 -- 172.21.15.49:0/1792310819 wait complete. 2024-09-21T06:37:16.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:15 smithi049 ceph-mon[31177]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 22 op/s 2024-09-21T06:37:16.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:15 smithi098 ceph-mon[34704]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 22 op/s 2024-09-21T06:37:16.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:15 smithi079 ceph-mon[34346]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 22 op/s 2024-09-21T06:37:16.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.782+0000 7f2dac36e640 1 -- 172.21.15.49:0/2677727645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4103130 msgr2=0x7f2da4103540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.782+0000 7f2dac36e640 1 --2- 172.21.15.49:0/2677727645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4103130 0x7f2da4103540 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009950 tx=0x7f2da002a440 comp rx=0 tx=0).stop 2024-09-21T06:37:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.782+0000 7f2dac36e640 1 -- 172.21.15.49:0/2677727645 shutdown_connections 2024-09-21T06:37:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.782+0000 7f2dac36e640 1 --2- 172.21.15.49:0/2677727645 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da4108d80 0x7f2da410f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.783+0000 7f2dac36e640 1 --2- 172.21.15.49:0/2677727645 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da4108430 0x7f2da4108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.783+0000 7f2dac36e640 1 --2- 172.21.15.49:0/2677727645 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4103130 0x7f2da4103540 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.783+0000 7f2dac36e640 1 -- 172.21.15.49:0/2677727645 >> 172.21.15.49:0/2677727645 conn(0x7f2da4079e50 msgr2=0x7f2da407a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.783+0000 7f2dac36e640 1 -- 172.21.15.49:0/2677727645 shutdown_connections 2024-09-21T06:37:16.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.783+0000 7f2dac36e640 1 -- 172.21.15.49:0/2677727645 wait complete. 2024-09-21T06:37:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2dac36e640 1 Processor -- start 2024-09-21T06:37:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2dac36e640 1 -- start start 2024-09-21T06:37:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2dac36e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da4103130 0x7f2da4111ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2dac36e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4108430 0x7f2da4110090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2dac36e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da4108d80 0x7f2da41105d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2da9909640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4108430 0x7f2da4110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2da9909640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4108430 0x7f2da4110090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39048/0 (socket says 172.21.15.49:39048) 2024-09-21T06:37:16.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2da9909640 1 -- 172.21.15.49:0/1945469816 learned_addr learned my addr 172.21.15.49:0/1945469816 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2da4113b60 con 0x7f2da4108430 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2da41139e0 con 0x7f2da4108d80 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2da4113ce0 con 0x7f2da4103130 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.784+0000 7f2daa10a640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da4103130 0x7f2da4111ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2da9909640 1 -- 172.21.15.49:0/1945469816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da4103130 msgr2=0x7f2da4111ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2da9909640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da4103130 0x7f2da4111ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2da9909640 1 -- 172.21.15.49:0/1945469816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da4108d80 msgr2=0x7f2da41105d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2daa90b640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da4108d80 0x7f2da41105d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2da9909640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da4108d80 0x7f2da41105d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2da9909640 1 -- 172.21.15.49:0/1945469816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da4110df0 con 0x7f2da4108430 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2daa90b640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da4108d80 0x7f2da41105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2da9909640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4108430 0x7f2da4110090 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400e9f0 tx=0x7f2d9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2d9b7fe640 1 -- 172.21.15.49:0/1945469816 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9400ccc0 con 0x7f2da4108430 2024-09-21T06:37:16.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2d9b7fe640 1 -- 172.21.15.49:0/1945469816 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d940108e0 con 0x7f2da4108430 2024-09-21T06:37:16.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.785+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da41acf50 con 0x7f2da4108430 2024-09-21T06:37:16.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.786+0000 7f2d9b7fe640 1 -- 172.21.15.49:0/1945469816 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d94018860 con 0x7f2da4108430 2024-09-21T06:37:16.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.786+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da41ad350 con 0x7f2da4108430 2024-09-21T06:37:16.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.790+0000 7f2db33bd740 1 Processor -- start 2024-09-21T06:37:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.790+0000 7f2db33bd740 1 -- start start 2024-09-21T06:37:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.790+0000 7f2d9b7fe640 1 -- 172.21.15.49:0/1945469816 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2d94010430 con 0x7f2da4108430 2024-09-21T06:37:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.790+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613fe1b0 0x55f6617a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.790+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 0x55f6617a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.790+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613dd4d0 0x55f6617a4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.790+0000 7f2db33bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f6617186f0 con 0x55f6613fe1b0 2024-09-21T06:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.790+0000 7f2db33bd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f661707b20 con 0x55f6613d52f0 2024-09-21T06:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.790+0000 7f2db33bd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f66170b930 con 0x55f6613dd4d0 2024-09-21T06:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa90b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613fe1b0 0x55f6617a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa90b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613fe1b0 0x55f6617a39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39054/0 (socket says 172.21.15.49:39054) 2024-09-21T06:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa90b640 1 -- 172.21.15.49:0/4275208427 learned_addr learned my addr 172.21.15.49:0/4275208427 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa10a640 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 0x55f6617a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2da9909640 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613dd4d0 0x55f6617a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa10a640 1 -- 172.21.15.49:0/4275208427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613dd4d0 msgr2=0x55f6617a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa10a640 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613dd4d0 0x55f6617a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa10a640 1 -- 172.21.15.49:0/4275208427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613fe1b0 msgr2=0x55f6617a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa10a640 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613fe1b0 0x55f6617a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa10a640 1 -- 172.21.15.49:0/4275208427 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6616cd530 con 0x55f6613d52f0 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa90b640 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613fe1b0 0x55f6617a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.791+0000 7f2daa10a640 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 0x55f6617a3ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009230 tx=0x7f2da0004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e22fc39352e67ba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.792+0000 7f2d98bfe640 1 -- 172.21.15.49:0/4275208427 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0035040 con 0x55f6613d52f0 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.792+0000 7f2d98bfe640 1 -- 172.21.15.49:0/4275208427 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2da00054d0 con 0x55f6613d52f0 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.792+0000 7f2d9b7fe640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d900b6700 0x7f2d900b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.792+0000 7f2daa90b640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d900b6700 0x7f2d900b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.792+0000 7f2d9b7fe640 1 -- 172.21.15.49:0/1945469816 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f2d940e7a00 con 0x7f2da4108430 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2d98bfe640 1 -- 172.21.15.49:0/4275208427 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da00035f0 con 0x55f6613d52f0 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2db33bd740 1 -- 172.21.15.49:0/4275208427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 msgr2=0x55f6617a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2db33bd740 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 0x55f6617a3ef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2da0009230 tx=0x7f2da0004040 comp rx=0 tx=0).stop 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2daa90b640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d900b6700 0x7f2d900b8c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c005f40 tx=0x7f2d9c009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2db33bd740 1 -- 172.21.15.49:0/4275208427 shutdown_connections 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2db33bd740 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613dd4d0 0x55f6617a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2db33bd740 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 0x55f6617a3ef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2db33bd740 1 --2- 172.21.15.49:0/4275208427 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613fe1b0 0x55f6617a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2db33bd740 1 -- 172.21.15.49:0/4275208427 >> 172.21.15.49:0/4275208427 conn(0x55f6613f2300 msgr2=0x55f6617a18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2db33bd740 1 -- 172.21.15.49:0/4275208427 shutdown_connections 2024-09-21T06:37:16.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.793+0000 7f2db33bd740 1 -- 172.21.15.49:0/4275208427 wait complete. 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.794+0000 7f2db33bd740 1 -- start start 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.794+0000 7f2db33bd740 1 Processor -- start 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.794+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613d52f0 0x55f6617aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.794+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613dd4d0 0x55f6617af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.794+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 0x55f6617afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.794+0000 7f2db33bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f66163fab0 con 0x55f6613d52f0 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2db33bd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f6616ad730 con 0x55f6613dd4d0 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2db33bd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f6617b2170 con 0x55f6613fe1b0 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa10a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613d52f0 0x55f6617aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2db33bd740 10 client.0 _ll_register_callbacks cb 0x55f6617016b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa10a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613d52f0 0x55f6617aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39058/0 (socket says 172.21.15.49:39058) 2024-09-21T06:37:16.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa10a640 1 -- 172.21.15.49:0/1385167625 learned_addr learned my addr 172.21.15.49:0/1385167625 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2da9909640 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613dd4d0 0x55f6617af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa90b640 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 0x55f6617afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa10a640 1 -- 172.21.15.49:0/1385167625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 msgr2=0x55f6617afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa10a640 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 0x55f6617afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa10a640 1 -- 172.21.15.49:0/1385167625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613dd4d0 msgr2=0x55f6617af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa10a640 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613dd4d0 0x55f6617af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa10a640 1 -- 172.21.15.49:0/1385167625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f661469790 con 0x55f6613d52f0 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2daa10a640 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613d52f0 0x55f6617aefe0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2da00049d0 tx=0x7f2da0004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6fa3bbeb0eb6f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.795+0000 7f2d8dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1385167625 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0052060 con 0x55f6613d52f0 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1385167625 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f2da0004df0 con 0x55f6613d52f0 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2db33bd740 1 -- 172.21.15.49:0/1385167625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2da00054d0 con 0x55f6613d52f0 2024-09-21T06:37:16.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1385167625 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2da0035050 con 0x55f6613d52f0 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2db33bd740 10 client.15621 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2db33bd740 1 -- 172.21.15.49:0/1385167625 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f6614e2620 con 0x55f6613d52f0 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1385167625 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2da00054d0 con 0x55f6613d52f0 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1385167625 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2da0003b10 con 0x55f6613d52f0 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2db33bd740 10 client.15621 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2db33bd740 10 client.15621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2db33bd740 20 client.15621 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f6613bcd80 0x55f6617c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2db33bd740 4 client.15621 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.796+0000 7f2db33bd740 1 -- 172.21.15.49:0/1385167625 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f66171a640 con 0x55f6613bcd80 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.797+0000 7f2da9909640 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f6613bcd80 0x55f6617c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.797+0000 7f2da9909640 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f6613bcd80 0x55f6617c1020 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b23c0934be138c56 server_cookie=eed1ff217e45ab4a in_seq=0 out_seq=0 2024-09-21T06:37:16.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.797+0000 7f2d8dffb640 10 client.15621 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:16.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1385167625 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f66171a640 con 0x55f6613bcd80 2024-09-21T06:37:16.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2d8dffb640 10 client.15621 handle_command_reply: tid=0 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 client.15621 shutdown 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 -- 172.21.15.49:0/1385167625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613d52f0 msgr2=0x55f6617aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613d52f0 0x55f6617aefe0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f2da00049d0 tx=0x7f2da0004a00 comp rx=0 tx=0).stop 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 -- 172.21.15.49:0/1385167625 shutdown_connections 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f6613bcd80 0x55f6617c1020 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2d8dffb640 0 client.15621 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 0x55f6617afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613dd4d0 0x55f6617af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1385167625 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613d52f0 0x55f6617aefe0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 -- 172.21.15.49:0/1385167625 >> 172.21.15.49:0/1385167625 conn(0x55f6613f2300 msgr2=0x55f6617a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 -- 172.21.15.49:0/1385167625 shutdown_connections 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.798+0000 7f2db33bd740 1 -- 172.21.15.49:0/1385167625 wait complete. 2024-09-21T06:37:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.799+0000 7f2db33bd740 20 client.15621 trim_cache size 0 max 16384 2024-09-21T06:37:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2db33bd740 1 Processor -- start 2024-09-21T06:37:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2db33bd740 1 -- start start 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 0x55f6617b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 0x55f6617ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2db33bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2da41b8680 con 0x55f6613dd4d0 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2db33bd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2da41b5f50 con 0x55f6613d52f0 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2db33bd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2da41b3dc0 con 0x55f6613fe1b0 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2da9909640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2da9909640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617ac1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39068/0 (socket says 172.21.15.49:39068) 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.828+0000 7f2da9909640 1 -- 172.21.15.49:0/2203749318 learned_addr learned my addr 172.21.15.49:0/2203749318 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2daa10a640 1 --2- 172.21.15.49:0/2203749318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 0x55f6617b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2daa90b640 1 --2- 172.21.15.49:0/2203749318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 0x55f6617ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2da9909640 1 -- 172.21.15.49:0/2203749318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 msgr2=0x55f6617ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2da9909640 1 --2- 172.21.15.49:0/2203749318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 0x55f6617ac6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2da9909640 1 -- 172.21.15.49:0/2203749318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 msgr2=0x55f6617b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2da9909640 1 --2- 172.21.15.49:0/2203749318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 0x55f6617b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2da9909640 1 -- 172.21.15.49:0/2203749318 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f6617a26d0 con 0x55f6613dd4d0 2024-09-21T06:37:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2da9909640 1 --2- 172.21.15.49:0/2203749318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617ac1b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2d940a9e00 tx=0x7f2d940a9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4fdda1798011d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2d8ffff640 1 -- 172.21.15.49:0/2203749318 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d940ee020 con 0x55f6613dd4d0 2024-09-21T06:37:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2d8ffff640 1 -- 172.21.15.49:0/2203749318 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d94010720 con 0x55f6613dd4d0 2024-09-21T06:37:16.832 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.829+0000 7f2d8ffff640 1 -- 172.21.15.49:0/2203749318 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d940f1040 con 0x55f6613dd4d0 2024-09-21T06:37:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 -- 172.21.15.49:0/2203749318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 msgr2=0x55f6617ac1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 --2- 172.21.15.49:0/2203749318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617ac1b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2d940a9e00 tx=0x7f2d940a9040 comp rx=0 tx=0).stop 2024-09-21T06:37:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 -- 172.21.15.49:0/2203749318 shutdown_connections 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 --2- 172.21.15.49:0/2203749318 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613fe1b0 0x55f6617ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 --2- 172.21.15.49:0/2203749318 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617ac1b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 --2- 172.21.15.49:0/2203749318 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613d52f0 0x55f6617b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 -- 172.21.15.49:0/2203749318 >> 172.21.15.49:0/2203749318 conn(0x55f6613f2300 msgr2=0x55f6617b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 -- 172.21.15.49:0/2203749318 shutdown_connections 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 -- 172.21.15.49:0/2203749318 wait complete. 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 -- start start 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.831+0000 7f2db33bd740 1 Processor -- start 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613d52f0 0x55f6617c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2db33bd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613fe1b0 0x55f661821750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2db33bd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2da41b4410 con 0x55f6613dd4d0 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2da9909640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2daa10a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613d52f0 0x55f6617c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2da9909640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39074/0 (socket says 172.21.15.49:39074) 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2da9909640 1 -- 172.21.15.49:0/1950820352 learned_addr learned my addr 172.21.15.49:0/1950820352 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2da41b5880 con 0x55f6613fe1b0 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2da41b4ae0 con 0x55f6613d52f0 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2daa90b640 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613fe1b0 0x55f661821750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2daa10a640 1 -- 172.21.15.49:0/1950820352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613fe1b0 msgr2=0x55f661821750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2daa10a640 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613fe1b0 0x55f661821750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2daa10a640 1 -- 172.21.15.49:0/1950820352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 msgr2=0x55f6617c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.832+0000 7f2daa10a640 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2daa10a640 1 -- 172.21.15.49:0/1950820352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f661821dc0 con 0x55f6613d52f0 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2db33bd740 10 client.0 _ll_register_callbacks cb 0x7f2d9c009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f6617160f0 con 0x55f6613d52f0 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2daa90b640 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613fe1b0 0x55f661821750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2da9909640 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2daa10a640 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613d52f0 0x55f6617c3c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2da002aa30 tx=0x7f2da0003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e4019de8c02422 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2d8dffb640 10 client.25285 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1950820352 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da0052040 con 0x55f6613d52f0 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1950820352 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f2da0005000 con 0x55f6613d52f0 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1950820352 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2da0005260 con 0x55f6613d52f0 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2db33bd740 10 client.25285 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.833+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55f66182b1a0 con 0x55f6613d52f0 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1950820352 <== mon.1 v2:172.21.15.98:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2da0005400 con 0x55f6613d52f0 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2db33bd740 10 client.25285 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2db33bd740 10 client.25285 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2db33bd740 20 client.25285 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f6613921c0 0x55f66182d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2db33bd740 4 client.25285 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f661713520 con 0x55f6613921c0 2024-09-21T06:37:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2da9909640 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f6613921c0 0x55f66182d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:16.839 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2d8dffb640 10 client.25285 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:16.839 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.834+0000 7f2da9909640 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f6613921c0 0x55f66182d850 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9cf56902f3d70ff server_cookie=c4ae275df88eb6 in_seq=0 out_seq=0 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2d8dffb640 1 -- 172.21.15.49:0/1950820352 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f661713520 con 0x55f6613921c0 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2d8dffb640 10 client.25285 handle_command_reply: tid=0 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 client.25285 shutdown 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613d52f0 msgr2=0x55f6617c3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613d52f0 0x55f6617c3c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2da002aa30 tx=0x7f2da0003ce0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 shutdown_connections 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f6613921c0 0x55f66182d850 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f6613fe1b0 0x55f661821750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2d8dffb640 0 client.25285 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:16.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f6613dd4d0 0x55f6617c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 --2- 172.21.15.49:0/1950820352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f6613d52f0 0x55f6617c3c30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 >> 172.21.15.49:0/1950820352 conn(0x55f6613f2300 msgr2=0x55f6617a1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 shutdown_connections 2024-09-21T06:37:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 1 -- 172.21.15.49:0/1950820352 wait complete. 2024-09-21T06:37:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.842+0000 7f2db33bd740 20 client.25285 trim_cache size 0 max 16384 2024-09-21T06:37:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:37:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:37:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:37:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:37:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d900b6700 msgr2=0x7f2d900b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d900b6700 0x7f2d900b8c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c005f40 tx=0x7f2d9c009500 comp rx=0 tx=0).stop 2024-09-21T06:37:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4108430 msgr2=0x7f2da4110090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4108430 0x7f2da4110090 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f2d9400e9f0 tx=0x7f2d9400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 shutdown_connections 2024-09-21T06:37:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2d900b6700 0x7f2d900b8c10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2da4108d80 0x7f2da41105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2da4108430 0x7f2da4110090 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 --2- 172.21.15.49:0/1945469816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2da4103130 0x7f2da4111ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 >> 172.21.15.49:0/1945469816 conn(0x7f2da4079e50 msgr2=0x7f2da4106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 shutdown_connections 2024-09-21T06:37:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:16.843+0000 7f2dac36e640 1 -- 172.21.15.49:0/1945469816 wait complete. 2024-09-21T06:37:17.393 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:37:17.394 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:37:17.685 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:18.067 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:17 smithi049 ceph-mon[31177]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2024-09-21T06:37:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.216+0000 7f61c66ac640 1 -- 172.21.15.49:0/208468996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0101f70 msgr2=0x7f61c0102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.216+0000 7f61c66ac640 1 --2- 172.21.15.49:0/208468996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0101f70 0x7f61c0102380 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009900 tx=0x7f61b002a410 comp rx=0 tx=0).stop 2024-09-21T06:37:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.216+0000 7f61c66ac640 1 -- 172.21.15.49:0/208468996 shutdown_connections 2024-09-21T06:37:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.216+0000 7f61c66ac640 1 --2- 172.21.15.49:0/208468996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c0109e00 0x7f61c0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.216+0000 7f61c66ac640 1 --2- 172.21.15.49:0/208468996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01094b0 0x7f61c01098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.216+0000 7f61c66ac640 1 --2- 172.21.15.49:0/208468996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0101f70 0x7f61c0102380 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.216+0000 7f61c66ac640 1 -- 172.21.15.49:0/208468996 >> 172.21.15.49:0/208468996 conn(0x7f61c0077c60 msgr2=0x7f61c00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.217+0000 7f61c66ac640 1 -- 172.21.15.49:0/208468996 shutdown_connections 2024-09-21T06:37:18.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.217+0000 7f61c66ac640 1 -- 172.21.15.49:0/208468996 wait complete. 2024-09-21T06:37:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.218+0000 7f61c66ac640 1 Processor -- start 2024-09-21T06:37:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.218+0000 7f61c66ac640 1 -- start start 2024-09-21T06:37:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61c66ac640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01094b0 0x7f61c019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61c66ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0109e00 0x7f61c019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61c66ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c019fd70 0x7f61c01a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61c66ac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0113ac0 con 0x7f61c0109e00 2024-09-21T06:37:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61c66ac640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0113940 con 0x7f61c019fd70 2024-09-21T06:37:18.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61c66ac640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61c0113c40 con 0x7f61c01094b0 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0109e00 0x7f61c019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0109e00 0x7f61c019ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39088/0 (socket says 172.21.15.49:39088) 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61bf7fe640 1 -- 172.21.15.49:0/813991770 learned_addr learned my addr 172.21.15.49:0/813991770 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61c4c49640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c019fd70 0x7f61c01a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61bf7fe640 1 -- 172.21.15.49:0/813991770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01094b0 msgr2=0x7f61c019a5f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01094b0 0x7f61c019a5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.219+0000 7f61bf7fe640 1 -- 172.21.15.49:0/813991770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c019fd70 msgr2=0x7f61c01a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.220+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c019fd70 0x7f61c01a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.220+0000 7f61bf7fe640 1 -- 172.21.15.49:0/813991770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c01a08c0 con 0x7f61c0109e00 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.220+0000 7f61c4c49640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c019fd70 0x7f61c01a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.220+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0109e00 0x7f61c019ab90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f61b400c8c0 tx=0x7f61b400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.220+0000 7f61bd7fa640 1 -- 172.21.15.49:0/813991770 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4007bb0 con 0x7f61c0109e00 2024-09-21T06:37:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.220+0000 7f61bd7fa640 1 -- 172.21.15.49:0/813991770 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b4007d50 con 0x7f61c0109e00 2024-09-21T06:37:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.221+0000 7f61bd7fa640 1 -- 172.21.15.49:0/813991770 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b40187c0 con 0x7f61c0109e00 2024-09-21T06:37:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.221+0000 7f61c66ac640 1 -- 172.21.15.49:0/813991770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c01a0bb0 con 0x7f61c0109e00 2024-09-21T06:37:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.222+0000 7f61c66ac640 1 -- 172.21.15.49:0/813991770 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c01a7180 con 0x7f61c0109e00 2024-09-21T06:37:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.225+0000 7f61bd7fa640 1 -- 172.21.15.49:0/813991770 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f61b4005030 con 0x7f61c0109e00 2024-09-21T06:37:18.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.225+0000 7f61ccc20740 1 Processor -- start 2024-09-21T06:37:18.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.225+0000 7f61bd7fa640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a80b6560 0x7f61a80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.225+0000 7f61ccc20740 1 -- start start 2024-09-21T06:37:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16758350 0x556b16aff430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61c4c49640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a80b6560 0x7f61a80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16aff970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 0x556b16affeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61ccc20740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556b16a75e60 con 0x556b1672f490 2024-09-21T06:37:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61ccc20740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556b16a65290 con 0x556b16758350 2024-09-21T06:37:18.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61ccc20740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556b16a690a0 con 0x556b16737670 2024-09-21T06:37:18.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61c4c49640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 0x556b16affeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16aff970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16758350 0x556b16aff430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61c4c49640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 0x556b16affeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:54924/0 (socket says 172.21.15.49:54924) 2024-09-21T06:37:18.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.226+0000 7f61c4c49640 1 -- 172.21.15.49:0/4107716749 learned_addr learned my addr 172.21.15.49:0/4107716749 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:18.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.227+0000 7f61bf7fe640 1 -- 172.21.15.49:0/4107716749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 msgr2=0x556b16affeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:18.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.227+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/4107716749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 0x556b16affeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.227+0000 7f61bf7fe640 1 -- 172.21.15.49:0/4107716749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16758350 msgr2=0x556b16aff430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:18.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.227+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/4107716749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16758350 0x556b16aff430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.227+0000 7f61bf7fe640 1 -- 172.21.15.49:0/4107716749 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b167c3930 con 0x556b1672f490 2024-09-21T06:37:18.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.227+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/4107716749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16aff970 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f61b40e4a50 tx=0x7f61b40ddbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3225956dba553289 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:18.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.228+0000 7f61a67fc640 1 -- 172.21.15.49:0/4107716749 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4077180 con 0x556b1672f490 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.228+0000 7f61a67fc640 1 -- 172.21.15.49:0/4107716749 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b40acc60 con 0x556b1672f490 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.228+0000 7f61a67fc640 1 -- 172.21.15.49:0/4107716749 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b4076120 con 0x556b1672f490 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.228+0000 7f61bd7fa640 1 -- 172.21.15.49:0/813991770 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f61b40e7320 con 0x7f61c0109e00 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 -- 172.21.15.49:0/4107716749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 msgr2=0x556b16aff970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61c4c49640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a80b6560 0x7f61a80b8a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f61b800fbf0 tx=0x7f61b801c510 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 --2- 172.21.15.49:0/4107716749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16aff970 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f61b40e4a50 tx=0x7f61b40ddbf0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 -- 172.21.15.49:0/4107716749 shutdown_connections 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 --2- 172.21.15.49:0/4107716749 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 0x556b16affeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 --2- 172.21.15.49:0/4107716749 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16aff970 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 --2- 172.21.15.49:0/4107716749 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16758350 0x556b16aff430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 -- 172.21.15.49:0/4107716749 >> 172.21.15.49:0/4107716749 conn(0x556b1674c740 msgr2=0x556b16afd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:18.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 -- 172.21.15.49:0/4107716749 shutdown_connections 2024-09-21T06:37:18.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 -- 172.21.15.49:0/4107716749 wait complete. 2024-09-21T06:37:18.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.229+0000 7f61ccc20740 1 -- start start 2024-09-21T06:37:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61ccc20740 1 Processor -- start 2024-09-21T06:37:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61bffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61bffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39112/0 (socket says 172.21.15.49:39112) 2024-09-21T06:37:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61bffff640 1 -- 172.21.15.49:0/649443924 learned_addr learned my addr 172.21.15.49:0/649443924 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61ccc20740 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 0x556b16b0b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61ccc20740 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16758350 0x556b16b16ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556b168c6890 con 0x556b1672f490 2024-09-21T06:37:18.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556b169ffd40 con 0x556b16737670 2024-09-21T06:37:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556b16b0dbb0 con 0x556b16758350 2024-09-21T06:37:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.230+0000 7f61ccc20740 10 client.0 _ll_register_callbacks cb 0x556b16a63c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61c4c49640 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16758350 0x556b16b16ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 0x556b16b0b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61bffff640 1 -- 172.21.15.49:0/649443924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16758350 msgr2=0x556b16b16ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61bffff640 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16758350 0x556b16b16ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61bffff640 1 -- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 msgr2=0x556b16b0b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61bffff640 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 0x556b16b0b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61bffff640 1 -- 172.21.15.49:0/649443924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b16b173e0 con 0x556b1672f490 2024-09-21T06:37:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 0x556b16b0b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61bffff640 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0af70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009230 tx=0x7f61b0031d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f118de6d6d7023 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f619f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f619f7fe640 1 -- 172.21.15.49:0/649443924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0040070 con 0x556b1672f490 2024-09-21T06:37:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f619f7fe640 1 -- 172.21.15.49:0/649443924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f61b00318b0 con 0x556b1672f490 2024-09-21T06:37:18.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.231+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b40acc60 con 0x556b1672f490 2024-09-21T06:37:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f619f7fe640 1 -- 172.21.15.49:0/649443924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61b0035040 con 0x556b1672f490 2024-09-21T06:37:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f61ccc20740 10 client.15639 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556b16b19cf0 con 0x556b1672f490 2024-09-21T06:37:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f619f7fe640 1 -- 172.21.15.49:0/649443924 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b00035f0 con 0x556b1672f490 2024-09-21T06:37:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f619f7fe640 1 -- 172.21.15.49:0/649443924 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f61b0045460 con 0x556b1672f490 2024-09-21T06:37:18.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f61ccc20740 10 client.15639 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f61ccc20740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f61ccc20740 20 client.15639 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f61ccc20740 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b16716cd0 0x556b16b1d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f61ccc20740 4 client.15639 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.232+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f61b40acc60 con 0x556b16716cd0 2024-09-21T06:37:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.233+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b16716cd0 0x556b16b1d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.233+0000 7f619f7fe640 10 client.15639 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:18.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.234+0000 7f61bf7fe640 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b16716cd0 0x556b16b1d1a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a7f6498d94fc93f server_cookie=5a8b4650f13f29e3 in_seq=0 out_seq=0 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f619f7fe640 1 -- 172.21.15.49:0/649443924 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f61b40acc60 con 0x556b16716cd0 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f619f7fe640 10 client.15639 handle_command_reply: tid=0 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 client.15639 shutdown 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 msgr2=0x556b16b0af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0af70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009230 tx=0x7f61b0031d40 comp rx=0 tx=0).stop 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 shutdown_connections 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b16716cd0 0x556b16b1d1a0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16758350 0x556b16b16ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 0x556b16b0b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 --2- 172.21.15.49:0/649443924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0af70 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 >> 172.21.15.49:0/649443924 conn(0x556b1674c740 msgr2=0x556b16b00460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f619f7fe640 0 client.15639 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 shutdown_connections 2024-09-21T06:37:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 1 -- 172.21.15.49:0/649443924 wait complete. 2024-09-21T06:37:18.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.235+0000 7f61ccc20740 20 client.15639 trim_cache size 0 max 16384 2024-09-21T06:37:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.253+0000 7f61ccc20740 1 Processor -- start 2024-09-21T06:37:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.253+0000 7f61ccc20740 1 -- start start 2024-09-21T06:37:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.253+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b1674c740 0x556b16b05550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.253+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.253+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 0x556b16b0c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.253+0000 7f61ccc20740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01b02d0 con 0x556b1672f490 2024-09-21T06:37:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.253+0000 7f61ccc20740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01adba0 con 0x556b16737670 2024-09-21T06:37:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.253+0000 7f61ccc20740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01aba10 con 0x556b1674c740 2024-09-21T06:37:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b1674c740 0x556b16b05550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bffff640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b1674c740 0x556b16b05550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:54938/0 (socket says 172.21.15.49:54938) 2024-09-21T06:37:18.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39122/0 (socket says 172.21.15.49:39122) 2024-09-21T06:37:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bffff640 1 -- 172.21.15.49:0/1328771593 learned_addr learned my addr 172.21.15.49:0/1328771593 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61c4c49640 1 --2- 172.21.15.49:0/1328771593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 0x556b16b0c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bffff640 1 -- 172.21.15.49:0/1328771593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 msgr2=0x556b16b0c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bffff640 1 --2- 172.21.15.49:0/1328771593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 0x556b16b0c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bffff640 1 -- 172.21.15.49:0/1328771593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 msgr2=0x556b16b0a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bffff640 1 --2- 172.21.15.49:0/1328771593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bffff640 1 -- 172.21.15.49:0/1328771593 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b16b01720 con 0x556b1674c740 2024-09-21T06:37:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.254+0000 7f61bffff640 1 --2- 172.21.15.49:0/1328771593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b1674c740 0x556b16b05550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f61b00057c0 tx=0x7f61b0031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59749bdf8779cf76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:18.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.255+0000 7f61a5ffb640 1 -- 172.21.15.49:0/1328771593 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0052070 con 0x556b1674c740 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.255+0000 7f61a5ffb640 1 -- 172.21.15.49:0/1328771593 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b0045460 con 0x556b1674c740 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.255+0000 7f61a5ffb640 1 -- 172.21.15.49:0/1328771593 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0040040 con 0x556b1674c740 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 -- 172.21.15.49:0/1328771593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b1674c740 msgr2=0x556b16b05550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 --2- 172.21.15.49:0/1328771593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b1674c740 0x556b16b05550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f61b00057c0 tx=0x7f61b0031400 comp rx=0 tx=0).stop 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 -- 172.21.15.49:0/1328771593 shutdown_connections 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 --2- 172.21.15.49:0/1328771593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b16737670 0x556b16b0c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 --2- 172.21.15.49:0/1328771593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1672f490 0x556b16b0a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 --2- 172.21.15.49:0/1328771593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b1674c740 0x556b16b05550 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 -- 172.21.15.49:0/1328771593 >> 172.21.15.49:0/1328771593 conn(0x556b16b0b720 msgr2=0x556b16b0c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 -- 172.21.15.49:0/1328771593 shutdown_connections 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 -- 172.21.15.49:0/1328771593 wait complete. 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.256+0000 7f61ccc20740 1 -- start start 2024-09-21T06:37:18.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61ccc20740 1 Processor -- start 2024-09-21T06:37:18.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b1672f490 0x556b16b13450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 0x556b16b0f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61ccc20740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1674c740 0x556b16b0fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61ccc20740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01ac060 con 0x556b1674c740 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61ccc20740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01ad4d0 con 0x556b1672f490 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61ccc20740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61c01ac730 con 0x556b16737670 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61ccc20740 10 client.0 _ll_register_callbacks cb 0x7f61b0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61bf7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 0x556b16b0f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b1672f490 0x556b16b13450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61c4c49640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1674c740 0x556b16b0fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61c4c49640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1674c740 0x556b16b0fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39138/0 (socket says 172.21.15.49:39138) 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61bffff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b1672f490 0x556b16b13450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:32770/0 (socket says 172.21.15.49:32770) 2024-09-21T06:37:18.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.257+0000 7f61c4c49640 1 -- 172.21.15.49:0/2831012077 learned_addr learned my addr 172.21.15.49:0/2831012077 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f61c4c49640 1 -- 172.21.15.49:0/2831012077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 msgr2=0x556b16b0f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f61c4c49640 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 0x556b16b0f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f61c4c49640 1 -- 172.21.15.49:0/2831012077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b1672f490 msgr2=0x556b16b13450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f61c4c49640 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b1672f490 0x556b16b13450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f61c4c49640 1 -- 172.21.15.49:0/2831012077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b16b10440 con 0x556b1674c740 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f61c4c49640 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1674c740 0x556b16b0fe50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f61b801ca10 tx=0x7f61b801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699f44b28832e7af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f619f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f619f7fe640 1 -- 172.21.15.49:0/2831012077 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b8037680 con 0x556b1674c740 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f619f7fe640 1 -- 172.21.15.49:0/2831012077 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f61b8037820 con 0x556b1674c740 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.258+0000 7f61ccc20740 1 -- 172.21.15.49:0/2831012077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b0045460 con 0x556b1674c740 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f619f7fe640 1 -- 172.21.15.49:0/2831012077 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61b8037a20 con 0x556b1674c740 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f61ccc20740 10 client.15645 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f61ccc20740 1 -- 172.21.15.49:0/2831012077 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556b16b88980 con 0x556b1674c740 2024-09-21T06:37:18.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f619f7fe640 1 -- 172.21.15.49:0/2831012077 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b0045460 con 0x556b1674c740 2024-09-21T06:37:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f619f7fe640 1 -- 172.21.15.49:0/2831012077 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f61b8011b60 con 0x556b1674c740 2024-09-21T06:37:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f61ccc20740 10 client.15645 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f61ccc20740 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f61ccc20740 20 client.15645 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f61ccc20740 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b16758350 0x556b16b8b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f61ccc20740 4 client.15645 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:37:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.259+0000 7f61ccc20740 1 -- 172.21.15.49:0/2831012077 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556b16a77db0 con 0x556b16758350 2024-09-21T06:37:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.260+0000 7f61bffff640 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b16758350 0x556b16b8b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:18.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.260+0000 7f619f7fe640 10 client.15645 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:18.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.261+0000 7f61bffff640 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b16758350 0x556b16b8b1a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99f8192e769f904 server_cookie=7d0dc27930802c24 in_seq=0 out_seq=0 2024-09-21T06:37:18.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.262+0000 7f619f7fe640 1 -- 172.21.15.49:0/2831012077 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556b16a77db0 con 0x556b16758350 2024-09-21T06:37:18.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.262+0000 7f619f7fe640 10 client.15645 handle_command_reply: tid=0 2024-09-21T06:37:18.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.262+0000 7f61ccc20740 1 client.15645 shutdown 2024-09-21T06:37:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f61ccc20740 1 -- 172.21.15.49:0/2831012077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1674c740 msgr2=0x556b16b0fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f61ccc20740 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1674c740 0x556b16b0fe50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f61b801ca10 tx=0x7f61b801e040 comp rx=0 tx=0).stop 2024-09-21T06:37:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f61ccc20740 1 -- 172.21.15.49:0/2831012077 shutdown_connections 2024-09-21T06:37:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f61ccc20740 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b16758350 0x556b16b8b1a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f61ccc20740 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b1674c740 0x556b16b0fe50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f619f7fe640 0 client.15645 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:18.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f61ccc20740 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b16737670 0x556b16b0f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f61ccc20740 1 --2- 172.21.15.49:0/2831012077 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b1672f490 0x556b16b13450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f61ccc20740 1 -- 172.21.15.49:0/2831012077 >> 172.21.15.49:0/2831012077 conn(0x556b16b0b720 msgr2=0x556b16b0cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.263+0000 7f61ccc20740 1 -- 172.21.15.49:0/2831012077 shutdown_connections 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.264+0000 7f61ccc20740 1 -- 172.21.15.49:0/2831012077 wait complete. 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.264+0000 7f61ccc20740 20 client.15645 trim_cache size 0 max 16384 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "10867b94-0c7e-4ad0-923a-2c9251148d7b", 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:37:18.267 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:37:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.264+0000 7f61c66ac640 1 -- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a80b6560 msgr2=0x7f61a80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.264+0000 7f61c66ac640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a80b6560 0x7f61a80b8a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f61b800fbf0 tx=0x7f61b801c510 comp rx=0 tx=0).stop 2024-09-21T06:37:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.264+0000 7f61c66ac640 1 -- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0109e00 msgr2=0x7f61c019ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.264+0000 7f61c66ac640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0109e00 0x7f61c019ab90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f61b400c8c0 tx=0x7f61b400cd80 comp rx=0 tx=0).stop 2024-09-21T06:37:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.265+0000 7f61c66ac640 1 -- 172.21.15.49:0/813991770 shutdown_connections 2024-09-21T06:37:18.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.265+0000 7f61c66ac640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a80b6560 0x7f61a80b8a70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.265+0000 7f61c66ac640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61c019fd70 0x7f61c01a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.265+0000 7f61c66ac640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61c0109e00 0x7f61c019ab90 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.265+0000 7f61c66ac640 1 --2- 172.21.15.49:0/813991770 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61c01094b0 0x7f61c019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:18.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.265+0000 7f61c66ac640 1 -- 172.21.15.49:0/813991770 >> 172.21.15.49:0/813991770 conn(0x7f61c0077c60 msgr2=0x7f61c01075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:18.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.265+0000 7f61c66ac640 1 -- 172.21.15.49:0/813991770 shutdown_connections 2024-09-21T06:37:18.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:18.265+0000 7f61c66ac640 1 -- 172.21.15.49:0/813991770 wait complete. 2024-09-21T06:37:18.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:17 smithi098 ceph-mon[34704]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2024-09-21T06:37:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:17 smithi079 ceph-mon[34346]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 3.1 KiB/s wr, 7 op/s 2024-09-21T06:37:18.945 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:37:19.099 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:18 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:37:19.099 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:18 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:19.099 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:18 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:37:19.099 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:18 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:19.099 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:18 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:37:19.250 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:19.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:18 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:37:19.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:18 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:19.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:18 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:37:19.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:18 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:19.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:18 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:37:19.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:18 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:37:19.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:18 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:19.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:18 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:37:19.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:18 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:19.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:18 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:37:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.787+0000 7fb9cb257640 1 -- 172.21.15.49:0/3989991446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 msgr2=0x7fb9c4103fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.787+0000 7fb9cb257640 1 --2- 172.21.15.49:0/3989991446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 0x7fb9c4103fd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009900 tx=0x7fb9b802a410 comp rx=0 tx=0).stop 2024-09-21T06:37:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.787+0000 7fb9cb257640 1 -- 172.21.15.49:0/3989991446 shutdown_connections 2024-09-21T06:37:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.787+0000 7fb9cb257640 1 --2- 172.21.15.49:0/3989991446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c4109e00 0x7fb9c4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.787+0000 7fb9cb257640 1 --2- 172.21.15.49:0/3989991446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c41094b0 0x7fb9c41098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.787+0000 7fb9cb257640 1 --2- 172.21.15.49:0/3989991446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 0x7fb9c4103fd0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.787+0000 7fb9cb257640 1 -- 172.21.15.49:0/3989991446 >> 172.21.15.49:0/3989991446 conn(0x7fb9c407b910 msgr2=0x7fb9c407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.788+0000 7fb9cb257640 1 -- 172.21.15.49:0/3989991446 shutdown_connections 2024-09-21T06:37:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.788+0000 7fb9cb257640 1 -- 172.21.15.49:0/3989991446 wait complete. 2024-09-21T06:37:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.789+0000 7fb9cb257640 1 Processor -- start 2024-09-21T06:37:19.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.789+0000 7fb9cb257640 1 -- start start 2024-09-21T06:37:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9cb257640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 0x7fb9c419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9cb257640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c41094b0 0x7fb9c419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9c8ff3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 0x7fb9c419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9c8ff3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 0x7fb9c419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39150/0 (socket says 172.21.15.49:39150) 2024-09-21T06:37:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9cb257640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c4109e00 0x7fb9c419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/1811274798 learned_addr learned my addr 172.21.15.49:0/1811274798 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c41094b0 0x7fb9c419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c4113ac0 con 0x7fb9c4103bc0 2024-09-21T06:37:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c4113940 con 0x7fb9c41094b0 2024-09-21T06:37:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.790+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c4109e00 0x7fb9c419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.791+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c4113c40 con 0x7fb9c4109e00 2024-09-21T06:37:19.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.791+0000 7fb9c97f4640 1 -- 172.21.15.49:0/1811274798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c41094b0 msgr2=0x7fb9c419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.791+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c41094b0 0x7fb9c419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.791+0000 7fb9c97f4640 1 -- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 msgr2=0x7fb9c419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.791+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 0x7fb9c419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.791+0000 7fb9c97f4640 1 -- 172.21.15.49:0/1811274798 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c41a0400 con 0x7fb9c4109e00 2024-09-21T06:37:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.791+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 0x7fb9c419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.792+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c4109e00 0x7fb9c419fcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009fd0 tx=0x7fb9bc00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.792+0000 7fb9c1ffb640 1 -- 172.21.15.49:0/1811274798 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc00ce20 con 0x7fb9c4109e00 2024-09-21T06:37:19.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.792+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c41a06f0 con 0x7fb9c4109e00 2024-09-21T06:37:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.792+0000 7fb9c1ffb640 1 -- 172.21.15.49:0/1811274798 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9bc0137d0 con 0x7fb9c4109e00 2024-09-21T06:37:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.792+0000 7fb9c1ffb640 1 -- 172.21.15.49:0/1811274798 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc005510 con 0x7fb9c4109e00 2024-09-21T06:37:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.792+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c40755f0 con 0x7fb9c4109e00 2024-09-21T06:37:19.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.796+0000 7fb9d17cb740 1 Processor -- start 2024-09-21T06:37:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.797+0000 7fb9c1ffb640 1 -- 172.21.15.49:0/1811274798 <== mon.1 v2:172.21.15.98:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fb9bc0057d0 con 0x7fb9c4109e00 2024-09-21T06:37:19.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.797+0000 7fb9d17cb740 1 -- start start 2024-09-21T06:37:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.797+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49bf4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.797+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bf4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.797+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 0x563c49bf4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.797+0000 7fb9d17cb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563c49b6ae50 con 0x563c4984d070 2024-09-21T06:37:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.797+0000 7fb9d17cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563c49b5a280 con 0x563c498241b0 2024-09-21T06:37:19.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.797+0000 7fb9d17cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563c49b5e090 con 0x563c4982c390 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49bf4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49bf4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39166/0 (socket says 172.21.15.49:39166) 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c3fff640 1 -- 172.21.15.49:0/2021305732 learned_addr learned my addr 172.21.15.49:0/2021305732 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/2021305732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bf4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/2021305732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 msgr2=0x563c49bf4cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/2021305732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 0x563c49bf4cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/2021305732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 msgr2=0x563c49bf4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/2021305732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49bf4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/2021305732 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c498b8650 con 0x563c498241b0 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.798+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/2021305732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49bf4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:19.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.799+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/2021305732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bf4780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8004770 tx=0x7fb9b8005ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=172dc58a9f5152f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.799+0000 7fb9aeffd640 1 -- 172.21.15.49:0/2021305732 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8035040 con 0x563c498241b0 2024-09-21T06:37:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.799+0000 7fb9aeffd640 1 -- 172.21.15.49:0/2021305732 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9b8031820 con 0x563c498241b0 2024-09-21T06:37:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.799+0000 7fb9aeffd640 1 -- 172.21.15.49:0/2021305732 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b80049e0 con 0x563c498241b0 2024-09-21T06:37:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.799+0000 7fb9c1ffb640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb9b40b6700 0x7fb9b40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.800+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb9b40b6700 0x7fb9b40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.800+0000 7fb9c1ffb640 1 -- 172.21.15.49:0/1811274798 <== mon.1 v2:172.21.15.98:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb9bc0ebdd0 con 0x7fb9c4109e00 2024-09-21T06:37:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.800+0000 7fb9d17cb740 1 -- 172.21.15.49:0/2021305732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 msgr2=0x563c49bf4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.800+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/2021305732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bf4780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8004770 tx=0x7fb9b8005ed0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.800+0000 7fb9d17cb740 1 -- 172.21.15.49:0/2021305732 shutdown_connections 2024-09-21T06:37:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.800+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/2021305732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 0x563c49bf4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.800+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/2021305732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bf4780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.800+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/2021305732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49bf4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.800+0000 7fb9d17cb740 1 -- 172.21.15.49:0/2021305732 >> 172.21.15.49:0/2021305732 conn(0x563c49841460 msgr2=0x563c49bf2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.801+0000 7fb9d17cb740 1 -- 172.21.15.49:0/2021305732 shutdown_connections 2024-09-21T06:37:19.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.801+0000 7fb9d17cb740 1 -- 172.21.15.49:0/2021305732 wait complete. 2024-09-21T06:37:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.801+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb9b40b6700 0x7fb9b40b8c10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009f30 tx=0x7fb9b0005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.801+0000 7fb9d17cb740 1 -- start start 2024-09-21T06:37:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.802+0000 7fb9d17cb740 1 Processor -- start 2024-09-21T06:37:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.802+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bff8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.802+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 0x563c49bffe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.802+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49c0bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.802+0000 7fb9d17cb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563c499bb700 con 0x563c4984d070 2024-09-21T06:37:19.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9d17cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563c49af5110 con 0x563c498241b0 2024-09-21T06:37:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c8ff3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bff8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c8ff3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bff8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:32802/0 (socket says 172.21.15.49:32802) 2024-09-21T06:37:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/3325266024 learned_addr learned my addr 172.21.15.49:0/3325266024 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49c0bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9d17cb740 1 -- 172.21.15.49:0/3325266024 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563c49c029c0 con 0x563c4982c390 2024-09-21T06:37:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9d17cb740 10 client.0 _ll_register_callbacks cb 0x563c49b0e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 0x563c49bffe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c97f4640 1 -- 172.21.15.49:0/3325266024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 msgr2=0x563c49bffe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:19.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 0x563c49bffe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c97f4640 1 -- 172.21.15.49:0/3325266024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 msgr2=0x563c49bff8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:19.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bff8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c97f4640 1 -- 172.21.15.49:0/3325266024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c49b22c40 con 0x563c4984d070 2024-09-21T06:37:19.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.803+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 0x563c49bffe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:19.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.804+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49c0bcb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0e9500 tx=0x7fb9bc0b1430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9245c46dfbb17361 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:19.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.804+0000 7fb9a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:19.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.804+0000 7fb9a3fff640 1 -- 172.21.15.49:0/3325266024 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0d91b0 con 0x563c4984d070 2024-09-21T06:37:19.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.804+0000 7fb9d17cb740 1 -- 172.21.15.49:0/3325266024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9b8031820 con 0x563c4984d070 2024-09-21T06:37:19.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.804+0000 7fb9a3fff640 1 -- 172.21.15.49:0/3325266024 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb9bc0b0e60 con 0x563c4984d070 2024-09-21T06:37:19.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.805+0000 7fb9a3fff640 1 -- 172.21.15.49:0/3325266024 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9bc0b2300 con 0x563c4984d070 2024-09-21T06:37:19.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.805+0000 7fb9d17cb740 10 client.15657 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:19.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.805+0000 7fb9d17cb740 1 -- 172.21.15.49:0/3325266024 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563c49c0e720 con 0x563c4984d070 2024-09-21T06:37:19.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.805+0000 7fb9a3fff640 1 -- 172.21.15.49:0/3325266024 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9b8031820 con 0x563c4984d070 2024-09-21T06:37:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.806+0000 7fb9a3fff640 1 -- 172.21.15.49:0/3325266024 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb9bc0b08d0 con 0x563c4984d070 2024-09-21T06:37:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.807+0000 7fb9d17cb740 10 client.15657 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.807+0000 7fb9d17cb740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:19.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.807+0000 7fb9d17cb740 20 client.15657 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.807+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563c4980b9f0 0x563c49c11e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.807+0000 7fb9d17cb740 4 client.15657 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.807+0000 7fb9d17cb740 1 -- 172.21.15.49:0/3325266024 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c49b6cda0 con 0x563c4980b9f0 2024-09-21T06:37:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.807+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563c4980b9f0 0x563c49c11e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.807+0000 7fb9a3fff640 10 client.15657 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:19.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.807+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563c4980b9f0 0x563c49c11e00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=304ff39060c00e20 server_cookie=9fcaf3d08b70dcde in_seq=0 out_seq=0 2024-09-21T06:37:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.808+0000 7fb9a3fff640 1 -- 172.21.15.49:0/3325266024 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c49b6cda0 con 0x563c4980b9f0 2024-09-21T06:37:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.808+0000 7fb9a3fff640 10 client.15657 handle_command_reply: tid=0 2024-09-21T06:37:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.808+0000 7fb9d17cb740 1 client.15657 shutdown 2024-09-21T06:37:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 -- 172.21.15.49:0/3325266024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 msgr2=0x563c49c0bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:19.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49c0bcb0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0e9500 tx=0x7fb9bc0b1430 comp rx=0 tx=0).stop 2024-09-21T06:37:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 -- 172.21.15.49:0/3325266024 shutdown_connections 2024-09-21T06:37:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563c4980b9f0 0x563c49c11e00 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c4984d070 0x563c49c0bcb0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4982c390 0x563c49bffe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/3325266024 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c498241b0 0x563c49bff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 -- 172.21.15.49:0/3325266024 >> 172.21.15.49:0/3325266024 conn(0x563c49841460 msgr2=0x563c49bf7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9a3fff640 0 client.15657 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 -- 172.21.15.49:0/3325266024 shutdown_connections 2024-09-21T06:37:19.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 1 -- 172.21.15.49:0/3325266024 wait complete. 2024-09-21T06:37:19.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.809+0000 7fb9d17cb740 20 client.15657 trim_cache size 0 max 16384 2024-09-21T06:37:19.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.843+0000 7fb9d17cb740 1 Processor -- start 2024-09-21T06:37:19.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.843+0000 7fb9d17cb740 1 -- start start 2024-09-21T06:37:19.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c014f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 0x563c49bf16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9c8ff3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c014f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 0x563c49bf1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9d17cb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c41afd00 con 0x563c498241b0 2024-09-21T06:37:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9d17cb740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c41ad5d0 con 0x563c4982c390 2024-09-21T06:37:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9c8ff3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c014f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39192/0 (socket says 172.21.15.49:39192) 2024-09-21T06:37:19.846 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9d17cb740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c41ab4d0 con 0x563c4984d070 2024-09-21T06:37:19.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/591673485 learned_addr learned my addr 172.21.15.49:0/591673485 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:19.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/591673485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 0x563c49bf16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.844+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/591673485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 0x563c49bf1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.845+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/591673485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 msgr2=0x563c49bf1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:19.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.845+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/591673485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 0x563c49bf1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.845+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/591673485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 msgr2=0x563c49bf16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:19.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.845+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/591673485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 0x563c49bf16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.847 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.845+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/591673485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c49c00b80 con 0x563c498241b0 2024-09-21T06:37:19.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.845+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/591673485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c014f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009a20 tx=0x7fb9b80055c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddd44431be60f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:19.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.845+0000 7fb9ae7fc640 1 -- 172.21.15.49:0/591673485 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8035040 con 0x563c498241b0 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.845+0000 7fb9ae7fc640 1 -- 172.21.15.49:0/591673485 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9b8031cc0 con 0x563c498241b0 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.845+0000 7fb9ae7fc640 1 -- 172.21.15.49:0/591673485 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b8003bb0 con 0x563c498241b0 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.846+0000 7fb9d17cb740 1 -- 172.21.15.49:0/591673485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 msgr2=0x563c49c014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.846+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/591673485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c014f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8009a20 tx=0x7fb9b80055c0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.847+0000 7fb9d17cb740 1 -- 172.21.15.49:0/591673485 shutdown_connections 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.847+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/591673485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 0x563c49bf1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.847+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/591673485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 0x563c49bf16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.847+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/591673485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c014f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.847+0000 7fb9d17cb740 1 -- 172.21.15.49:0/591673485 >> 172.21.15.49:0/591673485 conn(0x563c49841460 msgr2=0x563c49c00de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.847+0000 7fb9d17cb740 1 -- 172.21.15.49:0/591673485 shutdown_connections 2024-09-21T06:37:19.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.847+0000 7fb9d17cb740 1 -- 172.21.15.49:0/591673485 wait complete. 2024-09-21T06:37:19.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.848+0000 7fb9d17cb740 1 -- start start 2024-09-21T06:37:19.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.848+0000 7fb9d17cb740 1 Processor -- start 2024-09-21T06:37:19.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c156d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 0x563c49c12ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9d17cb740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 0x563c49c13290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9d17cb740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c41aba90 con 0x563c498241b0 2024-09-21T06:37:19.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c8ff3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c8ff3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c156d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39200/0 (socket says 172.21.15.49:39200) 2024-09-21T06:37:19.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c8ff3640 1 -- 172.21.15.49:0/1528213660 learned_addr learned my addr 172.21.15.49:0/1528213660 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:19.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c41acf00 con 0x563c4982c390 2024-09-21T06:37:19.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c41ac160 con 0x563c4984d070 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 0x563c49c12ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9d17cb740 10 client.0 _ll_register_callbacks cb 0x7fb9bc0ae250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c97f4640 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 0x563c49c13290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c3fff640 1 -- 172.21.15.49:0/1528213660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 msgr2=0x563c49c13290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 0x563c49c13290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c3fff640 1 -- 172.21.15.49:0/1528213660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 msgr2=0x563c49c156d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c156d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.849+0000 7fb9c3fff640 1 -- 172.21.15.49:0/1528213660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c49c7b620 con 0x563c4982c390 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.850+0000 7fb9c3fff640 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 0x563c49c12ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0012cb0 tx=0x7fb9b0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851d1ff9e1ca3eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:19.852 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.850+0000 7fb9a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:37:19.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.850+0000 7fb9a3fff640 1 -- 172.21.15.49:0/1528213660 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9b001f630 con 0x563c4982c390 2024-09-21T06:37:19.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.850+0000 7fb9a3fff640 1 -- 172.21.15.49:0/1528213660 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb9b001f7d0 con 0x563c4982c390 2024-09-21T06:37:19.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.850+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9b8031cc0 con 0x563c4982c390 2024-09-21T06:37:19.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.850+0000 7fb9a3fff640 1 -- 172.21.15.49:0/1528213660 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9b001fa10 con 0x563c4982c390 2024-09-21T06:37:19.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.850+0000 7fb9d17cb740 10 client.25334 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:19.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.850+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563c49c7c760 con 0x563c4982c390 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.850+0000 7fb9a3fff640 1 -- 172.21.15.49:0/1528213660 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9b001fbb0 con 0x563c4982c390 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.851+0000 7fb9a3fff640 1 -- 172.21.15.49:0/1528213660 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb9b0029070 con 0x563c4982c390 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.851+0000 7fb9d17cb740 10 client.25334 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.851+0000 7fb9d17cb740 10 client.25334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.851+0000 7fb9d17cb740 20 client.25334 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.851+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563c497e0da0 0x563c49c7efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.851+0000 7fb9d17cb740 4 client.25334 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.851+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb9b8031cc0 con 0x563c497e0da0 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.851+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563c497e0da0 0x563c49c7efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9a3fff640 10 client.25334 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9c8ff3640 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563c497e0da0 0x563c49c7efd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=879276d52327af2d server_cookie=848077ec8a830352 in_seq=0 out_seq=0 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9a3fff640 1 -- 172.21.15.49:0/1528213660 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x7fb9b8031cc0 con 0x563c497e0da0 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9a3fff640 10 client.25334 handle_command_reply: tid=0 2024-09-21T06:37:19.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9d17cb740 1 client.25334 shutdown 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 msgr2=0x563c49c12ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 0x563c49c12ba0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0012cb0 tx=0x7fb9b0004730 comp rx=0 tx=0).stop 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 shutdown_connections 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563c497e0da0 0x563c49c7efd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563c4984d070 0x563c49c13290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563c4982c390 0x563c49c12ba0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9d17cb740 1 --2- 172.21.15.49:0/1528213660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563c498241b0 0x563c49c156d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 >> 172.21.15.49:0/1528213660 conn(0x563c49841460 msgr2=0x563c49c00d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.852+0000 7fb9a3fff640 0 client.25334 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.853+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 shutdown_connections 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.853+0000 7fb9d17cb740 1 -- 172.21.15.49:0/1528213660 wait complete. 2024-09-21T06:37:19.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.853+0000 7fb9d17cb740 20 client.25334 trim_cache size 0 max 16384 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:37:19.857 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:37:19.858 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:37:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb9b40b6700 msgr2=0x7fb9b40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb9b40b6700 0x7fb9b40b8c10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0009f30 tx=0x7fb9b0005f90 comp rx=0 tx=0).stop 2024-09-21T06:37:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c4109e00 msgr2=0x7fb9c419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c4109e00 0x7fb9c419fcd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009fd0 tx=0x7fb9bc00ef10 comp rx=0 tx=0).stop 2024-09-21T06:37:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 shutdown_connections 2024-09-21T06:37:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb9b40b6700 0x7fb9b40b8c10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb9c4109e00 0x7fb9c419fcd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb9c41094b0 0x7fb9c419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 --2- 172.21.15.49:0/1811274798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb9c4103bc0 0x7fb9c419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:19.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 >> 172.21.15.49:0/1811274798 conn(0x7fb9c407b910 msgr2=0x7fb9c41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:19.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 shutdown_connections 2024-09-21T06:37:19.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:19.854+0000 7fb9cb257640 1 -- 172.21.15.49:0/1811274798 wait complete. 2024-09-21T06:37:19.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:19 smithi049 ceph-mon[31177]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-21T06:37:20.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:19 smithi098 ceph-mon[34704]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-21T06:37:20.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:19 smithi079 ceph-mon[34346]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-21T06:37:20.583 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:37:20.583 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:37:20.982 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:21.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:20 smithi049 ceph-mon[31177]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-21T06:37:21.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:20 smithi098 ceph-mon[34704]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-21T06:37:21.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:20 smithi079 ceph-mon[34346]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2024-09-21T06:37:21.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.531+0000 7f591c035640 1 -- 172.21.15.49:0/210787694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 msgr2=0x7f591410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:21.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.531+0000 7f591c035640 1 --2- 172.21.15.49:0/210787694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 0x7f591410f540 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f590c009ca0 tx=0x7f590c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:21.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.531+0000 7f591c035640 1 -- 172.21.15.49:0/210787694 shutdown_connections 2024-09-21T06:37:21.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.531+0000 7f591c035640 1 --2- 172.21.15.49:0/210787694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 0x7f591410f540 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.531+0000 7f591c035640 1 --2- 172.21.15.49:0/210787694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f59141083c0 0x7f59141087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.531+0000 7f591c035640 1 --2- 172.21.15.49:0/210787694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5914102a80 0x7f5914102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.531+0000 7f591c035640 1 -- 172.21.15.49:0/210787694 >> 172.21.15.49:0/210787694 conn(0x7f5914079740 msgr2=0x7f5914079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.531+0000 7f591c035640 1 -- 172.21.15.49:0/210787694 shutdown_connections 2024-09-21T06:37:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.531+0000 7f591c035640 1 -- 172.21.15.49:0/210787694 wait complete. 2024-09-21T06:37:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.533+0000 7f591c035640 1 Processor -- start 2024-09-21T06:37:21.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.533+0000 7f591c035640 1 -- start start 2024-09-21T06:37:21.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.533+0000 7f591c035640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5914102a80 0x7f591419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:21.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.533+0000 7f591c035640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59141083c0 0x7f591419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:21.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f591c035640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 0x7f591419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f59195d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59141083c0 0x7f591419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f59195d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59141083c0 0x7f591419a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:32842/0 (socket says 172.21.15.49:32842) 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f591a5d2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 0x7f591419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f5919dd1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5914102a80 0x7f591419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f5919dd1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5914102a80 0x7f591419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:55022/0 (socket says 172.21.15.49:55022) 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f591a5d2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 0x7f591419fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39220/0 (socket says 172.21.15.49:39220) 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f59195d0640 1 -- 172.21.15.49:0/1468906204 learned_addr learned my addr 172.21.15.49:0/1468906204 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f59141129d0 con 0x7f5914108d10 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5914112850 con 0x7f59141083c0 2024-09-21T06:37:21.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.534+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5914112b50 con 0x7f5914102a80 2024-09-21T06:37:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.535+0000 7f591a5d2640 1 -- 172.21.15.49:0/1468906204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5914102a80 msgr2=0x7f591419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.535+0000 7f591a5d2640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5914102a80 0x7f591419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.535+0000 7f591a5d2640 1 -- 172.21.15.49:0/1468906204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59141083c0 msgr2=0x7f591419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.535+0000 7f591a5d2640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59141083c0 0x7f591419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.535+0000 7f591a5d2640 1 -- 172.21.15.49:0/1468906204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59141a03a0 con 0x7f5914108d10 2024-09-21T06:37:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.535+0000 7f591a5d2640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 0x7f591419fc70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f590c005e30 tx=0x7f590c0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:21.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.535+0000 7f590affd640 1 -- 172.21.15.49:0/1468906204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c003b70 con 0x7f5914108d10 2024-09-21T06:37:21.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.535+0000 7f590affd640 1 -- 172.21.15.49:0/1468906204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f590c003d10 con 0x7f5914108d10 2024-09-21T06:37:21.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.536+0000 7f590affd640 1 -- 172.21.15.49:0/1468906204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c02fa00 con 0x7f5914108d10 2024-09-21T06:37:21.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.536+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59141a0630 con 0x7f5914108d10 2024-09-21T06:37:21.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.537+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59141a6df0 con 0x7f5914108d10 2024-09-21T06:37:21.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.538+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5914103d00 con 0x7f5914108d10 2024-09-21T06:37:21.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.541+0000 7f590affd640 1 -- 172.21.15.49:0/1468906204 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f590c02fba0 con 0x7f5914108d10 2024-09-21T06:37:21.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.542+0000 7f590affd640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f59000b6560 0x7f59000b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:21.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.542+0000 7f5919dd1640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f59000b6560 0x7f59000b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:21.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.542+0000 7f590affd640 1 -- 172.21.15.49:0/1468906204 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f590c1089e0 con 0x7f5914108d10 2024-09-21T06:37:21.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.543+0000 7f5919dd1640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f59000b6560 0x7f59000b8a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5910009bd0 tx=0x7f5910005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:21.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:21.548+0000 7f590affd640 1 -- 172.21.15.49:0/1468906204 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f590c02fe90 con 0x7f5914108d10 2024-09-21T06:37:22.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.006+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f591419b560 con 0x7f5914108d10 2024-09-21T06:37:22.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.007+0000 7f590affd640 1 -- 172.21.15.49:0/1468906204 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11893 (secure 0 0 0) 0x7f590c0cefa0 con 0x7f5914108d10 2024-09-21T06:37:22.009 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:37:22.009 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":25,"btime":"2024-09-21T06:36:27:292026+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:36:27.233682+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:37:22.010 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 25 2024-09-21T06:37:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.010+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f59000b6560 msgr2=0x7f59000b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:22.013 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.010+0000 7f591c035640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f59000b6560 0x7f59000b8a70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5910009bd0 tx=0x7f5910005f90 comp rx=0 tx=0).stop 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 msgr2=0x7f591419fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 0x7f591419fc70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f590c005e30 tx=0x7f590c0317c0 comp rx=0 tx=0).stop 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 shutdown_connections 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f59000b6560 0x7f59000b8a70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5914108d10 0x7f591419fc70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f59141083c0 0x7f591419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 --2- 172.21.15.49:0/1468906204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5914102a80 0x7f591419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 >> 172.21.15.49:0/1468906204 conn(0x7f5914079740 msgr2=0x7f5914101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 shutdown_connections 2024-09-21T06:37:22.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:22.011+0000 7f591c035640 1 -- 172.21.15.49:0/1468906204 wait complete. 2024-09-21T06:37:22.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:22 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1468906204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:22.329 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:22 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1468906204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:22.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:22 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1468906204' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:22.670 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:37:23.055 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:23.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:23 smithi079 ceph-mon[34346]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-21T06:37:23.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:23 smithi049 ceph-mon[31177]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-21T06:37:23.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:23 smithi098 ceph-mon[34704]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.4 KiB/s wr, 9 op/s 2024-09-21T06:37:23.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.546+0000 7f6be7734640 1 -- 172.21.15.49:0/272507377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be0104840 msgr2=0x7f6be0104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:23.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.546+0000 7f6be7734640 1 --2- 172.21.15.49:0/272507377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be0104840 0x7f6be0104c50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009900 tx=0x7f6bdc02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.546+0000 7f6be7734640 1 -- 172.21.15.49:0/272507377 shutdown_connections 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.546+0000 7f6be7734640 1 --2- 172.21.15.49:0/272507377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be010ddf0 0x7f6be0110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.546+0000 7f6be7734640 1 --2- 172.21.15.49:0/272507377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0105270 0x7f6be010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.546+0000 7f6be7734640 1 --2- 172.21.15.49:0/272507377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be0104840 0x7f6be0104c50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.546+0000 7f6be7734640 1 -- 172.21.15.49:0/272507377 >> 172.21.15.49:0/272507377 conn(0x7f6be0079730 msgr2=0x7f6be0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.546+0000 7f6be7734640 1 -- 172.21.15.49:0/272507377 shutdown_connections 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.546+0000 7f6be7734640 1 -- 172.21.15.49:0/272507377 wait complete. 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.547+0000 7f6be7734640 1 Processor -- start 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.547+0000 7f6be7734640 1 -- start start 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be7734640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0105270 0x7f6be019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be7734640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be010ddf0 0x7f6be019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be7734640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be019fda0 0x7f6be01a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be7734640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0113a70 con 0x7f6be010ddf0 2024-09-21T06:37:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be7734640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01138f0 con 0x7f6be019fda0 2024-09-21T06:37:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be7734640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6be0113bf0 con 0x7f6be0105270 2024-09-21T06:37:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be5cd1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be019fda0 0x7f6be01a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be5cd1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be019fda0 0x7f6be01a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:32858/0 (socket says 172.21.15.49:32858) 2024-09-21T06:37:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be5cd1640 1 -- 172.21.15.49:0/3627864044 learned_addr learned my addr 172.21.15.49:0/3627864044 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be010ddf0 0x7f6be019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be54d0640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0105270 0x7f6be019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be5cd1640 1 -- 172.21.15.49:0/3627864044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0105270 msgr2=0x7f6be019a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be5cd1640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0105270 0x7f6be019a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be5cd1640 1 -- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be010ddf0 msgr2=0x7f6be019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be5cd1640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be010ddf0 0x7f6be019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.548+0000 7f6be5cd1640 1 -- 172.21.15.49:0/3627864044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be01a08f0 con 0x7f6be019fda0 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.549+0000 7f6be5cd1640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be019fda0 0x7f6be01a01b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800cce0 tx=0x7f6bd800a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.549+0000 7f6bd67fc640 1 -- 172.21.15.49:0/3627864044 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800f450 con 0x7f6be019fda0 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.549+0000 7f6be7734640 1 -- 172.21.15.49:0/3627864044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be01a0be0 con 0x7f6be019fda0 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.549+0000 7f6bd67fc640 1 -- 172.21.15.49:0/3627864044 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd800faa0 con 0x7f6be019fda0 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.549+0000 7f6bd67fc640 1 -- 172.21.15.49:0/3627864044 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8018a80 con 0x7f6be019fda0 2024-09-21T06:37:23.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.549+0000 7f6be7734640 1 -- 172.21.15.49:0/3627864044 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be0102630 con 0x7f6be019fda0 2024-09-21T06:37:23.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.553+0000 7f6bd67fc640 1 -- 172.21.15.49:0/3627864044 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6bd800fc50 con 0x7f6be019fda0 2024-09-21T06:37:23.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.553+0000 7f6bedca8740 1 Processor -- start 2024-09-21T06:37:23.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.554+0000 7f6bedca8740 1 -- start start 2024-09-21T06:37:23.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.554+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e012c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.554+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a311b0 0x561973e01800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.554+0000 7f6bd67fc640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6bcc0b6680 0x7f6bcc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.554+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a39390 0x561973e01d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.554+0000 7f6bedca8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561973d77ea0 con 0x561973a311b0 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.554+0000 7f6bedca8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561973d672d0 con 0x561973a39390 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.554+0000 7f6bedca8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561973d6b0e0 con 0x561973a5a070 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be4ccf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be5cd1640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6bcc0b6680 0x7f6bcc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be4ccf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:55054/0 (socket says 172.21.15.49:55054) 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be4ccf640 1 -- 172.21.15.49:0/2597108425 learned_addr learned my addr 172.21.15.49:0/2597108425 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6bd67fc640 1 -- 172.21.15.49:0/3627864044 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6bd80e7ab0 con 0x7f6be019fda0 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a39390 0x561973e01d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be4ccf640 1 -- 172.21.15.49:0/2597108425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a39390 msgr2=0x561973e01d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:23.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a39390 0x561973e01d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be4ccf640 1 -- 172.21.15.49:0/2597108425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a311b0 msgr2=0x561973e01800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be54d0640 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a311b0 0x561973e01800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a311b0 0x561973e01800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be4ccf640 1 -- 172.21.15.49:0/2597108425 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561973ac5650 con 0x561973a5a070 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.555+0000 7f6be5cd1640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6bcc0b6680 0x7f6bcc0b8b90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80e5290 tx=0x7f6bd80122b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.556+0000 7f6be54d0640 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a311b0 0x561973e01800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.556+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e012c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0013930 tx=0x7f6bd000a690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eba4be7b6b4176c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.556+0000 7f6bcb7fe640 1 -- 172.21.15.49:0/2597108425 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000db50 con 0x561973a5a070 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.556+0000 7f6bcb7fe640 1 -- 172.21.15.49:0/2597108425 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd000dcf0 con 0x561973a5a070 2024-09-21T06:37:23.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.556+0000 7f6bcb7fe640 1 -- 172.21.15.49:0/2597108425 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000e3b0 con 0x561973a5a070 2024-09-21T06:37:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.557+0000 7f6bedca8740 1 -- 172.21.15.49:0/2597108425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 msgr2=0x561973e012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.557+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e012c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0013930 tx=0x7f6bd000a690 comp rx=0 tx=0).stop 2024-09-21T06:37:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.557+0000 7f6bedca8740 1 -- 172.21.15.49:0/2597108425 shutdown_connections 2024-09-21T06:37:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.557+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a39390 0x561973e01d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.557+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a311b0 0x561973e01800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.557+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2597108425 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e012c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.557+0000 7f6bedca8740 1 -- 172.21.15.49:0/2597108425 >> 172.21.15.49:0/2597108425 conn(0x561973a4e460 msgr2=0x561973dff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:23.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.557+0000 7f6bedca8740 1 -- 172.21.15.49:0/2597108425 shutdown_connections 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.557+0000 7f6bedca8740 1 -- 172.21.15.49:0/2597108425 wait complete. 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.558+0000 7f6bedca8740 1 -- start start 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.558+0000 7f6bedca8740 1 Processor -- start 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.558+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e0c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.558+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e0cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.558+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e18d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.558+0000 7f6bedca8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561973bc8700 con 0x561973a39390 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.558+0000 7f6bedca8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561973d02160 con 0x561973a311b0 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.558+0000 7f6bedca8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561973e0fa40 con 0x561973a5a070 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6bedca8740 10 client.0 _ll_register_callbacks cb 0x561973d1b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be54d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e0cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be4ccf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e0c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be54d0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e0cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39250/0 (socket says 172.21.15.49:39250) 2024-09-21T06:37:23.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be54d0640 1 -- 172.21.15.49:0/2057983047 learned_addr learned my addr 172.21.15.49:0/2057983047 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e18d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be54d0640 1 -- 172.21.15.49:0/2057983047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 msgr2=0x561973e18d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be54d0640 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e18d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be54d0640 1 -- 172.21.15.49:0/2057983047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 msgr2=0x561973e0c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be54d0640 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e0c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.559+0000 7f6be54d0640 1 -- 172.21.15.49:0/2057983047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561973d2fc90 con 0x561973a39390 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.560+0000 7f6be54d0640 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e0cf30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc005940 tx=0x7f6bdc031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86814db58c26ac7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.560+0000 7f6bc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.560+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/2057983047 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc035040 con 0x561973a39390 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.560+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/2057983047 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6bdc043de0 con 0x561973a39390 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.560+0000 7f6bedca8740 1 -- 172.21.15.49:0/2057983047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd000dcf0 con 0x561973a39390 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.560+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/2057983047 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bdc004040 con 0x561973a39390 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.560+0000 7f6bedca8740 10 client.15678 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.560+0000 7f6bedca8740 1 -- 172.21.15.49:0/2057983047 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561973e1b740 con 0x561973a39390 2024-09-21T06:37:23.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.560+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/2057983047 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd000dcf0 con 0x561973a39390 2024-09-21T06:37:23.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.561+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/2057983047 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6bdc04c480 con 0x561973a39390 2024-09-21T06:37:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.561+0000 7f6bedca8740 10 client.15678 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.561+0000 7f6bedca8740 10 client.15678 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:37:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.561+0000 7f6bedca8740 20 client.15678 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.561+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561973a189f0 0x561973e1eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.561+0000 7f6bedca8740 4 client.15678 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.561+0000 7f6bedca8740 1 -- 172.21.15.49:0/2057983047 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561973d79df0 con 0x561973a189f0 2024-09-21T06:37:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.561+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561973a189f0 0x561973e1eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.561+0000 7f6bc8ff9640 10 client.15678 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:37:23.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.562+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561973a189f0 0x561973e1eca0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=724d3e20112012bd server_cookie=58768232b6e31d15 in_seq=0 out_seq=0 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.563+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/2057983047 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561973d79df0 con 0x561973a189f0 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.563+0000 7f6bc8ff9640 10 client.15678 handle_command_reply: tid=0 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.563+0000 7f6bedca8740 1 client.15678 shutdown 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.563+0000 7f6bedca8740 1 -- 172.21.15.49:0/2057983047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 msgr2=0x561973e0cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.563+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e0cf30 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc005940 tx=0x7f6bdc031740 comp rx=0 tx=0).stop 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.563+0000 7f6bedca8740 1 -- 172.21.15.49:0/2057983047 shutdown_connections 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.564+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x561973a189f0 0x561973e1eca0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.564+0000 7f6bc8ff9640 0 client.15678 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.564+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a5a070 0x561973e18d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.564+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e0cf30 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.564+0000 7f6bedca8740 1 --2- 172.21.15.49:0/2057983047 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e0c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.564+0000 7f6bedca8740 1 -- 172.21.15.49:0/2057983047 >> 172.21.15.49:0/2057983047 conn(0x561973a4e460 msgr2=0x561973e044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:23.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.564+0000 7f6bedca8740 1 -- 172.21.15.49:0/2057983047 shutdown_connections 2024-09-21T06:37:23.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.564+0000 7f6bedca8740 1 -- 172.21.15.49:0/2057983047 wait complete. 2024-09-21T06:37:23.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.564+0000 7f6bedca8740 20 client.15678 trim_cache size 0 max 16384 2024-09-21T06:37:23.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.577+0000 7f6bedca8740 1 Processor -- start 2024-09-21T06:37:23.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.577+0000 7f6bedca8740 1 -- start start 2024-09-21T06:37:23.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a189f0 0x561973e02cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e0e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e18c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6bedca8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01b03d0 con 0x561973a39390 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6bedca8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01adca0 con 0x561973a311b0 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6bedca8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01abb10 con 0x561973a189f0 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6be4ccf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e18c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6be54d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e0e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6be4ccf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e18c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39262/0 (socket says 172.21.15.49:39262) 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6be4ccf640 1 -- 172.21.15.49:0/1850911328 learned_addr learned my addr 172.21.15.49:0/1850911328 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6be54d0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e0e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:32896/0 (socket says 172.21.15.49:32896) 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.578+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/1850911328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a189f0 0x561973e02cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.579+0000 7f6be4ccf640 1 -- 172.21.15.49:0/1850911328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 msgr2=0x561973e0e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:23.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.579+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/1850911328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e0e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.579+0000 7f6be4ccf640 1 -- 172.21.15.49:0/1850911328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 msgr2=0x561973e18c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:23.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.579+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/1850911328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e18c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.579+0000 7f6be4ccf640 1 -- 172.21.15.49:0/1850911328 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561973dffaa0 con 0x561973a189f0 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.579+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/1850911328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a189f0 0x561973e02cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00057c0 tx=0x7f6bd000a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7804271bd1386572 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.579+0000 7f6bcaffd640 1 -- 172.21.15.49:0/1850911328 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000d950 con 0x561973a189f0 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.579+0000 7f6bcaffd640 1 -- 172.21.15.49:0/1850911328 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd000f900 con 0x561973a189f0 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.579+0000 7f6bcaffd640 1 -- 172.21.15.49:0/1850911328 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bd001f560 con 0x561973a189f0 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.580+0000 7f6bedca8740 1 -- 172.21.15.49:0/1850911328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a189f0 msgr2=0x561973e02cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.580+0000 7f6bedca8740 1 --2- 172.21.15.49:0/1850911328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a189f0 0x561973e02cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6bd00057c0 tx=0x7f6bd000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.580+0000 7f6bedca8740 1 -- 172.21.15.49:0/1850911328 shutdown_connections 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.580+0000 7f6bedca8740 1 --2- 172.21.15.49:0/1850911328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a39390 0x561973e18c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.580+0000 7f6bedca8740 1 --2- 172.21.15.49:0/1850911328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e0e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.580+0000 7f6bedca8740 1 --2- 172.21.15.49:0/1850911328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a189f0 0x561973e02cb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.580+0000 7f6bedca8740 1 -- 172.21.15.49:0/1850911328 >> 172.21.15.49:0/1850911328 conn(0x561973a4e460 msgr2=0x561973e0df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.581+0000 7f6bedca8740 1 -- 172.21.15.49:0/1850911328 shutdown_connections 2024-09-21T06:37:23.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.581+0000 7f6bedca8740 1 -- 172.21.15.49:0/1850911328 wait complete. 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.581+0000 7f6bedca8740 1 -- start start 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.581+0000 7f6bedca8740 1 Processor -- start 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e116e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a39390 0x561973e11cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6bedca8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a5a070 0x561973e82710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6bedca8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01ac160 con 0x561973a5a070 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6bedca8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01ad5d0 con 0x561973a311b0 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6bedca8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6be01ac830 con 0x561973a39390 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6bedca8740 10 client.0 _ll_register_callbacks cb 0x7f6bdc009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6be54d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a39390 0x561973e11cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6be54d0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a39390 0x561973e11cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:55090/0 (socket says 172.21.15.49:55090) 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.582+0000 7f6be54d0640 1 -- 172.21.15.49:0/3799762544 learned_addr learned my addr 172.21.15.49:0/3799762544 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.583+0000 7f6be54d0640 1 -- 172.21.15.49:0/3799762544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 msgr2=0x561973e116e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:37:23.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.583+0000 7f6be54d0640 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e116e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.583+0000 7f6be54d0640 1 -- 172.21.15.49:0/3799762544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a5a070 msgr2=0x561973e82710 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:37:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.583+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a5a070 0x561973e82710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.583+0000 7f6be54d0640 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a5a070 0x561973e82710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.583+0000 7f6be54d0640 1 -- 172.21.15.49:0/3799762544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561973e82d80 con 0x561973a39390 2024-09-21T06:37:23.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.583+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a5a070 0x561973e82710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.584+0000 7f6be54d0640 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a39390 0x561973e11cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc04c9a0 tx=0x7f6bdc031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3915b9c59e58c317 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.584+0000 7f6bc8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T06:37:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.584+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/3799762544 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc035070 con 0x561973a39390 2024-09-21T06:37:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.584+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/3799762544 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6bdc043de0 con 0x561973a39390 2024-09-21T06:37:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.584+0000 7f6bedca8740 1 -- 172.21.15.49:0/3799762544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bd000f900 con 0x561973a39390 2024-09-21T06:37:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.585+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/3799762544 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6bdc04c690 con 0x561973a39390 2024-09-21T06:37:23.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.585+0000 7f6bedca8740 10 client.25333 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.585+0000 7f6bedca8740 1 -- 172.21.15.49:0/3799762544 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561973e8a180 con 0x561973a39390 2024-09-21T06:37:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.585+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/3799762544 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bd000f900 con 0x561973a39390 2024-09-21T06:37:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.585+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/3799762544 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6bdc0041e0 con 0x561973a39390 2024-09-21T06:37:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.585+0000 7f6bedca8740 10 client.25333 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.585+0000 7f6bedca8740 10 client.25333 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:37:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.585+0000 7f6bedca8740 20 client.25333 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:23.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.585+0000 7f6bedca8740 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5619739edda0 0x561973e8c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.586+0000 7f6bedca8740 4 client.25333 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.586+0000 7f6bedca8740 1 -- 172.21.15.49:0/3799762544 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561973d758a0 con 0x5619739edda0 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.586+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5619739edda0 0x561973e8c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.586+0000 7f6be4ccf640 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5619739edda0 0x561973e8c950 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=474a7c30b916073e server_cookie=52aacd75cc842181 in_seq=0 out_seq=0 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.586+0000 7f6bc8ff9640 10 client.25333 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bc8ff9640 1 -- 172.21.15.49:0/3799762544 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561973d758a0 con 0x5619739edda0 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bc8ff9640 10 client.25333 handle_command_reply: tid=0 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bedca8740 1 client.25333 shutdown 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bedca8740 1 -- 172.21.15.49:0/3799762544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a39390 msgr2=0x561973e11cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bedca8740 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a39390 0x561973e11cc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc04c9a0 tx=0x7f6bdc031400 comp rx=0 tx=0).stop 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bedca8740 1 -- 172.21.15.49:0/3799762544 shutdown_connections 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bedca8740 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5619739edda0 0x561973e8c950 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bedca8740 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561973a5a070 0x561973e82710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bc8ff9640 0 client.25333 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:37:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bedca8740 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561973a39390 0x561973e11cc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bedca8740 1 --2- 172.21.15.49:0/3799762544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561973a311b0 0x561973e116e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.587+0000 7f6bedca8740 1 -- 172.21.15.49:0/3799762544 >> 172.21.15.49:0/3799762544 conn(0x561973a4e460 msgr2=0x561973e02a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.588+0000 7f6bedca8740 1 -- 172.21.15.49:0/3799762544 shutdown_connections 2024-09-21T06:37:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.588+0000 7f6bedca8740 1 -- 172.21.15.49:0/3799762544 wait complete. 2024-09-21T06:37:23.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.588+0000 7f6bedca8740 20 client.25333 trim_cache size 0 max 16384 2024-09-21T06:37:23.591 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 -- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6bcc0b6680 msgr2=0x7f6bcc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6bcc0b6680 0x7f6bcc0b8b90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6bd80e5290 tx=0x7f6bd80122b0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 -- 172.21.15.49:0/3627864044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be019fda0 msgr2=0x7f6be01a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be019fda0 0x7f6be01a01b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800cce0 tx=0x7f6bd800a620 comp rx=0 tx=0).stop 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 -- 172.21.15.49:0/3627864044 shutdown_connections 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6bcc0b6680 0x7f6bcc0b8b90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6be019fda0 0x7f6be01a01b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6be010ddf0 0x7f6be019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 --2- 172.21.15.49:0/3627864044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6be0105270 0x7f6be019a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 -- 172.21.15.49:0/3627864044 >> 172.21.15.49:0/3627864044 conn(0x7f6be0079730 msgr2=0x7f6be0100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 -- 172.21.15.49:0/3627864044 shutdown_connections 2024-09-21T06:37:23.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:23.589+0000 7f6be7734640 1 -- 172.21.15.49:0/3627864044 wait complete. 2024-09-21T06:37:24.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:37:24.650 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:25.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.182+0000 7f8a52bab640 1 -- 172.21.15.49:0/2414553516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c108cf0 msgr2=0x7f8a4c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:25.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.182+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2414553516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c108cf0 0x7f8a4c10f520 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009ca0 tx=0x7f8a4402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.182+0000 7f8a52bab640 1 -- 172.21.15.49:0/2414553516 shutdown_connections 2024-09-21T06:37:25.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.182+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2414553516 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c108cf0 0x7f8a4c10f520 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.182+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2414553516 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a4c1083a0 0x7f8a4c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.182+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2414553516 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c102a60 0x7f8a4c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.182+0000 7f8a52bab640 1 -- 172.21.15.49:0/2414553516 >> 172.21.15.49:0/2414553516 conn(0x7f8a4c079730 msgr2=0x7f8a4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:25.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.182+0000 7f8a52bab640 1 -- 172.21.15.49:0/2414553516 shutdown_connections 2024-09-21T06:37:25.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.182+0000 7f8a52bab640 1 -- 172.21.15.49:0/2414553516 wait complete. 2024-09-21T06:37:25.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.183+0000 7f8a52bab640 1 Processor -- start 2024-09-21T06:37:25.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.183+0000 7f8a52bab640 1 -- start start 2024-09-21T06:37:25.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a52bab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c102a60 0x7f8a4c19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a52bab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c1083a0 0x7f8a4c19b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a52bab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a4c108cf0 0x7f8a4c19bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a52bab640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1129b0 con 0x7f8a4c1083a0 2024-09-21T06:37:25.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a52bab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c112830 con 0x7f8a4c108cf0 2024-09-21T06:37:25.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a52bab640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c112b30 con 0x7f8a4c102a60 2024-09-21T06:37:25.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c1083a0 0x7f8a4c19b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.187 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c1083a0 0x7f8a4c19b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39292/0 (socket says 172.21.15.49:39292) 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a4bfff640 1 -- 172.21.15.49:0/2892803180 learned_addr learned my addr 172.21.15.49:0/2892803180 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a51148640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a4c108cf0 0x7f8a4c19bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a50947640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c102a60 0x7f8a4c19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.184+0000 7f8a51148640 1 -- 172.21.15.49:0/2892803180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c102a60 msgr2=0x7f8a4c19b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a51148640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c102a60 0x7f8a4c19b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a51148640 1 -- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c1083a0 msgr2=0x7f8a4c19b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a51148640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c1083a0 0x7f8a4c19b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a51148640 1 -- 172.21.15.49:0/2892803180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c1a6490 con 0x7f8a4c108cf0 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a50947640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c102a60 0x7f8a4c19b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c1083a0 0x7f8a4c19b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:25.188 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a51148640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a4c108cf0 0x7f8a4c19bc80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a44005e30 tx=0x7f8a440317c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a49ffb640 1 -- 172.21.15.49:0/2892803180 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44003b70 con 0x7f8a4c108cf0 2024-09-21T06:37:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a49ffb640 1 -- 172.21.15.49:0/2892803180 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a44003d10 con 0x7f8a4c108cf0 2024-09-21T06:37:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a49ffb640 1 -- 172.21.15.49:0/2892803180 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4402f950 con 0x7f8a4c108cf0 2024-09-21T06:37:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.185+0000 7f8a52bab640 1 -- 172.21.15.49:0/2892803180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c198ff0 con 0x7f8a4c108cf0 2024-09-21T06:37:25.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.186+0000 7f8a52bab640 1 -- 172.21.15.49:0/2892803180 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c199470 con 0x7f8a4c108cf0 2024-09-21T06:37:25.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.189+0000 7f8a5911f740 1 Processor -- start 2024-09-21T06:37:25.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.190+0000 7f8a49ffb640 1 -- 172.21.15.49:0/2892803180 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8a4402faf0 con 0x7f8a4c108cf0 2024-09-21T06:37:25.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a5911f740 1 -- start start 2024-09-21T06:37:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d914070 0x561e8dcbb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8eb1b0 0x561e8dcbbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8f3390 0x561e8dcbc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a5911f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561e8dc31ea0 con 0x561e8d914070 2024-09-21T06:37:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a5911f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561e8dc212d0 con 0x561e8d8f3390 2024-09-21T06:37:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a49ffb640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a3c0baac0 0x7f8a3c0bcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a5911f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561e8dc250e0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d914070 0x561e8dcbb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a50947640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8eb1b0 0x561e8dcbbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a50947640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8eb1b0 0x561e8dcbbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:55122/0 (socket says 172.21.15.49:55122) 2024-09-21T06:37:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d914070 0x561e8dcbb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39300/0 (socket says 172.21.15.49:39300) 2024-09-21T06:37:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.192+0000 7f8a50947640 1 -- 172.21.15.49:0/4035172446 learned_addr learned my addr 172.21.15.49:0/4035172446 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:25.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.191+0000 7f8a49ffb640 1 -- 172.21.15.49:0/2892803180 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a441087e0 con 0x7f8a4c108cf0 2024-09-21T06:37:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.192+0000 7f8a50947640 1 -- 172.21.15.49:0/4035172446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8f3390 msgr2=0x561e8dcbc120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:37:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.192+0000 7f8a50947640 1 --2- 172.21.15.49:0/4035172446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8f3390 0x561e8dcbc120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.192+0000 7f8a50947640 1 -- 172.21.15.49:0/4035172446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d914070 msgr2=0x561e8dcbb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.192+0000 7f8a50947640 1 --2- 172.21.15.49:0/4035172446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d914070 0x561e8dcbb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.192+0000 7f8a50947640 1 -- 172.21.15.49:0/4035172446 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e8d97f650 con 0x561e8d8eb1b0 2024-09-21T06:37:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.192+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/4035172446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d914070 0x561e8dcbb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.192+0000 7f8a51148640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a3c0baac0 0x7f8a3c0bcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.192+0000 7f8a50947640 1 --2- 172.21.15.49:0/4035172446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8eb1b0 0x561e8dcbbbe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009c20 tx=0x7f8a40010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edc98aed5e5d7733 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.193+0000 7f8a36ffd640 1 -- 172.21.15.49:0/4035172446 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40004030 con 0x561e8d8eb1b0 2024-09-21T06:37:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.193+0000 7f8a36ffd640 1 -- 172.21.15.49:0/4035172446 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a400035f0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a36ffd640 1 -- 172.21.15.49:0/4035172446 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400126b0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a5911f740 1 -- 172.21.15.49:0/4035172446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8eb1b0 msgr2=0x561e8dcbbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a51148640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a3c0baac0 0x7f8a3c0bcfd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8a4402ade0 tx=0x7f8a440095c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a5911f740 1 --2- 172.21.15.49:0/4035172446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8eb1b0 0x561e8dcbbbe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009c20 tx=0x7f8a40010740 comp rx=0 tx=0).stop 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a5911f740 1 -- 172.21.15.49:0/4035172446 shutdown_connections 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a5911f740 1 --2- 172.21.15.49:0/4035172446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8f3390 0x561e8dcbc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a5911f740 1 --2- 172.21.15.49:0/4035172446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8eb1b0 0x561e8dcbbbe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a5911f740 1 --2- 172.21.15.49:0/4035172446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d914070 0x561e8dcbb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a5911f740 1 -- 172.21.15.49:0/4035172446 >> 172.21.15.49:0/4035172446 conn(0x561e8d908460 msgr2=0x561e8dcb9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a5911f740 1 -- 172.21.15.49:0/4035172446 shutdown_connections 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.194+0000 7f8a5911f740 1 -- 172.21.15.49:0/4035172446 wait complete. 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.195+0000 7f8a5911f740 1 -- start start 2024-09-21T06:37:25.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.195+0000 7f8a5911f740 1 Processor -- start 2024-09-21T06:37:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.195+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.195+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8f3390 0x561e8dcc72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d914070 0x561e8dcd3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a5911f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561e8da82700 con 0x561e8d8eb1b0 2024-09-21T06:37:25.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a5911f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561e8dbbc160 con 0x561e8d914070 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a5911f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561e8dcc9ed0 con 0x561e8d8f3390 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a5911f740 10 client.0 _ll_register_callbacks cb 0x561e8dbd59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a50947640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8f3390 0x561e8dcc72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a50947640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8f3390 0x561e8dcc72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:55134/0 (socket says 172.21.15.49:55134) 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39316/0 (socket says 172.21.15.49:39316) 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a50947640 1 -- 172.21.15.49:0/1896470868 learned_addr learned my addr 172.21.15.49:0/1896470868 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a50947640 1 -- 172.21.15.49:0/1896470868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d914070 msgr2=0x561e8dcd3210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a50947640 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d914070 0x561e8dcd3210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a50947640 1 -- 172.21.15.49:0/1896470868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8eb1b0 msgr2=0x561e8dcc6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a50947640 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a50947640 1 -- 172.21.15.49:0/1896470868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e8dbe9c90 con 0x561e8d8f3390 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.196+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:25.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.197+0000 7f8a50947640 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8f3390 0x561e8dcc72f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009fb0 tx=0x7f8a400037a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92a64e947e4b1665 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.197+0000 7f8a2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T06:37:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.197+0000 7f8a2bfff640 1 -- 172.21.15.49:0/1896470868 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4002b060 con 0x561e8d8f3390 2024-09-21T06:37:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.197+0000 7f8a2bfff640 1 -- 172.21.15.49:0/1896470868 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a40003f90 con 0x561e8d8f3390 2024-09-21T06:37:25.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.197+0000 7f8a5911f740 1 -- 172.21.15.49:0/1896470868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a400035f0 con 0x561e8d8f3390 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.197+0000 7f8a2bfff640 1 -- 172.21.15.49:0/1896470868 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a40004190 con 0x561e8d8f3390 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.197+0000 7f8a5911f740 10 client.25342 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.197+0000 7f8a5911f740 1 -- 172.21.15.49:0/1896470868 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e8dcd5c90 con 0x561e8d8f3390 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.198+0000 7f8a2bfff640 1 -- 172.21.15.49:0/1896470868 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a40004330 con 0x561e8d8f3390 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.198+0000 7f8a2bfff640 1 -- 172.21.15.49:0/1896470868 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a4000f040 con 0x561e8d8f3390 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.198+0000 7f8a5911f740 10 client.25342 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.198+0000 7f8a5911f740 10 client.25342 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.198+0000 7f8a5911f740 20 client.25342 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.198+0000 7f8a5911f740 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561e8d8d29f0 0x561e8dcd9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.198+0000 7f8a5911f740 4 client.25342 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.198+0000 7f8a5911f740 1 -- 172.21.15.49:0/1896470868 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a400035f0 con 0x561e8d8d29f0 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.198+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561e8d8d29f0 0x561e8dcd9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.199+0000 7f8a2bfff640 10 client.25342 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:37:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.199+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561e8d8d29f0 0x561e8dcd9090 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=214b004800d39243 server_cookie=c89cc2d2b505669d in_seq=0 out_seq=0 2024-09-21T06:37:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a2bfff640 1 -- 172.21.15.49:0/1896470868 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8a400035f0 con 0x561e8d8d29f0 2024-09-21T06:37:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a2bfff640 10 client.25342 handle_command_reply: tid=0 2024-09-21T06:37:25.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a5911f740 1 client.25342 shutdown 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a5911f740 1 -- 172.21.15.49:0/1896470868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8f3390 msgr2=0x561e8dcc72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a5911f740 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8f3390 0x561e8dcc72f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009fb0 tx=0x7f8a400037a0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a5911f740 1 -- 172.21.15.49:0/1896470868 shutdown_connections 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a5911f740 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561e8d8d29f0 0x561e8dcd9090 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a5911f740 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d914070 0x561e8dcd3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a2bfff640 0 client.25342 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a5911f740 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d8f3390 0x561e8dcc72f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a5911f740 1 --2- 172.21.15.49:0/1896470868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.200+0000 7f8a5911f740 1 -- 172.21.15.49:0/1896470868 >> 172.21.15.49:0/1896470868 conn(0x561e8d908460 msgr2=0x561e8dcbe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.201+0000 7f8a5911f740 1 -- 172.21.15.49:0/1896470868 shutdown_connections 2024-09-21T06:37:25.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.201+0000 7f8a5911f740 1 -- 172.21.15.49:0/1896470868 wait complete. 2024-09-21T06:37:25.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.202+0000 7f8a5911f740 20 client.25342 trim_cache size 0 max 16384 2024-09-21T06:37:25.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.228+0000 7f8a5911f740 1 Processor -- start 2024-09-21T06:37:25.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.228+0000 7f8a5911f740 1 -- start start 2024-09-21T06:37:25.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dcbcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 0x561e8dcb8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a5911f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1afdf0 con 0x561e8d8f3390 2024-09-21T06:37:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a5911f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1ad6c0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a5911f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1ab530 con 0x561e8d914070 2024-09-21T06:37:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:32934/0 (socket says 172.21.15.49:32934) 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a4bfff640 1 -- 172.21.15.49:0/2012140188 learned_addr learned my addr 172.21.15.49:0/2012140188 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 0x561e8dcb8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a50947640 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dcbcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a4bfff640 1 -- 172.21.15.49:0/2012140188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 msgr2=0x561e8dcb8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 0x561e8dcb8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a4bfff640 1 -- 172.21.15.49:0/2012140188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 msgr2=0x561e8dcbcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dcbcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a4bfff640 1 -- 172.21.15.49:0/2012140188 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e8dcbd990 con 0x561e8d8eb1b0 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.229+0000 7f8a50947640 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dcbcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:25.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.230+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc8c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a38000c00 tx=0x7f8a38005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25d69382bd831555 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.230+0000 7f8a367fc640 1 -- 172.21.15.49:0/2012140188 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38022c00 con 0x561e8d8eb1b0 2024-09-21T06:37:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.230+0000 7f8a367fc640 1 -- 172.21.15.49:0/2012140188 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a380044d0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.230+0000 7f8a367fc640 1 -- 172.21.15.49:0/2012140188 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38003d80 con 0x561e8d8eb1b0 2024-09-21T06:37:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.231+0000 7f8a5911f740 1 -- 172.21.15.49:0/2012140188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 msgr2=0x561e8dcc8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.231+0000 7f8a5911f740 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc8c90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a38000c00 tx=0x7f8a38005f90 comp rx=0 tx=0).stop 2024-09-21T06:37:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.231+0000 7f8a5911f740 1 -- 172.21.15.49:0/2012140188 shutdown_connections 2024-09-21T06:37:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.231+0000 7f8a5911f740 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 0x561e8dcb8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.231+0000 7f8a5911f740 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dcbcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.231+0000 7f8a5911f740 1 --2- 172.21.15.49:0/2012140188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dcc8c90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.231+0000 7f8a5911f740 1 -- 172.21.15.49:0/2012140188 >> 172.21.15.49:0/2012140188 conn(0x561e8d908460 msgr2=0x561e8dcbc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.231+0000 7f8a5911f740 1 -- 172.21.15.49:0/2012140188 shutdown_connections 2024-09-21T06:37:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.231+0000 7f8a5911f740 1 -- 172.21.15.49:0/2012140188 wait complete. 2024-09-21T06:37:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.232+0000 7f8a5911f740 1 -- start start 2024-09-21T06:37:25.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.232+0000 7f8a5911f740 1 Processor -- start 2024-09-21T06:37:25.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dccb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dccb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a5911f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 0x561e8dccbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a5911f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1abb80 con 0x561e8d8f3390 2024-09-21T06:37:25.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a5911f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1acff0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a5911f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c1ac250 con 0x561e8d914070 2024-09-21T06:37:25.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a5911f740 10 client.0 _ll_register_callbacks cb 0x7f8a38009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:25.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dccb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a50947640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dccb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a4bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dccb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:32942/0 (socket says 172.21.15.49:32942) 2024-09-21T06:37:25.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a4bfff640 1 -- 172.21.15.49:0/3744473149 learned_addr learned my addr 172.21.15.49:0/3744473149 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:25.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.233+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 0x561e8dccbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a4bfff640 1 -- 172.21.15.49:0/3744473149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 msgr2=0x561e8dccbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 0x561e8dccbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a4bfff640 1 -- 172.21.15.49:0/3744473149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 msgr2=0x561e8dccb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dccb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a4bfff640 1 -- 172.21.15.49:0/3744473149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e8dd4b2e0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a50947640 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dccb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a4bfff640 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dccb370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a38012e40 tx=0x7f8a38015040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58c44e591cd79260 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a2bfff640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a2bfff640 1 -- 172.21.15.49:0/3744473149 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38003b00 con 0x561e8d8eb1b0 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a2bfff640 1 -- 172.21.15.49:0/3744473149 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a38003ca0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.234+0000 7f8a5911f740 1 -- 172.21.15.49:0/3744473149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a380044d0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.235+0000 7f8a2bfff640 1 -- 172.21.15.49:0/3744473149 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a38003ea0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.235+0000 7f8a5911f740 10 client.25364 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:25.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.235+0000 7f8a5911f740 1 -- 172.21.15.49:0/3744473149 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561e8dd4c4d0 con 0x561e8d8eb1b0 2024-09-21T06:37:25.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.235+0000 7f8a2bfff640 1 -- 172.21.15.49:0/3744473149 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a38004040 con 0x561e8d8eb1b0 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.236+0000 7f8a2bfff640 1 -- 172.21.15.49:0/3744473149 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a38027460 con 0x561e8d8eb1b0 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.236+0000 7f8a5911f740 10 client.25364 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.236+0000 7f8a5911f740 10 client.25364 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.236+0000 7f8a5911f740 20 client.25364 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.236+0000 7f8a5911f740 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561e8d8a7da0 0x561e8dd4eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.236+0000 7f8a5911f740 4 client.25364 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.236+0000 7f8a5911f740 1 -- 172.21.15.49:0/3744473149 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8a380044d0 con 0x561e8d8a7da0 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.236+0000 7f8a50947640 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561e8d8a7da0 0x561e8dd4eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.237+0000 7f8a2bfff640 10 client.25364 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.237+0000 7f8a50947640 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561e8d8a7da0 0x561e8dd4eb80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4887126315754a9c server_cookie=4f6be3d12ac5257a in_seq=0 out_seq=0 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.237+0000 7f8a2bfff640 1 -- 172.21.15.49:0/3744473149 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8a380044d0 con 0x561e8d8a7da0 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.237+0000 7f8a2bfff640 10 client.25364 handle_command_reply: tid=0 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.237+0000 7f8a5911f740 1 client.25364 shutdown 2024-09-21T06:37:25.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.237+0000 7f8a5911f740 1 -- 172.21.15.49:0/3744473149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 msgr2=0x561e8dccb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:25.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.237+0000 7f8a5911f740 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dccb370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a38012e40 tx=0x7f8a38015040 comp rx=0 tx=0).stop 2024-09-21T06:37:25.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.238+0000 7f8a5911f740 1 -- 172.21.15.49:0/3744473149 shutdown_connections 2024-09-21T06:37:25.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.238+0000 7f8a5911f740 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561e8d8a7da0 0x561e8dd4eb80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.238+0000 7f8a5911f740 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e8d914070 0x561e8dccbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.238+0000 7f8a5911f740 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e8d8f3390 0x561e8dccb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.238+0000 7f8a5911f740 1 --2- 172.21.15.49:0/3744473149 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e8d8eb1b0 0x561e8dccb370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.238+0000 7f8a5911f740 1 -- 172.21.15.49:0/3744473149 >> 172.21.15.49:0/3744473149 conn(0x561e8d908460 msgr2=0x561e8dcbef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.238+0000 7f8a2bfff640 0 client.25364 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:37:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.238+0000 7f8a5911f740 1 -- 172.21.15.49:0/3744473149 shutdown_connections 2024-09-21T06:37:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.238+0000 7f8a5911f740 1 -- 172.21.15.49:0/3744473149 wait complete. 2024-09-21T06:37:25.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.239+0000 7f8a5911f740 20 client.25364 trim_cache size 0 max 16384 2024-09-21T06:37:25.242 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:37:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.239+0000 7f8a52bab640 1 -- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a3c0baac0 msgr2=0x7f8a3c0bcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.239+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a3c0baac0 0x7f8a3c0bcfd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8a4402ade0 tx=0x7f8a440095c0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.239+0000 7f8a52bab640 1 -- 172.21.15.49:0/2892803180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a4c108cf0 msgr2=0x7f8a4c19bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.239+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a4c108cf0 0x7f8a4c19bc80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8a44005e30 tx=0x7f8a440317c0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.239+0000 7f8a52bab640 1 -- 172.21.15.49:0/2892803180 shutdown_connections 2024-09-21T06:37:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.240+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a3c0baac0 0x7f8a3c0bcfd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.240+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a4c108cf0 0x7f8a4c19bc80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.240+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a4c1083a0 0x7f8a4c19b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.240+0000 7f8a52bab640 1 --2- 172.21.15.49:0/2892803180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a4c102a60 0x7f8a4c19b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:25.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.240+0000 7f8a52bab640 1 -- 172.21.15.49:0/2892803180 >> 172.21.15.49:0/2892803180 conn(0x7f8a4c079730 msgr2=0x7f8a4c104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:25.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.240+0000 7f8a52bab640 1 -- 172.21.15.49:0/2892803180 shutdown_connections 2024-09-21T06:37:25.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:25.240+0000 7f8a52bab640 1 -- 172.21.15.49:0/2892803180 wait complete. 2024-09-21T06:37:25.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:25 smithi049 ceph-mon[31177]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-21T06:37:25.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:25 smithi098 ceph-mon[34704]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-21T06:37:25.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:25 smithi079 ceph-mon[34346]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-21T06:37:25.950 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:37:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.728+0000 7f8e984c0640 1 -- 172.21.15.49:0/358353814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90102890 msgr2=0x7f8e90112530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.728+0000 7f8e984c0640 1 --2- 172.21.15.49:0/358353814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90102890 0x7f8e90112530 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009ca0 tx=0x7f8e8802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.729+0000 7f8e984c0640 1 -- 172.21.15.49:0/358353814 shutdown_connections 2024-09-21T06:37:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.729+0000 7f8e984c0640 1 --2- 172.21.15.49:0/358353814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90102890 0x7f8e90112530 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.729+0000 7f8e984c0640 1 --2- 172.21.15.49:0/358353814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e90101da0 0x7f8e901021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.729+0000 7f8e984c0640 1 --2- 172.21.15.49:0/358353814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90104690 0x7f8e90104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.729+0000 7f8e984c0640 1 -- 172.21.15.49:0/358353814 >> 172.21.15.49:0/358353814 conn(0x7f8e90077c60 msgr2=0x7f8e900780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.729+0000 7f8e984c0640 1 -- 172.21.15.49:0/358353814 shutdown_connections 2024-09-21T06:37:26.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.729+0000 7f8e984c0640 1 -- 172.21.15.49:0/358353814 wait complete. 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.729+0000 7f8e984c0640 1 Processor -- start 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.729+0000 7f8e984c0640 1 -- start start 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e984c0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90101da0 0x7f8e90109480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e984c0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90102890 0x7f8e901099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e984c0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e90104690 0x7f8e90109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e984c0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8e90115cf0 con 0x7f8e90102890 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e984c0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e90115b70 con 0x7f8e90104690 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e984c0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e90115e70 con 0x7f8e90101da0 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e96a5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e90104690 0x7f8e90109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e96a5d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e90104690 0x7f8e90109f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:53234/0 (socket says 172.21.15.49:53234) 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e96a5d640 1 -- 172.21.15.49:0/3288303823 learned_addr learned my addr 172.21.15.49:0/3288303823 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90102890 0x7f8e901099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.730+0000 7f8e9625c640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90101da0 0x7f8e90109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.731+0000 7f8e96a5d640 1 -- 172.21.15.49:0/3288303823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90101da0 msgr2=0x7f8e90109480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.731+0000 7f8e96a5d640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90101da0 0x7f8e90109480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.731+0000 7f8e96a5d640 1 -- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90102890 msgr2=0x7f8e901099c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.731+0000 7f8e96a5d640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90102890 0x7f8e901099c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.731+0000 7f8e96a5d640 1 -- 172.21.15.49:0/3288303823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e901acae0 con 0x7f8e90104690 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.731+0000 7f8e9625c640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90101da0 0x7f8e90109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.731+0000 7f8e96a5d640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e90104690 0x7f8e90109f00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8e8802f540 tx=0x7f8e880316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.731+0000 7f8e877fe640 1 -- 172.21.15.49:0/3288303823 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e88003b70 con 0x7f8e90104690 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.732+0000 7f8e984c0640 1 -- 172.21.15.49:0/3288303823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e901acd70 con 0x7f8e90104690 2024-09-21T06:37:26.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.732+0000 7f8e877fe640 1 -- 172.21.15.49:0/3288303823 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e88003d10 con 0x7f8e90104690 2024-09-21T06:37:26.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.732+0000 7f8e877fe640 1 -- 172.21.15.49:0/3288303823 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8802f990 con 0x7f8e90104690 2024-09-21T06:37:26.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.732+0000 7f8e984c0640 1 -- 172.21.15.49:0/3288303823 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e901ad270 con 0x7f8e90104690 2024-09-21T06:37:26.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.734+0000 7f8e9ea34740 1 Processor -- start 2024-09-21T06:37:26.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.736+0000 7f8e877fe640 1 -- 172.21.15.49:0/3288303823 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8e8802fb30 con 0x7f8e90104690 2024-09-21T06:37:26.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.736+0000 7f8e9ea34740 1 -- start start 2024-09-21T06:37:26.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.736+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b55070 0x557820efc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.736+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b2c1b0 0x557820efc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 0x557820efcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9ea34740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557820e72ea0 con 0x557820b55070 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9ea34740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557820e622d0 con 0x557820b34390 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9ea34740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557820e660e0 con 0x557820b2c1b0 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e95a5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b55070 0x557820efc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e95a5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b55070 0x557820efc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52442/0 (socket says 172.21.15.49:52442) 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e95a5b640 1 -- 172.21.15.49:0/1501548855 learned_addr learned my addr 172.21.15.49:0/1501548855 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9625c640 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b2c1b0 0x557820efc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9625c640 1 -- 172.21.15.49:0/1501548855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 msgr2=0x557820efcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 0x557820efcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9625c640 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 0x557820efcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9625c640 1 -- 172.21.15.49:0/1501548855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b55070 msgr2=0x557820efc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9625c640 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b55070 0x557820efc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e9625c640 1 -- 172.21.15.49:0/1501548855 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557820bc0650 con 0x557820b2c1b0 2024-09-21T06:37:26.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 0x557820efcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:26.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.737+0000 7f8e877fe640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e7c0b6780 0x7f8e7c0b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.738+0000 7f8e877fe640 1 -- 172.21.15.49:0/3288303823 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8e88108940 con 0x7f8e90104690 2024-09-21T06:37:26.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.738+0000 7f8e9625c640 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b2c1b0 0x557820efc800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009c00 tx=0x7f8e8c0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3014c202857ca2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.738+0000 7f8e96a5d640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e7c0b6780 0x7f8e7c0b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.738+0000 7f8e84d9a640 1 -- 172.21.15.49:0/1501548855 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c005020 con 0x557820b2c1b0 2024-09-21T06:37:26.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.738+0000 7f8e84d9a640 1 -- 172.21.15.49:0/1501548855 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e8c0047a0 con 0x557820b2c1b0 2024-09-21T06:37:26.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e84d9a640 1 -- 172.21.15.49:0/1501548855 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0126b0 con 0x557820b2c1b0 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1501548855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b2c1b0 msgr2=0x557820efc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e96a5d640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e7c0b6780 0x7f8e7c0b8c90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ce6a0 tx=0x7f8e88009460 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b2c1b0 0x557820efc800 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009c00 tx=0x7f8e8c0117b0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1501548855 shutdown_connections 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 0x557820efcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b2c1b0 0x557820efc800 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1501548855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b55070 0x557820efc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1501548855 >> 172.21.15.49:0/1501548855 conn(0x557820b49460 msgr2=0x557820efa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1501548855 shutdown_connections 2024-09-21T06:37:26.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.740+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1501548855 wait complete. 2024-09-21T06:37:26.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.741+0000 7f8e9ea34740 1 -- start start 2024-09-21T06:37:26.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.741+0000 7f8e9ea34740 1 Processor -- start 2024-09-21T06:37:26.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.741+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f07840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.741+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 0x557820f07d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.741+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 0x557820f082c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.741+0000 7f8e9ea34740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557820cc3700 con 0x557820b2c1b0 2024-09-21T06:37:26.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.741+0000 7f8e9ea34740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557820dfd160 con 0x557820b55070 2024-09-21T06:37:26.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.741+0000 7f8e9ea34740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557820f0ab40 con 0x557820b34390 2024-09-21T06:37:26.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.741+0000 7f8e9ea34740 10 client.0 _ll_register_callbacks cb 0x557820e169e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e95a5b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 0x557820f082c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e95a5b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 0x557820f082c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:53262/0 (socket says 172.21.15.49:53262) 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e95a5b640 1 -- 172.21.15.49:0/1756222880 learned_addr learned my addr 172.21.15.49:0/1756222880 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e9625c640 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 0x557820f07d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f07840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e9625c640 1 -- 172.21.15.49:0/1756222880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 msgr2=0x557820f082c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e9625c640 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 0x557820f082c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e9625c640 1 -- 172.21.15.49:0/1756222880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 msgr2=0x557820f07840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e9625c640 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f07840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e9625c640 1 -- 172.21.15.49:0/1756222880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557820e2ac90 con 0x557820b34390 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e9625c640 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 0x557820f07d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c004770 tx=0x7f8e8c009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6ec94407043ab90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.742+0000 7f8e79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T06:37:26.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.743+0000 7f8e79ffb640 1 -- 172.21.15.49:0/1756222880 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c028020 con 0x557820b34390 2024-09-21T06:37:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.743+0000 7f8e79ffb640 1 -- 172.21.15.49:0/1756222880 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8e8c005110 con 0x557820b34390 2024-09-21T06:37:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.743+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1756222880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e8c0047a0 con 0x557820b34390 2024-09-21T06:37:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.743+0000 7f8e79ffb640 1 -- 172.21.15.49:0/1756222880 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8e8c009820 con 0x557820b34390 2024-09-21T06:37:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.743+0000 7f8e9ea34740 10 client.25360 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.743+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1756222880 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557820f166b0 con 0x557820b34390 2024-09-21T06:37:26.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.744+0000 7f8e79ffb640 1 -- 172.21.15.49:0/1756222880 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e8c0047a0 con 0x557820b34390 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.744+0000 7f8e79ffb640 1 -- 172.21.15.49:0/1756222880 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8e8c012450 con 0x557820b34390 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.744+0000 7f8e9ea34740 10 client.25360 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.744+0000 7f8e9ea34740 10 client.25360 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.744+0000 7f8e9ea34740 20 client.25360 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.744+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x557820b139f0 0x557820f19a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.744+0000 7f8e9ea34740 4 client.25360 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.744+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1756222880 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557820e74df0 con 0x557820b139f0 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.744+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x557820b139f0 0x557820f19a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.745+0000 7f8e79ffb640 10 client.25360 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:26.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.745+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x557820b139f0 0x557820f19a10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93c04d731d3a9f57 server_cookie=c22966f74fab800c in_seq=0 out_seq=0 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e79ffb640 1 -- 172.21.15.49:0/1756222880 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557820e74df0 con 0x557820b139f0 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e79ffb640 10 client.25360 handle_command_reply: tid=0 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 client.25360 shutdown 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1756222880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 msgr2=0x557820f07d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 0x557820f07d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c004770 tx=0x7f8e8c009e50 comp rx=0 tx=0).stop 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1756222880 shutdown_connections 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x557820b139f0 0x557820f19a10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e79ffb640 0 client.25360 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 0x557820f082c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 0x557820f07d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/1756222880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f07840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1756222880 >> 172.21.15.49:0/1756222880 conn(0x557820b49460 msgr2=0x557820eff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1756222880 shutdown_connections 2024-09-21T06:37:26.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 1 -- 172.21.15.49:0/1756222880 wait complete. 2024-09-21T06:37:26.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.746+0000 7f8e9ea34740 20 client.25360 trim_cache size 0 max 16384 2024-09-21T06:37:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e9ea34740 1 Processor -- start 2024-09-21T06:37:26.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e9ea34740 1 -- start start 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f09720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 0x557820efda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b55070 0x557820ef9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e9ea34740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8e901b8540 con 0x557820b2c1b0 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e9ea34740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e901b5e10 con 0x557820b34390 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e9ea34740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e901b3c80 con 0x557820b55070 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e95a5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f09720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e95a5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f09720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52456/0 (socket says 172.21.15.49:52456) 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e95a5b640 1 -- 172.21.15.49:0/715292138 learned_addr learned my addr 172.21.15.49:0/715292138 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:26.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.760+0000 7f8e9625c640 1 --2- 172.21.15.49:0/715292138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 0x557820efda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/715292138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b55070 0x557820ef9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e95a5b640 1 -- 172.21.15.49:0/715292138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b55070 msgr2=0x557820ef9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/715292138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b55070 0x557820ef9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e95a5b640 1 -- 172.21.15.49:0/715292138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 msgr2=0x557820efda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/715292138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 0x557820efda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e95a5b640 1 -- 172.21.15.49:0/715292138 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557820f05d40 con 0x557820b2c1b0 2024-09-21T06:37:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/715292138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f09720 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8e80005dd0 tx=0x7f8e80005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9754680f6fa869c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e7bfff640 1 -- 172.21.15.49:0/715292138 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8002f070 con 0x557820b2c1b0 2024-09-21T06:37:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e7bfff640 1 -- 172.21.15.49:0/715292138 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e8000fd20 con 0x557820b2c1b0 2024-09-21T06:37:26.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.761+0000 7f8e7bfff640 1 -- 172.21.15.49:0/715292138 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e80021430 con 0x557820b2c1b0 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.762+0000 7f8e9ea34740 1 -- 172.21.15.49:0/715292138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 msgr2=0x557820f09720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.762+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/715292138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f09720 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8e80005dd0 tx=0x7f8e80005850 comp rx=0 tx=0).stop 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.763+0000 7f8e9ea34740 1 -- 172.21.15.49:0/715292138 shutdown_connections 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.763+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/715292138 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b55070 0x557820ef9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.763+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/715292138 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b34390 0x557820efda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.763+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/715292138 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f09720 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.763+0000 7f8e9ea34740 1 -- 172.21.15.49:0/715292138 >> 172.21.15.49:0/715292138 conn(0x557820b49460 msgr2=0x557820efd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.763+0000 7f8e9ea34740 1 -- 172.21.15.49:0/715292138 shutdown_connections 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.763+0000 7f8e9ea34740 1 -- 172.21.15.49:0/715292138 wait complete. 2024-09-21T06:37:26.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.763+0000 7f8e9ea34740 1 -- start start 2024-09-21T06:37:26.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.763+0000 7f8e9ea34740 1 Processor -- start 2024-09-21T06:37:26.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f1a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e95a5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f1a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e95a5b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f1a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52462/0 (socket says 172.21.15.49:52462) 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e9ea34740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 0x557820f1aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e95a5b640 1 -- 172.21.15.49:0/3629349816 learned_addr learned my addr 172.21.15.49:0/3629349816 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 0x557820f1b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8e901b42d0 con 0x557820b2c1b0 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e901b5740 con 0x557820b55070 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e901b49a0 con 0x557820b34390 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e9625c640 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 0x557820f1aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e95a5b640 1 -- 172.21.15.49:0/3629349816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 msgr2=0x557820f1aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 0x557820f1aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.765+0000 7f8e95a5b640 1 -- 172.21.15.49:0/3629349816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 msgr2=0x557820f1b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.765+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 0x557820f1b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.765+0000 7f8e95a5b640 1 -- 172.21.15.49:0/3629349816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557820f83190 con 0x557820b2c1b0 2024-09-21T06:37:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.764+0000 7f8e9ea34740 10 client.0 _ll_register_callbacks cb 0x7f8e8c009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.765+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e8000fd20 con 0x557820b2c1b0 2024-09-21T06:37:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.765+0000 7f8e95a5b640 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f1a990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8e80010840 tx=0x7f8e8000ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f226c985d8631a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.765+0000 7f8e79ffb640 10 client.15714 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:26.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.765+0000 7f8e79ffb640 1 -- 172.21.15.49:0/3629349816 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8002f040 con 0x557820b2c1b0 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.765+0000 7f8e79ffb640 1 -- 172.21.15.49:0/3629349816 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8e80024b00 con 0x557820b2c1b0 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e79ffb640 1 -- 172.21.15.49:0/3629349816 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8e80024d40 con 0x557820b2c1b0 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e9ea34740 10 client.15714 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=25}) -- 0x557820f84210 con 0x557820b2c1b0 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e79ffb640 1 -- 172.21.15.49:0/3629349816 <== mon.0 v2:172.21.15.49:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8e80027040 con 0x557820b2c1b0 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e9ea34740 10 client.15714 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e9ea34740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e9ea34740 20 client.15714 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x557820ae8da0 0x557820f86990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e9ea34740 4 client.15714 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.766+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557820e708a0 con 0x557820ae8da0 2024-09-21T06:37:26.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.767+0000 7f8e9625c640 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x557820ae8da0 0x557820f86990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.767+0000 7f8e79ffb640 10 client.15714 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.767+0000 7f8e9625c640 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x557820ae8da0 0x557820f86990 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de305d9579e2021d server_cookie=972346373d23191e in_seq=0 out_seq=0 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e79ffb640 1 -- 172.21.15.49:0/3629349816 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557820e708a0 con 0x557820ae8da0 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e79ffb640 10 client.15714 handle_command_reply: tid=0 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 client.15714 shutdown 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 msgr2=0x557820f1a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f1a990 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8e80010840 tx=0x7f8e8000ff60 comp rx=0 tx=0).stop 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 shutdown_connections 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x557820ae8da0 0x557820f86990 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557820b55070 0x557820f1b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557820b34390 0x557820f1aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 --2- 172.21.15.49:0/3629349816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557820b2c1b0 0x557820f1a990 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 >> 172.21.15.49:0/3629349816 conn(0x557820b49460 msgr2=0x557820f135a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e79ffb640 0 client.15714 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:26.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 shutdown_connections 2024-09-21T06:37:26.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 1 -- 172.21.15.49:0/3629349816 wait complete. 2024-09-21T06:37:26.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.768+0000 7f8e9ea34740 20 client.15714 trim_cache size 0 max 16384 2024-09-21T06:37:26.773 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:37:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 -- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e7c0b6780 msgr2=0x7f8e7c0b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e7c0b6780 0x7f8e7c0b8c90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e880ce6a0 tx=0x7f8e88009460 comp rx=0 tx=0).stop 2024-09-21T06:37:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 -- 172.21.15.49:0/3288303823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e90104690 msgr2=0x7f8e90109f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e90104690 0x7f8e90109f00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8e8802f540 tx=0x7f8e880316f0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 -- 172.21.15.49:0/3288303823 shutdown_connections 2024-09-21T06:37:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e7c0b6780 0x7f8e7c0b8c90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e90104690 0x7f8e90109f00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e90102890 0x7f8e901099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 --2- 172.21.15.49:0/3288303823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e90101da0 0x7f8e90109480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 -- 172.21.15.49:0/3288303823 >> 172.21.15.49:0/3288303823 conn(0x7f8e90077c60 msgr2=0x7f8e9010c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.769+0000 7f8e984c0640 1 -- 172.21.15.49:0/3288303823 shutdown_connections 2024-09-21T06:37:26.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:26.770+0000 7f8e984c0640 1 -- 172.21.15.49:0/3288303823 wait complete. 2024-09-21T06:37:27.463 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:27 smithi049 ceph-mon[31177]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T06:37:27.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:27 smithi098 ceph-mon[34704]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T06:37:27.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:27 smithi079 ceph-mon[34346]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-21T06:37:28.500 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:37:28.501 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:37:28.793 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:29.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.321+0000 7fa24bcb1640 1 -- 172.21.15.49:0/3594887322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa24410de10 msgr2=0x7fa244110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.321+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/3594887322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa24410de10 0x7fa244110300 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009ca0 tx=0x7fa23c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.321+0000 7fa24bcb1640 1 -- 172.21.15.49:0/3594887322 shutdown_connections 2024-09-21T06:37:29.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.321+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/3594887322 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa24410de10 0x7fa244110300 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.321+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/3594887322 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244105300 0x7fa24410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.321+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/3594887322 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa2441049b0 0x7fa244104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.321+0000 7fa24bcb1640 1 -- 172.21.15.49:0/3594887322 >> 172.21.15.49:0/3594887322 conn(0x7fa244079730 msgr2=0x7fa244079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.321+0000 7fa24bcb1640 1 -- 172.21.15.49:0/3594887322 shutdown_connections 2024-09-21T06:37:29.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.321+0000 7fa24bcb1640 1 -- 172.21.15.49:0/3594887322 wait complete. 2024-09-21T06:37:29.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.322+0000 7fa24bcb1640 1 Processor -- start 2024-09-21T06:37:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.322+0000 7fa24bcb1640 1 -- start start 2024-09-21T06:37:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24bcb1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2441049b0 0x7fa24419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24bcb1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244105300 0x7fa24419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24bcb1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa24410de10 0x7fa24419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24bcb1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa244113a90 con 0x7fa2441049b0 2024-09-21T06:37:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24bcb1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa244113910 con 0x7fa244105300 2024-09-21T06:37:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24bcb1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa244113c10 con 0x7fa24410de10 2024-09-21T06:37:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa249a4d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2441049b0 0x7fa24419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa249a4d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2441049b0 0x7fa24419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52478/0 (socket says 172.21.15.49:52478) 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa249a4d640 1 -- 172.21.15.49:0/4091843060 learned_addr learned my addr 172.21.15.49:0/4091843060 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24924c640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244105300 0x7fa24419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24a24e640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa24410de10 0x7fa24419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24924c640 1 -- 172.21.15.49:0/4091843060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa24410de10 msgr2=0x7fa24419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24924c640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa24410de10 0x7fa24419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24924c640 1 -- 172.21.15.49:0/4091843060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2441049b0 msgr2=0x7fa24419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24924c640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2441049b0 0x7fa24419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.323+0000 7fa24924c640 1 -- 172.21.15.49:0/4091843060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2441a0440 con 0x7fa244105300 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.324+0000 7fa24924c640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244105300 0x7fa24419aaa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa234009c10 tx=0x7fa23400d6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.324+0000 7fa23affd640 1 -- 172.21.15.49:0/4091843060 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23400de80 con 0x7fa244105300 2024-09-21T06:37:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.324+0000 7fa23affd640 1 -- 172.21.15.49:0/4091843060 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2340198b0 con 0x7fa244105300 2024-09-21T06:37:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.324+0000 7fa23affd640 1 -- 172.21.15.49:0/4091843060 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23400f7b0 con 0x7fa244105300 2024-09-21T06:37:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.324+0000 7fa24bcb1640 1 -- 172.21.15.49:0/4091843060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2441a0730 con 0x7fa244105300 2024-09-21T06:37:29.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.324+0000 7fa24bcb1640 1 -- 172.21.15.49:0/4091843060 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2441025d0 con 0x7fa244105300 2024-09-21T06:37:29.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.327+0000 7fa252225740 1 Processor -- start 2024-09-21T06:37:29.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.327+0000 7fa252225740 1 -- start start 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa252225740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a36430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa252225740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a36970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa252225740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 0x563536a36eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa252225740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5635369ace60 con 0x563536666490 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa252225740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56353699c290 con 0x56353668f350 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa252225740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5635369a00a0 con 0x56353666e670 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa24a24e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a36430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa24a24e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a36430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:53302/0 (socket says 172.21.15.49:53302) 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa24a24e640 1 -- 172.21.15.49:0/905082671 learned_addr learned my addr 172.21.15.49:0/905082671 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa249a4d640 1 --2- 172.21.15.49:0/905082671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a36970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.328+0000 7fa23affd640 1 -- 172.21.15.49:0/4091843060 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fa234019400 con 0x7fa244105300 2024-09-21T06:37:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.329+0000 7fa24a24e640 1 -- 172.21.15.49:0/905082671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 msgr2=0x563536a36eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.329+0000 7fa24a24e640 1 --2- 172.21.15.49:0/905082671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 0x563536a36eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.329+0000 7fa24a24e640 1 -- 172.21.15.49:0/905082671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 msgr2=0x563536a36970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.329+0000 7fa23affd640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2300b6700 0x7fa2300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.329+0000 7fa24a24e640 1 --2- 172.21.15.49:0/905082671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a36970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.330+0000 7fa24a24e640 1 -- 172.21.15.49:0/905082671 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635366fa930 con 0x56353668f350 2024-09-21T06:37:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.330+0000 7fa23affd640 1 -- 172.21.15.49:0/4091843060 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa2340e7830 con 0x7fa244105300 2024-09-21T06:37:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.330+0000 7fa24924c640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2300b6700 0x7fa2300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.330+0000 7fa24a24e640 1 --2- 172.21.15.49:0/905082671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a36430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa23c02f3f0 tx=0x7fa23c02f420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff54e9e0423d5470 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.331+0000 7fa22ffff640 1 -- 172.21.15.49:0/905082671 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c031cf0 con 0x56353668f350 2024-09-21T06:37:29.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.331+0000 7fa22ffff640 1 -- 172.21.15.49:0/905082671 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa23c050070 con 0x56353668f350 2024-09-21T06:37:29.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.331+0000 7fa22ffff640 1 -- 172.21.15.49:0/905082671 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c003ce0 con 0x56353668f350 2024-09-21T06:37:29.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.331+0000 7fa24924c640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2300b6700 0x7fa2300b8c10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa2340ad360 tx=0x7fa234010670 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.332+0000 7fa252225740 1 -- 172.21.15.49:0/905082671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 msgr2=0x563536a36430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.332+0000 7fa252225740 1 --2- 172.21.15.49:0/905082671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a36430 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa23c02f3f0 tx=0x7fa23c02f420 comp rx=0 tx=0).stop 2024-09-21T06:37:29.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.332+0000 7fa252225740 1 -- 172.21.15.49:0/905082671 shutdown_connections 2024-09-21T06:37:29.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.332+0000 7fa252225740 1 --2- 172.21.15.49:0/905082671 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 0x563536a36eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.332+0000 7fa252225740 1 --2- 172.21.15.49:0/905082671 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a36970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.332+0000 7fa252225740 1 --2- 172.21.15.49:0/905082671 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a36430 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.332+0000 7fa252225740 1 -- 172.21.15.49:0/905082671 >> 172.21.15.49:0/905082671 conn(0x563536683740 msgr2=0x563536a34320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.332+0000 7fa252225740 1 -- 172.21.15.49:0/905082671 shutdown_connections 2024-09-21T06:37:29.335 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.332+0000 7fa252225740 1 -- 172.21.15.49:0/905082671 wait complete. 2024-09-21T06:37:29.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.333+0000 7fa252225740 1 -- start start 2024-09-21T06:37:29.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.333+0000 7fa252225740 1 Processor -- start 2024-09-21T06:37:29.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa252225740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a42020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa252225740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 0x563536a42560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.336 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa24a24e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a42020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa24a24e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a42020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52490/0 (socket says 172.21.15.49:52490) 2024-09-21T06:37:29.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa24a24e640 1 -- 172.21.15.49:0/3603569986 learned_addr learned my addr 172.21.15.49:0/3603569986 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:29.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa249a4d640 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 0x563536a42560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa252225740 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353668f350 0x563536a4dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5635367fd890 con 0x563536666490 2024-09-21T06:37:29.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563536936d40 con 0x56353666e670 2024-09-21T06:37:29.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.334+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563536a44bb0 con 0x56353668f350 2024-09-21T06:37:29.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa24a24e640 1 -- 172.21.15.49:0/3603569986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353668f350 msgr2=0x563536a4dea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:37:29.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa24a24e640 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353668f350 0x563536a4dea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa24a24e640 1 -- 172.21.15.49:0/3603569986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 msgr2=0x563536a42560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.338 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa24a24e640 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 0x563536a42560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa24a24e640 1 -- 172.21.15.49:0/3603569986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563536a4e430 con 0x563536666490 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa24a24e640 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a42020 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa23c004af0 tx=0x7fa23c040d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d0d7400284a190 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa22d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa22d7fa640 1 -- 172.21.15.49:0/3603569986 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c05b020 con 0x563536666490 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa252225740 10 client.0 _ll_register_callbacks cb 0x56353699ac80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa22d7fa640 1 -- 172.21.15.49:0/3603569986 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa23c0305c0 con 0x563536666490 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.335+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa23c050070 con 0x563536666490 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.336+0000 7fa22d7fa640 1 -- 172.21.15.49:0/3603569986 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa23c066050 con 0x563536666490 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.336+0000 7fa252225740 10 client.15726 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:29.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.336+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({fsmap=25}) -- 0x563536a50700 con 0x563536666490 2024-09-21T06:37:29.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.336+0000 7fa22d7fa640 1 -- 172.21.15.49:0/3603569986 <== mon.0 v2:172.21.15.49:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa23c0307c0 con 0x563536666490 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.336+0000 7fa252225740 10 client.15726 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.336+0000 7fa252225740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.336+0000 7fa252225740 20 client.15726 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.336+0000 7fa252225740 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56353664dcd0 0x563536a53b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.336+0000 7fa252225740 4 client.15726 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.337+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa23c050070 con 0x56353664dcd0 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.337+0000 7fa249a4d640 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56353664dcd0 0x563536a53b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.337+0000 7fa249a4d640 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56353664dcd0 0x563536a53b30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70269cc42d6357f0 server_cookie=5efb331affc4fed4 in_seq=0 out_seq=0 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.337+0000 7fa22d7fa640 10 client.15726 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa22d7fa640 1 -- 172.21.15.49:0/3603569986 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fa23c050070 con 0x56353664dcd0 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa22d7fa640 10 client.15726 handle_command_reply: tid=0 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa252225740 1 client.15726 shutdown 2024-09-21T06:37:29.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 msgr2=0x563536a42020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa252225740 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a42020 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa23c004af0 tx=0x7fa23c040d50 comp rx=0 tx=0).stop 2024-09-21T06:37:29.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 shutdown_connections 2024-09-21T06:37:29.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa252225740 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56353664dcd0 0x563536a53b30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa252225740 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353668f350 0x563536a4dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa252225740 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 0x563536a42560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa22d7fa640 0 client.15726 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:29.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa252225740 1 --2- 172.21.15.49:0/3603569986 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a42020 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.338+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 >> 172.21.15.49:0/3603569986 conn(0x563536683740 msgr2=0x563536a39610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.339+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 shutdown_connections 2024-09-21T06:37:29.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.339+0000 7fa252225740 1 -- 172.21.15.49:0/3603569986 wait complete. 2024-09-21T06:37:29.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.339+0000 7fa252225740 20 client.15726 trim_cache size 0 max 16384 2024-09-21T06:37:29.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.357+0000 7fa252225740 1 Processor -- start 2024-09-21T06:37:29.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.357+0000 7fa252225740 1 -- start start 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.357+0000 7fa252225740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a3b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.357+0000 7fa252225740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 0x563536a3ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa252225740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a3f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa252225740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa2441b85f0 con 0x563536666490 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa252225740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2440735e0 con 0x56353668f350 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa252225740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa244071450 con 0x56353666e670 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa249a4d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 0x563536a3ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa249a4d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 0x563536a3ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:59894/0 (socket says 172.21.15.49:59894) 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa249a4d640 1 -- 172.21.15.49:0/3011179468 learned_addr learned my addr 172.21.15.49:0/3011179468 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa24a24e640 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a3b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa24a24e640 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a3f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa249a4d640 1 -- 172.21.15.49:0/3011179468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 msgr2=0x563536a3f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa249a4d640 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a3f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa249a4d640 1 -- 172.21.15.49:0/3011179468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 msgr2=0x563536a3b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa249a4d640 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a3b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa249a4d640 1 -- 172.21.15.49:0/3011179468 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563536a3d6b0 con 0x56353666e670 2024-09-21T06:37:29.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.358+0000 7fa24a24e640 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a3b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:29.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.359+0000 7fa249a4d640 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 0x563536a3ba50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x563536a542a0 tx=0x7fa240011ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ae0f7de23df4183 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.359+0000 7fa22f7fe640 1 -- 172.21.15.49:0/3011179468 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240004030 con 0x56353666e670 2024-09-21T06:37:29.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.359+0000 7fa22f7fe640 1 -- 172.21.15.49:0/3011179468 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa240010d30 con 0x56353666e670 2024-09-21T06:37:29.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.359+0000 7fa22f7fe640 1 -- 172.21.15.49:0/3011179468 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa240003950 con 0x56353666e670 2024-09-21T06:37:29.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.360+0000 7fa252225740 1 -- 172.21.15.49:0/3011179468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 msgr2=0x563536a3ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.360+0000 7fa252225740 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 0x563536a3ba50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x563536a542a0 tx=0x7fa240011ba0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.360+0000 7fa252225740 1 -- 172.21.15.49:0/3011179468 shutdown_connections 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.360+0000 7fa252225740 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353668f350 0x563536a3f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.360+0000 7fa252225740 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353666e670 0x563536a3ba50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.360+0000 7fa252225740 1 --2- 172.21.15.49:0/3011179468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a3b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.360+0000 7fa252225740 1 -- 172.21.15.49:0/3011179468 >> 172.21.15.49:0/3011179468 conn(0x563536683740 msgr2=0x563536a42230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.361+0000 7fa252225740 1 -- 172.21.15.49:0/3011179468 shutdown_connections 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.361+0000 7fa252225740 1 -- 172.21.15.49:0/3011179468 wait complete. 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.361+0000 7fa252225740 1 -- start start 2024-09-21T06:37:29.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.361+0000 7fa252225740 1 Processor -- start 2024-09-21T06:37:29.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa252225740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a46e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa252225740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 0x563536a47340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa252225740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353668f350 0x563536a47880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa252225740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa244071aa0 con 0x563536666490 2024-09-21T06:37:29.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa252225740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa244072f10 con 0x56353666e670 2024-09-21T06:37:29.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa252225740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa244072170 con 0x56353668f350 2024-09-21T06:37:29.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa252225740 10 client.0 _ll_register_callbacks cb 0x7fa24000b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:29.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa24a24e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a46e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa24a24e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a46e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52510/0 (socket says 172.21.15.49:52510) 2024-09-21T06:37:29.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa24a24e640 1 -- 172.21.15.49:0/1704136095 learned_addr learned my addr 172.21.15.49:0/1704136095 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:29.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.362+0000 7fa249a4d640 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 0x563536a47340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.363+0000 7fa24a24e640 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353668f350 0x563536a47880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.363+0000 7fa24a24e640 1 -- 172.21.15.49:0/1704136095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353668f350 msgr2=0x563536a47880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.363+0000 7fa24a24e640 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353668f350 0x563536a47880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.363+0000 7fa24a24e640 1 -- 172.21.15.49:0/1704136095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 msgr2=0x563536a47340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.363+0000 7fa24a24e640 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 0x563536a47340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.363+0000 7fa24a24e640 1 -- 172.21.15.49:0/1704136095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563536a38cc0 con 0x563536666490 2024-09-21T06:37:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.363+0000 7fa24a24e640 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a46e00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa23c02a900 tx=0x7fa23c062040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a82d8c49ec0db63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.363+0000 7fa22d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.364+0000 7fa22d7fa640 1 -- 172.21.15.49:0/1704136095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c003b70 con 0x563536666490 2024-09-21T06:37:29.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.364+0000 7fa22d7fa640 1 -- 172.21.15.49:0/1704136095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa23c003d10 con 0x563536666490 2024-09-21T06:37:29.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.364+0000 7fa252225740 1 -- 172.21.15.49:0/1704136095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa240010d30 con 0x563536666490 2024-09-21T06:37:29.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.364+0000 7fa22d7fa640 1 -- 172.21.15.49:0/1704136095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa23c004030 con 0x563536666490 2024-09-21T06:37:29.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.364+0000 7fa252225740 10 client.15732 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:29.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.364+0000 7fa252225740 1 -- 172.21.15.49:0/1704136095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563536abf650 con 0x563536666490 2024-09-21T06:37:29.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.365+0000 7fa22d7fa640 1 -- 172.21.15.49:0/1704136095 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa240010d30 con 0x563536666490 2024-09-21T06:37:29.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.365+0000 7fa22d7fa640 1 -- 172.21.15.49:0/1704136095 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa23c02f4c0 con 0x563536666490 2024-09-21T06:37:29.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.365+0000 7fa252225740 10 client.15732 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:29.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.365+0000 7fa252225740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:29.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.365+0000 7fa252225740 20 client.15732 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:29.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.365+0000 7fa252225740 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563536623080 0x563536ac1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:29.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.365+0000 7fa252225740 4 client.15732 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:37:29.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.365+0000 7fa252225740 1 -- 172.21.15.49:0/1704136095 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5635369aedb0 con 0x563536623080 2024-09-21T06:37:29.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.366+0000 7fa249a4d640 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563536623080 0x563536ac1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:29.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.366+0000 7fa22d7fa640 10 client.15732 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:29.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.366+0000 7fa249a4d640 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563536623080 0x563536ac1da0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0f756fc99061362 server_cookie=fac581498e43cf1c in_seq=0 out_seq=0 2024-09-21T06:37:29.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.368+0000 7fa22d7fa640 1 -- 172.21.15.49:0/1704136095 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5635369aedb0 con 0x563536623080 2024-09-21T06:37:29.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.368+0000 7fa22d7fa640 10 client.15732 handle_command_reply: tid=0 2024-09-21T06:37:29.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.368+0000 7fa252225740 1 client.15732 shutdown 2024-09-21T06:37:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa252225740 1 -- 172.21.15.49:0/1704136095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 msgr2=0x563536a46e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa252225740 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a46e00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa23c02a900 tx=0x7fa23c062040 comp rx=0 tx=0).stop 2024-09-21T06:37:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa252225740 1 -- 172.21.15.49:0/1704136095 shutdown_connections 2024-09-21T06:37:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa252225740 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563536623080 0x563536ac1da0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa252225740 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56353668f350 0x563536a47880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa252225740 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56353666e670 0x563536a47340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa22d7fa640 0 client.15732 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa252225740 1 --2- 172.21.15.49:0/1704136095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563536666490 0x563536a46e00 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa252225740 1 -- 172.21.15.49:0/1704136095 >> 172.21.15.49:0/1704136095 conn(0x563536683740 msgr2=0x563536a42230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.369+0000 7fa252225740 1 -- 172.21.15.49:0/1704136095 shutdown_connections 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.370+0000 7fa252225740 1 -- 172.21.15.49:0/1704136095 wait complete. 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.370+0000 7fa252225740 20 client.15732 trim_cache size 0 max 16384 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "24aa6e4a-e86b-4660-a729-05218ad60cca", 2024-09-21T06:37:29.373 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:37:29.374 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:37:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.370+0000 7fa24bcb1640 1 -- 172.21.15.49:0/4091843060 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2300b6700 msgr2=0x7fa2300b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.370+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2300b6700 0x7fa2300b8c10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa2340ad360 tx=0x7fa234010670 comp rx=0 tx=0).stop 2024-09-21T06:37:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.370+0000 7fa24bcb1640 1 -- 172.21.15.49:0/4091843060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244105300 msgr2=0x7fa24419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.370+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244105300 0x7fa24419aaa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa234009c10 tx=0x7fa23400d6b0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.371+0000 7fa24bcb1640 1 -- 172.21.15.49:0/4091843060 shutdown_connections 2024-09-21T06:37:29.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.371+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa2300b6700 0x7fa2300b8c10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.371+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa24410de10 0x7fa24419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.371+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa244105300 0x7fa24419aaa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.371+0000 7fa24bcb1640 1 --2- 172.21.15.49:0/4091843060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa2441049b0 0x7fa24419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.371+0000 7fa24bcb1640 1 -- 172.21.15.49:0/4091843060 >> 172.21.15.49:0/4091843060 conn(0x7fa244079730 msgr2=0x7fa244100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.371+0000 7fa24bcb1640 1 -- 172.21.15.49:0/4091843060 shutdown_connections 2024-09-21T06:37:29.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:29.371+0000 7fa24bcb1640 1 -- 172.21.15.49:0/4091843060 wait complete. 2024-09-21T06:37:29.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:29 smithi049 ceph-mon[31177]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T06:37:29.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:29 smithi098 ceph-mon[34704]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T06:37:29.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:29 smithi079 ceph-mon[34346]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T06:37:29.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.995+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3708937992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3c107aa0 msgr2=0x7f2a3c107eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:29.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.995+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3708937992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3c107aa0 0x7f2a3c107eb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009860 tx=0x7f2a3002a340 comp rx=0 tx=0).stop 2024-09-21T06:37:29.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.996+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3708937992 shutdown_connections 2024-09-21T06:37:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.996+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3708937992 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a3c1083f0 0x7f2a3c10ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.996+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3708937992 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3c107aa0 0x7f2a3c107eb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.996+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3708937992 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c102170 0x7f2a3c102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.996+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3708937992 >> 172.21.15.49:0/3708937992 conn(0x7f2a3c079ea0 msgr2=0x7f2a3c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.996+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3708937992 shutdown_connections 2024-09-21T06:37:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.996+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3708937992 wait complete. 2024-09-21T06:37:29.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.997+0000 7f2a40b8b640 1 Processor -- start 2024-09-21T06:37:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.997+0000 7f2a40b8b640 1 -- start start 2024-09-21T06:37:30.000 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.997+0000 7f2a40b8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a3c102170 0x7f2a3c1982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.997+0000 7f2a40b8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3c107aa0 0x7f2a3c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.997+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a3c102170 0x7f2a3c1982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.997+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a3c102170 0x7f2a3c1982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52528/0 (socket says 172.21.15.49:52528) 2024-09-21T06:37:30.001 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.997+0000 7f2a3a59c640 1 -- 172.21.15.49:0/3010164326 learned_addr learned my addr 172.21.15.49:0/3010164326 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c1083f0 0x7f2a3c19db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c111830 con 0x7f2a3c102170 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1116b0 con 0x7f2a3c107aa0 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1119b0 con 0x7f2a3c1083f0 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3c107aa0 0x7f2a3c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c1083f0 0x7f2a3c19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3010164326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c1083f0 msgr2=0x7f2a3c19db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c1083f0 0x7f2a3c19db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3010164326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a3c102170 msgr2=0x7f2a3c1982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a3c102170 0x7f2a3c1982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3010164326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a3c19e200 con 0x7f2a3c107aa0 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.998+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3c107aa0 0x7f2a3c198870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009780 tx=0x7f2a30032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.002 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.999+0000 7f2a2b7fe640 1 -- 172.21.15.49:0/3010164326 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30037040 con 0x7f2a3c107aa0 2024-09-21T06:37:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.999+0000 7f2a2b7fe640 1 -- 172.21.15.49:0/3010164326 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a30030d50 con 0x7f2a3c107aa0 2024-09-21T06:37:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.999+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a3c19e490 con 0x7f2a3c107aa0 2024-09-21T06:37:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.999+0000 7f2a2b7fe640 1 -- 172.21.15.49:0/3010164326 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3003c9f0 con 0x7f2a3c107aa0 2024-09-21T06:37:30.003 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:29.999+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a3c19e8e0 con 0x7f2a3c107aa0 2024-09-21T06:37:30.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.002+0000 7f2a47bd8740 1 Processor -- start 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a47bd8740 1 -- start start 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a2b7fe640 1 -- 172.21.15.49:0/3010164326 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2a3003cb90 con 0x7f2a3c107aa0 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2feb8a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb8aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2feb8b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a47bd8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f2feaff6f0 con 0x55f2fe7c44d0 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a3ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2feb8a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a3ad9d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2feb8a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:53370/0 (socket says 172.21.15.49:53370) 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a3ad9d640 1 -- 172.21.15.49:0/1910446289 learned_addr learned my addr 172.21.15.49:0/1910446289 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/1910446289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2feb8b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a47bd8740 1 -- 172.21.15.49:0/1910446289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2feaeeb20 con 0x55f2fe7e51b0 2024-09-21T06:37:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a47bd8740 1 -- 172.21.15.49:0/1910446289 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f2feaf2930 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.003+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/1910446289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb8aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.004+0000 7f2a3ad9d640 1 -- 172.21.15.49:0/1910446289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7bc2f0 msgr2=0x55f2feb8aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.004+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/1910446289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb8aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.004+0000 7f2a3ad9d640 1 -- 172.21.15.49:0/1910446289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 msgr2=0x55f2feb8b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.004+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/1910446289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2feb8b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.004+0000 7f2a3ad9d640 1 -- 172.21.15.49:0/1910446289 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2feab4530 con 0x55f2fe7e51b0 2024-09-21T06:37:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.004+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/1910446289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2feb8a9b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400afb0 tx=0x7f2a3400a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed0685bada5b044 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.004+0000 7f2a28ff9640 1 -- 172.21.15.49:0/1910446289 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3401c070 con 0x55f2fe7e51b0 2024-09-21T06:37:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.004+0000 7f2a28ff9640 1 -- 172.21.15.49:0/1910446289 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a34003c30 con 0x55f2fe7e51b0 2024-09-21T06:37:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.004+0000 7f2a28ff9640 1 -- 172.21.15.49:0/1910446289 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a340178c0 con 0x55f2fe7e51b0 2024-09-21T06:37:30.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.005+0000 7f2a2b7fe640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2a240b6700 0x7f2a240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.005+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2a240b6700 0x7f2a240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.005+0000 7f2a47bd8740 1 -- 172.21.15.49:0/1910446289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 msgr2=0x55f2feb8a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.005+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/1910446289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2feb8a9b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400afb0 tx=0x7f2a3400a6d0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a47bd8740 1 -- 172.21.15.49:0/1910446289 shutdown_connections 2024-09-21T06:37:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/1910446289 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2feb8b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/1910446289 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb8aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/1910446289 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2feb8a9b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a47bd8740 1 -- 172.21.15.49:0/1910446289 >> 172.21.15.49:0/1910446289 conn(0x55f2fe7d9300 msgr2=0x55f2feb888a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a47bd8740 1 -- 172.21.15.49:0/1910446289 shutdown_connections 2024-09-21T06:37:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a47bd8740 1 -- 172.21.15.49:0/1910446289 wait complete. 2024-09-21T06:37:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2a240b6700 0x7f2a240b8c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55f2feb89630 tx=0x7f2a2c00b4a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a2b7fe640 1 -- 172.21.15.49:0/3010164326 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f2a3003b010 con 0x7f2a3c107aa0 2024-09-21T06:37:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.006+0000 7f2a47bd8740 1 -- start start 2024-09-21T06:37:30.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a47bd8740 1 Processor -- start 2024-09-21T06:37:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb9e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb9edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2febaac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a47bd8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f2fea26ab0 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a47bd8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f2fea94730 con 0x55f2fe7e51b0 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a47bd8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f2feba18f0 con 0x55f2fe7c44d0 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb9e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb9e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52546/0 (socket says 172.21.15.49:52546) 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a47bd8740 10 client.0 _ll_register_callbacks cb 0x55f2feae86b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a3a59c640 1 -- 172.21.15.49:0/2582389099 learned_addr learned my addr 172.21.15.49:0/2582389099 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2febaac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.007+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb9edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a3ad9d640 1 -- 172.21.15.49:0/2582389099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 msgr2=0x55f2feb9edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb9edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a3ad9d640 1 -- 172.21.15.49:0/2582389099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7bc2f0 msgr2=0x55f2feb9e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb9e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a3ad9d640 1 -- 172.21.15.49:0/2582389099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2fe850790 con 0x55f2fe7e51b0 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb9e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb9edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2febaac20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400a9e0 tx=0x7f2a340048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a61b65dc090dbd2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a21ffb640 1 -- 172.21.15.49:0/2582389099 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34028060 con 0x55f2fe7e51b0 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a21ffb640 1 -- 172.21.15.49:0/2582389099 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f2a34017700 con 0x55f2fe7e51b0 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a47bd8740 1 -- 172.21.15.49:0/2582389099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a34003c30 con 0x55f2fe7e51b0 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a21ffb640 1 -- 172.21.15.49:0/2582389099 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2a3401c070 con 0x55f2fe7e51b0 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a47bd8740 10 client.25406 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.008+0000 7f2a47bd8740 1 -- 172.21.15.49:0/2582389099 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f2fe8c9620 con 0x55f2fe7e51b0 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.009+0000 7f2a21ffb640 1 -- 172.21.15.49:0/2582389099 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a34003c30 con 0x55f2fe7e51b0 2024-09-21T06:37:30.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.009+0000 7f2a21ffb640 1 -- 172.21.15.49:0/2582389099 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2a34005250 con 0x55f2fe7e51b0 2024-09-21T06:37:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.009+0000 7f2a47bd8740 10 client.25406 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.009+0000 7f2a47bd8740 10 client.25406 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.009+0000 7f2a47bd8740 20 client.25406 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.009+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f2fe7a3d80 0x55f2febb0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.009+0000 7f2a47bd8740 4 client.25406 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.009+0000 7f2a47bd8740 1 -- 172.21.15.49:0/2582389099 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2feb01640 con 0x55f2fe7a3d80 2024-09-21T06:37:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.009+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f2fe7a3d80 0x55f2febb0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.010+0000 7f2a21ffb640 10 client.25406 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:30.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.010+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f2fe7a3d80 0x55f2febb0890 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=334012af1a15ab74 server_cookie=c97476eb5488000f in_seq=0 out_seq=0 2024-09-21T06:37:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a21ffb640 1 -- 172.21.15.49:0/2582389099 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2feb01640 con 0x55f2fe7a3d80 2024-09-21T06:37:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a21ffb640 10 client.25406 handle_command_reply: tid=0 2024-09-21T06:37:30.016 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a47bd8740 1 client.25406 shutdown 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a47bd8740 1 -- 172.21.15.49:0/2582389099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 msgr2=0x55f2febaac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2febaac20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400a9e0 tx=0x7f2a340048f0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a47bd8740 1 -- 172.21.15.49:0/2582389099 shutdown_connections 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f2fe7a3d80 0x55f2febb0890 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7e51b0 0x55f2febaac20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a21ffb640 0 client.25406 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb9edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.011+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/2582389099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7bc2f0 0x55f2feb9e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.012+0000 7f2a47bd8740 1 -- 172.21.15.49:0/2582389099 >> 172.21.15.49:0/2582389099 conn(0x55f2fe7d9300 msgr2=0x55f2feb8dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.012+0000 7f2a47bd8740 1 -- 172.21.15.49:0/2582389099 shutdown_connections 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.012+0000 7f2a47bd8740 1 -- 172.21.15.49:0/2582389099 wait complete. 2024-09-21T06:37:30.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.012+0000 7f2a47bd8740 20 client.25406 trim_cache size 0 max 16384 2024-09-21T06:37:30.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.042+0000 7f2a47bd8740 1 Processor -- start 2024-09-21T06:37:30.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.042+0000 7f2a47bd8740 1 -- start start 2024-09-21T06:37:30.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.042+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7a3d80 0x55f2feb9fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.042+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febaab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb87eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7a3d80 0x55f2feb9fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a39d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febaab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a39d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febaab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:53386/0 (socket says 172.21.15.49:53386) 2024-09-21T06:37:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3541639973 learned_addr learned my addr 172.21.15.49:0/3541639973 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3541639973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1afe40 con 0x55f2fe7a3d80 2024-09-21T06:37:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3541639973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1ad710 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3541639973 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1ab580 con 0x55f2fe7c44d0 2024-09-21T06:37:30.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb87eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3541639973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 msgr2=0x55f2feb87eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb87eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.043+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3541639973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7a3d80 msgr2=0x55f2feb9fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.044+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7a3d80 0x55f2feb9fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.044+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3541639973 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2feba0c80 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.044+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb87eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.044+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7a3d80 0x55f2feb9fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.044+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febaab90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a300328c0 tx=0x7f2a300ccb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d39d9f10d5998d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.044+0000 7f2a23fff640 1 -- 172.21.15.49:0/3541639973 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3004a030 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.044+0000 7f2a23fff640 1 -- 172.21.15.49:0/3541639973 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a3010f040 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.048 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.044+0000 7f2a23fff640 1 -- 172.21.15.49:0/3541639973 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3010e070 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.045+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3541639973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 msgr2=0x55f2febaab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.045+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febaab90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a300328c0 tx=0x7f2a300ccb40 comp rx=0 tx=0).stop 2024-09-21T06:37:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.045+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3541639973 shutdown_connections 2024-09-21T06:37:30.050 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.045+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7c44d0 0x55f2feb87eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.045+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febaab90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.045+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3541639973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7a3d80 0x55f2feb9fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.046+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3541639973 >> 172.21.15.49:0/3541639973 conn(0x55f2fe7d9300 msgr2=0x55f2feb8e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.046+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3541639973 shutdown_connections 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.046+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3541639973 wait complete. 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.046+0000 7f2a47bd8740 1 -- start start 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.046+0000 7f2a47bd8740 1 Processor -- start 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7a3d80 0x55f2febb0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febb12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a47bd8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2fec19000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a39d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febb12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a3ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2fec19000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a39d9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febb12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:53390/0 (socket says 172.21.15.49:53390) 2024-09-21T06:37:30.051 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a3ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2fec19000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52558/0 (socket says 172.21.15.49:52558) 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a3a59c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7a3d80 0x55f2febb0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3405512288 learned_addr learned my addr 172.21.15.49:0/3405512288 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1abbd0 con 0x55f2fe7c44d0 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1ad040 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3c1ac2a0 con 0x55f2fe7a3d80 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3405512288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7a3d80 msgr2=0x55f2febb0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7a3d80 0x55f2febb0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.047+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3405512288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 msgr2=0x55f2fec19000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2fec19000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a47bd8740 10 client.0 _ll_register_callbacks cb 0x7f2a3401a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a39d9b640 1 -- 172.21.15.49:0/3405512288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2fec19540 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7a3d80 0x55f2febb0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a3ad9d640 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2fec19000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a3010f040 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.052 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a39d9b640 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febb12b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a300045d0 tx=0x7f2a30030a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4561cdde9a9fab95 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:30.053 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a21ffb640 10 client.25412 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a21ffb640 1 -- 172.21.15.49:0/3405512288 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3004a050 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a21ffb640 1 -- 172.21.15.49:0/3405512288 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f2a3003a440 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a21ffb640 1 -- 172.21.15.49:0/3405512288 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2a3010e070 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a47bd8740 10 client.25412 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.048+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55f2fec1a5b0 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.049+0000 7f2a21ffb640 1 -- 172.21.15.49:0/3405512288 <== mon.2 v2:172.21.15.79:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2a3004d060 con 0x55f2fe7bc2f0 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.049+0000 7f2a47bd8740 10 client.25412 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.049+0000 7f2a47bd8740 10 client.25412 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.049+0000 7f2a47bd8740 20 client.25412 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.049+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f2fe7e51b0 0x55f2fec1ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.049+0000 7f2a47bd8740 4 client.25412 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:30.054 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.049+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f2feafd0f0 con 0x55f2fe7e51b0 2024-09-21T06:37:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.049+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f2fe7e51b0 0x55f2fec1ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.050+0000 7f2a21ffb640 10 client.25412 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:30.055 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.050+0000 7f2a3a59c640 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f2fe7e51b0 0x55f2fec1ca70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d139f2b1220bb8f server_cookie=616a7f2e27def977 in_seq=0 out_seq=0 2024-09-21T06:37:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a21ffb640 1 -- 172.21.15.49:0/3405512288 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f2feafd0f0 con 0x55f2fe7e51b0 2024-09-21T06:37:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a21ffb640 10 client.25412 handle_command_reply: tid=0 2024-09-21T06:37:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a47bd8740 1 client.25412 shutdown 2024-09-21T06:37:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 msgr2=0x55f2febb12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.058 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febb12b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2a300045d0 tx=0x7f2a30030a40 comp rx=0 tx=0).stop 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 shutdown_connections 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f2fe7e51b0 0x55f2fec1ca70 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f2fe7c44d0 0x55f2fec19000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f2fe7bc2f0 0x55f2febb12b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a47bd8740 1 --2- 172.21.15.49:0/3405512288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f2fe7a3d80 0x55f2febb0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 >> 172.21.15.49:0/3405512288 conn(0x55f2fe7d9300 msgr2=0x55f2feb8b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.055+0000 7f2a21ffb640 0 client.25412 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.056+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 shutdown_connections 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.056+0000 7f2a47bd8740 1 -- 172.21.15.49:0/3405512288 wait complete. 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.056+0000 7f2a47bd8740 20 client.25412 trim_cache size 0 max 16384 2024-09-21T06:37:30.059 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:37:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:37:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:37:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:37:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.056+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2a240b6700 msgr2=0x7f2a240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.060 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.056+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2a240b6700 0x7f2a240b8c10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55f2feb89630 tx=0x7f2a2c00b4a0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.056+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3c107aa0 msgr2=0x7f2a3c198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.056+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3c107aa0 0x7f2a3c198870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009780 tx=0x7f2a30032d50 comp rx=0 tx=0).stop 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.057+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 shutdown_connections 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.057+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2a240b6700 0x7f2a240b8c10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.057+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2a3c1083f0 0x7f2a3c19db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.057+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2a3c107aa0 0x7f2a3c198870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.057+0000 7f2a40b8b640 1 --2- 172.21.15.49:0/3010164326 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2a3c102170 0x7f2a3c1982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.057+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 >> 172.21.15.49:0/3010164326 conn(0x7f2a3c079ea0 msgr2=0x7f2a3c103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.057+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 shutdown_connections 2024-09-21T06:37:30.061 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:30.057+0000 7f2a40b8b640 1 -- 172.21.15.49:0/3010164326 wait complete. 2024-09-21T06:37:30.143 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:37:30.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:30 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:37:30.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:30 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:30.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:30 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:37:30.218 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:30 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:30.483 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:30.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:30 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:37:30.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:30 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:30.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:30 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:37:30.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:30 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:30.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:30 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:37:30.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:30 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:30.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:30 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:37:30.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:30 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:31.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:30.999+0000 7fb24f29c640 1 -- 172.21.15.49:0/2274827651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb248105330 msgr2=0x7fb24810d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:31.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:30.999+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2274827651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb248105330 0x7fb24810d880 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb238009900 tx=0x7fb23802a410 comp rx=0 tx=0).stop 2024-09-21T06:37:31.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:30.999+0000 7fb24f29c640 1 -- 172.21.15.49:0/2274827651 shutdown_connections 2024-09-21T06:37:31.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:30.999+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2274827651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb24810de40 0x7fb248110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:30.999+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2274827651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb248105330 0x7fb24810d880 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:30.999+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2274827651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb2481049e0 0x7fb248104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:30.999+0000 7fb24f29c640 1 -- 172.21.15.49:0/2274827651 >> 172.21.15.49:0/2274827651 conn(0x7fb248079700 msgr2=0x7fb248079b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:30.999+0000 7fb24f29c640 1 -- 172.21.15.49:0/2274827651 shutdown_connections 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:30.999+0000 7fb24f29c640 1 -- 172.21.15.49:0/2274827651 wait complete. 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24f29c640 1 Processor -- start 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24f29c640 1 -- start start 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24f29c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481049e0 0x7fb248102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24f29c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb248105330 0x7fb248102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24f29c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24810de40 0x7fb2481031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24f29c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb248113aa0 con 0x7fb24810de40 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24f29c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb248113920 con 0x7fb248105330 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24f29c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb248113c20 con 0x7fb2481049e0 2024-09-21T06:37:31.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24c837640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb248105330 0x7fb248102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24d038640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481049e0 0x7fb248102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24d038640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481049e0 0x7fb248102720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:59982/0 (socket says 172.21.15.49:59982) 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24c837640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb248105330 0x7fb248102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:53410/0 (socket says 172.21.15.49:53410) 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24d038640 1 -- 172.21.15.49:0/2372457771 learned_addr learned my addr 172.21.15.49:0/2372457771 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.000+0000 7fb24d839640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24810de40 0x7fb2481031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24c837640 1 -- 172.21.15.49:0/2372457771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481049e0 msgr2=0x7fb248102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24c837640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481049e0 0x7fb248102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24c837640 1 -- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24810de40 msgr2=0x7fb2481031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24c837640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24810de40 0x7fb2481031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24c837640 1 -- 172.21.15.49:0/2372457771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2481a87d0 con 0x7fb248105330 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24d839640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24810de40 0x7fb2481031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24c837640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb248105330 0x7fb248102c60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb23802a930 tx=0x7fb238031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb23e7fc640 1 -- 172.21.15.49:0/2372457771 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238035070 con 0x7fb248105330 2024-09-21T06:37:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb24f29c640 1 -- 172.21.15.49:0/2372457771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24819a220 con 0x7fb248105330 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.001+0000 7fb23e7fc640 1 -- 172.21.15.49:0/2372457771 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb238041e20 con 0x7fb248105330 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.002+0000 7fb23e7fc640 1 -- 172.21.15.49:0/2372457771 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238049630 con 0x7fb248105330 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.002+0000 7fb24f29c640 1 -- 172.21.15.49:0/2372457771 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb24819a750 con 0x7fb248105330 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb255810740 1 Processor -- start 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb255810740 1 -- start start 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb255810740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9bc070 0x55bf2dd63240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb255810740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9931b0 0x55bf2dd63780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb255810740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d99b390 0x55bf2dd63cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb255810740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bf2dcd9e50 con 0x55bf2d9931b0 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb255810740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf2dcc9280 con 0x55bf2d9bc070 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb255810740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bf2dccd090 con 0x55bf2d99b390 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb24d839640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9bc070 0x55bf2dd63240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb24d839640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9bc070 0x55bf2dd63240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:53420/0 (socket says 172.21.15.49:53420) 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb24d839640 1 -- 172.21.15.49:0/3275798731 learned_addr learned my addr 172.21.15.49:0/3275798731 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb24d038640 1 --2- 172.21.15.49:0/3275798731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9931b0 0x55bf2dd63780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.005+0000 7fb23e7fc640 1 -- 172.21.15.49:0/2372457771 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fb2380041c0 con 0x7fb248105330 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.006+0000 7fb24d839640 1 -- 172.21.15.49:0/3275798731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d99b390 msgr2=0x55bf2dd63cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.006+0000 7fb24d839640 1 --2- 172.21.15.49:0/3275798731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d99b390 0x55bf2dd63cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.006+0000 7fb24d839640 1 -- 172.21.15.49:0/3275798731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9931b0 msgr2=0x55bf2dd63780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.006+0000 7fb24d839640 1 --2- 172.21.15.49:0/3275798731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9931b0 0x55bf2dd63780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.006+0000 7fb24d839640 1 -- 172.21.15.49:0/3275798731 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2da27650 con 0x55bf2d9bc070 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.006+0000 7fb24d038640 1 --2- 172.21.15.49:0/3275798731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9931b0 0x55bf2dd63780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.006+0000 7fb24d839640 1 --2- 172.21.15.49:0/3275798731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9bc070 0x55bf2dd63240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb240011790 tx=0x7fb240011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4ee62b1a96c122d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.007+0000 7fb2337fe640 1 -- 172.21.15.49:0/3275798731 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb240003c30 con 0x55bf2d9bc070 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.007+0000 7fb2337fe640 1 -- 172.21.15.49:0/3275798731 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb24000fe50 con 0x55bf2d9bc070 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.007+0000 7fb2337fe640 1 -- 172.21.15.49:0/3275798731 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2400193e0 con 0x55bf2d9bc070 2024-09-21T06:37:31.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.007+0000 7fb23e7fc640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb2340b6700 0x7fb2340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.007+0000 7fb23e7fc640 1 -- 172.21.15.49:0/2372457771 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb2381102c0 con 0x7fb248105330 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb24d038640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb2340b6700 0x7fb2340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb255810740 1 -- 172.21.15.49:0/3275798731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9bc070 msgr2=0x55bf2dd63240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb255810740 1 --2- 172.21.15.49:0/3275798731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9bc070 0x55bf2dd63240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb240011790 tx=0x7fb240011c50 comp rx=0 tx=0).stop 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb255810740 1 -- 172.21.15.49:0/3275798731 shutdown_connections 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb255810740 1 --2- 172.21.15.49:0/3275798731 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d99b390 0x55bf2dd63cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb255810740 1 --2- 172.21.15.49:0/3275798731 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9931b0 0x55bf2dd63780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb255810740 1 --2- 172.21.15.49:0/3275798731 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9bc070 0x55bf2dd63240 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb255810740 1 -- 172.21.15.49:0/3275798731 >> 172.21.15.49:0/3275798731 conn(0x55bf2d9b0460 msgr2=0x55bf2dd61130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb24d038640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb2340b6700 0x7fb2340b8c10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55bf2dd61ec0 tx=0x7fb244005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb255810740 1 -- 172.21.15.49:0/3275798731 shutdown_connections 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.008+0000 7fb255810740 1 -- 172.21.15.49:0/3275798731 wait complete. 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.009+0000 7fb255810740 1 -- start start 2024-09-21T06:37:31.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.009+0000 7fb255810740 1 Processor -- start 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.009+0000 7fb255810740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 0x55bf2dd6e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.009+0000 7fb255810740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d99b390 0x55bf2dd6ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb255810740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd7ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb255810740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bf2db2a700 con 0x55bf2d9bc070 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb255810740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bf2dc64110 con 0x55bf2d99b390 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb255810740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bf2dd71a20 con 0x55bf2d9931b0 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb255810740 10 client.0 _ll_register_callbacks cb 0x55bf2dc7d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24d839640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd7ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24d839640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd7ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52584/0 (socket says 172.21.15.49:52584) 2024-09-21T06:37:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24d839640 1 -- 172.21.15.49:0/2730906513 learned_addr learned my addr 172.21.15.49:0/2730906513 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24d038640 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 0x55bf2dd6e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24c837640 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d99b390 0x55bf2dd6ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24c837640 1 -- 172.21.15.49:0/2730906513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 msgr2=0x55bf2dd6e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24c837640 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 0x55bf2dd6e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24c837640 1 -- 172.21.15.49:0/2730906513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 msgr2=0x55bf2dd7ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24c837640 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd7ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24c837640 1 -- 172.21.15.49:0/2730906513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf2dc91c40 con 0x55bf2d99b390 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb24c837640 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d99b390 0x55bf2dd6ef30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb23810d9f0 tx=0x7fb2380d2050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b794cf0336f56b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.010+0000 7fb230ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.011+0000 7fb230ff9640 1 -- 172.21.15.49:0/2730906513 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2380d5860 con 0x55bf2d99b390 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.011+0000 7fb230ff9640 1 -- 172.21.15.49:0/2730906513 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb2380df680 con 0x55bf2d99b390 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.011+0000 7fb255810740 1 -- 172.21.15.49:0/2730906513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb24000fe50 con 0x55bf2d99b390 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.011+0000 7fb230ff9640 1 -- 172.21.15.49:0/2730906513 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb2380044b0 con 0x55bf2d99b390 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.011+0000 7fb255810740 10 client.25424 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.011+0000 7fb255810740 1 -- 172.21.15.49:0/2730906513 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bf2dd7d7d0 con 0x55bf2d99b390 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.011+0000 7fb230ff9640 1 -- 172.21.15.49:0/2730906513 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2380d5c00 con 0x55bf2d99b390 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.012+0000 7fb230ff9640 1 -- 172.21.15.49:0/2730906513 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb2380c11a0 con 0x55bf2d99b390 2024-09-21T06:37:31.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.012+0000 7fb255810740 10 client.25424 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.012+0000 7fb255810740 10 client.25424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.012+0000 7fb255810740 20 client.25424 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.012+0000 7fb255810740 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bf2d97a9f0 0x55bf2dd80c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.012+0000 7fb255810740 4 client.25424 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.012+0000 7fb255810740 1 -- 172.21.15.49:0/2730906513 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb24000fe50 con 0x55bf2d97a9f0 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.012+0000 7fb24d038640 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bf2d97a9f0 0x55bf2dd80c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.013+0000 7fb230ff9640 10 client.25424 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.013+0000 7fb24d038640 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bf2d97a9f0 0x55bf2dd80c40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74bce654687991ea server_cookie=472f2c1eb737abee in_seq=0 out_seq=0 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.013+0000 7fb230ff9640 1 -- 172.21.15.49:0/2730906513 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fb24000fe50 con 0x55bf2d97a9f0 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.013+0000 7fb230ff9640 10 client.25424 handle_command_reply: tid=0 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.013+0000 7fb255810740 1 client.25424 shutdown 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 -- 172.21.15.49:0/2730906513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d99b390 msgr2=0x55bf2dd6ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d99b390 0x55bf2dd6ef30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb23810d9f0 tx=0x7fb2380d2050 comp rx=0 tx=0).stop 2024-09-21T06:37:31.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 -- 172.21.15.49:0/2730906513 shutdown_connections 2024-09-21T06:37:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bf2d97a9f0 0x55bf2dd80c40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb230ff9640 0 client.25424 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd7ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d99b390 0x55bf2dd6ef30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 --2- 172.21.15.49:0/2730906513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 0x55bf2dd6e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 -- 172.21.15.49:0/2730906513 >> 172.21.15.49:0/2730906513 conn(0x55bf2d9b0460 msgr2=0x55bf2dd66420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 -- 172.21.15.49:0/2730906513 shutdown_connections 2024-09-21T06:37:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.014+0000 7fb255810740 1 -- 172.21.15.49:0/2730906513 wait complete. 2024-09-21T06:37:31.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.015+0000 7fb255810740 20 client.25424 trim_cache size 0 max 16384 2024-09-21T06:37:31.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.050+0000 7fb255810740 1 Processor -- start 2024-09-21T06:37:31.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.050+0000 7fb255810740 1 -- start start 2024-09-21T06:37:31.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.050+0000 7fb255810740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9931b0 0x55bf2dd7ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.050+0000 7fb255810740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd66340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.050+0000 7fb255810740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d94fda0 0x55bf2dd66880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.050+0000 7fb255810740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb248074260 con 0x55bf2d9bc070 2024-09-21T06:37:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.050+0000 7fb255810740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb248071b30 con 0x55bf2d9931b0 2024-09-21T06:37:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.050+0000 7fb255810740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb24806f9a0 con 0x55bf2d94fda0 2024-09-21T06:37:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.050+0000 7fb24c837640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd66340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24c837640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd66340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52588/0 (socket says 172.21.15.49:52588) 2024-09-21T06:37:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24c837640 1 -- 172.21.15.49:0/2804183868 learned_addr learned my addr 172.21.15.49:0/2804183868 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24d839640 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d94fda0 0x55bf2dd66880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24d038640 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9931b0 0x55bf2dd7ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24c837640 1 -- 172.21.15.49:0/2804183868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d94fda0 msgr2=0x55bf2dd66880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24c837640 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d94fda0 0x55bf2dd66880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24c837640 1 -- 172.21.15.49:0/2804183868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9931b0 msgr2=0x55bf2dd7ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24c837640 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9931b0 0x55bf2dd7ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24c837640 1 -- 172.21.15.49:0/2804183868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2dd61a20 con 0x55bf2d9bc070 2024-09-21T06:37:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24d839640 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d94fda0 0x55bf2dd66880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.051+0000 7fb24c837640 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd66340 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb2380bf040 tx=0x7fb2380d20c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ed82e27ea487da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.052+0000 7fb232ffd640 1 -- 172.21.15.49:0/2804183868 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2380d5860 con 0x55bf2d9bc070 2024-09-21T06:37:31.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.052+0000 7fb232ffd640 1 -- 172.21.15.49:0/2804183868 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2380d67f0 con 0x55bf2d9bc070 2024-09-21T06:37:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb232ffd640 1 -- 172.21.15.49:0/2804183868 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2380df680 con 0x55bf2d9bc070 2024-09-21T06:37:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb255810740 1 -- 172.21.15.49:0/2804183868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 msgr2=0x55bf2dd66340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:31.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb255810740 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd66340 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb2380bf040 tx=0x7fb2380d20c0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb255810740 1 -- 172.21.15.49:0/2804183868 shutdown_connections 2024-09-21T06:37:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb255810740 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d94fda0 0x55bf2dd66880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb255810740 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d9bc070 0x55bf2dd66340 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb255810740 1 --2- 172.21.15.49:0/2804183868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2d9931b0 0x55bf2dd7ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb255810740 1 -- 172.21.15.49:0/2804183868 >> 172.21.15.49:0/2804183868 conn(0x55bf2d9b0460 msgr2=0x55bf2dd6d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb255810740 1 -- 172.21.15.49:0/2804183868 shutdown_connections 2024-09-21T06:37:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.053+0000 7fb255810740 1 -- 172.21.15.49:0/2804183868 wait complete. 2024-09-21T06:37:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.054+0000 7fb255810740 1 -- start start 2024-09-21T06:37:31.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.054+0000 7fb255810740 1 Processor -- start 2024-09-21T06:37:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.054+0000 7fb255810740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d94fda0 0x55bf2dd737a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb255810740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 0x55bf2dd73d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb255810740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2dde46d0 0x55bf2dde4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb255810740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb24806fff0 con 0x55bf2d94fda0 2024-09-21T06:37:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d038640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d94fda0 0x55bf2dd737a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb255810740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb248071460 con 0x55bf2dde46d0 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d038640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d94fda0 0x55bf2dd737a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52600/0 (socket says 172.21.15.49:52600) 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d038640 1 -- 172.21.15.49:0/3736996706 learned_addr learned my addr 172.21.15.49:0/3736996706 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb255810740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb2480706c0 con 0x55bf2d9931b0 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb255810740 10 client.0 _ll_register_callbacks cb 0x7fb238005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24c837640 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 0x55bf2dd73d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d038640 1 -- 172.21.15.49:0/3736996706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 msgr2=0x55bf2dd73d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d038640 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 0x55bf2dd73d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d038640 1 -- 172.21.15.49:0/3736996706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2dde46d0 msgr2=0x55bf2dde4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d839640 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2dde46d0 0x55bf2dde4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d038640 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2dde46d0 0x55bf2dde4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d038640 1 -- 172.21.15.49:0/3736996706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf2dde5150 con 0x55bf2d94fda0 2024-09-21T06:37:31.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.055+0000 7fb24d839640 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2dde46d0 0x55bf2dde4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.056+0000 7fb24d038640 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d94fda0 0x55bf2dd737a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb2440041e0 tx=0x7fb2440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c986723a0d64fed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.056+0000 7fb230ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.056+0000 7fb230ff9640 1 -- 172.21.15.49:0/3736996706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244036060 con 0x55bf2d94fda0 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.056+0000 7fb230ff9640 1 -- 172.21.15.49:0/3736996706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb244003b80 con 0x55bf2d94fda0 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.056+0000 7fb255810740 1 -- 172.21.15.49:0/3736996706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bf2dd61690 con 0x55bf2d94fda0 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.056+0000 7fb230ff9640 1 -- 172.21.15.49:0/3736996706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb244003d80 con 0x55bf2d94fda0 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.056+0000 7fb255810740 10 client.15768 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.056+0000 7fb255810740 1 -- 172.21.15.49:0/3736996706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bf2ddec590 con 0x55bf2d94fda0 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.057+0000 7fb230ff9640 1 -- 172.21.15.49:0/3736996706 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bf2dd61690 con 0x55bf2d94fda0 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.057+0000 7fb230ff9640 1 -- 172.21.15.49:0/3736996706 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb24401e460 con 0x55bf2d94fda0 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.057+0000 7fb255810740 10 client.15768 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.057+0000 7fb255810740 10 client.15768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.057+0000 7fb255810740 20 client.15768 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:31.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.057+0000 7fb255810740 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bf2ddecd40 0x55bf2ddef160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:31.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.057+0000 7fb255810740 4 client.15768 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:37:31.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.057+0000 7fb255810740 1 -- 172.21.15.49:0/3736996706 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bf2dcdbda0 con 0x55bf2ddecd40 2024-09-21T06:37:31.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.057+0000 7fb24c837640 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bf2ddecd40 0x55bf2ddef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:31.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.058+0000 7fb24c837640 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bf2ddecd40 0x55bf2ddef160 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63c7d2d718a8a5be server_cookie=f9a7442ec24194ce in_seq=0 out_seq=0 2024-09-21T06:37:31.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.058+0000 7fb230ff9640 10 client.15768 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:31.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.058+0000 7fb230ff9640 1 -- 172.21.15.49:0/3736996706 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55bf2dcdbda0 con 0x55bf2ddecd40 2024-09-21T06:37:31.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.058+0000 7fb230ff9640 10 client.15768 handle_command_reply: tid=0 2024-09-21T06:37:31.062 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.058+0000 7fb255810740 1 client.15768 shutdown 2024-09-21T06:37:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.058+0000 7fb255810740 1 -- 172.21.15.49:0/3736996706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d94fda0 msgr2=0x55bf2dd737a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.058+0000 7fb255810740 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d94fda0 0x55bf2dd737a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb2440041e0 tx=0x7fb2440046c0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.058+0000 7fb255810740 1 -- 172.21.15.49:0/3736996706 shutdown_connections 2024-09-21T06:37:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.058+0000 7fb255810740 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bf2ddecd40 0x55bf2ddef160 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.059+0000 7fb255810740 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bf2dde46d0 0x55bf2dde4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.059+0000 7fb230ff9640 0 client.15768 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.059+0000 7fb255810740 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bf2d9931b0 0x55bf2dd73d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.059+0000 7fb255810740 1 --2- 172.21.15.49:0/3736996706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bf2d94fda0 0x55bf2dd737a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.059+0000 7fb255810740 1 -- 172.21.15.49:0/3736996706 >> 172.21.15.49:0/3736996706 conn(0x55bf2d9b0460 msgr2=0x55bf2dd641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.059+0000 7fb255810740 1 -- 172.21.15.49:0/3736996706 shutdown_connections 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.059+0000 7fb255810740 1 -- 172.21.15.49:0/3736996706 wait complete. 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.059+0000 7fb255810740 20 client.15768 trim_cache size 0 max 16384 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:37:31.064 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "24aa6e4a-e86b-4660-a729-05218ad60cca", 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:37:31.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:37:31.066 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:37:31.067 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:37:31.067 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:37:31.067 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:37:31.067 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 -- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb2340b6700 msgr2=0x7fb2340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb2340b6700 0x7fb2340b8c10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55bf2dd61ec0 tx=0x7fb244005f90 comp rx=0 tx=0).stop 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 -- 172.21.15.49:0/2372457771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb248105330 msgr2=0x7fb248102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb248105330 0x7fb248102c60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb23802a930 tx=0x7fb238031a20 comp rx=0 tx=0).stop 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 -- 172.21.15.49:0/2372457771 shutdown_connections 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb2340b6700 0x7fb2340b8c10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb24810de40 0x7fb2481031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb248105330 0x7fb248102c60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 --2- 172.21.15.49:0/2372457771 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2481049e0 0x7fb248102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 -- 172.21.15.49:0/2372457771 >> 172.21.15.49:0/2372457771 conn(0x7fb248079700 msgr2=0x7fb2481079d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 -- 172.21.15.49:0/2372457771 shutdown_connections 2024-09-21T06:37:31.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:37:31.060+0000 7fb24f29c640 1 -- 172.21.15.49:0/2372457771 wait complete. 2024-09-21T06:37:31.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:31 smithi049 ceph-mon[31177]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T06:37:31.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:31 smithi098 ceph-mon[34704]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T06:37:31.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:31 smithi079 ceph-mon[34346]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 853 B/s wr, 7 op/s 2024-09-21T06:37:31.822 INFO:tasks.cephfs.filesystem:scrub status for tag:24aa6e4a-e86b-4660-a729-05218ad60cca - {'path': '/', 'tag': '24aa6e4a-e86b-4660-a729-05218ad60cca', 'options': 'recursive,force'} 2024-09-21T06:37:33.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:33 smithi049 ceph-mon[31177]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-21T06:37:33.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:33 smithi098 ceph-mon[34704]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-21T06:37:33.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:33 smithi079 ceph-mon[34346]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1023 B/s wr, 9 op/s 2024-09-21T06:37:34.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:34 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:37:34.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:34 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:37:34.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:34 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:37:35.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:35 smithi098 ceph-mon[34704]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:37:35.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:35 smithi079 ceph-mon[34346]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:37:35.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:35 smithi049 ceph-mon[31177]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:37:37.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:37 smithi049 ceph-mon[31177]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:37:37.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:37 smithi098 ceph-mon[34704]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:37:37.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:37 smithi079 ceph-mon[34346]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:37:39.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:39 smithi098 ceph-mon[34704]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T06:37:39.570 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:39 smithi079 ceph-mon[34346]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T06:37:39.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:39 smithi049 ceph-mon[31177]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T06:37:41.342 INFO:tasks.workunit.client.0.smithi049.stderr:Updating files: 92% (11778/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T06:37:41.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:41 smithi098 ceph-mon[34704]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:37:41.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:41 smithi079 ceph-mon[34346]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:37:41.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:41 smithi049 ceph-mon[31177]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-21T06:37:41.948 INFO:tasks.workunit.client.0.smithi049.stderr: git switch -c 2024-09-21T06:37:41.949 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-21T06:37:41.949 INFO:tasks.workunit.client.0.smithi049.stderr:Or undo this operation with: 2024-09-21T06:37:41.949 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-21T06:37:41.949 INFO:tasks.workunit.client.0.smithi049.stderr: git switch - 2024-09-21T06:37:41.949 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-21T06:37:41.949 INFO:tasks.workunit.client.0.smithi049.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T06:37:41.949 INFO:tasks.workunit.client.0.smithi049.stderr: 2024-09-21T06:37:41.949 INFO:tasks.workunit.client.0.smithi049.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:37:41.953 DEBUG:teuthology.orchestra.run.smithi049:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T06:37:41.980 INFO:tasks.workunit.client.0.smithi049.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T06:37:41.983 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:37:41.983 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T06:37:42.692 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T06:37:42.764 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T06:37:42.807 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:37:42.809 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:37:42.809 INFO:tasks.workunit.client.0.smithi049.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T06:37:42.849 INFO:tasks.workunit.client.0.smithi049.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:37:42.853 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:37:42.853 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T06:37:42.910 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-09-21T06:37:42.911 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-09-21T06:37:42.912 DEBUG:teuthology.orchestra.run.smithi049:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-21T06:37:42.973 INFO:tasks.workunit.client.0.smithi049.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-09-21T06:37:42.973 INFO:tasks.workunit.client.0.smithi049.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-09-21T06:37:42.973 INFO:tasks.workunit.client.0.smithi049.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-09-21T06:37:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.161+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/4051307874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108c50 msgr2=0x7f8a3810f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.161+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/4051307874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108c50 0x7f8a3810f480 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009ca0 tx=0x7f8a3002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.162+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/4051307874 shutdown_connections 2024-09-21T06:37:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.162+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/4051307874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108c50 0x7f8a3810f480 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.162+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/4051307874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a38108300 0x7f8a38108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.162+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/4051307874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a381029d0 0x7f8a38102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.162+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/4051307874 >> 172.21.15.49:0/4051307874 conn(0x7f8a3807a710 msgr2=0x7f8a3807ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.162+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/4051307874 shutdown_connections 2024-09-21T06:37:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.162+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/4051307874 wait complete. 2024-09-21T06:37:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.162+0000 7f8a3cdc3640 1 Processor -- start 2024-09-21T06:37:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.162+0000 7f8a3cdc3640 1 -- start start 2024-09-21T06:37:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a3cdc3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381029d0 0x7f8a3819b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a3cdc3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108300 0x7f8a3819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a3cdc3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a38108c50 0x7f8a3819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a3cdc3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38112910 con 0x7f8a38108300 2024-09-21T06:37:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a3cdc3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38112790 con 0x7f8a38108c50 2024-09-21T06:37:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a3cdc3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a38112a90 con 0x7f8a381029d0 2024-09-21T06:37:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a35d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108300 0x7f8a3819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a35d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108300 0x7f8a3819b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35344/0 (socket says 172.21.15.49:35344) 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a35d9b640 1 -- 172.21.15.49:0/2958762629 learned_addr learned my addr 172.21.15.49:0/2958762629 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a3659c640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381029d0 0x7f8a3819b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a38108c50 0x7f8a3819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a35d9b640 1 -- 172.21.15.49:0/2958762629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381029d0 msgr2=0x7f8a3819b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381029d0 0x7f8a3819b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a35d9b640 1 -- 172.21.15.49:0/2958762629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a38108c50 msgr2=0x7f8a3819bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a38108c50 0x7f8a3819bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a35d9b640 1 -- 172.21.15.49:0/2958762629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a381a6530 con 0x7f8a38108300 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.163+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108300 0x7f8a3819b760 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000d740 tx=0x7f8a2000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.164+0000 7f8a2f7fe640 1 -- 172.21.15.49:0/2958762629 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20017070 con 0x7f8a38108300 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.164+0000 7f8a2f7fe640 1 -- 172.21.15.49:0/2958762629 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a2000de50 con 0x7f8a38108300 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.164+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/2958762629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a381a6820 con 0x7f8a38108300 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.164+0000 7f8a2f7fe640 1 -- 172.21.15.49:0/2958762629 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20004ce0 con 0x7f8a38108300 2024-09-21T06:37:43.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.164+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/2958762629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a381a6d70 con 0x7f8a38108300 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.166+0000 7f8a43e0b740 1 Processor -- start 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a43e0b740 1 -- start start 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a2f7fe640 1 -- 172.21.15.49:0/2958762629 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8a20004e80 con 0x7f8a38108300 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ee19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 0x55fa86ee1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ee2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fa86e566f0 con 0x55fa86b1b4d0 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fa86e45b20 con 0x55fa86b3c1b0 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fa86e49930 con 0x55fa86b132f0 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a35d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ee2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a35d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ee2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35350/0 (socket says 172.21.15.49:35350) 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a35d9b640 1 -- 172.21.15.49:0/950586766 learned_addr learned my addr 172.21.15.49:0/950586766 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/950586766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ee19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a3659c640 1 --2- 172.21.15.49:0/950586766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 0x55fa86ee1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a35d9b640 1 -- 172.21.15.49:0/950586766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 msgr2=0x55fa86ee1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/950586766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 0x55fa86ee1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a35d9b640 1 -- 172.21.15.49:0/950586766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 msgr2=0x55fa86ee19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/950586766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ee19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.167+0000 7f8a35d9b640 1 -- 172.21.15.49:0/950586766 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa86e0b530 con 0x55fa86b1b4d0 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.168+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/950586766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ee2430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8a200e4780 tx=0x7f8a200ef910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6656e4fe0e05a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.168+0000 7f8a2f7fe640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a240b6700 0x7f8a240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.168+0000 7f8a2cff9640 1 -- 172.21.15.49:0/950586766 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a200fa070 con 0x55fa86b1b4d0 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.168+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a240b6700 0x7f8a240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.168+0000 7f8a2cff9640 1 -- 172.21.15.49:0/950586766 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a200aca20 con 0x55fa86b1b4d0 2024-09-21T06:37:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.168+0000 7f8a2cff9640 1 -- 172.21.15.49:0/950586766 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a20099750 con 0x55fa86b1b4d0 2024-09-21T06:37:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.168+0000 7f8a2f7fe640 1 -- 172.21.15.49:0/2958762629 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a200e70e0 con 0x7f8a38108300 2024-09-21T06:37:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 -- 172.21.15.49:0/950586766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 msgr2=0x55fa86ee2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a240b6700 0x7f8a240b8c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005e30 tx=0x7f8a30005c30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/950586766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ee2430 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8a200e4780 tx=0x7f8a200ef910 comp rx=0 tx=0).stop 2024-09-21T06:37:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 -- 172.21.15.49:0/950586766 shutdown_connections 2024-09-21T06:37:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/950586766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ee2430 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/950586766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 0x55fa86ee1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/950586766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ee19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 -- 172.21.15.49:0/950586766 >> 172.21.15.49:0/950586766 conn(0x55fa86b30300 msgr2=0x55fa86edf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 -- 172.21.15.49:0/950586766 shutdown_connections 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 -- 172.21.15.49:0/950586766 wait complete. 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.169+0000 7f8a43e0b740 1 -- start start 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a43e0b740 1 Processor -- start 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b132f0 0x55fa86eed020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 0x55fa86eed560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ef9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fa86d7dab0 con 0x55fa86b132f0 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fa86deb730 con 0x55fa86b3c1b0 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fa86ef0130 con 0x55fa86b1b4d0 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a43e0b740 10 client.0 _ll_register_callbacks cb 0x55fa86e3f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a3659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b132f0 0x55fa86eed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a3659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b132f0 0x55fa86eed020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35362/0 (socket says 172.21.15.49:35362) 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a3659c640 1 -- 172.21.15.49:0/2527274030 learned_addr learned my addr 172.21.15.49:0/2527274030 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 0x55fa86eed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ef9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a3659c640 1 -- 172.21.15.49:0/2527274030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 msgr2=0x55fa86eed560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a3659c640 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 0x55fa86eed560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a3659c640 1 -- 172.21.15.49:0/2527274030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 msgr2=0x55fa86ef9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a3659c640 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ef9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a3659c640 1 -- 172.21.15.49:0/2527274030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa86ba7790 con 0x55fa86b132f0 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.170+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ef9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a3659c640 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b132f0 0x55fa86eed020 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800be90 tx=0x7f8a28012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30c90caafbd457a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a1dffb640 1 -- 172.21.15.49:0/2527274030 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a28005020 con 0x55fa86b132f0 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a1dffb640 1 -- 172.21.15.49:0/2527274030 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a280051c0 con 0x55fa86b132f0 2024-09-21T06:37:43.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2527274030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a200aca20 con 0x55fa86b132f0 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a1dffb640 1 -- 172.21.15.49:0/2527274030 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a28005400 con 0x55fa86b132f0 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a43e0b740 10 client.15780 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2527274030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fa86c20620 con 0x55fa86b132f0 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a1dffb640 1 -- 172.21.15.49:0/2527274030 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a200aca20 con 0x55fa86b132f0 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a1dffb640 1 -- 172.21.15.49:0/2527274030 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a28019070 con 0x55fa86b132f0 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a43e0b740 10 client.15780 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a43e0b740 10 client.15780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a43e0b740 20 client.15780 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fa86afad80 0x55fa86eff270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a43e0b740 4 client.15780 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.171+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2527274030 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fa86e58640 con 0x55fa86afad80 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.172+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fa86afad80 0x55fa86eff270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.172+0000 7f8a1dffb640 10 client.15780 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:43.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.172+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fa86afad80 0x55fa86eff270 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40497172aa49ab23 server_cookie=6ec747e97f68ffdf in_seq=0 out_seq=0 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a1dffb640 1 -- 172.21.15.49:0/2527274030 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fa86e58640 con 0x55fa86afad80 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a1dffb640 10 client.15780 handle_command_reply: tid=0 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 client.15780 shutdown 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2527274030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b132f0 msgr2=0x55fa86eed020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b132f0 0x55fa86eed020 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800be90 tx=0x7f8a28012820 comp rx=0 tx=0).stop 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2527274030 shutdown_connections 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fa86afad80 0x55fa86eff270 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ef9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 0x55fa86eed560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2527274030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b132f0 0x55fa86eed020 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a1dffb640 0 client.15780 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2527274030 >> 172.21.15.49:0/2527274030 conn(0x55fa86b30300 msgr2=0x55fa86ee29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.173+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2527274030 shutdown_connections 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.174+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2527274030 wait complete. 2024-09-21T06:37:43.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.174+0000 7f8a43e0b740 20 client.15780 trim_cache size 0 max 16384 2024-09-21T06:37:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.188+0000 7f8a43e0b740 1 Processor -- start 2024-09-21T06:37:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.188+0000 7f8a43e0b740 1 -- start start 2024-09-21T06:37:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.188+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b132f0 0x55fa86ede5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.188+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.188+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b3c1b0 0x55fa86eea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.188+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a381b2160 con 0x55fa86b3c1b0 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.188+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a381afa30 con 0x55fa86b132f0 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.188+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a381ad8a0 con 0x55fa86b1b4d0 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a36d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b3c1b0 0x55fa86eea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a36d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b3c1b0 0x55fa86eea1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35372/0 (socket says 172.21.15.49:35372) 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a36d9d640 1 -- 172.21.15.49:0/2776045498 learned_addr learned my addr 172.21.15.49:0/2776045498 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a3659c640 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b132f0 0x55fa86ede5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a36d9d640 1 -- 172.21.15.49:0/2776045498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 msgr2=0x55fa86ef9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a36d9d640 1 -- 172.21.15.49:0/2776045498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b132f0 msgr2=0x55fa86ede5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b132f0 0x55fa86ede5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a36d9d640 1 -- 172.21.15.49:0/2776045498 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa86efa1a0 con 0x55fa86b3c1b0 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b3c1b0 0x55fa86eea1f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8a30032e20 tx=0x7f8a30041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa43875465c92ec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:43.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a1ffff640 1 -- 172.21.15.49:0/2776045498 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30003970 con 0x55fa86b3c1b0 2024-09-21T06:37:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a1ffff640 1 -- 172.21.15.49:0/2776045498 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a30036040 con 0x55fa86b3c1b0 2024-09-21T06:37:43.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.189+0000 7f8a1ffff640 1 -- 172.21.15.49:0/2776045498 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004760 con 0x55fa86b3c1b0 2024-09-21T06:37:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2776045498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b3c1b0 msgr2=0x55fa86eea1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b3c1b0 0x55fa86eea1f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8a30032e20 tx=0x7f8a30041000 comp rx=0 tx=0).stop 2024-09-21T06:37:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2776045498 shutdown_connections 2024-09-21T06:37:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b3c1b0 0x55fa86eea1f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.196 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/2776045498 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b132f0 0x55fa86ede5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2776045498 >> 172.21.15.49:0/2776045498 conn(0x55fa86b30300 msgr2=0x55fa86eddea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2776045498 shutdown_connections 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 -- 172.21.15.49:0/2776045498 wait complete. 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.190+0000 7f8a43e0b740 1 -- start start 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a43e0b740 1 Processor -- start 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 0x55fa86ef58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a43e0b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ef32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a381adef0 con 0x55fa86b1b4d0 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a381af360 con 0x55fa86b3c1b0 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a43e0b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a381ae5c0 con 0x55fa86b132f0 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a43e0b740 10 client.0 _ll_register_callbacks cb 0x7f8a2800b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a35d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.197 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a35d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35384/0 (socket says 172.21.15.49:35384) 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a35d9b640 1 -- 172.21.15.49:0/1541999988 learned_addr learned my addr 172.21.15.49:0/1541999988 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a3659c640 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 0x55fa86ef58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a35d9b640 1 -- 172.21.15.49:0/1541999988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 msgr2=0x55fa86ef58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 0x55fa86ef58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a35d9b640 1 -- 172.21.15.49:0/1541999988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 msgr2=0x55fa86ef32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a36d9d640 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ef32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ef32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.191+0000 7f8a35d9b640 1 -- 172.21.15.49:0/1541999988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa86ef3810 con 0x55fa86b1b4d0 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a35d9b640 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef2d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8a2009e180 tx=0x7f8a20005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cc5a20fd34c1e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:43.198 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a1dffb640 1 -- 172.21.15.49:0/1541999988 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2009dfe0 con 0x55fa86b1b4d0 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a1dffb640 1 -- 172.21.15.49:0/1541999988 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a200e4a90 con 0x55fa86b1b4d0 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a43e0b740 1 -- 172.21.15.49:0/1541999988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a30036040 con 0x55fa86b1b4d0 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a1dffb640 1 -- 172.21.15.49:0/1541999988 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8a2009e1b0 con 0x55fa86b1b4d0 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a43e0b740 10 client.15786 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a43e0b740 1 -- 172.21.15.49:0/1541999988 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fa86f698d0 con 0x55fa86b1b4d0 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a1dffb640 1 -- 172.21.15.49:0/1541999988 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a30036040 con 0x55fa86b1b4d0 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a1dffb640 1 -- 172.21.15.49:0/1541999988 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8a20092ce0 con 0x55fa86b1b4d0 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a43e0b740 10 client.15786 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a43e0b740 10 client.15786 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a43e0b740 20 client.15786 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fa86ad01c0 0x55fa86f6bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a43e0b740 4 client.15786 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.192+0000 7f8a43e0b740 1 -- 172.21.15.49:0/1541999988 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fa86e540f0 con 0x55fa86ad01c0 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.193+0000 7f8a3659c640 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fa86ad01c0 0x55fa86f6bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:43.199 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.193+0000 7f8a3659c640 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fa86ad01c0 0x55fa86f6bb70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af3a062c57f14f4b server_cookie=88a6f3796edbe556 in_seq=0 out_seq=0 2024-09-21T06:37:43.200 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.193+0000 7f8a1dffb640 10 client.15786 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a1dffb640 1 -- 172.21.15.49:0/1541999988 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fa86e540f0 con 0x55fa86ad01c0 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a1dffb640 10 client.15786 handle_command_reply: tid=0 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 client.15786 shutdown 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 -- 172.21.15.49:0/1541999988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 msgr2=0x55fa86ef2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef2d90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8a2009e180 tx=0x7f8a20005bf0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 -- 172.21.15.49:0/1541999988 shutdown_connections 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fa86ad01c0 0x55fa86f6bb70 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fa86b3c1b0 0x55fa86ef32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fa86b1b4d0 0x55fa86ef2d90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.205 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a1dffb640 0 client.15786 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 --2- 172.21.15.49:0/1541999988 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fa86b132f0 0x55fa86ef58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 -- 172.21.15.49:0/1541999988 >> 172.21.15.49:0/1541999988 conn(0x55fa86b30300 msgr2=0x55fa86ee29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 -- 172.21.15.49:0/1541999988 shutdown_connections 2024-09-21T06:37:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 1 -- 172.21.15.49:0/1541999988 wait complete. 2024-09-21T06:37:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.203+0000 7f8a43e0b740 20 client.15786 trim_cache size 0 max 16384 2024-09-21T06:37:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:37:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:37:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:37:43.206 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:37:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a240b6700 msgr2=0x7f8a240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a240b6700 0x7f8a240b8c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8a30005e30 tx=0x7f8a30005c30 comp rx=0 tx=0).stop 2024-09-21T06:37:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108300 msgr2=0x7f8a3819b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:43.207 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108300 0x7f8a3819b760 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000d740 tx=0x7f8a2000dc00 comp rx=0 tx=0).stop 2024-09-21T06:37:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/2958762629 shutdown_connections 2024-09-21T06:37:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a240b6700 0x7f8a240b8c10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a38108c50 0x7f8a3819bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a38108300 0x7f8a3819b760 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 --2- 172.21.15.49:0/2958762629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a381029d0 0x7f8a3819b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/2958762629 >> 172.21.15.49:0/2958762629 conn(0x7f8a3807a710 msgr2=0x7f8a38105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/2958762629 shutdown_connections 2024-09-21T06:37:43.208 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:43.204+0000 7f8a3cdc3640 1 -- 172.21.15.49:0/2958762629 wait complete. 2024-09-21T06:37:43.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:43 smithi098 ceph-mon[34704]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:37:43.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:43 smithi079 ceph-mon[34346]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:37:43.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:43 smithi049 ceph-mon[31177]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:37:45.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:45 smithi098 ceph-mon[34704]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:37:45.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:45 smithi079 ceph-mon[34346]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:37:45.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:45 smithi049 ceph-mon[31177]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:37:47.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:47 smithi098 ceph-mon[34704]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T06:37:47.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:47 smithi079 ceph-mon[34346]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T06:37:47.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:47 smithi049 ceph-mon[31177]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-21T06:37:49.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:49 smithi098 ceph-mon[34704]: pgmap v354: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-09-21T06:37:49.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:49 smithi079 ceph-mon[34346]: pgmap v354: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-09-21T06:37:49.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:49 smithi049 ceph-mon[31177]: pgmap v354: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-09-21T06:37:50.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:50 smithi098 ceph-mon[34704]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:37:50.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:50 smithi079 ceph-mon[34346]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:37:50.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:50 smithi049 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:37:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:51 smithi098 ceph-mon[34704]: pgmap v355: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.5 KiB/s wr, 8 op/s 2024-09-21T06:37:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:37:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:51 smithi079 ceph-mon[34346]: pgmap v355: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.5 KiB/s wr, 8 op/s 2024-09-21T06:37:51.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:37:51.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:51 smithi049 ceph-mon[31177]: pgmap v355: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.5 KiB/s wr, 8 op/s 2024-09-21T06:37:51.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:37:51.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:51.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:52.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:37:52.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:37:52.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:52.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:37:52.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:37:52.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:52.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:37:52.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:37:52.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:37:53.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:53 smithi079 ceph-mon[34346]: pgmap v356: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T06:37:53.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:53 smithi049 ceph-mon[31177]: pgmap v356: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T06:37:53.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:53 smithi098 ceph-mon[34704]: pgmap v356: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T06:37:55.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:55 smithi079 ceph-mon[34346]: pgmap v357: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:37:55.598 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:55 smithi098 ceph-mon[34704]: pgmap v357: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:37:55.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:55 smithi049 ceph-mon[31177]: pgmap v357: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:37:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.320+0000 7fbb12913640 1 -- 172.21.15.49:0/534209611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c1050e0 msgr2=0x7fbb0c1054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.320+0000 7fbb12913640 1 --2- 172.21.15.49:0/534209611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c1050e0 0x7fbb0c1054f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbb00009900 tx=0x7fbb0002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.320+0000 7fbb12913640 1 -- 172.21.15.49:0/534209611 shutdown_connections 2024-09-21T06:37:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.320+0000 7fbb12913640 1 --2- 172.21.15.49:0/534209611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c105a30 0x7fbb0c10f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.320+0000 7fbb12913640 1 --2- 172.21.15.49:0/534209611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c1050e0 0x7fbb0c1054f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.320+0000 7fbb12913640 1 --2- 172.21.15.49:0/534209611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c103180 0x7fbb0c103590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.320+0000 7fbb12913640 1 -- 172.21.15.49:0/534209611 >> 172.21.15.49:0/534209611 conn(0x7fbb0c079ea0 msgr2=0x7fbb0c07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.320+0000 7fbb12913640 1 -- 172.21.15.49:0/534209611 shutdown_connections 2024-09-21T06:37:56.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.320+0000 7fbb12913640 1 -- 172.21.15.49:0/534209611 wait complete. 2024-09-21T06:37:56.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb12913640 1 Processor -- start 2024-09-21T06:37:56.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb12913640 1 -- start start 2024-09-21T06:37:56.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb12913640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c103180 0x7fbb0c0feed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb12913640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1050e0 0x7fbb0c0ff410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb12913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c105a30 0x7fbb0c0ff950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb12913640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c112980 con 0x7fbb0c103180 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb12913640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c112800 con 0x7fbb0c105a30 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb12913640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c112b00 con 0x7fbb0c1050e0 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c103180 0x7fbb0c0feed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c103180 0x7fbb0c0feed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45978/0 (socket says 172.21.15.49:45978) 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.321+0000 7fbb0bfff640 1 -- 172.21.15.49:0/2088475952 learned_addr learned my addr 172.21.15.49:0/2088475952 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c105a30 0x7fbb0c0ff950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb0b7fe640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1050e0 0x7fbb0c0ff410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb0bfff640 1 -- 172.21.15.49:0/2088475952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1050e0 msgr2=0x7fbb0c0ff410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1050e0 0x7fbb0c0ff410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb0bfff640 1 -- 172.21.15.49:0/2088475952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c105a30 msgr2=0x7fbb0c0ff950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c105a30 0x7fbb0c0ff950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb0bfff640 1 -- 172.21.15.49:0/2088475952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0c1a8720 con 0x7fbb0c103180 2024-09-21T06:37:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c103180 0x7fbb0c0feed0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00d950 tx=0x7fbafc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb097fa640 1 -- 172.21.15.49:0/2088475952 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc017030 con 0x7fbb0c103180 2024-09-21T06:37:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb097fa640 1 -- 172.21.15.49:0/2088475952 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbafc004020 con 0x7fbb0c103180 2024-09-21T06:37:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb12913640 1 -- 172.21.15.49:0/2088475952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0c1a8a10 con 0x7fbb0c103180 2024-09-21T06:37:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb097fa640 1 -- 172.21.15.49:0/2088475952 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0047a0 con 0x7fbb0c103180 2024-09-21T06:37:56.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.322+0000 7fbb12913640 1 -- 172.21.15.49:0/2088475952 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb0c1a8f80 con 0x7fbb0c103180 2024-09-21T06:37:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb1987f740 1 Processor -- start 2024-09-21T06:37:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb1987f740 1 -- start start 2024-09-21T06:37:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb097fa640 1 -- 172.21.15.49:0/2088475952 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fbafc009a30 con 0x7fbb0c103180 2024-09-21T06:37:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eed061b0 0x55b9ef0ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eece54d0 0x55b9ef0ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb1987f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef0206f0 con 0x55b9eecdd2f0 2024-09-21T06:37:56.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb1987f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef00fb20 con 0x55b9eed061b0 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb1987f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef013930 con 0x55b9eece54d0 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.325+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45982/0 (socket says 172.21.15.49:45982) 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb0bfff640 1 -- 172.21.15.49:0/3798812180 learned_addr learned my addr 172.21.15.49:0/3798812180 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eed061b0 0x55b9ef0ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb0b7fe640 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eece54d0 0x55b9ef0ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb0bfff640 1 -- 172.21.15.49:0/3798812180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eece54d0 msgr2=0x55b9ef0ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eece54d0 0x55b9ef0ac430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb0bfff640 1 -- 172.21.15.49:0/3798812180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eed061b0 msgr2=0x55b9ef0ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eed061b0 0x55b9ef0ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb0bfff640 1 -- 172.21.15.49:0/3798812180 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9eefd5530 con 0x55b9eecdd2f0 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eed061b0 0x55b9ef0ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0abef0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0e4760 tx=0x7fbafc0ef640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14c536ceec3f9a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:56.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb097fa640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf40b6730 0x7fbaf40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbaf27fc640 1 -- 172.21.15.49:0/3798812180 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0fa070 con 0x55b9eecdd2f0 2024-09-21T06:37:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.326+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf40b6730 0x7fbaf40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.327+0000 7fbb097fa640 1 -- 172.21.15.49:0/2088475952 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fbafc0e70c0 con 0x7fbb0c103180 2024-09-21T06:37:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.327+0000 7fbaf27fc640 1 -- 172.21.15.49:0/3798812180 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbafc0efe40 con 0x55b9eecdd2f0 2024-09-21T06:37:56.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.327+0000 7fbaf27fc640 1 -- 172.21.15.49:0/3798812180 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0a8d90 con 0x55b9eecdd2f0 2024-09-21T06:37:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.327+0000 7fbb1987f740 1 -- 172.21.15.49:0/3798812180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 msgr2=0x55b9ef0abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:56.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.327+0000 7fbb1987f740 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0abef0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0e4760 tx=0x7fbafc0ef640 comp rx=0 tx=0).stop 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.327+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf40b6730 0x7fbaf40b8c40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbb04005fd0 tx=0x7fbb04009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.328+0000 7fbb1987f740 1 -- 172.21.15.49:0/3798812180 shutdown_connections 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.328+0000 7fbb1987f740 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eece54d0 0x55b9ef0ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.328+0000 7fbb1987f740 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0abef0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.328+0000 7fbb1987f740 1 --2- 172.21.15.49:0/3798812180 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eed061b0 0x55b9ef0ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.328+0000 7fbb1987f740 1 -- 172.21.15.49:0/3798812180 >> 172.21.15.49:0/3798812180 conn(0x55b9eecfa300 msgr2=0x55b9ef0a98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.328+0000 7fbb1987f740 1 -- 172.21.15.49:0/3798812180 shutdown_connections 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.328+0000 7fbb1987f740 1 -- 172.21.15.49:0/3798812180 wait complete. 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.328+0000 7fbb1987f740 1 -- start start 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.328+0000 7fbb1987f740 1 Processor -- start 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0b7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0b7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eed061b0 0x55b9ef0c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb1987f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b9eef47ab0 con 0x55b9eed061b0 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb1987f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b9eefb5730 con 0x55b9eece54d0 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb1987f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b9ef0ba130 con 0x55b9eecdd2f0 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb1987f740 10 client.0 _ll_register_callbacks cb 0x55b9ef0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb10eb0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eed061b0 0x55b9ef0c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb10eb0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eed061b0 0x55b9ef0c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45986/0 (socket says 172.21.15.49:45986) 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb10eb0640 1 -- 172.21.15.49:0/1118335699 learned_addr learned my addr 172.21.15.49:0/1118335699 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb0b7fe640 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb10eb0640 1 -- 172.21.15.49:0/1118335699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eecdd2f0 msgr2=0x55b9ef0b7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0b7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb10eb0640 1 -- 172.21.15.49:0/1118335699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 msgr2=0x55b9ef0b7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0b7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb10eb0640 1 -- 172.21.15.49:0/1118335699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9eed71790 con 0x55b9eed061b0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eed061b0 0x55b9ef0c3480 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbb04005f40 tx=0x7fbb04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165f3b91b30346ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.329+0000 7fbaeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/1118335699 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0401ed30 con 0x55b9eed061b0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbb1987f740 1 -- 172.21.15.49:0/1118335699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9ef022640 con 0x55b9eed061b0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/1118335699 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fbb0402a480 con 0x55b9eed061b0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/1118335699 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbb04009af0 con 0x55b9eed061b0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbb1987f740 10 client.15798 fetch_fsmap learned FSMap version 26 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbb1987f740 1 -- 172.21.15.49:0/1118335699 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b9eedea620 con 0x55b9eed061b0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/1118335699 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b9ef022640 con 0x55b9eed061b0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/1118335699 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fbb0400f040 con 0x55b9eed061b0 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbb1987f740 10 client.15798 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbb1987f740 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbb1987f740 20 client.15798 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b9eecc4d80 0x55b9ef0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbb1987f740 4 client.15798 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.330+0000 7fbb1987f740 1 -- 172.21.15.49:0/1118335699 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9ef01e0f0 con 0x55b9eecc4d80 2024-09-21T06:37:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.331+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b9eecc4d80 0x55b9ef0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.331+0000 7fbaeb7fe640 10 client.15798 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.331+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b9eecc4d80 0x55b9ef0c9280 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16a71d261039fce server_cookie=96b8aec712d4c0ab in_seq=0 out_seq=0 2024-09-21T06:37:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/1118335699 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b9ef01e0f0 con 0x55b9eecc4d80 2024-09-21T06:37:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbaeb7fe640 10 client.15798 handle_command_reply: tid=0 2024-09-21T06:37:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbb1987f740 1 client.15798 shutdown 2024-09-21T06:37:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbb1987f740 1 -- 172.21.15.49:0/1118335699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eed061b0 msgr2=0x55b9ef0c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eed061b0 0x55b9ef0c3480 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbb04005f40 tx=0x7fbb04004a40 comp rx=0 tx=0).stop 2024-09-21T06:37:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbb1987f740 1 -- 172.21.15.49:0/1118335699 shutdown_connections 2024-09-21T06:37:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b9eecc4d80 0x55b9ef0c9280 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eed061b0 0x55b9ef0c3480 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0b7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1118335699 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0b7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbaeb7fe640 0 client.15798 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.332+0000 7fbb1987f740 1 -- 172.21.15.49:0/1118335699 >> 172.21.15.49:0/1118335699 conn(0x55b9eecfa300 msgr2=0x55b9ef0ac9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.333+0000 7fbb1987f740 1 -- 172.21.15.49:0/1118335699 shutdown_connections 2024-09-21T06:37:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.333+0000 7fbb1987f740 1 -- 172.21.15.49:0/1118335699 wait complete. 2024-09-21T06:37:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.333+0000 7fbb1987f740 20 client.15798 trim_cache size 0 max 16384 2024-09-21T06:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb1987f740 1 Processor -- start 2024-09-21T06:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb1987f740 1 -- start start 2024-09-21T06:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0ad010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0c3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 0x55b9ef0c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb1987f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c1b42f0 con 0x55b9eecdd2f0 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb1987f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c1b1bc0 con 0x55b9eece54d0 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb1987f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c1afa30 con 0x55b9eed061b0 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45994/0 (socket says 172.21.15.49:45994) 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0bfff640 1 -- 172.21.15.49:0/1696732728 learned_addr learned my addr 172.21.15.49:0/1696732728 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 0x55b9ef0c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0b7fe640 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0bfff640 1 -- 172.21.15.49:0/1696732728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 msgr2=0x55b9ef0c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 0x55b9ef0c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0bfff640 1 -- 172.21.15.49:0/1696732728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 msgr2=0x55b9ef0c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0bfff640 1 -- 172.21.15.49:0/1696732728 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ef0b9950 con 0x55b9eecdd2f0 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.348+0000 7fbb0b7fe640 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.349+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0ad010 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0e4df0 tx=0x7fbafc0d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315489c184ee8c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.349+0000 7fbaf1ffb640 1 -- 172.21.15.49:0/1696732728 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc086e60 con 0x55b9eecdd2f0 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.349+0000 7fbaf1ffb640 1 -- 172.21.15.49:0/1696732728 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbafc0aca00 con 0x55b9eecdd2f0 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.349+0000 7fbaf1ffb640 1 -- 172.21.15.49:0/1696732728 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0ac660 con 0x55b9eecdd2f0 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 -- 172.21.15.49:0/1696732728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 msgr2=0x55b9ef0ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0ad010 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fbafc0e4df0 tx=0x7fbafc0d0040 comp rx=0 tx=0).stop 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 -- 172.21.15.49:0/1696732728 shutdown_connections 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 0x55b9ef0c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 --2- 172.21.15.49:0/1696732728 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0ad010 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 -- 172.21.15.49:0/1696732728 >> 172.21.15.49:0/1696732728 conn(0x55b9eecfa300 msgr2=0x55b9ef0ac900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 -- 172.21.15.49:0/1696732728 shutdown_connections 2024-09-21T06:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 -- 172.21.15.49:0/1696732728 wait complete. 2024-09-21T06:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 -- start start 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.350+0000 7fbb1987f740 1 Processor -- start 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0bca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0bcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb1987f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 0x55b9ef131c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb1987f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c1b0080 con 0x55b9eecdd2f0 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb1987f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c1b14f0 con 0x55b9eece54d0 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb1987f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fbb0c1b0750 con 0x55b9eed061b0 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb1987f740 10 client.0 _ll_register_callbacks cb 0x7fbb04009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0bca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0bca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46010/0 (socket says 172.21.15.49:46010) 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0bfff640 1 -- 172.21.15.49:0/2808133653 learned_addr learned my addr 172.21.15.49:0/2808133653 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb10eb0640 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 0x55b9ef131c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0b7fe640 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0bcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0bfff640 1 -- 172.21.15.49:0/2808133653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 msgr2=0x55b9ef131c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 0x55b9ef131c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0bfff640 1 -- 172.21.15.49:0/2808133653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 msgr2=0x55b9ef0bcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0bcfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0bfff640 1 -- 172.21.15.49:0/2808133653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ef132180 con 0x55b9eecdd2f0 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0b7fe640 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0bcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb0bfff640 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0bca90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbafc000c00 tx=0x7fbafc0e4c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b7635940dbe669 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbaeb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/2808133653 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbafc0ac840 con 0x55b9eecdd2f0 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/2808133653 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fbafc0041d0 con 0x55b9eecdd2f0 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.351+0000 7fbb1987f740 1 -- 172.21.15.49:0/2808133653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbafc0aca00 con 0x55b9eecdd2f0 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/2808133653 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbafc0accc0 con 0x55b9eecdd2f0 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbb1987f740 10 client.15804 fetch_fsmap learned FSMap version 26 2024-09-21T06:37:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbb1987f740 1 -- 172.21.15.49:0/2808133653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b9ef133300 con 0x55b9eecdd2f0 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/2808133653 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbafc0aca00 con 0x55b9eecdd2f0 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/2808133653 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fbafc0a9160 con 0x55b9eecdd2f0 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbb1987f740 10 client.15804 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbb1987f740 10 client.15804 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbb1987f740 20 client.15804 populate_metadata read hostname 'smithi049' 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbb1987f740 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b9eec9a1c0 0x55b9ef135590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbb1987f740 4 client.15804 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbb1987f740 1 -- 172.21.15.49:0/2808133653 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b9ef01b520 con 0x55b9eec9a1c0 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.352+0000 7fbb0b7fe640 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b9eec9a1c0 0x55b9ef135590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.353+0000 7fbaeb7fe640 10 client.15804 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:56.359 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.353+0000 7fbb0b7fe640 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b9eec9a1c0 0x55b9ef135590 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8da4a336b11e6e16 server_cookie=6ca0824d89150a92 in_seq=0 out_seq=0 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbaeb7fe640 1 -- 172.21.15.49:0/2808133653 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b9ef01b520 con 0x55b9eec9a1c0 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbaeb7fe640 10 client.15804 handle_command_reply: tid=0 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 client.15804 shutdown 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 -- 172.21.15.49:0/2808133653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 msgr2=0x55b9ef0bca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0bca90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbafc000c00 tx=0x7fbafc0e4c70 comp rx=0 tx=0).stop 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 -- 172.21.15.49:0/2808133653 shutdown_connections 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b9eec9a1c0 0x55b9ef135590 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b9eed061b0 0x55b9ef131c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b9eece54d0 0x55b9ef0bcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbaeb7fe640 0 client.15804 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:37:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 --2- 172.21.15.49:0/2808133653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b9eecdd2f0 0x55b9ef0bca90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 -- 172.21.15.49:0/2808133653 >> 172.21.15.49:0/2808133653 conn(0x55b9eecfa300 msgr2=0x55b9ef0a9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 -- 172.21.15.49:0/2808133653 shutdown_connections 2024-09-21T06:37:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 1 -- 172.21.15.49:0/2808133653 wait complete. 2024-09-21T06:37:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.364+0000 7fbb1987f740 20 client.15804 trim_cache size 0 max 16384 2024-09-21T06:37:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:37:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:37:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:37:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:37:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 -- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf40b6730 msgr2=0x7fbaf40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf40b6730 0x7fbaf40b8c40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fbb04005fd0 tx=0x7fbb04009600 comp rx=0 tx=0).stop 2024-09-21T06:37:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 -- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c103180 msgr2=0x7fbb0c0feed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c103180 0x7fbb0c0feed0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00d950 tx=0x7fbafc00de10 comp rx=0 tx=0).stop 2024-09-21T06:37:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 -- 172.21.15.49:0/2088475952 shutdown_connections 2024-09-21T06:37:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fbaf40b6730 0x7fbaf40b8c40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fbb0c105a30 0x7fbb0c0ff950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fbb0c1050e0 0x7fbb0c0ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 --2- 172.21.15.49:0/2088475952 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fbb0c103180 0x7fbb0c0feed0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 -- 172.21.15.49:0/2088475952 >> 172.21.15.49:0/2088475952 conn(0x7fbb0c079ea0 msgr2=0x7fbb0c106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 -- 172.21.15.49:0/2088475952 shutdown_connections 2024-09-21T06:37:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:37:56.365+0000 7fbb12913640 1 -- 172.21.15.49:0/2088475952 wait complete. 2024-09-21T06:37:57.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:57 smithi049 ceph-mon[31177]: pgmap v358: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-21T06:37:57.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:57 smithi098 ceph-mon[34704]: pgmap v358: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-21T06:37:57.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:57 smithi079 ceph-mon[34346]: pgmap v358: 97 pgs: 97 active+clean; 1.5 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-21T06:37:59.621 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:37:59 smithi079 ceph-mon[34346]: pgmap v359: 97 pgs: 97 active+clean; 1.6 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-21T06:37:59.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:37:59 smithi049 ceph-mon[31177]: pgmap v359: 97 pgs: 97 active+clean; 1.6 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-21T06:37:59.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:37:59 smithi098 ceph-mon[34704]: pgmap v359: 97 pgs: 97 active+clean; 1.6 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-21T06:38:01.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:01 smithi049 ceph-mon[31177]: pgmap v360: 97 pgs: 97 active+clean; 1.6 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T06:38:01.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:01 smithi098 ceph-mon[34704]: pgmap v360: 97 pgs: 97 active+clean; 1.6 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T06:38:01.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:01 smithi079 ceph-mon[34346]: pgmap v360: 97 pgs: 97 active+clean; 1.6 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T06:38:01.823 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:38:02.097 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.559+0000 7fa658f8e640 1 -- 172.21.15.49:0/2236727880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654103bb0 msgr2=0x7fa654103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.559+0000 7fa658f8e640 1 --2- 172.21.15.49:0/2236727880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654103bb0 0x7fa654103fc0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009900 tx=0x7fa63c02a410 comp rx=0 tx=0).stop 2024-09-21T06:38:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.560+0000 7fa658f8e640 1 -- 172.21.15.49:0/2236727880 shutdown_connections 2024-09-21T06:38:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.560+0000 7fa658f8e640 1 --2- 172.21.15.49:0/2236727880 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa654109e40 0x7fa654110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.560+0000 7fa658f8e640 1 --2- 172.21.15.49:0/2236727880 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541094f0 0x7fa654109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.560+0000 7fa658f8e640 1 --2- 172.21.15.49:0/2236727880 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654103bb0 0x7fa654103fc0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.560+0000 7fa658f8e640 1 -- 172.21.15.49:0/2236727880 >> 172.21.15.49:0/2236727880 conn(0x7fa6540ff600 msgr2=0x7fa654101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.560+0000 7fa658f8e640 1 -- 172.21.15.49:0/2236727880 shutdown_connections 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.560+0000 7fa658f8e640 1 -- 172.21.15.49:0/2236727880 wait complete. 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.560+0000 7fa658f8e640 1 Processor -- start 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.560+0000 7fa658f8e640 1 -- start start 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa658f8e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa654103bb0 0x7fa65419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa658f8e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541094f0 0x7fa65419abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa658f8e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654109e40 0x7fa65419fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa658f8e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa654113bc0 con 0x7fa654109e40 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa658f8e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa654113a40 con 0x7fa6541094f0 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa658f8e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa654113d40 con 0x7fa654103bb0 2024-09-21T06:38:02.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa652d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654109e40 0x7fa65419fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa652d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654109e40 0x7fa65419fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46032/0 (socket says 172.21.15.49:46032) 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa652d9d640 1 -- 172.21.15.49:0/1924965014 learned_addr learned my addr 172.21.15.49:0/1924965014 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa651d9b640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541094f0 0x7fa65419abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa65259c640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa654103bb0 0x7fa65419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa652d9d640 1 -- 172.21.15.49:0/1924965014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa654103bb0 msgr2=0x7fa65419a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa652d9d640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa654103bb0 0x7fa65419a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa652d9d640 1 -- 172.21.15.49:0/1924965014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541094f0 msgr2=0x7fa65419abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa652d9d640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541094f0 0x7fa65419abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa652d9d640 1 -- 172.21.15.49:0/1924965014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6541a0580 con 0x7fa654109e40 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.561+0000 7fa652d9d640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654109e40 0x7fa65419fe50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00b970 tx=0x7fa64c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.562+0000 7fa64b7fe640 1 -- 172.21.15.49:0/1924965014 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c019070 con 0x7fa654109e40 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.562+0000 7fa658f8e640 1 -- 172.21.15.49:0/1924965014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6541a0870 con 0x7fa654109e40 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.562+0000 7fa64b7fe640 1 -- 172.21.15.49:0/1924965014 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa64c014440 con 0x7fa654109e40 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.562+0000 7fa64b7fe640 1 -- 172.21.15.49:0/1924965014 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa64c0075d0 con 0x7fa654109e40 2024-09-21T06:38:02.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.562+0000 7fa658f8e640 1 -- 172.21.15.49:0/1924965014 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6541a6fd0 con 0x7fa654109e40 2024-09-21T06:38:02.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.564+0000 7fa65f502740 1 Processor -- start 2024-09-21T06:38:02.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.565+0000 7fa64b7fe640 1 -- 172.21.15.49:0/1924965014 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fa64c01c070 con 0x7fa654109e40 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.565+0000 7fa65f502740 1 -- start start 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.565+0000 7fa65f502740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093745270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.565+0000 7fa65f502740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 0x5650937457b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.565+0000 7fa65f502740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093745cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.565+0000 7fa65f502740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5650936bbe50 con 0x56509337d390 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.565+0000 7fa65f502740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5650936ab280 con 0x5650933751b0 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.565+0000 7fa65f502740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5650936af090 con 0x56509339e070 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093745cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093745cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46038/0 (socket says 172.21.15.49:46038) 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 -- 172.21.15.49:0/137838554 learned_addr learned my addr 172.21.15.49:0/137838554 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:02.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa65259c640 1 --2- 172.21.15.49:0/137838554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 0x5650937457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 --2- 172.21.15.49:0/137838554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093745270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa64b7fe640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6400b6680 0x7fa6400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 -- 172.21.15.49:0/137838554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 msgr2=0x565093745270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 --2- 172.21.15.49:0/137838554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093745270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 -- 172.21.15.49:0/137838554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 msgr2=0x5650937457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 --2- 172.21.15.49:0/137838554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 0x5650937457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 -- 172.21.15.49:0/137838554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565093409650 con 0x56509337d390 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa64b7fe640 1 -- 172.21.15.49:0/1924965014 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa64c0e6bf0 con 0x7fa654109e40 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa652d9d640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6400b6680 0x7fa6400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa651d9b640 1 --2- 172.21.15.49:0/137838554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093745cf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa644009f20 tx=0x7fa644009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b670a588616a19e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa648ff9640 1 -- 172.21.15.49:0/137838554 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644017470 con 0x56509337d390 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.566+0000 7fa648ff9640 1 -- 172.21.15.49:0/137838554 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa64401c070 con 0x56509337d390 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.567+0000 7fa648ff9640 1 -- 172.21.15.49:0/137838554 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644015830 con 0x56509337d390 2024-09-21T06:38:02.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.567+0000 7fa65f502740 1 -- 172.21.15.49:0/137838554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 msgr2=0x565093745cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.567+0000 7fa652d9d640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6400b6680 0x7fa6400b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00b940 tx=0x7fa64c004b50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.567+0000 7fa65f502740 1 --2- 172.21.15.49:0/137838554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093745cf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa644009f20 tx=0x7fa644009580 comp rx=0 tx=0).stop 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.567+0000 7fa65f502740 1 -- 172.21.15.49:0/137838554 shutdown_connections 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.567+0000 7fa65f502740 1 --2- 172.21.15.49:0/137838554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093745cf0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.567+0000 7fa65f502740 1 --2- 172.21.15.49:0/137838554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 0x5650937457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.567+0000 7fa65f502740 1 --2- 172.21.15.49:0/137838554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093745270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.567+0000 7fa65f502740 1 -- 172.21.15.49:0/137838554 >> 172.21.15.49:0/137838554 conn(0x565093392460 msgr2=0x565093743160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 -- 172.21.15.49:0/137838554 shutdown_connections 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 -- 172.21.15.49:0/137838554 wait complete. 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 -- start start 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 Processor -- start 2024-09-21T06:38:02.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5650933751b0 0x565093754c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093755150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509339e070 0x565093755690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56509350c700 con 0x56509337d390 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x565093646110 con 0x56509339e070 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x565093757d80 con 0x5650933751b0 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.568+0000 7fa65f502740 10 client.0 _ll_register_callbacks cb 0x56509365f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093755150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093755150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46044/0 (socket says 172.21.15.49:46044) 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65259c640 1 -- 172.21.15.49:0/441564708 learned_addr learned my addr 172.21.15.49:0/441564708 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa651d9b640 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5650933751b0 0x565093754c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa651d9b640 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509339e070 0x565093755690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65259c640 1 -- 172.21.15.49:0/441564708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5650933751b0 msgr2=0x565093754c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:02.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65259c640 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5650933751b0 0x565093754c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65259c640 1 -- 172.21.15.49:0/441564708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509339e070 msgr2=0x565093755690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65259c640 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509339e070 0x565093755690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65259c640 1 -- 172.21.15.49:0/441564708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565093673c40 con 0x56509337d390 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa651d9b640 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509339e070 0x565093755690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65259c640 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093755150 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa63c02a930 tx=0x7fa63c031810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dac9ce1082e34c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa639ffb640 1 -- 172.21.15.49:0/441564708 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c035040 con 0x56509337d390 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa639ffb640 1 -- 172.21.15.49:0/441564708 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa63c004240 con 0x56509337d390 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.569+0000 7fa65f502740 1 -- 172.21.15.49:0/441564708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa64401c070 con 0x56509337d390 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa639ffb640 1 -- 172.21.15.49:0/441564708 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa63c004440 con 0x56509337d390 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa65f502740 10 client.15816 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa65f502740 1 -- 172.21.15.49:0/441564708 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x565093763a00 con 0x56509337d390 2024-09-21T06:38:02.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa639ffb640 1 -- 172.21.15.49:0/441564708 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa64401c070 con 0x56509337d390 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa639ffb640 1 -- 172.21.15.49:0/441564708 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa63c045610 con 0x56509337d390 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa65f502740 10 client.15816 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa65f502740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa65f502740 20 client.15816 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa65f502740 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56509335c9f0 0x565093766f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa65f502740 4 client.15816 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa65f502740 1 -- 172.21.15.49:0/441564708 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650936bdda0 con 0x56509335c9f0 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.570+0000 7fa651d9b640 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56509335c9f0 0x565093766f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.571+0000 7fa639ffb640 10 client.15816 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.571+0000 7fa651d9b640 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56509335c9f0 0x565093766f70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d400713782138a7e server_cookie=a4e077b18625241f in_seq=0 out_seq=0 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa639ffb640 1 -- 172.21.15.49:0/441564708 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5650936bdda0 con 0x56509335c9f0 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa639ffb640 10 client.15816 handle_command_reply: tid=0 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 client.15816 shutdown 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 -- 172.21.15.49:0/441564708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 msgr2=0x565093755150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:02.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093755150 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa63c02a930 tx=0x7fa63c031810 comp rx=0 tx=0).stop 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 -- 172.21.15.49:0/441564708 shutdown_connections 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56509335c9f0 0x565093766f70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509339e070 0x565093755690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x565093755150 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 --2- 172.21.15.49:0/441564708 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5650933751b0 0x565093754c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa639ffb640 0 client.15816 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 -- 172.21.15.49:0/441564708 >> 172.21.15.49:0/441564708 conn(0x565093392460 msgr2=0x5650937483c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 -- 172.21.15.49:0/441564708 shutdown_connections 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 1 -- 172.21.15.49:0/441564708 wait complete. 2024-09-21T06:38:02.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.572+0000 7fa65f502740 20 client.15816 trim_cache size 0 max 16384 2024-09-21T06:38:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.589+0000 7fa65f502740 1 Processor -- start 2024-09-21T06:38:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.589+0000 7fa65f502740 1 -- start start 2024-09-21T06:38:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa65f502740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650933751b0 0x565093748cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa65f502740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509337d390 0x565093756840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa65f502740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093751e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa65f502740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa6541affb0 con 0x5650933751b0 2024-09-21T06:38:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa65f502740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa6541ad880 con 0x56509337d390 2024-09-21T06:38:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa65f502740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa6541ab6f0 con 0x56509339e070 2024-09-21T06:38:02.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa651d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650933751b0 0x565093748cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa651d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650933751b0 0x565093748cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46048/0 (socket says 172.21.15.49:46048) 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa651d9b640 1 -- 172.21.15.49:0/3560201189 learned_addr learned my addr 172.21.15.49:0/3560201189 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa65259c640 1 --2- 172.21.15.49:0/3560201189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509337d390 0x565093756840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa651d9b640 1 -- 172.21.15.49:0/3560201189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 msgr2=0x565093751e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa651d9b640 1 --2- 172.21.15.49:0/3560201189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093751e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa651d9b640 1 -- 172.21.15.49:0/3560201189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509337d390 msgr2=0x565093756840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa651d9b640 1 --2- 172.21.15.49:0/3560201189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509337d390 0x565093756840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa651d9b640 1 -- 172.21.15.49:0/3560201189 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565093748070 con 0x5650933751b0 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa651d9b640 1 --2- 172.21.15.49:0/3560201189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650933751b0 0x565093748cd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa644009f20 tx=0x7fa644009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1bc5d434434e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.590+0000 7fa63bfff640 1 -- 172.21.15.49:0/3560201189 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6440176b0 con 0x5650933751b0 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa63bfff640 1 -- 172.21.15.49:0/3560201189 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa644032020 con 0x5650933751b0 2024-09-21T06:38:02.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa63bfff640 1 -- 172.21.15.49:0/3560201189 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa644015af0 con 0x5650933751b0 2024-09-21T06:38:02.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa65f502740 1 -- 172.21.15.49:0/3560201189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650933751b0 msgr2=0x565093748cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:02.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa65f502740 1 --2- 172.21.15.49:0/3560201189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650933751b0 0x565093748cd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa644009f20 tx=0x7fa644009f50 comp rx=0 tx=0).stop 2024-09-21T06:38:02.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa65f502740 1 -- 172.21.15.49:0/3560201189 shutdown_connections 2024-09-21T06:38:02.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa65f502740 1 --2- 172.21.15.49:0/3560201189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093751e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa65f502740 1 --2- 172.21.15.49:0/3560201189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56509337d390 0x565093756840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa65f502740 1 --2- 172.21.15.49:0/3560201189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5650933751b0 0x565093748cd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa65f502740 1 -- 172.21.15.49:0/3560201189 >> 172.21.15.49:0/3560201189 conn(0x565093392460 msgr2=0x565093756130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:02.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa65f502740 1 -- 172.21.15.49:0/3560201189 shutdown_connections 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.591+0000 7fa65f502740 1 -- 172.21.15.49:0/3560201189 wait complete. 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65f502740 1 -- start start 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65f502740 1 Processor -- start 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65f502740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 0x565093759160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65f502740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x5650937596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65f502740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093759be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65f502740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa6541abd40 con 0x56509337d390 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65f502740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa6541ad1b0 con 0x5650933751b0 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65f502740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa6541ac410 con 0x56509339e070 2024-09-21T06:38:02.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65f502740 10 client.0 _ll_register_callbacks cb 0x7fa63c005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x5650937596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x5650937596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46064/0 (socket says 172.21.15.49:46064) 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa65259c640 1 -- 172.21.15.49:0/438619524 learned_addr learned my addr 172.21.15.49:0/438619524 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.592+0000 7fa651d9b640 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 0x565093759160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa651d9b640 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093759be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa65259c640 1 -- 172.21.15.49:0/438619524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 msgr2=0x565093759be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa65259c640 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093759be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa65259c640 1 -- 172.21.15.49:0/438619524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 msgr2=0x565093759160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa65259c640 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 0x565093759160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa65259c640 1 -- 172.21.15.49:0/438619524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650937d0a40 con 0x56509337d390 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa651d9b640 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093759be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa65259c640 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x5650937596a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa63c02a930 tx=0x7fa63c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86dab9e0e88d3c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:02.600 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa639ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa639ffb640 1 -- 172.21.15.49:0/438619524 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63c052040 con 0x56509337d390 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa639ffb640 1 -- 172.21.15.49:0/438619524 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa63c005020 con 0x56509337d390 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa65f502740 1 -- 172.21.15.49:0/438619524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa644032020 con 0x56509337d390 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa639ffb640 1 -- 172.21.15.49:0/438619524 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa63c035040 con 0x56509337d390 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa65f502740 10 client.15822 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.593+0000 7fa65f502740 1 -- 172.21.15.49:0/438619524 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5650937d1d00 con 0x56509337d390 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.594+0000 7fa639ffb640 1 -- 172.21.15.49:0/438619524 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa644032020 con 0x56509337d390 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.594+0000 7fa639ffb640 1 -- 172.21.15.49:0/438619524 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa63c04e450 con 0x56509337d390 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.594+0000 7fa65f502740 10 client.15822 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.594+0000 7fa65f502740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.594+0000 7fa65f502740 20 client.15822 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.594+0000 7fa65f502740 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565093331da0 0x5650937d4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:02.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.594+0000 7fa65f502740 4 client.15822 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.594+0000 7fa65f502740 1 -- 172.21.15.49:0/438619524 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5650936b9850 con 0x565093331da0 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.594+0000 7fa651d9b640 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565093331da0 0x5650937d4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa651d9b640 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565093331da0 0x5650937d4550 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a3a45a2867af716 server_cookie=7206dc2f78a9b170 in_seq=0 out_seq=0 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa639ffb640 10 client.15822 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa639ffb640 1 -- 172.21.15.49:0/438619524 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x5650936b9850 con 0x565093331da0 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa639ffb640 10 client.15822 handle_command_reply: tid=0 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 client.15822 shutdown 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 -- 172.21.15.49:0/438619524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 msgr2=0x5650937596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x5650937596a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa63c02a930 tx=0x7fa63c005fd0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 -- 172.21.15.49:0/438619524 shutdown_connections 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565093331da0 0x5650937d4550 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56509339e070 0x565093759be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56509337d390 0x5650937596a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 --2- 172.21.15.49:0/438619524 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5650933751b0 0x565093759160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 -- 172.21.15.49:0/438619524 >> 172.21.15.49:0/438619524 conn(0x565093392460 msgr2=0x565093748aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa639ffb640 0 client.15822 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 -- 172.21.15.49:0/438619524 shutdown_connections 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 1 -- 172.21.15.49:0/438619524 wait complete. 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.595+0000 7fa65f502740 20 client.15822 trim_cache size 0 max 16384 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:38:02.603 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:02.604 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:02.605 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:02.606 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:02.606 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:38:02.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 -- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6400b6680 msgr2=0x7fa6400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:02.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6400b6680 0x7fa6400b8b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00b940 tx=0x7fa64c004b50 comp rx=0 tx=0).stop 2024-09-21T06:38:02.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 -- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654109e40 msgr2=0x7fa65419fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:02.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654109e40 0x7fa65419fe50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00b970 tx=0x7fa64c00bd70 comp rx=0 tx=0).stop 2024-09-21T06:38:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 -- 172.21.15.49:0/1924965014 shutdown_connections 2024-09-21T06:38:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa6400b6680 0x7fa6400b8b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa654109e40 0x7fa65419fe50 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa6541094f0 0x7fa65419abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 --2- 172.21.15.49:0/1924965014 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa654103bb0 0x7fa65419a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 -- 172.21.15.49:0/1924965014 >> 172.21.15.49:0/1924965014 conn(0x7fa6540ff600 msgr2=0x7fa654101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 -- 172.21.15.49:0/1924965014 shutdown_connections 2024-09-21T06:38:02.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:02.596+0000 7fa658f8e640 1 -- 172.21.15.49:0/1924965014 wait complete. 2024-09-21T06:38:03.363 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:38:03.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:38:03.623 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:03.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:03 smithi049 ceph-mon[31177]: pgmap v361: 97 pgs: 97 active+clean; 1.6 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:38:03.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:03 smithi098 ceph-mon[34704]: pgmap v361: 97 pgs: 97 active+clean; 1.6 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:38:03.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:03 smithi079 ceph-mon[34346]: pgmap v361: 97 pgs: 97 active+clean; 1.6 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.097+0000 7fc44a468640 1 -- 172.21.15.49:0/2250358527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4441094a0 msgr2=0x7fc4441098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.097+0000 7fc44a468640 1 --2- 172.21.15.49:0/2250358527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4441094a0 0x7fc4441098b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009900 tx=0x7fc42c02a410 comp rx=0 tx=0).stop 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.097+0000 7fc44a468640 1 -- 172.21.15.49:0/2250358527 shutdown_connections 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.097+0000 7fc44a468640 1 --2- 172.21.15.49:0/2250358527 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc444109df0 0x7fc444110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.097+0000 7fc44a468640 1 --2- 172.21.15.49:0/2250358527 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc4441094a0 0x7fc4441098b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.097+0000 7fc44a468640 1 --2- 172.21.15.49:0/2250358527 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc444103b60 0x7fc444103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.097+0000 7fc44a468640 1 -- 172.21.15.49:0/2250358527 >> 172.21.15.49:0/2250358527 conn(0x7fc44407b850 msgr2=0x7fc44407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.097+0000 7fc44a468640 1 -- 172.21.15.49:0/2250358527 shutdown_connections 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.097+0000 7fc44a468640 1 -- 172.21.15.49:0/2250358527 wait complete. 2024-09-21T06:38:04.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.098+0000 7fc44a468640 1 Processor -- start 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.098+0000 7fc44a468640 1 -- start start 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.098+0000 7fc44a468640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc444103b60 0x7fc444075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.098+0000 7fc44a468640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4441094a0 0x7fc444075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.098+0000 7fc44a468640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc444109df0 0x7fc444076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.098+0000 7fc44a468640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc444113ab0 con 0x7fc444109df0 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.098+0000 7fc44a468640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc444113930 con 0x7fc4441094a0 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.098+0000 7fc44a468640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc444113c30 con 0x7fc444103b60 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc448a05640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc444109df0 0x7fc444076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc448a05640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc444109df0 0x7fc444076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46082/0 (socket says 172.21.15.49:46082) 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc448a05640 1 -- 172.21.15.49:0/3299644793 learned_addr learned my addr 172.21.15.49:0/3299644793 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc443fff640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc444103b60 0x7fc444075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc43bfff640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4441094a0 0x7fc444075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc448a05640 1 -- 172.21.15.49:0/3299644793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc444103b60 msgr2=0x7fc444075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc448a05640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc444103b60 0x7fc444075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc448a05640 1 -- 172.21.15.49:0/3299644793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4441094a0 msgr2=0x7fc444075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc448a05640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4441094a0 0x7fc444075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc448a05640 1 -- 172.21.15.49:0/3299644793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4441a8610 con 0x7fc444109df0 2024-09-21T06:38:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc43bfff640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4441094a0 0x7fc444075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.099+0000 7fc448a05640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc444109df0 0x7fc444076190 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00cce0 tx=0x7fc43c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:04.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.100+0000 7fc441ffb640 1 -- 172.21.15.49:0/3299644793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c00f450 con 0x7fc444109df0 2024-09-21T06:38:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.100+0000 7fc441ffb640 1 -- 172.21.15.49:0/3299644793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc43c00faa0 con 0x7fc444109df0 2024-09-21T06:38:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.100+0000 7fc441ffb640 1 -- 172.21.15.49:0/3299644793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43c018a80 con 0x7fc444109df0 2024-09-21T06:38:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.100+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4441a8900 con 0x7fc444109df0 2024-09-21T06:38:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.100+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4441a8dc0 con 0x7fc444109df0 2024-09-21T06:38:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.101+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc444103f70 con 0x7fc444109df0 2024-09-21T06:38:04.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.103+0000 7fc441ffb640 1 -- 172.21.15.49:0/3299644793 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fc43c00fc50 con 0x7fc444109df0 2024-09-21T06:38:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.104+0000 7fc441ffb640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4300b6680 0x7fc4300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.104+0000 7fc443fff640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4300b6680 0x7fc4300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:04.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.104+0000 7fc441ffb640 1 -- 172.21.15.49:0/3299644793 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fc43c0e80f0 con 0x7fc444109df0 2024-09-21T06:38:04.107 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.104+0000 7fc443fff640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4300b6680 0x7fc4300b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc444077160 tx=0x7fc43400a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:04.110 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.107+0000 7fc441ffb640 1 -- 172.21.15.49:0/3299644793 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc43c014030 con 0x7fc444109df0 2024-09-21T06:38:04.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.334+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc444076a10 con 0x7fc444109df0 2024-09-21T06:38:04.337 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.335+0000 7fc441ffb640 1 -- 172.21.15.49:0/3299644793 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11894 (secure 0 0 0) 0x7fc43c0ae5c0 con 0x7fc444109df0 2024-09-21T06:38:04.338 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:38:04.338 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"btime":"2024-09-21T06:37:49:249607+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:37:48.552776+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:38:04.338 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-09-21T06:38:04.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4300b6680 msgr2=0x7fc4300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:04.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4300b6680 0x7fc4300b8b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc444077160 tx=0x7fc43400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc444109df0 msgr2=0x7fc444076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:04.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc444109df0 0x7fc444076190 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc43c00cce0 tx=0x7fc43c00a620 comp rx=0 tx=0).stop 2024-09-21T06:38:04.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 shutdown_connections 2024-09-21T06:38:04.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc4300b6680 0x7fc4300b8b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc444109df0 0x7fc444076190 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc4441094a0 0x7fc444075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 --2- 172.21.15.49:0/3299644793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc444103b60 0x7fc444075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:04.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 >> 172.21.15.49:0/3299644793 conn(0x7fc44407b850 msgr2=0x7fc4441054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:04.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.337+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 shutdown_connections 2024-09-21T06:38:04.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:04.338+0000 7fc44a468640 1 -- 172.21.15.49:0/3299644793 wait complete. 2024-09-21T06:38:04.949 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:38:05.205 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:05.618 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:05 smithi049 ceph-mon[31177]: pgmap v362: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 KiB/s wr, 29 op/s 2024-09-21T06:38:05.618 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:05 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3299644793' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:05.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.636+0000 7f9183636640 1 -- 172.21.15.49:0/2137656225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c10ddf0 msgr2=0x7f917c110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.636+0000 7f9183636640 1 --2- 172.21.15.49:0/2137656225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c10ddf0 0x7f917c110300 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9174009ca0 tx=0x7f917402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.636+0000 7f9183636640 1 -- 172.21.15.49:0/2137656225 shutdown_connections 2024-09-21T06:38:05.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.636+0000 7f9183636640 1 --2- 172.21.15.49:0/2137656225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c10ddf0 0x7f917c110300 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.636+0000 7f9183636640 1 --2- 172.21.15.49:0/2137656225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f917c105270 0x7f917c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.636+0000 7f9183636640 1 --2- 172.21.15.49:0/2137656225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f917c104840 0x7f917c104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.636+0000 7f9183636640 1 -- 172.21.15.49:0/2137656225 >> 172.21.15.49:0/2137656225 conn(0x7f917c079730 msgr2=0x7f917c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.639 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.636+0000 7f9183636640 1 -- 172.21.15.49:0/2137656225 shutdown_connections 2024-09-21T06:38:05.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.636+0000 7f9183636640 1 -- 172.21.15.49:0/2137656225 wait complete. 2024-09-21T06:38:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9183636640 1 Processor -- start 2024-09-21T06:38:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9183636640 1 -- start start 2024-09-21T06:38:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9183636640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f917c104840 0x7f917c19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9183636640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c105270 0x7f917c19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9183636640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f917c10ddf0 0x7f917c19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9183636640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f917c113a90 con 0x7f917c105270 2024-09-21T06:38:05.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9183636640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f917c113910 con 0x7f917c10ddf0 2024-09-21T06:38:05.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9183636640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f917c113c10 con 0x7f917c104840 2024-09-21T06:38:05.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9180bd1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c105270 0x7f917c19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9180bd1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c105270 0x7f917c19aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46092/0 (socket says 172.21.15.49:46092) 2024-09-21T06:38:05.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f9180bd1640 1 -- 172.21.15.49:0/2838296720 learned_addr learned my addr 172.21.15.49:0/2838296720 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:05.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.637+0000 7f91813d2640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f917c104840 0x7f917c19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9181bd3640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f917c10ddf0 0x7f917c19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9180bd1640 1 -- 172.21.15.49:0/2838296720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f917c104840 msgr2=0x7f917c19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9180bd1640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f917c104840 0x7f917c19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9180bd1640 1 -- 172.21.15.49:0/2838296720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f917c10ddf0 msgr2=0x7f917c19fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9180bd1640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f917c10ddf0 0x7f917c19fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9180bd1640 1 -- 172.21.15.49:0/2838296720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c1a03f0 con 0x7f917c105270 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9181bd3640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f917c10ddf0 0x7f917c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9180bd1640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c105270 0x7f917c19aa20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f916c00c970 tx=0x7f916c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f91727fc640 1 -- 172.21.15.49:0/2838296720 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c004220 con 0x7f917c105270 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9183636640 1 -- 172.21.15.49:0/2838296720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f917c1a06e0 con 0x7f917c105270 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f91727fc640 1 -- 172.21.15.49:0/2838296720 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f916c0043c0 con 0x7f917c105270 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f91727fc640 1 -- 172.21.15.49:0/2838296720 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f916c004a00 con 0x7f917c105270 2024-09-21T06:38:05.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.638+0000 7f9183636640 1 -- 172.21.15.49:0/2838296720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f917c1a6e40 con 0x7f917c105270 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.641+0000 7f91727fc640 1 -- 172.21.15.49:0/2838296720 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f916c0079b0 con 0x7f917c105270 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.641+0000 7f9189baa740 1 Processor -- start 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.641+0000 7f9189baa740 1 -- start start 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.641+0000 7f9189baa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485de070 0x5563489852c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.641+0000 7f9189baa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x556348985800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f9189baa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 0x556348985d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f9189baa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5563488fbea0 con 0x5563485b51b0 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f9189baa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5563488eb2d0 con 0x5563485bd390 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f9189baa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5563488ef0e0 con 0x5563485de070 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91813d2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x556348985800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91813d2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x556348985800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46106/0 (socket says 172.21.15.49:46106) 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91813d2640 1 -- 172.21.15.49:0/2169626119 learned_addr learned my addr 172.21.15.49:0/2169626119 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f9181bd3640 1 --2- 172.21.15.49:0/2169626119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485de070 0x5563489852c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f9180bd1640 1 --2- 172.21.15.49:0/2169626119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 0x556348985d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91813d2640 1 -- 172.21.15.49:0/2169626119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485de070 msgr2=0x5563489852c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91727fc640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91680b6680 0x7f91680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91813d2640 1 --2- 172.21.15.49:0/2169626119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485de070 0x5563489852c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91813d2640 1 -- 172.21.15.49:0/2169626119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 msgr2=0x556348985d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91813d2640 1 --2- 172.21.15.49:0/2169626119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 0x556348985d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91813d2640 1 -- 172.21.15.49:0/2169626119 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556348649650 con 0x5563485b51b0 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f9181bd3640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91680b6680 0x7f91680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91727fc640 1 -- 172.21.15.49:0/2838296720 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f916c0e74c0 con 0x7f917c105270 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.642+0000 7f91813d2640 1 --2- 172.21.15.49:0/2169626119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x556348985800 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f917800bcb0 tx=0x7f91780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5757611bf5f4c648 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.643+0000 7f91677fe640 1 -- 172.21.15.49:0/2169626119 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178004020 con 0x5563485b51b0 2024-09-21T06:38:05.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.643+0000 7f91677fe640 1 -- 172.21.15.49:0/2169626119 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91780054d0 con 0x5563485b51b0 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.643+0000 7f91677fe640 1 -- 172.21.15.49:0/2169626119 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178004cb0 con 0x5563485b51b0 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 -- 172.21.15.49:0/2169626119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 msgr2=0x556348985800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9181bd3640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91680b6680 0x7f91680b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9174005cc0 tx=0x7f91740095c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 --2- 172.21.15.49:0/2169626119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x556348985800 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f917800bcb0 tx=0x7f91780107a0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 -- 172.21.15.49:0/2169626119 shutdown_connections 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 --2- 172.21.15.49:0/2169626119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 0x556348985d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 --2- 172.21.15.49:0/2169626119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x556348985800 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 --2- 172.21.15.49:0/2169626119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485de070 0x5563489852c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 -- 172.21.15.49:0/2169626119 >> 172.21.15.49:0/2169626119 conn(0x5563485d2460 msgr2=0x5563489831b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 -- 172.21.15.49:0/2169626119 shutdown_connections 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 -- 172.21.15.49:0/2169626119 wait complete. 2024-09-21T06:38:05.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 -- start start 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.644+0000 7f9189baa740 1 Processor -- start 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f9189baa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x5563489909f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f9189baa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 0x556348990f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f9189baa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485de070 0x55634899cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f9189baa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55634874c700 con 0x5563485b51b0 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f9189baa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556348886160 con 0x5563485de070 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f9189baa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556348993aa0 con 0x5563485bd390 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f9189baa740 10 client.0 _ll_register_callbacks cb 0x55634889f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f91813d2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x5563489909f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f91813d2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x5563489909f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46108/0 (socket says 172.21.15.49:46108) 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f91813d2640 1 -- 172.21.15.49:0/908253590 learned_addr learned my addr 172.21.15.49:0/908253590 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f9180bd1640 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 0x556348990f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f9181bd3640 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485de070 0x55634899cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f91813d2640 1 -- 172.21.15.49:0/908253590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 msgr2=0x556348990f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f91813d2640 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 0x556348990f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f91813d2640 1 -- 172.21.15.49:0/908253590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485de070 msgr2=0x55634899cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.645+0000 7f91813d2640 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485de070 0x55634899cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f91813d2640 1 -- 172.21.15.49:0/908253590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563488b3c90 con 0x5563485b51b0 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f91813d2640 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x5563489909f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9178000c00 tx=0x7f917800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46cb360df3681943 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f9164ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f9164ff9640 1 -- 172.21.15.49:0/908253590 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917802b060 con 0x5563485b51b0 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f9189baa740 1 -- 172.21.15.49:0/908253590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91780054d0 con 0x5563485b51b0 2024-09-21T06:38:05.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f9164ff9640 1 -- 172.21.15.49:0/908253590 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9178004bc0 con 0x5563485b51b0 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f9164ff9640 1 -- 172.21.15.49:0/908253590 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f91780046c0 con 0x5563485b51b0 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f9189baa740 10 client.15840 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f9189baa740 1 -- 172.21.15.49:0/908253590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55634899f7f0 con 0x5563485b51b0 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f9164ff9640 1 -- 172.21.15.49:0/908253590 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f91780054d0 con 0x5563485b51b0 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.646+0000 7f9164ff9640 1 -- 172.21.15.49:0/908253590 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f9178011880 con 0x5563485b51b0 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.647+0000 7f9189baa740 10 client.15840 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.647+0000 7f9189baa740 10 client.15840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.647+0000 7f9189baa740 20 client.15840 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.647+0000 7f9189baa740 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55634859c9f0 0x5563489a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.647+0000 7f9189baa740 4 client.15840 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.647+0000 7f9189baa740 1 -- 172.21.15.49:0/908253590 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563488fddf0 con 0x55634859c9f0 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.647+0000 7f9180bd1640 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55634859c9f0 0x5563489a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.647+0000 7f9180bd1640 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55634859c9f0 0x5563489a2bb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f920049b65b09f6 server_cookie=741384a28a853dc8 in_seq=0 out_seq=0 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.647+0000 7f9164ff9640 10 client.15840 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.648+0000 7f9164ff9640 1 -- 172.21.15.49:0/908253590 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5563488fddf0 con 0x55634859c9f0 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.648+0000 7f9164ff9640 10 client.15840 handle_command_reply: tid=0 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.648+0000 7f9189baa740 1 client.15840 shutdown 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 -- 172.21.15.49:0/908253590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 msgr2=0x5563489909f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x5563489909f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9178000c00 tx=0x7f917800bfd0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 -- 172.21.15.49:0/908253590 shutdown_connections 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55634859c9f0 0x5563489a2bb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485de070 0x55634899cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 0x556348990f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 --2- 172.21.15.49:0/908253590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485b51b0 0x5563489909f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 -- 172.21.15.49:0/908253590 >> 172.21.15.49:0/908253590 conn(0x5563485d2460 msgr2=0x556348988450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9164ff9640 0 client.15840 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 -- 172.21.15.49:0/908253590 shutdown_connections 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 1 -- 172.21.15.49:0/908253590 wait complete. 2024-09-21T06:38:05.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.649+0000 7f9189baa740 20 client.15840 trim_cache size 0 max 16384 2024-09-21T06:38:05.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9189baa740 1 Processor -- start 2024-09-21T06:38:05.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9189baa740 1 -- start start 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9189baa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485b51b0 0x556348990f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9189baa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 0x5563489928d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9189baa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x55634899cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9189baa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f917c1b2150 con 0x5563485de070 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9189baa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f917c1afa20 con 0x5563485bd390 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9189baa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f917c1ad890 con 0x5563485b51b0 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9181bd3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x55634899cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9181bd3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x55634899cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46124/0 (socket says 172.21.15.49:46124) 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9181bd3640 1 -- 172.21.15.49:0/4184265657 learned_addr learned my addr 172.21.15.49:0/4184265657 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f91813d2640 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485b51b0 0x556348990f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9180bd1640 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 0x5563489928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9181bd3640 1 -- 172.21.15.49:0/4184265657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485b51b0 msgr2=0x556348990f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9181bd3640 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485b51b0 0x556348990f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9181bd3640 1 -- 172.21.15.49:0/4184265657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 msgr2=0x5563489928d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9181bd3640 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 0x5563489928d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9181bd3640 1 -- 172.21.15.49:0/4184265657 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556348983b20 con 0x5563485de070 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.663+0000 7f9180bd1640 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 0x5563489928d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.664+0000 7f9181bd3640 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x55634899cd30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9174031fc0 tx=0x7f9174041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3db88f0148bcf2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.664+0000 7f9166ffd640 1 -- 172.21.15.49:0/4184265657 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174053070 con 0x5563485de070 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.664+0000 7f9166ffd640 1 -- 172.21.15.49:0/4184265657 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9174036040 con 0x5563485de070 2024-09-21T06:38:05.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.664+0000 7f9166ffd640 1 -- 172.21.15.49:0/4184265657 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917402f8c0 con 0x5563485de070 2024-09-21T06:38:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 -- 172.21.15.49:0/4184265657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 msgr2=0x55634899cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x55634899cd30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9174031fc0 tx=0x7f9174041000 comp rx=0 tx=0).stop 2024-09-21T06:38:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 -- 172.21.15.49:0/4184265657 shutdown_connections 2024-09-21T06:38:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x55634899cd30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485bd390 0x5563489928d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 --2- 172.21.15.49:0/4184265657 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485b51b0 0x556348990f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 -- 172.21.15.49:0/4184265657 >> 172.21.15.49:0/4184265657 conn(0x5563485d2460 msgr2=0x5563489862f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 -- 172.21.15.49:0/4184265657 shutdown_connections 2024-09-21T06:38:05.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 -- 172.21.15.49:0/4184265657 wait complete. 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 -- start start 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.665+0000 7f9189baa740 1 Processor -- start 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9189baa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485b51b0 0x5563489a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9189baa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 0x5563489a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9189baa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x5563489a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9189baa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f917c1adee0 con 0x5563485de070 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9189baa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f917c1af350 con 0x5563485b51b0 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9189baa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f917c1ae5b0 con 0x5563485bd390 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9189baa740 10 client.0 _ll_register_callbacks cb 0x7f916c0eaee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:05.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9181bd3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x5563489a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f91813d2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485b51b0 0x5563489a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9181bd3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x5563489a5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46132/0 (socket says 172.21.15.49:46132) 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9181bd3640 1 -- 172.21.15.49:0/3999161769 learned_addr learned my addr 172.21.15.49:0/3999161769 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9180bd1640 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 0x5563489a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9181bd3640 1 -- 172.21.15.49:0/3999161769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 msgr2=0x5563489a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9181bd3640 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 0x5563489a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9181bd3640 1 -- 172.21.15.49:0/3999161769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485b51b0 msgr2=0x5563489a50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9181bd3640 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485b51b0 0x5563489a50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9181bd3640 1 -- 172.21.15.49:0/3999161769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55634897e5d0 con 0x5563485de070 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9181bd3640 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x5563489a5b60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9174031cf0 tx=0x7f9174004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2644ffc45ed3e535 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.666+0000 7f9164ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9164ff9640 1 -- 172.21.15.49:0/3999161769 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917405e060 con 0x5563485de070 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9164ff9640 1 -- 172.21.15.49:0/3999161769 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f917402f660 con 0x5563485de070 2024-09-21T06:38:05.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9189baa740 1 -- 172.21.15.49:0/3999161769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9174036040 con 0x5563485de070 2024-09-21T06:38:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9164ff9640 1 -- 172.21.15.49:0/3999161769 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9174053070 con 0x5563485de070 2024-09-21T06:38:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9189baa740 10 client.15846 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9189baa740 1 -- 172.21.15.49:0/3999161769 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556348a116d0 con 0x5563485de070 2024-09-21T06:38:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9164ff9640 1 -- 172.21.15.49:0/3999161769 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9174036040 con 0x5563485de070 2024-09-21T06:38:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9164ff9640 1 -- 172.21.15.49:0/3999161769 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f9174030930 con 0x5563485de070 2024-09-21T06:38:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9189baa740 10 client.15846 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9189baa740 10 client.15846 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:38:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9189baa740 20 client.15846 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:05.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9189baa740 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x556348571da0 0x556348a13d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9189baa740 4 client.15846 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.667+0000 7f9189baa740 1 -- 172.21.15.49:0/3999161769 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563488f98a0 con 0x556348571da0 2024-09-21T06:38:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.668+0000 7f91813d2640 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x556348571da0 0x556348a13d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.668+0000 7f91813d2640 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x556348571da0 0x556348a13d90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ee56944333097c6 server_cookie=5b27c321b25a31ee in_seq=0 out_seq=0 2024-09-21T06:38:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.668+0000 7f9164ff9640 10 client.15846 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:38:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.668+0000 7f9164ff9640 1 -- 172.21.15.49:0/3999161769 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563488f98a0 con 0x556348571da0 2024-09-21T06:38:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.668+0000 7f9164ff9640 10 client.15846 handle_command_reply: tid=0 2024-09-21T06:38:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.668+0000 7f9189baa740 1 client.15846 shutdown 2024-09-21T06:38:05.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.668+0000 7f9189baa740 1 -- 172.21.15.49:0/3999161769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 msgr2=0x5563489a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x5563489a5b60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9174031cf0 tx=0x7f9174004600 comp rx=0 tx=0).stop 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 1 -- 172.21.15.49:0/3999161769 shutdown_connections 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x556348571da0 0x556348a13d90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563485de070 0x5563489a5b60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563485bd390 0x5563489a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 1 --2- 172.21.15.49:0/3999161769 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563485b51b0 0x5563489a50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 1 -- 172.21.15.49:0/3999161769 >> 172.21.15.49:0/3999161769 conn(0x5563485d2460 msgr2=0x556348986a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9164ff9640 0 client.15846 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 1 -- 172.21.15.49:0/3999161769 shutdown_connections 2024-09-21T06:38:05.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 1 -- 172.21.15.49:0/3999161769 wait complete. 2024-09-21T06:38:05.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9189baa740 20 client.15846 trim_cache size 0 max 16384 2024-09-21T06:38:05.678 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:38:05.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 -- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91680b6680 msgr2=0x7f91680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91680b6680 0x7f91680b8b90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9174005cc0 tx=0x7f91740095c0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 -- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c105270 msgr2=0x7f917c19aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c105270 0x7f917c19aa20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f916c00c970 tx=0x7f916c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 -- 172.21.15.49:0/2838296720 shutdown_connections 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91680b6680 0x7f91680b8b90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f917c10ddf0 0x7f917c19fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f917c105270 0x7f917c19aa20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 --2- 172.21.15.49:0/2838296720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f917c104840 0x7f917c19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.669+0000 7f9183636640 1 -- 172.21.15.49:0/2838296720 >> 172.21.15.49:0/2838296720 conn(0x7f917c079730 msgr2=0x7f917c0ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.670+0000 7f9183636640 1 -- 172.21.15.49:0/2838296720 shutdown_connections 2024-09-21T06:38:05.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:05.670+0000 7f9183636640 1 -- 172.21.15.49:0/2838296720 wait complete. 2024-09-21T06:38:05.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:05 smithi098 ceph-mon[34704]: pgmap v362: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 KiB/s wr, 29 op/s 2024-09-21T06:38:05.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:05 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3299644793' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:05.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:05 smithi079 ceph-mon[34346]: pgmap v362: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 38 KiB/s wr, 29 op/s 2024-09-21T06:38:05.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:05 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3299644793' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:06.462 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:38:06.722 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:07.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.203+0000 7f2568086640 1 -- 172.21.15.49:0/4253498549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 msgr2=0x7f2560110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:07.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.203+0000 7f2568086640 1 --2- 172.21.15.49:0/4253498549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 0x7f2560110630 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2558009ca0 tx=0x7f255802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.203+0000 7f2568086640 1 -- 172.21.15.49:0/4253498549 shutdown_connections 2024-09-21T06:38:07.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.203+0000 7f2568086640 1 --2- 172.21.15.49:0/4253498549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 0x7f2560110630 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.203+0000 7f2568086640 1 --2- 172.21.15.49:0/4253498549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25601094b0 0x7f25601098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.203+0000 7f2568086640 1 --2- 172.21.15.49:0/4253498549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560101f70 0x7f2560102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.203+0000 7f2568086640 1 -- 172.21.15.49:0/4253498549 >> 172.21.15.49:0/4253498549 conn(0x7f2560077c60 msgr2=0x7f25600780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:07.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.203+0000 7f2568086640 1 -- 172.21.15.49:0/4253498549 shutdown_connections 2024-09-21T06:38:07.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.203+0000 7f2568086640 1 -- 172.21.15.49:0/4253498549 wait complete. 2024-09-21T06:38:07.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.204+0000 7f2568086640 1 Processor -- start 2024-09-21T06:38:07.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.204+0000 7f2568086640 1 -- start start 2024-09-21T06:38:07.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.204+0000 7f2568086640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560101f70 0x7f2560102f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2568086640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25601094b0 0x7f2560103450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2568086640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 0x7f2560103990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2568086640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2560113ac0 con 0x7f2560109e00 2024-09-21T06:38:07.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2568086640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2560113940 con 0x7f2560101f70 2024-09-21T06:38:07.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2568086640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2560113c40 con 0x7f25601094b0 2024-09-21T06:38:07.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2566623640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 0x7f2560103990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2566623640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 0x7f2560103990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59128/0 (socket says 172.21.15.49:59128) 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2566623640 1 -- 172.21.15.49:0/3330382152 learned_addr learned my addr 172.21.15.49:0/3330382152 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2565e22640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560101f70 0x7f2560102f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2565621640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25601094b0 0x7f2560103450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2566623640 1 -- 172.21.15.49:0/3330382152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25601094b0 msgr2=0x7f2560103450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2566623640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25601094b0 0x7f2560103450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2566623640 1 -- 172.21.15.49:0/3330382152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560101f70 msgr2=0x7f2560102f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2566623640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560101f70 0x7f2560102f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2566623640 1 -- 172.21.15.49:0/3330382152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25601a8770 con 0x7f2560109e00 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2565e22640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560101f70 0x7f2560102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:07.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.205+0000 7f2566623640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 0x7f2560103990 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f25580098d0 tx=0x7f25580317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:07.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.206+0000 7f2556ffd640 1 -- 172.21.15.49:0/3330382152 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558003b70 con 0x7f2560109e00 2024-09-21T06:38:07.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.206+0000 7f2556ffd640 1 -- 172.21.15.49:0/3330382152 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2558003d10 con 0x7f2560109e00 2024-09-21T06:38:07.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.206+0000 7f2568086640 1 -- 172.21.15.49:0/3330382152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25601a8a00 con 0x7f2560109e00 2024-09-21T06:38:07.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.206+0000 7f2556ffd640 1 -- 172.21.15.49:0/3330382152 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255802fa20 con 0x7f2560109e00 2024-09-21T06:38:07.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.206+0000 7f2568086640 1 -- 172.21.15.49:0/3330382152 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25601a8f40 con 0x7f2560109e00 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.208+0000 7f256e5fa740 1 Processor -- start 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.208+0000 7f2556ffd640 1 -- 172.21.15.49:0/3330382152 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f255802fc40 con 0x7f2560109e00 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f256e5fa740 1 -- start start 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e3f070 0x55a9391e66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e161b0 0x55a9391e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f256e5fa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a93915cea0 con 0x55a938e1e390 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f256e5fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a93914c2d0 con 0x55a938e161b0 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f256e5fa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a9391500e0 con 0x55a938e3f070 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f2565621640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f2565621640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391e7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59134/0 (socket says 172.21.15.49:59134) 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f2565621640 1 -- 172.21.15.49:0/4226401257 learned_addr learned my addr 172.21.15.49:0/4226401257 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:07.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f2565621640 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e3f070 0x55a9391e66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f2565e22640 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e161b0 0x55a9391e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.209+0000 7f2556ffd640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f254c0b6680 0x7f254c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2565621640 1 -- 172.21.15.49:0/4226401257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e3f070 msgr2=0x55a9391e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2565621640 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e3f070 0x55a9391e66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2566623640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f254c0b6680 0x7f254c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2565621640 1 -- 172.21.15.49:0/4226401257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e161b0 msgr2=0x55a9391e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2565621640 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e161b0 0x55a9391e6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2565621640 1 -- 172.21.15.49:0/4226401257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a938eaa650 con 0x55a938e1e390 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2565e22640 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e161b0 0x55a9391e6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2556ffd640 1 -- 172.21.15.49:0/3330382152 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f2558108a20 con 0x7f2560109e00 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2565621640 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391e7120 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2550012440 tx=0x7f255000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1917745ec1549bda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f254bfff640 1 -- 172.21.15.49:0/4226401257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550004250 con 0x55a938e1e390 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f2566623640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f254c0b6680 0x7f254c0b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2558106200 tx=0x7f255802a8c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:07.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f254bfff640 1 -- 172.21.15.49:0/4226401257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25500043f0 con 0x55a938e1e390 2024-09-21T06:38:07.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.210+0000 7f254bfff640 1 -- 172.21.15.49:0/4226401257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2550004e00 con 0x55a938e1e390 2024-09-21T06:38:07.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.211+0000 7f256e5fa740 1 -- 172.21.15.49:0/4226401257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 msgr2=0x55a9391e7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:07.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.211+0000 7f256e5fa740 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391e7120 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2550012440 tx=0x7f255000b790 comp rx=0 tx=0).stop 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.211+0000 7f256e5fa740 1 -- 172.21.15.49:0/4226401257 shutdown_connections 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.211+0000 7f256e5fa740 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391e7120 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.211+0000 7f256e5fa740 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e161b0 0x55a9391e6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.211+0000 7f256e5fa740 1 --2- 172.21.15.49:0/4226401257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e3f070 0x55a9391e66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.211+0000 7f256e5fa740 1 -- 172.21.15.49:0/4226401257 >> 172.21.15.49:0/4226401257 conn(0x55a938e33460 msgr2=0x55a9391e4590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.211+0000 7f256e5fa740 1 -- 172.21.15.49:0/4226401257 shutdown_connections 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.211+0000 7f256e5fa740 1 -- 172.21.15.49:0/4226401257 wait complete. 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f256e5fa740 1 -- start start 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f256e5fa740 1 Processor -- start 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 0x55a9391fe1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f256e5fa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a938fad700 con 0x55a938e1e390 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f256e5fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a9390e7160 con 0x55a938e3f070 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f256e5fa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a9391f4e80 con 0x55a938e161b0 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f256e5fa740 10 client.0 _ll_register_callbacks cb 0x55a9391009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f2565e22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f2565e22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59136/0 (socket says 172.21.15.49:59136) 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.212+0000 7f2565e22640 1 -- 172.21.15.49:0/2548845339 learned_addr learned my addr 172.21.15.49:0/2548845339 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f2565621640 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 0x55a9391fe1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f2565e22640 1 -- 172.21.15.49:0/2548845339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 msgr2=0x55a9391f1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f2565e22640 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f2565e22640 1 -- 172.21.15.49:0/2548845339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 msgr2=0x55a9391fe1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f2565e22640 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 0x55a9391fe1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f2565e22640 1 -- 172.21.15.49:0/2548845339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a939114c90 con 0x55a938e1e390 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f2565e22640 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f2250 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f255c013790 tx=0x7f255c013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f46ee50b690182 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:07.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f25497fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f25497fa640 1 -- 172.21.15.49:0/2548845339 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c011dd0 con 0x55a938e1e390 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f25497fa640 1 -- 172.21.15.49:0/2548845339 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f255c004020 con 0x55a938e1e390 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f256e5fa740 1 -- 172.21.15.49:0/2548845339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25500043f0 con 0x55a938e1e390 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f25497fa640 1 -- 172.21.15.49:0/2548845339 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f255c004260 con 0x55a938e1e390 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f256e5fa740 10 client.15858 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.213+0000 7f256e5fa740 1 -- 172.21.15.49:0/2548845339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a939200c10 con 0x55a938e1e390 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.214+0000 7f25497fa640 1 -- 172.21.15.49:0/2548845339 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25500043f0 con 0x55a938e1e390 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.214+0000 7f25497fa640 1 -- 172.21.15.49:0/2548845339 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f255c01a030 con 0x55a938e1e390 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.214+0000 7f256e5fa740 10 client.15858 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.214+0000 7f256e5fa740 10 client.15858 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.214+0000 7f256e5fa740 20 client.15858 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.214+0000 7f256e5fa740 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55a938dfd9f0 0x55a939204200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.214+0000 7f256e5fa740 4 client.15858 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:07.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.214+0000 7f256e5fa740 1 -- 172.21.15.49:0/2548845339 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a93915edf0 con 0x55a938dfd9f0 2024-09-21T06:38:07.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.214+0000 7f2565621640 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55a938dfd9f0 0x55a939204200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.215+0000 7f2565621640 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55a938dfd9f0 0x55a939204200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da4be79ef17ac15e server_cookie=a2f407997a707336 in_seq=0 out_seq=0 2024-09-21T06:38:07.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.215+0000 7f25497fa640 10 client.15858 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:38:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f25497fa640 1 -- 172.21.15.49:0/2548845339 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a93915edf0 con 0x55a938dfd9f0 2024-09-21T06:38:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f25497fa640 10 client.15858 handle_command_reply: tid=0 2024-09-21T06:38:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 client.15858 shutdown 2024-09-21T06:38:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 -- 172.21.15.49:0/2548845339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 msgr2=0x55a9391f2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f2250 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f255c013790 tx=0x7f255c013c50 comp rx=0 tx=0).stop 2024-09-21T06:38:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 -- 172.21.15.49:0/2548845339 shutdown_connections 2024-09-21T06:38:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55a938dfd9f0 0x55a939204200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 0x55a9391fe1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f2250 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 --2- 172.21.15.49:0/2548845339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391f1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f25497fa640 0 client.15858 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:38:07.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 -- 172.21.15.49:0/2548845339 >> 172.21.15.49:0/2548845339 conn(0x55a938e33460 msgr2=0x55a9391e9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:07.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 -- 172.21.15.49:0/2548845339 shutdown_connections 2024-09-21T06:38:07.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 1 -- 172.21.15.49:0/2548845339 wait complete. 2024-09-21T06:38:07.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.216+0000 7f256e5fa740 20 client.15858 trim_cache size 0 max 16384 2024-09-21T06:38:07.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.229+0000 7f256e5fa740 1 Processor -- start 2024-09-21T06:38:07.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.229+0000 7f256e5fa740 1 -- start start 2024-09-21T06:38:07.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e1e390 0x55a9391fe0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e3f070 0x55a9391eef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f256e5fa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f25601b42d0 con 0x55a938e3f070 2024-09-21T06:38:07.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f256e5fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25601b1ba0 con 0x55a938e1e390 2024-09-21T06:38:07.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f256e5fa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f25601afa10 con 0x55a938e161b0 2024-09-21T06:38:07.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e3f070 0x55a9391eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e3f070 0x55a9391eef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59148/0 (socket says 172.21.15.49:59148) 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 -- 172.21.15.49:0/628977836 learned_addr learned my addr 172.21.15.49:0/628977836 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 --2- 172.21.15.49:0/628977836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565e22640 1 --2- 172.21.15.49:0/628977836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e1e390 0x55a9391fe0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 -- 172.21.15.49:0/628977836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 msgr2=0x55a9391f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 --2- 172.21.15.49:0/628977836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 -- 172.21.15.49:0/628977836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e1e390 msgr2=0x55a9391fe0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 --2- 172.21.15.49:0/628977836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e1e390 0x55a9391fe0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 -- 172.21.15.49:0/628977836 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9391f2fd0 con 0x55a938e3f070 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f2565621640 1 --2- 172.21.15.49:0/628977836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e3f070 0x55a9391eef00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2550004810 tx=0x7f2550020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a81562af8b54c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.230+0000 7f254b7fe640 1 -- 172.21.15.49:0/628977836 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255002c070 con 0x55a938e3f070 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f254b7fe640 1 -- 172.21.15.49:0/628977836 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f255002d040 con 0x55a938e3f070 2024-09-21T06:38:07.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f254b7fe640 1 -- 172.21.15.49:0/628977836 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255000f650 con 0x55a938e3f070 2024-09-21T06:38:07.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f256e5fa740 1 -- 172.21.15.49:0/628977836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e3f070 msgr2=0x55a9391eef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:07.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f256e5fa740 1 --2- 172.21.15.49:0/628977836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e3f070 0x55a9391eef00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2550004810 tx=0x7f2550020040 comp rx=0 tx=0).stop 2024-09-21T06:38:07.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f256e5fa740 1 -- 172.21.15.49:0/628977836 shutdown_connections 2024-09-21T06:38:07.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f256e5fa740 1 --2- 172.21.15.49:0/628977836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e3f070 0x55a9391eef00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f256e5fa740 1 --2- 172.21.15.49:0/628977836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e1e390 0x55a9391fe0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f256e5fa740 1 --2- 172.21.15.49:0/628977836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f256e5fa740 1 -- 172.21.15.49:0/628977836 >> 172.21.15.49:0/628977836 conn(0x55a938e33460 msgr2=0x55a9391f1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f256e5fa740 1 -- 172.21.15.49:0/628977836 shutdown_connections 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.231+0000 7f256e5fa740 1 -- 172.21.15.49:0/628977836 wait complete. 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.232+0000 7f256e5fa740 1 -- start start 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.232+0000 7f256e5fa740 1 Processor -- start 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.232+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.232+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.232+0000 7f256e5fa740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 0x55a9391f6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.232+0000 7f256e5fa740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f25601b0060 con 0x55a938e1e390 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.232+0000 7f256e5fa740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25601b14d0 con 0x55a938e3f070 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.232+0000 7f256e5fa740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f25601b0730 con 0x55a938e161b0 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f256e5fa740 10 client.0 _ll_register_callbacks cb 0x7f255c009630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565e22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565e22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59156/0 (socket says 172.21.15.49:59156) 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565e22640 1 -- 172.21.15.49:0/1613902828 learned_addr learned my addr 172.21.15.49:0/1613902828 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565621640 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565621640 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 0x55a9391f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565e22640 1 -- 172.21.15.49:0/1613902828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 msgr2=0x55a9391faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565e22640 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565e22640 1 -- 172.21.15.49:0/1613902828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 msgr2=0x55a9391f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565e22640 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 0x55a9391f6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565e22640 1 -- 172.21.15.49:0/1613902828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a93926dba0 con 0x55a938e1e390 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f2565e22640 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f5f50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f255c00f4a0 tx=0x7f255c011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c33a1a4f2c1f47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f25497fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f25497fa640 1 -- 172.21.15.49:0/1613902828 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c00fb20 con 0x55a938e1e390 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f25497fa640 1 -- 172.21.15.49:0/1613902828 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f255c00fcc0 con 0x55a938e1e390 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.233+0000 7f256e5fa740 1 -- 172.21.15.49:0/1613902828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f255002d040 con 0x55a938e1e390 2024-09-21T06:38:07.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f25497fa640 1 -- 172.21.15.49:0/1613902828 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f255c03b050 con 0x55a938e1e390 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f256e5fa740 10 client.15864 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f256e5fa740 1 -- 172.21.15.49:0/1613902828 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a93926eca0 con 0x55a938e1e390 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f25497fa640 1 -- 172.21.15.49:0/1613902828 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f255002d040 con 0x55a938e1e390 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f25497fa640 1 -- 172.21.15.49:0/1613902828 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f255c01a040 con 0x55a938e1e390 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f256e5fa740 10 client.15864 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f256e5fa740 10 client.15864 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f256e5fa740 20 client.15864 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f256e5fa740 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55a938dd2da0 0x55a939271480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f256e5fa740 4 client.15864 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f256e5fa740 1 -- 172.21.15.49:0/1613902828 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a93915a8a0 con 0x55a938dd2da0 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.234+0000 7f2565621640 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55a938dd2da0 0x55a939271480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f25497fa640 10 client.15864 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f2565621640 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55a938dd2da0 0x55a939271480 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bd7e78577e265f5b server_cookie=1353e39003b2cd1a in_seq=0 out_seq=0 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f25497fa640 1 -- 172.21.15.49:0/1613902828 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a93915a8a0 con 0x55a938dd2da0 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f25497fa640 10 client.15864 handle_command_reply: tid=0 2024-09-21T06:38:07.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 client.15864 shutdown 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 -- 172.21.15.49:0/1613902828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 msgr2=0x55a9391f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f5f50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f255c00f4a0 tx=0x7f255c011c70 comp rx=0 tx=0).stop 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 -- 172.21.15.49:0/1613902828 shutdown_connections 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55a938dd2da0 0x55a939271480 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a938e3f070 0x55a9391f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a938e1e390 0x55a9391f5f50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 --2- 172.21.15.49:0/1613902828 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a938e161b0 0x55a9391faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f25497fa640 0 client.15864 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 -- 172.21.15.49:0/1613902828 >> 172.21.15.49:0/1613902828 conn(0x55a938e33460 msgr2=0x55a9391e76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.235+0000 7f256e5fa740 1 -- 172.21.15.49:0/1613902828 shutdown_connections 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f256e5fa740 1 -- 172.21.15.49:0/1613902828 wait complete. 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f256e5fa740 20 client.15864 trim_cache size 0 max 16384 2024-09-21T06:38:07.242 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:38:07.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 -- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f254c0b6680 msgr2=0x7f254c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f254c0b6680 0x7f254c0b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2558106200 tx=0x7f255802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 -- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 msgr2=0x7f2560103990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 0x7f2560103990 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f25580098d0 tx=0x7f25580317b0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 -- 172.21.15.49:0/3330382152 shutdown_connections 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f254c0b6680 0x7f254c0b8b90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2560109e00 0x7f2560103990 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f25601094b0 0x7f2560103450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 --2- 172.21.15.49:0/3330382152 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2560101f70 0x7f2560102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 -- 172.21.15.49:0/3330382152 >> 172.21.15.49:0/3330382152 conn(0x7f2560077c60 msgr2=0x7f2560107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 -- 172.21.15.49:0/3330382152 shutdown_connections 2024-09-21T06:38:07.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:07.236+0000 7f2568086640 1 -- 172.21.15.49:0/3330382152 wait complete. 2024-09-21T06:38:07.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:07 smithi049 ceph-mon[31177]: pgmap v363: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 KiB/s wr, 26 op/s 2024-09-21T06:38:07.798 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:07 smithi098 ceph-mon[34704]: pgmap v363: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 KiB/s wr, 26 op/s 2024-09-21T06:38:07.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:07 smithi079 ceph-mon[34346]: pgmap v363: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 35 KiB/s wr, 26 op/s 2024-09-21T06:38:07.927 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:38:08.189 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 -- 172.21.15.49:0/1511310654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8103b60 msgr2=0x7f8cf8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 --2- 172.21.15.49:0/1511310654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8103b60 0x7f8cf8103f70 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009900 tx=0x7f8cec02a410 comp rx=0 tx=0).stop 2024-09-21T06:38:08.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 -- 172.21.15.49:0/1511310654 shutdown_connections 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 --2- 172.21.15.49:0/1511310654 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf8109df0 0x7f8cf8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 --2- 172.21.15.49:0/1511310654 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cf81094a0 0x7f8cf81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 --2- 172.21.15.49:0/1511310654 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf8103b60 0x7f8cf8103f70 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 -- 172.21.15.49:0/1511310654 >> 172.21.15.49:0/1511310654 conn(0x7f8cf807b850 msgr2=0x7f8cf807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 -- 172.21.15.49:0/1511310654 shutdown_connections 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 -- 172.21.15.49:0/1511310654 wait complete. 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 Processor -- start 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.646+0000 7f8cff20e640 1 -- start start 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cff20e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf8103b60 0x7f8cf8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cff20e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf81094a0 0x7f8cf8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cff20e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cf8109df0 0x7f8cf8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cff20e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8113b00 con 0x7f8cf81094a0 2024-09-21T06:38:08.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cff20e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8113980 con 0x7f8cf8109df0 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cff20e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf8113c80 con 0x7f8cf8103b60 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf81094a0 0x7f8cf8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf81094a0 0x7f8cf8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59174/0 (socket says 172.21.15.49:59174) 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cf7fff640 1 -- 172.21.15.49:0/2927490793 learned_addr learned my addr 172.21.15.49:0/2927490793 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf8103b60 0x7f8cf8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cf8109df0 0x7f8cf8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cf7fff640 1 -- 172.21.15.49:0/2927490793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf8103b60 msgr2=0x7f8cf8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf8103b60 0x7f8cf8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cf7fff640 1 -- 172.21.15.49:0/2927490793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cf8109df0 msgr2=0x7f8cf8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:08.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cf8109df0 0x7f8cf8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cf7fff640 1 -- 172.21.15.49:0/2927490793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf81a87b0 con 0x7f8cf81094a0 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.647+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf81094a0 0x7f8cf8075c50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400d740 tx=0x7f8ce400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.648+0000 7f8cf5ffb640 1 -- 172.21.15.49:0/2927490793 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4017070 con 0x7f8cf81094a0 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.648+0000 7f8cff20e640 1 -- 172.21.15.49:0/2927490793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf81a8aa0 con 0x7f8cf81094a0 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.648+0000 7f8cf5ffb640 1 -- 172.21.15.49:0/2927490793 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce400de50 con 0x7f8cf81094a0 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.648+0000 7f8cf5ffb640 1 -- 172.21.15.49:0/2927490793 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400f620 con 0x7f8cf81094a0 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.648+0000 7f8cff20e640 1 -- 172.21.15.49:0/2927490793 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf81a9000 con 0x7f8cf81094a0 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.650+0000 7f8d05782740 1 Processor -- start 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8d05782740 1 -- start start 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cf5ffb640 1 -- 172.21.15.49:0/2927490793 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8ce401a070 con 0x7f8cf81094a0 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8d05782740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 0x55aba17e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8d05782740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba14171b0 0x55aba17e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8d05782740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17e7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8d05782740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55aba175dea0 con 0x55aba141f390 2024-09-21T06:38:08.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8d05782740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aba174d2d0 con 0x55aba1440070 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8d05782740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aba17510e0 con 0x55aba14171b0 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17e7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17e7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59190/0 (socket says 172.21.15.49:59190) 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cf7fff640 1 -- 172.21.15.49:0/1578270078 learned_addr learned my addr 172.21.15.49:0/1578270078 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/1578270078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 0x55aba17e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/1578270078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba14171b0 0x55aba17e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cf7fff640 1 -- 172.21.15.49:0/1578270078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba14171b0 msgr2=0x55aba17e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/1578270078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba14171b0 0x55aba17e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cf7fff640 1 -- 172.21.15.49:0/1578270078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 msgr2=0x55aba17e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/1578270078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 0x55aba17e72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.651+0000 7f8cf7fff640 1 -- 172.21.15.49:0/1578270078 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba14ab650 con 0x55aba141f390 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.652+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/1578270078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17e7d40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40e4810 tx=0x7f8ce40ef860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ebcaa76cdd5276 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.652+0000 7f8ce2ffd640 1 -- 172.21.15.49:0/1578270078 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40fa070 con 0x55aba141f390 2024-09-21T06:38:08.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.652+0000 7f8cf5ffb640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ce80b6680 0x7f8ce80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.652+0000 7f8ce2ffd640 1 -- 172.21.15.49:0/1578270078 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce40e7ad0 con 0x55aba141f390 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.652+0000 7f8ce2ffd640 1 -- 172.21.15.49:0/1578270078 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40f59b0 con 0x55aba141f390 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.652+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ce80b6680 0x7f8ce80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.652+0000 7f8cf5ffb640 1 -- 172.21.15.49:0/2927490793 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8ce40e7170 con 0x7f8cf81094a0 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 -- 172.21.15.49:0/1578270078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 msgr2=0x55aba17e7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ce80b6680 0x7f8ce80b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0008e40 tx=0x7f8cf00085f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 --2- 172.21.15.49:0/1578270078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17e7d40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40e4810 tx=0x7f8ce40ef860 comp rx=0 tx=0).stop 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 -- 172.21.15.49:0/1578270078 shutdown_connections 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 --2- 172.21.15.49:0/1578270078 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17e7d40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 --2- 172.21.15.49:0/1578270078 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba14171b0 0x55aba17e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 --2- 172.21.15.49:0/1578270078 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 0x55aba17e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 -- 172.21.15.49:0/1578270078 >> 172.21.15.49:0/1578270078 conn(0x55aba1434460 msgr2=0x55aba17e51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:08.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 -- 172.21.15.49:0/1578270078 shutdown_connections 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 -- 172.21.15.49:0/1578270078 wait complete. 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 -- start start 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.653+0000 7f8d05782740 1 Processor -- start 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8d05782740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 0x55aba17f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8d05782740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 0x55aba17f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8d05782740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba1440070 0x55aba17fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8d05782740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55aba15ae700 con 0x55aba1440070 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8d05782740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55aba16e8160 con 0x55aba14171b0 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8d05782740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55aba17f5aa0 con 0x55aba141f390 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8d05782740 10 client.0 _ll_register_callbacks cb 0x55aba17019e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cfd7ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba1440070 0x55aba17fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cfd7ab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba1440070 0x55aba17fedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59194/0 (socket says 172.21.15.49:59194) 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cfd7ab640 1 -- 172.21.15.49:0/2666996465 learned_addr learned my addr 172.21.15.49:0/2666996465 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:08.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 0x55aba17f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 0x55aba17f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cfd7ab640 1 -- 172.21.15.49:0/2666996465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 msgr2=0x55aba17f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 0x55aba17f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cfd7ab640 1 -- 172.21.15.49:0/2666996465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 msgr2=0x55aba17f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 0x55aba17f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.654+0000 7f8cfd7ab640 1 -- 172.21.15.49:0/2666996465 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba1715c90 con 0x55aba1440070 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba1440070 0x55aba17fedc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00085c0 tx=0x7f8cf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d065e750e2d6b6ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8cd7fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8cd7fff640 1 -- 172.21.15.49:0/2666996465 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf001cd30 con 0x55aba1440070 2024-09-21T06:38:08.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8cd7fff640 1 -- 172.21.15.49:0/2666996465 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8cf0028480 con 0x55aba1440070 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8d05782740 1 -- 172.21.15.49:0/2666996465 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce40e7ad0 con 0x55aba1440070 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8cd7fff640 1 -- 172.21.15.49:0/2666996465 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8cf0028680 con 0x55aba1440070 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8d05782740 10 client.15876 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8d05782740 1 -- 172.21.15.49:0/2666996465 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aba18018a0 con 0x55aba1440070 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8cd7fff640 1 -- 172.21.15.49:0/2666996465 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce40e7ad0 con 0x55aba1440070 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.655+0000 7f8cd7fff640 1 -- 172.21.15.49:0/2666996465 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f8cf001d850 con 0x55aba1440070 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.656+0000 7f8d05782740 10 client.15876 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.656+0000 7f8d05782740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.656+0000 7f8d05782740 20 client.15876 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.656+0000 7f8d05782740 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55aba13fe9f0 0x55aba1804dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.656+0000 7f8d05782740 4 client.15876 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.656+0000 7f8d05782740 1 -- 172.21.15.49:0/2666996465 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aba175fdf0 con 0x55aba13fe9f0 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.656+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55aba13fe9f0 0x55aba1804dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.669 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.656+0000 7f8cd7fff640 10 client.15876 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.656+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55aba13fe9f0 0x55aba1804dd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d8f29932da993a5 server_cookie=c1a9034b778dabd0 in_seq=0 out_seq=0 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.657+0000 7f8cd7fff640 1 -- 172.21.15.49:0/2666996465 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aba175fdf0 con 0x55aba13fe9f0 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.657+0000 7f8cd7fff640 10 client.15876 handle_command_reply: tid=0 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.657+0000 7f8d05782740 1 client.15876 shutdown 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.657+0000 7f8d05782740 1 -- 172.21.15.49:0/2666996465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba1440070 msgr2=0x55aba17fedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.657+0000 7f8d05782740 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba1440070 0x55aba17fedc0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00085c0 tx=0x7f8cf0004a40 comp rx=0 tx=0).stop 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8d05782740 1 -- 172.21.15.49:0/2666996465 shutdown_connections 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8d05782740 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55aba13fe9f0 0x55aba1804dd0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8d05782740 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba1440070 0x55aba17fedc0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8d05782740 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 0x55aba17f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8d05782740 1 --2- 172.21.15.49:0/2666996465 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 0x55aba17f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8d05782740 1 -- 172.21.15.49:0/2666996465 >> 172.21.15.49:0/2666996465 conn(0x55aba1434460 msgr2=0x55aba17e82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:08.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8cd7fff640 0 client.15876 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:08.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8d05782740 1 -- 172.21.15.49:0/2666996465 shutdown_connections 2024-09-21T06:38:08.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8d05782740 1 -- 172.21.15.49:0/2666996465 wait complete. 2024-09-21T06:38:08.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.658+0000 7f8d05782740 20 client.15876 trim_cache size 0 max 16384 2024-09-21T06:38:08.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.671+0000 7f8d05782740 1 Processor -- start 2024-09-21T06:38:08.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.671+0000 7f8d05782740 1 -- start start 2024-09-21T06:38:08.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8d05782740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 0x55aba17e8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8d05782740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8d05782740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba1440070 0x55aba17fecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8d05782740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b4320 con 0x55aba141f390 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8d05782740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b1bf0 con 0x55aba14171b0 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8d05782740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81afa60 con 0x55aba1440070 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cf7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17f2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59202/0 (socket says 172.21.15.49:59202) 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cf7fff640 1 -- 172.21.15.49:0/500535701 learned_addr learned my addr 172.21.15.49:0/500535701 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 0x55aba17e8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba1440070 0x55aba17fecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cf7fff640 1 -- 172.21.15.49:0/500535701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba1440070 msgr2=0x55aba17fecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:08.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba1440070 0x55aba17fecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cf7fff640 1 -- 172.21.15.49:0/500535701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 msgr2=0x55aba17e8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 0x55aba17e8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cf7fff640 1 -- 172.21.15.49:0/500535701 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aba13fec20 con 0x55aba141f390 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 0x55aba17e8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba1440070 0x55aba17fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17f2e90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40acf30 tx=0x7f8ce40f5510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86fd4f94a52ab1f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8ce27fc640 1 -- 172.21.15.49:0/500535701 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4021030 con 0x55aba141f390 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8ce27fc640 1 -- 172.21.15.49:0/500535701 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce40eaa90 con 0x55aba141f390 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.672+0000 7f8ce27fc640 1 -- 172.21.15.49:0/500535701 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40acd70 con 0x55aba141f390 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.673+0000 7f8d05782740 1 -- 172.21.15.49:0/500535701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 msgr2=0x55aba17f2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.673+0000 7f8d05782740 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17f2e90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40acf30 tx=0x7f8ce40f5510 comp rx=0 tx=0).stop 2024-09-21T06:38:08.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.673+0000 7f8d05782740 1 -- 172.21.15.49:0/500535701 shutdown_connections 2024-09-21T06:38:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.673+0000 7f8d05782740 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba1440070 0x55aba17fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.673+0000 7f8d05782740 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba141f390 0x55aba17f2e90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.673+0000 7f8d05782740 1 --2- 172.21.15.49:0/500535701 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba14171b0 0x55aba17e8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.673+0000 7f8d05782740 1 -- 172.21.15.49:0/500535701 >> 172.21.15.49:0/500535701 conn(0x55aba1434460 msgr2=0x55aba17f2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.673+0000 7f8d05782740 1 -- 172.21.15.49:0/500535701 shutdown_connections 2024-09-21T06:38:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.673+0000 7f8d05782740 1 -- 172.21.15.49:0/500535701 wait complete. 2024-09-21T06:38:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8d05782740 1 -- start start 2024-09-21T06:38:08.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8d05782740 1 Processor -- start 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8d05782740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba14171b0 0x55aba17fb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8d05782740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 0x55aba17f6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8d05782740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 0x55aba17f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8d05782740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b00b0 con 0x55aba14171b0 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8d05782740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b1520 con 0x55aba1440070 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8d05782740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf81b0780 con 0x55aba141f390 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8cfcfaa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba14171b0 0x55aba17fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8d05782740 10 client.0 _ll_register_callbacks cb 0x7f8cf0008870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8cfcfaa640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba14171b0 0x55aba17fb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59216/0 (socket says 172.21.15.49:59216) 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.674+0000 7f8cfcfaa640 1 -- 172.21.15.49:0/406287206 learned_addr learned my addr 172.21.15.49:0/406287206 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 0x55aba17f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cfd7ab640 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 0x55aba17f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cfcfaa640 1 -- 172.21.15.49:0/406287206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 msgr2=0x55aba17f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 0x55aba17f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cfcfaa640 1 -- 172.21.15.49:0/406287206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 msgr2=0x55aba17f6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 0x55aba17f6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cfcfaa640 1 -- 172.21.15.49:0/406287206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aba17f7550 con 0x55aba14171b0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cfcfaa640 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba14171b0 0x55aba17fb470 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8cec02a9d0 tx=0x7f8cec02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7bad6c0f7ea4490 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cd7fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cd7fff640 1 -- 172.21.15.49:0/406287206 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec035040 con 0x55aba14171b0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8d05782740 1 -- 172.21.15.49:0/406287206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce40eaa90 con 0x55aba14171b0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cd7fff640 1 -- 172.21.15.49:0/406287206 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8cec004770 con 0x55aba14171b0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8cd7fff640 1 -- 172.21.15.49:0/406287206 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8cec004970 con 0x55aba14171b0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8d05782740 10 client.15882 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.675+0000 7f8d05782740 1 -- 172.21.15.49:0/406287206 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55aba186f600 con 0x55aba14171b0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.676+0000 7f8cd7fff640 1 -- 172.21.15.49:0/406287206 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce40eaa90 con 0x55aba14171b0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.676+0000 7f8cd7fff640 1 -- 172.21.15.49:0/406287206 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f8cec003d20 con 0x55aba14171b0 2024-09-21T06:38:08.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.676+0000 7f8d05782740 10 client.15882 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.676+0000 7f8d05782740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.676+0000 7f8d05782740 20 client.15882 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.676+0000 7f8d05782740 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55aba13d3da0 0x55aba1871d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.676+0000 7f8d05782740 4 client.15882 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.676+0000 7f8d05782740 1 -- 172.21.15.49:0/406287206 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aba175b8a0 con 0x55aba13d3da0 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.676+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55aba13d3da0 0x55aba1871d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8cd7fff640 10 client.15882 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8cf7fff640 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55aba13d3da0 0x55aba1871d90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d61a2d93c8e754e3 server_cookie=32aee0b9a38c9968 in_seq=0 out_seq=0 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8cd7fff640 1 -- 172.21.15.49:0/406287206 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aba175b8a0 con 0x55aba13d3da0 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8cd7fff640 10 client.15882 handle_command_reply: tid=0 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 client.15882 shutdown 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 -- 172.21.15.49:0/406287206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba14171b0 msgr2=0x55aba17fb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba14171b0 0x55aba17fb470 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8cec02a9d0 tx=0x7f8cec02a410 comp rx=0 tx=0).stop 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 -- 172.21.15.49:0/406287206 shutdown_connections 2024-09-21T06:38:08.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55aba13d3da0 0x55aba1871d90 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55aba1440070 0x55aba17f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55aba141f390 0x55aba17f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 --2- 172.21.15.49:0/406287206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55aba14171b0 0x55aba17fb470 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 -- 172.21.15.49:0/406287206 >> 172.21.15.49:0/406287206 conn(0x55aba1434460 msgr2=0x55aba17f0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8cd7fff640 0 client.15882 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 -- 172.21.15.49:0/406287206 shutdown_connections 2024-09-21T06:38:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 1 -- 172.21.15.49:0/406287206 wait complete. 2024-09-21T06:38:08.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.677+0000 7f8d05782740 20 client.15882 trim_cache size 0 max 16384 2024-09-21T06:38:08.685 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 -- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ce80b6680 msgr2=0x7f8ce80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ce80b6680 0x7f8ce80b8b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0008e40 tx=0x7f8cf00085f0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 -- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf81094a0 msgr2=0x7f8cf8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf81094a0 0x7f8cf8075c50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400d740 tx=0x7f8ce400dc00 comp rx=0 tx=0).stop 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 -- 172.21.15.49:0/2927490793 shutdown_connections 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ce80b6680 0x7f8ce80b8b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8cf8109df0 0x7f8cf8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8cf81094a0 0x7f8cf8075c50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 --2- 172.21.15.49:0/2927490793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8cf8103b60 0x7f8cf8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 -- 172.21.15.49:0/2927490793 >> 172.21.15.49:0/2927490793 conn(0x7f8cf807b850 msgr2=0x7f8cf8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 -- 172.21.15.49:0/2927490793 shutdown_connections 2024-09-21T06:38:08.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:08.678+0000 7f8cff20e640 1 -- 172.21.15.49:0/2927490793 wait complete. 2024-09-21T06:38:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 -- 172.21.15.49:0/1390824413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 msgr2=0x7f0ccc10d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 --2- 172.21.15.49:0/1390824413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 0x7f0ccc10d7e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009900 tx=0x7f0cbc02a410 comp rx=0 tx=0).stop 2024-09-21T06:38:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 -- 172.21.15.49:0/1390824413 shutdown_connections 2024-09-21T06:38:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 --2- 172.21.15.49:0/1390824413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ccc10ddb0 0x7f0ccc1102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 --2- 172.21.15.49:0/1390824413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 0x7f0ccc10d7e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 --2- 172.21.15.49:0/1390824413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ccc104950 0x7f0ccc104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 -- 172.21.15.49:0/1390824413 >> 172.21.15.49:0/1390824413 conn(0x7f0ccc0fe400 msgr2=0x7f0ccc100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 -- 172.21.15.49:0/1390824413 shutdown_connections 2024-09-21T06:38:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 -- 172.21.15.49:0/1390824413 wait complete. 2024-09-21T06:38:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.469+0000 7f0cd3569640 1 Processor -- start 2024-09-21T06:38:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd3569640 1 -- start start 2024-09-21T06:38:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd3569640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ccc104950 0x7f0ccc19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd3569640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 0x7f0ccc19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd3569640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ccc10ddb0 0x7f0ccc19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd3569640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc113a10 con 0x7f0ccc1052a0 2024-09-21T06:38:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd3569640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc113890 con 0x7f0ccc104950 2024-09-21T06:38:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd3569640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc113b90 con 0x7f0ccc10ddb0 2024-09-21T06:38:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd0b04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 0x7f0ccc19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd0b04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 0x7f0ccc19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59232/0 (socket says 172.21.15.49:59232) 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd0b04640 1 -- 172.21.15.49:0/4034507117 learned_addr learned my addr 172.21.15.49:0/4034507117 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ccc10ddb0 0x7f0ccc19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd1305640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ccc104950 0x7f0ccc19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd0b04640 1 -- 172.21.15.49:0/4034507117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ccc10ddb0 msgr2=0x7f0ccc19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ccc10ddb0 0x7f0ccc19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd0b04640 1 -- 172.21.15.49:0/4034507117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ccc104950 msgr2=0x7f0ccc19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ccc104950 0x7f0ccc19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd0b04640 1 -- 172.21.15.49:0/4034507117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ccc1a02b0 con 0x7f0ccc1052a0 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.470+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ccc10ddb0 0x7f0ccc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.471+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 0x7f0ccc19a9b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc02a930 tx=0x7f0cbc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.471+0000 7f0cc27fc640 1 -- 172.21.15.49:0/4034507117 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc03f030 con 0x7f0ccc1052a0 2024-09-21T06:38:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.471+0000 7f0cc27fc640 1 -- 172.21.15.49:0/4034507117 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cbc003aa0 con 0x7f0ccc1052a0 2024-09-21T06:38:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.471+0000 7f0cc27fc640 1 -- 172.21.15.49:0/4034507117 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc035070 con 0x7f0ccc1052a0 2024-09-21T06:38:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.471+0000 7f0cd3569640 1 -- 172.21.15.49:0/4034507117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ccc1a0540 con 0x7f0ccc1052a0 2024-09-21T06:38:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.471+0000 7f0cd3569640 1 -- 172.21.15.49:0/4034507117 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ccc1a09e0 con 0x7f0ccc1052a0 2024-09-21T06:38:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.473+0000 7f0cda4d8740 1 Processor -- start 2024-09-21T06:38:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.473+0000 7f0cda4d8740 1 -- start start 2024-09-21T06:38:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f3d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b6f2f0 0x560a55f3def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b774d0 0x560a55f3e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560a55eb26f0 con 0x560a55b6f2f0 2024-09-21T06:38:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a55ea1b20 con 0x560a55b774d0 2024-09-21T06:38:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a55ea5930 con 0x560a55b981b0 2024-09-21T06:38:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cc27fc640 1 -- 172.21.15.49:0/4034507117 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0cbc042030 con 0x7f0ccc1052a0 2024-09-21T06:38:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1305640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b6f2f0 0x560a55f3def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1305640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b6f2f0 0x560a55f3def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59244/0 (socket says 172.21.15.49:59244) 2024-09-21T06:38:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1305640 1 -- 172.21.15.49:0/2921996208 learned_addr learned my addr 172.21.15.49:0/2921996208 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f3d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b774d0 0x560a55f3e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1305640 1 -- 172.21.15.49:0/2921996208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 msgr2=0x560a55f3d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1305640 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f3d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1305640 1 -- 172.21.15.49:0/2921996208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b774d0 msgr2=0x560a55f3e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1305640 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b774d0 0x560a55f3e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1305640 1 -- 172.21.15.49:0/2921996208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a55e67530 con 0x560a55b6f2f0 2024-09-21T06:38:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.474+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f3d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.475+0000 7f0cd1305640 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b6f2f0 0x560a55f3def0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800cc60 tx=0x7f0cc800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1b4aef033e5fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.475+0000 7f0cb77fe640 1 -- 172.21.15.49:0/2921996208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8014070 con 0x560a55b6f2f0 2024-09-21T06:38:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.475+0000 7f0cb77fe640 1 -- 172.21.15.49:0/2921996208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc80047a0 con 0x560a55b6f2f0 2024-09-21T06:38:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.475+0000 7f0cb77fe640 1 -- 172.21.15.49:0/2921996208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8010690 con 0x560a55b6f2f0 2024-09-21T06:38:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.475+0000 7f0cc27fc640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0cb80b6680 0x7f0cb80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.475+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0cb80b6680 0x7f0cb80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.475+0000 7f0cc27fc640 1 -- 172.21.15.49:0/4034507117 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0cbc107d10 con 0x7f0ccc1052a0 2024-09-21T06:38:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 -- 172.21.15.49:0/2921996208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b6f2f0 msgr2=0x560a55f3def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b6f2f0 0x560a55f3def0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800cc60 tx=0x7f0cc800e720 comp rx=0 tx=0).stop 2024-09-21T06:38:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0cb80b6680 0x7f0cb80b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40095f0 tx=0x7f0cc4009580 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 -- 172.21.15.49:0/2921996208 shutdown_connections 2024-09-21T06:38:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b774d0 0x560a55f3e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b6f2f0 0x560a55f3def0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/2921996208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f3d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 -- 172.21.15.49:0/2921996208 >> 172.21.15.49:0/2921996208 conn(0x560a55b8c300 msgr2=0x560a55f3b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 -- 172.21.15.49:0/2921996208 shutdown_connections 2024-09-21T06:38:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 -- 172.21.15.49:0/2921996208 wait complete. 2024-09-21T06:38:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 -- start start 2024-09-21T06:38:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.476+0000 7f0cda4d8740 1 Processor -- start 2024-09-21T06:38:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 0x560a55f48fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f49520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f49aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560a55dd9ab0 con 0x560a55b774d0 2024-09-21T06:38:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a55e47730 con 0x560a55b6f2f0 2024-09-21T06:38:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a55f4c130 con 0x560a55b981b0 2024-09-21T06:38:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cda4d8740 10 client.0 _ll_register_callbacks cb 0x560a55e9b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd0b04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f49520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd0b04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f49520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59246/0 (socket says 172.21.15.49:59246) 2024-09-21T06:38:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd0b04640 1 -- 172.21.15.49:0/329988254 learned_addr learned my addr 172.21.15.49:0/329988254 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd1305640 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 0x560a55f48fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f49aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd0b04640 1 -- 172.21.15.49:0/329988254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 msgr2=0x560a55f49aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f49aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd0b04640 1 -- 172.21.15.49:0/329988254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 msgr2=0x560a55f48fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 0x560a55f48fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd0b04640 1 -- 172.21.15.49:0/329988254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a55c03790 con 0x560a55b774d0 2024-09-21T06:38:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd1305640 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 0x560a55f48fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f49aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f49520 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc1054a0 tx=0x7f0cbc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3d9e3b9bc9e7ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/329988254 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc049070 con 0x560a55b774d0 2024-09-21T06:38:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/329988254 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0cbc0c9db0 con 0x560a55b774d0 2024-09-21T06:38:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.477+0000 7f0cda4d8740 1 -- 172.21.15.49:0/329988254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc80047a0 con 0x560a55b774d0 2024-09-21T06:38:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/329988254 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0cbc0c99e0 con 0x560a55b774d0 2024-09-21T06:38:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cda4d8740 10 client.15894 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cda4d8740 1 -- 172.21.15.49:0/329988254 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560a55c7c620 con 0x560a55b774d0 2024-09-21T06:38:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/329988254 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc80047a0 con 0x560a55b774d0 2024-09-21T06:38:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/329988254 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f0cbc10bc20 con 0x560a55b774d0 2024-09-21T06:38:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cda4d8740 10 client.15894 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cda4d8740 10 client.15894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cda4d8740 20 client.15894 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a55b56d80 0x560a55f5b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cda4d8740 4 client.15894 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cda4d8740 1 -- 172.21.15.49:0/329988254 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a55eb4640 con 0x560a55b56d80 2024-09-21T06:38:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.478+0000 7f0cd1305640 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a55b56d80 0x560a55f5b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.479+0000 7f0cd1305640 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a55b56d80 0x560a55f5b160 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af4890decd1ebe73 server_cookie=b0d72f13bb4d58b8 in_seq=0 out_seq=0 2024-09-21T06:38:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.479+0000 7f0cb4ff9640 10 client.15894 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/329988254 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a55eb4640 con 0x560a55b56d80 2024-09-21T06:38:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cb4ff9640 10 client.15894 handle_command_reply: tid=0 2024-09-21T06:38:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 client.15894 shutdown 2024-09-21T06:38:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 -- 172.21.15.49:0/329988254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 msgr2=0x560a55f49520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f49520 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc1054a0 tx=0x7f0cbc02a410 comp rx=0 tx=0).stop 2024-09-21T06:38:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 -- 172.21.15.49:0/329988254 shutdown_connections 2024-09-21T06:38:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a55b56d80 0x560a55f5b160 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b981b0 0x560a55f49aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f49520 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/329988254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 0x560a55f48fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cb4ff9640 0 client.15894 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 -- 172.21.15.49:0/329988254 >> 172.21.15.49:0/329988254 conn(0x560a55b8c300 msgr2=0x560a55f3e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 -- 172.21.15.49:0/329988254 shutdown_connections 2024-09-21T06:38:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 1 -- 172.21.15.49:0/329988254 wait complete. 2024-09-21T06:38:09.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.480+0000 7f0cda4d8740 20 client.15894 trim_cache size 0 max 16384 2024-09-21T06:38:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.494+0000 7f0cda4d8740 1 Processor -- start 2024-09-21T06:38:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.494+0000 7f0cda4d8740 1 -- start start 2024-09-21T06:38:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 0x560a55f3f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.508 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b774d0 0x560a55f461b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b981b0 0x560a55f466f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc1b2060 con 0x560a55b981b0 2024-09-21T06:38:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc1af930 con 0x560a55b6f2f0 2024-09-21T06:38:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc1ad7a0 con 0x560a55b774d0 2024-09-21T06:38:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1b06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b981b0 0x560a55f466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1b06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b981b0 0x560a55f466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59250/0 (socket says 172.21.15.49:59250) 2024-09-21T06:38:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1b06640 1 -- 172.21.15.49:0/871388640 learned_addr learned my addr 172.21.15.49:0/871388640 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1305640 1 --2- 172.21.15.49:0/871388640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 0x560a55f3f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/871388640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b774d0 0x560a55f461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1b06640 1 -- 172.21.15.49:0/871388640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b774d0 msgr2=0x560a55f461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/871388640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b774d0 0x560a55f461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1b06640 1 -- 172.21.15.49:0/871388640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 msgr2=0x560a55f3f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/871388640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 0x560a55f3f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1b06640 1 -- 172.21.15.49:0/871388640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a55f3e790 con 0x560a55b981b0 2024-09-21T06:38:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/871388640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b981b0 0x560a55f466f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0cc401c6b0 tx=0x7f0cc4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824818870d667d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.495+0000 7f0cb6ffd640 1 -- 172.21.15.49:0/871388640 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc402a070 con 0x560a55b981b0 2024-09-21T06:38:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cb6ffd640 1 -- 172.21.15.49:0/871388640 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc4010a20 con 0x560a55b981b0 2024-09-21T06:38:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cb6ffd640 1 -- 172.21.15.49:0/871388640 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4025af0 con 0x560a55b981b0 2024-09-21T06:38:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cda4d8740 1 -- 172.21.15.49:0/871388640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b981b0 msgr2=0x560a55f466f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/871388640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b981b0 0x560a55f466f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f0cc401c6b0 tx=0x7f0cc4015000 comp rx=0 tx=0).stop 2024-09-21T06:38:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cda4d8740 1 -- 172.21.15.49:0/871388640 shutdown_connections 2024-09-21T06:38:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/871388640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b981b0 0x560a55f466f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/871388640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b774d0 0x560a55f461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/871388640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b6f2f0 0x560a55f3f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cda4d8740 1 -- 172.21.15.49:0/871388640 >> 172.21.15.49:0/871388640 conn(0x560a55b8c300 msgr2=0x560a55f3e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cda4d8740 1 -- 172.21.15.49:0/871388640 shutdown_connections 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.496+0000 7f0cda4d8740 1 -- 172.21.15.49:0/871388640 wait complete. 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cda4d8740 1 -- start start 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cda4d8740 1 Processor -- start 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b6f2f0 0x560a55f4edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f4f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cda4d8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b981b0 0x560a55fbdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc1addf0 con 0x560a55b774d0 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc1af260 con 0x560a55b981b0 2024-09-21T06:38:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cda4d8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0ccc1ae4c0 con 0x560a55b6f2f0 2024-09-21T06:38:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cda4d8740 10 client.0 _ll_register_callbacks cb 0x7f0cbc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cd0b04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f4f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cd0b04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f4f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59260/0 (socket says 172.21.15.49:59260) 2024-09-21T06:38:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cd0b04640 1 -- 172.21.15.49:0/3281867402 learned_addr learned my addr 172.21.15.49:0/3281867402 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cd1305640 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b6f2f0 0x560a55f4edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cd1b06640 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b981b0 0x560a55fbdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.497+0000 7f0cd0b04640 1 -- 172.21.15.49:0/3281867402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b6f2f0 msgr2=0x560a55f4edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b6f2f0 0x560a55f4edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cd0b04640 1 -- 172.21.15.49:0/3281867402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b981b0 msgr2=0x560a55fbdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b981b0 0x560a55fbdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cd0b04640 1 -- 172.21.15.49:0/3281867402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a55fbe1f0 con 0x560a55b774d0 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cd1305640 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b6f2f0 0x560a55f4edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cd0b04640 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f4f3b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc1080c0 tx=0x7f0cbc0b50f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2643c0a7bb2c1177 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/3281867402 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc049040 con 0x560a55b774d0 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/3281867402 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0cbc0d70d0 con 0x560a55b774d0 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cda4d8740 1 -- 172.21.15.49:0/3281867402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cc4010a20 con 0x560a55b774d0 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/3281867402 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0cbc0cd2b0 con 0x560a55b774d0 2024-09-21T06:38:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cda4d8740 10 client.15900 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cda4d8740 1 -- 172.21.15.49:0/3281867402 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560a55fc5610 con 0x560a55b774d0 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/3281867402 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0cc4010a20 con 0x560a55b774d0 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/3281867402 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f0cbc03bbb0 con 0x560a55b774d0 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cda4d8740 10 client.15900 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cda4d8740 10 client.15900 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cda4d8740 20 client.15900 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a55b2c1c0 0x560a55fc7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cda4d8740 4 client.15900 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.498+0000 7f0cda4d8740 1 -- 172.21.15.49:0/3281867402 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a55eb00f0 con 0x560a55b2c1c0 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.499+0000 7f0cd1305640 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a55b2c1c0 0x560a55fc7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.499+0000 7f0cb4ff9640 10 client.15900 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.499+0000 7f0cd1305640 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a55b2c1c0 0x560a55fc7c60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bc5c20939755163 server_cookie=f9765aa8ac9e81e0 in_seq=0 out_seq=0 2024-09-21T06:38:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cb4ff9640 1 -- 172.21.15.49:0/3281867402 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560a55eb00f0 con 0x560a55b2c1c0 2024-09-21T06:38:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cb4ff9640 10 client.15900 handle_command_reply: tid=0 2024-09-21T06:38:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 client.15900 shutdown 2024-09-21T06:38:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 -- 172.21.15.49:0/3281867402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 msgr2=0x560a55f4f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f4f3b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc1080c0 tx=0x7f0cbc0b50f0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 -- 172.21.15.49:0/3281867402 shutdown_connections 2024-09-21T06:38:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a55b2c1c0 0x560a55fc7c60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a55b981b0 0x560a55fbdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a55b774d0 0x560a55f4f3b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cb4ff9640 0 client.15900 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 --2- 172.21.15.49:0/3281867402 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a55b6f2f0 0x560a55f4edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 -- 172.21.15.49:0/3281867402 >> 172.21.15.49:0/3281867402 conn(0x560a55b8c300 msgr2=0x560a55f3e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 -- 172.21.15.49:0/3281867402 shutdown_connections 2024-09-21T06:38:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 1 -- 172.21.15.49:0/3281867402 wait complete. 2024-09-21T06:38:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.508+0000 7f0cda4d8740 20 client.15900 trim_cache size 0 max 16384 2024-09-21T06:38:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:38:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:38:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:38:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:38:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 -- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0cb80b6680 msgr2=0x7f0cb80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0cb80b6680 0x7f0cb80b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40095f0 tx=0x7f0cc4009580 comp rx=0 tx=0).stop 2024-09-21T06:38:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 -- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 msgr2=0x7f0ccc19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 0x7f0ccc19a9b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc02a930 tx=0x7f0cbc004270 comp rx=0 tx=0).stop 2024-09-21T06:38:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 -- 172.21.15.49:0/4034507117 shutdown_connections 2024-09-21T06:38:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0cb80b6680 0x7f0cb80b8b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0ccc10ddb0 0x7f0ccc19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0ccc1052a0 0x7f0ccc19a9b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 --2- 172.21.15.49:0/4034507117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0ccc104950 0x7f0ccc19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 -- 172.21.15.49:0/4034507117 >> 172.21.15.49:0/4034507117 conn(0x7f0ccc0fe400 msgr2=0x7f0ccc1078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 -- 172.21.15.49:0/4034507117 shutdown_connections 2024-09-21T06:38:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:09.509+0000 7f0cd3569640 1 -- 172.21.15.49:0/4034507117 wait complete. 2024-09-21T06:38:09.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:09 smithi049 ceph-mon[31177]: pgmap v364: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 39 KiB/s wr, 31 op/s 2024-09-21T06:38:09.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:09 smithi098 ceph-mon[34704]: pgmap v364: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 39 KiB/s wr, 31 op/s 2024-09-21T06:38:09.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:09 smithi079 ceph-mon[34346]: pgmap v364: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 39 KiB/s wr, 31 op/s 2024-09-21T06:38:10.423 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:38:10.423 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:38:10.696 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:11.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.121+0000 7fc4133e7640 1 -- 172.21.15.49:0/3407349081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c1083a0 msgr2=0x7fc40c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.121+0000 7fc4133e7640 1 --2- 172.21.15.49:0/3407349081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c1083a0 0x7fc40c1087b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009900 tx=0x7fc3fc02a410 comp rx=0 tx=0).stop 2024-09-21T06:38:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.121+0000 7fc4133e7640 1 -- 172.21.15.49:0/3407349081 shutdown_connections 2024-09-21T06:38:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.121+0000 7fc4133e7640 1 --2- 172.21.15.49:0/3407349081 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc40c108cf0 0x7fc40c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.121+0000 7fc4133e7640 1 --2- 172.21.15.49:0/3407349081 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c1083a0 0x7fc40c1087b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.121+0000 7fc4133e7640 1 --2- 172.21.15.49:0/3407349081 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c102a60 0x7fc40c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.121+0000 7fc4133e7640 1 -- 172.21.15.49:0/3407349081 >> 172.21.15.49:0/3407349081 conn(0x7fc40c079730 msgr2=0x7fc40c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.121+0000 7fc4133e7640 1 -- 172.21.15.49:0/3407349081 shutdown_connections 2024-09-21T06:38:11.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.121+0000 7fc4133e7640 1 -- 172.21.15.49:0/3407349081 wait complete. 2024-09-21T06:38:11.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.122+0000 7fc4133e7640 1 Processor -- start 2024-09-21T06:38:11.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.122+0000 7fc4133e7640 1 -- start start 2024-09-21T06:38:11.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.122+0000 7fc4133e7640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc40c102a60 0x7fc40c19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.122+0000 7fc4133e7640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c1083a0 0x7fc40c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.122+0000 7fc4133e7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c108cf0 0x7fc40c19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.122+0000 7fc4133e7640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c112960 con 0x7fc40c108cf0 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.122+0000 7fc4133e7640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1127e0 con 0x7fc40c1083a0 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.122+0000 7fc4133e7640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c112ae0 con 0x7fc40c102a60 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411984640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c108cf0 0x7fc40c19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411984640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c108cf0 0x7fc40c19bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59268/0 (socket says 172.21.15.49:59268) 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411984640 1 -- 172.21.15.49:0/2806624166 learned_addr learned my addr 172.21.15.49:0/2806624166 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc410982640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c1083a0 0x7fc40c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411183640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc40c102a60 0x7fc40c19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411984640 1 -- 172.21.15.49:0/2806624166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc40c102a60 msgr2=0x7fc40c19b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411984640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc40c102a60 0x7fc40c19b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411984640 1 -- 172.21.15.49:0/2806624166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c1083a0 msgr2=0x7fc40c19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411984640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c1083a0 0x7fc40c19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411984640 1 -- 172.21.15.49:0/2806624166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c1a6550 con 0x7fc40c108cf0 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc411984640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c108cf0 0x7fc40c19bdd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc40400cce0 tx=0x7fc40400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc4027fc640 1 -- 172.21.15.49:0/2806624166 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40400f450 con 0x7fc40c108cf0 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.123+0000 7fc4133e7640 1 -- 172.21.15.49:0/2806624166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c1a6840 con 0x7fc40c108cf0 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.124+0000 7fc4027fc640 1 -- 172.21.15.49:0/2806624166 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40400faa0 con 0x7fc40c108cf0 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.124+0000 7fc4027fc640 1 -- 172.21.15.49:0/2806624166 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404018b70 con 0x7fc40c108cf0 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.124+0000 7fc4133e7640 1 -- 172.21.15.49:0/2806624166 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c1a6d00 con 0x7fc40c108cf0 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.126+0000 7fc41995b740 1 Processor -- start 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.126+0000 7fc4027fc640 1 -- 172.21.15.49:0/2806624166 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fc404018d10 con 0x7fc40c108cf0 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.126+0000 7fc41995b740 1 -- start start 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc41995b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd365350 0x55a3fd70c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc41995b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc41995b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 0x55a3fd70ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc41995b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a3fd682e60 con 0x55a3fd33c490 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc41995b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a3fd672290 con 0x55a3fd365350 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc41995b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3fd6760a0 con 0x55a3fd344670 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc411183640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc411183640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59284/0 (socket says 172.21.15.49:59284) 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc411183640 1 -- 172.21.15.49:0/1435338644 learned_addr learned my addr 172.21.15.49:0/1435338644 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc410982640 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd365350 0x55a3fd70c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc410982640 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 0x55a3fd70ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc411183640 1 -- 172.21.15.49:0/1435338644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 msgr2=0x55a3fd70ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc411183640 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 0x55a3fd70ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc411183640 1 -- 172.21.15.49:0/1435338644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd365350 msgr2=0x55a3fd70c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc411183640 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd365350 0x55a3fd70c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc411183640 1 -- 172.21.15.49:0/1435338644 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3fd3d0930 con 0x55a3fd33c490 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc410982640 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 0x55a3fd70ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.127+0000 7fc4027fc640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3f80b66b0 0x7fc3f80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.128+0000 7fc410982640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3f80b66b0 0x7fc3f80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.128+0000 7fc411183640 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70c970 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bcb0 tx=0x7fc4080107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e97e407f19a601f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.128+0000 7fc4027fc640 1 -- 172.21.15.49:0/2806624166 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fc4040e7a80 con 0x7fc40c108cf0 2024-09-21T06:38:11.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.128+0000 7fc3f77fe640 1 -- 172.21.15.49:0/1435338644 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40801c480 con 0x55a3fd33c490 2024-09-21T06:38:11.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.128+0000 7fc3f77fe640 1 -- 172.21.15.49:0/1435338644 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40801cad0 con 0x55a3fd33c490 2024-09-21T06:38:11.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.128+0000 7fc3f77fe640 1 -- 172.21.15.49:0/1435338644 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408011c30 con 0x55a3fd33c490 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 -- 172.21.15.49:0/1435338644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 msgr2=0x55a3fd70c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc410982640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3f80b66b0 0x7fc3f80b8bc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc000c00 tx=0x7fc3fc005780 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70c970 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bcb0 tx=0x7fc4080107a0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 -- 172.21.15.49:0/1435338644 shutdown_connections 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 0x55a3fd70ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70c970 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 --2- 172.21.15.49:0/1435338644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd365350 0x55a3fd70c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 -- 172.21.15.49:0/1435338644 >> 172.21.15.49:0/1435338644 conn(0x55a3fd359740 msgr2=0x55a3fd70a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 -- 172.21.15.49:0/1435338644 shutdown_connections 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 -- 172.21.15.49:0/1435338644 wait complete. 2024-09-21T06:38:11.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.129+0000 7fc41995b740 1 -- start start 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc41995b740 1 Processor -- start 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc41995b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd33c490 0x55a3fd718080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc41995b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 0x55a3fd718600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc41995b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd365350 0x55a3fd723f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc41995b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a3fd4d3890 con 0x55a3fd365350 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc41995b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a3fd60cd40 con 0x55a3fd33c490 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc41995b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a3fd71ac10 con 0x55a3fd344670 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc41995b740 10 client.0 _ll_register_callbacks cb 0x55a3fd670c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc411984640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd365350 0x55a3fd723f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc411984640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd365350 0x55a3fd723f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59288/0 (socket says 172.21.15.49:59288) 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc411984640 1 -- 172.21.15.49:0/3584158367 learned_addr learned my addr 172.21.15.49:0/3584158367 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc411183640 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd33c490 0x55a3fd718080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.130+0000 7fc410982640 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 0x55a3fd718600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc411984640 1 -- 172.21.15.49:0/3584158367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 msgr2=0x55a3fd718600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc411984640 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 0x55a3fd718600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc411984640 1 -- 172.21.15.49:0/3584158367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd33c490 msgr2=0x55a3fd718080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc411984640 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd33c490 0x55a3fd718080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc411984640 1 -- 172.21.15.49:0/3584158367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3fd724540 con 0x55a3fd365350 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc411984640 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd365350 0x55a3fd723f30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc4040ad840 tx=0x7fc4040ad740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9bf1b38fc579b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc3f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3584158367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4040b2170 con 0x55a3fd365350 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3584158367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fc4040aebe0 con 0x55a3fd365350 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc41995b740 1 -- 172.21.15.49:0/3584158367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc40801cad0 con 0x55a3fd365350 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3584158367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc4040adfb0 con 0x55a3fd365350 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc41995b740 10 client.15912 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc41995b740 1 -- 172.21.15.49:0/3584158367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a3fd726ed0 con 0x55a3fd365350 2024-09-21T06:38:11.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.131+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3584158367 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc40801cad0 con 0x55a3fd365350 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3584158367 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc4040a9200 con 0x55a3fd365350 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc41995b740 10 client.15912 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc41995b740 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc41995b740 20 client.15912 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc41995b740 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a3fd323cd0 0x55a3fd72a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc41995b740 4 client.15912 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc41995b740 1 -- 172.21.15.49:0/3584158367 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3fd684db0 con 0x55a3fd323cd0 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc411183640 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a3fd323cd0 0x55a3fd72a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc411183640 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a3fd323cd0 0x55a3fd72a480 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dcf5efe9b8f077a server_cookie=433b0f3ba7df2542 in_seq=0 out_seq=0 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.132+0000 7fc3f4ff9640 10 client.15912 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3584158367 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a3fd684db0 con 0x55a3fd323cd0 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc3f4ff9640 10 client.15912 handle_command_reply: tid=0 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc41995b740 1 client.15912 shutdown 2024-09-21T06:38:11.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc41995b740 1 -- 172.21.15.49:0/3584158367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd365350 msgr2=0x55a3fd723f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc41995b740 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd365350 0x55a3fd723f30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc4040ad840 tx=0x7fc4040ad740 comp rx=0 tx=0).stop 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc41995b740 1 -- 172.21.15.49:0/3584158367 shutdown_connections 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc41995b740 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a3fd323cd0 0x55a3fd72a480 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc41995b740 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd365350 0x55a3fd723f30 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc41995b740 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd344670 0x55a3fd718600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc41995b740 1 --2- 172.21.15.49:0/3584158367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd33c490 0x55a3fd718080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc3f4ff9640 0 client.15912 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.133+0000 7fc41995b740 1 -- 172.21.15.49:0/3584158367 >> 172.21.15.49:0/3584158367 conn(0x55a3fd359740 msgr2=0x55a3fd70f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.134+0000 7fc41995b740 1 -- 172.21.15.49:0/3584158367 shutdown_connections 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.134+0000 7fc41995b740 1 -- 172.21.15.49:0/3584158367 wait complete. 2024-09-21T06:38:11.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.134+0000 7fc41995b740 20 client.15912 trim_cache size 0 max 16384 2024-09-21T06:38:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.151+0000 7fc41995b740 1 Processor -- start 2024-09-21T06:38:11.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.151+0000 7fc41995b740 1 -- start start 2024-09-21T06:38:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.151+0000 7fc41995b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.151+0000 7fc41995b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 0x55a3fd7114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.151+0000 7fc41995b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 0x55a3fd711a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.151+0000 7fc41995b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1b2080 con 0x55a3fd33c490 2024-09-21T06:38:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.151+0000 7fc41995b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1af950 con 0x55a3fd344670 2024-09-21T06:38:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.151+0000 7fc41995b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1ad7c0 con 0x55a3fd365350 2024-09-21T06:38:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411183640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411183640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59296/0 (socket says 172.21.15.49:59296) 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411183640 1 -- 172.21.15.49:0/2397847257 learned_addr learned my addr 172.21.15.49:0/2397847257 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411984640 1 --2- 172.21.15.49:0/2397847257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 0x55a3fd711a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc410982640 1 --2- 172.21.15.49:0/2397847257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 0x55a3fd7114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411183640 1 -- 172.21.15.49:0/2397847257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 msgr2=0x55a3fd711a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411183640 1 --2- 172.21.15.49:0/2397847257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 0x55a3fd711a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411183640 1 -- 172.21.15.49:0/2397847257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 msgr2=0x55a3fd7114c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411183640 1 --2- 172.21.15.49:0/2397847257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 0x55a3fd7114c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411183640 1 -- 172.21.15.49:0/2397847257 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3fd716de0 con 0x55a3fd33c490 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc411183640 1 --2- 172.21.15.49:0/2397847257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70fc40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bbd0 tx=0x7fc408000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595c55e414a5e22a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc3f6ffd640 1 -- 172.21.15.49:0/2397847257 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080050c0 con 0x55a3fd33c490 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc3f6ffd640 1 -- 172.21.15.49:0/2397847257 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4080118c0 con 0x55a3fd33c490 2024-09-21T06:38:11.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.152+0000 7fc3f6ffd640 1 -- 172.21.15.49:0/2397847257 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408003830 con 0x55a3fd33c490 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.153+0000 7fc41995b740 1 -- 172.21.15.49:0/2397847257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 msgr2=0x55a3fd70fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.153+0000 7fc41995b740 1 --2- 172.21.15.49:0/2397847257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70fc40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bbd0 tx=0x7fc408000bc0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.153+0000 7fc41995b740 1 -- 172.21.15.49:0/2397847257 shutdown_connections 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.153+0000 7fc41995b740 1 --2- 172.21.15.49:0/2397847257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 0x55a3fd711a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.153+0000 7fc41995b740 1 --2- 172.21.15.49:0/2397847257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 0x55a3fd7114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.153+0000 7fc41995b740 1 --2- 172.21.15.49:0/2397847257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd70fc40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.153+0000 7fc41995b740 1 -- 172.21.15.49:0/2397847257 >> 172.21.15.49:0/2397847257 conn(0x55a3fd359740 msgr2=0x55a3fd70f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.153+0000 7fc41995b740 1 -- 172.21.15.49:0/2397847257 shutdown_connections 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.153+0000 7fc41995b740 1 -- 172.21.15.49:0/2397847257 wait complete. 2024-09-21T06:38:11.158 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc41995b740 1 -- start start 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc41995b740 1 Processor -- start 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc41995b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd720470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc41995b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 0x55a3fd71c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc41995b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 0x55a3fd71cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc41995b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1ade10 con 0x55a3fd33c490 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc41995b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1af280 con 0x55a3fd344670 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc41995b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1ae4e0 con 0x55a3fd365350 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc41995b740 10 client.0 _ll_register_callbacks cb 0x7fc40400af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc411183640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd720470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc411183640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd720470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59300/0 (socket says 172.21.15.49:59300) 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc411183640 1 -- 172.21.15.49:0/3530266462 learned_addr learned my addr 172.21.15.49:0/3530266462 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.154+0000 7fc410982640 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 0x55a3fd71c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc411984640 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 0x55a3fd71cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc411183640 1 -- 172.21.15.49:0/3530266462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 msgr2=0x55a3fd71cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc411183640 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 0x55a3fd71cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc411183640 1 -- 172.21.15.49:0/3530266462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 msgr2=0x55a3fd71c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc411183640 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 0x55a3fd71c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc411183640 1 -- 172.21.15.49:0/3530266462 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3fd7183f0 con 0x55a3fd33c490 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc411183640 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd720470 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bc80 tx=0x7fc4080114c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03df3862588b8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc3f4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3530266462 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4080050e0 con 0x55a3fd33c490 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc41995b740 1 -- 172.21.15.49:0/3530266462 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4080118c0 con 0x55a3fd33c490 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3530266462 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fc408005280 con 0x55a3fd33c490 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3530266462 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc408005480 con 0x55a3fd33c490 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc41995b740 10 client.15918 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.155+0000 7fc41995b740 1 -- 172.21.15.49:0/3530266462 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a3fd795a30 con 0x55a3fd33c490 2024-09-21T06:38:11.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.156+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3530266462 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4080118c0 con 0x55a3fd33c490 2024-09-21T06:38:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.156+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3530266462 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fc40801c480 con 0x55a3fd33c490 2024-09-21T06:38:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.156+0000 7fc41995b740 10 client.15918 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.156+0000 7fc41995b740 10 client.15918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.156+0000 7fc41995b740 20 client.15918 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.156+0000 7fc41995b740 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a3fd2f9080 0x55a3fd797f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.156+0000 7fc41995b740 4 client.15918 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:38:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.156+0000 7fc41995b740 1 -- 172.21.15.49:0/3530266462 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a3fd680860 con 0x55a3fd2f9080 2024-09-21T06:38:11.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.156+0000 7fc410982640 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a3fd2f9080 0x55a3fd797f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.157+0000 7fc3f4ff9640 10 client.15918 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.157+0000 7fc410982640 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a3fd2f9080 0x55a3fd797f10 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a29efcce5d79186 server_cookie=131081c8752f72aa in_seq=0 out_seq=0 2024-09-21T06:38:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.158+0000 7fc3f4ff9640 1 -- 172.21.15.49:0/3530266462 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a3fd680860 con 0x55a3fd2f9080 2024-09-21T06:38:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.158+0000 7fc3f4ff9640 10 client.15918 handle_command_reply: tid=0 2024-09-21T06:38:11.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.158+0000 7fc41995b740 1 client.15918 shutdown 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 -- 172.21.15.49:0/3530266462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 msgr2=0x55a3fd720470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd720470 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc40800bc80 tx=0x7fc4080114c0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 -- 172.21.15.49:0/3530266462 shutdown_connections 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a3fd2f9080 0x55a3fd797f10 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a3fd365350 0x55a3fd71cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a3fd344670 0x55a3fd71c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 --2- 172.21.15.49:0/3530266462 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a3fd33c490 0x55a3fd720470 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 -- 172.21.15.49:0/3530266462 >> 172.21.15.49:0/3530266462 conn(0x55a3fd359740 msgr2=0x55a3fd70d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc3f4ff9640 0 client.15918 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 -- 172.21.15.49:0/3530266462 shutdown_connections 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 1 -- 172.21.15.49:0/3530266462 wait complete. 2024-09-21T06:38:11.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc41995b740 20 client.15918 trim_cache size 0 max 16384 2024-09-21T06:38:11.164 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:38:11.164 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:38:11.164 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "d7811de5-abf3-4713-aa65-d43ca6b1e162", 2024-09-21T06:38:11.164 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:38:11.164 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:38:11.164 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc4133e7640 1 -- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3f80b66b0 msgr2=0x7fc3f80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc4133e7640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3f80b66b0 0x7fc3f80b8bc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc000c00 tx=0x7fc3fc005780 comp rx=0 tx=0).stop 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.159+0000 7fc4133e7640 1 -- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c108cf0 msgr2=0x7fc40c19bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.160+0000 7fc4133e7640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c108cf0 0x7fc40c19bdd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc40400cce0 tx=0x7fc40400a620 comp rx=0 tx=0).stop 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.160+0000 7fc4133e7640 1 -- 172.21.15.49:0/2806624166 shutdown_connections 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.160+0000 7fc4133e7640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3f80b66b0 0x7fc3f80b8bc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.160+0000 7fc4133e7640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc40c108cf0 0x7fc40c19bdd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.160+0000 7fc4133e7640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc40c1083a0 0x7fc40c19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.160+0000 7fc4133e7640 1 --2- 172.21.15.49:0/2806624166 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc40c102a60 0x7fc40c19b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.160+0000 7fc4133e7640 1 -- 172.21.15.49:0/2806624166 >> 172.21.15.49:0/2806624166 conn(0x7fc40c079730 msgr2=0x7fc40c104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.160+0000 7fc4133e7640 1 -- 172.21.15.49:0/2806624166 shutdown_connections 2024-09-21T06:38:11.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:11.160+0000 7fc4133e7640 1 -- 172.21.15.49:0/2806624166 wait complete. 2024-09-21T06:38:11.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:11 smithi049 ceph-mon[31177]: pgmap v365: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 KiB/s wr, 25 op/s 2024-09-21T06:38:11.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:11 smithi098 ceph-mon[34704]: pgmap v365: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 KiB/s wr, 25 op/s 2024-09-21T06:38:11.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:11 smithi079 ceph-mon[34346]: pgmap v365: 97 pgs: 97 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 34 KiB/s wr, 25 op/s 2024-09-21T06:38:11.914 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:38:12.174 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:12.569 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:12 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:38:12.569 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:12 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:12.569 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:12 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:38:12.569 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:12 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:38:12.569 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:12 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:12.569 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:12 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:12.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.661+0000 7fde5405b640 1 -- 172.21.15.49:0/4209618058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c109df0 msgr2=0x7fde4c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:12.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.661+0000 7fde5405b640 1 --2- 172.21.15.49:0/4209618058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c109df0 0x7fde4c110620 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fde44009ca0 tx=0x7fde4402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.661+0000 7fde5405b640 1 -- 172.21.15.49:0/4209618058 shutdown_connections 2024-09-21T06:38:12.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.661+0000 7fde5405b640 1 --2- 172.21.15.49:0/4209618058 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c109df0 0x7fde4c110620 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.661+0000 7fde5405b640 1 --2- 172.21.15.49:0/4209618058 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde4c1094a0 0x7fde4c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.661+0000 7fde5405b640 1 --2- 172.21.15.49:0/4209618058 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde4c103b60 0x7fde4c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.661+0000 7fde5405b640 1 -- 172.21.15.49:0/4209618058 >> 172.21.15.49:0/4209618058 conn(0x7fde4c07b850 msgr2=0x7fde4c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:12.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.662+0000 7fde5405b640 1 -- 172.21.15.49:0/4209618058 shutdown_connections 2024-09-21T06:38:12.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.662+0000 7fde5405b640 1 -- 172.21.15.49:0/4209618058 wait complete. 2024-09-21T06:38:12.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.662+0000 7fde5405b640 1 Processor -- start 2024-09-21T06:38:12.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde5405b640 1 -- start start 2024-09-21T06:38:12.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde5405b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde4c103b60 0x7fde4c19a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde5405b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c1094a0 0x7fde4c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde5405b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde4c109df0 0x7fde4c19fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde5405b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c113ab0 con 0x7fde4c1094a0 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde5405b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c113930 con 0x7fde4c109df0 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde5405b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c113c30 con 0x7fde4c103b60 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde515f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c1094a0 0x7fde4c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde515f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c1094a0 0x7fde4c19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59326/0 (socket says 172.21.15.49:59326) 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde515f6640 1 -- 172.21.15.49:0/4221644056 learned_addr learned my addr 172.21.15.49:0/4221644056 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde51df7640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde4c103b60 0x7fde4c19a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde515f6640 1 -- 172.21.15.49:0/4221644056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde4c103b60 msgr2=0x7fde4c19a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde515f6640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde4c103b60 0x7fde4c19a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde515f6640 1 -- 172.21.15.49:0/4221644056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde4c109df0 msgr2=0x7fde4c19fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:12.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde515f6640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde4c109df0 0x7fde4c19fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde515f6640 1 -- 172.21.15.49:0/4221644056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4c1a03d0 con 0x7fde4c1094a0 2024-09-21T06:38:12.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.663+0000 7fde51df7640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde4c103b60 0x7fde4c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:12.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.664+0000 7fde515f6640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c1094a0 0x7fde4c19aa00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00d750 tx=0x7fde3c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:12.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.664+0000 7fde42ffd640 1 -- 172.21.15.49:0/4221644056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c017070 con 0x7fde4c1094a0 2024-09-21T06:38:12.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.664+0000 7fde42ffd640 1 -- 172.21.15.49:0/4221644056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde3c0054d0 con 0x7fde4c1094a0 2024-09-21T06:38:12.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.664+0000 7fde42ffd640 1 -- 172.21.15.49:0/4221644056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c004c30 con 0x7fde4c1094a0 2024-09-21T06:38:12.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.664+0000 7fde5405b640 1 -- 172.21.15.49:0/4221644056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4c1a06c0 con 0x7fde4c1094a0 2024-09-21T06:38:12.667 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.664+0000 7fde5405b640 1 -- 172.21.15.49:0/4221644056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde4c1a6e20 con 0x7fde4c1094a0 2024-09-21T06:38:12.668 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde5a5cf740 1 Processor -- start 2024-09-21T06:38:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde5a5cf740 1 -- start start 2024-09-21T06:38:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde42ffd640 1 -- 172.21.15.49:0/4221644056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fde3c004dd0 con 0x7fde4c1094a0 2024-09-21T06:38:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e4e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e4f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.670 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5646d1dc4e50 con 0x5646d1aa7070 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5646d1db4280 con 0x5646d1a86390 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5646d1db8090 con 0x5646d1a7e1b0 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde525f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e4e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde525f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e4e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59342/0 (socket says 172.21.15.49:59342) 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.667+0000 7fde525f8640 1 -- 172.21.15.49:0/3474292909 learned_addr learned my addr 172.21.15.49:0/3474292909 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde51df7640 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde515f6640 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e4f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde51df7640 1 -- 172.21.15.49:0/3474292909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 msgr2=0x5646d1e4f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde51df7640 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e4f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde51df7640 1 -- 172.21.15.49:0/3474292909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 msgr2=0x5646d1e4e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde51df7640 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e4e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde51df7640 1 -- 172.21.15.49:0/3474292909 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d1b12650 con 0x5646d1a7e1b0 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde515f6640 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e4f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:12.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde525f8640 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e4e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde42ffd640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fde380b6700 0x7fde380b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde51df7640 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4eb90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fde48009bc0 tx=0x7fde4800e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92b5302fa00a9e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde525f8640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fde380b6700 0x7fde380b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde42ffd640 1 -- 172.21.15.49:0/4221644056 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fde3c0e70f0 con 0x7fde4c1094a0 2024-09-21T06:38:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.668+0000 7fde37fff640 1 -- 172.21.15.49:0/3474292909 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48016070 con 0x5646d1a7e1b0 2024-09-21T06:38:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.669+0000 7fde37fff640 1 -- 172.21.15.49:0/3474292909 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde480054d0 con 0x5646d1a7e1b0 2024-09-21T06:38:12.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.669+0000 7fde37fff640 1 -- 172.21.15.49:0/3474292909 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48011470 con 0x5646d1a7e1b0 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.669+0000 7fde5a5cf740 1 -- 172.21.15.49:0/3474292909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 msgr2=0x5646d1e4eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.669+0000 7fde525f8640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fde380b6700 0x7fde380b8c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fde4402f500 tx=0x7fde44009800 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.669+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4eb90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fde48009bc0 tx=0x7fde4800e6c0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.670+0000 7fde5a5cf740 1 -- 172.21.15.49:0/3474292909 shutdown_connections 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.670+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e4f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.670+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4eb90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.670+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/3474292909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e4e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.670+0000 7fde5a5cf740 1 -- 172.21.15.49:0/3474292909 >> 172.21.15.49:0/3474292909 conn(0x5646d1a9b460 msgr2=0x5646d1e4c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.670+0000 7fde5a5cf740 1 -- 172.21.15.49:0/3474292909 shutdown_connections 2024-09-21T06:38:12.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.670+0000 7fde5a5cf740 1 -- 172.21.15.49:0/3474292909 wait complete. 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.670+0000 7fde5a5cf740 1 -- start start 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.670+0000 7fde5a5cf740 1 Processor -- start 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 0x5646d1e5e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e5e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e5eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5646d1c15700 con 0x5646d1aa7070 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5646d1d4f110 con 0x5646d1a86390 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5646d1e61160 con 0x5646d1a7e1b0 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde525f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e5eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde5a5cf740 10 client.0 _ll_register_callbacks cb 0x5646d1d68990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde525f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e5eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59358/0 (socket says 172.21.15.49:59358) 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde525f8640 1 -- 172.21.15.49:0/2197057374 learned_addr learned my addr 172.21.15.49:0/2197057374 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde51df7640 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 0x5646d1e5e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde515f6640 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e5e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde525f8640 1 -- 172.21.15.49:0/2197057374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 msgr2=0x5646d1e5e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde525f8640 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 0x5646d1e5e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde525f8640 1 -- 172.21.15.49:0/2197057374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 msgr2=0x5646d1e5e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde525f8640 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e5e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.671+0000 7fde525f8640 1 -- 172.21.15.49:0/2197057374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d1d7cc40 con 0x5646d1aa7070 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde525f8640 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e5eaf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fde440094b0 tx=0x7fde440095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1709b37d1fa7326a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde357fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde357fa640 1 -- 172.21.15.49:0/2197057374 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4404e070 con 0x5646d1aa7070 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde357fa640 1 -- 172.21.15.49:0/2197057374 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fde44004450 con 0x5646d1aa7070 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde5a5cf740 1 -- 172.21.15.49:0/2197057374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde480054d0 con 0x5646d1aa7070 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde357fa640 1 -- 172.21.15.49:0/2197057374 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fde4405a050 con 0x5646d1aa7070 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde5a5cf740 10 client.15930 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde5a5cf740 1 -- 172.21.15.49:0/2197057374 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5646d1e6cdb0 con 0x5646d1aa7070 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde357fa640 1 -- 172.21.15.49:0/2197057374 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde480054d0 con 0x5646d1aa7070 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.672+0000 7fde357fa640 1 -- 172.21.15.49:0/2197057374 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fde44043040 con 0x5646d1aa7070 2024-09-21T06:38:12.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.673+0000 7fde5a5cf740 10 client.15930 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:12.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.673+0000 7fde5a5cf740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:12.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.673+0000 7fde5a5cf740 20 client.15930 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:12.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.673+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5646d1a659f0 0x5646d1e702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.673+0000 7fde5a5cf740 4 client.15930 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:12.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.673+0000 7fde5a5cf740 1 -- 172.21.15.49:0/2197057374 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646d1dc6da0 con 0x5646d1a659f0 2024-09-21T06:38:12.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.673+0000 7fde51df7640 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5646d1a659f0 0x5646d1e702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.673+0000 7fde51df7640 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5646d1a659f0 0x5646d1e702d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=785cc67344603b98 server_cookie=3547cc0ea42d21a4 in_seq=0 out_seq=0 2024-09-21T06:38:12.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.673+0000 7fde357fa640 10 client.15930 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.674+0000 7fde357fa640 1 -- 172.21.15.49:0/2197057374 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646d1dc6da0 con 0x5646d1a659f0 2024-09-21T06:38:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.674+0000 7fde357fa640 10 client.15930 handle_command_reply: tid=0 2024-09-21T06:38:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.674+0000 7fde5a5cf740 1 client.15930 shutdown 2024-09-21T06:38:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 -- 172.21.15.49:0/2197057374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 msgr2=0x5646d1e5eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e5eaf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fde440094b0 tx=0x7fde440095c0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 -- 172.21.15.49:0/2197057374 shutdown_connections 2024-09-21T06:38:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5646d1a659f0 0x5646d1e702d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1e5eaf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e5e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/2197057374 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a7e1b0 0x5646d1e5e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde357fa640 0 client.15930 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 -- 172.21.15.49:0/2197057374 >> 172.21.15.49:0/2197057374 conn(0x5646d1a9b460 msgr2=0x5646d1e517a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 -- 172.21.15.49:0/2197057374 shutdown_connections 2024-09-21T06:38:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 1 -- 172.21.15.49:0/2197057374 wait complete. 2024-09-21T06:38:12.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.675+0000 7fde5a5cf740 20 client.15930 trim_cache size 0 max 16384 2024-09-21T06:38:12.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.692+0000 7fde5a5cf740 1 Processor -- start 2024-09-21T06:38:12.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.692+0000 7fde5a5cf740 1 -- start start 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e5b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1aa7070 0x5646d1e5b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1afee0 con 0x5646d1a7e1b0 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1ad7b0 con 0x5646d1a86390 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1ab620 con 0x5646d1aa7070 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde51df7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde51df7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59360/0 (socket says 172.21.15.49:59360) 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde51df7640 1 -- 172.21.15.49:0/1268103060 learned_addr learned my addr 172.21.15.49:0/1268103060 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde515f6640 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e5b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde525f8640 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1aa7070 0x5646d1e5b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde51df7640 1 -- 172.21.15.49:0/1268103060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1aa7070 msgr2=0x5646d1e5b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde51df7640 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1aa7070 0x5646d1e5b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde51df7640 1 -- 172.21.15.49:0/1268103060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 msgr2=0x5646d1e5b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:12.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde51df7640 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e5b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde51df7640 1 -- 172.21.15.49:0/1268103060 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646d1e5cfd0 con 0x5646d1a7e1b0 2024-09-21T06:38:12.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde525f8640 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1aa7070 0x5646d1e5b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:12.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde515f6640 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e5b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:12.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.693+0000 7fde51df7640 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4fd90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fde48009ab0 tx=0x7fde48004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329a45ac123fdeec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:12.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde377fe640 1 -- 172.21.15.49:0/1268103060 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48016040 con 0x5646d1a7e1b0 2024-09-21T06:38:12.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde377fe640 1 -- 172.21.15.49:0/1268103060 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde48011920 con 0x5646d1a7e1b0 2024-09-21T06:38:12.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde377fe640 1 -- 172.21.15.49:0/1268103060 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde480256c0 con 0x5646d1a7e1b0 2024-09-21T06:38:12.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1268103060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1a7e1b0 msgr2=0x5646d1e4fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4fd90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fde48009ab0 tx=0x7fde48004ac0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1268103060 shutdown_connections 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1aa7070 0x5646d1e5b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a86390 0x5646d1e5b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1268103060 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1a7e1b0 0x5646d1e4fd90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1268103060 >> 172.21.15.49:0/1268103060 conn(0x5646d1a9b460 msgr2=0x5646d1e4f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1268103060 shutdown_connections 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.694+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1268103060 wait complete. 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.695+0000 7fde5a5cf740 1 -- start start 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.695+0000 7fde5a5cf740 1 Processor -- start 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.695+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a7e1b0 0x5646d1e62c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.695+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a86390 0x5646d1e63160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.695+0000 7fde5a5cf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1ed9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.695+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1abc70 con 0x5646d1aa7070 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.695+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1ad0e0 con 0x5646d1a7e1b0 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.695+0000 7fde5a5cf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fde4c1ac340 con 0x5646d1a86390 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.695+0000 7fde5a5cf740 10 client.0 _ll_register_callbacks cb 0x7fde44009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde525f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1ed9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde525f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1ed9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59366/0 (socket says 172.21.15.49:59366) 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde525f8640 1 -- 172.21.15.49:0/1367907634 learned_addr learned my addr 172.21.15.49:0/1367907634 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde515f6640 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a86390 0x5646d1e63160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde51df7640 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a7e1b0 0x5646d1e62c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde525f8640 1 -- 172.21.15.49:0/1367907634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a86390 msgr2=0x5646d1e63160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde525f8640 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a86390 0x5646d1e63160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde525f8640 1 -- 172.21.15.49:0/1367907634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a7e1b0 msgr2=0x5646d1e62c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde525f8640 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a7e1b0 0x5646d1e62c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde525f8640 1 -- 172.21.15.49:0/1367907634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646d1eda260 con 0x5646d1aa7070 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde515f6640 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a86390 0x5646d1e63160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde525f8640 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1ed9cd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fde4402ade0 tx=0x7fde44003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b669741eb0ea3643 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde357fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde357fa640 1 -- 172.21.15.49:0/1367907634 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4404e040 con 0x5646d1aa7070 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1367907634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde48011920 con 0x5646d1aa7070 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.696+0000 7fde357fa640 1 -- 172.21.15.49:0/1367907634 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fde44004d40 con 0x5646d1aa7070 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde357fa640 1 -- 172.21.15.49:0/1367907634 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fde44030ec0 con 0x5646d1aa7070 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde5a5cf740 10 client.15936 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1367907634 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5646d1edb460 con 0x5646d1aa7070 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde357fa640 1 -- 172.21.15.49:0/1367907634 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde48011920 con 0x5646d1aa7070 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde357fa640 1 -- 172.21.15.49:0/1367907634 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fde44043040 con 0x5646d1aa7070 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde5a5cf740 10 client.15936 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:12.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde5a5cf740 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde5a5cf740 20 client.15936 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5646d1a3ada0 0x5646d1eddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde5a5cf740 4 client.15936 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1367907634 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5646d1dc2850 con 0x5646d1a3ada0 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.697+0000 7fde51df7640 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5646d1a3ada0 0x5646d1eddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde51df7640 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5646d1a3ada0 0x5646d1eddc80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80fe361adf2d8304 server_cookie=3e4d30c682467015 in_seq=0 out_seq=0 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde357fa640 10 client.15936 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde357fa640 1 -- 172.21.15.49:0/1367907634 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x5646d1dc2850 con 0x5646d1a3ada0 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde357fa640 10 client.15936 handle_command_reply: tid=0 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 client.15936 shutdown 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1367907634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 msgr2=0x5646d1ed9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1ed9cd0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fde4402ade0 tx=0x7fde44003e90 comp rx=0 tx=0).stop 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1367907634 shutdown_connections 2024-09-21T06:38:12.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5646d1a3ada0 0x5646d1eddc80 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5646d1aa7070 0x5646d1ed9cd0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5646d1a86390 0x5646d1e63160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde357fa640 0 client.15936 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 --2- 172.21.15.49:0/1367907634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5646d1a7e1b0 0x5646d1e62c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1367907634 >> 172.21.15.49:0/1367907634 conn(0x5646d1a9b460 msgr2=0x5646d1e520b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.698+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1367907634 shutdown_connections 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5a5cf740 1 -- 172.21.15.49:0/1367907634 wait complete. 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5a5cf740 20 client.15936 trim_cache size 0 max 16384 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:38:12.705 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "d7811de5-abf3-4713-aa65-d43ca6b1e162", 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:12.706 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:12.707 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:12.708 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:38:12.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 -- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fde380b6700 msgr2=0x7fde380b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:12.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fde380b6700 0x7fde380b8c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fde4402f500 tx=0x7fde44009800 comp rx=0 tx=0).stop 2024-09-21T06:38:12.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 -- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c1094a0 msgr2=0x7fde4c19aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:12.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c1094a0 0x7fde4c19aa00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00d750 tx=0x7fde3c00dc10 comp rx=0 tx=0).stop 2024-09-21T06:38:12.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 -- 172.21.15.49:0/4221644056 shutdown_connections 2024-09-21T06:38:12.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fde380b6700 0x7fde380b8c10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fde4c109df0 0x7fde4c19fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fde4c1094a0 0x7fde4c19aa00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 --2- 172.21.15.49:0/4221644056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fde4c103b60 0x7fde4c19a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:12.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 -- 172.21.15.49:0/4221644056 >> 172.21.15.49:0/4221644056 conn(0x7fde4c07b850 msgr2=0x7fde4c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:12.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 -- 172.21.15.49:0/4221644056 shutdown_connections 2024-09-21T06:38:12.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:12.699+0000 7fde5405b640 1 -- 172.21.15.49:0/4221644056 wait complete. 2024-09-21T06:38:12.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:12 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:38:12.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:12 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:12.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:12 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:38:12.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:12 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:38:12.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:12 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:12.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:12 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:12.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:12 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:38:12.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:12 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:12.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:12 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:38:12.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:12 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:38:12.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:12 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:12.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:12 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:13.427 INFO:tasks.cephfs.filesystem:scrub status for tag:d7811de5-abf3-4713-aa65-d43ca6b1e162 - {'path': '/', 'tag': 'd7811de5-abf3-4713-aa65-d43ca6b1e162', 'options': 'recursive,force'} 2024-09-21T06:38:13.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:13 smithi049 ceph-mon[31177]: pgmap v366: 97 pgs: 97 active+clean; 1.7 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 KiB/s wr, 29 op/s 2024-09-21T06:38:13.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:13 smithi098 ceph-mon[34704]: pgmap v366: 97 pgs: 97 active+clean; 1.7 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 KiB/s wr, 29 op/s 2024-09-21T06:38:13.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:13 smithi079 ceph-mon[34346]: pgmap v366: 97 pgs: 97 active+clean; 1.7 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 38 KiB/s wr, 29 op/s 2024-09-21T06:38:15.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:15 smithi049 ceph-mon[31177]: pgmap v367: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 40 KiB/s wr, 30 op/s 2024-09-21T06:38:15.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:15 smithi098 ceph-mon[34704]: pgmap v367: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 40 KiB/s wr, 30 op/s 2024-09-21T06:38:15.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:15 smithi079 ceph-mon[34346]: pgmap v367: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 40 KiB/s wr, 30 op/s 2024-09-21T06:38:17.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:17 smithi049 ceph-mon[31177]: pgmap v368: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-21T06:38:17.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:17 smithi098 ceph-mon[34704]: pgmap v368: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-21T06:38:17.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:17 smithi079 ceph-mon[34346]: pgmap v368: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-21T06:38:19.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:19 smithi049 ceph-mon[31177]: pgmap v369: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-09-21T06:38:19.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:19 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:38:19.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:19 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:38:19.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:19 smithi098 ceph-mon[34704]: pgmap v369: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-09-21T06:38:19.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:19 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:38:19.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:19 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:38:19.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:19 smithi079 ceph-mon[34346]: pgmap v369: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 17 KiB/s wr, 18 op/s 2024-09-21T06:38:19.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:19 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:38:19.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:19 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:38:21.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:21 smithi049 ceph-mon[31177]: pgmap v370: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-21T06:38:21.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:21 smithi098 ceph-mon[34704]: pgmap v370: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-21T06:38:21.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:21 smithi079 ceph-mon[34346]: pgmap v370: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 13 op/s 2024-09-21T06:38:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.623+0000 7f78af684640 1 -- 172.21.15.49:0/2393588275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8102070 msgr2=0x7f78a8102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.623+0000 7f78af684640 1 --2- 172.21.15.49:0/2393588275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8102070 0x7f78a8102480 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009900 tx=0x7f78a402a410 comp rx=0 tx=0).stop 2024-09-21T06:38:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.623+0000 7f78af684640 1 -- 172.21.15.49:0/2393588275 shutdown_connections 2024-09-21T06:38:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.623+0000 7f78af684640 1 --2- 172.21.15.49:0/2393588275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78a8106b30 0x7f78a81105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.623+0000 7f78af684640 1 --2- 172.21.15.49:0/2393588275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78a81061e0 0x7f78a81065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.623+0000 7f78af684640 1 --2- 172.21.15.49:0/2393588275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8102070 0x7f78a8102480 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.623+0000 7f78af684640 1 -- 172.21.15.49:0/2393588275 >> 172.21.15.49:0/2393588275 conn(0x7f78a8079ea0 msgr2=0x7f78a807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.623+0000 7f78af684640 1 -- 172.21.15.49:0/2393588275 shutdown_connections 2024-09-21T06:38:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.623+0000 7f78af684640 1 -- 172.21.15.49:0/2393588275 wait complete. 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78af684640 1 Processor -- start 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78af684640 1 -- start start 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78af684640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78a8102070 0x7f78a819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78af684640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78a81061e0 0x7f78a819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78af684640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8106b30 0x7f78a819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78af684640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f78a8113a30 con 0x7f78a8106b30 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78af684640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78a81138b0 con 0x7f78a81061e0 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78af684640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78a8113bb0 con 0x7f78a8102070 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78adc21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8106b30 0x7f78a819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78adc21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8106b30 0x7f78a819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43204/0 (socket says 172.21.15.49:43204) 2024-09-21T06:38:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.624+0000 7f78adc21640 1 -- 172.21.15.49:0/245337666 learned_addr learned my addr 172.21.15.49:0/245337666 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78ad420640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78a8102070 0x7f78a819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78acc1f640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78a81061e0 0x7f78a819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78adc21640 1 -- 172.21.15.49:0/245337666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78a8102070 msgr2=0x7f78a819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78adc21640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78a8102070 0x7f78a819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78adc21640 1 -- 172.21.15.49:0/245337666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78a81061e0 msgr2=0x7f78a819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78adc21640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78a81061e0 0x7f78a819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78adc21640 1 -- 172.21.15.49:0/245337666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a81a0440 con 0x7f78a8106b30 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78ad420640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78a8102070 0x7f78a819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78adc21640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8106b30 0x7f78a819fd40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009fd0 tx=0x7f78a000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f789e7fc640 1 -- 172.21.15.49:0/245337666 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0017070 con 0x7f78a8106b30 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f789e7fc640 1 -- 172.21.15.49:0/245337666 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78a0003e20 con 0x7f78a8106b30 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78af684640 1 -- 172.21.15.49:0/245337666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78a81a0730 con 0x7f78a8106b30 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f789e7fc640 1 -- 172.21.15.49:0/245337666 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0010460 con 0x7f78a8106b30 2024-09-21T06:38:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.625+0000 7f78af684640 1 -- 172.21.15.49:0/245337666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78a81a6ec0 con 0x7f78a8106b30 2024-09-21T06:38:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.628+0000 7f78b65f2740 1 Processor -- start 2024-09-21T06:38:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.628+0000 7f789e7fc640 1 -- 172.21.15.49:0/245337666 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f78a0003970 con 0x7f78a8106b30 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.628+0000 7f78b65f2740 1 -- start start 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 0x55e3e9beb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bebef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 0x55e3e9bec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78b65f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9b606f0 con 0x55e3e981d2f0 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78b65f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9b4fb20 con 0x55e3e98461b0 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78b65f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9b53930 con 0x55e3e98254d0 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78ad420640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bebef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78ad420640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bebef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43210/0 (socket says 172.21.15.49:43210) 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78ad420640 1 -- 172.21.15.49:0/325069172 learned_addr learned my addr 172.21.15.49:0/325069172 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78acc1f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 0x55e3e9beb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78acc1f640 1 --2- 172.21.15.49:0/325069172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 0x55e3e9bec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78ad420640 1 -- 172.21.15.49:0/325069172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 msgr2=0x55e3e9bec430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78ad420640 1 --2- 172.21.15.49:0/325069172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 0x55e3e9bec430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78ad420640 1 -- 172.21.15.49:0/325069172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 msgr2=0x55e3e9beb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78ad420640 1 --2- 172.21.15.49:0/325069172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 0x55e3e9beb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f78ad420640 1 -- 172.21.15.49:0/325069172 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3e9b15530 con 0x55e3e981d2f0 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.629+0000 7f789e7fc640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f78940b6680 0x7f78940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.630+0000 7f78acc1f640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f78940b6680 0x7f78940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.630+0000 7f78ad420640 1 --2- 172.21.15.49:0/325069172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bebef0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f78a402a930 tx=0x7f78a4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec47e59d174e4d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.630+0000 7f789e7fc640 1 -- 172.21.15.49:0/245337666 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f78a00e7520 con 0x7f78a8106b30 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.630+0000 7f78937fe640 1 -- 172.21.15.49:0/325069172 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a403f070 con 0x55e3e981d2f0 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.630+0000 7f78937fe640 1 -- 172.21.15.49:0/325069172 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78a40316a0 con 0x55e3e981d2f0 2024-09-21T06:38:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.630+0000 7f78937fe640 1 -- 172.21.15.49:0/325069172 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a4035070 con 0x55e3e981d2f0 2024-09-21T06:38:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 -- 172.21.15.49:0/325069172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 msgr2=0x55e3e9bebef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 --2- 172.21.15.49:0/325069172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bebef0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f78a402a930 tx=0x7f78a4032ce0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78acc1f640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f78940b6680 0x7f78940b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f78a807a4b0 tx=0x7f7898004730 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 -- 172.21.15.49:0/325069172 shutdown_connections 2024-09-21T06:38:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 --2- 172.21.15.49:0/325069172 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 0x55e3e9bec430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 --2- 172.21.15.49:0/325069172 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bebef0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 --2- 172.21.15.49:0/325069172 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 0x55e3e9beb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 -- 172.21.15.49:0/325069172 >> 172.21.15.49:0/325069172 conn(0x55e3e983a300 msgr2=0x55e3e9be98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 -- 172.21.15.49:0/325069172 shutdown_connections 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 -- 172.21.15.49:0/325069172 wait complete. 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.631+0000 7f78b65f2740 1 -- start start 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78b65f2740 1 Processor -- start 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bf7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 0x55e3e9bf7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 0x55e3e9c03420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78b65f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9a87ab0 con 0x55e3e981d2f0 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78b65f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9af5730 con 0x55e3e98461b0 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78b65f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e3e9bfa0d0 con 0x55e3e98254d0 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78b65f2740 10 client.0 _ll_register_callbacks cb 0x55e3e9b496b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78ad420640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bf7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78ad420640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bf7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43216/0 (socket says 172.21.15.49:43216) 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78ad420640 1 -- 172.21.15.49:0/4007758898 learned_addr learned my addr 172.21.15.49:0/4007758898 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:22.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78acc1f640 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 0x55e3e9bf7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.632+0000 7f78adc21640 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 0x55e3e9c03420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f78ad420640 1 -- 172.21.15.49:0/4007758898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 msgr2=0x55e3e9bf7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f78ad420640 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 0x55e3e9bf7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f78ad420640 1 -- 172.21.15.49:0/4007758898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 msgr2=0x55e3e9c03420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f78ad420640 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 0x55e3e9c03420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f78ad420640 1 -- 172.21.15.49:0/4007758898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3e98b1790 con 0x55e3e981d2f0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f78ad420640 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bf7020 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009900 tx=0x7f78a4005150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855cd07f0b87960d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f7890ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f7890ff9640 1 -- 172.21.15.49:0/4007758898 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a403f030 con 0x55e3e981d2f0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f7890ff9640 1 -- 172.21.15.49:0/4007758898 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f78a4004250 con 0x55e3e981d2f0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f78b65f2740 1 -- 172.21.15.49:0/4007758898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78a40316a0 con 0x55e3e981d2f0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f7890ff9640 1 -- 172.21.15.49:0/4007758898 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f78a4055050 con 0x55e3e981d2f0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f78b65f2740 10 client.15948 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f78b65f2740 1 -- 172.21.15.49:0/4007758898 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e3e992a620 con 0x55e3e981d2f0 2024-09-21T06:38:22.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.633+0000 7f7890ff9640 1 -- 172.21.15.49:0/4007758898 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78a40316a0 con 0x55e3e981d2f0 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.634+0000 7f7890ff9640 1 -- 172.21.15.49:0/4007758898 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f78a40046c0 con 0x55e3e981d2f0 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.634+0000 7f78b65f2740 10 client.15948 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.634+0000 7f78b65f2740 10 client.15948 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.634+0000 7f78b65f2740 20 client.15948 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.634+0000 7f78b65f2740 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e3e9804d80 0x55e3e9c08f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.634+0000 7f78b65f2740 4 client.15948 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.634+0000 7f78b65f2740 1 -- 172.21.15.49:0/4007758898 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3e9b62640 con 0x55e3e9804d80 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.634+0000 7f78acc1f640 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e3e9804d80 0x55e3e9c08f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.635+0000 7f7890ff9640 10 client.15948 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.635+0000 7f78acc1f640 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e3e9804d80 0x55e3e9c08f90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2ce5f734a837d15 server_cookie=c9e42e281f972f24 in_seq=0 out_seq=0 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.635+0000 7f7890ff9640 1 -- 172.21.15.49:0/4007758898 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3e9b62640 con 0x55e3e9804d80 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.635+0000 7f7890ff9640 10 client.15948 handle_command_reply: tid=0 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.635+0000 7f78b65f2740 1 client.15948 shutdown 2024-09-21T06:38:22.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 -- 172.21.15.49:0/4007758898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 msgr2=0x55e3e9bf7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bf7020 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009900 tx=0x7f78a4005150 comp rx=0 tx=0).stop 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 -- 172.21.15.49:0/4007758898 shutdown_connections 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e3e9804d80 0x55e3e9c08f90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98461b0 0x55e3e9c03420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f7890ff9640 0 client.15948 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e98254d0 0x55e3e9bf7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 --2- 172.21.15.49:0/4007758898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e981d2f0 0x55e3e9bf7020 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 -- 172.21.15.49:0/4007758898 >> 172.21.15.49:0/4007758898 conn(0x55e3e983a300 msgr2=0x55e3e9bec9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 -- 172.21.15.49:0/4007758898 shutdown_connections 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 1 -- 172.21.15.49:0/4007758898 wait complete. 2024-09-21T06:38:22.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.636+0000 7f78b65f2740 20 client.15948 trim_cache size 0 max 16384 2024-09-21T06:38:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.651+0000 7f78b65f2740 1 Processor -- start 2024-09-21T06:38:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.651+0000 7f78b65f2740 1 -- start start 2024-09-21T06:38:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.651+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 0x55e3e9bed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.651+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9c03320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.651+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9bf41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.651+0000 7f78b65f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f78a81b2060 con 0x55e3e98461b0 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.651+0000 7f78b65f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78a81af930 con 0x55e3e98254d0 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.651+0000 7f78b65f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78a81ad7a0 con 0x55e3e981d2f0 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.651+0000 7f78adc21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9bf41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78adc21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9bf41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43224/0 (socket says 172.21.15.49:43224) 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78adc21640 1 -- 172.21.15.49:0/721634924 learned_addr learned my addr 172.21.15.49:0/721634924 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78acc1f640 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9c03320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78ad420640 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 0x55e3e9bed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78adc21640 1 -- 172.21.15.49:0/721634924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 msgr2=0x55e3e9bed0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78adc21640 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 0x55e3e9bed0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78adc21640 1 -- 172.21.15.49:0/721634924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 msgr2=0x55e3e9c03320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78adc21640 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9c03320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78adc21640 1 -- 172.21.15.49:0/721634924 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3e9bed630 con 0x55e3e98461b0 2024-09-21T06:38:22.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78acc1f640 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9c03320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:22.656 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f78adc21640 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9bf41f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f78a00a9920 tx=0x7f78a00acac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b947b3e53fef649 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.656 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f7892ffd640 1 -- 172.21.15.49:0/721634924 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0020030 con 0x55e3e98461b0 2024-09-21T06:38:22.656 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f7892ffd640 1 -- 172.21.15.49:0/721634924 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78a00ace60 con 0x55e3e98461b0 2024-09-21T06:38:22.656 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.652+0000 7f7892ffd640 1 -- 172.21.15.49:0/721634924 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a00a8ca0 con 0x55e3e98461b0 2024-09-21T06:38:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 -- 172.21.15.49:0/721634924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 msgr2=0x55e3e9bf41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9bf41f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f78a00a9920 tx=0x7f78a00acac0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 -- 172.21.15.49:0/721634924 shutdown_connections 2024-09-21T06:38:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9bf41f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9c03320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.659 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 --2- 172.21.15.49:0/721634924 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 0x55e3e9bed0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 -- 172.21.15.49:0/721634924 >> 172.21.15.49:0/721634924 conn(0x55e3e983a300 msgr2=0x55e3e9bec9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 -- 172.21.15.49:0/721634924 shutdown_connections 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 -- 172.21.15.49:0/721634924 wait complete. 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.653+0000 7f78b65f2740 1 -- start start 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78b65f2740 1 Processor -- start 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 0x55e3e9bfce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9bfd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78b65f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9c6a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78b65f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f78a81addf0 con 0x55e3e98461b0 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78b65f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78a81af260 con 0x55e3e98254d0 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78b65f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78a81ae4c0 con 0x55e3e981d2f0 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78b65f2740 10 client.0 _ll_register_callbacks cb 0x7f789800ca10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78adc21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9c6a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.660 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78adc21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9c6a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43230/0 (socket says 172.21.15.49:43230) 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78adc21640 1 -- 172.21.15.49:0/3602905926 learned_addr learned my addr 172.21.15.49:0/3602905926 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78ad420640 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 0x55e3e9bfce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78acc1f640 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9bfd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78adc21640 1 -- 172.21.15.49:0/3602905926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 msgr2=0x55e3e9bfce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78adc21640 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 0x55e3e9bfce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78adc21640 1 -- 172.21.15.49:0/3602905926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 msgr2=0x55e3e9bfd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.654+0000 7f78adc21640 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9bfd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78adc21640 1 -- 172.21.15.49:0/3602905926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3e9c6ad90 con 0x55e3e98461b0 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78acc1f640 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9bfd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78adc21640 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9c6a720 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f78a000dfd0 tx=0x7f78a00e5100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7127407dcb971e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f7890ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f7890ff9640 1 -- 172.21.15.49:0/3602905926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0020070 con 0x55e3e98461b0 2024-09-21T06:38:22.661 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f7890ff9640 1 -- 172.21.15.49:0/3602905926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f78a00e7250 con 0x55e3e98461b0 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78b65f2740 1 -- 172.21.15.49:0/3602905926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78a00ace60 con 0x55e3e98461b0 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f7890ff9640 1 -- 172.21.15.49:0/3602905926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f78a00ada50 con 0x55e3e98461b0 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78b65f2740 10 client.15954 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78b65f2740 1 -- 172.21.15.49:0/3602905926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e3e9c732c0 con 0x55e3e98461b0 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f7890ff9640 1 -- 172.21.15.49:0/3602905926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78a00ace60 con 0x55e3e98461b0 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f7890ff9640 1 -- 172.21.15.49:0/3602905926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f78a00d2ce0 con 0x55e3e98461b0 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78b65f2740 10 client.15954 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78b65f2740 10 client.15954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78b65f2740 20 client.15954 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78b65f2740 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e3e97da1c0 0x55e3e9c75990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.655+0000 7f78b65f2740 4 client.15954 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.656+0000 7f78b65f2740 1 -- 172.21.15.49:0/3602905926 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e3e9b5e0f0 con 0x55e3e97da1c0 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.656+0000 7f78ad420640 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e3e97da1c0 0x55e3e9c75990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.662 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.656+0000 7f7890ff9640 10 client.15954 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:22.663 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.656+0000 7f78ad420640 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e3e97da1c0 0x55e3e9c75990 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c05478d6d2440746 server_cookie=2c2937a15b6269c8 in_seq=0 out_seq=0 2024-09-21T06:38:22.665 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.663+0000 7f7890ff9640 1 -- 172.21.15.49:0/3602905926 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e3e9b5e0f0 con 0x55e3e97da1c0 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.663+0000 7f7890ff9640 10 client.15954 handle_command_reply: tid=0 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.663+0000 7f78b65f2740 1 client.15954 shutdown 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 -- 172.21.15.49:0/3602905926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 msgr2=0x55e3e9c6a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9c6a720 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f78a000dfd0 tx=0x7f78a00e5100 comp rx=0 tx=0).stop 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 -- 172.21.15.49:0/3602905926 shutdown_connections 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e3e97da1c0 0x55e3e9c75990 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e3e98461b0 0x55e3e9c6a720 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e3e98254d0 0x55e3e9bfd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f7890ff9640 0 client.15954 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 --2- 172.21.15.49:0/3602905926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e3e981d2f0 0x55e3e9bfce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 -- 172.21.15.49:0/3602905926 >> 172.21.15.49:0/3602905926 conn(0x55e3e983a300 msgr2=0x55e3e9be7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 -- 172.21.15.49:0/3602905926 shutdown_connections 2024-09-21T06:38:22.666 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 1 -- 172.21.15.49:0/3602905926 wait complete. 2024-09-21T06:38:22.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78b65f2740 20 client.15954 trim_cache size 0 max 16384 2024-09-21T06:38:22.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:38:22.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:38:22.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:38:22.667 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78af684640 1 -- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f78940b6680 msgr2=0x7f78940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78af684640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f78940b6680 0x7f78940b8b90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f78a807a4b0 tx=0x7f7898004730 comp rx=0 tx=0).stop 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78af684640 1 -- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8106b30 msgr2=0x7f78a819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.664+0000 7f78af684640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8106b30 0x7f78a819fd40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009fd0 tx=0x7f78a000b260 comp rx=0 tx=0).stop 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.665+0000 7f78af684640 1 -- 172.21.15.49:0/245337666 shutdown_connections 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.665+0000 7f78af684640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f78940b6680 0x7f78940b8b90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.665+0000 7f78af684640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f78a8106b30 0x7f78a819fd40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.665+0000 7f78af684640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78a81061e0 0x7f78a819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.665+0000 7f78af684640 1 --2- 172.21.15.49:0/245337666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78a8102070 0x7f78a819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.665+0000 7f78af684640 1 -- 172.21.15.49:0/245337666 >> 172.21.15.49:0/245337666 conn(0x7f78a8079ea0 msgr2=0x7f78a81084a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.668 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.665+0000 7f78af684640 1 -- 172.21.15.49:0/245337666 shutdown_connections 2024-09-21T06:38:22.669 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:22.665+0000 7f78af684640 1 -- 172.21.15.49:0/245337666 wait complete. 2024-09-21T06:38:23.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:23 smithi049 ceph-mon[31177]: pgmap v371: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-21T06:38:23.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:23 smithi098 ceph-mon[34704]: pgmap v371: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-21T06:38:23.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:23 smithi079 ceph-mon[34346]: pgmap v371: 97 pgs: 97 active+clean; 1.8 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-21T06:38:25.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:25 smithi079 ceph-mon[34346]: pgmap v372: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-21T06:38:25.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:25 smithi049 ceph-mon[31177]: pgmap v372: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-21T06:38:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:25 smithi098 ceph-mon[34704]: pgmap v372: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-21T06:38:27.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:27 smithi079 ceph-mon[34346]: pgmap v373: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-09-21T06:38:27.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:27 smithi049 ceph-mon[31177]: pgmap v373: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-09-21T06:38:28.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:27 smithi098 ceph-mon[34704]: pgmap v373: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 KiB/s wr, 10 op/s 2024-09-21T06:38:29.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:29 smithi049 ceph-mon[31177]: pgmap v374: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-21T06:38:30.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:29 smithi098 ceph-mon[34704]: pgmap v374: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-21T06:38:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:29 smithi079 ceph-mon[34346]: pgmap v374: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 KiB/s wr, 16 op/s 2024-09-21T06:38:31.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:31 smithi049 ceph-mon[31177]: pgmap v375: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:32.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:31 smithi098 ceph-mon[34704]: pgmap v375: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:31 smithi079 ceph-mon[34346]: pgmap v375: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:33.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:33 smithi049 ceph-mon[31177]: pgmap v376: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-21T06:38:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:33 smithi098 ceph-mon[34704]: pgmap v376: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-21T06:38:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:33 smithi079 ceph-mon[34346]: pgmap v376: 97 pgs: 97 active+clean; 1.9 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-21T06:38:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.778+0000 7fa255439640 1 -- 172.21.15.49:0/1489164203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 msgr2=0x7fa25010f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.778+0000 7fa255439640 1 --2- 172.21.15.49:0/1489164203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 0x7fa25010f480 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa248009ca0 tx=0x7fa24802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.778+0000 7fa255439640 1 -- 172.21.15.49:0/1489164203 shutdown_connections 2024-09-21T06:38:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.778+0000 7fa255439640 1 --2- 172.21.15.49:0/1489164203 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 0x7fa25010f480 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.778+0000 7fa255439640 1 --2- 172.21.15.49:0/1489164203 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa250108300 0x7fa250108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.778+0000 7fa255439640 1 --2- 172.21.15.49:0/1489164203 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2501029d0 0x7fa250102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.778+0000 7fa255439640 1 -- 172.21.15.49:0/1489164203 >> 172.21.15.49:0/1489164203 conn(0x7fa25007a710 msgr2=0x7fa25007ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.778+0000 7fa255439640 1 -- 172.21.15.49:0/1489164203 shutdown_connections 2024-09-21T06:38:35.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.778+0000 7fa255439640 1 -- 172.21.15.49:0/1489164203 wait complete. 2024-09-21T06:38:35.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa255439640 1 Processor -- start 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa255439640 1 -- start start 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa255439640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2501029d0 0x7fa25019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa255439640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa250108300 0x7fa25019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa255439640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 0x7fa25019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa255439640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa250112910 con 0x7fa250108c50 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa255439640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa250112790 con 0x7fa2501029d0 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa255439640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa250112a90 con 0x7fa250108300 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa24f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 0x7fa25019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa24f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 0x7fa25019fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34432/0 (socket says 172.21.15.49:34432) 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa24f7fe640 1 -- 172.21.15.49:0/1831957416 learned_addr learned my addr 172.21.15.49:0/1831957416 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa247fff640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa250108300 0x7fa25019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.779+0000 7fa24effd640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2501029d0 0x7fa25019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa24f7fe640 1 -- 172.21.15.49:0/1831957416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa250108300 msgr2=0x7fa25019a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:35.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa24f7fe640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa250108300 0x7fa25019a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa24f7fe640 1 -- 172.21.15.49:0/1831957416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2501029d0 msgr2=0x7fa25019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa24f7fe640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2501029d0 0x7fa25019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa24f7fe640 1 -- 172.21.15.49:0/1831957416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2501a02b0 con 0x7fa250108c50 2024-09-21T06:38:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa24f7fe640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 0x7fa25019fbb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa2480098d0 tx=0x7fa2480317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa24cff9640 1 -- 172.21.15.49:0/1831957416 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248003b70 con 0x7fa250108c50 2024-09-21T06:38:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa24cff9640 1 -- 172.21.15.49:0/1831957416 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa248003d10 con 0x7fa250108c50 2024-09-21T06:38:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa255439640 1 -- 172.21.15.49:0/1831957416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2501a0540 con 0x7fa250108c50 2024-09-21T06:38:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa24cff9640 1 -- 172.21.15.49:0/1831957416 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24802fa20 con 0x7fa250108c50 2024-09-21T06:38:35.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.780+0000 7fa255439640 1 -- 172.21.15.49:0/1831957416 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2501a6d30 con 0x7fa250108c50 2024-09-21T06:38:35.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.783+0000 7fa25c482740 1 Processor -- start 2024-09-21T06:38:35.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.783+0000 7fa24cff9640 1 -- 172.21.15.49:0/1831957416 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fa24802fc20 con 0x7fa250108c50 2024-09-21T06:38:35.785 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.783+0000 7fa25c482740 1 -- start start 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa25c482740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 0x561e33d219b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa25c482740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 0x561e33d21ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa25c482740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3395b4d0 0x561e33d22430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa25c482740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561e33c966f0 con 0x561e3395b4d0 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa25c482740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561e33c85b20 con 0x561e3397c1b0 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa25c482740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561e33c89930 con 0x561e339532f0 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa247fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3395b4d0 0x561e33d22430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa247fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3395b4d0 0x561e33d22430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34434/0 (socket says 172.21.15.49:34434) 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa247fff640 1 -- 172.21.15.49:0/1518352408 learned_addr learned my addr 172.21.15.49:0/1518352408 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa24effd640 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 0x561e33d21ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa247fff640 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 0x561e33d219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa247fff640 1 -- 172.21.15.49:0/1518352408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 msgr2=0x561e33d21ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:35.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa247fff640 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 0x561e33d21ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa24cff9640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa23c0b6680 0x7fa23c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa247fff640 1 -- 172.21.15.49:0/1518352408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 msgr2=0x561e33d219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa247fff640 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 0x561e33d219b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa247fff640 1 -- 172.21.15.49:0/1518352408 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e33c4b530 con 0x561e3395b4d0 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.784+0000 7fa24effd640 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 0x561e33d21ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.785+0000 7fa24f7fe640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa23c0b6680 0x7fa23c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.785+0000 7fa247fff640 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3395b4d0 0x561e33d22430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa238012750 tx=0x7fa238004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abda8083fcef6fa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.785+0000 7fa24cff9640 1 -- 172.21.15.49:0/1831957416 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa2481089e0 con 0x7fa250108c50 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.785+0000 7fa2457fa640 1 -- 172.21.15.49:0/1518352408 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238012cd0 con 0x561e3395b4d0 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.785+0000 7fa2457fa640 1 -- 172.21.15.49:0/1518352408 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa238005020 con 0x561e3395b4d0 2024-09-21T06:38:35.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.785+0000 7fa2457fa640 1 -- 172.21.15.49:0/1518352408 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238004a00 con 0x561e3395b4d0 2024-09-21T06:38:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 -- 172.21.15.49:0/1518352408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3395b4d0 msgr2=0x561e33d22430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa24f7fe640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa23c0b6680 0x7fa23c0b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa2481061c0 tx=0x7fa2480ca040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3395b4d0 0x561e33d22430 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa238012750 tx=0x7fa238004730 comp rx=0 tx=0).stop 2024-09-21T06:38:35.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 -- 172.21.15.49:0/1518352408 shutdown_connections 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3395b4d0 0x561e33d22430 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 0x561e33d21ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 --2- 172.21.15.49:0/1518352408 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 0x561e33d219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 -- 172.21.15.49:0/1518352408 >> 172.21.15.49:0/1518352408 conn(0x561e33970300 msgr2=0x561e33d1f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 -- 172.21.15.49:0/1518352408 shutdown_connections 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 -- 172.21.15.49:0/1518352408 wait complete. 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.786+0000 7fa25c482740 1 -- start start 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa25c482740 1 Processor -- start 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa25c482740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e339532f0 0x561e33d2d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa25c482740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 0x561e33d2d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa25c482740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 0x561e33d39450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa25c482740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561e33bbdab0 con 0x561e339532f0 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa25c482740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561e33c2b730 con 0x561e3397c1b0 2024-09-21T06:38:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa25c482740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561e33d30130 con 0x561e3395b4d0 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa25c482740 10 client.0 _ll_register_callbacks cb 0x561e33c7f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa247fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e339532f0 0x561e33d2d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa247fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e339532f0 0x561e33d2d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34444/0 (socket says 172.21.15.49:34444) 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa247fff640 1 -- 172.21.15.49:0/1876836372 learned_addr learned my addr 172.21.15.49:0/1876836372 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa24effd640 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 0x561e33d2d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa247fff640 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 0x561e33d39450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa247fff640 1 -- 172.21.15.49:0/1876836372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 msgr2=0x561e33d2d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa247fff640 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 0x561e33d2d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa247fff640 1 -- 172.21.15.49:0/1876836372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 msgr2=0x561e33d39450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa247fff640 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 0x561e33d39450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa247fff640 1 -- 172.21.15.49:0/1876836372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e339e7790 con 0x561e339532f0 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.787+0000 7fa24effd640 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 0x561e33d2d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa247fff640 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e339532f0 0x561e33d2d070 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa238004610 tx=0x7fa238005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf93a57e8e644cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa2367fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa2367fc640 1 -- 172.21.15.49:0/1876836372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23802c060 con 0x561e339532f0 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa2367fc640 1 -- 172.21.15.49:0/1876836372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa2380049a0 con 0x561e339532f0 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa25c482740 1 -- 172.21.15.49:0/1876836372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa238005020 con 0x561e339532f0 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa2367fc640 1 -- 172.21.15.49:0/1876836372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa238004ba0 con 0x561e339532f0 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa25c482740 10 client.15966 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa25c482740 1 -- 172.21.15.49:0/1876836372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561e33a60620 con 0x561e339532f0 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa2367fc640 1 -- 172.21.15.49:0/1876836372 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa238005020 con 0x561e339532f0 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa2367fc640 1 -- 172.21.15.49:0/1876836372 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa23801f470 con 0x561e339532f0 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa25c482740 10 client.15966 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa25c482740 10 client.15966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.788+0000 7fa25c482740 20 client.15966 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.789+0000 7fa25c482740 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561e3393ad80 0x561e33d3f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.789+0000 7fa25c482740 4 client.15966 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.789+0000 7fa25c482740 1 -- 172.21.15.49:0/1876836372 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e33c98640 con 0x561e3393ad80 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.789+0000 7fa24effd640 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561e3393ad80 0x561e33d3f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.789+0000 7fa2367fc640 10 client.15966 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.789+0000 7fa24effd640 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561e3393ad80 0x561e33d3f070 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7ba88af8ffa016 server_cookie=76d91f04f5a44899 in_seq=0 out_seq=0 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa2367fc640 1 -- 172.21.15.49:0/1876836372 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561e33c98640 con 0x561e3393ad80 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa2367fc640 10 client.15966 handle_command_reply: tid=0 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa25c482740 1 client.15966 shutdown 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa25c482740 1 -- 172.21.15.49:0/1876836372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e339532f0 msgr2=0x561e33d2d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa25c482740 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e339532f0 0x561e33d2d070 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa238004610 tx=0x7fa238005fb0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa25c482740 1 -- 172.21.15.49:0/1876836372 shutdown_connections 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa25c482740 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561e3393ad80 0x561e33d3f070 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa25c482740 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3397c1b0 0x561e33d39450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa25c482740 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 0x561e33d2d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa25c482740 1 --2- 172.21.15.49:0/1876836372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e339532f0 0x561e33d2d070 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa2367fc640 0 client.15966 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.790+0000 7fa25c482740 1 -- 172.21.15.49:0/1876836372 >> 172.21.15.49:0/1876836372 conn(0x561e33970300 msgr2=0x561e33d229e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.791+0000 7fa25c482740 1 -- 172.21.15.49:0/1876836372 shutdown_connections 2024-09-21T06:38:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.791+0000 7fa25c482740 1 -- 172.21.15.49:0/1876836372 wait complete. 2024-09-21T06:38:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.791+0000 7fa25c482740 20 client.15966 trim_cache size 0 max 16384 2024-09-21T06:38:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.805+0000 7fa25c482740 1 Processor -- start 2024-09-21T06:38:35.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa25c482740 1 -- start start 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa25c482740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e339532f0 0x561e33d23350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa25c482740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 0x561e33d1e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa25c482740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33d2a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa25c482740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa2501b1fe0 con 0x561e3397c1b0 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa25c482740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2501af8b0 con 0x561e339532f0 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa25c482740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa2501ad720 con 0x561e3395b4d0 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa247fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33d2a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa247fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33d2a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34458/0 (socket says 172.21.15.49:34458) 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa247fff640 1 -- 172.21.15.49:0/1609642195 learned_addr learned my addr 172.21.15.49:0/1609642195 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa247fff640 1 --2- 172.21.15.49:0/1609642195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e339532f0 0x561e33d23350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.806+0000 7fa24effd640 1 --2- 172.21.15.49:0/1609642195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 0x561e33d1e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.807+0000 7fa247fff640 1 -- 172.21.15.49:0/1609642195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 msgr2=0x561e33d1e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:35.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.807+0000 7fa247fff640 1 --2- 172.21.15.49:0/1609642195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 0x561e33d1e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.807+0000 7fa247fff640 1 -- 172.21.15.49:0/1609642195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e339532f0 msgr2=0x561e33d23350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.807+0000 7fa247fff640 1 --2- 172.21.15.49:0/1609642195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e339532f0 0x561e33d23350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.807+0000 7fa247fff640 1 -- 172.21.15.49:0/1609642195 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e33d23ee0 con 0x561e3397c1b0 2024-09-21T06:38:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.807+0000 7fa247fff640 1 --2- 172.21.15.49:0/1609642195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33d2a240 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa238012750 tx=0x7fa238023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a083b457cb7781 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.807+0000 7fa244ff9640 1 -- 172.21.15.49:0/1609642195 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23802c070 con 0x561e3397c1b0 2024-09-21T06:38:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.807+0000 7fa244ff9640 1 -- 172.21.15.49:0/1609642195 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa238016040 con 0x561e3397c1b0 2024-09-21T06:38:35.810 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.807+0000 7fa244ff9640 1 -- 172.21.15.49:0/1609642195 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23801f470 con 0x561e3397c1b0 2024-09-21T06:38:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 -- 172.21.15.49:0/1609642195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 msgr2=0x561e33d2a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 --2- 172.21.15.49:0/1609642195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33d2a240 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fa238012750 tx=0x7fa238023040 comp rx=0 tx=0).stop 2024-09-21T06:38:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 -- 172.21.15.49:0/1609642195 shutdown_connections 2024-09-21T06:38:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 --2- 172.21.15.49:0/1609642195 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33d2a240 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 --2- 172.21.15.49:0/1609642195 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e3395b4d0 0x561e33d1e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 --2- 172.21.15.49:0/1609642195 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e339532f0 0x561e33d23350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 -- 172.21.15.49:0/1609642195 >> 172.21.15.49:0/1609642195 conn(0x561e33970300 msgr2=0x561e33d1dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 -- 172.21.15.49:0/1609642195 shutdown_connections 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 -- 172.21.15.49:0/1609642195 wait complete. 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 -- start start 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.808+0000 7fa25c482740 1 Processor -- start 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa25c482740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 0x561e33d41d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa25c482740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3395b4d0 0x561e33d422f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa25c482740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33da1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa25c482740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa2501add70 con 0x561e3397c1b0 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa25c482740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa2501af1e0 con 0x561e3395b4d0 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa25c482740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa2501ae440 con 0x561e339532f0 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa25c482740 10 client.0 _ll_register_callbacks cb 0x7fa23800be40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33da1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33da1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34474/0 (socket says 172.21.15.49:34474) 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 -- 172.21.15.49:0/3437581873 learned_addr learned my addr 172.21.15.49:0/3437581873 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 0x561e33d41d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa24effd640 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3395b4d0 0x561e33d422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 -- 172.21.15.49:0/3437581873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 msgr2=0x561e33d41d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 0x561e33d41d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 -- 172.21.15.49:0/3437581873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3395b4d0 msgr2=0x561e33d422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3395b4d0 0x561e33d422f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 -- 172.21.15.49:0/3437581873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e33d24860 con 0x561e3397c1b0 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa247fff640 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33da1a60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa23801f910 tx=0x7fa238012520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b471bea8611845 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.809+0000 7fa2367fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa2367fc640 1 -- 172.21.15.49:0/3437581873 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23802c070 con 0x561e3397c1b0 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa2367fc640 1 -- 172.21.15.49:0/3437581873 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa23801fb90 con 0x561e3397c1b0 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa25c482740 1 -- 172.21.15.49:0/3437581873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa238016040 con 0x561e3397c1b0 2024-09-21T06:38:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa2367fc640 1 -- 172.21.15.49:0/3437581873 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa238045040 con 0x561e3397c1b0 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa25c482740 10 client.15972 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa25c482740 1 -- 172.21.15.49:0/3437581873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561e33da9310 con 0x561e3397c1b0 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa2367fc640 1 -- 172.21.15.49:0/3437581873 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa238016040 con 0x561e3397c1b0 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa2367fc640 1 -- 172.21.15.49:0/3437581873 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa238010ae0 con 0x561e3397c1b0 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa25c482740 10 client.15972 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa25c482740 10 client.15972 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa25c482740 20 client.15972 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa25c482740 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561e339101c0 0x561e33dab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa25c482740 4 client.15972 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa25c482740 1 -- 172.21.15.49:0/3437581873 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e33c940f0 con 0x561e339101c0 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.810+0000 7fa24effd640 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561e339101c0 0x561e33dab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.811+0000 7fa2367fc640 10 client.15972 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.811+0000 7fa24effd640 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561e339101c0 0x561e33dab650 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c105bffdbceb8e42 server_cookie=370e3987b18df516 in_seq=0 out_seq=0 2024-09-21T06:38:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa2367fc640 1 -- 172.21.15.49:0/3437581873 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e33c940f0 con 0x561e339101c0 2024-09-21T06:38:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa2367fc640 10 client.15972 handle_command_reply: tid=0 2024-09-21T06:38:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 client.15972 shutdown 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 -- 172.21.15.49:0/3437581873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 msgr2=0x561e33da1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33da1a60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa23801f910 tx=0x7fa238012520 comp rx=0 tx=0).stop 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 -- 172.21.15.49:0/3437581873 shutdown_connections 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561e339101c0 0x561e33dab650 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561e3397c1b0 0x561e33da1a60 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa2367fc640 0 client.15972 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561e3395b4d0 0x561e33d422f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 --2- 172.21.15.49:0/3437581873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561e339532f0 0x561e33d41d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 -- 172.21.15.49:0/3437581873 >> 172.21.15.49:0/3437581873 conn(0x561e33970300 msgr2=0x561e33d23330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 -- 172.21.15.49:0/3437581873 shutdown_connections 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 1 -- 172.21.15.49:0/3437581873 wait complete. 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.818+0000 7fa25c482740 20 client.15972 trim_cache size 0 max 16384 2024-09-21T06:38:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:38:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:38:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:38:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:38:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 -- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa23c0b6680 msgr2=0x7fa23c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa23c0b6680 0x7fa23c0b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa2481061c0 tx=0x7fa2480ca040 comp rx=0 tx=0).stop 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 -- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 msgr2=0x7fa25019fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 0x7fa25019fbb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fa2480098d0 tx=0x7fa2480317b0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 -- 172.21.15.49:0/1831957416 shutdown_connections 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa23c0b6680 0x7fa23c0b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa250108c50 0x7fa25019fbb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa250108300 0x7fa25019a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 --2- 172.21.15.49:0/1831957416 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa2501029d0 0x7fa25019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 -- 172.21.15.49:0/1831957416 >> 172.21.15.49:0/1831957416 conn(0x7fa25007a710 msgr2=0x7fa25006bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 -- 172.21.15.49:0/1831957416 shutdown_connections 2024-09-21T06:38:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:35.819+0000 7fa255439640 1 -- 172.21.15.49:0/1831957416 wait complete. 2024-09-21T06:38:35.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:35 smithi049 ceph-mon[31177]: pgmap v377: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:38:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:35 smithi098 ceph-mon[34704]: pgmap v377: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:38:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:35 smithi079 ceph-mon[34346]: pgmap v377: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:38:37.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:37 smithi049 ceph-mon[31177]: pgmap v378: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:37 smithi098 ceph-mon[34704]: pgmap v378: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:38.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:37 smithi079 ceph-mon[34346]: pgmap v378: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:39.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:39 smithi049 ceph-mon[31177]: pgmap v379: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-21T06:38:40.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:39 smithi098 ceph-mon[34704]: pgmap v379: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-21T06:38:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:39 smithi079 ceph-mon[34346]: pgmap v379: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 17 op/s 2024-09-21T06:38:41.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:41 smithi049 ceph-mon[31177]: pgmap v380: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:41 smithi098 ceph-mon[34704]: pgmap v380: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:41 smithi079 ceph-mon[34346]: pgmap v380: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:43.428 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:38:43.706 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:43.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:43 smithi049 ceph-mon[31177]: pgmap v381: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-21T06:38:44.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:43 smithi098 ceph-mon[34704]: pgmap v381: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-21T06:38:44.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:43 smithi079 ceph-mon[34346]: pgmap v381: 97 pgs: 97 active+clean; 2.0 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-21T06:38:44.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.155+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1781503586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 msgr2=0x7f4ca01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.155+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1781503586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 0x7f4ca01098b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009ca0 tx=0x7f4c9002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.156+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1781503586 shutdown_connections 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.156+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1781503586 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca0109df0 0x7f4ca0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.156+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1781503586 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 0x7f4ca01098b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.156+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1781503586 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca0103b60 0x7f4ca0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.156+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1781503586 >> 172.21.15.49:0/1781503586 conn(0x7f4ca007b850 msgr2=0x7f4ca007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.156+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1781503586 shutdown_connections 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.156+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1781503586 wait complete. 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.156+0000 7f4ca6b9a640 1 Processor -- start 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.156+0000 7f4ca6b9a640 1 -- start start 2024-09-21T06:38:44.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4ca6b9a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca0103b60 0x7f4ca019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4ca6b9a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 0x7f4ca019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4ca6b9a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca0109df0 0x7f4ca01a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4ca6b9a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca0113ad0 con 0x7f4ca01094a0 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4ca6b9a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca0113950 con 0x7f4ca0103b60 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4ca6b9a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca0113c50 con 0x7f4ca0109df0 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4c9ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 0x7f4ca019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4c9ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 0x7f4ca019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60918/0 (socket says 172.21.15.49:60918) 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4c9ffff640 1 -- 172.21.15.49:0/1624548622 learned_addr learned my addr 172.21.15.49:0/1624548622 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4ca5137640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca0109df0 0x7f4ca01a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4ca4936640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca0103b60 0x7f4ca019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4c9ffff640 1 -- 172.21.15.49:0/1624548622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca0109df0 msgr2=0x7f4ca01a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca0109df0 0x7f4ca01a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4c9ffff640 1 -- 172.21.15.49:0/1624548622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca0103b60 msgr2=0x7f4ca019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca0103b60 0x7f4ca019c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4c9ffff640 1 -- 172.21.15.49:0/1624548622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca01a2670 con 0x7f4ca01094a0 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.157+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 0x7f4ca019cca0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4c900319f0 tx=0x7f4c90031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.158+0000 7f4c9dffb640 1 -- 172.21.15.49:0/1624548622 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c90003bf0 con 0x7f4ca01094a0 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.158+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1624548622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca01a2900 con 0x7f4ca01094a0 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.158+0000 7f4c9dffb640 1 -- 172.21.15.49:0/1624548622 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c90003d90 con 0x7f4ca01094a0 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.158+0000 7f4c9dffb640 1 -- 172.21.15.49:0/1624548622 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9002fb70 con 0x7f4ca01094a0 2024-09-21T06:38:44.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.158+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1624548622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca01a90c0 con 0x7f4ca01094a0 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.160+0000 7f4cad10e740 1 Processor -- start 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.160+0000 7f4cad10e740 1 -- start start 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4c9dffb640 1 -- 172.21.15.49:0/1624548622 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f4c9002fd10 con 0x7f4ca01094a0 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f7d070 0x556249324270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x5562493247b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x556249324cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4cad10e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55624929ae50 con 0x556248f541b0 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4cad10e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55624928a280 con 0x556248f5c390 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4cad10e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55624928e090 con 0x556248f7d070 2024-09-21T06:38:44.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4ca4936640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x5562493247b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4ca4936640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x5562493247b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60922/0 (socket says 172.21.15.49:60922) 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4ca4936640 1 -- 172.21.15.49:0/4280607598 learned_addr learned my addr 172.21.15.49:0/4280607598 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4ca5137640 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f7d070 0x556249324270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x556249324cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4ca4936640 1 -- 172.21.15.49:0/4280607598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f7d070 msgr2=0x556249324270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4ca4936640 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f7d070 0x556249324270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4ca4936640 1 -- 172.21.15.49:0/4280607598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 msgr2=0x556249324cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4ca4936640 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x556249324cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4ca4936640 1 -- 172.21.15.49:0/4280607598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556248fe8650 con 0x556248f541b0 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.161+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x556249324cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.162+0000 7f4ca4936640 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x5562493247b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800bd10 tx=0x7f4c880107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd791dfbff5e1282 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.162+0000 7f4c9dffb640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c8c0b6680 0x7f4c8c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.162+0000 7f4ca5137640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c8c0b6680 0x7f4c8c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.162+0000 7f4c96ffd640 1 -- 172.21.15.49:0/4280607598 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88004030 con 0x556248f541b0 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.162+0000 7f4c96ffd640 1 -- 172.21.15.49:0/4280607598 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c880035f0 con 0x556248f541b0 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.162+0000 7f4c96ffd640 1 -- 172.21.15.49:0/4280607598 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88011770 con 0x556248f541b0 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.162+0000 7f4c9dffb640 1 -- 172.21.15.49:0/1624548622 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f4c90108a10 con 0x7f4ca01094a0 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 -- 172.21.15.49:0/4280607598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 msgr2=0x5562493247b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4ca5137640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c8c0b6680 0x7f4c8c0b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009a70 tx=0x7f4c980090e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x5562493247b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800bd10 tx=0x7f4c880107a0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 -- 172.21.15.49:0/4280607598 shutdown_connections 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x556249324cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x5562493247b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 --2- 172.21.15.49:0/4280607598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f7d070 0x556249324270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 -- 172.21.15.49:0/4280607598 >> 172.21.15.49:0/4280607598 conn(0x556248f71460 msgr2=0x556249322160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:44.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 -- 172.21.15.49:0/4280607598 shutdown_connections 2024-09-21T06:38:44.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 -- 172.21.15.49:0/4280607598 wait complete. 2024-09-21T06:38:44.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 -- start start 2024-09-21T06:38:44.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.163+0000 7f4cad10e740 1 Processor -- start 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 0x55624932f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x55624932fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f7d070 0x55624933bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4cad10e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5562490eb700 con 0x556248f7d070 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4cad10e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556249225110 con 0x556248f5c390 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4cad10e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556249332a50 con 0x556248f541b0 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4cad10e740 10 client.0 _ll_register_callbacks cb 0x55624923e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4ca5137640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f7d070 0x55624933bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4ca5137640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f7d070 0x55624933bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60928/0 (socket says 172.21.15.49:60928) 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4ca5137640 1 -- 172.21.15.49:0/451043313 learned_addr learned my addr 172.21.15.49:0/451043313 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:44.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4ca4936640 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 0x55624932f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x55624932fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4ca5137640 1 -- 172.21.15.49:0/451043313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 msgr2=0x55624932f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4ca5137640 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 0x55624932f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4ca5137640 1 -- 172.21.15.49:0/451043313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 msgr2=0x55624932fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4ca5137640 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x55624932fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.164+0000 7f4ca5137640 1 -- 172.21.15.49:0/451043313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556249252c40 con 0x556248f7d070 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.165+0000 7f4ca5137640 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f7d070 0x55624933bd70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4c980149c0 tx=0x7f4c980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2928ecc9d726f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.165+0000 7f4c7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.165+0000 7f4c7ffff640 1 -- 172.21.15.49:0/451043313 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98025070 con 0x556248f7d070 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.165+0000 7f4cad10e740 1 -- 172.21.15.49:0/451043313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c880035f0 con 0x556248f7d070 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.165+0000 7f4c7ffff640 1 -- 172.21.15.49:0/451043313 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f4c98021600 con 0x556248f7d070 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.165+0000 7f4c7ffff640 1 -- 172.21.15.49:0/451043313 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4c98021800 con 0x556248f7d070 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.165+0000 7f4cad10e740 10 client.15984 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.165+0000 7f4cad10e740 1 -- 172.21.15.49:0/451043313 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55624933e7f0 con 0x556248f7d070 2024-09-21T06:38:44.173 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.165+0000 7f4c7ffff640 1 -- 172.21.15.49:0/451043313 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c880035f0 con 0x556248f7d070 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4c7ffff640 1 -- 172.21.15.49:0/451043313 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f4c98020070 con 0x556248f7d070 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4cad10e740 10 client.15984 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4cad10e740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4cad10e740 20 client.15984 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4cad10e740 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556248f3b9f0 0x556249341d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4cad10e740 4 client.15984 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4cad10e740 1 -- 172.21.15.49:0/451043313 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55624929cda0 con 0x556248f3b9f0 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4ca4936640 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556248f3b9f0 0x556249341d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4c7ffff640 10 client.15984 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.166+0000 7f4ca4936640 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556248f3b9f0 0x556249341d20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ab0a5913bc9be00 server_cookie=24e81781ef1efabc in_seq=0 out_seq=0 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4c7ffff640 1 -- 172.21.15.49:0/451043313 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55624929cda0 con 0x556248f3b9f0 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4c7ffff640 10 client.15984 handle_command_reply: tid=0 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4cad10e740 1 client.15984 shutdown 2024-09-21T06:38:44.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4cad10e740 1 -- 172.21.15.49:0/451043313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f7d070 msgr2=0x55624933bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4cad10e740 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f7d070 0x55624933bd70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4c980149c0 tx=0x7f4c980046c0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4cad10e740 1 -- 172.21.15.49:0/451043313 shutdown_connections 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4cad10e740 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556248f3b9f0 0x556249341d20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4c7ffff640 0 client.15984 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4cad10e740 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f7d070 0x55624933bd70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4cad10e740 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x55624932fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4cad10e740 1 --2- 172.21.15.49:0/451043313 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 0x55624932f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.167+0000 7f4cad10e740 1 -- 172.21.15.49:0/451043313 >> 172.21.15.49:0/451043313 conn(0x556248f71460 msgr2=0x556249327400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.168+0000 7f4cad10e740 1 -- 172.21.15.49:0/451043313 shutdown_connections 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.168+0000 7f4cad10e740 1 -- 172.21.15.49:0/451043313 wait complete. 2024-09-21T06:38:44.175 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.168+0000 7f4cad10e740 20 client.15984 trim_cache size 0 max 16384 2024-09-21T06:38:44.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4cad10e740 1 Processor -- start 2024-09-21T06:38:44.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4cad10e740 1 -- start start 2024-09-21T06:38:44.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f3b9f0 0x5562493315b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 0x55624933bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x55624932cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4cad10e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01b43b0 con 0x556248f3b9f0 2024-09-21T06:38:44.189 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4cad10e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01b1c80 con 0x556248f5c390 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4cad10e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01afaf0 con 0x556248f541b0 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4ca4936640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f3b9f0 0x5562493315b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4ca4936640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f3b9f0 0x5562493315b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60932/0 (socket says 172.21.15.49:60932) 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.185+0000 7f4ca4936640 1 -- 172.21.15.49:0/43832360 learned_addr learned my addr 172.21.15.49:0/43832360 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 0x55624933bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4ca5137640 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x55624932cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4ca4936640 1 -- 172.21.15.49:0/43832360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 msgr2=0x55624933bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4ca4936640 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 0x55624933bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4ca4936640 1 -- 172.21.15.49:0/43832360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 msgr2=0x55624932cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4ca4936640 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x55624932cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4ca4936640 1 -- 172.21.15.49:0/43832360 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562493304e0 con 0x556248f3b9f0 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4ca5137640 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x55624932cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4ca4936640 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f3b9f0 0x5562493315b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800baa0 tx=0x7f4c8801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c49b862e6b34e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:44.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4c967fc640 1 -- 172.21.15.49:0/43832360 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c88032070 con 0x556248f3b9f0 2024-09-21T06:38:44.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4c967fc640 1 -- 172.21.15.49:0/43832360 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c880035f0 con 0x556248f3b9f0 2024-09-21T06:38:44.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.186+0000 7f4c967fc640 1 -- 172.21.15.49:0/43832360 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c880116a0 con 0x556248f3b9f0 2024-09-21T06:38:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 -- 172.21.15.49:0/43832360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f3b9f0 msgr2=0x5562493315b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f3b9f0 0x5562493315b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800baa0 tx=0x7f4c8801d040 comp rx=0 tx=0).stop 2024-09-21T06:38:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 -- 172.21.15.49:0/43832360 shutdown_connections 2024-09-21T06:38:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x55624932cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f541b0 0x55624933bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 --2- 172.21.15.49:0/43832360 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f3b9f0 0x5562493315b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 -- 172.21.15.49:0/43832360 >> 172.21.15.49:0/43832360 conn(0x556248f71460 msgr2=0x556249330ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:44.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 -- 172.21.15.49:0/43832360 shutdown_connections 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 -- 172.21.15.49:0/43832360 wait complete. 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.187+0000 7f4cad10e740 1 -- start start 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4cad10e740 1 Processor -- start 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f3b9f0 0x556249334550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x556249334b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4cad10e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x5562493ab720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4cad10e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01b0140 con 0x556248f541b0 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4cad10e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01b15b0 con 0x556248f5c390 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4cad10e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca01b0810 con 0x556248f3b9f0 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4cad10e740 10 client.0 _ll_register_callbacks cb 0x7f4c98009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4c9ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x556249334b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4c9ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x556249334b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60948/0 (socket says 172.21.15.49:60948) 2024-09-21T06:38:44.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4c9ffff640 1 -- 172.21.15.49:0/2076051376 learned_addr learned my addr 172.21.15.49:0/2076051376 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4ca5137640 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x5562493ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4ca4936640 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f3b9f0 0x556249334550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4c9ffff640 1 -- 172.21.15.49:0/2076051376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f3b9f0 msgr2=0x556249334550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.188+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f3b9f0 0x556249334550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4c9ffff640 1 -- 172.21.15.49:0/2076051376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 msgr2=0x5562493ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x5562493ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4c9ffff640 1 -- 172.21.15.49:0/2076051376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562493abd90 con 0x556248f541b0 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4ca4936640 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f3b9f0 0x556249334550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4c9ffff640 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x556249334b10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4c900ce540 tx=0x7f4c9002f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f5629c98664270 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4c7ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:44.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4c7ffff640 1 -- 172.21.15.49:0/2076051376 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c900ce190 con 0x556248f541b0 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4c7ffff640 1 -- 172.21.15.49:0/2076051376 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f4c900cdca0 con 0x556248f541b0 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4cad10e740 1 -- 172.21.15.49:0/2076051376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c880035f0 con 0x556248f541b0 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4c7ffff640 1 -- 172.21.15.49:0/2076051376 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4c900cdfb0 con 0x556248f541b0 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4cad10e740 10 client.15990 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4cad10e740 1 -- 172.21.15.49:0/2076051376 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5562493acfd0 con 0x556248f541b0 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.189+0000 7f4c7ffff640 1 -- 172.21.15.49:0/2076051376 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c9010f020 con 0x556248f541b0 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4c7ffff640 1 -- 172.21.15.49:0/2076051376 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f4c900cd510 con 0x556248f541b0 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4cad10e740 10 client.15990 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4cad10e740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4cad10e740 20 client.15990 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:44.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4cad10e740 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556248f7d070 0x5562493af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4cad10e740 4 client.15990 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4cad10e740 1 -- 172.21.15.49:0/2076051376 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556249298850 con 0x556248f7d070 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4ca4936640 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556248f7d070 0x5562493af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4c7ffff640 10 client.15990 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.190+0000 7f4ca4936640 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556248f7d070 0x5562493af7c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d36ed8ead724ef6 server_cookie=c30ff94f0f34d669 in_seq=0 out_seq=0 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4c7ffff640 1 -- 172.21.15.49:0/2076051376 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x556249298850 con 0x556248f7d070 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4c7ffff640 10 client.15990 handle_command_reply: tid=0 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 client.15990 shutdown 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 -- 172.21.15.49:0/2076051376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 msgr2=0x556249334b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x556249334b10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4c900ce540 tx=0x7f4c9002f660 comp rx=0 tx=0).stop 2024-09-21T06:38:44.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 -- 172.21.15.49:0/2076051376 shutdown_connections 2024-09-21T06:38:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556248f7d070 0x5562493af7c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556248f5c390 0x5562493ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556248f541b0 0x556249334b10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 --2- 172.21.15.49:0/2076051376 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556248f3b9f0 0x556249334550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4c7ffff640 0 client.15990 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 -- 172.21.15.49:0/2076051376 >> 172.21.15.49:0/2076051376 conn(0x556248f71460 msgr2=0x556249325a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 -- 172.21.15.49:0/2076051376 shutdown_connections 2024-09-21T06:38:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 1 -- 172.21.15.49:0/2076051376 wait complete. 2024-09-21T06:38:44.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.191+0000 7f4cad10e740 20 client.15990 trim_cache size 0 max 16384 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:44.201 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:44.202 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:44.203 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:38:44.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c8c0b6680 msgr2=0x7f4c8c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:44.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c8c0b6680 0x7f4c8c0b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009a70 tx=0x7f4c980090e0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 msgr2=0x7f4ca019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:44.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 0x7f4ca019cca0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4c900319f0 tx=0x7f4c90031a20 comp rx=0 tx=0).stop 2024-09-21T06:38:44.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1624548622 shutdown_connections 2024-09-21T06:38:44.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4c8c0b6680 0x7f4c8c0b8b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4ca0109df0 0x7f4ca01a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4ca01094a0 0x7f4ca019cca0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 --2- 172.21.15.49:0/1624548622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4ca0103b60 0x7f4ca019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:44.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1624548622 >> 172.21.15.49:0/1624548622 conn(0x7f4ca007b850 msgr2=0x7f4ca0107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:44.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1624548622 shutdown_connections 2024-09-21T06:38:44.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:44.192+0000 7f4ca6b9a640 1 -- 172.21.15.49:0/1624548622 wait complete. 2024-09-21T06:38:44.905 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:38:44.905 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:38:45.165 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.619+0000 7f7be08ac640 1 -- 172.21.15.49:0/4162621549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 msgr2=0x7f7bdc10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.619+0000 7f7be08ac640 1 --2- 172.21.15.49:0/4162621549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 0x7f7bdc10f530 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009ca0 tx=0x7f7bd402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.620+0000 7f7be08ac640 1 -- 172.21.15.49:0/4162621549 shutdown_connections 2024-09-21T06:38:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.620+0000 7f7be08ac640 1 --2- 172.21.15.49:0/4162621549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 0x7f7bdc10f530 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.620+0000 7f7be08ac640 1 --2- 172.21.15.49:0/4162621549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bdc1083b0 0x7f7bdc1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.620+0000 7f7be08ac640 1 --2- 172.21.15.49:0/4162621549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bdc102a70 0x7f7bdc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.620+0000 7f7be08ac640 1 -- 172.21.15.49:0/4162621549 >> 172.21.15.49:0/4162621549 conn(0x7f7bdc079710 msgr2=0x7f7bdc079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.620+0000 7f7be08ac640 1 -- 172.21.15.49:0/4162621549 shutdown_connections 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.620+0000 7f7be08ac640 1 -- 172.21.15.49:0/4162621549 wait complete. 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.620+0000 7f7be08ac640 1 Processor -- start 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.620+0000 7f7be08ac640 1 -- start start 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7be08ac640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bdc102a70 0x7f7bdc19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7be08ac640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bdc1083b0 0x7f7bdc19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7be08ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 0x7f7bdc19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7be08ac640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc1129c0 con 0x7f7bdc108d00 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7be08ac640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc112840 con 0x7f7bdc102a70 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7be08ac640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7bdc112b40 con 0x7f7bdc1083b0 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bdad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 0x7f7bdc19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bdad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 0x7f7bdc19bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60966/0 (socket says 172.21.15.49:60966) 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bdad9d640 1 -- 172.21.15.49:0/2998906687 learned_addr learned my addr 172.21.15.49:0/2998906687 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bda59c640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bdc102a70 0x7f7bdc19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bd9d9b640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bdc1083b0 0x7f7bdc19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bdad9d640 1 -- 172.21.15.49:0/2998906687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bdc1083b0 msgr2=0x7f7bdc19b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bdad9d640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bdc1083b0 0x7f7bdc19b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bdad9d640 1 -- 172.21.15.49:0/2998906687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bdc102a70 msgr2=0x7f7bdc19b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bdad9d640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bdc102a70 0x7f7bdc19b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bdad9d640 1 -- 172.21.15.49:0/2998906687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bdc1a6490 con 0x7f7bdc108d00 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.621+0000 7f7bdad9d640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 0x7f7bdc19bc90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005cc0 tx=0x7f7bd402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.622+0000 7f7bcb7fe640 1 -- 172.21.15.49:0/2998906687 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4003bf0 con 0x7f7bdc108d00 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.622+0000 7f7bcb7fe640 1 -- 172.21.15.49:0/2998906687 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bd4003d90 con 0x7f7bdc108d00 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.622+0000 7f7bcb7fe640 1 -- 172.21.15.49:0/2998906687 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd402fbc0 con 0x7f7bdc108d00 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.622+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bdc1a6720 con 0x7f7bdc108d00 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.622+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bdc1a6c60 con 0x7f7bdc108d00 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.623+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bdc103cf0 con 0x7f7bdc108d00 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.624+0000 7f7bcb7fe640 1 -- 172.21.15.49:0/2998906687 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f7bd402fd60 con 0x7f7bdc108d00 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.625+0000 7f7bcb7fe640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7bc40b6680 0x7f7bc40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.625+0000 7f7bda59c640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7bc40b6680 0x7f7bc40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:45.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.625+0000 7f7bcb7fe640 1 -- 172.21.15.49:0/2998906687 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f7bd4108e10 con 0x7f7bdc108d00 2024-09-21T06:38:45.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.626+0000 7f7bda59c640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7bc40b6680 0x7f7bc40b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc06c740 tx=0x7f7bcc00b410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:45.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.628+0000 7f7bcb7fe640 1 -- 172.21.15.49:0/2998906687 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7bd40cf340 con 0x7f7bdc108d00 2024-09-21T06:38:45.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.853+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bdc102e80 con 0x7f7bdc108d00 2024-09-21T06:38:45.856 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:45 smithi049 ceph-mon[31177]: pgmap v382: 97 pgs: 97 active+clean; 2.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:38:45.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.853+0000 7f7bcb7fe640 1 -- 172.21.15.49:0/2998906687 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11894 (secure 0 0 0) 0x7f7bd40d3720 con 0x7f7bdc108d00 2024-09-21T06:38:45.857 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:38:45.857 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"btime":"2024-09-21T06:37:49:249607+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:37:48.552776+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:38:45.857 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7bc40b6680 msgr2=0x7f7bc40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7bc40b6680 0x7f7bc40b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc06c740 tx=0x7f7bcc00b410 comp rx=0 tx=0).stop 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 msgr2=0x7f7bdc19bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 0x7f7bdc19bc90 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4005cc0 tx=0x7f7bd402f380 comp rx=0 tx=0).stop 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 shutdown_connections 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7bc40b6680 0x7f7bc40b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7bdc108d00 0x7f7bdc19bc90 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7bdc1083b0 0x7f7bdc19b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 --2- 172.21.15.49:0/2998906687 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7bdc102a70 0x7f7bdc19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:45.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 >> 172.21.15.49:0/2998906687 conn(0x7f7bdc079710 msgr2=0x7f7bdc106400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:45.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 shutdown_connections 2024-09-21T06:38:45.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:45.856+0000 7f7be08ac640 1 -- 172.21.15.49:0/2998906687 wait complete. 2024-09-21T06:38:46.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:45 smithi098 ceph-mon[34704]: pgmap v382: 97 pgs: 97 active+clean; 2.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:38:46.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:45 smithi079 ceph-mon[34346]: pgmap v382: 97 pgs: 97 active+clean; 2.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:38:46.411 INFO:tasks.workunit.client.0.smithi049.stdout:1/600: open fd = 3 2024-09-21T06:38:46.411 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.411 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:2/600: open fd = 3 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:3/600: open fd = 3 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:4/600: open fd = 3 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:5/600: open fd = 3 2024-09-21T06:38:46.412 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:6/600: open fd = 3 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:7/600: open fd = 3 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:8/600: open fd = 3 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.413 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.414 INFO:tasks.workunit.client.0.smithi049.stdout:9/600: open fd = 3 2024-09-21T06:38:46.414 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.414 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.414 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.414 INFO:tasks.workunit.client.0.smithi049.stdout:10/600: open fd = 3 2024-09-21T06:38:46.414 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.414 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.414 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.414 INFO:tasks.workunit.client.0.smithi049.stdout:11/600: open fd = 3 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:12/600: open fd = 3 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:13/600: open fd = 3 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:14/600: open fd = 3 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.415 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:15/600: open fd = 3 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:16/600: open fd = 3 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.416 INFO:tasks.workunit.client.0.smithi049.stdout:17/600: open fd = 3 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:18/600: open fd = 3 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:19/600: open fd = 3 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.417 INFO:tasks.workunit.client.0.smithi049.stdout:20/600: open fd = 3 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:21/600: open fd = 3 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:22/600: open fd = 3 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.418 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:23/600: open fd = 3 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:24/600: open fd = 3 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:25/600: open fd = 3 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.419 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:26/600: open fd = 3 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:27/600: open fd = 3 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:28/600: open fd = 3 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.420 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:29/600: open fd = 3 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:30/600: open fd = 3 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:31/600: open fd = 3 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.421 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:32/600: open fd = 3 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:33/600: open fd = 3 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.422 INFO:tasks.workunit.client.0.smithi049.stdout:34/600: open fd = 3 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:35/600: open fd = 3 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:36/600: open fd = 3 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.423 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:37/600: open fd = 3 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:38/600: open fd = 3 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:39/600: open fd = 3 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.424 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:40/600: open fd = 3 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:41/600: open fd = 3 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.425 INFO:tasks.workunit.client.0.smithi049.stdout:42/600: open fd = 3 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:43/600: open fd = 3 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:44/600: open fd = 3 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.426 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:45/600: open fd = 3 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:46/600: open fd = 3 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:47/600: open fd = 3 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:48/600: open fd = 3 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.427 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:49/600: open fd = 3 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:50/600: open fd = 3 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:51/600: open fd = 3 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.428 INFO:tasks.workunit.client.0.smithi049.stdout:52/600: open fd = 3 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:53/600: open fd = 3 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:54/600: open fd = 3 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:55/600: open fd = 3 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.429 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:56/600: open fd = 3 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:57/600: open fd = 3 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:58/600: open fd = 3 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:59/600: open fd = 3 2024-09-21T06:38:46.430 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:60/600: open fd = 3 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:61/600: open fd = 3 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:62/600: open fd = 3 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.431 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.432 INFO:tasks.workunit.client.0.smithi049.stdout:63/600: open fd = 3 2024-09-21T06:38:46.432 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.432 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:38:46.432 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:38:46.472 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:38:46.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:46 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2998906687' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:46.732 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:47.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:46 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2998906687' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:47.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:46 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2998906687' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.203+0000 7f1db3f98640 1 -- 172.21.15.49:0/3076541310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 msgr2=0x7f1dac104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.203+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3076541310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 0x7f1dac104c70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009900 tx=0x7f1da402a410 comp rx=0 tx=0).stop 2024-09-21T06:38:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.203+0000 7f1db3f98640 1 -- 172.21.15.49:0/3076541310 shutdown_connections 2024-09-21T06:38:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.203+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3076541310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dac10de10 0x7f1dac1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.203+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3076541310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dac105290 0x7f1dac10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.203+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3076541310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 0x7f1dac104c70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.203+0000 7f1db3f98640 1 -- 172.21.15.49:0/3076541310 >> 172.21.15.49:0/3076541310 conn(0x7f1dac079730 msgr2=0x7f1dac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:47.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.203+0000 7f1db3f98640 1 -- 172.21.15.49:0/3076541310 shutdown_connections 2024-09-21T06:38:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.203+0000 7f1db3f98640 1 -- 172.21.15.49:0/3076541310 wait complete. 2024-09-21T06:38:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db3f98640 1 Processor -- start 2024-09-21T06:38:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db3f98640 1 -- start start 2024-09-21T06:38:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db3f98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 0x7f1dac102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db3f98640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dac105290 0x7f1dac102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db3f98640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dac10de10 0x7f1dac1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db3f98640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac113b40 con 0x7f1dac104860 2024-09-21T06:38:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db3f98640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1139c0 con 0x7f1dac105290 2024-09-21T06:38:47.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db3f98640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac113cc0 con 0x7f1dac10de10 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db1d34640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 0x7f1dac102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db1d34640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 0x7f1dac102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37850/0 (socket says 172.21.15.49:37850) 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db1d34640 1 -- 172.21.15.49:0/3124158722 learned_addr learned my addr 172.21.15.49:0/3124158722 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db2535640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dac10de10 0x7f1dac1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.204+0000 7f1db1533640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dac105290 0x7f1dac102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1db1d34640 1 -- 172.21.15.49:0/3124158722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dac10de10 msgr2=0x7f1dac1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1db1d34640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dac10de10 0x7f1dac1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1db1d34640 1 -- 172.21.15.49:0/3124158722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dac105290 msgr2=0x7f1dac102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1db1d34640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dac105290 0x7f1dac102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1db1d34640 1 -- 172.21.15.49:0/3124158722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dac1a8870 con 0x7f1dac104860 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1db1d34640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 0x7f1dac102770 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006010 tx=0x7f1da40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:47.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1daaffd640 1 -- 172.21.15.49:0/3124158722 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da403f030 con 0x7f1dac104860 2024-09-21T06:38:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1daaffd640 1 -- 172.21.15.49:0/3124158722 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1da4003800 con 0x7f1dac104860 2024-09-21T06:38:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1db3f98640 1 -- 172.21.15.49:0/3124158722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dac1a8b00 con 0x7f1dac104860 2024-09-21T06:38:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1daaffd640 1 -- 172.21.15.49:0/3124158722 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4035070 con 0x7f1dac104860 2024-09-21T06:38:47.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.205+0000 7f1db3f98640 1 -- 172.21.15.49:0/3124158722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dac1a8fe0 con 0x7f1dac104860 2024-09-21T06:38:47.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1dba50c740 1 Processor -- start 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1dba50c740 1 -- start start 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a8579592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8575891b0 0x55a857959800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 0x55a857959d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1dba50c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a8578cfea0 con 0x55a8575b2070 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1dba50c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8578bf2d0 con 0x55a857591390 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1dba50c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a8578c30e0 con 0x55a8575891b0 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1daaffd640 1 -- 172.21.15.49:0/3124158722 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f1da4031b10 con 0x7f1dac104860 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1db2535640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a8579592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1db2535640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a8579592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37852/0 (socket says 172.21.15.49:37852) 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.208+0000 7f1db2535640 1 -- 172.21.15.49:0/403030399 learned_addr learned my addr 172.21.15.49:0/403030399 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1db1533640 1 --2- 172.21.15.49:0/403030399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 0x55a857959d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1db2535640 1 -- 172.21.15.49:0/403030399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8575891b0 msgr2=0x55a857959800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:47.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1db2535640 1 --2- 172.21.15.49:0/403030399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8575891b0 0x55a857959800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1db2535640 1 -- 172.21.15.49:0/403030399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 msgr2=0x55a857959d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1db2535640 1 --2- 172.21.15.49:0/403030399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 0x55a857959d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1db2535640 1 -- 172.21.15.49:0/403030399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a85761d650 con 0x55a8575b2070 2024-09-21T06:38:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1db1533640 1 --2- 172.21.15.49:0/403030399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 0x55a857959d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1db2535640 1 --2- 172.21.15.49:0/403030399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a8579592c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009f20 tx=0x7f1d9c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554d459932f508f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1d93fff640 1 -- 172.21.15.49:0/403030399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c01a070 con 0x55a8575b2070 2024-09-21T06:38:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1d93fff640 1 -- 172.21.15.49:0/403030399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d9c0158c0 con 0x55a8575b2070 2024-09-21T06:38:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1d93fff640 1 -- 172.21.15.49:0/403030399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00a7e0 con 0x55a8575b2070 2024-09-21T06:38:47.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1daaffd640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d940b6680 0x7f1d940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.209+0000 7f1db1d34640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d940b6680 0x7f1d940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1daaffd640 1 -- 172.21.15.49:0/3124158722 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1da41080f0 con 0x7f1dac104860 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1dba50c740 1 -- 172.21.15.49:0/403030399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 msgr2=0x55a8579592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1db1d34640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d940b6680 0x7f1d940b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1da4105970 tx=0x7f1da402a410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1dba50c740 1 --2- 172.21.15.49:0/403030399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a8579592c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009f20 tx=0x7f1d9c00c8b0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1dba50c740 1 -- 172.21.15.49:0/403030399 shutdown_connections 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1dba50c740 1 --2- 172.21.15.49:0/403030399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 0x55a857959d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1dba50c740 1 --2- 172.21.15.49:0/403030399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8575891b0 0x55a857959800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1dba50c740 1 --2- 172.21.15.49:0/403030399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a8579592c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1dba50c740 1 -- 172.21.15.49:0/403030399 >> 172.21.15.49:0/403030399 conn(0x55a8575a6460 msgr2=0x55a8579571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1dba50c740 1 -- 172.21.15.49:0/403030399 shutdown_connections 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.210+0000 7f1dba50c740 1 -- 172.21.15.49:0/403030399 wait complete. 2024-09-21T06:38:47.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.211+0000 7f1dba50c740 1 -- start start 2024-09-21T06:38:47.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.211+0000 7f1dba50c740 1 Processor -- start 2024-09-21T06:38:47.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.211+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8575891b0 0x55a8579649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.211+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 0x55a857964ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.211+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a857970d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.211+0000 7f1dba50c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a857720700 con 0x55a8575b2070 2024-09-21T06:38:47.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.211+0000 7f1dba50c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a85785a160 con 0x55a857591390 2024-09-21T06:38:47.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.211+0000 7f1dba50c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a857967aa0 con 0x55a8575891b0 2024-09-21T06:38:47.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1dba50c740 10 client.0 _ll_register_callbacks cb 0x55a8578739e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:47.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a857970d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a857970d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37856/0 (socket says 172.21.15.49:37856) 2024-09-21T06:38:47.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 -- 172.21.15.49:0/4154810869 learned_addr learned my addr 172.21.15.49:0/4154810869 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:47.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db1533640 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 0x55a857964ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8575891b0 0x55a8579649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 -- 172.21.15.49:0/4154810869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8575891b0 msgr2=0x55a8579649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:47.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8575891b0 0x55a8579649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 -- 172.21.15.49:0/4154810869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 msgr2=0x55a857964ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:47.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 0x55a857964ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 -- 172.21.15.49:0/4154810869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a857887c90 con 0x55a8575b2070 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1db2535640 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a857970d90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c015890 tx=0x7f1d9c00a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f7451d15da8add server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1d917fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1d917fa640 1 -- 172.21.15.49:0/4154810869 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c028060 con 0x55a8575b2070 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1dba50c740 1 -- 172.21.15.49:0/4154810869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d9c0158c0 con 0x55a8575b2070 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.212+0000 7f1d917fa640 1 -- 172.21.15.49:0/4154810869 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1d9c015e00 con 0x55a8575b2070 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1d917fa640 1 -- 172.21.15.49:0/4154810869 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c01a040 con 0x55a8575b2070 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1dba50c740 10 client.16008 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1dba50c740 1 -- 172.21.15.49:0/4154810869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a8579737e0 con 0x55a8575b2070 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1d917fa640 1 -- 172.21.15.49:0/4154810869 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d9c0158c0 con 0x55a8575b2070 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1d917fa640 1 -- 172.21.15.49:0/4154810869 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f1d9c02cae0 con 0x55a8575b2070 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1dba50c740 10 client.16008 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1dba50c740 10 client.16008 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:38:47.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1dba50c740 20 client.16008 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:47.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1dba50c740 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a8575709f0 0x55a857976c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1dba50c740 4 client.16008 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:47.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.213+0000 7f1dba50c740 1 -- 172.21.15.49:0/4154810869 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8578d1df0 con 0x55a8575709f0 2024-09-21T06:38:47.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.214+0000 7f1db1533640 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a8575709f0 0x55a857976c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.214+0000 7f1db1533640 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a8575709f0 0x55a857976c00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a0269c5d8d2fbcfe server_cookie=91245bd70f83f192 in_seq=0 out_seq=0 2024-09-21T06:38:47.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.214+0000 7f1d917fa640 10 client.16008 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1d917fa640 1 -- 172.21.15.49:0/4154810869 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8578d1df0 con 0x55a8575709f0 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1d917fa640 10 client.16008 handle_command_reply: tid=0 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 client.16008 shutdown 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 -- 172.21.15.49:0/4154810869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 msgr2=0x55a857970d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a857970d90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c015890 tx=0x7f1d9c00a4a0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 -- 172.21.15.49:0/4154810869 shutdown_connections 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a8575709f0 0x55a857976c00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575b2070 0x55a857970d90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a857591390 0x55a857964ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1d917fa640 0 client.16008 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:38:47.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 --2- 172.21.15.49:0/4154810869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8575891b0 0x55a8579649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 -- 172.21.15.49:0/4154810869 >> 172.21.15.49:0/4154810869 conn(0x55a8575a6460 msgr2=0x55a85795c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 -- 172.21.15.49:0/4154810869 shutdown_connections 2024-09-21T06:38:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 1 -- 172.21.15.49:0/4154810869 wait complete. 2024-09-21T06:38:47.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.215+0000 7f1dba50c740 20 client.16008 trim_cache size 0 max 16384 2024-09-21T06:38:47.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1dba50c740 1 Processor -- start 2024-09-21T06:38:47.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1dba50c740 1 -- start start 2024-09-21T06:38:47.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85795acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 0x55a8579665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 0x55a857970d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1dba50c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1b43d0 con 0x55a8575891b0 2024-09-21T06:38:47.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1dba50c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1b1ca0 con 0x55a8575b2070 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1dba50c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1afb10 con 0x55a857591390 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1db2535640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85795acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1db2535640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85795acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37866/0 (socket says 172.21.15.49:37866) 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1db2535640 1 -- 172.21.15.49:0/2235388187 learned_addr learned my addr 172.21.15.49:0/2235388187 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1db2535640 1 --2- 172.21.15.49:0/2235388187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 0x55a857970d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1db2535640 1 -- 172.21.15.49:0/2235388187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 msgr2=0x55a8579665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1db2535640 1 --2- 172.21.15.49:0/2235388187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 0x55a8579665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1db2535640 1 -- 172.21.15.49:0/2235388187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 msgr2=0x55a857970d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1db2535640 1 --2- 172.21.15.49:0/2235388187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 0x55a857970d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.229+0000 7f1db2535640 1 -- 172.21.15.49:0/2235388187 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a85795c120 con 0x55a8575891b0 2024-09-21T06:38:47.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1db2535640 1 --2- 172.21.15.49:0/2235388187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85795acb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00a470 tx=0x7f1d9c00a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e999318eeaa84216 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1d937fe640 1 -- 172.21.15.49:0/2235388187 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c028070 con 0x55a8575891b0 2024-09-21T06:38:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1d937fe640 1 -- 172.21.15.49:0/2235388187 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d9c009a50 con 0x55a8575891b0 2024-09-21T06:38:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1d937fe640 1 -- 172.21.15.49:0/2235388187 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c020670 con 0x55a8575891b0 2024-09-21T06:38:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1dba50c740 1 -- 172.21.15.49:0/2235388187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 msgr2=0x55a85795acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:47.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1dba50c740 1 --2- 172.21.15.49:0/2235388187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85795acb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c00a470 tx=0x7f1d9c00a510 comp rx=0 tx=0).stop 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1dba50c740 1 -- 172.21.15.49:0/2235388187 shutdown_connections 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1dba50c740 1 --2- 172.21.15.49:0/2235388187 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 0x55a857970d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1dba50c740 1 --2- 172.21.15.49:0/2235388187 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 0x55a8579665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.230+0000 7f1dba50c740 1 --2- 172.21.15.49:0/2235388187 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85795acb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.231+0000 7f1dba50c740 1 -- 172.21.15.49:0/2235388187 >> 172.21.15.49:0/2235388187 conn(0x55a8575a6460 msgr2=0x55a857965ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.231+0000 7f1dba50c740 1 -- 172.21.15.49:0/2235388187 shutdown_connections 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.231+0000 7f1dba50c740 1 -- 172.21.15.49:0/2235388187 wait complete. 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.231+0000 7f1dba50c740 1 -- start start 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.231+0000 7f1dba50c740 1 Processor -- start 2024-09-21T06:38:47.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85797a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 0x55a857977700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1dba50c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 0x55a857977c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1dba50c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1b0160 con 0x55a8575891b0 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1dba50c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1b15d0 con 0x55a8575b2070 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1dba50c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1dac1b0830 con 0x55a857591390 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1dba50c740 10 client.0 _ll_register_callbacks cb 0x7f1d9c018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85797a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85797a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37874/0 (socket says 172.21.15.49:37874) 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 -- 172.21.15.49:0/1483120243 learned_addr learned my addr 172.21.15.49:0/1483120243 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db1533640 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 0x55a857977700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 0x55a857977c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 -- 172.21.15.49:0/1483120243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 msgr2=0x55a857977700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:47.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 0x55a857977700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 -- 172.21.15.49:0/1483120243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 msgr2=0x55a857977c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 0x55a857977c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 -- 172.21.15.49:0/1483120243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a857978200 con 0x55a8575891b0 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db1533640 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 0x55a857977700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1db2535640 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85797a230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c007160 tx=0x7f1d9c009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4428d57499099db0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1d917fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1d917fa640 1 -- 172.21.15.49:0/1483120243 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c028070 con 0x55a8575891b0 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1d917fa640 1 -- 172.21.15.49:0/1483120243 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1d9c002030 con 0x55a8575891b0 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.232+0000 7f1dba50c740 1 -- 172.21.15.49:0/1483120243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d9c009a50 con 0x55a8575891b0 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1d917fa640 1 -- 172.21.15.49:0/1483120243 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1d9c020990 con 0x55a8575891b0 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1dba50c740 10 client.16014 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1dba50c740 1 -- 172.21.15.49:0/1483120243 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a8579e10d0 con 0x55a8575891b0 2024-09-21T06:38:47.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1d917fa640 1 -- 172.21.15.49:0/1483120243 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d9c009a50 con 0x55a8575891b0 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1d917fa640 1 -- 172.21.15.49:0/1483120243 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f1d9c02c480 con 0x55a8575891b0 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1dba50c740 10 client.16014 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1dba50c740 10 client.16014 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1dba50c740 20 client.16014 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1dba50c740 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a857545da0 0x55a8579e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1dba50c740 4 client.16014 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1dba50c740 1 -- 172.21.15.49:0/1483120243 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a8578cd8a0 con 0x55a857545da0 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.233+0000 7f1db1533640 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a857545da0 0x55a8579e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1db1533640 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a857545da0 0x55a8579e36f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c481555ffc1627ce server_cookie=bc65b51001105510 in_seq=0 out_seq=0 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1d917fa640 10 client.16014 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1d917fa640 1 -- 172.21.15.49:0/1483120243 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a8578cd8a0 con 0x55a857545da0 2024-09-21T06:38:47.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1d917fa640 10 client.16014 handle_command_reply: tid=0 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 client.16014 shutdown 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 -- 172.21.15.49:0/1483120243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 msgr2=0x55a85797a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85797a230 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c007160 tx=0x7f1d9c009870 comp rx=0 tx=0).stop 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 -- 172.21.15.49:0/1483120243 shutdown_connections 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a857545da0 0x55a8579e36f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8575b2070 0x55a857977c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a857591390 0x55a857977700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1d917fa640 0 client.16014 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 --2- 172.21.15.49:0/1483120243 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8575891b0 0x55a85797a230 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 -- 172.21.15.49:0/1483120243 >> 172.21.15.49:0/1483120243 conn(0x55a8575a6460 msgr2=0x55a8579667a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.234+0000 7f1dba50c740 1 -- 172.21.15.49:0/1483120243 shutdown_connections 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1dba50c740 1 -- 172.21.15.49:0/1483120243 wait complete. 2024-09-21T06:38:47.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1dba50c740 20 client.16014 trim_cache size 0 max 16384 2024-09-21T06:38:47.243 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:38:47.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 -- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d940b6680 msgr2=0x7f1d940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d940b6680 0x7f1d940b8b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1da4105970 tx=0x7f1da402a410 comp rx=0 tx=0).stop 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 -- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 msgr2=0x7f1dac102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 0x7f1dac102770 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006010 tx=0x7f1da40042f0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 -- 172.21.15.49:0/3124158722 shutdown_connections 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d940b6680 0x7f1d940b8b90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1dac10de10 0x7f1dac1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1dac105290 0x7f1dac102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 --2- 172.21.15.49:0/3124158722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1dac104860 0x7f1dac102770 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 -- 172.21.15.49:0/3124158722 >> 172.21.15.49:0/3124158722 conn(0x7f1dac079730 msgr2=0x7f1dac1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 -- 172.21.15.49:0/3124158722 shutdown_connections 2024-09-21T06:38:47.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:47.235+0000 7f1db3f98640 1 -- 172.21.15.49:0/3124158722 wait complete. 2024-09-21T06:38:47.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:47 smithi049 ceph-mon[31177]: pgmap v383: 97 pgs: 97 active+clean; 2.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:48.007 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:38:48.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:47 smithi098 ceph-mon[34704]: pgmap v383: 97 pgs: 97 active+clean; 2.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:47 smithi079 ceph-mon[34346]: pgmap v383: 97 pgs: 97 active+clean; 2.1 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:48.268 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:48.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.773+0000 7f0a5a437640 1 -- 172.21.15.49:0/3474815481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 msgr2=0x7f0a54102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.773+0000 7f0a5a437640 1 --2- 172.21.15.49:0/3474815481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 0x7f0a54102ef0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0a44009900 tx=0x7f0a4402a410 comp rx=0 tx=0).stop 2024-09-21T06:38:48.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.773+0000 7f0a5a437640 1 -- 172.21.15.49:0/3474815481 shutdown_connections 2024-09-21T06:38:48.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.773+0000 7f0a5a437640 1 --2- 172.21.15.49:0/3474815481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a54108d20 0x7f0a5410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.773+0000 7f0a5a437640 1 --2- 172.21.15.49:0/3474815481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a541083d0 0x7f0a541087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.773+0000 7f0a5a437640 1 --2- 172.21.15.49:0/3474815481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 0x7f0a54102ef0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.773+0000 7f0a5a437640 1 -- 172.21.15.49:0/3474815481 >> 172.21.15.49:0/3474815481 conn(0x7f0a54079760 msgr2=0x7f0a54079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.773+0000 7f0a5a437640 1 -- 172.21.15.49:0/3474815481 shutdown_connections 2024-09-21T06:38:48.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.773+0000 7f0a5a437640 1 -- 172.21.15.49:0/3474815481 wait complete. 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.774+0000 7f0a5a437640 1 Processor -- start 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.774+0000 7f0a5a437640 1 -- start start 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a5a437640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 0x7f0a5419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a5a437640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a541083d0 0x7f0a5419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a5a437640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a54108d20 0x7f0a5419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a5a437640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541129e0 con 0x7f0a54102ae0 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a5a437640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0a54112860 con 0x7f0a54108d20 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a5a437640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a54112b60 con 0x7f0a541083d0 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 0x7f0a5419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 0x7f0a5419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37888/0 (socket says 172.21.15.49:37888) 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a53fff640 1 -- 172.21.15.49:0/1718109550 learned_addr learned my addr 172.21.15.49:0/1718109550 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a537fe640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a541083d0 0x7f0a5419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a589d4640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a54108d20 0x7f0a5419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a53fff640 1 -- 172.21.15.49:0/1718109550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a541083d0 msgr2=0x7f0a5419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a53fff640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a541083d0 0x7f0a5419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a53fff640 1 -- 172.21.15.49:0/1718109550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a54108d20 msgr2=0x7f0a5419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a53fff640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a54108d20 0x7f0a5419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a53fff640 1 -- 172.21.15.49:0/1718109550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a541a0410 con 0x7f0a54102ae0 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.775+0000 7f0a53fff640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 0x7f0a5419a4a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0a44005ab0 tx=0x7f0a44003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.776+0000 7f0a517fa640 1 -- 172.21.15.49:0/1718109550 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4403f070 con 0x7f0a54102ae0 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.776+0000 7f0a517fa640 1 -- 172.21.15.49:0/1718109550 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a44031d60 con 0x7f0a54102ae0 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.776+0000 7f0a5a437640 1 -- 172.21.15.49:0/1718109550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a541a06a0 con 0x7f0a54102ae0 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.776+0000 7f0a517fa640 1 -- 172.21.15.49:0/1718109550 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a44035030 con 0x7f0a54102ae0 2024-09-21T06:38:48.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.776+0000 7f0a5a437640 1 -- 172.21.15.49:0/1718109550 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a541a6e60 con 0x7f0a54102ae0 2024-09-21T06:38:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.778+0000 7f0a609ab740 1 Processor -- start 2024-09-21T06:38:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.778+0000 7f0a609ab740 1 -- start start 2024-09-21T06:38:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917b07070 0x561917eae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917ade1b0 0x561917eaebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ae6390 0x561917eaf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a609ab740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561917e24ea0 con 0x561917b07070 2024-09-21T06:38:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a609ab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561917e142d0 con 0x561917ade1b0 2024-09-21T06:38:48.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a609ab740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561917e180e0 con 0x561917ae6390 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a589d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917b07070 0x561917eae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a589d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917b07070 0x561917eae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37898/0 (socket says 172.21.15.49:37898) 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a589d4640 1 -- 172.21.15.49:0/1790836238 learned_addr learned my addr 172.21.15.49:0/1790836238 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a517fa640 1 -- 172.21.15.49:0/1718109550 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0a44042070 con 0x7f0a54102ae0 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a537fe640 1 --2- 172.21.15.49:0/1790836238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ae6390 0x561917eaf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a589d4640 1 -- 172.21.15.49:0/1790836238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ae6390 msgr2=0x561917eaf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a589d4640 1 --2- 172.21.15.49:0/1790836238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ae6390 0x561917eaf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a589d4640 1 -- 172.21.15.49:0/1790836238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917ade1b0 msgr2=0x561917eaebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a589d4640 1 --2- 172.21.15.49:0/1790836238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917ade1b0 0x561917eaebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a589d4640 1 -- 172.21.15.49:0/1790836238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561917b72650 con 0x561917b07070 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a537fe640 1 --2- 172.21.15.49:0/1790836238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ae6390 0x561917eaf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.779+0000 7f0a589d4640 1 --2- 172.21.15.49:0/1790836238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917b07070 0x561917eae6a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009fd0 tx=0x7f0a4c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e445913b985439 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.780+0000 7f0a3a7fc640 1 -- 172.21.15.49:0/1790836238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c004d20 con 0x561917b07070 2024-09-21T06:38:48.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.780+0000 7f0a3a7fc640 1 -- 172.21.15.49:0/1790836238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c004050 con 0x561917b07070 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.780+0000 7f0a3a7fc640 1 -- 172.21.15.49:0/1790836238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c005220 con 0x561917b07070 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.780+0000 7f0a517fa640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a3c0b6680 0x7f0a3c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.780+0000 7f0a53fff640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a3c0b6680 0x7f0a3c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.780+0000 7f0a517fa640 1 -- 172.21.15.49:0/1718109550 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0a44107f40 con 0x7f0a54102ae0 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 -- 172.21.15.49:0/1790836238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917b07070 msgr2=0x561917eae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a53fff640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a3c0b6680 0x7f0a3c0b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x561917ead320 tx=0x7f0a44031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1790836238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917b07070 0x561917eae6a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c009fd0 tx=0x7f0a4c0118d0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 -- 172.21.15.49:0/1790836238 shutdown_connections 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1790836238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ae6390 0x561917eaf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1790836238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917ade1b0 0x561917eaebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1790836238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917b07070 0x561917eae6a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 -- 172.21.15.49:0/1790836238 >> 172.21.15.49:0/1790836238 conn(0x561917afb460 msgr2=0x561917eac590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 -- 172.21.15.49:0/1790836238 shutdown_connections 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 -- 172.21.15.49:0/1790836238 wait complete. 2024-09-21T06:38:48.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.781+0000 7f0a609ab740 1 -- start start 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a609ab740 1 Processor -- start 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917ade1b0 0x561917eb9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ae6390 0x561917eba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 0x561917ec61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a609ab740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561917c75700 con 0x561917ae6390 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a609ab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561917daf160 con 0x561917ade1b0 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a609ab740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561917ebce80 con 0x561917b07070 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a609ab740 10 client.0 _ll_register_callbacks cb 0x561917dc89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a537fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ae6390 0x561917eba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a537fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ae6390 0x561917eba2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37902/0 (socket says 172.21.15.49:37902) 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a537fe640 1 -- 172.21.15.49:0/2365067901 learned_addr learned my addr 172.21.15.49:0/2365067901 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a589d4640 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 0x561917ec61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a589d4640 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917ade1b0 0x561917eb9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a537fe640 1 -- 172.21.15.49:0/2365067901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 msgr2=0x561917ec61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a537fe640 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 0x561917ec61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a537fe640 1 -- 172.21.15.49:0/2365067901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917ade1b0 msgr2=0x561917eb9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a537fe640 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917ade1b0 0x561917eb9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a537fe640 1 -- 172.21.15.49:0/2365067901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561917ddcc90 con 0x561917ae6390 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.782+0000 7f0a589d4640 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 0x561917ec61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a537fe640 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ae6390 0x561917eba2a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0a48012780 tx=0x7f0a48012c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8486d8a550053c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a337fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a337fe640 1 -- 172.21.15.49:0/2365067901 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4801f060 con 0x561917ae6390 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a337fe640 1 -- 172.21.15.49:0/2365067901 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0a4801a430 con 0x561917ae6390 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a609ab740 1 -- 172.21.15.49:0/2365067901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a4c004050 con 0x561917ae6390 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a337fe640 1 -- 172.21.15.49:0/2365067901 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a48010e80 con 0x561917ae6390 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a609ab740 10 client.16026 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a609ab740 1 -- 172.21.15.49:0/2365067901 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561917ec8bf0 con 0x561917ae6390 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a337fe640 1 -- 172.21.15.49:0/2365067901 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c004050 con 0x561917ae6390 2024-09-21T06:38:48.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a337fe640 1 -- 172.21.15.49:0/2365067901 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f0a4800e4d0 con 0x561917ae6390 2024-09-21T06:38:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.783+0000 7f0a609ab740 10 client.16026 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.784+0000 7f0a609ab740 10 client.16026 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:38:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.784+0000 7f0a609ab740 20 client.16026 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.784+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561917ac59f0 0x561917ecc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.784+0000 7f0a609ab740 4 client.16026 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.784+0000 7f0a609ab740 1 -- 172.21.15.49:0/2365067901 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561917e26df0 con 0x561917ac59f0 2024-09-21T06:38:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.784+0000 7f0a589d4640 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561917ac59f0 0x561917ecc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.784+0000 7f0a589d4640 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561917ac59f0 0x561917ecc1b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d88667c95e0598d server_cookie=4de37bf4ec318a50 in_seq=0 out_seq=0 2024-09-21T06:38:48.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.784+0000 7f0a337fe640 10 client.16026 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:38:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a337fe640 1 -- 172.21.15.49:0/2365067901 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561917e26df0 con 0x561917ac59f0 2024-09-21T06:38:48.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a337fe640 10 client.16026 handle_command_reply: tid=0 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a609ab740 1 client.16026 shutdown 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a609ab740 1 -- 172.21.15.49:0/2365067901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ae6390 msgr2=0x561917eba2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ae6390 0x561917eba2a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0a48012780 tx=0x7f0a48012c40 comp rx=0 tx=0).stop 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a609ab740 1 -- 172.21.15.49:0/2365067901 shutdown_connections 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561917ac59f0 0x561917ecc1b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 0x561917ec61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ae6390 0x561917eba2a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2365067901 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917ade1b0 0x561917eb9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.785+0000 7f0a609ab740 1 -- 172.21.15.49:0/2365067901 >> 172.21.15.49:0/2365067901 conn(0x561917afb460 msgr2=0x561917eb1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.786+0000 7f0a337fe640 0 client.16026 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.786+0000 7f0a609ab740 1 -- 172.21.15.49:0/2365067901 shutdown_connections 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.786+0000 7f0a609ab740 1 -- 172.21.15.49:0/2365067901 wait complete. 2024-09-21T06:38:48.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.786+0000 7f0a609ab740 20 client.16026 trim_cache size 0 max 16384 2024-09-21T06:38:48.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a609ab740 1 Processor -- start 2024-09-21T06:38:48.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a609ab740 1 -- start start 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ade1b0 0x561917ebb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 0x561917eabbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917a9ada0 0x561917eac100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a609ab740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541b2070 con 0x561917ade1b0 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a609ab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541af940 con 0x561917a9ada0 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a609ab740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541ad7b0 con 0x561917b07070 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a589d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ade1b0 0x561917ebb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a589d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ade1b0 0x561917ebb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37914/0 (socket says 172.21.15.49:37914) 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.799+0000 7f0a589d4640 1 -- 172.21.15.49:0/2322331726 learned_addr learned my addr 172.21.15.49:0/2322331726 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a537fe640 1 --2- 172.21.15.49:0/2322331726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 0x561917eabbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a589d4640 1 -- 172.21.15.49:0/2322331726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 msgr2=0x561917eabbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a589d4640 1 --2- 172.21.15.49:0/2322331726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 0x561917eabbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a589d4640 1 -- 172.21.15.49:0/2322331726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917a9ada0 msgr2=0x561917eac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a589d4640 1 --2- 172.21.15.49:0/2322331726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917a9ada0 0x561917eac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a589d4640 1 -- 172.21.15.49:0/2322331726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561917ac5c20 con 0x561917ade1b0 2024-09-21T06:38:48.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a589d4640 1 --2- 172.21.15.49:0/2322331726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ade1b0 0x561917ebb990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c014040 tx=0x7f0a4c003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bdeb5c425882d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2322331726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c033070 con 0x561917ade1b0 2024-09-21T06:38:48.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2322331726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c005bd0 con 0x561917ade1b0 2024-09-21T06:38:48.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.800+0000 7f0a39ffb640 1 -- 172.21.15.49:0/2322331726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c005030 con 0x561917ade1b0 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 -- 172.21.15.49:0/2322331726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ade1b0 msgr2=0x561917ebb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2322331726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ade1b0 0x561917ebb990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c014040 tx=0x7f0a4c003ed0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 -- 172.21.15.49:0/2322331726 shutdown_connections 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2322331726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917a9ada0 0x561917eac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2322331726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917b07070 0x561917eabbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 --2- 172.21.15.49:0/2322331726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917ade1b0 0x561917ebb990 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 -- 172.21.15.49:0/2322331726 >> 172.21.15.49:0/2322331726 conn(0x561917afb460 msgr2=0x561917ebb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 -- 172.21.15.49:0/2322331726 shutdown_connections 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 -- 172.21.15.49:0/2322331726 wait complete. 2024-09-21T06:38:48.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.801+0000 7f0a609ab740 1 -- start start 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a609ab740 1 Processor -- start 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917a9ada0 0x561917ebe430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ade1b0 0x561917ebe970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a609ab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917b07070 0x561917f35bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a609ab740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541ade00 con 0x561917a9ada0 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a609ab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541af270 con 0x561917b07070 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a609ab740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a541ae4d0 con 0x561917ade1b0 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a609ab740 10 client.0 _ll_register_callbacks cb 0x7f0a4800a650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a589d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917a9ada0 0x561917ebe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a589d4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917a9ada0 0x561917ebe430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37930/0 (socket says 172.21.15.49:37930) 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a589d4640 1 -- 172.21.15.49:0/1195647991 learned_addr learned my addr 172.21.15.49:0/1195647991 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a537fe640 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ade1b0 0x561917ebe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a589d4640 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917b07070 0x561917f35bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a589d4640 1 -- 172.21.15.49:0/1195647991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ade1b0 msgr2=0x561917ebe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a589d4640 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ade1b0 0x561917ebe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a589d4640 1 -- 172.21.15.49:0/1195647991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917b07070 msgr2=0x561917f35bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a589d4640 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917b07070 0x561917f35bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.802+0000 7f0a589d4640 1 -- 172.21.15.49:0/1195647991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561917ebf240 con 0x561917a9ada0 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a589d4640 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917a9ada0 0x561917ebe430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c011910 tx=0x7f0a4c009d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7960dd36a734dba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a337fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a337fe640 1 -- 172.21.15.49:0/1195647991 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c033040 con 0x561917a9ada0 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a337fe640 1 -- 172.21.15.49:0/1195647991 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0a4c004ba0 con 0x561917a9ada0 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a609ab740 1 -- 172.21.15.49:0/1195647991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a4c005bd0 con 0x561917a9ada0 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a337fe640 1 -- 172.21.15.49:0/1195647991 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0a4c004da0 con 0x561917a9ada0 2024-09-21T06:38:48.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a609ab740 10 client.16032 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a609ab740 1 -- 172.21.15.49:0/1195647991 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561917f37150 con 0x561917a9ada0 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a337fe640 1 -- 172.21.15.49:0/1195647991 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a4c005bd0 con 0x561917a9ada0 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a337fe640 1 -- 172.21.15.49:0/1195647991 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f0a4c00f4e0 con 0x561917a9ada0 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a609ab740 10 client.16032 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a609ab740 10 client.16032 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a609ab740 20 client.16032 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561917f37600 0x561917f39a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a609ab740 4 client.16032 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.803+0000 7f0a609ab740 1 -- 172.21.15.49:0/1195647991 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561917e228a0 con 0x561917f37600 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.804+0000 7f0a537fe640 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561917f37600 0x561917f39a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.804+0000 7f0a537fe640 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561917f37600 0x561917f39a20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9777fbd02e8ce2af server_cookie=eae89f01f09fbfac in_seq=0 out_seq=0 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.804+0000 7f0a337fe640 10 client.16032 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:38:48.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.804+0000 7f0a337fe640 1 -- 172.21.15.49:0/1195647991 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561917e228a0 con 0x561917f37600 2024-09-21T06:38:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.804+0000 7f0a337fe640 10 client.16032 handle_command_reply: tid=0 2024-09-21T06:38:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.804+0000 7f0a609ab740 1 client.16032 shutdown 2024-09-21T06:38:48.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 -- 172.21.15.49:0/1195647991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917a9ada0 msgr2=0x561917ebe430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917a9ada0 0x561917ebe430 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c011910 tx=0x7f0a4c009d80 comp rx=0 tx=0).stop 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 -- 172.21.15.49:0/1195647991 shutdown_connections 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561917f37600 0x561917f39a20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561917b07070 0x561917f35bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561917ade1b0 0x561917ebe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 --2- 172.21.15.49:0/1195647991 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561917a9ada0 0x561917ebe430 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 -- 172.21.15.49:0/1195647991 >> 172.21.15.49:0/1195647991 conn(0x561917afb460 msgr2=0x561917ebb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a337fe640 0 client.16032 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 -- 172.21.15.49:0/1195647991 shutdown_connections 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 1 -- 172.21.15.49:0/1195647991 wait complete. 2024-09-21T06:38:48.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a609ab740 20 client.16032 trim_cache size 0 max 16384 2024-09-21T06:38:48.812 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:38:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a5a437640 1 -- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a3c0b6680 msgr2=0x7f0a3c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a5a437640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a3c0b6680 0x7f0a3c0b8b90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x561917ead320 tx=0x7f0a44031400 comp rx=0 tx=0).stop 2024-09-21T06:38:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a5a437640 1 -- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 msgr2=0x7f0a5419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.805+0000 7f0a5a437640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 0x7f0a5419a4a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0a44005ab0 tx=0x7f0a44003c80 comp rx=0 tx=0).stop 2024-09-21T06:38:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.806+0000 7f0a5a437640 1 -- 172.21.15.49:0/1718109550 shutdown_connections 2024-09-21T06:38:48.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.806+0000 7f0a5a437640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a3c0b6680 0x7f0a3c0b8b90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.806+0000 7f0a5a437640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a54108d20 0x7f0a5419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.806+0000 7f0a5a437640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a541083d0 0x7f0a5419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.806+0000 7f0a5a437640 1 --2- 172.21.15.49:0/1718109550 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a54102ae0 0x7f0a5419a4a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.806+0000 7f0a5a437640 1 -- 172.21.15.49:0/1718109550 >> 172.21.15.49:0/1718109550 conn(0x7f0a54079760 msgr2=0x7f0a541066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.806+0000 7f0a5a437640 1 -- 172.21.15.49:0/1718109550 shutdown_connections 2024-09-21T06:38:48.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:48.806+0000 7f0a5a437640 1 -- 172.21.15.49:0/1718109550 wait complete. 2024-09-21T06:38:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.921+0000 7f026d9c6640 1 -- 172.21.15.49:0/618685410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0268108c70 msgr2=0x7f026810f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.921+0000 7f026d9c6640 1 --2- 172.21.15.49:0/618685410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0268108c70 0x7f026810f4a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0260009ca0 tx=0x7f026002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.921+0000 7f026d9c6640 1 -- 172.21.15.49:0/618685410 shutdown_connections 2024-09-21T06:38:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.921+0000 7f026d9c6640 1 --2- 172.21.15.49:0/618685410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0268108c70 0x7f026810f4a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.921+0000 7f026d9c6640 1 --2- 172.21.15.49:0/618685410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0268108320 0x7f0268108730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.921+0000 7f026d9c6640 1 --2- 172.21.15.49:0/618685410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f02681029f0 0x7f0268102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.921+0000 7f026d9c6640 1 -- 172.21.15.49:0/618685410 >> 172.21.15.49:0/618685410 conn(0x7f02680fe3f0 msgr2=0x7f0268100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.921+0000 7f026d9c6640 1 -- 172.21.15.49:0/618685410 shutdown_connections 2024-09-21T06:38:48.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.921+0000 7f026d9c6640 1 -- 172.21.15.49:0/618685410 wait complete. 2024-09-21T06:38:48.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f026d9c6640 1 Processor -- start 2024-09-21T06:38:48.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f026d9c6640 1 -- start start 2024-09-21T06:38:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f026d9c6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02681029f0 0x7f026819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f026d9c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0268108320 0x7f026819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f026d9c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0268108c70 0x7f026819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f026d9c6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0268112930 con 0x7f02681029f0 2024-09-21T06:38:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f026d9c6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02681127b0 con 0x7f0268108320 2024-09-21T06:38:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f026d9c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0268112ab0 con 0x7f0268108c70 2024-09-21T06:38:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f0266ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02681029f0 0x7f026819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f0266ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02681029f0 0x7f026819b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37954/0 (socket says 172.21.15.49:37954) 2024-09-21T06:38:48.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f0266ffd640 1 -- 172.21.15.49:0/105668204 learned_addr learned my addr 172.21.15.49:0/105668204 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f02677fe640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0268108c70 0x7f026819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.922+0000 7f02667fc640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0268108320 0x7f026819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f0266ffd640 1 -- 172.21.15.49:0/105668204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0268108c70 msgr2=0x7f026819bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f0266ffd640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0268108c70 0x7f026819bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f0266ffd640 1 -- 172.21.15.49:0/105668204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0268108320 msgr2=0x7f026819b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f0266ffd640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0268108320 0x7f026819b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f0266ffd640 1 -- 172.21.15.49:0/105668204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02681a63f0 con 0x7f02681029f0 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f0266ffd640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02681029f0 0x7f026819b1c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f025800e9f0 tx=0x7f025800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f026c9c4640 1 -- 172.21.15.49:0/105668204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025800cd80 con 0x7f02681029f0 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f026c9c4640 1 -- 172.21.15.49:0/105668204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02580108e0 con 0x7f02681029f0 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f026d9c6640 1 -- 172.21.15.49:0/105668204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02681a66e0 con 0x7f02681029f0 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f026c9c4640 1 -- 172.21.15.49:0/105668204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0258018980 con 0x7f02681029f0 2024-09-21T06:38:48.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.923+0000 7f026d9c6640 1 -- 172.21.15.49:0/105668204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02681a6c30 con 0x7f02681029f0 2024-09-21T06:38:48.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.926+0000 7f0274a16740 1 Processor -- start 2024-09-21T06:38:48.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.926+0000 7f0274a16740 1 -- start start 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f0274a16740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe234f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f0274a16740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 0x563fe234fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f0274a16740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f894d0 0x563fe2350430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f0274a16740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563fe22c46f0 con 0x563fe1faa1b0 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f0274a16740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563fe22b3b20 con 0x563fe1f812f0 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f0274a16740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563fe22b7930 con 0x563fe1f894d0 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe234f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe234f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37958/0 (socket says 172.21.15.49:37958) 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02677fe640 1 -- 172.21.15.49:0/1941495590 learned_addr learned my addr 172.21.15.49:0/1941495590 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02667fc640 1 --2- 172.21.15.49:0/1941495590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f894d0 0x563fe2350430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f026c9c4640 1 -- 172.21.15.49:0/105668204 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0258010430 con 0x7f02681029f0 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02677fe640 1 -- 172.21.15.49:0/1941495590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f894d0 msgr2=0x563fe2350430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02677fe640 1 --2- 172.21.15.49:0/1941495590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f894d0 0x563fe2350430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02677fe640 1 -- 172.21.15.49:0/1941495590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 msgr2=0x563fe234fef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02677fe640 1 --2- 172.21.15.49:0/1941495590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 0x563fe234fef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02677fe640 1 -- 172.21.15.49:0/1941495590 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe2279530 con 0x563fe1faa1b0 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f02677fe640 1 --2- 172.21.15.49:0/1941495590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe234f9b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f02600098b0 tx=0x7f02600098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc52f96a85a0fa5c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.927+0000 7f024dffb640 1 -- 172.21.15.49:0/1941495590 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260031e30 con 0x563fe1faa1b0 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.928+0000 7f024dffb640 1 -- 172.21.15.49:0/1941495590 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0260036030 con 0x563fe1faa1b0 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.928+0000 7f024dffb640 1 -- 172.21.15.49:0/1941495590 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260004280 con 0x563fe1faa1b0 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.928+0000 7f026c9c4640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f02500b6680 0x7f02500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.928+0000 7f0266ffd640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f02500b6680 0x7f02500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.928+0000 7f026c9c4640 1 -- 172.21.15.49:0/105668204 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f02580e7ad0 con 0x7f02681029f0 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.928+0000 7f0274a16740 1 -- 172.21.15.49:0/1941495590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 msgr2=0x563fe234f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.928+0000 7f0274a16740 1 --2- 172.21.15.49:0/1941495590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe234f9b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f02600098b0 tx=0x7f02600098e0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.928+0000 7f0274a16740 1 -- 172.21.15.49:0/1941495590 shutdown_connections 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.929+0000 7f0274a16740 1 --2- 172.21.15.49:0/1941495590 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f894d0 0x563fe2350430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.929+0000 7f0274a16740 1 --2- 172.21.15.49:0/1941495590 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 0x563fe234fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.929+0000 7f0274a16740 1 --2- 172.21.15.49:0/1941495590 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe234f9b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.929+0000 7f0274a16740 1 -- 172.21.15.49:0/1941495590 >> 172.21.15.49:0/1941495590 conn(0x563fe1f9e300 msgr2=0x563fe234d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.929+0000 7f0266ffd640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f02500b6680 0x7f02500b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x563fe234e630 tx=0x7f02580764e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.929+0000 7f0274a16740 1 -- 172.21.15.49:0/1941495590 shutdown_connections 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.929+0000 7f0274a16740 1 -- 172.21.15.49:0/1941495590 wait complete. 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.929+0000 7f0274a16740 1 -- start start 2024-09-21T06:38:48.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.929+0000 7f0274a16740 1 Processor -- start 2024-09-21T06:38:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f0274a16740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 0x563fe235b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f0274a16740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f894d0 0x563fe235b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.937 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f0274a16740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe23672a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f0274a16740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563fe21ebab0 con 0x563fe1faa1b0 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f0274a16740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563fe2259730 con 0x563fe1f894d0 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f0274a16740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563fe235df50 con 0x563fe1f812f0 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f0274a16740 10 client.0 _ll_register_callbacks cb 0x563fe22ad6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe23672a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe23672a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37964/0 (socket says 172.21.15.49:37964) 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 -- 172.21.15.49:0/2718999727 learned_addr learned my addr 172.21.15.49:0/2718999727 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02667fc640 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f894d0 0x563fe235b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 0x563fe235b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 -- 172.21.15.49:0/2718999727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 msgr2=0x563fe235b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.938 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 0x563fe235b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 -- 172.21.15.49:0/2718999727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f894d0 msgr2=0x563fe235b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f894d0 0x563fe235b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 -- 172.21.15.49:0/2718999727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe2015790 con 0x563fe1faa1b0 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f02677fe640 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe23672a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x563fe2351e00 tx=0x7f0260003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacf2383df0f8c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.930+0000 7f0246ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0246ffd640 1 -- 172.21.15.49:0/2718999727 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0260059060 con 0x563fe1faa1b0 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0246ffd640 1 -- 172.21.15.49:0/2718999727 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0260031450 con 0x563fe1faa1b0 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0274a16740 1 -- 172.21.15.49:0/2718999727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0260036030 con 0x563fe1faa1b0 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0246ffd640 1 -- 172.21.15.49:0/2718999727 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0260031650 con 0x563fe1faa1b0 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0274a16740 10 client.16044 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:48.939 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0274a16740 1 -- 172.21.15.49:0/2718999727 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563fe208e620 con 0x563fe1faa1b0 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0246ffd640 1 -- 172.21.15.49:0/2718999727 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0260036030 con 0x563fe1faa1b0 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0246ffd640 1 -- 172.21.15.49:0/2718999727 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f0260050070 con 0x563fe1faa1b0 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0274a16740 10 client.16044 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0274a16740 10 client.16044 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0274a16740 20 client.16044 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0274a16740 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563fe1f68d80 0x563fe236ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0274a16740 4 client.16044 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.931+0000 7f0274a16740 1 -- 172.21.15.49:0/2718999727 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fe22c6640 con 0x563fe1f68d80 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.932+0000 7f02667fc640 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563fe1f68d80 0x563fe236ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.932+0000 7f02667fc640 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563fe1f68d80 0x563fe236ce10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cce3024563dfdd8 server_cookie=227eab71ca5949fd in_seq=0 out_seq=0 2024-09-21T06:38:48.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.932+0000 7f0246ffd640 10 client.16044 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0246ffd640 1 -- 172.21.15.49:0/2718999727 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563fe22c6640 con 0x563fe1f68d80 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0246ffd640 10 client.16044 handle_command_reply: tid=0 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 client.16044 shutdown 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 -- 172.21.15.49:0/2718999727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 msgr2=0x563fe23672a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe23672a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x563fe2351e00 tx=0x7f0260003e50 comp rx=0 tx=0).stop 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 -- 172.21.15.49:0/2718999727 shutdown_connections 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563fe1f68d80 0x563fe236ce10 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1faa1b0 0x563fe23672a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f894d0 0x563fe235b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0246ffd640 0 client.16044 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 --2- 172.21.15.49:0/2718999727 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 0x563fe235b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 -- 172.21.15.49:0/2718999727 >> 172.21.15.49:0/2718999727 conn(0x563fe1f9e300 msgr2=0x563fe23509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 -- 172.21.15.49:0/2718999727 shutdown_connections 2024-09-21T06:38:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 1 -- 172.21.15.49:0/2718999727 wait complete. 2024-09-21T06:38:48.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.933+0000 7f0274a16740 20 client.16044 trim_cache size 0 max 16384 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f0274a16740 1 Processor -- start 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f0274a16740 1 -- start start 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f0274a16740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 0x563fe234c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f0274a16740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe23510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f0274a16740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1faa1b0 0x563fe23581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f0274a16740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f02681b1ff0 con 0x563fe1f894d0 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f0274a16740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02681af8c0 con 0x563fe1f812f0 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f0274a16740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f02681ad730 con 0x563fe1faa1b0 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f02667fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe23510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f02667fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe23510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37974/0 (socket says 172.21.15.49:37974) 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f02667fc640 1 -- 172.21.15.49:0/980076841 learned_addr learned my addr 172.21.15.49:0/980076841 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f02677fe640 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1faa1b0 0x563fe23581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f02677fe640 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 0x563fe234c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f02667fc640 1 -- 172.21.15.49:0/980076841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1faa1b0 msgr2=0x563fe23581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f02667fc640 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1faa1b0 0x563fe23581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f02667fc640 1 -- 172.21.15.49:0/980076841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 msgr2=0x563fe234c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.948+0000 7f02667fc640 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 0x563fe234c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.949+0000 7f02667fc640 1 -- 172.21.15.49:0/980076841 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe235b940 con 0x563fe1f894d0 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.949+0000 7f02677fe640 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 0x563fe234c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.949+0000 7f02667fc640 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe23510f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f026806b310 tx=0x7f025c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14f79e08c5a732c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.949+0000 7f024d7fa640 1 -- 172.21.15.49:0/980076841 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c003a40 con 0x563fe1f894d0 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.949+0000 7f024d7fa640 1 -- 172.21.15.49:0/980076841 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f025c0054d0 con 0x563fe1f894d0 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.949+0000 7f024d7fa640 1 -- 172.21.15.49:0/980076841 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c004c30 con 0x563fe1f894d0 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 -- 172.21.15.49:0/980076841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 msgr2=0x563fe23510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe23510f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f026806b310 tx=0x7f025c00cd00 comp rx=0 tx=0).stop 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 -- 172.21.15.49:0/980076841 shutdown_connections 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1faa1b0 0x563fe23581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe23510f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 --2- 172.21.15.49:0/980076841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1f812f0 0x563fe234c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 -- 172.21.15.49:0/980076841 >> 172.21.15.49:0/980076841 conn(0x563fe1f9e300 msgr2=0x563fe23509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 -- 172.21.15.49:0/980076841 shutdown_connections 2024-09-21T06:38:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 -- 172.21.15.49:0/980076841 wait complete. 2024-09-21T06:38:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 -- start start 2024-09-21T06:38:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.950+0000 7f0274a16740 1 Processor -- start 2024-09-21T06:38:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0274a16740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 0x563fe2360a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0274a16740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe2360f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0274a16740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1faa1b0 0x563fe23d55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0274a16740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f02681add80 con 0x563fe1f894d0 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0274a16740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f02681af1f0 con 0x563fe1faa1b0 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0274a16740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f02681ae450 con 0x563fe1f812f0 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0274a16740 10 client.0 _ll_register_callbacks cb 0x7f025c00c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02667fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe2360f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02667fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe2360f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:37990/0 (socket says 172.21.15.49:37990) 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02677fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 0x563fe2360a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02667fc640 1 -- 172.21.15.49:0/948476411 learned_addr learned my addr 172.21.15.49:0/948476411 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02677fe640 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1faa1b0 0x563fe23d55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02667fc640 1 -- 172.21.15.49:0/948476411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 msgr2=0x563fe2360a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02667fc640 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 0x563fe2360a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02667fc640 1 -- 172.21.15.49:0/948476411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1faa1b0 msgr2=0x563fe23d55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02667fc640 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1faa1b0 0x563fe23d55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02667fc640 1 -- 172.21.15.49:0/948476411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe23d5b70 con 0x563fe1f894d0 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f02667fc640 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe2360f60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f025c0058c0 tx=0x7f025c005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39967132a19ee07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0246ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0246ffd640 1 -- 172.21.15.49:0/948476411 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f025c003cd0 con 0x563fe1f894d0 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0246ffd640 1 -- 172.21.15.49:0/948476411 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f025c0049b0 con 0x563fe1f894d0 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.951+0000 7f0274a16740 1 -- 172.21.15.49:0/948476411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f025c0054d0 con 0x563fe1f894d0 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0246ffd640 1 -- 172.21.15.49:0/948476411 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f025c003e70 con 0x563fe1f894d0 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0274a16740 10 client.16050 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0274a16740 1 -- 172.21.15.49:0/948476411 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563fe23d6d50 con 0x563fe1f894d0 2024-09-21T06:38:48.958 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0246ffd640 1 -- 172.21.15.49:0/948476411 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f025c0054d0 con 0x563fe1f894d0 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0246ffd640 1 -- 172.21.15.49:0/948476411 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f025c01cc10 con 0x563fe1f894d0 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0274a16740 10 client.16050 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0274a16740 10 client.16050 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0274a16740 20 client.16050 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0274a16740 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563fe1f3e1c0 0x563fe23d9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0274a16740 4 client.16050 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f0274a16740 1 -- 172.21.15.49:0/948476411 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563fe22c20f0 con 0x563fe1f3e1c0 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.952+0000 7f02677fe640 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563fe1f3e1c0 0x563fe23d9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.953+0000 7f02677fe640 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563fe1f3e1c0 0x563fe23d9510 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=218a735d0b0e9596 server_cookie=f17a424add475483 in_seq=0 out_seq=0 2024-09-21T06:38:48.959 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.953+0000 7f0246ffd640 10 client.16050 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:48.961 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.959+0000 7f0246ffd640 1 -- 172.21.15.49:0/948476411 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563fe22c20f0 con 0x563fe1f3e1c0 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.959+0000 7f0246ffd640 10 client.16050 handle_command_reply: tid=0 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.959+0000 7f0274a16740 1 client.16050 shutdown 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 -- 172.21.15.49:0/948476411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 msgr2=0x563fe2360f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe2360f60 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f025c0058c0 tx=0x7f025c005340 comp rx=0 tx=0).stop 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 -- 172.21.15.49:0/948476411 shutdown_connections 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563fe1f3e1c0 0x563fe23d9510 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563fe1faa1b0 0x563fe23d55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563fe1f894d0 0x563fe2360f60 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0246ffd640 0 client.16050 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 --2- 172.21.15.49:0/948476411 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563fe1f812f0 0x563fe2360a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 -- 172.21.15.49:0/948476411 >> 172.21.15.49:0/948476411 conn(0x563fe1f9e300 msgr2=0x563fe234c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.962 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 -- 172.21.15.49:0/948476411 shutdown_connections 2024-09-21T06:38:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 1 -- 172.21.15.49:0/948476411 wait complete. 2024-09-21T06:38:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f0274a16740 20 client.16050 trim_cache size 0 max 16384 2024-09-21T06:38:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:38:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:38:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:38:48.963 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:38:48.964 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 -- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f02500b6680 msgr2=0x7f02500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.964 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f02500b6680 0x7f02500b8b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x563fe234e630 tx=0x7f02580764e0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.964 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 -- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02681029f0 msgr2=0x7f026819b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:48.964 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02681029f0 0x7f026819b1c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f025800e9f0 tx=0x7f025800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 -- 172.21.15.49:0/105668204 shutdown_connections 2024-09-21T06:38:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f02500b6680 0x7f02500b8b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0268108c70 0x7f026819bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0268108320 0x7f026819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 --2- 172.21.15.49:0/105668204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f02681029f0 0x7f026819b1c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.960+0000 7f026d9c6640 1 -- 172.21.15.49:0/105668204 >> 172.21.15.49:0/105668204 conn(0x7f02680fe3f0 msgr2=0x7f0268105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.961+0000 7f026d9c6640 1 -- 172.21.15.49:0/105668204 shutdown_connections 2024-09-21T06:38:48.965 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:38:48.961+0000 7f026d9c6640 1 -- 172.21.15.49:0/105668204 wait complete. 2024-09-21T06:38:49.505 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:38:49.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:49 smithi049 ceph-mon[31177]: pgmap v384: 97 pgs: 97 active+clean; 2.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-09-21T06:38:49.803 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:49 smithi098 ceph-mon[34704]: pgmap v384: 97 pgs: 97 active+clean; 2.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-09-21T06:38:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:49 smithi079 ceph-mon[34346]: pgmap v384: 97 pgs: 97 active+clean; 2.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-09-21T06:38:50.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.306+0000 7f147015a640 1 -- 172.21.15.49:0/1687189869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468108d20 msgr2=0x7f146810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.306+0000 7f147015a640 1 --2- 172.21.15.49:0/1687189869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468108d20 0x7f146810f550 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1460009ca0 tx=0x7f146002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.306+0000 7f147015a640 1 -- 172.21.15.49:0/1687189869 shutdown_connections 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.306+0000 7f147015a640 1 --2- 172.21.15.49:0/1687189869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468108d20 0x7f146810f550 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.306+0000 7f147015a640 1 --2- 172.21.15.49:0/1687189869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f14681083d0 0x7f14681087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.306+0000 7f147015a640 1 --2- 172.21.15.49:0/1687189869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1468102a90 0x7f1468102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.306+0000 7f147015a640 1 -- 172.21.15.49:0/1687189869 >> 172.21.15.49:0/1687189869 conn(0x7f1468079750 msgr2=0x7f1468079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.306+0000 7f147015a640 1 -- 172.21.15.49:0/1687189869 shutdown_connections 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.306+0000 7f147015a640 1 -- 172.21.15.49:0/1687189869 wait complete. 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f147015a640 1 Processor -- start 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f147015a640 1 -- start start 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f147015a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468102a90 0x7f1468199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f147015a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14681083d0 0x7f1468199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f147015a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1468108d20 0x7f1468199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f147015a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1468112990 con 0x7f1468102a90 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f147015a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1468112810 con 0x7f14681083d0 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f147015a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1468112b10 con 0x7f1468108d20 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146def6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468102a90 0x7f1468199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146def6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468102a90 0x7f1468199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38006/0 (socket says 172.21.15.49:38006) 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146def6640 1 -- 172.21.15.49:0/126122276 learned_addr learned my addr 172.21.15.49:0/126122276 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146d6f5640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14681083d0 0x7f1468199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146e6f7640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1468108d20 0x7f1468199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146def6640 1 -- 172.21.15.49:0/126122276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1468108d20 msgr2=0x7f1468199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146def6640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1468108d20 0x7f1468199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146def6640 1 -- 172.21.15.49:0/126122276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14681083d0 msgr2=0x7f1468199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146def6640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14681083d0 0x7f1468199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146def6640 1 -- 172.21.15.49:0/126122276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14681a86d0 con 0x7f1468102a90 2024-09-21T06:38:50.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146e6f7640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1468108d20 0x7f1468199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.307+0000 7f146d6f5640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14681083d0 0x7f1468199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.308+0000 7f146def6640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468102a90 0x7f1468199050 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f145800d950 tx=0x7f145800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.308+0000 7f1466ffd640 1 -- 172.21.15.49:0/126122276 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458017070 con 0x7f1468102a90 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.308+0000 7f147015a640 1 -- 172.21.15.49:0/126122276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14681a8960 con 0x7f1468102a90 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.308+0000 7f1466ffd640 1 -- 172.21.15.49:0/126122276 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1458009c30 con 0x7f1468102a90 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.308+0000 7f1466ffd640 1 -- 172.21.15.49:0/126122276 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145800f620 con 0x7f1468102a90 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.308+0000 7f147015a640 1 -- 172.21.15.49:0/126122276 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14681a8ea0 con 0x7f1468102a90 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f1466ffd640 1 -- 172.21.15.49:0/126122276 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f1458010460 con 0x7f1468102a90 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f14766ce740 1 Processor -- start 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f14766ce740 1 -- start start 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f14766ce740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7adcd02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f14766ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad9001b0 0x55e7adcd0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f14766ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 0x55e7adcd0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f14766ce740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e7adc46ea0 con 0x55e7ad929070 2024-09-21T06:38:50.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f14766ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e7adc362d0 con 0x55e7ad908390 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f14766ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e7adc3a0e0 con 0x55e7ad9001b0 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f146e6f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7adcd02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f146e6f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7adcd02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38010/0 (socket says 172.21.15.49:38010) 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.311+0000 7f146e6f7640 1 -- 172.21.15.49:0/1552125647 learned_addr learned my addr 172.21.15.49:0/1552125647 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f146def6640 1 --2- 172.21.15.49:0/1552125647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad9001b0 0x55e7adcd0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f146d6f5640 1 --2- 172.21.15.49:0/1552125647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 0x55e7adcd0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f146e6f7640 1 -- 172.21.15.49:0/1552125647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad9001b0 msgr2=0x55e7adcd0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f146e6f7640 1 --2- 172.21.15.49:0/1552125647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad9001b0 0x55e7adcd0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f146e6f7640 1 -- 172.21.15.49:0/1552125647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 msgr2=0x55e7adcd0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f146e6f7640 1 --2- 172.21.15.49:0/1552125647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 0x55e7adcd0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f146e6f7640 1 -- 172.21.15.49:0/1552125647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7ad994650 con 0x55e7ad929070 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f1466ffd640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14500b6680 0x7f14500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f146def6640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14500b6680 0x7f14500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f146e6f7640 1 --2- 172.21.15.49:0/1552125647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7adcd02c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f146002f500 tx=0x7f14600099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3716342249a84c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:50.329 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f1466ffd640 1 -- 172.21.15.49:0/126122276 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f14580e7460 con 0x7f1468102a90 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f144ffff640 1 -- 172.21.15.49:0/1552125647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460031450 con 0x55e7ad929070 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f144ffff640 1 -- 172.21.15.49:0/1552125647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1460036040 con 0x55e7ad929070 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.312+0000 7f144ffff640 1 -- 172.21.15.49:0/1552125647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460004400 con 0x55e7ad929070 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f14766ce740 1 -- 172.21.15.49:0/1552125647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 msgr2=0x55e7adcd02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f146def6640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14500b6680 0x7f14500b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f14580e4c40 tx=0x7f145801fec0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f14766ce740 1 --2- 172.21.15.49:0/1552125647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7adcd02c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f146002f500 tx=0x7f14600099c0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f14766ce740 1 -- 172.21.15.49:0/1552125647 shutdown_connections 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f14766ce740 1 --2- 172.21.15.49:0/1552125647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 0x55e7adcd0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f14766ce740 1 --2- 172.21.15.49:0/1552125647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad9001b0 0x55e7adcd0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f14766ce740 1 --2- 172.21.15.49:0/1552125647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7adcd02c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f14766ce740 1 -- 172.21.15.49:0/1552125647 >> 172.21.15.49:0/1552125647 conn(0x55e7ad91d460 msgr2=0x55e7adcce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f14766ce740 1 -- 172.21.15.49:0/1552125647 shutdown_connections 2024-09-21T06:38:50.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.313+0000 7f14766ce740 1 -- 172.21.15.49:0/1552125647 wait complete. 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f14766ce740 1 -- start start 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f14766ce740 1 Processor -- start 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f14766ce740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcdb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f14766ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 0x55e7adcdbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f14766ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad929070 0x55e7adcdc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f14766ce740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e7ada97700 con 0x55e7ad9001b0 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f14766ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e7adbd1160 con 0x55e7ad908390 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f14766ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e7adcdea40 con 0x55e7ad929070 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f14766ce740 10 client.0 _ll_register_callbacks cb 0x55e7adbea9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f146e6f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcdb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f146e6f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcdb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38016/0 (socket says 172.21.15.49:38016) 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.314+0000 7f146e6f7640 1 -- 172.21.15.49:0/3936346303 learned_addr learned my addr 172.21.15.49:0/3936346303 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f146e6f7640 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad929070 0x55e7adcdc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f146d6f5640 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 0x55e7adcdbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f146e6f7640 1 -- 172.21.15.49:0/3936346303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad929070 msgr2=0x55e7adcdc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f146e6f7640 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad929070 0x55e7adcdc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f146e6f7640 1 -- 172.21.15.49:0/3936346303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 msgr2=0x55e7adcdbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f146e6f7640 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 0x55e7adcdbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f146e6f7640 1 -- 172.21.15.49:0/3936346303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7adbfec90 con 0x55e7ad9001b0 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f146e6f7640 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcdb8f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1460006010 tx=0x7f14600095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a60f20d9c213ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f144d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f144d7fa640 1 -- 172.21.15.49:0/3936346303 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460059060 con 0x55e7ad9001b0 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f144d7fa640 1 -- 172.21.15.49:0/3936346303 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1460031860 con 0x55e7ad9001b0 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f14766ce740 1 -- 172.21.15.49:0/3936346303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1460036040 con 0x55e7ad9001b0 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f144d7fa640 1 -- 172.21.15.49:0/3936346303 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1460004120 con 0x55e7ad9001b0 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f14766ce740 10 client.16062 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.315+0000 7f14766ce740 1 -- 172.21.15.49:0/3936346303 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e7adcea6e0 con 0x55e7ad9001b0 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.316+0000 7f144d7fa640 1 -- 172.21.15.49:0/3936346303 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1460036040 con 0x55e7ad9001b0 2024-09-21T06:38:50.332 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.316+0000 7f144d7fa640 1 -- 172.21.15.49:0/3936346303 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f146002fba0 con 0x55e7ad9001b0 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.316+0000 7f14766ce740 10 client.16062 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.316+0000 7f14766ce740 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.316+0000 7f14766ce740 20 client.16062 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.316+0000 7f14766ce740 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e7ad8e79f0 0x55e7adceda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.316+0000 7f14766ce740 4 client.16062 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.316+0000 7f14766ce740 1 -- 172.21.15.49:0/3936346303 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7adc48df0 con 0x55e7ad8e79f0 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.316+0000 7f146d6f5640 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e7ad8e79f0 0x55e7adceda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.317+0000 7f144d7fa640 10 client.16062 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.317+0000 7f146d6f5640 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e7ad8e79f0 0x55e7adceda40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b10ff119d6fec254 server_cookie=a33200d5c2e432cd in_seq=0 out_seq=0 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.317+0000 7f144d7fa640 1 -- 172.21.15.49:0/3936346303 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e7adc48df0 con 0x55e7ad8e79f0 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.317+0000 7f144d7fa640 10 client.16062 handle_command_reply: tid=0 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.317+0000 7f14766ce740 1 client.16062 shutdown 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 -- 172.21.15.49:0/3936346303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 msgr2=0x55e7adcdb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:50.333 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcdb8f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1460006010 tx=0x7f14600095a0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 -- 172.21.15.49:0/3936346303 shutdown_connections 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e7ad8e79f0 0x55e7adceda40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad929070 0x55e7adcdc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad908390 0x55e7adcdbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f144d7fa640 0 client.16062 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 --2- 172.21.15.49:0/3936346303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcdb8f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 -- 172.21.15.49:0/3936346303 >> 172.21.15.49:0/3936346303 conn(0x55e7ad91d460 msgr2=0x55e7adcd34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 -- 172.21.15.49:0/3936346303 shutdown_connections 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 1 -- 172.21.15.49:0/3936346303 wait complete. 2024-09-21T06:38:50.334 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.318+0000 7f14766ce740 20 client.16062 trim_cache size 0 max 16384 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f14766ce740 1 Processor -- start 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f14766ce740 1 -- start start 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f14766ce740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcd1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f14766ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 0x55e7adccd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f14766ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad929070 0x55e7adccdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f14766ce740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f14681b42e0 con 0x55e7ad9001b0 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f14766ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f14681b1bb0 con 0x55e7ad929070 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f14766ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f14681afa20 con 0x55e7ad908390 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f146e6f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcd1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f146e6f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcd1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38018/0 (socket says 172.21.15.49:38018) 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.331+0000 7f146e6f7640 1 -- 172.21.15.49:0/1131985021 learned_addr learned my addr 172.21.15.49:0/1131985021 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.332+0000 7f146e6f7640 1 -- 172.21.15.49:0/1131985021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 msgr2=0x55e7adccd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.332+0000 7f146e6f7640 1 --2- 172.21.15.49:0/1131985021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 0x55e7adccd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.332+0000 7f146e6f7640 1 -- 172.21.15.49:0/1131985021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad929070 msgr2=0x55e7adccdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.332+0000 7f146e6f7640 1 --2- 172.21.15.49:0/1131985021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad929070 0x55e7adccdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.332+0000 7f146e6f7640 1 -- 172.21.15.49:0/1131985021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7adcd3120 con 0x55e7ad9001b0 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.332+0000 7f146e6f7640 1 --2- 172.21.15.49:0/1131985021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcd1a00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1460002230 tx=0x7f1460003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fb4327860163ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.332+0000 7f144f7fe640 1 -- 172.21.15.49:0/1131985021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460059040 con 0x55e7ad9001b0 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.332+0000 7f144f7fe640 1 -- 172.21.15.49:0/1131985021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1460036070 con 0x55e7ad9001b0 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.332+0000 7f144f7fe640 1 -- 172.21.15.49:0/1131985021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460003f20 con 0x55e7ad9001b0 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 -- 172.21.15.49:0/1131985021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 msgr2=0x55e7adcd1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 --2- 172.21.15.49:0/1131985021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcd1a00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1460002230 tx=0x7f1460003b60 comp rx=0 tx=0).stop 2024-09-21T06:38:50.340 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 -- 172.21.15.49:0/1131985021 shutdown_connections 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 --2- 172.21.15.49:0/1131985021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad929070 0x55e7adccdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 --2- 172.21.15.49:0/1131985021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 0x55e7adccd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 --2- 172.21.15.49:0/1131985021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad9001b0 0x55e7adcd1a00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 -- 172.21.15.49:0/1131985021 >> 172.21.15.49:0/1131985021 conn(0x55e7ad91d460 msgr2=0x55e7adcd12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 -- 172.21.15.49:0/1131985021 shutdown_connections 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 -- 172.21.15.49:0/1131985021 wait complete. 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 -- start start 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.333+0000 7f14766ce740 1 Processor -- start 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f14766ce740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad9001b0 0x55e7adcef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f14766ce740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 0x55e7adcef9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f14766ce740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7add51190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f14766ce740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f14681b0070 con 0x55e7ad929070 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f14766ce740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f14681b14e0 con 0x55e7ad9001b0 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f14766ce740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f14681b0740 con 0x55e7ad908390 2024-09-21T06:38:50.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f14766ce740 10 client.0 _ll_register_callbacks cb 0x7f1460009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146e6f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7add51190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146e6f7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7add51190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38026/0 (socket says 172.21.15.49:38026) 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146e6f7640 1 -- 172.21.15.49:0/3725089224 learned_addr learned my addr 172.21.15.49:0/3725089224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146e6f7640 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad9001b0 0x55e7adcef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146d6f5640 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 0x55e7adcef9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146e6f7640 1 -- 172.21.15.49:0/3725089224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 msgr2=0x55e7adcef9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146e6f7640 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 0x55e7adcef9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146e6f7640 1 -- 172.21.15.49:0/3725089224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad9001b0 msgr2=0x55e7adcef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146e6f7640 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad9001b0 0x55e7adcef3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146e6f7640 1 -- 172.21.15.49:0/3725089224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7add51800 con 0x55e7ad929070 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.334+0000 7f146d6f5640 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 0x55e7adcef9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.335+0000 7f146e6f7640 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7add51190 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f146002ffa0 tx=0x7f14600093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7d03a953038feb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.335+0000 7f144d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:50.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.335+0000 7f144d7fa640 1 -- 172.21.15.49:0/3725089224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460003dd0 con 0x55e7ad929070 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.335+0000 7f144d7fa640 1 -- 172.21.15.49:0/3725089224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1460030a40 con 0x55e7ad929070 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.335+0000 7f14766ce740 1 -- 172.21.15.49:0/3725089224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1460036070 con 0x55e7ad929070 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.335+0000 7f144d7fa640 1 -- 172.21.15.49:0/3725089224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f1460070050 con 0x55e7ad929070 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.335+0000 7f14766ce740 10 client.16068 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.335+0000 7f14766ce740 1 -- 172.21.15.49:0/3725089224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e7add58b40 con 0x55e7ad929070 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.335+0000 7f144d7fa640 1 -- 172.21.15.49:0/3725089224 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1460036070 con 0x55e7ad929070 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f144d7fa640 1 -- 172.21.15.49:0/3725089224 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f146002f660 con 0x55e7ad929070 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f14766ce740 10 client.16068 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f14766ce740 10 client.16068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f14766ce740 20 client.16068 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f14766ce740 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e7ad8bcda0 0x55e7add5b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f14766ce740 4 client.16068 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f14766ce740 1 -- 172.21.15.49:0/3725089224 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e7adc448a0 con 0x55e7ad8bcda0 2024-09-21T06:38:50.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f146d6f5640 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e7ad8bcda0 0x55e7add5b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f146d6f5640 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e7ad8bcda0 0x55e7add5b060 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ebf93268baef679 server_cookie=54bf08dbc0c2811f in_seq=0 out_seq=0 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f144d7fa640 10 client.16068 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f144d7fa640 1 -- 172.21.15.49:0/3725089224 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e7adc448a0 con 0x55e7ad8bcda0 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.336+0000 7f144d7fa640 10 client.16068 handle_command_reply: tid=0 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 client.16068 shutdown 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 -- 172.21.15.49:0/3725089224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 msgr2=0x55e7add51190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7add51190 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f146002ffa0 tx=0x7f14600093e0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 -- 172.21.15.49:0/3725089224 shutdown_connections 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e7ad8bcda0 0x55e7add5b060 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e7ad929070 0x55e7add51190 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e7ad908390 0x55e7adcef9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 --2- 172.21.15.49:0/3725089224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e7ad9001b0 0x55e7adcef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 -- 172.21.15.49:0/3725089224 >> 172.21.15.49:0/3725089224 conn(0x55e7ad91d460 msgr2=0x55e7adce6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f144d7fa640 0 client.16068 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:50.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 -- 172.21.15.49:0/3725089224 shutdown_connections 2024-09-21T06:38:50.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 1 -- 172.21.15.49:0/3725089224 wait complete. 2024-09-21T06:38:50.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f14766ce740 20 client.16068 trim_cache size 0 max 16384 2024-09-21T06:38:50.345 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f147015a640 1 -- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14500b6680 msgr2=0x7f14500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f147015a640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14500b6680 0x7f14500b8b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f14580e4c40 tx=0x7f145801fec0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f147015a640 1 -- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468102a90 msgr2=0x7f1468199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.337+0000 7f147015a640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468102a90 0x7f1468199050 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f145800d950 tx=0x7f145800de10 comp rx=0 tx=0).stop 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.338+0000 7f147015a640 1 -- 172.21.15.49:0/126122276 shutdown_connections 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.338+0000 7f147015a640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14500b6680 0x7f14500b8b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.338+0000 7f147015a640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1468108d20 0x7f1468199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.338+0000 7f147015a640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f14681083d0 0x7f1468199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.338+0000 7f147015a640 1 --2- 172.21.15.49:0/126122276 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1468102a90 0x7f1468199050 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.338+0000 7f147015a640 1 -- 172.21.15.49:0/126122276 >> 172.21.15.49:0/126122276 conn(0x7f1468079750 msgr2=0x7f14681043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:50.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.338+0000 7f147015a640 1 -- 172.21.15.49:0/126122276 shutdown_connections 2024-09-21T06:38:50.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:50.338+0000 7f147015a640 1 -- 172.21.15.49:0/126122276 wait complete. 2024-09-21T06:38:51.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:51 smithi049 ceph-mon[31177]: pgmap v385: 97 pgs: 97 active+clean; 2.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.9 KiB/s wr, 9 op/s 2024-09-21T06:38:51.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:38:52.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:51 smithi098 ceph-mon[34704]: pgmap v385: 97 pgs: 97 active+clean; 2.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.9 KiB/s wr, 9 op/s 2024-09-21T06:38:52.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:38:52.048 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:38:52.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:38:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:51 smithi079 ceph-mon[34346]: pgmap v385: 97 pgs: 97 active+clean; 2.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 8.9 KiB/s wr, 9 op/s 2024-09-21T06:38:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:38:52.307 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:52.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:38:52.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:38:52.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:38:52.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.816+0000 7f277b38b640 1 -- 172.21.15.49:0/4265778372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774108cf0 msgr2=0x7f277410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:52.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.816+0000 7f277b38b640 1 --2- 172.21.15.49:0/4265778372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774108cf0 0x7f277410f520 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f276c009ca0 tx=0x7f276c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.816+0000 7f277b38b640 1 -- 172.21.15.49:0/4265778372 shutdown_connections 2024-09-21T06:38:52.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.816+0000 7f277b38b640 1 --2- 172.21.15.49:0/4265778372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774108cf0 0x7f277410f520 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.816+0000 7f277b38b640 1 --2- 172.21.15.49:0/4265778372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27741083a0 0x7f27741087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.816+0000 7f277b38b640 1 --2- 172.21.15.49:0/4265778372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2774102a60 0x7f2774102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.816+0000 7f277b38b640 1 -- 172.21.15.49:0/4265778372 >> 172.21.15.49:0/4265778372 conn(0x7f2774079730 msgr2=0x7f2774079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:52.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.816+0000 7f277b38b640 1 -- 172.21.15.49:0/4265778372 shutdown_connections 2024-09-21T06:38:52.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.816+0000 7f277b38b640 1 -- 172.21.15.49:0/4265778372 wait complete. 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f277b38b640 1 Processor -- start 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f277b38b640 1 -- start start 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f277b38b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774102a60 0x7f277419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f277b38b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27741083a0 0x7f277419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f277b38b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2774108cf0 0x7f277419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f277b38b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2774112960 con 0x7f2774102a60 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f277b38b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27741127e0 con 0x7f2774108cf0 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f277b38b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2774112ae0 con 0x7f27741083a0 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f2779127640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774102a60 0x7f277419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f2779127640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774102a60 0x7f277419a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38040/0 (socket says 172.21.15.49:38040) 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.817+0000 7f2779127640 1 -- 172.21.15.49:0/3980542352 learned_addr learned my addr 172.21.15.49:0/3980542352 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2778926640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27741083a0 0x7f277419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2779928640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2774108cf0 0x7f277419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2779127640 1 -- 172.21.15.49:0/3980542352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27741083a0 msgr2=0x7f277419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2779127640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27741083a0 0x7f277419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2779127640 1 -- 172.21.15.49:0/3980542352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2774108cf0 msgr2=0x7f277419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2779127640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2774108cf0 0x7f277419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2779127640 1 -- 172.21.15.49:0/3980542352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27741a0350 con 0x7f2774102a60 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2778926640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27741083a0 0x7f277419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2779928640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2774108cf0 0x7f277419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f2779127640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774102a60 0x7f277419a4a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f277000c920 tx=0x7f277000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f276a7fc640 1 -- 172.21.15.49:0/3980542352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770007c70 con 0x7f2774102a60 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f277b38b640 1 -- 172.21.15.49:0/3980542352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27741a0640 con 0x7f2774102a60 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f276a7fc640 1 -- 172.21.15.49:0/3980542352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2770007e10 con 0x7f2774102a60 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f276a7fc640 1 -- 172.21.15.49:0/3980542352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2770018820 con 0x7f2774102a60 2024-09-21T06:38:52.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.818+0000 7f277b38b640 1 -- 172.21.15.49:0/3980542352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27741a6e60 con 0x7f2774102a60 2024-09-21T06:38:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.821+0000 7f27818ff740 1 Processor -- start 2024-09-21T06:38:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.821+0000 7f276a7fc640 1 -- 172.21.15.49:0/3980542352 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f277000f450 con 0x7f2774102a60 2024-09-21T06:38:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.821+0000 7f27818ff740 1 -- start start 2024-09-21T06:38:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.821+0000 7f27818ff740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10567350 0x555a1090e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.821+0000 7f27818ff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1090e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.821+0000 7f27818ff740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10546670 0x555a1090eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.821+0000 7f27818ff740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555a10884e60 con 0x555a10546670 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.821+0000 7f27818ff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a10874290 con 0x555a1053e490 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.821+0000 7f27818ff740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555a108780a0 con 0x555a10567350 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2778926640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10546670 0x555a1090eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2778926640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10546670 0x555a1090eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38052/0 (socket says 172.21.15.49:38052) 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2778926640 1 -- 172.21.15.49:0/1074979763 learned_addr learned my addr 172.21.15.49:0/1074979763 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2779928640 1 --2- 172.21.15.49:0/1074979763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10567350 0x555a1090e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2779127640 1 --2- 172.21.15.49:0/1074979763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1090e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2778926640 1 -- 172.21.15.49:0/1074979763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10567350 msgr2=0x555a1090e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2778926640 1 --2- 172.21.15.49:0/1074979763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10567350 0x555a1090e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2778926640 1 -- 172.21.15.49:0/1074979763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 msgr2=0x555a1090e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2778926640 1 --2- 172.21.15.49:0/1074979763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1090e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2778926640 1 -- 172.21.15.49:0/1074979763 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a105d2930 con 0x555a10546670 2024-09-21T06:38:52.825 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f276a7fc640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27600b66b0 0x7f27600b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2778926640 1 --2- 172.21.15.49:0/1074979763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10546670 0x555a1090eeb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f276400bc60 tx=0x7f276400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0711910408826fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f2779928640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27600b66b0 0x7f27600b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.822+0000 7f276a7fc640 1 -- 172.21.15.49:0/3980542352 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f27700e7930 con 0x7f2774102a60 2024-09-21T06:38:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.823+0000 7f275f7fe640 1 -- 172.21.15.49:0/1074979763 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2764015070 con 0x555a10546670 2024-09-21T06:38:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.823+0000 7f275f7fe640 1 -- 172.21.15.49:0/1074979763 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f276401a910 con 0x555a10546670 2024-09-21T06:38:52.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.823+0000 7f275f7fe640 1 -- 172.21.15.49:0/1074979763 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27640118e0 con 0x555a10546670 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.823+0000 7f27818ff740 1 -- 172.21.15.49:0/1074979763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10546670 msgr2=0x555a1090eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.823+0000 7f2779928640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27600b66b0 0x7f27600b8bc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f276c004af0 tx=0x7f276c005d80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.823+0000 7f27818ff740 1 --2- 172.21.15.49:0/1074979763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10546670 0x555a1090eeb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f276400bc60 tx=0x7f276400f730 comp rx=0 tx=0).stop 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.824+0000 7f27818ff740 1 -- 172.21.15.49:0/1074979763 shutdown_connections 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.824+0000 7f27818ff740 1 --2- 172.21.15.49:0/1074979763 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10546670 0x555a1090eeb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.824+0000 7f27818ff740 1 --2- 172.21.15.49:0/1074979763 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1090e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.824+0000 7f27818ff740 1 --2- 172.21.15.49:0/1074979763 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10567350 0x555a1090e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.824+0000 7f27818ff740 1 -- 172.21.15.49:0/1074979763 >> 172.21.15.49:0/1074979763 conn(0x555a1055b740 msgr2=0x555a1090c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.824+0000 7f27818ff740 1 -- 172.21.15.49:0/1074979763 shutdown_connections 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.824+0000 7f27818ff740 1 -- 172.21.15.49:0/1074979763 wait complete. 2024-09-21T06:38:52.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.824+0000 7f27818ff740 1 -- start start 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.824+0000 7f27818ff740 1 Processor -- start 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f27818ff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1091a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f27818ff740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a1091a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f27818ff740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10567350 0x555a10925f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f27818ff740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555a106d5890 con 0x555a10567350 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f27818ff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a1080ed40 con 0x555a1053e490 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f27818ff740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555a1091cc10 con 0x555a10546670 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f27818ff740 10 client.0 _ll_register_callbacks cb 0x555a10872c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779928640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10567350 0x555a10925f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779127640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1091a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779928640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10567350 0x555a10925f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38060/0 (socket says 172.21.15.49:38060) 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779928640 1 -- 172.21.15.49:0/3611045981 learned_addr learned my addr 172.21.15.49:0/3611045981 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2778926640 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a1091a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779928640 1 -- 172.21.15.49:0/3611045981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 msgr2=0x555a1091a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779928640 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a1091a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779928640 1 -- 172.21.15.49:0/3611045981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 msgr2=0x555a1091a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779928640 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1091a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779928640 1 -- 172.21.15.49:0/3611045981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a10926540 con 0x555a10567350 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2778926640 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a1091a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f2779928640 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10567350 0x555a10925f00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f276c031590 tx=0x7f276c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf69de58818e2d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.825+0000 7f275cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f275cff9640 1 -- 172.21.15.49:0/3611045981 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c004250 con 0x555a10567350 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f275cff9640 1 -- 172.21.15.49:0/3611045981 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f276c0043f0 con 0x555a10567350 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f27818ff740 1 -- 172.21.15.49:0/3611045981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f276401a910 con 0x555a10567350 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f275cff9640 1 -- 172.21.15.49:0/3611045981 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f276c0045f0 con 0x555a10567350 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f27818ff740 10 client.16080 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f27818ff740 1 -- 172.21.15.49:0/3611045981 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a10928e70 con 0x555a10567350 2024-09-21T06:38:52.831 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f275cff9640 1 -- 172.21.15.49:0/3611045981 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f276401a910 con 0x555a10567350 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f275cff9640 1 -- 172.21.15.49:0/3611045981 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f276c050070 con 0x555a10567350 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f27818ff740 10 client.16080 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f27818ff740 10 client.16080 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f27818ff740 20 client.16080 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f27818ff740 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a10525cd0 0x555a1092c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f27818ff740 4 client.16080 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.826+0000 7f27818ff740 1 -- 172.21.15.49:0/3611045981 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a10886db0 con 0x555a10525cd0 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.827+0000 7f2779127640 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a10525cd0 0x555a1092c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.827+0000 7f2779127640 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a10525cd0 0x555a1092c3f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8c13265e4a621e6 server_cookie=869e8e5f8cb25bbc in_seq=0 out_seq=0 2024-09-21T06:38:52.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.827+0000 7f275cff9640 10 client.16080 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f275cff9640 1 -- 172.21.15.49:0/3611045981 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a10886db0 con 0x555a10525cd0 2024-09-21T06:38:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f275cff9640 10 client.16080 handle_command_reply: tid=0 2024-09-21T06:38:52.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f27818ff740 1 client.16080 shutdown 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f27818ff740 1 -- 172.21.15.49:0/3611045981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10567350 msgr2=0x555a10925f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f27818ff740 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10567350 0x555a10925f00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f276c031590 tx=0x7f276c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f27818ff740 1 -- 172.21.15.49:0/3611045981 shutdown_connections 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f27818ff740 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a10525cd0 0x555a1092c3f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f27818ff740 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10567350 0x555a10925f00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f275cff9640 0 client.16080 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f27818ff740 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a1091a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f27818ff740 1 --2- 172.21.15.49:0/3611045981 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1091a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.828+0000 7f27818ff740 1 -- 172.21.15.49:0/3611045981 >> 172.21.15.49:0/3611045981 conn(0x555a1055b740 msgr2=0x555a109115c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.829+0000 7f27818ff740 1 -- 172.21.15.49:0/3611045981 shutdown_connections 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.829+0000 7f27818ff740 1 -- 172.21.15.49:0/3611045981 wait complete. 2024-09-21T06:38:52.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.829+0000 7f27818ff740 20 client.16080 trim_cache size 0 max 16384 2024-09-21T06:38:52.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.846+0000 7f27818ff740 1 Processor -- start 2024-09-21T06:38:52.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.846+0000 7f27818ff740 1 -- start start 2024-09-21T06:38:52.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.846+0000 7f27818ff740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a10925e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.846+0000 7f27818ff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a109186d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.846+0000 7f27818ff740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a10918c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.849 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f27818ff740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f27741b1fb0 con 0x555a10525cd0 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f27818ff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27741af880 con 0x555a1053e490 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f27818ff740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27741ad6f0 con 0x555a10546670 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779127640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a10925e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779127640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a10925e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38070/0 (socket says 172.21.15.49:38070) 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779127640 1 -- 172.21.15.49:0/1337724032 learned_addr learned my addr 172.21.15.49:0/1337724032 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779928640 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a10918c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2778926640 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a109186d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779127640 1 -- 172.21.15.49:0/1337724032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 msgr2=0x555a10918c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779127640 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a10918c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779127640 1 -- 172.21.15.49:0/1337724032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 msgr2=0x555a109186d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779127640 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a109186d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779127640 1 -- 172.21.15.49:0/1337724032 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a10910720 con 0x555a10525cd0 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779928640 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a10918c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:52.850 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f2779127640 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a10925e00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f27700aa9d0 tx=0x7f27700eaf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5584cf7faf4134 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:52.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f275effd640 1 -- 172.21.15.49:0/1337724032 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27700a7e60 con 0x555a10525cd0 2024-09-21T06:38:52.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f275effd640 1 -- 172.21.15.49:0/1337724032 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27700b2240 con 0x555a10525cd0 2024-09-21T06:38:52.851 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.847+0000 7f275effd640 1 -- 172.21.15.49:0/1337724032 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27700b6cf0 con 0x555a10525cd0 2024-09-21T06:38:52.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.848+0000 7f27818ff740 1 -- 172.21.15.49:0/1337724032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 msgr2=0x555a10925e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.848+0000 7f27818ff740 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a10925e00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f27700aa9d0 tx=0x7f27700eaf90 comp rx=0 tx=0).stop 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.848+0000 7f27818ff740 1 -- 172.21.15.49:0/1337724032 shutdown_connections 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.848+0000 7f27818ff740 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a10918c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.848+0000 7f27818ff740 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a109186d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.848+0000 7f27818ff740 1 --2- 172.21.15.49:0/1337724032 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a10925e00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.848+0000 7f27818ff740 1 -- 172.21.15.49:0/1337724032 >> 172.21.15.49:0/1337724032 conn(0x555a1055b740 msgr2=0x555a10914f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.848+0000 7f27818ff740 1 -- 172.21.15.49:0/1337724032 shutdown_connections 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.848+0000 7f27818ff740 1 -- 172.21.15.49:0/1337724032 wait complete. 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f27818ff740 1 -- start start 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f27818ff740 1 Processor -- start 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f27818ff740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a1091e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f27818ff740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1091e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.854 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f27818ff740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a10995df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f27818ff740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f27741add40 con 0x555a10525cd0 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f27818ff740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f27741af1b0 con 0x555a1053e490 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f27818ff740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f27741ae410 con 0x555a10546670 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f27818ff740 10 client.0 _ll_register_callbacks cb 0x7f276c02f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f2779127640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a1091e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f2779127640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a1091e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38086/0 (socket says 172.21.15.49:38086) 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f2779127640 1 -- 172.21.15.49:0/825771364 learned_addr learned my addr 172.21.15.49:0/825771364 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.849+0000 7f2778926640 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1091e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f2779928640 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a10995df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f2779127640 1 -- 172.21.15.49:0/825771364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 msgr2=0x555a10995df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f2779127640 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a10995df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f2779127640 1 -- 172.21.15.49:0/825771364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 msgr2=0x555a1091e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f2779127640 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1091e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.855 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f2779127640 1 -- 172.21.15.49:0/825771364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a1091ee10 con 0x555a10525cd0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f2779127640 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a1091e0c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f27700ad6f0 tx=0x7f27700e52e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a11494ee182fa3a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f275cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f275cff9640 1 -- 172.21.15.49:0/825771364 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27700a7e60 con 0x555a10525cd0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f275cff9640 1 -- 172.21.15.49:0/825771364 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f27700a99d0 con 0x555a10525cd0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f27818ff740 1 -- 172.21.15.49:0/825771364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27700b2240 con 0x555a10525cd0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f275cff9640 1 -- 172.21.15.49:0/825771364 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f27700b6cf0 con 0x555a10525cd0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f27818ff740 10 client.16086 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.850+0000 7f27818ff740 1 -- 172.21.15.49:0/825771364 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555a1099b740 con 0x555a10525cd0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.851+0000 7f275cff9640 1 -- 172.21.15.49:0/825771364 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27700b2240 con 0x555a10525cd0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.851+0000 7f275cff9640 1 -- 172.21.15.49:0/825771364 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f27700ac430 con 0x555a10525cd0 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.851+0000 7f27818ff740 10 client.16086 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.851+0000 7f27818ff740 10 client.16086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.851+0000 7f27818ff740 20 client.16086 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:52.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.851+0000 7f27818ff740 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a10567350 0x555a1099ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:52.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.851+0000 7f27818ff740 4 client.16086 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:38:52.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.851+0000 7f27818ff740 1 -- 172.21.15.49:0/825771364 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555a10882860 con 0x555a10567350 2024-09-21T06:38:52.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.851+0000 7f2778926640 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a10567350 0x555a1099ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:52.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.852+0000 7f2778926640 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a10567350 0x555a1099ddf0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2136989c8a19847 server_cookie=f28e4d276ea14edb in_seq=0 out_seq=0 2024-09-21T06:38:52.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.852+0000 7f275cff9640 10 client.16086 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f275cff9640 1 -- 172.21.15.49:0/825771364 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555a10882860 con 0x555a10567350 2024-09-21T06:38:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f275cff9640 10 client.16086 handle_command_reply: tid=0 2024-09-21T06:38:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f27818ff740 1 client.16086 shutdown 2024-09-21T06:38:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f27818ff740 1 -- 172.21.15.49:0/825771364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 msgr2=0x555a1091e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f27818ff740 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a1091e0c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f27700ad6f0 tx=0x7f27700e52e0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f27818ff740 1 -- 172.21.15.49:0/825771364 shutdown_connections 2024-09-21T06:38:52.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f27818ff740 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a10567350 0x555a1099ddf0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f27818ff740 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a10546670 0x555a10995df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f27818ff740 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a1053e490 0x555a1091e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f27818ff740 1 --2- 172.21.15.49:0/825771364 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a10525cd0 0x555a1091e0c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f27818ff740 1 -- 172.21.15.49:0/825771364 >> 172.21.15.49:0/825771364 conn(0x555a1055b740 msgr2=0x555a10913540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.853+0000 7f275cff9640 0 client.16086 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f27818ff740 1 -- 172.21.15.49:0/825771364 shutdown_connections 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f27818ff740 1 -- 172.21.15.49:0/825771364 wait complete. 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f27818ff740 20 client.16086 trim_cache size 0 max 16384 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:38:52.859 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "1d017204-bcd9-4d51-9dec-2c0beb771c0f", 2024-09-21T06:38:52.860 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:38:52.860 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:38:52.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 -- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27600b66b0 msgr2=0x7f27600b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:52.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27600b66b0 0x7f27600b8bc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f276c004af0 tx=0x7f276c005d80 comp rx=0 tx=0).stop 2024-09-21T06:38:52.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 -- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774102a60 msgr2=0x7f277419a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:52.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774102a60 0x7f277419a4a0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f277000c920 tx=0x7f277000cde0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 -- 172.21.15.49:0/3980542352 shutdown_connections 2024-09-21T06:38:52.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f27600b66b0 0x7f27600b8bc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2774108cf0 0x7f277419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f27741083a0 0x7f277419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 --2- 172.21.15.49:0/3980542352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2774102a60 0x7f277419a4a0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:52.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 -- 172.21.15.49:0/3980542352 >> 172.21.15.49:0/3980542352 conn(0x7f2774079730 msgr2=0x7f277406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:52.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 -- 172.21.15.49:0/3980542352 shutdown_connections 2024-09-21T06:38:52.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:52.854+0000 7f277b38b640 1 -- 172.21.15.49:0/3980542352 wait complete. 2024-09-21T06:38:53.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:38:53.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:38:53.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:38:53.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:38:53.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:38:53.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:38:53.597 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:38:53.855 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:53 smithi098 ceph-mon[34704]: pgmap v386: 97 pgs: 97 active+clean; 2.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T06:38:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:53 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:38:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:53 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:53 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:38:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:53 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:38:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:53 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:53 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:53 smithi079 ceph-mon[34346]: pgmap v386: 97 pgs: 97 active+clean; 2.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T06:38:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:53 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:38:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:53 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:53 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:38:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:53 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:38:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:53 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:53 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:54.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:53 smithi049 ceph-mon[31177]: pgmap v386: 97 pgs: 97 active+clean; 2.1 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T06:38:54.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:53 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:38:54.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:53 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:54.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:53 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:38:54.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:53 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:38:54.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:53 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:54.102 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:53 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.333+0000 7fa15ce43640 1 -- 172.21.15.49:0/3662189919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108d70 msgr2=0x7fa15810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.333+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3662189919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108d70 0x7fa15810f5a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa150009ca0 tx=0x7fa15002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.333+0000 7fa15ce43640 1 -- 172.21.15.49:0/3662189919 shutdown_connections 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.333+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3662189919 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108d70 0x7fa15810f5a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.333+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3662189919 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa158108420 0x7fa158108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.333+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3662189919 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa158102ae0 0x7fa158102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.333+0000 7fa15ce43640 1 -- 172.21.15.49:0/3662189919 >> 172.21.15.49:0/3662189919 conn(0x7fa158079770 msgr2=0x7fa158079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.333+0000 7fa15ce43640 1 -- 172.21.15.49:0/3662189919 shutdown_connections 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.333+0000 7fa15ce43640 1 -- 172.21.15.49:0/3662189919 wait complete. 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa15ce43640 1 Processor -- start 2024-09-21T06:38:54.358 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa15ce43640 1 -- start start 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa15ce43640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa158102ae0 0x7fa15819b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa15ce43640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108420 0x7fa15819b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa15ce43640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa158108d70 0x7fa15819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa15ce43640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa158112a30 con 0x7fa158108420 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa15ce43640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa1581128b0 con 0x7fa158108d70 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa15ce43640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa158112bb0 con 0x7fa158102ae0 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa155d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108420 0x7fa15819b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa155d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108420 0x7fa15819b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38104/0 (socket says 172.21.15.49:38104) 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.334+0000 7fa155d9b640 1 -- 172.21.15.49:0/3523065173 learned_addr learned my addr 172.21.15.49:0/3523065173 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa15659c640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa158102ae0 0x7fa15819b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa156d9d640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa158108d70 0x7fa15819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa155d9b640 1 -- 172.21.15.49:0/3523065173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa158102ae0 msgr2=0x7fa15819b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa158102ae0 0x7fa15819b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.359 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa155d9b640 1 -- 172.21.15.49:0/3523065173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa158108d70 msgr2=0x7fa15819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa158108d70 0x7fa15819bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa155d9b640 1 -- 172.21.15.49:0/3523065173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1581a64d0 con 0x7fa158108420 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa15659c640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa158102ae0 0x7fa15819b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108420 0x7fa15819b7e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00c8c0 tx=0x7fa14c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa1477fe640 1 -- 172.21.15.49:0/3523065173 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c007bb0 con 0x7fa158108420 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa15ce43640 1 -- 172.21.15.49:0/3523065173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1581a67c0 con 0x7fa158108420 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa1477fe640 1 -- 172.21.15.49:0/3523065173 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa14c007d50 con 0x7fa158108420 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa1477fe640 1 -- 172.21.15.49:0/3523065173 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0187c0 con 0x7fa158108420 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.335+0000 7fa15ce43640 1 -- 172.21.15.49:0/3523065173 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1581a6d50 con 0x7fa158108420 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa1633b7740 1 Processor -- start 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa1633b7740 1 -- start start 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa1477fe640 1 -- 172.21.15.49:0/3523065173 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fa14c00fa20 con 0x7fa158108420 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366a9a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.360 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 0x556366a9ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366a9b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa1633b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556366a10e50 con 0x5563666f3070 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa1633b7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556366a00280 con 0x5563666d2390 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa1633b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556366a04090 con 0x5563666ca1b0 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa156d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366a9a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa156d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366a9a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38114/0 (socket says 172.21.15.49:38114) 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa156d9d640 1 -- 172.21.15.49:0/3168066837 learned_addr learned my addr 172.21.15.49:0/3168066837 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.338+0000 7fa15659c640 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 0x556366a9ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366a9b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa156d9d640 1 -- 172.21.15.49:0/3168066837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 msgr2=0x556366a9ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa156d9d640 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 0x556366a9ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa156d9d640 1 -- 172.21.15.49:0/3168066837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 msgr2=0x556366a9b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa156d9d640 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366a9b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa156d9d640 1 -- 172.21.15.49:0/3168066837 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55636675e650 con 0x5563666f3070 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa15659c640 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 0x556366a9ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366a9b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa1477fe640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa1400b6680 0x7fa1400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa156d9d640 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366a9a650 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa150006010 tx=0x7fa150009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11be7cf61b0254f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa15659c640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa1400b6680 0x7fa1400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa1477fe640 1 -- 172.21.15.49:0/3523065173 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa14c0e7890 con 0x7fa158108420 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa144ff9640 1 -- 172.21.15.49:0/3168066837 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150031cf0 con 0x5563666f3070 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa144ff9640 1 -- 172.21.15.49:0/3168066837 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa15003f070 con 0x5563666f3070 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.339+0000 7fa144ff9640 1 -- 172.21.15.49:0/3168066837 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1500042a0 con 0x5563666f3070 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa1633b7740 1 -- 172.21.15.49:0/3168066837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 msgr2=0x556366a9a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa15659c640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa1400b6680 0x7fa1400b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa148009350 tx=0x7fa1480092e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366a9a650 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa150006010 tx=0x7fa150009800 comp rx=0 tx=0).stop 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa1633b7740 1 -- 172.21.15.49:0/3168066837 shutdown_connections 2024-09-21T06:38:54.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366a9b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 0x556366a9ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3168066837 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366a9a650 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa1633b7740 1 -- 172.21.15.49:0/3168066837 >> 172.21.15.49:0/3168066837 conn(0x5563666e7460 msgr2=0x556366a98540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa1633b7740 1 -- 172.21.15.49:0/3168066837 shutdown_connections 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.340+0000 7fa1633b7740 1 -- 172.21.15.49:0/3168066837 wait complete. 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa1633b7740 1 -- start start 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa1633b7740 1 Processor -- start 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 0x556366aaa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366aaa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366ab6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa1633b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556366861700 con 0x5563666f3070 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa1633b7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55636699b110 con 0x5563666d2390 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa1633b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556366aad100 con 0x5563666ca1b0 2024-09-21T06:38:54.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa1633b7740 10 client.0 _ll_register_callbacks cb 0x5563669b4990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa156d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366ab6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa156d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366ab6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38122/0 (socket says 172.21.15.49:38122) 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa156d9d640 1 -- 172.21.15.49:0/3426469445 learned_addr learned my addr 172.21.15.49:0/3426469445 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366aaa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.341+0000 7fa15659c640 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 0x556366aaa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa156d9d640 1 -- 172.21.15.49:0/3426469445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 msgr2=0x556366aaa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa156d9d640 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 0x556366aaa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa156d9d640 1 -- 172.21.15.49:0/3426469445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 msgr2=0x556366aaa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa156d9d640 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366aaa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa156d9d640 1 -- 172.21.15.49:0/3426469445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563669c8c40 con 0x5563666f3070 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa156d9d640 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366ab6460 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa150009bf0 tx=0x7fa150031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f0e33169e6c37f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa13dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa13dffb640 1 -- 172.21.15.49:0/3426469445 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15002f660 con 0x5563666f3070 2024-09-21T06:38:54.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa13dffb640 1 -- 172.21.15.49:0/3426469445 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa15002f800 con 0x5563666f3070 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa1633b7740 1 -- 172.21.15.49:0/3426469445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa15003f070 con 0x5563666f3070 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa13dffb640 1 -- 172.21.15.49:0/3426469445 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa15002fa00 con 0x5563666f3070 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa1633b7740 10 client.16098 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.342+0000 7fa1633b7740 1 -- 172.21.15.49:0/3426469445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556366ab8d90 con 0x5563666f3070 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.343+0000 7fa13dffb640 1 -- 172.21.15.49:0/3426469445 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa15003f070 con 0x5563666f3070 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.343+0000 7fa13dffb640 1 -- 172.21.15.49:0/3426469445 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa150044470 con 0x5563666f3070 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.343+0000 7fa1633b7740 10 client.16098 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.343+0000 7fa1633b7740 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.343+0000 7fa1633b7740 20 client.16098 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.343+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5563666b19f0 0x556366abc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.343+0000 7fa1633b7740 4 client.16098 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.343+0000 7fa1633b7740 1 -- 172.21.15.49:0/3426469445 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556366a12da0 con 0x5563666b19f0 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.343+0000 7fa15659c640 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5563666b19f0 0x556366abc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa15659c640 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5563666b19f0 0x556366abc0f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9800f1ce6c04f8a7 server_cookie=38eb70036e60e932 in_seq=0 out_seq=0 2024-09-21T06:38:54.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa13dffb640 10 client.16098 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa13dffb640 1 -- 172.21.15.49:0/3426469445 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556366a12da0 con 0x5563666b19f0 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa13dffb640 10 client.16098 handle_command_reply: tid=0 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa1633b7740 1 client.16098 shutdown 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa1633b7740 1 -- 172.21.15.49:0/3426469445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 msgr2=0x556366ab6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366ab6460 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fa150009bf0 tx=0x7fa150031ee0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa1633b7740 1 -- 172.21.15.49:0/3426469445 shutdown_connections 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5563666b19f0 0x556366abc0f0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.345+0000 7fa13dffb640 0 client.16098 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.344+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666f3070 0x556366ab6460 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.345+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366aaa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.345+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3426469445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666ca1b0 0x556366aaa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.345+0000 7fa1633b7740 1 -- 172.21.15.49:0/3426469445 >> 172.21.15.49:0/3426469445 conn(0x5563666e7460 msgr2=0x556366a9d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.345+0000 7fa1633b7740 1 -- 172.21.15.49:0/3426469445 shutdown_connections 2024-09-21T06:38:54.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.345+0000 7fa1633b7740 1 -- 172.21.15.49:0/3426469445 wait complete. 2024-09-21T06:38:54.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.345+0000 7fa1633b7740 20 client.16098 trim_cache size 0 max 16384 2024-09-21T06:38:54.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa1633b7740 1 Processor -- start 2024-09-21T06:38:54.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa1633b7740 1 -- start start 2024-09-21T06:38:54.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666b19f0 0x556366ab63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666ca1b0 0x556366aabce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366aa72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa1633b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa1581afda0 con 0x5563666ca1b0 2024-09-21T06:38:54.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa1633b7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa1581ad670 con 0x5563666d2390 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa1633b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1581ab4e0 con 0x5563666b19f0 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa155d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666ca1b0 0x556366aabce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa155d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666ca1b0 0x556366aabce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38132/0 (socket says 172.21.15.49:38132) 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa155d9b640 1 -- 172.21.15.49:0/3059323381 learned_addr learned my addr 172.21.15.49:0/3059323381 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.363+0000 7fa156d9d640 1 --2- 172.21.15.49:0/3059323381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366aa72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa15659c640 1 --2- 172.21.15.49:0/3059323381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666b19f0 0x556366ab63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa155d9b640 1 -- 172.21.15.49:0/3059323381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666b19f0 msgr2=0x556366ab63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3059323381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666b19f0 0x556366ab63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa155d9b640 1 -- 172.21.15.49:0/3059323381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 msgr2=0x556366aa72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3059323381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366aa72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa155d9b640 1 -- 172.21.15.49:0/3059323381 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556366a9d450 con 0x5563666ca1b0 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3059323381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666ca1b0 0x556366aabce0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0aa930 tx=0x7fa14c00a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e8dc0d93ebd1af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa13ffff640 1 -- 172.21.15.49:0/3059323381 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c098020 con 0x5563666ca1b0 2024-09-21T06:38:54.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa13ffff640 1 -- 172.21.15.49:0/3059323381 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa14c0b70e0 con 0x5563666ca1b0 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.364+0000 7fa13ffff640 1 -- 172.21.15.49:0/3059323381 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0a9010 con 0x5563666ca1b0 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.365+0000 7fa1633b7740 1 -- 172.21.15.49:0/3059323381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666ca1b0 msgr2=0x556366aabce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.365+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3059323381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666ca1b0 0x556366aabce0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0aa930 tx=0x7fa14c00a610 comp rx=0 tx=0).stop 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.365+0000 7fa1633b7740 1 -- 172.21.15.49:0/3059323381 shutdown_connections 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.365+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3059323381 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666d2390 0x556366aa72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.365+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3059323381 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666ca1b0 0x556366aabce0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.365+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3059323381 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666b19f0 0x556366ab63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.365+0000 7fa1633b7740 1 -- 172.21.15.49:0/3059323381 >> 172.21.15.49:0/3059323381 conn(0x5563666e7460 msgr2=0x556366aab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.365+0000 7fa1633b7740 1 -- 172.21.15.49:0/3059323381 shutdown_connections 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.365+0000 7fa1633b7740 1 -- 172.21.15.49:0/3059323381 wait complete. 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa1633b7740 1 -- start start 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa1633b7740 1 Processor -- start 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666b19f0 0x556366abfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666ca1b0 0x556366aa3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa1633b7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666d2390 0x556366aa4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa1633b7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa1581abb30 con 0x5563666b19f0 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa1633b7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa1581acfa0 con 0x5563666ca1b0 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa1633b7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa1581ac200 con 0x5563666d2390 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa1633b7740 10 client.0 _ll_register_callbacks cb 0x7fa1500093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa15659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666b19f0 0x556366abfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa15659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666b19f0 0x556366abfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38144/0 (socket says 172.21.15.49:38144) 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa15659c640 1 -- 172.21.15.49:0/3147505508 learned_addr learned my addr 172.21.15.49:0/3147505508 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.366+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666ca1b0 0x556366aa3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa156d9d640 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666d2390 0x556366aa4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa15659c640 1 -- 172.21.15.49:0/3147505508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666d2390 msgr2=0x556366aa4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa15659c640 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666d2390 0x556366aa4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa15659c640 1 -- 172.21.15.49:0/3147505508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666ca1b0 msgr2=0x556366aa3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:54.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa15659c640 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666ca1b0 0x556366aa3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa15659c640 1 -- 172.21.15.49:0/3147505508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556366abe6e0 con 0x5563666b19f0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666ca1b0 0x556366aa3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa15659c640 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666b19f0 0x556366abfaa0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa148005d00 tx=0x7fa1480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7af05d6e8cc733 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa13dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa13dffb640 1 -- 172.21.15.49:0/3147505508 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1480209c0 con 0x5563666b19f0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa13dffb640 1 -- 172.21.15.49:0/3147505508 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa148020b60 con 0x5563666b19f0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa1633b7740 1 -- 172.21.15.49:0/3147505508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa14c0b70e0 con 0x5563666b19f0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa13dffb640 1 -- 172.21.15.49:0/3147505508 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa148020d60 con 0x5563666b19f0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa1633b7740 10 client.16104 fetch_fsmap learned FSMap version 26 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa1633b7740 1 -- 172.21.15.49:0/3147505508 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556366b2b1f0 con 0x5563666b19f0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.367+0000 7fa13dffb640 1 -- 172.21.15.49:0/3147505508 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa14c0b70e0 con 0x5563666b19f0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa13dffb640 1 -- 172.21.15.49:0/3147505508 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa14802f070 con 0x5563666b19f0 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa1633b7740 10 client.16104 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:38:54.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa1633b7740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa1633b7740 20 client.16104 populate_metadata read hostname 'smithi049' 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5563666f3070 0x556366b2d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa1633b7740 4 client.16104 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa1633b7740 1 -- 172.21.15.49:0/3147505508 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556366a0e850 con 0x5563666f3070 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5563666f3070 0x556366b2d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa13dffb640 10 client.16104 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.368+0000 7fa155d9b640 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5563666f3070 0x556366b2d9e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7062fa24a29eb793 server_cookie=9d0ebb467019a286 in_seq=0 out_seq=0 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa13dffb640 1 -- 172.21.15.49:0/3147505508 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1706 (crc 0 0 0) 0x556366a0e850 con 0x5563666f3070 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa13dffb640 10 client.16104 handle_command_reply: tid=0 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 client.16104 shutdown 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 -- 172.21.15.49:0/3147505508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666b19f0 msgr2=0x556366abfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666b19f0 0x556366abfaa0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa148005d00 tx=0x7fa1480046c0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 -- 172.21.15.49:0/3147505508 shutdown_connections 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5563666f3070 0x556366b2d9e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5563666d2390 0x556366aa4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5563666ca1b0 0x556366aa3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 --2- 172.21.15.49:0/3147505508 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5563666b19f0 0x556366abfaa0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 -- 172.21.15.49:0/3147505508 >> 172.21.15.49:0/3147505508 conn(0x5563666e7460 msgr2=0x556366a9d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa13dffb640 0 client.16104 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 -- 172.21.15.49:0/3147505508 shutdown_connections 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 1 -- 172.21.15.49:0/3147505508 wait complete. 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.369+0000 7fa1633b7740 20 client.16104 trim_cache size 0 max 16384 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:38:54.377 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "1d017204-bcd9-4d51-9dec-2c0beb771c0f", 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:54.378 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:54.379 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:38:54.380 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:38:54.381 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:38:54.381 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:38:54.381 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:38:54.381 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:54.381 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:38:54.381 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:38:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 -- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa1400b6680 msgr2=0x7fa1400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa1400b6680 0x7fa1400b8b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa148009350 tx=0x7fa1480092e0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 -- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108420 msgr2=0x7fa15819b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108420 0x7fa15819b7e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00c8c0 tx=0x7fa14c00cd80 comp rx=0 tx=0).stop 2024-09-21T06:38:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 -- 172.21.15.49:0/3523065173 shutdown_connections 2024-09-21T06:38:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa1400b6680 0x7fa1400b8b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa158108d70 0x7fa15819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa158108420 0x7fa15819b7e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 --2- 172.21.15.49:0/3523065173 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa158102ae0 0x7fa15819b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 -- 172.21.15.49:0/3523065173 >> 172.21.15.49:0/3523065173 conn(0x7fa158079770 msgr2=0x7fa1581043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 -- 172.21.15.49:0/3523065173 shutdown_connections 2024-09-21T06:38:54.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:38:54.370+0000 7fa15ce43640 1 -- 172.21.15.49:0/3523065173 wait complete. 2024-09-21T06:38:55.166 INFO:tasks.cephfs.filesystem:scrub status for tag:1d017204-bcd9-4d51-9dec-2c0beb771c0f - {'path': '/', 'tag': '1d017204-bcd9-4d51-9dec-2c0beb771c0f', 'options': 'recursive,force'} 2024-09-21T06:38:56.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:55 smithi098 ceph-mon[34704]: pgmap v387: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:38:56.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:55 smithi079 ceph-mon[34346]: pgmap v387: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:38:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:55 smithi049 ceph-mon[31177]: pgmap v387: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:38:58.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:57 smithi098 ceph-mon[34704]: pgmap v388: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:58.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:57 smithi079 ceph-mon[34346]: pgmap v388: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:58.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:57 smithi049 ceph-mon[31177]: pgmap v388: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-09-21T06:38:59.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:58 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:38:59.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:58 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:38:59.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:58 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:39:00.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:59 smithi098 ceph-mon[34704]: pgmap v389: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-21T06:39:00.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:38:59 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:39:00.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:59 smithi079 ceph-mon[34346]: pgmap v389: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-21T06:39:00.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:38:59 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:39:00.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:59 smithi049 ceph-mon[31177]: pgmap v389: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 KiB/s wr, 17 op/s 2024-09-21T06:39:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:38:59 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:39:02.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:01 smithi079 ceph-mon[34346]: pgmap v390: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-21T06:39:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.073+0000 7f659c8b6640 1 -- 172.21.15.49:0/2610994016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598109450 msgr2=0x7f6598109860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.073+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2610994016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598109450 0x7f6598109860 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f658c009900 tx=0x7f658c02a410 comp rx=0 tx=0).stop 2024-09-21T06:39:02.075 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.074+0000 7f659c8b6640 1 -- 172.21.15.49:0/2610994016 shutdown_connections 2024-09-21T06:39:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.074+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2610994016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6598109da0 0x7f65981105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.074+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2610994016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598109450 0x7f6598109860 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.074+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2610994016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6598103b20 0x7f6598103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.074+0000 7f659c8b6640 1 -- 172.21.15.49:0/2610994016 >> 172.21.15.49:0/2610994016 conn(0x7f65980ff560 msgr2=0x7f65981019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.074+0000 7f659c8b6640 1 -- 172.21.15.49:0/2610994016 shutdown_connections 2024-09-21T06:39:02.076 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.074+0000 7f659c8b6640 1 -- 172.21.15.49:0/2610994016 wait complete. 2024-09-21T06:39:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659c8b6640 1 Processor -- start 2024-09-21T06:39:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659c8b6640 1 -- start start 2024-09-21T06:39:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659c8b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598103b20 0x7f659819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659c8b6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6598109450 0x7f659819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659c8b6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6598109da0 0x7f659819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659c8b6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6598113a60 con 0x7f6598103b20 2024-09-21T06:39:02.078 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659c8b6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65981138e0 con 0x7f6598109da0 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659c8b6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6598113be0 con 0x7f6598109450 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598103b20 0x7f659819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598103b20 0x7f659819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52824/0 (socket says 172.21.15.49:52824) 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659659c640 1 -- 172.21.15.49:0/2888975056 learned_addr learned my addr 172.21.15.49:0/2888975056 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f6596d9d640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6598109da0 0x7f659819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f6595d9b640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6598109450 0x7f659819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659659c640 1 -- 172.21.15.49:0/2888975056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6598109450 msgr2=0x7f659819aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659659c640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6598109450 0x7f659819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659659c640 1 -- 172.21.15.49:0/2888975056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6598109da0 msgr2=0x7f659819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659659c640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6598109da0 0x7f659819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f659659c640 1 -- 172.21.15.49:0/2888975056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65981a03d0 con 0x7f6598103b20 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.075+0000 7f6596d9d640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6598109da0 0x7f659819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.076+0000 7f659659c640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598103b20 0x7f659819a4a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f658800d770 tx=0x7f658800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:02.079 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.076+0000 7f65877fe640 1 -- 172.21.15.49:0/2888975056 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588017070 con 0x7f6598103b20 2024-09-21T06:39:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.076+0000 7f659c8b6640 1 -- 172.21.15.49:0/2888975056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65981a06c0 con 0x7f6598103b20 2024-09-21T06:39:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.076+0000 7f65877fe640 1 -- 172.21.15.49:0/2888975056 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65880054d0 con 0x7f6598103b20 2024-09-21T06:39:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.076+0000 7f65877fe640 1 -- 172.21.15.49:0/2888975056 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588004c30 con 0x7f6598103b20 2024-09-21T06:39:02.080 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.076+0000 7f659c8b6640 1 -- 172.21.15.49:0/2888975056 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65981a6e50 con 0x7f6598103b20 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.078+0000 7f65a3822740 1 Processor -- start 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f65a3822740 1 -- start start 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f65877fe640 1 -- 172.21.15.49:0/2888975056 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6588004e10 con 0x7f6598103b20 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f65a3822740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b127a1b0 0x5564b161f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f65a3822740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12512f0 0x5564b161fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f65a3822740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b1620430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f65a3822740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5564b15946f0 con 0x5564b12512f0 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f65a3822740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564b1583b20 con 0x5564b127a1b0 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f65a3822740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5564b1587930 con 0x5564b12594d0 2024-09-21T06:39:02.082 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f659659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12512f0 0x5564b161fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f659659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12512f0 0x5564b161fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52838/0 (socket says 172.21.15.49:52838) 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f659659c640 1 -- 172.21.15.49:0/4064890474 learned_addr learned my addr 172.21.15.49:0/4064890474 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.079+0000 7f6596d9d640 1 --2- 172.21.15.49:0/4064890474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b127a1b0 0x5564b161f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f6595d9b640 1 --2- 172.21.15.49:0/4064890474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b1620430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f659659c640 1 -- 172.21.15.49:0/4064890474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 msgr2=0x5564b1620430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f659659c640 1 --2- 172.21.15.49:0/4064890474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b1620430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f659659c640 1 -- 172.21.15.49:0/4064890474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b127a1b0 msgr2=0x5564b161f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f659659c640 1 --2- 172.21.15.49:0/4064890474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b127a1b0 0x5564b161f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f659659c640 1 -- 172.21.15.49:0/4064890474 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b1549530 con 0x5564b12512f0 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f65877fe640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65800b6680 0x7f65800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f6596d9d640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65800b6680 0x7f65800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f659659c640 1 --2- 172.21.15.49:0/4064890474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12512f0 0x5564b161fef0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f65880e4980 tx=0x7f65880eda30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8bb6463eab3000 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f65877fe640 1 -- 172.21.15.49:0/2888975056 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f65880e72e0 con 0x7f6598103b20 2024-09-21T06:39:02.083 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f6584ff9640 1 -- 172.21.15.49:0/4064890474 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588020070 con 0x5564b12512f0 2024-09-21T06:39:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f6584ff9640 1 -- 172.21.15.49:0/4064890474 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65880acc20 con 0x5564b12512f0 2024-09-21T06:39:02.084 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.080+0000 7f6584ff9640 1 -- 172.21.15.49:0/4064890474 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65880acee0 con 0x5564b12512f0 2024-09-21T06:39:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f65a3822740 1 -- 172.21.15.49:0/4064890474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12512f0 msgr2=0x5564b161fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f65a3822740 1 --2- 172.21.15.49:0/4064890474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12512f0 0x5564b161fef0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f65880e4980 tx=0x7f65880eda30 comp rx=0 tx=0).stop 2024-09-21T06:39:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f6596d9d640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65800b6680 0x7f65800b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6590005fd0 tx=0x7f6590009700 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f65a3822740 1 -- 172.21.15.49:0/4064890474 shutdown_connections 2024-09-21T06:39:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f65a3822740 1 --2- 172.21.15.49:0/4064890474 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b1620430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f65a3822740 1 --2- 172.21.15.49:0/4064890474 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12512f0 0x5564b161fef0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f65a3822740 1 --2- 172.21.15.49:0/4064890474 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b127a1b0 0x5564b161f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f65a3822740 1 -- 172.21.15.49:0/4064890474 >> 172.21.15.49:0/4064890474 conn(0x5564b126e300 msgr2=0x5564b161d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:02.088 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f65a3822740 1 -- 172.21.15.49:0/4064890474 shutdown_connections 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.081+0000 7f65a3822740 1 -- 172.21.15.49:0/4064890474 wait complete. 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f65a3822740 1 -- start start 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f65a3822740 1 Processor -- start 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f65a3822740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b162b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f65a3822740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b162b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f65a3822740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b1637450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f65a3822740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5564b14bbab0 con 0x5564b127a1b0 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f65a3822740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5564b1529730 con 0x5564b12512f0 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f65a3822740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5564b162e130 con 0x5564b12594d0 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f65a3822740 10 client.0 _ll_register_callbacks cb 0x5564b157d6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b1637450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b1637450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52840/0 (socket says 172.21.15.49:52840) 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.082+0000 7f6596d9d640 1 -- 172.21.15.49:0/2206486563 learned_addr learned my addr 172.21.15.49:0/2206486563 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f6595d9b640 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b162b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.089 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f659659c640 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b162b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f6596d9d640 1 -- 172.21.15.49:0/2206486563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 msgr2=0x5564b162b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f6596d9d640 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b162b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f6596d9d640 1 -- 172.21.15.49:0/2206486563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 msgr2=0x5564b162b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f6596d9d640 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b162b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f6596d9d640 1 -- 172.21.15.49:0/2206486563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b12e5790 con 0x5564b127a1b0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f6596d9d640 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b1637450 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6590013fd0 tx=0x7f6590004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fdaf96fa2f1813d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f657dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f657dffb640 1 -- 172.21.15.49:0/2206486563 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659001e6d0 con 0x5564b127a1b0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f657dffb640 1 -- 172.21.15.49:0/2206486563 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f659001e870 con 0x5564b127a1b0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f65a3822740 1 -- 172.21.15.49:0/2206486563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65880acc20 con 0x5564b127a1b0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f657dffb640 1 -- 172.21.15.49:0/2206486563 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f659001eab0 con 0x5564b127a1b0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f65a3822740 10 client.16116 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.083+0000 7f65a3822740 1 -- 172.21.15.49:0/2206486563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5564b135e620 con 0x5564b127a1b0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.084+0000 7f657dffb640 1 -- 172.21.15.49:0/2206486563 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65880acc20 con 0x5564b127a1b0 2024-09-21T06:39:02.090 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.084+0000 7f657dffb640 1 -- 172.21.15.49:0/2206486563 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f659002f420 con 0x5564b127a1b0 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.084+0000 7f65a3822740 10 client.16116 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.084+0000 7f65a3822740 10 client.16116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.084+0000 7f65a3822740 20 client.16116 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.084+0000 7f65a3822740 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5564b1238d80 0x5564b163d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.084+0000 7f65a3822740 4 client.16116 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.084+0000 7f65a3822740 1 -- 172.21.15.49:0/2206486563 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564b1596640 con 0x5564b1238d80 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.084+0000 7f659659c640 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5564b1238d80 0x5564b163d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.085+0000 7f659659c640 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5564b1238d80 0x5564b163d3a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9616a8917ad1940e server_cookie=de33d5db416e985d in_seq=0 out_seq=0 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.085+0000 7f657dffb640 10 client.16116 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.085+0000 7f657dffb640 1 -- 172.21.15.49:0/2206486563 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5564b1596640 con 0x5564b1238d80 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.085+0000 7f657dffb640 10 client.16116 handle_command_reply: tid=0 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 client.16116 shutdown 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 -- 172.21.15.49:0/2206486563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 msgr2=0x5564b1637450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b1637450 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6590013fd0 tx=0x7f6590004a40 comp rx=0 tx=0).stop 2024-09-21T06:39:02.091 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 -- 172.21.15.49:0/2206486563 shutdown_connections 2024-09-21T06:39:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5564b1238d80 0x5564b163d3a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b1637450 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b162b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 --2- 172.21.15.49:0/2206486563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b162b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f657dffb640 0 client.16116 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 -- 172.21.15.49:0/2206486563 >> 172.21.15.49:0/2206486563 conn(0x5564b126e300 msgr2=0x5564b16209e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 -- 172.21.15.49:0/2206486563 shutdown_connections 2024-09-21T06:39:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 1 -- 172.21.15.49:0/2206486563 wait complete. 2024-09-21T06:39:02.092 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.086+0000 7f65a3822740 20 client.16116 trim_cache size 0 max 16384 2024-09-21T06:39:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.101+0000 7f65a3822740 1 Processor -- start 2024-09-21T06:39:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.101+0000 7f65a3822740 1 -- start start 2024-09-21T06:39:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.101+0000 7f65a3822740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b16210f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.101+0000 7f65a3822740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12594d0 0x5564b1637350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.101+0000 7f65a3822740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b127a1b0 0x5564b1637890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.101+0000 7f65a3822740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f65981b20e0 con 0x5564b12594d0 2024-09-21T06:39:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.101+0000 7f65a3822740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65981af9b0 con 0x5564b12512f0 2024-09-21T06:39:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.101+0000 7f65a3822740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f65981ad820 con 0x5564b127a1b0 2024-09-21T06:39:02.104 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.101+0000 7f6595d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12594d0 0x5564b1637350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6595d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12594d0 0x5564b1637350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52852/0 (socket says 172.21.15.49:52852) 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6595d9b640 1 -- 172.21.15.49:0/1494954994 learned_addr learned my addr 172.21.15.49:0/1494954994 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f659659c640 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b16210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6596d9d640 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b127a1b0 0x5564b1637890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6595d9b640 1 -- 172.21.15.49:0/1494954994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b127a1b0 msgr2=0x5564b1637890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6595d9b640 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b127a1b0 0x5564b1637890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6595d9b640 1 -- 172.21.15.49:0/1494954994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 msgr2=0x5564b16210f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6595d9b640 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b16210f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6595d9b640 1 -- 172.21.15.49:0/1494954994 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564b1629580 con 0x5564b12594d0 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6596d9d640 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b127a1b0 0x5564b1637890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f6595d9b640 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12594d0 0x5564b1637350 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f658c02ac00 tx=0x7f658c032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562ad0c851385271 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f657ffff640 1 -- 172.21.15.49:0/1494954994 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c035040 con 0x5564b12594d0 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f657ffff640 1 -- 172.21.15.49:0/1494954994 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f658c0316a0 con 0x5564b12594d0 2024-09-21T06:39:02.105 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.102+0000 7f657ffff640 1 -- 172.21.15.49:0/1494954994 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f658c0055d0 con 0x5564b12594d0 2024-09-21T06:39:02.108 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.103+0000 7f65a3822740 1 -- 172.21.15.49:0/1494954994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12594d0 msgr2=0x5564b1637350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.103+0000 7f65a3822740 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12594d0 0x5564b1637350 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f658c02ac00 tx=0x7f658c032bf0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.103+0000 7f65a3822740 1 -- 172.21.15.49:0/1494954994 shutdown_connections 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.103+0000 7f65a3822740 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b127a1b0 0x5564b1637890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.103+0000 7f65a3822740 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b12594d0 0x5564b1637350 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.103+0000 7f65a3822740 1 --2- 172.21.15.49:0/1494954994 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b16210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.103+0000 7f65a3822740 1 -- 172.21.15.49:0/1494954994 >> 172.21.15.49:0/1494954994 conn(0x5564b126e300 msgr2=0x5564b16209e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.103+0000 7f65a3822740 1 -- 172.21.15.49:0/1494954994 shutdown_connections 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.103+0000 7f65a3822740 1 -- 172.21.15.49:0/1494954994 wait complete. 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f65a3822740 1 -- start start 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f65a3822740 1 Processor -- start 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f65a3822740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b1630e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f65a3822740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b16313f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f65a3822740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b169ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.109 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f65a3822740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f65981ade70 con 0x5564b127a1b0 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f65a3822740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65981af2e0 con 0x5564b12512f0 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f65a3822740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f65981ae540 con 0x5564b12594d0 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f65a3822740 10 client.0 _ll_register_callbacks cb 0x7f6590009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b169ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f6596d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b169ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52864/0 (socket says 172.21.15.49:52864) 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f6596d9d640 1 -- 172.21.15.49:0/1839470458 learned_addr learned my addr 172.21.15.49:0/1839470458 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f6595d9b640 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b16313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f659659c640 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b1630e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f6596d9d640 1 -- 172.21.15.49:0/1839470458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 msgr2=0x5564b16313f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f6596d9d640 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b16313f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f6596d9d640 1 -- 172.21.15.49:0/1839470458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 msgr2=0x5564b1630e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f6596d9d640 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b1630e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.104+0000 7f6596d9d640 1 -- 172.21.15.49:0/1839470458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564b169f3d0 con 0x5564b127a1b0 2024-09-21T06:39:02.110 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f6596d9d640 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b169ed60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6590012cb0 tx=0x7f659002fdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa2b4f907a67c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f657dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f657dffb640 1 -- 172.21.15.49:0/1839470458 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6590004ab0 con 0x5564b127a1b0 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f657dffb640 1 -- 172.21.15.49:0/1839470458 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6590004c50 con 0x5564b127a1b0 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f65a3822740 1 -- 172.21.15.49:0/1839470458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f658c0316a0 con 0x5564b127a1b0 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f657dffb640 1 -- 172.21.15.49:0/1839470458 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6590046050 con 0x5564b127a1b0 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f65a3822740 10 client.16122 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f65a3822740 1 -- 172.21.15.49:0/1839470458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5564b16a78e0 con 0x5564b127a1b0 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f657dffb640 1 -- 172.21.15.49:0/1839470458 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f658c0316a0 con 0x5564b127a1b0 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f657dffb640 1 -- 172.21.15.49:0/1839470458 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f6590041030 con 0x5564b127a1b0 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f65a3822740 10 client.16122 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f65a3822740 10 client.16122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.105+0000 7f65a3822740 20 client.16122 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.106+0000 7f65a3822740 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5564b120e1c0 0x5564b16aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.106+0000 7f65a3822740 4 client.16122 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:39:02.111 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.106+0000 7f65a3822740 1 -- 172.21.15.49:0/1839470458 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564b15920f0 con 0x5564b120e1c0 2024-09-21T06:39:02.112 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.106+0000 7f659659c640 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5564b120e1c0 0x5564b16aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:02.112 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.106+0000 7f659659c640 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5564b120e1c0 0x5564b16aa0f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37954a5a763489f9 server_cookie=a9045bdb164658dd in_seq=0 out_seq=0 2024-09-21T06:39:02.112 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:02.106+0000 7f657dffb640 10 client.16122 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:02.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:01 smithi049 ceph-mon[31177]: pgmap v390: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-21T06:39:02.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:01 smithi098 ceph-mon[34704]: pgmap v390: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 12 op/s 2024-09-21T06:39:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f657dffb640 1 -- 172.21.15.49:0/1839470458 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564b15920f0 con 0x5564b120e1c0 2024-09-21T06:39:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f657dffb640 10 client.16122 handle_command_reply: tid=0 2024-09-21T06:39:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 client.16122 shutdown 2024-09-21T06:39:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 -- 172.21.15.49:0/1839470458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 msgr2=0x5564b169ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b169ed60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6590012cb0 tx=0x7f659002fdb0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 -- 172.21.15.49:0/1839470458 shutdown_connections 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5564b120e1c0 0x5564b16aa0f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5564b127a1b0 0x5564b169ed60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5564b12594d0 0x5564b16313f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 --2- 172.21.15.49:0/1839470458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5564b12512f0 0x5564b1630e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f657dffb640 0 client.16122 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 -- 172.21.15.49:0/1839470458 >> 172.21.15.49:0/1839470458 conn(0x5564b126e300 msgr2=0x5564b161d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 -- 172.21.15.49:0/1839470458 shutdown_connections 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.556+0000 7f65a3822740 1 -- 172.21.15.49:0/1839470458 wait complete. 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f65a3822740 20 client.16122 trim_cache size 0 max 16384 2024-09-21T06:39:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:39:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:39:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:39:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:39:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 -- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65800b6680 msgr2=0x7f65800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65800b6680 0x7f65800b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6590005fd0 tx=0x7f6590009700 comp rx=0 tx=0).stop 2024-09-21T06:39:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 -- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598103b20 msgr2=0x7f659819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598103b20 0x7f659819a4a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f658800d770 tx=0x7f658800dc30 comp rx=0 tx=0).stop 2024-09-21T06:39:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 -- 172.21.15.49:0/2888975056 shutdown_connections 2024-09-21T06:39:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65800b6680 0x7f65800b8b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6598109da0 0x7f659819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6598109450 0x7f659819aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 --2- 172.21.15.49:0/2888975056 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6598103b20 0x7f659819a4a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.557+0000 7f659c8b6640 1 -- 172.21.15.49:0/2888975056 >> 172.21.15.49:0/2888975056 conn(0x7f65980ff560 msgr2=0x7f6598101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.558+0000 7f659c8b6640 1 -- 172.21.15.49:0/2888975056 shutdown_connections 2024-09-21T06:39:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:03.558+0000 7f659c8b6640 1 -- 172.21.15.49:0/2888975056 wait complete. 2024-09-21T06:39:04.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:03 smithi079 ceph-mon[34346]: pgmap v391: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-21T06:39:04.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:03 smithi049 ceph-mon[31177]: pgmap v391: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-21T06:39:04.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:03 smithi098 ceph-mon[34704]: pgmap v391: 97 pgs: 97 active+clean; 2.2 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 14 op/s 2024-09-21T06:39:06.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:05 smithi079 ceph-mon[34346]: pgmap v392: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 KiB/s wr, 30 op/s 2024-09-21T06:39:06.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:05 smithi049 ceph-mon[31177]: pgmap v392: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 KiB/s wr, 30 op/s 2024-09-21T06:39:06.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:05 smithi098 ceph-mon[34704]: pgmap v392: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 KiB/s wr, 30 op/s 2024-09-21T06:39:08.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:07 smithi079 ceph-mon[34346]: pgmap v393: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 34 KiB/s wr, 26 op/s 2024-09-21T06:39:08.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:07 smithi049 ceph-mon[31177]: pgmap v393: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 34 KiB/s wr, 26 op/s 2024-09-21T06:39:08.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:07 smithi098 ceph-mon[34704]: pgmap v393: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 34 KiB/s wr, 26 op/s 2024-09-21T06:39:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:09 smithi079 ceph-mon[34346]: pgmap v394: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 41 KiB/s wr, 32 op/s 2024-09-21T06:39:10.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:09 smithi049 ceph-mon[31177]: pgmap v394: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 41 KiB/s wr, 32 op/s 2024-09-21T06:39:10.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:09 smithi098 ceph-mon[34704]: pgmap v394: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 41 KiB/s wr, 32 op/s 2024-09-21T06:39:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:11 smithi079 ceph-mon[34346]: pgmap v395: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 36 KiB/s wr, 26 op/s 2024-09-21T06:39:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:11 smithi049 ceph-mon[31177]: pgmap v395: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 36 KiB/s wr, 26 op/s 2024-09-21T06:39:12.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:11 smithi098 ceph-mon[34704]: pgmap v395: 97 pgs: 97 active+clean; 2.3 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 36 KiB/s wr, 26 op/s 2024-09-21T06:39:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:13 smithi079 ceph-mon[34346]: pgmap v396: 97 pgs: 97 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 KiB/s wr, 28 op/s 2024-09-21T06:39:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:13 smithi049 ceph-mon[31177]: pgmap v396: 97 pgs: 97 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 KiB/s wr, 28 op/s 2024-09-21T06:39:14.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:13 smithi098 ceph-mon[34704]: pgmap v396: 97 pgs: 97 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 KiB/s wr, 28 op/s 2024-09-21T06:39:16.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:15 smithi079 ceph-mon[34346]: pgmap v397: 97 pgs: 97 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 41 KiB/s wr, 29 op/s 2024-09-21T06:39:16.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:15 smithi049 ceph-mon[31177]: pgmap v397: 97 pgs: 97 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 41 KiB/s wr, 29 op/s 2024-09-21T06:39:16.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:15 smithi098 ceph-mon[34704]: pgmap v397: 97 pgs: 97 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 41 KiB/s wr, 29 op/s 2024-09-21T06:39:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 -- 172.21.15.49:0/2853977383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108300 msgr2=0x7ff780108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.678 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 --2- 172.21.15.49:0/2853977383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108300 0x7ff780108710 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff770009900 tx=0x7ff77002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:16.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 -- 172.21.15.49:0/2853977383 shutdown_connections 2024-09-21T06:39:16.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 --2- 172.21.15.49:0/2853977383 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff780108c50 0x7ff78010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.679 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 --2- 172.21.15.49:0/2853977383 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108300 0x7ff780108710 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 --2- 172.21.15.49:0/2853977383 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7801029d0 0x7ff780102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 -- 172.21.15.49:0/2853977383 >> 172.21.15.49:0/2853977383 conn(0x7ff78007a710 msgr2=0x7ff78007ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 -- 172.21.15.49:0/2853977383 shutdown_connections 2024-09-21T06:39:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 -- 172.21.15.49:0/2853977383 wait complete. 2024-09-21T06:39:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 Processor -- start 2024-09-21T06:39:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.676+0000 7ff787ded640 1 -- start start 2024-09-21T06:39:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff787ded640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7801029d0 0x7ff78019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff787ded640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff780108300 0x7ff78019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.680 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff787ded640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108c50 0x7ff78019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff787ded640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff780112910 con 0x7ff780108c50 2024-09-21T06:39:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff787ded640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff780112790 con 0x7ff7801029d0 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff787ded640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff780112a90 con 0x7ff780108300 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff78638a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108c50 0x7ff78019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff78638a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108c50 0x7ff78019fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44276/0 (socket says 172.21.15.49:44276) 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff78638a640 1 -- 172.21.15.49:0/1090582617 learned_addr learned my addr 172.21.15.49:0/1090582617 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff785b89640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7801029d0 0x7ff78019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff785388640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff780108300 0x7ff78019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff78638a640 1 -- 172.21.15.49:0/1090582617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff780108300 msgr2=0x7ff78019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff78638a640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff780108300 0x7ff78019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff78638a640 1 -- 172.21.15.49:0/1090582617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7801029d0 msgr2=0x7ff78019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff78638a640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7801029d0 0x7ff78019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.677+0000 7ff78638a640 1 -- 172.21.15.49:0/1090582617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7801a0350 con 0x7ff780108c50 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.678+0000 7ff78638a640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108c50 0x7ff78019fc50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff77800cad0 tx=0x7ff77800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.678+0000 7ff776ffd640 1 -- 172.21.15.49:0/1090582617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77800ae20 con 0x7ff780108c50 2024-09-21T06:39:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.678+0000 7ff787ded640 1 -- 172.21.15.49:0/1090582617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7801a0640 con 0x7ff780108c50 2024-09-21T06:39:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.678+0000 7ff776ffd640 1 -- 172.21.15.49:0/1090582617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff778005020 con 0x7ff780108c50 2024-09-21T06:39:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.678+0000 7ff776ffd640 1 -- 172.21.15.49:0/1090582617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77800f6b0 con 0x7ff780108c50 2024-09-21T06:39:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.678+0000 7ff787ded640 1 -- 172.21.15.49:0/1090582617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7801a6dd0 con 0x7ff780108c50 2024-09-21T06:39:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.681+0000 7ff78ee36740 1 Processor -- start 2024-09-21T06:39:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.681+0000 7ff776ffd640 1 -- 172.21.15.49:0/1090582617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ff7780051d0 con 0x7ff780108c50 2024-09-21T06:39:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.681+0000 7ff78ee36740 1 -- start start 2024-09-21T06:39:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.681+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7b71b0 0x5595dab5c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.681+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 0x5595dab5cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.681+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7964d0 0x5595dab5d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.681+0000 7ff78ee36740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5595daad16f0 con 0x5595da7964d0 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.681+0000 7ff78ee36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5595daac0b20 con 0x5595da78e2f0 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.681+0000 7ff78ee36740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5595daac4930 con 0x5595da7b71b0 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785388640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7964d0 0x5595dab5d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785388640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7964d0 0x5595dab5d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44292/0 (socket says 172.21.15.49:44292) 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785388640 1 -- 172.21.15.49:0/2331607303 learned_addr learned my addr 172.21.15.49:0/2331607303 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785b89640 1 --2- 172.21.15.49:0/2331607303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 0x5595dab5cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785388640 1 --2- 172.21.15.49:0/2331607303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7b71b0 0x5595dab5c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785b89640 1 -- 172.21.15.49:0/2331607303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7b71b0 msgr2=0x5595dab5c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785b89640 1 --2- 172.21.15.49:0/2331607303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7b71b0 0x5595dab5c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785b89640 1 -- 172.21.15.49:0/2331607303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7964d0 msgr2=0x5595dab5d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785b89640 1 --2- 172.21.15.49:0/2331607303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7964d0 0x5595dab5d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff776ffd640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff76c0b6680 0x7ff76c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785b89640 1 -- 172.21.15.49:0/2331607303 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595daa86530 con 0x5595da78e2f0 2024-09-21T06:39:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff78638a640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff76c0b6680 0x7ff76c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff785b89640 1 --2- 172.21.15.49:0/2331607303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 0x5595dab5cef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00bca0 tx=0x7ff77c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96bfb2712bbc0f7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.682+0000 7ff776ffd640 1 -- 172.21.15.49:0/1090582617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff7780e76a0 con 0x7ff780108c50 2024-09-21T06:39:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.683+0000 7ff76bfff640 1 -- 172.21.15.49:0/2331607303 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c01c480 con 0x5595da78e2f0 2024-09-21T06:39:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.683+0000 7ff76bfff640 1 -- 172.21.15.49:0/2331607303 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff77c01cad0 con 0x5595da78e2f0 2024-09-21T06:39:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.683+0000 7ff76bfff640 1 -- 172.21.15.49:0/2331607303 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77c011b50 con 0x5595da78e2f0 2024-09-21T06:39:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 -- 172.21.15.49:0/2331607303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 msgr2=0x5595dab5cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2331607303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 0x5595dab5cef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00bca0 tx=0x7ff77c0107a0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78638a640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff76c0b6680 0x7ff76c0b8b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff7780e4e80 tx=0x7ff77807a230 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 -- 172.21.15.49:0/2331607303 shutdown_connections 2024-09-21T06:39:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2331607303 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7964d0 0x5595dab5d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2331607303 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 0x5595dab5cef0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2331607303 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7b71b0 0x5595dab5c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 -- 172.21.15.49:0/2331607303 >> 172.21.15.49:0/2331607303 conn(0x5595da7ab300 msgr2=0x5595dab5a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 -- 172.21.15.49:0/2331607303 shutdown_connections 2024-09-21T06:39:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 -- 172.21.15.49:0/2331607303 wait complete. 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 -- start start 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.684+0000 7ff78ee36740 1 Processor -- start 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab68070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab685b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 0x5595dab74420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff78ee36740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5595da9f8ab0 con 0x5595da78e2f0 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff78ee36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5595daa66730 con 0x5595da7b71b0 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff78ee36740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5595dab6b130 con 0x5595da7964d0 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff78ee36740 10 client.0 _ll_register_callbacks cb 0x5595daaba6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab68070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab68070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44294/0 (socket says 172.21.15.49:44294) 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 -- 172.21.15.49:0/3345435971 learned_addr learned my addr 172.21.15.49:0/3345435971 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785b89640 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 0x5595dab74420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 -- 172.21.15.49:0/3345435971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 msgr2=0x5595dab685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab685b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 -- 172.21.15.49:0/3345435971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 msgr2=0x5595dab74420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 0x5595dab74420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 -- 172.21.15.49:0/3345435971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595da822790 con 0x5595da78e2f0 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff785388640 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab68070 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff77002a930 tx=0x7ff77002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10eb4e874d345cad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.685+0000 7ff7697fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff7697fa640 1 -- 172.21.15.49:0/3345435971 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770041020 con 0x5595da78e2f0 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff7697fa640 1 -- 172.21.15.49:0/3345435971 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff770004480 con 0x5595da78e2f0 2024-09-21T06:39:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff78ee36740 1 -- 172.21.15.49:0/3345435971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff77c01cad0 con 0x5595da78e2f0 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff7697fa640 1 -- 172.21.15.49:0/3345435971 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff770035030 con 0x5595da78e2f0 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff78ee36740 10 client.16134 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff78ee36740 1 -- 172.21.15.49:0/3345435971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5595da89b620 con 0x5595da78e2f0 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff7697fa640 1 -- 172.21.15.49:0/3345435971 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff77c01cad0 con 0x5595da78e2f0 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff7697fa640 1 -- 172.21.15.49:0/3345435971 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7ff770004c20 con 0x5595da78e2f0 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff78ee36740 10 client.16134 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff78ee36740 10 client.16134 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff78ee36740 20 client.16134 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff78ee36740 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595da775d80 0x5595dab7a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff78ee36740 4 client.16134 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.686+0000 7ff78ee36740 1 -- 172.21.15.49:0/3345435971 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595daad3640 con 0x5595da775d80 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.687+0000 7ff785b89640 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595da775d80 0x5595dab7a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.687+0000 7ff7697fa640 10 client.16134 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.687+0000 7ff785b89640 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595da775d80 0x5595dab7a120 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f7b0f13124bc545 server_cookie=fe8a815f74411b56 in_seq=0 out_seq=0 2024-09-21T06:39:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff7697fa640 1 -- 172.21.15.49:0/3345435971 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595daad3640 con 0x5595da775d80 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff7697fa640 10 client.16134 handle_command_reply: tid=0 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 client.16134 shutdown 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 -- 172.21.15.49:0/3345435971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 msgr2=0x5595dab68070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab68070 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff77002a930 tx=0x7ff77002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 -- 172.21.15.49:0/3345435971 shutdown_connections 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595da775d80 0x5595dab7a120 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 0x5595dab74420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 --2- 172.21.15.49:0/3345435971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab68070 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff7697fa640 0 client.16134 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 -- 172.21.15.49:0/3345435971 >> 172.21.15.49:0/3345435971 conn(0x5595da7ab300 msgr2=0x5595dab5d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 -- 172.21.15.49:0/3345435971 shutdown_connections 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 1 -- 172.21.15.49:0/3345435971 wait complete. 2024-09-21T06:39:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.688+0000 7ff78ee36740 20 client.16134 trim_cache size 0 max 16384 2024-09-21T06:39:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.703+0000 7ff78ee36740 1 Processor -- start 2024-09-21T06:39:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.703+0000 7ff78ee36740 1 -- start start 2024-09-21T06:39:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 0x5595dab5e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab69ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7b71b0 0x5595dab74320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff78ee36740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801b20a0 con 0x5595da7b71b0 2024-09-21T06:39:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff78ee36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801af970 con 0x5595da78e2f0 2024-09-21T06:39:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff78ee36740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801ad7e0 con 0x5595da7964d0 2024-09-21T06:39:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7b71b0 0x5595dab74320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7b71b0 0x5595dab74320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44300/0 (socket says 172.21.15.49:44300) 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 -- 172.21.15.49:0/893844983 learned_addr learned my addr 172.21.15.49:0/893844983 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 --2- 172.21.15.49:0/893844983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 0x5595dab5e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785b89640 1 --2- 172.21.15.49:0/893844983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab69ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 -- 172.21.15.49:0/893844983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 msgr2=0x5595dab69ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 --2- 172.21.15.49:0/893844983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab69ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 -- 172.21.15.49:0/893844983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 msgr2=0x5595dab5e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 --2- 172.21.15.49:0/893844983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 0x5595dab5e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 -- 172.21.15.49:0/893844983 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595dab5f250 con 0x5595da7b71b0 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff785388640 1 --2- 172.21.15.49:0/893844983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7b71b0 0x5595dab74320 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff770032cf0 tx=0x7ff770031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f11ffa5b13ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff76b7fe640 1 -- 172.21.15.49:0/893844983 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770041070 con 0x5595da7b71b0 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff76b7fe640 1 -- 172.21.15.49:0/893844983 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff770003c60 con 0x5595da7b71b0 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.704+0000 7ff76b7fe640 1 -- 172.21.15.49:0/893844983 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7700046c0 con 0x5595da7b71b0 2024-09-21T06:39:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.705+0000 7ff78ee36740 1 -- 172.21.15.49:0/893844983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7b71b0 msgr2=0x5595dab74320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.705+0000 7ff78ee36740 1 --2- 172.21.15.49:0/893844983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7b71b0 0x5595dab74320 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff770032cf0 tx=0x7ff770031400 comp rx=0 tx=0).stop 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.705+0000 7ff78ee36740 1 -- 172.21.15.49:0/893844983 shutdown_connections 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.705+0000 7ff78ee36740 1 --2- 172.21.15.49:0/893844983 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da7b71b0 0x5595dab74320 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.705+0000 7ff78ee36740 1 --2- 172.21.15.49:0/893844983 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab69ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.705+0000 7ff78ee36740 1 --2- 172.21.15.49:0/893844983 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da78e2f0 0x5595dab5e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.705+0000 7ff78ee36740 1 -- 172.21.15.49:0/893844983 >> 172.21.15.49:0/893844983 conn(0x5595da7ab300 msgr2=0x5595dab69590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.705+0000 7ff78ee36740 1 -- 172.21.15.49:0/893844983 shutdown_connections 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.705+0000 7ff78ee36740 1 -- 172.21.15.49:0/893844983 wait complete. 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff78ee36740 1 -- start start 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff78ee36740 1 Processor -- start 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab6da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab6dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff78ee36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 0x5595dabe2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff78ee36740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801ade30 con 0x5595da78e2f0 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff78ee36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801af2a0 con 0x5595da7b71b0 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff78ee36740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801ae500 con 0x5595da7964d0 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff78ee36740 10 client.0 _ll_register_callbacks cb 0x7ff770031980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff785388640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab6da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff785388640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab6da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44306/0 (socket says 172.21.15.49:44306) 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff785388640 1 -- 172.21.15.49:0/2300027879 learned_addr learned my addr 172.21.15.49:0/2300027879 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff785b89640 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab6dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.706+0000 7ff785388640 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 0x5595dabe2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff785388640 1 -- 172.21.15.49:0/2300027879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 msgr2=0x5595dab6dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff785388640 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab6dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff785388640 1 -- 172.21.15.49:0/2300027879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 msgr2=0x5595dabe2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff785388640 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 0x5595dabe2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff785388640 1 -- 172.21.15.49:0/2300027879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595dabe3070 con 0x5595da78e2f0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff785388640 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab6da70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff77002a930 tx=0x7ff770005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddf6a1735e287d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff7697fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff7697fa640 1 -- 172.21.15.49:0/2300027879 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770068060 con 0x5595da78e2f0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff7697fa640 1 -- 172.21.15.49:0/2300027879 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff7700053d0 con 0x5595da78e2f0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff78ee36740 1 -- 172.21.15.49:0/2300027879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff770003c60 con 0x5595da78e2f0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff7697fa640 1 -- 172.21.15.49:0/2300027879 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff77005e040 con 0x5595da78e2f0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff78ee36740 10 client.16140 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff78ee36740 1 -- 172.21.15.49:0/2300027879 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5595dabe42d0 con 0x5595da78e2f0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff7697fa640 1 -- 172.21.15.49:0/2300027879 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff770003c60 con 0x5595da78e2f0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.707+0000 7ff7697fa640 1 -- 172.21.15.49:0/2300027879 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7ff77003d5c0 con 0x5595da78e2f0 2024-09-21T06:39:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.708+0000 7ff78ee36740 10 client.16140 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.708+0000 7ff78ee36740 10 client.16140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.708+0000 7ff78ee36740 20 client.16140 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.708+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595da74b1c0 0x5595dabe6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.708+0000 7ff78ee36740 4 client.16140 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:39:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.708+0000 7ff78ee36740 1 -- 172.21.15.49:0/2300027879 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595daacf0f0 con 0x5595da74b1c0 2024-09-21T06:39:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.708+0000 7ff785b89640 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595da74b1c0 0x5595dabe6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.708+0000 7ff785b89640 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595da74b1c0 0x5595dabe6940 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2472d59fcc83074a server_cookie=b1dfad636064cce8 in_seq=0 out_seq=0 2024-09-21T06:39:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.708+0000 7ff7697fa640 10 client.16140 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.715+0000 7ff7697fa640 1 -- 172.21.15.49:0/2300027879 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595daacf0f0 con 0x5595da74b1c0 2024-09-21T06:39:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.715+0000 7ff7697fa640 10 client.16140 handle_command_reply: tid=0 2024-09-21T06:39:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.715+0000 7ff78ee36740 1 client.16140 shutdown 2024-09-21T06:39:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.715+0000 7ff78ee36740 1 -- 172.21.15.49:0/2300027879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 msgr2=0x5595dab6da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.715+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab6da70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff77002a930 tx=0x7ff770005850 comp rx=0 tx=0).stop 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff78ee36740 1 -- 172.21.15.49:0/2300027879 shutdown_connections 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595da74b1c0 0x5595dabe6940 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595da7b71b0 0x5595dabe2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595da7964d0 0x5595dab6dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff7697fa640 0 client.16140 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff78ee36740 1 --2- 172.21.15.49:0/2300027879 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595da78e2f0 0x5595dab6da70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff78ee36740 1 -- 172.21.15.49:0/2300027879 >> 172.21.15.49:0/2300027879 conn(0x5595da7ab300 msgr2=0x5595dab5e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff78ee36740 1 -- 172.21.15.49:0/2300027879 shutdown_connections 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff78ee36740 1 -- 172.21.15.49:0/2300027879 wait complete. 2024-09-21T06:39:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff78ee36740 20 client.16140 trim_cache size 0 max 16384 2024-09-21T06:39:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:39:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:39:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:39:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 -- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff76c0b6680 msgr2=0x7ff76c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff76c0b6680 0x7ff76c0b8b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff7780e4e80 tx=0x7ff77807a230 comp rx=0 tx=0).stop 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 -- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108c50 msgr2=0x7ff78019fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108c50 0x7ff78019fc50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff77800cad0 tx=0x7ff77800cf90 comp rx=0 tx=0).stop 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 -- 172.21.15.49:0/1090582617 shutdown_connections 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff76c0b6680 0x7ff76c0b8b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff780108c50 0x7ff78019fc50 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff780108300 0x7ff78019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 --2- 172.21.15.49:0/1090582617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7801029d0 0x7ff78019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 -- 172.21.15.49:0/1090582617 >> 172.21.15.49:0/1090582617 conn(0x7ff78007a710 msgr2=0x7ff78006bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 -- 172.21.15.49:0/1090582617 shutdown_connections 2024-09-21T06:39:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:16.716+0000 7ff787ded640 1 -- 172.21.15.49:0/1090582617 wait complete. 2024-09-21T06:39:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:17 smithi049 ceph-mon[31177]: pgmap v398: 97 pgs: 97 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-09-21T06:39:18.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:17 smithi098 ceph-mon[34704]: pgmap v398: 97 pgs: 97 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-09-21T06:39:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:17 smithi079 ceph-mon[34346]: pgmap v398: 97 pgs: 97 active+clean; 2.4 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-09-21T06:39:20.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:19 smithi049 ceph-mon[31177]: pgmap v399: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-21T06:39:20.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:19 smithi098 ceph-mon[34704]: pgmap v399: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-21T06:39:20.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:19 smithi079 ceph-mon[34346]: pgmap v399: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 16 op/s 2024-09-21T06:39:22.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:21 smithi049 ceph-mon[31177]: pgmap v400: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-09-21T06:39:22.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:21 smithi098 ceph-mon[34704]: pgmap v400: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-09-21T06:39:22.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:21 smithi079 ceph-mon[34346]: pgmap v400: 97 pgs: 97 active+clean; 2.4 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 KiB/s wr, 10 op/s 2024-09-21T06:39:24.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:23 smithi049 ceph-mon[31177]: pgmap v401: 97 pgs: 97 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:39:24.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:23 smithi098 ceph-mon[34704]: pgmap v401: 97 pgs: 97 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:39:24.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:23 smithi079 ceph-mon[34346]: pgmap v401: 97 pgs: 97 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:39:25.167 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:39:25.442 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 -- 172.21.15.49:0/2387874413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 msgr2=0x7ff0cc108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 --2- 172.21.15.49:0/2387874413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 0x7ff0cc108870 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009900 tx=0x7ff0c002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 -- 172.21.15.49:0/2387874413 shutdown_connections 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 --2- 172.21.15.49:0/2387874413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc108db0 0x7ff0cc10f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 --2- 172.21.15.49:0/2387874413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 0x7ff0cc108870 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 --2- 172.21.15.49:0/2387874413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc1031f0 0x7ff0cc103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 -- 172.21.15.49:0/2387874413 >> 172.21.15.49:0/2387874413 conn(0x7ff0cc079ec0 msgr2=0x7ff0cc07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 -- 172.21.15.49:0/2387874413 shutdown_connections 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 -- 172.21.15.49:0/2387874413 wait complete. 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.876+0000 7ff0d136b640 1 Processor -- start 2024-09-21T06:39:25.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0d136b640 1 -- start start 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0d136b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc1031f0 0x7ff0cc19a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0d136b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 0x7ff0cc19ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0d136b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc108db0 0x7ff0cc19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0d136b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc112a90 con 0x7ff0cc108460 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0d136b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc112910 con 0x7ff0cc108db0 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0d136b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc112c10 con 0x7ff0cc1031f0 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0ca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 0x7ff0cc19ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0ca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 0x7ff0cc19ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44320/0 (socket says 172.21.15.49:44320) 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/4143193621 learned_addr learned my addr 172.21.15.49:0/4143193621 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0cb7fe640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc108db0 0x7ff0cc19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0caffd640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc1031f0 0x7ff0cc19a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/4143193621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc1031f0 msgr2=0x7ff0cc19a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc1031f0 0x7ff0cc19a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/4143193621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc108db0 msgr2=0x7ff0cc19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.877+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc108db0 0x7ff0cc19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.878+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/4143193621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc1a04e0 con 0x7ff0cc108460 2024-09-21T06:39:25.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.878+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 0x7ff0cc19ab10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff0c002a930 tx=0x7ff0c0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.878+0000 7ff0b3fff640 1 -- 172.21.15.49:0/4143193621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c003f030 con 0x7ff0cc108460 2024-09-21T06:39:25.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.878+0000 7ff0d136b640 1 -- 172.21.15.49:0/4143193621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc1a0770 con 0x7ff0cc108460 2024-09-21T06:39:25.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.878+0000 7ff0b3fff640 1 -- 172.21.15.49:0/4143193621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0c0003aa0 con 0x7ff0cc108460 2024-09-21T06:39:25.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.878+0000 7ff0b3fff640 1 -- 172.21.15.49:0/4143193621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0035070 con 0x7ff0cc108460 2024-09-21T06:39:25.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.878+0000 7ff0d136b640 1 -- 172.21.15.49:0/4143193621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc1a6f30 con 0x7ff0cc108460 2024-09-21T06:39:25.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0d78df740 1 Processor -- start 2024-09-21T06:39:25.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0d78df740 1 -- start start 2024-09-21T06:39:25.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 0x556173cf1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561739211b0 0x556173cf1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556173929390 0x556173cf20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0d78df740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556173c67e50 con 0x5561739211b0 2024-09-21T06:39:25.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0d78df740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556173c57280 con 0x556173929390 2024-09-21T06:39:25.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0d78df740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556173c5b090 con 0x55617394a070 2024-09-21T06:39:25.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0caffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561739211b0 0x556173cf1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0caffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561739211b0 0x556173cf1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44322/0 (socket says 172.21.15.49:44322) 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0caffd640 1 -- 172.21.15.49:0/44277794 learned_addr learned my addr 172.21.15.49:0/44277794 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.881+0000 7ff0cb7fe640 1 --2- 172.21.15.49:0/44277794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 0x556173cf1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0caffd640 1 -- 172.21.15.49:0/44277794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 msgr2=0x556173cf1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0caffd640 1 --2- 172.21.15.49:0/44277794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 0x556173cf1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0caffd640 1 -- 172.21.15.49:0/44277794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556173929390 msgr2=0x556173cf20d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0caffd640 1 --2- 172.21.15.49:0/44277794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556173929390 0x556173cf20d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0caffd640 1 -- 172.21.15.49:0/44277794 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561739b5650 con 0x5561739211b0 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0b3fff640 1 -- 172.21.15.49:0/4143193621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ff0c0042030 con 0x7ff0cc108460 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0caffd640 1 --2- 172.21.15.49:0/44277794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561739211b0 0x556173cf1b90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009a70 tx=0x7ff0bc009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfbec7e0cd716009 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0b17fa640 1 -- 172.21.15.49:0/44277794 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc017070 con 0x5561739211b0 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0b17fa640 1 -- 172.21.15.49:0/44277794 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0bc013470 con 0x5561739211b0 2024-09-21T06:39:25.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.882+0000 7ff0b17fa640 1 -- 172.21.15.49:0/44277794 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc012610 con 0x5561739211b0 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0b3fff640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff0b40b6680 0x7ff0b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0cb7fe640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff0b40b6680 0x7ff0b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0b3fff640 1 -- 172.21.15.49:0/4143193621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff0c0107d90 con 0x7ff0cc108460 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0d78df740 1 -- 172.21.15.49:0/44277794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561739211b0 msgr2=0x556173cf1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0d78df740 1 --2- 172.21.15.49:0/44277794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561739211b0 0x556173cf1b90 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009a70 tx=0x7ff0bc009f30 comp rx=0 tx=0).stop 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0d78df740 1 -- 172.21.15.49:0/44277794 shutdown_connections 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0d78df740 1 --2- 172.21.15.49:0/44277794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556173929390 0x556173cf20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0d78df740 1 --2- 172.21.15.49:0/44277794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5561739211b0 0x556173cf1b90 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0d78df740 1 --2- 172.21.15.49:0/44277794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 0x556173cf1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0d78df740 1 -- 172.21.15.49:0/44277794 >> 172.21.15.49:0/44277794 conn(0x55617393e460 msgr2=0x556173cef540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0d78df740 1 -- 172.21.15.49:0/44277794 shutdown_connections 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.883+0000 7ff0d78df740 1 -- 172.21.15.49:0/44277794 wait complete. 2024-09-21T06:39:25.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0cb7fe640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff0b40b6680 0x7ff0b40b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4005fd0 tx=0x7ff0c4009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0d78df740 1 -- start start 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0d78df740 1 Processor -- start 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561739211b0 0x556173d01a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173d01ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55617394a070 0x556173d07010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0d78df740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556173ab8700 con 0x556173929390 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0d78df740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556173bf2110 con 0x55617394a070 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0d78df740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556173cffe30 con 0x5561739211b0 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0d78df740 10 client.0 _ll_register_callbacks cb 0x556173c0b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.884+0000 7ff0ca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173d01ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0ca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173d01ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44336/0 (socket says 172.21.15.49:44336) 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/526996982 learned_addr learned my addr 172.21.15.49:0/526996982 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0caffd640 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561739211b0 0x556173d01a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0cb7fe640 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55617394a070 0x556173d07010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/526996982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561739211b0 msgr2=0x556173d01a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561739211b0 0x556173d01a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/526996982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55617394a070 msgr2=0x556173d07010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55617394a070 0x556173d07010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/526996982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556173c1fc40 con 0x556173929390 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173d01ff0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0105520 tx=0x7ff0c00c9a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee70212ccd6764b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0aeff5640 1 -- 172.21.15.49:0/526996982 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0049070 con 0x556173929390 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0aeff5640 1 -- 172.21.15.49:0/526996982 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff0c00f10e0 con 0x556173929390 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.885+0000 7ff0d78df740 1 -- 172.21.15.49:0/526996982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0bc013470 con 0x556173929390 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0aeff5640 1 -- 172.21.15.49:0/526996982 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff0c00cd510 con 0x556173929390 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0d78df740 10 client.16152 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0d78df740 1 -- 172.21.15.49:0/526996982 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556173d0ff60 con 0x556173929390 2024-09-21T06:39:25.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0aeff5640 1 -- 172.21.15.49:0/526996982 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0bc013470 con 0x556173929390 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0aeff5640 1 -- 172.21.15.49:0/526996982 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7ff0c00efbd0 con 0x556173929390 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0d78df740 10 client.16152 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0d78df740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0d78df740 20 client.16152 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0d78df740 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5561739089f0 0x556173d13450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0d78df740 4 client.16152 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.886+0000 7ff0d78df740 1 -- 172.21.15.49:0/526996982 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556173c69da0 con 0x5561739089f0 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.887+0000 7ff0caffd640 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5561739089f0 0x556173d13450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.887+0000 7ff0aeff5640 10 client.16152 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:25.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.887+0000 7ff0caffd640 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5561739089f0 0x556173d13450 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1fbc9f58b246958 server_cookie=9a7f06c1292f6274 in_seq=0 out_seq=0 2024-09-21T06:39:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0aeff5640 1 -- 172.21.15.49:0/526996982 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556173c69da0 con 0x5561739089f0 2024-09-21T06:39:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0aeff5640 10 client.16152 handle_command_reply: tid=0 2024-09-21T06:39:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 client.16152 shutdown 2024-09-21T06:39:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 -- 172.21.15.49:0/526996982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 msgr2=0x556173d01ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173d01ff0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0105520 tx=0x7ff0c00c9a60 comp rx=0 tx=0).stop 2024-09-21T06:39:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 -- 172.21.15.49:0/526996982 shutdown_connections 2024-09-21T06:39:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5561739089f0 0x556173d13450 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55617394a070 0x556173d07010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173d01ff0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0aeff5640 0 client.16152 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 --2- 172.21.15.49:0/526996982 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5561739211b0 0x556173d01a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 -- 172.21.15.49:0/526996982 >> 172.21.15.49:0/526996982 conn(0x55617393e460 msgr2=0x556173cf47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 -- 172.21.15.49:0/526996982 shutdown_connections 2024-09-21T06:39:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 1 -- 172.21.15.49:0/526996982 wait complete. 2024-09-21T06:39:25.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.888+0000 7ff0d78df740 20 client.16152 trim_cache size 0 max 16384 2024-09-21T06:39:25.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.906+0000 7ff0d78df740 1 Processor -- start 2024-09-21T06:39:25.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.906+0000 7ff0d78df740 1 -- start start 2024-09-21T06:39:25.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.906+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 0x556173d00780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.906+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173cfc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.906+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 0x556173cfe340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.906+0000 7ff0d78df740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1aff30 con 0x556173929390 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.906+0000 7ff0d78df740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1ad800 con 0x5561739211b0 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.906+0000 7ff0d78df740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1ab670 con 0x55617394a070 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0ca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173cfc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0ca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173cfc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44352/0 (socket says 172.21.15.49:44352) 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/3343741433 learned_addr learned my addr 172.21.15.49:0/3343741433 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0cb7fe640 1 --2- 172.21.15.49:0/3343741433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 0x556173cfe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0caffd640 1 --2- 172.21.15.49:0/3343741433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 0x556173d00780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/3343741433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 msgr2=0x556173cfe340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/3343741433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 0x556173cfe340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/3343741433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 msgr2=0x556173d00780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/3343741433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 0x556173d00780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0ca7fc640 1 -- 172.21.15.49:0/3343741433 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556173cfc9e0 con 0x556173929390 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/3343741433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173cfc300 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0105ac0 tx=0x7ff0c00b5170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5433c83ed675135 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0b0ff9640 1 -- 172.21.15.49:0/3343741433 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0049070 con 0x556173929390 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0b0ff9640 1 -- 172.21.15.49:0/3343741433 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0c003b460 con 0x556173929390 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.907+0000 7ff0b0ff9640 1 -- 172.21.15.49:0/3343741433 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00cd330 con 0x556173929390 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.908+0000 7ff0d78df740 1 -- 172.21.15.49:0/3343741433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 msgr2=0x556173cfc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.908+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3343741433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173cfc300 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0105ac0 tx=0x7ff0c00b5170 comp rx=0 tx=0).stop 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.908+0000 7ff0d78df740 1 -- 172.21.15.49:0/3343741433 shutdown_connections 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.908+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3343741433 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55617394a070 0x556173cfe340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.908+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3343741433 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556173929390 0x556173cfc300 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.908+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3343741433 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 0x556173d00780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.908+0000 7ff0d78df740 1 -- 172.21.15.49:0/3343741433 >> 172.21.15.49:0/3343741433 conn(0x55617393e460 msgr2=0x556173d00070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.908+0000 7ff0d78df740 1 -- 172.21.15.49:0/3343741433 shutdown_connections 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.909+0000 7ff0d78df740 1 -- 172.21.15.49:0/3343741433 wait complete. 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.909+0000 7ff0d78df740 1 -- start start 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.909+0000 7ff0d78df740 1 Processor -- start 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.909+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 0x556173d097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.909+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556173929390 0x556173d09d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.909+0000 7ff0d78df740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55617394a070 0x556173d7cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0d78df740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1abcc0 con 0x55617394a070 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0d78df740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1ad130 con 0x5561739211b0 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0d78df740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc1ac390 con 0x556173929390 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0d78df740 10 client.0 _ll_register_callbacks cb 0x7ff0c0003e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55617394a070 0x556173d7cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55617394a070 0x556173d7cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44358/0 (socket says 172.21.15.49:44358) 2024-09-21T06:39:25.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0cb7fe640 1 -- 172.21.15.49:0/3284812162 learned_addr learned my addr 172.21.15.49:0/3284812162 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0caffd640 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 0x556173d097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556173929390 0x556173d09d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0caffd640 1 -- 172.21.15.49:0/3284812162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556173929390 msgr2=0x556173d09d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0caffd640 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556173929390 0x556173d09d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0caffd640 1 -- 172.21.15.49:0/3284812162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55617394a070 msgr2=0x556173d7cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0caffd640 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55617394a070 0x556173d7cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0caffd640 1 -- 172.21.15.49:0/3284812162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556173d7d310 con 0x5561739211b0 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0cb7fe640 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55617394a070 0x556173d7cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0caffd640 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 0x556173d097c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc013b70 tx=0x7ff0bc013e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d66774beeabc65f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.910+0000 7ff0aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:39:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0aeff5640 1 -- 172.21.15.49:0/3284812162 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc017040 con 0x5561739211b0 2024-09-21T06:39:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0aeff5640 1 -- 172.21.15.49:0/3284812162 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff0bc005bc0 con 0x5561739211b0 2024-09-21T06:39:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0d78df740 1 -- 172.21.15.49:0/3284812162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556173c65850 con 0x5561739211b0 2024-09-21T06:39:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0aeff5640 1 -- 172.21.15.49:0/3284812162 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff0bc00ee10 con 0x5561739211b0 2024-09-21T06:39:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0d78df740 10 client.25739 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0d78df740 1 -- 172.21.15.49:0/3284812162 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556173d7e450 con 0x5561739211b0 2024-09-21T06:39:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0aeff5640 1 -- 172.21.15.49:0/3284812162 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556173c65850 con 0x5561739211b0 2024-09-21T06:39:25.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0aeff5640 1 -- 172.21.15.49:0/3284812162 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7ff0bc0062b0 con 0x5561739211b0 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0d78df740 10 client.25739 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0d78df740 10 client.25739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0d78df740 20 client.25739 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.911+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5561738ddda0 0x556173d809b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.912+0000 7ff0d78df740 4 client.25739 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.912+0000 7ff0d78df740 1 -- 172.21.15.49:0/3284812162 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556173c62c80 con 0x5561738ddda0 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.912+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5561738ddda0 0x556173d809b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.912+0000 7ff0aeff5640 10 client.25739 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.912+0000 7ff0ca7fc640 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5561738ddda0 0x556173d809b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85219e5eafc78ac server_cookie=39c9104c97769a2f in_seq=0 out_seq=0 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.912+0000 7ff0aeff5640 1 -- 172.21.15.49:0/3284812162 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x556173c62c80 con 0x5561738ddda0 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.912+0000 7ff0aeff5640 10 client.25739 handle_command_reply: tid=0 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.912+0000 7ff0d78df740 1 client.25739 shutdown 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 -- 172.21.15.49:0/3284812162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 msgr2=0x556173d097c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 0x556173d097c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc013b70 tx=0x7ff0bc013e10 comp rx=0 tx=0).stop 2024-09-21T06:39:25.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 -- 172.21.15.49:0/3284812162 shutdown_connections 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5561738ddda0 0x556173d809b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55617394a070 0x556173d7cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0aeff5640 0 client.25739 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556173929390 0x556173d09d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 --2- 172.21.15.49:0/3284812162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5561739211b0 0x556173d097c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 -- 172.21.15.49:0/3284812162 >> 172.21.15.49:0/3284812162 conn(0x55617393e460 msgr2=0x556173d05de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 -- 172.21.15.49:0/3284812162 shutdown_connections 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 1 -- 172.21.15.49:0/3284812162 wait complete. 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d78df740 20 client.25739 trim_cache size 0 max 16384 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:39:25.918 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:25.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:25.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:39:25.921 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:39:25.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d136b640 1 -- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff0b40b6680 msgr2=0x7ff0b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d136b640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff0b40b6680 0x7ff0b40b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4005fd0 tx=0x7ff0c4009600 comp rx=0 tx=0).stop 2024-09-21T06:39:25.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d136b640 1 -- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 msgr2=0x7ff0cc19ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d136b640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 0x7ff0cc19ab10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7ff0c002a930 tx=0x7ff0c0004270 comp rx=0 tx=0).stop 2024-09-21T06:39:25.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d136b640 1 -- 172.21.15.49:0/4143193621 shutdown_connections 2024-09-21T06:39:25.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.913+0000 7ff0d136b640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff0b40b6680 0x7ff0b40b8b90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.914+0000 7ff0d136b640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff0cc108db0 0x7ff0cc19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.914+0000 7ff0d136b640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff0cc108460 0x7ff0cc19ab10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.914+0000 7ff0d136b640 1 --2- 172.21.15.49:0/4143193621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff0cc1031f0 0x7ff0cc19a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.914+0000 7ff0d136b640 1 -- 172.21.15.49:0/4143193621 >> 172.21.15.49:0/4143193621 conn(0x7ff0cc079ec0 msgr2=0x7ff0cc101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.914+0000 7ff0d136b640 1 -- 172.21.15.49:0/4143193621 shutdown_connections 2024-09-21T06:39:25.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:25.914+0000 7ff0d136b640 1 -- 172.21.15.49:0/4143193621 wait complete. 2024-09-21T06:39:26.098 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:25 smithi098 ceph-mon[34704]: pgmap v402: 97 pgs: 97 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:39:26.112 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:25 smithi049 ceph-mon[31177]: pgmap v402: 97 pgs: 97 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:39:26.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:25 smithi079 ceph-mon[34346]: pgmap v402: 97 pgs: 97 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:39:26.739 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:39:26.739 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:39:27.003 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 -- 172.21.15.49:0/1195767270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c1048e0 msgr2=0x7f215c104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 --2- 172.21.15.49:0/1195767270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c1048e0 0x7f215c104cf0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f2144009900 tx=0x7f214402a410 comp rx=0 tx=0).stop 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 -- 172.21.15.49:0/1195767270 shutdown_connections 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 --2- 172.21.15.49:0/1195767270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f215c105230 0x7f215c10eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 --2- 172.21.15.49:0/1195767270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c1048e0 0x7f215c104cf0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 --2- 172.21.15.49:0/1195767270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215c102430 0x7f215c102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 -- 172.21.15.49:0/1195767270 >> 172.21.15.49:0/1195767270 conn(0x7f215c077800 msgr2=0x7f215c077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 -- 172.21.15.49:0/1195767270 shutdown_connections 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 -- 172.21.15.49:0/1195767270 wait complete. 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 Processor -- start 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.490+0000 7f2162981640 1 -- start start 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2162981640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f215c102430 0x7f215c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2162981640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215c1048e0 0x7f215c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2162981640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c105230 0x7f215c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2162981640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f215c113aa0 con 0x7f215c105230 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2162981640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f215c113920 con 0x7f215c1048e0 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2162981640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f215c113c20 con 0x7f215c102430 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2160f1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c105230 0x7f215c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2160f1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c105230 0x7f215c19fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57898/0 (socket says 172.21.15.49:57898) 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2160f1e640 1 -- 172.21.15.49:0/2258743332 learned_addr learned my addr 172.21.15.49:0/2258743332 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:27.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2153fff640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215c1048e0 0x7f215c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f215bfff640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f215c102430 0x7f215c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2160f1e640 1 -- 172.21.15.49:0/2258743332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f215c102430 msgr2=0x7f215c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2160f1e640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f215c102430 0x7f215c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2160f1e640 1 -- 172.21.15.49:0/2258743332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215c1048e0 msgr2=0x7f215c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2160f1e640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215c1048e0 0x7f215c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2160f1e640 1 -- 172.21.15.49:0/2258743332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c1a03e0 con 0x7f215c105230 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.491+0000 7f2160f1e640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c105230 0x7f215c19fcb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f215400eaa0 tx=0x7f215400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.492+0000 7f2159ffb640 1 -- 172.21.15.49:0/2258743332 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215400cdb0 con 0x7f215c105230 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.492+0000 7f2159ffb640 1 -- 172.21.15.49:0/2258743332 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2154005020 con 0x7f215c105230 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.492+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c1a06d0 con 0x7f215c105230 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.492+0000 7f2159ffb640 1 -- 172.21.15.49:0/2258743332 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21540116d0 con 0x7f215c105230 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.492+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c1a6e30 con 0x7f215c105230 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.493+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c102840 con 0x7f215c105230 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.494+0000 7f2159ffb640 1 -- 172.21.15.49:0/2258743332 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f21540051d0 con 0x7f215c105230 2024-09-21T06:39:27.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.495+0000 7f2159ffb640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21480b6680 0x7f21480b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.495+0000 7f215bfff640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21480b6680 0x7f21480b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.495+0000 7f2159ffb640 1 -- 172.21.15.49:0/2258743332 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f21540e7d10 con 0x7f215c105230 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.496+0000 7f215bfff640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21480b6680 0x7f21480b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f214c005fd0 tx=0x7f214c005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:27.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.498+0000 7f2159ffb640 1 -- 172.21.15.49:0/2258743332 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2154016030 con 0x7f215c105230 2024-09-21T06:39:27.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.724+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f215c19b5a0 con 0x7f215c105230 2024-09-21T06:39:27.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.725+0000 7f2159ffb640 1 -- 172.21.15.49:0/2258743332 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11894 (secure 0 0 0) 0x7f215c19b5a0 con 0x7f215c105230 2024-09-21T06:39:27.727 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:39:27.727 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":26,"btime":"2024-09-21T06:37:49:249607+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:37:48.552776+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:39:27.727 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 26 2024-09-21T06:39:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21480b6680 msgr2=0x7f21480b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21480b6680 0x7f21480b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f214c005fd0 tx=0x7f214c005850 comp rx=0 tx=0).stop 2024-09-21T06:39:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c105230 msgr2=0x7f215c19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c105230 0x7f215c19fcb0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f215400eaa0 tx=0x7f215400ef60 comp rx=0 tx=0).stop 2024-09-21T06:39:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 shutdown_connections 2024-09-21T06:39:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21480b6680 0x7f21480b8b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f215c105230 0x7f215c19fcb0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f215c1048e0 0x7f215c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 --2- 172.21.15.49:0/2258743332 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f215c102430 0x7f215c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 >> 172.21.15.49:0/2258743332 conn(0x7f215c077800 msgr2=0x7f215c105bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:27.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 shutdown_connections 2024-09-21T06:39:27.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:27.727+0000 7f2162981640 1 -- 172.21.15.49:0/2258743332 wait complete. 2024-09-21T06:39:28.042 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:27 smithi049 ceph-mon[31177]: pgmap v403: 97 pgs: 97 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:39:28.043 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:27 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2258743332' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:28.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:27 smithi098 ceph-mon[34704]: pgmap v403: 97 pgs: 97 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:39:28.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:27 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2258743332' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:28.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:27 smithi079 ceph-mon[34346]: pgmap v403: 97 pgs: 97 active+clean; 2.5 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:39:28.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:27 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2258743332' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:28.468 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:39:28.730 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:29.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.197+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/2957949189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8109df0 msgr2=0x7fb3b8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.197+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/2957949189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8109df0 0x7fb3b8110620 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009900 tx=0x7fb3b002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:29.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.197+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/2957949189 shutdown_connections 2024-09-21T06:39:29.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.197+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/2957949189 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b8109df0 0x7fb3b8110620 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.197+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/2957949189 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b81094a0 0x7fb3b81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.197+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/2957949189 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3b8103b60 0x7fb3b8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.198+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/2957949189 >> 172.21.15.49:0/2957949189 conn(0x7fb3b807b850 msgr2=0x7fb3b807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.198+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/2957949189 shutdown_connections 2024-09-21T06:39:29.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.198+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/2957949189 wait complete. 2024-09-21T06:39:29.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.198+0000 7fb3bd1d1640 1 Processor -- start 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3bd1d1640 1 -- start start 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3bd1d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3b8103b60 0x7fb3b819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3bd1d1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b81094a0 0x7fb3b819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3bd1d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b8109df0 0x7fb3b819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3bd1d1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b8113ab0 con 0x7fb3b81094a0 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3bd1d1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b8113930 con 0x7fb3b8103b60 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3bd1d1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b8113c30 con 0x7fb3b8109df0 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b81094a0 0x7fb3b819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b81094a0 0x7fb3b819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57912/0 (socket says 172.21.15.49:57912) 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b659c640 1 -- 172.21.15.49:0/3177570557 learned_addr learned my addr 172.21.15.49:0/3177570557 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b6d9d640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3b8103b60 0x7fb3b819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b759e640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b8109df0 0x7fb3b819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b659c640 1 -- 172.21.15.49:0/3177570557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b8109df0 msgr2=0x7fb3b819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b659c640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b8109df0 0x7fb3b819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b659c640 1 -- 172.21.15.49:0/3177570557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3b8103b60 msgr2=0x7fb3b819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b659c640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3b8103b60 0x7fb3b819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.199+0000 7fb3b659c640 1 -- 172.21.15.49:0/3177570557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b81a03b0 con 0x7fb3b81094a0 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.200+0000 7fb3b659c640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b81094a0 0x7fb3b819a9e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000d740 tx=0x7fb3a000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.200+0000 7fb3affff640 1 -- 172.21.15.49:0/3177570557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0017070 con 0x7fb3b81094a0 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.200+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/3177570557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b81a06a0 con 0x7fb3b81094a0 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.200+0000 7fb3affff640 1 -- 172.21.15.49:0/3177570557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3a000de50 con 0x7fb3b81094a0 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.200+0000 7fb3affff640 1 -- 172.21.15.49:0/3177570557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a000f620 con 0x7fb3b81094a0 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.200+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/3177570557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b81a6e00 con 0x7fb3b81094a0 2024-09-21T06:39:29.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.202+0000 7fb3affff640 1 -- 172.21.15.49:0/3177570557 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fb3a001a070 con 0x7fb3b81094a0 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3c3745740 1 Processor -- start 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3c3745740 1 -- start start 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec33b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 0x55efec33b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec33bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3c3745740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55efec2b1ea0 con 0x55efebf73390 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3c3745740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55efec2a12d0 con 0x55efebf6b1b0 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3c3745740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55efec2a50e0 con 0x55efebf94070 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3b659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec33bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3b659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec33bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57916/0 (socket says 172.21.15.49:57916) 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3b659c640 1 -- 172.21.15.49:0/1595627085 learned_addr learned my addr 172.21.15.49:0/1595627085 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.203+0000 7fb3b6d9d640 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 0x55efec33b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3b759e640 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec33b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3b659c640 1 -- 172.21.15.49:0/1595627085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 msgr2=0x55efec33b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3b659c640 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec33b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3b659c640 1 -- 172.21.15.49:0/1595627085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 msgr2=0x55efec33b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3b659c640 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 0x55efec33b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3b659c640 1 -- 172.21.15.49:0/1595627085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efebfff650 con 0x55efebf73390 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3b759e640 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec33b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3affff640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb3a40b6680 0x7fb3a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3b759e640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb3a40b6680 0x7fb3a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3b659c640 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec33bd40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00e4800 tx=0x7fb3a00ef850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5297d1358ff23548 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3affff640 1 -- 172.21.15.49:0/3177570557 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb3a00e7160 con 0x7fb3b81094a0 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3ad7fa640 1 -- 172.21.15.49:0/1595627085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0021020 con 0x55efebf73390 2024-09-21T06:39:29.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3ad7fa640 1 -- 172.21.15.49:0/1595627085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3a00acb10 con 0x55efebf73390 2024-09-21T06:39:29.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.204+0000 7fb3ad7fa640 1 -- 172.21.15.49:0/1595627085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00acdd0 con 0x55efebf73390 2024-09-21T06:39:29.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.205+0000 7fb3c3745740 1 -- 172.21.15.49:0/1595627085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 msgr2=0x55efec33bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.205+0000 7fb3b759e640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb3a40b6680 0x7fb3a40b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0005940 tx=0x7fb3b00058b0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.205+0000 7fb3c3745740 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec33bd40 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb3a00e4800 tx=0x7fb3a00ef850 comp rx=0 tx=0).stop 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.205+0000 7fb3c3745740 1 -- 172.21.15.49:0/1595627085 shutdown_connections 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.205+0000 7fb3c3745740 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec33bd40 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.205+0000 7fb3c3745740 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 0x55efec33b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.205+0000 7fb3c3745740 1 --2- 172.21.15.49:0/1595627085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec33b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.205+0000 7fb3c3745740 1 -- 172.21.15.49:0/1595627085 >> 172.21.15.49:0/1595627085 conn(0x55efebf88460 msgr2=0x55efec3391b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 -- 172.21.15.49:0/1595627085 shutdown_connections 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 -- 172.21.15.49:0/1595627085 wait complete. 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 -- start start 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 Processor -- start 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf6b1b0 0x55efec34ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 0x55efec34b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec34b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55efec102700 con 0x55efebf6b1b0 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55efec23c160 con 0x55efebf73390 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55efec34de00 con 0x55efebf94070 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.206+0000 7fb3c3745740 10 client.0 _ll_register_callbacks cb 0x55efec2559e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf6b1b0 0x55efec34ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b6d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf6b1b0 0x55efec34ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57918/0 (socket says 172.21.15.49:57918) 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b6d9d640 1 -- 172.21.15.49:0/2526814317 learned_addr learned my addr 172.21.15.49:0/2526814317 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b659c640 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 0x55efec34b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b759e640 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec34b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b6d9d640 1 -- 172.21.15.49:0/2526814317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 msgr2=0x55efec34b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b6d9d640 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec34b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b6d9d640 1 -- 172.21.15.49:0/2526814317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 msgr2=0x55efec34b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b6d9d640 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 0x55efec34b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b6d9d640 1 -- 172.21.15.49:0/2526814317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efec269c90 con 0x55efebf6b1b0 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3b6d9d640 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf6b1b0 0x55efec34ad20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8011d10 tx=0x7fb3a800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92adc357516d9af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb39e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2526814317 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a801f060 con 0x55efebf6b1b0 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2526814317 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb3a8017050 con 0x55efebf6b1b0 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.207+0000 7fb3c3745740 1 -- 172.21.15.49:0/2526814317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3a00acb10 con 0x55efebf6b1b0 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2526814317 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3a8023430 con 0x55efebf6b1b0 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb3c3745740 10 client.16176 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:29.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb3c3745740 1 -- 172.21.15.49:0/2526814317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55efec359b50 con 0x55efebf6b1b0 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2526814317 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3a00acb10 con 0x55efebf6b1b0 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2526814317 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fb3a8019030 con 0x55efebf6b1b0 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb3c3745740 10 client.16176 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb3c3745740 10 client.16176 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb3c3745740 20 client.16176 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55efebf529f0 0x55efec35d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb3c3745740 4 client.16176 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb3c3745740 1 -- 172.21.15.49:0/2526814317 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efec2b3df0 con 0x55efebf529f0 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.208+0000 7fb3b659c640 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55efebf529f0 0x55efec35d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.209+0000 7fb39e7fc640 10 client.16176 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:39:29.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.209+0000 7fb3b659c640 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55efebf529f0 0x55efec35d130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da275862b19da5e1 server_cookie=87868d90875833d4 in_seq=0 out_seq=0 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2526814317 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55efec2b3df0 con 0x55efebf529f0 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb39e7fc640 10 client.16176 handle_command_reply: tid=0 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 client.16176 shutdown 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 -- 172.21.15.49:0/2526814317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf6b1b0 msgr2=0x55efec34ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf6b1b0 0x55efec34ad20 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8011d10 tx=0x7fb3a800f790 comp rx=0 tx=0).stop 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 -- 172.21.15.49:0/2526814317 shutdown_connections 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55efebf529f0 0x55efec35d130 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec34b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 0x55efec34b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2526814317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf6b1b0 0x55efec34ad20 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 -- 172.21.15.49:0/2526814317 >> 172.21.15.49:0/2526814317 conn(0x55efebf88460 msgr2=0x55efec33ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb39e7fc640 0 client.16176 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:39:29.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 -- 172.21.15.49:0/2526814317 shutdown_connections 2024-09-21T06:39:29.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 1 -- 172.21.15.49:0/2526814317 wait complete. 2024-09-21T06:39:29.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.210+0000 7fb3c3745740 20 client.16176 trim_cache size 0 max 16384 2024-09-21T06:39:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.223+0000 7fb3c3745740 1 Processor -- start 2024-09-21T06:39:29.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.223+0000 7fb3c3745740 1 -- start start 2024-09-21T06:39:29.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf6b1b0 0x55efec34b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 0x55efec348120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf94070 0x55efec348660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3c3745740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81aff30 con 0x55efebf94070 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3c3745740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81ad800 con 0x55efebf73390 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3c3745740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81ab670 con 0x55efebf6b1b0 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf94070 0x55efec348660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf94070 0x55efec348660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57924/0 (socket says 172.21.15.49:57924) 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b759e640 1 -- 172.21.15.49:0/1792226660 learned_addr learned my addr 172.21.15.49:0/1792226660 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b659c640 1 --2- 172.21.15.49:0/1792226660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 0x55efec348120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b6d9d640 1 --2- 172.21.15.49:0/1792226660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf6b1b0 0x55efec34b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b759e640 1 -- 172.21.15.49:0/1792226660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf6b1b0 msgr2=0x55efec34b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b759e640 1 --2- 172.21.15.49:0/1792226660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf6b1b0 0x55efec34b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b759e640 1 -- 172.21.15.49:0/1792226660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 msgr2=0x55efec348120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b759e640 1 --2- 172.21.15.49:0/1792226660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 0x55efec348120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b759e640 1 -- 172.21.15.49:0/1792226660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efec33c100 con 0x55efebf94070 2024-09-21T06:39:29.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.224+0000 7fb3b759e640 1 --2- 172.21.15.49:0/1792226660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf94070 0x55efec348660 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009900 tx=0x7fb3b003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243e675668eb8955 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.225+0000 7fb3acff9640 1 -- 172.21.15.49:0/1792226660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b004c070 con 0x55efebf94070 2024-09-21T06:39:29.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.225+0000 7fb3acff9640 1 -- 172.21.15.49:0/1792226660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3b0004240 con 0x55efebf94070 2024-09-21T06:39:29.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.225+0000 7fb3acff9640 1 -- 172.21.15.49:0/1792226660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0035050 con 0x55efebf94070 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.225+0000 7fb3c3745740 1 -- 172.21.15.49:0/1792226660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf94070 msgr2=0x55efec348660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.225+0000 7fb3c3745740 1 --2- 172.21.15.49:0/1792226660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf94070 0x55efec348660 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009900 tx=0x7fb3b003d000 comp rx=0 tx=0).stop 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 -- 172.21.15.49:0/1792226660 shutdown_connections 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 --2- 172.21.15.49:0/1792226660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf94070 0x55efec348660 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 --2- 172.21.15.49:0/1792226660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf73390 0x55efec348120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 --2- 172.21.15.49:0/1792226660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf6b1b0 0x55efec34b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 -- 172.21.15.49:0/1792226660 >> 172.21.15.49:0/1792226660 conn(0x55efebf88460 msgr2=0x55efec34aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 -- 172.21.15.49:0/1792226660 shutdown_connections 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 -- 172.21.15.49:0/1792226660 wait complete. 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 -- start start 2024-09-21T06:39:29.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 Processor -- start 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 0x55efec353800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec34fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec350250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81abcc0 con 0x55efebf73390 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81ad130 con 0x55efebf6b1b0 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.226+0000 7fb3c3745740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b81ac390 con 0x55efebf94070 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3c3745740 10 client.0 _ll_register_callbacks cb 0x7fb3a8009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec34fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec34fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57936/0 (socket says 172.21.15.49:57936) 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b659c640 1 -- 172.21.15.49:0/2834195348 learned_addr learned my addr 172.21.15.49:0/2834195348 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b6d9d640 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 0x55efec353800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b759e640 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec350250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b659c640 1 -- 172.21.15.49:0/2834195348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 msgr2=0x55efec350250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b659c640 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec350250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b659c640 1 -- 172.21.15.49:0/2834195348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 msgr2=0x55efec353800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b659c640 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 0x55efec353800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b659c640 1 -- 172.21.15.49:0/2834195348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efec357060 con 0x55efebf73390 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b759e640 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec350250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3b659c640 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec34fd10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009610 tx=0x7fb3a0010ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07021d701be2308 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb39e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2834195348 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0021040 con 0x55efebf73390 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2834195348 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fb3a00a9270 con 0x55efebf73390 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3c3745740 1 -- 172.21.15.49:0/2834195348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3b0004240 con 0x55efebf73390 2024-09-21T06:39:29.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2834195348 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb3a00ac770 con 0x55efebf73390 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.227+0000 7fb3c3745740 10 client.16182 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb3c3745740 1 -- 172.21.15.49:0/2834195348 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55efec3c8810 con 0x55efebf73390 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2834195348 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3b0004240 con 0x55efebf73390 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2834195348 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fb3a00b6520 con 0x55efebf73390 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb3c3745740 10 client.16182 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb3c3745740 10 client.16182 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb3c3745740 20 client.16182 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55efebf27da0 0x55efec3cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb3c3745740 4 client.16182 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb3c3745740 1 -- 172.21.15.49:0/2834195348 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55efec2af8a0 con 0x55efebf27da0 2024-09-21T06:39:29.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.228+0000 7fb3b6d9d640 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55efebf27da0 0x55efec3cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3b6d9d640 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55efebf27da0 0x55efec3cab00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3cf704288688af0a server_cookie=f310d025dd636872 in_seq=0 out_seq=0 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb39e7fc640 10 client.16182 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb39e7fc640 1 -- 172.21.15.49:0/2834195348 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55efec2af8a0 con 0x55efebf27da0 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb39e7fc640 10 client.16182 handle_command_reply: tid=0 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 client.16182 shutdown 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 -- 172.21.15.49:0/2834195348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 msgr2=0x55efec34fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec34fd10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009610 tx=0x7fb3a0010ad0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 -- 172.21.15.49:0/2834195348 shutdown_connections 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55efebf27da0 0x55efec3cab00 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55efebf94070 0x55efec350250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55efebf73390 0x55efec34fd10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 --2- 172.21.15.49:0/2834195348 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55efebf6b1b0 0x55efec353800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb39e7fc640 0 client.16182 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:39:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 -- 172.21.15.49:0/2834195348 >> 172.21.15.49:0/2834195348 conn(0x55efebf88460 msgr2=0x55efec348120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 -- 172.21.15.49:0/2834195348 shutdown_connections 2024-09-21T06:39:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 1 -- 172.21.15.49:0/2834195348 wait complete. 2024-09-21T06:39:29.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.229+0000 7fb3c3745740 20 client.16182 trim_cache size 0 max 16384 2024-09-21T06:39:29.237 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:39:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb3a40b6680 msgr2=0x7fb3a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb3a40b6680 0x7fb3a40b8b90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0005940 tx=0x7fb3b00058b0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b81094a0 msgr2=0x7fb3b819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b81094a0 0x7fb3b819a9e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000d740 tx=0x7fb3a000dc00 comp rx=0 tx=0).stop 2024-09-21T06:39:29.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/3177570557 shutdown_connections 2024-09-21T06:39:29.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb3a40b6680 0x7fb3a40b8b90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb3b8109df0 0x7fb3b819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb3b81094a0 0x7fb3b819a9e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 --2- 172.21.15.49:0/3177570557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb3b8103b60 0x7fb3b819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/3177570557 >> 172.21.15.49:0/3177570557 conn(0x7fb3b807b850 msgr2=0x7fb3b8105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/3177570557 shutdown_connections 2024-09-21T06:39:29.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:29.230+0000 7fb3bd1d1640 1 -- 172.21.15.49:0/3177570557 wait complete. 2024-09-21T06:39:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.819+0000 7f82e08f2640 1 -- 172.21.15.49:0/3046709676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 msgr2=0x7f82dc1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.819+0000 7f82e08f2640 1 --2- 172.21.15.49:0/3046709676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 0x7f82dc1023b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009900 tx=0x7f82cc02a410 comp rx=0 tx=0).stop 2024-09-21T06:39:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.819+0000 7f82e08f2640 1 -- 172.21.15.49:0/3046709676 shutdown_connections 2024-09-21T06:39:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.819+0000 7f82e08f2640 1 --2- 172.21.15.49:0/3046709676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82dc106b30 0x7f82dc1105c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.819+0000 7f82e08f2640 1 --2- 172.21.15.49:0/3046709676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc1061e0 0x7f82dc1065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.819+0000 7f82e08f2640 1 --2- 172.21.15.49:0/3046709676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 0x7f82dc1023b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.819+0000 7f82e08f2640 1 -- 172.21.15.49:0/3046709676 >> 172.21.15.49:0/3046709676 conn(0x7f82dc079cf0 msgr2=0x7f82dc07a130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.819+0000 7f82e08f2640 1 -- 172.21.15.49:0/3046709676 shutdown_connections 2024-09-21T06:39:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.819+0000 7f82e08f2640 1 -- 172.21.15.49:0/3046709676 wait complete. 2024-09-21T06:39:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.820+0000 7f82e08f2640 1 Processor -- start 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.820+0000 7f82e08f2640 1 -- start start 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.820+0000 7f82e08f2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 0x7f82dc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.820+0000 7f82e08f2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc1061e0 0x7f82dc19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.820+0000 7f82e08f2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82dc106b30 0x7f82dc19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.820+0000 7f82e08f2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc113a00 con 0x7f82dc101fa0 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.820+0000 7f82e08f2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc113880 con 0x7f82dc1061e0 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.820+0000 7f82e08f2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc113b80 con 0x7f82dc106b30 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82da59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 0x7f82dc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82da59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 0x7f82dc19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57954/0 (socket says 172.21.15.49:57954) 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82da59c640 1 -- 172.21.15.49:0/218805663 learned_addr learned my addr 172.21.15.49:0/218805663 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82dad9d640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82dc106b30 0x7f82dc19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82d9d9b640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc1061e0 0x7f82dc19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82da59c640 1 -- 172.21.15.49:0/218805663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82dc106b30 msgr2=0x7f82dc19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82da59c640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82dc106b30 0x7f82dc19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82da59c640 1 -- 172.21.15.49:0/218805663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc1061e0 msgr2=0x7f82dc19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82da59c640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc1061e0 0x7f82dc19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82da59c640 1 -- 172.21.15.49:0/218805663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82dc1a03f0 con 0x7f82dc101fa0 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82dad9d640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82dc106b30 0x7f82dc19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82da59c640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 0x7f82dc19a4c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f82cc032fd0 tx=0x7f82cc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82cb7fe640 1 -- 172.21.15.49:0/218805663 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc03f030 con 0x7f82dc101fa0 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82cb7fe640 1 -- 172.21.15.49:0/218805663 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82cc004490 con 0x7f82dc101fa0 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82cb7fe640 1 -- 172.21.15.49:0/218805663 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc035070 con 0x7f82dc101fa0 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82e08f2640 1 -- 172.21.15.49:0/218805663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82dc1a0680 con 0x7f82dc101fa0 2024-09-21T06:39:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.821+0000 7f82e08f2640 1 -- 172.21.15.49:0/218805663 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82dc1a6e70 con 0x7f82dc101fa0 2024-09-21T06:39:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.824+0000 7f82e785f740 1 Processor -- start 2024-09-21T06:39:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.824+0000 7f82e785f740 1 -- start start 2024-09-21T06:39:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.824+0000 7f82e785f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d4112dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.824+0000 7f82e785f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d402f0 0x55a1d4113300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.824+0000 7f82e785f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d4113840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.824+0000 7f82cb7fe640 1 -- 172.21.15.49:0/218805663 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f82cc042030 con 0x7f82dc101fa0 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.824+0000 7f82e785f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a1d40836f0 con 0x55a1d3d402f0 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.824+0000 7f82e785f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a1d4072b20 con 0x55a1d3d691b0 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.824+0000 7f82e785f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a1d4076930 con 0x55a1d3d484d0 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82da59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d402f0 0x55a1d4113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82da59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d402f0 0x55a1d4113300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57968/0 (socket says 172.21.15.49:57968) 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82da59c640 1 -- 172.21.15.49:0/3860244821 learned_addr learned my addr 172.21.15.49:0/3860244821 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82dad9d640 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d4112dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82d9d9b640 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d4113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82da59c640 1 -- 172.21.15.49:0/3860244821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 msgr2=0x55a1d4113840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82da59c640 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d4113840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82da59c640 1 -- 172.21.15.49:0/3860244821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 msgr2=0x55a1d4112dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82da59c640 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d4112dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82da59c640 1 -- 172.21.15.49:0/3860244821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1d4038530 con 0x55a1d3d402f0 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82dad9d640 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d4112dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82da59c640 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d402f0 0x55a1d4113300 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f82cc1053a0 tx=0x7f82cc10bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d0f07e0f77ae14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82cb7fe640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82c40b6680 0x7f82c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.825+0000 7f82c8ff9640 1 -- 172.21.15.49:0/3860244821 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc11d070 con 0x55a1d3d402f0 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.826+0000 7f82c8ff9640 1 -- 172.21.15.49:0/3860244821 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82cc0cd640 con 0x55a1d3d402f0 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.826+0000 7f82c8ff9640 1 -- 172.21.15.49:0/3860244821 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0cd2a0 con 0x55a1d3d402f0 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.826+0000 7f82dad9d640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82c40b6680 0x7f82c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.826+0000 7f82cb7fe640 1 -- 172.21.15.49:0/218805663 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f82cc107d00 con 0x7f82dc101fa0 2024-09-21T06:39:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.826+0000 7f82e785f740 1 -- 172.21.15.49:0/3860244821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d402f0 msgr2=0x55a1d4113300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.826+0000 7f82e785f740 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d402f0 0x55a1d4113300 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f82cc1053a0 tx=0x7f82cc10bf50 comp rx=0 tx=0).stop 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.826+0000 7f82dad9d640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82c40b6680 0x7f82c40b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005fd0 tx=0x7f82d4009780 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 -- 172.21.15.49:0/3860244821 shutdown_connections 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d4113840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d402f0 0x55a1d4113300 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 --2- 172.21.15.49:0/3860244821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d4112dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 -- 172.21.15.49:0/3860244821 >> 172.21.15.49:0/3860244821 conn(0x55a1d3d5d300 msgr2=0x55a1d4110cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 -- 172.21.15.49:0/3860244821 shutdown_connections 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 -- 172.21.15.49:0/3860244821 wait complete. 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 -- start start 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 Processor -- start 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d402f0 0x55a1d411e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d484d0 0x55a1d411e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d412a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a1d3faaab0 con 0x55a1d3d484d0 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a1d4018730 con 0x55a1d3d691b0 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.827+0000 7f82e785f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a1d4121300 con 0x55a1d3d402f0 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82e785f740 10 client.0 _ll_register_callbacks cb 0x55a1d406c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82d9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d484d0 0x55a1d411e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82d9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d484d0 0x55a1d411e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57980/0 (socket says 172.21.15.49:57980) 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82d9d9b640 1 -- 172.21.15.49:0/1505369028 learned_addr learned my addr 172.21.15.49:0/1505369028 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82da59c640 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d402f0 0x55a1d411e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82dad9d640 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d412a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82d9d9b640 1 -- 172.21.15.49:0/1505369028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d402f0 msgr2=0x55a1d411e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82d9d9b640 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d402f0 0x55a1d411e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82d9d9b640 1 -- 172.21.15.49:0/1505369028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 msgr2=0x55a1d412a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82d9d9b640 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d412a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82d9d9b640 1 -- 172.21.15.49:0/1505369028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1d3dd4790 con 0x55a1d3d484d0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82dad9d640 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d412a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82d9d9b640 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d484d0 0x55a1d411e980 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f82d000da10 tx=0x7f82d000ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58e4dd34cf987a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82c1ffb640 1 -- 172.21.15.49:0/1505369028 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d001b640 con 0x55a1d3d484d0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82c1ffb640 1 -- 172.21.15.49:0/1505369028 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f82d0011440 con 0x55a1d3d484d0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82e785f740 1 -- 172.21.15.49:0/1505369028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82cc0cd640 con 0x55a1d3d484d0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82c1ffb640 1 -- 172.21.15.49:0/1505369028 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f82d001b7e0 con 0x55a1d3d484d0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82e785f740 10 client.16194 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.828+0000 7f82e785f740 1 -- 172.21.15.49:0/1505369028 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a1d3e4d620 con 0x55a1d3d484d0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.829+0000 7f82c1ffb640 1 -- 172.21.15.49:0/1505369028 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82cc0cd640 con 0x55a1d3d484d0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.829+0000 7f82c1ffb640 1 -- 172.21.15.49:0/1505369028 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f82d0019020 con 0x55a1d3d484d0 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.829+0000 7f82e785f740 10 client.16194 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.829+0000 7f82e785f740 10 client.16194 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.829+0000 7f82e785f740 20 client.16194 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.829+0000 7f82e785f740 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1d3d27d80 0x55a1d41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.829+0000 7f82e785f740 4 client.16194 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.829+0000 7f82e785f740 1 -- 172.21.15.49:0/1505369028 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1d4085640 con 0x55a1d3d27d80 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.829+0000 7f82da59c640 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1d3d27d80 0x55a1d41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.830+0000 7f82da59c640 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1d3d27d80 0x55a1d41304d0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f71f6c1583680e56 server_cookie=66607051715bdd51 in_seq=0 out_seq=0 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.830+0000 7f82c1ffb640 10 client.16194 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.830+0000 7f82c1ffb640 1 -- 172.21.15.49:0/1505369028 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1d4085640 con 0x55a1d3d27d80 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.830+0000 7f82c1ffb640 10 client.16194 handle_command_reply: tid=0 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.830+0000 7f82e785f740 1 client.16194 shutdown 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 -- 172.21.15.49:0/1505369028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d484d0 msgr2=0x55a1d411e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d484d0 0x55a1d411e980 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f82d000da10 tx=0x7f82d000ded0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 -- 172.21.15.49:0/1505369028 shutdown_connections 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1d3d27d80 0x55a1d41304d0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d691b0 0x55a1d412a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d484d0 0x55a1d411e980 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82c1ffb640 0 client.16194 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 --2- 172.21.15.49:0/1505369028 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d402f0 0x55a1d411e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 -- 172.21.15.49:0/1505369028 >> 172.21.15.49:0/1505369028 conn(0x55a1d3d5d300 msgr2=0x55a1d4113df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 -- 172.21.15.49:0/1505369028 shutdown_connections 2024-09-21T06:39:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 1 -- 172.21.15.49:0/1505369028 wait complete. 2024-09-21T06:39:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.831+0000 7f82e785f740 20 client.16194 trim_cache size 0 max 16384 2024-09-21T06:39:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82e785f740 1 Processor -- start 2024-09-21T06:39:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82e785f740 1 -- start start 2024-09-21T06:39:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82e785f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 0x55a1d4114500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82e785f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d412a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82e785f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d411b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82e785f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc1aff10 con 0x55a1d3d691b0 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82e785f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc1ad7e0 con 0x55a1d3d402f0 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82e785f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc1ab650 con 0x55a1d3d484d0 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82dad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d411b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82dad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d411b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57984/0 (socket says 172.21.15.49:57984) 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.846+0000 7f82dad9d640 1 -- 172.21.15.49:0/338331830 learned_addr learned my addr 172.21.15.49:0/338331830 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82da59c640 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 0x55a1d4114500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82d9d9b640 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d412a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82dad9d640 1 -- 172.21.15.49:0/338331830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 msgr2=0x55a1d412a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82dad9d640 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d412a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82dad9d640 1 -- 172.21.15.49:0/338331830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 msgr2=0x55a1d4114500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82dad9d640 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 0x55a1d4114500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82dad9d640 1 -- 172.21.15.49:0/338331830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1d411c920 con 0x55a1d3d691b0 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82d9d9b640 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d412a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82dad9d640 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d411b610 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f82d40117e0 tx=0x7f82d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100002d9a176716f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82c3fff640 1 -- 172.21.15.49:0/338331830 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4029640 con 0x55a1d3d691b0 2024-09-21T06:39:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82c3fff640 1 -- 172.21.15.49:0/338331830 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82d401f8c0 con 0x55a1d3d691b0 2024-09-21T06:39:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.847+0000 7f82c3fff640 1 -- 172.21.15.49:0/338331830 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d40287e0 con 0x55a1d3d691b0 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 -- 172.21.15.49:0/338331830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 msgr2=0x55a1d411b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d411b610 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f82d40117e0 tx=0x7f82d4016000 comp rx=0 tx=0).stop 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 -- 172.21.15.49:0/338331830 shutdown_connections 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d411b610 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d412a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 --2- 172.21.15.49:0/338331830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 0x55a1d4114500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 -- 172.21.15.49:0/338331830 >> 172.21.15.49:0/338331830 conn(0x55a1d3d5d300 msgr2=0x55a1d4113df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 -- 172.21.15.49:0/338331830 shutdown_connections 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 -- 172.21.15.49:0/338331830 wait complete. 2024-09-21T06:39:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.848+0000 7f82e785f740 1 -- start start 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82e785f740 1 Processor -- start 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82e785f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 0x55a1d4124090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82e785f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d4124670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82e785f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d4191ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82e785f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc1abca0 con 0x55a1d3d691b0 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82e785f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc1ad110 con 0x55a1d3d402f0 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82e785f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f82dc1ac370 con 0x55a1d3d484d0 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82e785f740 10 client.0 _ll_register_callbacks cb 0x7f82d0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82dad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d4191ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82dad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d4191ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57988/0 (socket says 172.21.15.49:57988) 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82dad9d640 1 -- 172.21.15.49:0/2016406300 learned_addr learned my addr 172.21.15.49:0/2016406300 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82da59c640 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 0x55a1d4124090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82d9d9b640 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d4124670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82dad9d640 1 -- 172.21.15.49:0/2016406300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 msgr2=0x55a1d4124670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82dad9d640 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d4124670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82dad9d640 1 -- 172.21.15.49:0/2016406300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 msgr2=0x55a1d4124090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82dad9d640 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 0x55a1d4124090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.849+0000 7f82dad9d640 1 -- 172.21.15.49:0/2016406300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1d4192580 con 0x55a1d3d691b0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82dad9d640 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d4191ee0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f82d401fcd0 tx=0x7f82d401fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0cba439d0122c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82c1ffb640 1 -- 172.21.15.49:0/2016406300 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4004c50 con 0x55a1d3d691b0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82c1ffb640 1 -- 172.21.15.49:0/2016406300 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f82d402e040 con 0x55a1d3d691b0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82e785f740 1 -- 172.21.15.49:0/2016406300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82d401f8c0 con 0x55a1d3d691b0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82c1ffb640 1 -- 172.21.15.49:0/2016406300 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f82d403f050 con 0x55a1d3d691b0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82e785f740 10 client.16200 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82e785f740 1 -- 172.21.15.49:0/2016406300 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a1d419aaa0 con 0x55a1d3d691b0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82c1ffb640 1 -- 172.21.15.49:0/2016406300 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82d401f8c0 con 0x55a1d3d691b0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82c1ffb640 1 -- 172.21.15.49:0/2016406300 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f82d4027070 con 0x55a1d3d691b0 2024-09-21T06:39:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82e785f740 10 client.16200 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82e785f740 10 client.16200 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82e785f740 20 client.16200 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82e785f740 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1d3cfd1c0 0x55a1d419d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82e785f740 4 client.16200 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:39:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.850+0000 7f82e785f740 1 -- 172.21.15.49:0/2016406300 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1d40810f0 con 0x55a1d3cfd1c0 2024-09-21T06:39:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.851+0000 7f82da59c640 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1d3cfd1c0 0x55a1d419d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.851+0000 7f82da59c640 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1d3cfd1c0 0x55a1d419d120 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45598e98dfdc8f50 server_cookie=ec9ee38c34622f51 in_seq=0 out_seq=0 2024-09-21T06:39:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.851+0000 7f82c1ffb640 10 client.16200 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82c1ffb640 1 -- 172.21.15.49:0/2016406300 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1d40810f0 con 0x55a1d3cfd1c0 2024-09-21T06:39:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82c1ffb640 10 client.16200 handle_command_reply: tid=0 2024-09-21T06:39:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 client.16200 shutdown 2024-09-21T06:39:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 -- 172.21.15.49:0/2016406300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 msgr2=0x55a1d4191ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d4191ee0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f82d401fcd0 tx=0x7f82d401fd00 comp rx=0 tx=0).stop 2024-09-21T06:39:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 -- 172.21.15.49:0/2016406300 shutdown_connections 2024-09-21T06:39:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a1d3cfd1c0 0x55a1d419d120 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a1d3d691b0 0x55a1d4191ee0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a1d3d484d0 0x55a1d4124670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82c1ffb640 0 client.16200 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 --2- 172.21.15.49:0/2016406300 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a1d3d402f0 0x55a1d4124090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 -- 172.21.15.49:0/2016406300 >> 172.21.15.49:0/2016406300 conn(0x55a1d3d5d300 msgr2=0x55a1d410aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 -- 172.21.15.49:0/2016406300 shutdown_connections 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 1 -- 172.21.15.49:0/2016406300 wait complete. 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.859+0000 7f82e785f740 20 client.16200 trim_cache size 0 max 16384 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:39:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:39:29.863 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 -- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82c40b6680 msgr2=0x7f82c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.863 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82c40b6680 0x7f82c40b8b90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f82d4005fd0 tx=0x7f82d4009780 comp rx=0 tx=0).stop 2024-09-21T06:39:29.863 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 -- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 msgr2=0x7f82dc19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:29.863 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 0x7f82dc19a4c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f82cc032fd0 tx=0x7f82cc004270 comp rx=0 tx=0).stop 2024-09-21T06:39:29.863 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 -- 172.21.15.49:0/218805663 shutdown_connections 2024-09-21T06:39:29.863 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f82c40b6680 0x7f82c40b8b90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f82dc106b30 0x7f82dc19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f82dc1061e0 0x7f82dc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 --2- 172.21.15.49:0/218805663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f82dc101fa0 0x7f82dc19a4c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 -- 172.21.15.49:0/218805663 >> 172.21.15.49:0/218805663 conn(0x7f82dc079cf0 msgr2=0x7f82dc107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 -- 172.21.15.49:0/218805663 shutdown_connections 2024-09-21T06:39:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:29.860+0000 7f82e08f2640 1 -- 172.21.15.49:0/218805663 wait complete. 2024-09-21T06:39:29.989 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:39:30.120 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:29 smithi079 ceph-mon[34346]: pgmap v404: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-21T06:39:30.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:29 smithi049 ceph-mon[31177]: pgmap v404: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-21T06:39:30.245 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:30.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:29 smithi098 ceph-mon[34704]: pgmap v404: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-21T06:39:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.758+0000 7fa3fd39e640 1 -- 172.21.15.49:0/2906458492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8108d20 msgr2=0x7fa3f810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.758+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/2906458492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8108d20 0x7fa3f810f550 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009ca0 tx=0x7fa3f002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.758+0000 7fa3fd39e640 1 -- 172.21.15.49:0/2906458492 shutdown_connections 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.758+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/2906458492 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8108d20 0x7fa3f810f550 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.758+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/2906458492 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f81083d0 0x7fa3f81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.758+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/2906458492 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f8102ae0 0x7fa3f8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.758+0000 7fa3fd39e640 1 -- 172.21.15.49:0/2906458492 >> 172.21.15.49:0/2906458492 conn(0x7fa3f8079760 msgr2=0x7fa3f8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.758+0000 7fa3fd39e640 1 -- 172.21.15.49:0/2906458492 shutdown_connections 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.759+0000 7fa3fd39e640 1 -- 172.21.15.49:0/2906458492 wait complete. 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.759+0000 7fa3fd39e640 1 Processor -- start 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3fd39e640 1 -- start start 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3fd39e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8102ae0 0x7fa3f819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3fd39e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f81083d0 0x7fa3f819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3fd39e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f8108d20 0x7fa3f819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3fd39e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8112990 con 0x7fa3f8102ae0 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3fd39e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8112810 con 0x7fa3f81083d0 2024-09-21T06:39:30.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3fd39e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8112b10 con 0x7fa3f8108d20 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8102ae0 0x7fa3f819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8102ae0 0x7fa3f819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58014/0 (socket says 172.21.15.49:58014) 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f6ffd640 1 -- 172.21.15.49:0/4209219505 learned_addr learned my addr 172.21.15.49:0/4209219505 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f8108d20 0x7fa3f819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f81083d0 0x7fa3f819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f6ffd640 1 -- 172.21.15.49:0/4209219505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f8108d20 msgr2=0x7fa3f819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f6ffd640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f8108d20 0x7fa3f819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f6ffd640 1 -- 172.21.15.49:0/4209219505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f81083d0 msgr2=0x7fa3f819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f6ffd640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f81083d0 0x7fa3f819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.760+0000 7fa3f6ffd640 1 -- 172.21.15.49:0/4209219505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f81a03e0 con 0x7fa3f8102ae0 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.761+0000 7fa3f6ffd640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8102ae0 0x7fa3f819a470 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800d950 tx=0x7fa3e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.761+0000 7fa3dffff640 1 -- 172.21.15.49:0/4209219505 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e8017070 con 0x7fa3f8102ae0 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.761+0000 7fa3fd39e640 1 -- 172.21.15.49:0/4209219505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f81a06d0 con 0x7fa3f8102ae0 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.761+0000 7fa3dffff640 1 -- 172.21.15.49:0/4209219505 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e8009c30 con 0x7fa3f8102ae0 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.761+0000 7fa3dffff640 1 -- 172.21.15.49:0/4209219505 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e800f620 con 0x7fa3f8102ae0 2024-09-21T06:39:30.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.761+0000 7fa3fd39e640 1 -- 172.21.15.49:0/4209219505 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f81a6e30 con 0x7fa3f8102ae0 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.763+0000 7fa403912740 1 Processor -- start 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.763+0000 7fa3dffff640 1 -- 172.21.15.49:0/4209219505 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fa3e8010460 con 0x7fa3f8102ae0 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.763+0000 7fa403912740 1 -- start start 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa403912740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa043070 0x5631fa3ea6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa403912740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 0x5631fa3eabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa403912740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 0x5631fa3eb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa403912740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5631fa360ea0 con 0x5631fa043070 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa403912740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5631fa3502d0 con 0x5631fa01a1b0 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa403912740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5631fa3540e0 con 0x5631fa022390 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa043070 0x5631fa3ea6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa043070 0x5631fa3ea6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58016/0 (socket says 172.21.15.49:58016) 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f77fe640 1 -- 172.21.15.49:0/1631032518 learned_addr learned my addr 172.21.15.49:0/1631032518 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f6ffd640 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 0x5631fa3eabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 0x5631fa3eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f77fe640 1 -- 172.21.15.49:0/1631032518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 msgr2=0x5631fa3eb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 0x5631fa3eb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f77fe640 1 -- 172.21.15.49:0/1631032518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 msgr2=0x5631fa3eabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 0x5631fa3eabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f77fe640 1 -- 172.21.15.49:0/1631032518 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa0ae650 con 0x5631fa043070 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.764+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 0x5631fa3eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.765+0000 7fa3dffff640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa3e00b6680 0x7fa3e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.765+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa043070 0x5631fa3ea6a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00098b0 tx=0x7fa3f00098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5d94082bd04367 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.765+0000 7fa3f6ffd640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa3e00b6680 0x7fa3e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.765+0000 7fa3dd7fa640 1 -- 172.21.15.49:0/1631032518 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0031cf0 con 0x5631fa043070 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.765+0000 7fa3dffff640 1 -- 172.21.15.49:0/4209219505 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa3e80e7300 con 0x7fa3f8102ae0 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.765+0000 7fa3dd7fa640 1 -- 172.21.15.49:0/1631032518 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0036030 con 0x5631fa043070 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.765+0000 7fa3dd7fa640 1 -- 172.21.15.49:0/1631032518 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00042a0 con 0x5631fa043070 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 -- 172.21.15.49:0/1631032518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa043070 msgr2=0x5631fa3ea6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa3f6ffd640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa3e00b6680 0x7fa3e00b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80e4ae0 tx=0x7fa3e8094040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa043070 0x5631fa3ea6a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00098b0 tx=0x7fa3f00098e0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 -- 172.21.15.49:0/1631032518 shutdown_connections 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 0x5631fa3eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 0x5631fa3eabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 --2- 172.21.15.49:0/1631032518 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa043070 0x5631fa3ea6a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 -- 172.21.15.49:0/1631032518 >> 172.21.15.49:0/1631032518 conn(0x5631fa037460 msgr2=0x5631fa3e8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 -- 172.21.15.49:0/1631032518 shutdown_connections 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 -- 172.21.15.49:0/1631032518 wait complete. 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.766+0000 7fa403912740 1 -- start start 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa403912740 1 Processor -- start 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa403912740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa01a1b0 0x5631fa3f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa403912740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa022390 0x5631fa3f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa403912740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa043070 0x5631fa401f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa403912740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5631fa1b1700 con 0x5631fa01a1b0 2024-09-21T06:39:30.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa403912740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5631fa2eb160 con 0x5631fa022390 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa403912740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5631fa3f8ca0 con 0x5631fa043070 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa403912740 10 client.0 _ll_register_callbacks cb 0x5631fa3049e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa01a1b0 0x5631fa3f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa01a1b0 0x5631fa3f5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58032/0 (socket says 172.21.15.49:58032) 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f77fe640 1 -- 172.21.15.49:0/1638005368 learned_addr learned my addr 172.21.15.49:0/1638005368 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa022390 0x5631fa3f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa043070 0x5631fa401f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f77fe640 1 -- 172.21.15.49:0/1638005368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa043070 msgr2=0x5631fa401f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa043070 0x5631fa401f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f77fe640 1 -- 172.21.15.49:0/1638005368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa022390 msgr2=0x5631fa3f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa022390 0x5631fa3f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.767+0000 7fa3f77fe640 1 -- 172.21.15.49:0/1638005368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fa318c90 con 0x5631fa01a1b0 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa01a1b0 0x5631fa3f5d80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009620 tx=0x7fa3f0003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20418826dbc4ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa3daff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa3daff5640 1 -- 172.21.15.49:0/1638005368 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0058060 con 0x5631fa01a1b0 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa3daff5640 1 -- 172.21.15.49:0/1638005368 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa3f002f660 con 0x5631fa01a1b0 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa403912740 1 -- 172.21.15.49:0/1638005368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f0036030 con 0x5631fa01a1b0 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa3daff5640 1 -- 172.21.15.49:0/1638005368 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa3f002f860 con 0x5631fa01a1b0 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa403912740 10 client.16212 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa403912740 1 -- 172.21.15.49:0/1638005368 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5631fa404970 con 0x5631fa01a1b0 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa3daff5640 1 -- 172.21.15.49:0/1638005368 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0036030 con 0x5631fa01a1b0 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.768+0000 7fa3daff5640 1 -- 172.21.15.49:0/1638005368 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa3f0043070 con 0x5631fa01a1b0 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.769+0000 7fa403912740 10 client.16212 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.769+0000 7fa403912740 10 client.16212 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.769+0000 7fa403912740 20 client.16212 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.769+0000 7fa403912740 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5631fa0019f0 0x5631fa407cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.769+0000 7fa403912740 4 client.16212 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.769+0000 7fa403912740 1 -- 172.21.15.49:0/1638005368 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631fa362df0 con 0x5631fa0019f0 2024-09-21T06:39:30.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.769+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5631fa0019f0 0x5631fa407cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.769+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5631fa0019f0 0x5631fa407cd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e71d46e2c9c64bc server_cookie=99e3e46799c3a776 in_seq=0 out_seq=0 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.769+0000 7fa3daff5640 10 client.16212 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa3daff5640 1 -- 172.21.15.49:0/1638005368 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5631fa362df0 con 0x5631fa0019f0 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa3daff5640 10 client.16212 handle_command_reply: tid=0 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa403912740 1 client.16212 shutdown 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa403912740 1 -- 172.21.15.49:0/1638005368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa01a1b0 msgr2=0x5631fa3f5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa403912740 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa01a1b0 0x5631fa3f5d80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa3f0009620 tx=0x7fa3f0003da0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa403912740 1 -- 172.21.15.49:0/1638005368 shutdown_connections 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa403912740 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5631fa0019f0 0x5631fa407cd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa3daff5640 0 client.16212 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa403912740 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa043070 0x5631fa401f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa403912740 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa022390 0x5631fa3f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa403912740 1 --2- 172.21.15.49:0/1638005368 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa01a1b0 0x5631fa3f5d80 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.770+0000 7fa403912740 1 -- 172.21.15.49:0/1638005368 >> 172.21.15.49:0/1638005368 conn(0x5631fa037460 msgr2=0x5631fa3ed880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.771+0000 7fa403912740 1 -- 172.21.15.49:0/1638005368 shutdown_connections 2024-09-21T06:39:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.771+0000 7fa403912740 1 -- 172.21.15.49:0/1638005368 wait complete. 2024-09-21T06:39:30.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.771+0000 7fa403912740 20 client.16212 trim_cache size 0 max 16384 2024-09-21T06:39:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa403912740 1 Processor -- start 2024-09-21T06:39:30.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa403912740 1 -- start start 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa403912740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa0019f0 0x5631fa3ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa403912740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 0x5631fa3f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa403912740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 0x5631fa401e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa403912740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81b2050 con 0x5631fa0019f0 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa403912740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81af920 con 0x5631fa01a1b0 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa403912740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81ad790 con 0x5631fa022390 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa0019f0 0x5631fa3ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa0019f0 0x5631fa3ec1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58036/0 (socket says 172.21.15.49:58036) 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.784+0000 7fa3f77fe640 1 -- 172.21.15.49:0/3388767871 learned_addr learned my addr 172.21.15.49:0/3388767871 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/3388767871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 0x5631fa3f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3f77fe640 1 -- 172.21.15.49:0/3388767871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 msgr2=0x5631fa401e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/3388767871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 0x5631fa401e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3f77fe640 1 -- 172.21.15.49:0/3388767871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 msgr2=0x5631fa3f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/3388767871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 0x5631fa3f7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3f77fe640 1 -- 172.21.15.49:0/3388767871 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631fa3ecee0 con 0x5631fa0019f0 2024-09-21T06:39:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/3388767871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa0019f0 0x5631fa3ec1a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa3f002ade0 tx=0x7fa3f0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb2d72783cd21b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3dcff9640 1 -- 172.21.15.49:0/3388767871 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0009360 con 0x5631fa0019f0 2024-09-21T06:39:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3dcff9640 1 -- 172.21.15.49:0/3388767871 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0036070 con 0x5631fa0019f0 2024-09-21T06:39:30.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.785+0000 7fa3dcff9640 1 -- 172.21.15.49:0/3388767871 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f002fa00 con 0x5631fa0019f0 2024-09-21T06:39:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 -- 172.21.15.49:0/3388767871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa0019f0 msgr2=0x5631fa3ec1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 --2- 172.21.15.49:0/3388767871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa0019f0 0x5631fa3ec1a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa3f002ade0 tx=0x7fa3f0000f40 comp rx=0 tx=0).stop 2024-09-21T06:39:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 -- 172.21.15.49:0/3388767871 shutdown_connections 2024-09-21T06:39:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 --2- 172.21.15.49:0/3388767871 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa022390 0x5631fa401e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 --2- 172.21.15.49:0/3388767871 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa01a1b0 0x5631fa3f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 --2- 172.21.15.49:0/3388767871 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa0019f0 0x5631fa3ec1a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.794 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 -- 172.21.15.49:0/3388767871 >> 172.21.15.49:0/3388767871 conn(0x5631fa037460 msgr2=0x5631fa3ef7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 -- 172.21.15.49:0/3388767871 shutdown_connections 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 -- 172.21.15.49:0/3388767871 wait complete. 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 -- start start 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.786+0000 7fa403912740 1 Processor -- start 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa403912740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa0019f0 0x5631fa3fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa403912740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa01a1b0 0x5631fa3fa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa403912740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa022390 0x5631fa3fab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa403912740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81adde0 con 0x5631fa022390 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa403912740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81af250 con 0x5631fa0019f0 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa403912740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81ae4b0 con 0x5631fa01a1b0 2024-09-21T06:39:30.795 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa403912740 10 client.0 _ll_register_callbacks cb 0x7fa3e80ead20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa022390 0x5631fa3fab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa022390 0x5631fa3fab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58040/0 (socket says 172.21.15.49:58040) 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f77fe640 1 -- 172.21.15.49:0/2876581073 learned_addr learned my addr 172.21.15.49:0/2876581073 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa01a1b0 0x5631fa3fa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa0019f0 0x5631fa3fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f77fe640 1 -- 172.21.15.49:0/2876581073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa01a1b0 msgr2=0x5631fa3fa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa01a1b0 0x5631fa3fa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f77fe640 1 -- 172.21.15.49:0/2876581073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa0019f0 msgr2=0x5631fa3fa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa0019f0 0x5631fa3fa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.787+0000 7fa3f77fe640 1 -- 172.21.15.49:0/2876581073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631fa475a30 con 0x5631fa022390 2024-09-21T06:39:30.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa3f77fe640 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa022390 0x5631fa3fab30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00094b0 tx=0x7fa3f0003a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822ae97495e06a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa3daff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa3daff5640 1 -- 172.21.15.49:0/2876581073 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f002fa00 con 0x5631fa022390 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa3daff5640 1 -- 172.21.15.49:0/2876581073 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fa3f002fc20 con 0x5631fa022390 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa403912740 1 -- 172.21.15.49:0/2876581073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3f0036070 con 0x5631fa022390 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa3daff5640 1 -- 172.21.15.49:0/2876581073 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa3f0058070 con 0x5631fa022390 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa403912740 10 client.16218 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa403912740 1 -- 172.21.15.49:0/2876581073 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5631fa476c90 con 0x5631fa022390 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa3daff5640 1 -- 172.21.15.49:0/2876581073 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3f0036070 con 0x5631fa022390 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa3daff5640 1 -- 172.21.15.49:0/2876581073 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fa3f0043040 con 0x5631fa022390 2024-09-21T06:39:30.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa403912740 10 client.16218 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa403912740 10 client.16218 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa403912740 20 client.16218 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa403912740 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5631fa043070 0x5631fa479340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa403912740 4 client.16218 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.788+0000 7fa403912740 1 -- 172.21.15.49:0/2876581073 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631fa35e8a0 con 0x5631fa043070 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.789+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5631fa043070 0x5631fa479340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.789+0000 7fa3daff5640 10 client.16218 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.789+0000 7fa3f67fc640 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5631fa043070 0x5631fa479340 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e099dfe1aa0ed434 server_cookie=66932e4af73d7424 in_seq=0 out_seq=0 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.789+0000 7fa3daff5640 1 -- 172.21.15.49:0/2876581073 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631fa35e8a0 con 0x5631fa043070 2024-09-21T06:39:30.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.789+0000 7fa3daff5640 10 client.16218 handle_command_reply: tid=0 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.789+0000 7fa403912740 1 client.16218 shutdown 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.789+0000 7fa403912740 1 -- 172.21.15.49:0/2876581073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa022390 msgr2=0x5631fa3fab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.789+0000 7fa403912740 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa022390 0x5631fa3fab30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa3f00094b0 tx=0x7fa3f0003a10 comp rx=0 tx=0).stop 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.789+0000 7fa403912740 1 -- 172.21.15.49:0/2876581073 shutdown_connections 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa403912740 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5631fa043070 0x5631fa479340 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa403912740 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631fa022390 0x5631fa3fab30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa403912740 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631fa01a1b0 0x5631fa3fa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa403912740 1 --2- 172.21.15.49:0/2876581073 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631fa0019f0 0x5631fa3fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3daff5640 0 client.16218 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa403912740 1 -- 172.21.15.49:0/2876581073 >> 172.21.15.49:0/2876581073 conn(0x5631fa037460 msgr2=0x5631fa3f79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa403912740 1 -- 172.21.15.49:0/2876581073 shutdown_connections 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa403912740 1 -- 172.21.15.49:0/2876581073 wait complete. 2024-09-21T06:39:30.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa403912740 20 client.16218 trim_cache size 0 max 16384 2024-09-21T06:39:30.800 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:39:30.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 -- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa3e00b6680 msgr2=0x7fa3e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa3e00b6680 0x7fa3e00b8b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80e4ae0 tx=0x7fa3e8094040 comp rx=0 tx=0).stop 2024-09-21T06:39:30.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 -- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8102ae0 msgr2=0x7fa3f819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8102ae0 0x7fa3f819a470 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa3e800d950 tx=0x7fa3e800de10 comp rx=0 tx=0).stop 2024-09-21T06:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 -- 172.21.15.49:0/4209219505 shutdown_connections 2024-09-21T06:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa3e00b6680 0x7fa3e00b8b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa3f8108d20 0x7fa3f819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa3f81083d0 0x7fa3f819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 --2- 172.21.15.49:0/4209219505 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa3f8102ae0 0x7fa3f819a470 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 -- 172.21.15.49:0/4209219505 >> 172.21.15.49:0/4209219505 conn(0x7fa3f8079760 msgr2=0x7fa3f8101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.790+0000 7fa3fd39e640 1 -- 172.21.15.49:0/4209219505 shutdown_connections 2024-09-21T06:39:30.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:30.791+0000 7fa3fd39e640 1 -- 172.21.15.49:0/4209219505 wait complete. 2024-09-21T06:39:31.525 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:39:31.783 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:32.099 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:31 smithi049 ceph-mon[31177]: pgmap v405: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T06:39:32.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:31 smithi098 ceph-mon[34704]: pgmap v405: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T06:39:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.310+0000 7f0d38621640 1 -- 172.21.15.49:0/529903556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 msgr2=0x7f0d30110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.310+0000 7f0d38621640 1 --2- 172.21.15.49:0/529903556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 0x7f0d30110300 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009ca0 tx=0x7f0d2002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.310+0000 7f0d38621640 1 -- 172.21.15.49:0/529903556 shutdown_connections 2024-09-21T06:39:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.310+0000 7f0d38621640 1 --2- 172.21.15.49:0/529903556 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 0x7f0d30110300 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.310+0000 7f0d38621640 1 --2- 172.21.15.49:0/529903556 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d30105270 0x7f0d3010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.310+0000 7f0d38621640 1 --2- 172.21.15.49:0/529903556 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d30104840 0x7f0d30104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.310+0000 7f0d38621640 1 -- 172.21.15.49:0/529903556 >> 172.21.15.49:0/529903556 conn(0x7f0d30079730 msgr2=0x7f0d30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.310+0000 7f0d38621640 1 -- 172.21.15.49:0/529903556 shutdown_connections 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.310+0000 7f0d38621640 1 -- 172.21.15.49:0/529903556 wait complete. 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.311+0000 7f0d38621640 1 Processor -- start 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.311+0000 7f0d38621640 1 -- start start 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.311+0000 7f0d38621640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d30104840 0x7f0d3019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.311+0000 7f0d38621640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d30105270 0x7f0d3019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.311+0000 7f0d38621640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 0x7f0d3019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.311+0000 7f0d38621640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30113a90 con 0x7f0d3010ddf0 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.311+0000 7f0d38621640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30113910 con 0x7f0d30104840 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.311+0000 7f0d38621640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0d30113c10 con 0x7f0d30105270 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.311+0000 7f0d36bbe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 0x7f0d3019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d36bbe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 0x7f0d3019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58070/0 (socket says 172.21.15.49:58070) 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d36bbe640 1 -- 172.21.15.49:0/3500488330 learned_addr learned my addr 172.21.15.49:0/3500488330 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d363bd640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d30104840 0x7f0d3019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d30105270 0x7f0d3019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d36bbe640 1 -- 172.21.15.49:0/3500488330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d30105270 msgr2=0x7f0d3019aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d36bbe640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d30105270 0x7f0d3019aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d36bbe640 1 -- 172.21.15.49:0/3500488330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d30104840 msgr2=0x7f0d3019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d36bbe640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d30104840 0x7f0d3019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d36bbe640 1 -- 172.21.15.49:0/3500488330 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d301a0430 con 0x7f0d3010ddf0 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d36bbe640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 0x7f0d3019fd00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0d20005cc0 tx=0x7f0d2002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d2f7fe640 1 -- 172.21.15.49:0/3500488330 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d20003bf0 con 0x7f0d3010ddf0 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d2f7fe640 1 -- 172.21.15.49:0/3500488330 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d20003d90 con 0x7f0d3010ddf0 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d2f7fe640 1 -- 172.21.15.49:0/3500488330 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2002fbc0 con 0x7f0d3010ddf0 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d38621640 1 -- 172.21.15.49:0/3500488330 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d301a06c0 con 0x7f0d3010ddf0 2024-09-21T06:39:32.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.312+0000 7f0d38621640 1 -- 172.21.15.49:0/3500488330 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d301a6e80 con 0x7f0d3010ddf0 2024-09-21T06:39:32.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:31 smithi079 ceph-mon[34346]: pgmap v405: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 10 op/s 2024-09-21T06:39:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.315+0000 7f0d3eb95740 1 Processor -- start 2024-09-21T06:39:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.315+0000 7f0d2f7fe640 1 -- 172.21.15.49:0/3500488330 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0d2002fd60 con 0x7f0d3010ddf0 2024-09-21T06:39:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d3eb95740 1 -- start start 2024-09-21T06:39:32.323 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd758886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd75888be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 0x55fd75889120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fd757feea0 con 0x55fd754b81b0 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fd757ee2d0 con 0x55fd754e1070 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fd757f20e0 con 0x55fd754c0390 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d363bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd75888be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d363bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd75888be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58082/0 (socket says 172.21.15.49:58082) 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d363bd640 1 -- 172.21.15.49:0/4197865942 learned_addr learned my addr 172.21.15.49:0/4197865942 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 0x55fd75889120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.316+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd758886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d2f7fe640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0d180b6680 0x7f0d180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d363bd640 1 -- 172.21.15.49:0/4197865942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 msgr2=0x55fd75889120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d363bd640 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 0x55fd75889120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d363bd640 1 -- 172.21.15.49:0/4197865942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 msgr2=0x55fd758886a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d363bd640 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd758886a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d363bd640 1 -- 172.21.15.49:0/4197865942 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7554c650 con 0x55fd754b81b0 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd758886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d2f7fe640 1 -- 172.21.15.49:0/3500488330 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0d20108d60 con 0x7f0d3010ddf0 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d36bbe640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0d180b6680 0x7f0d180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d363bd640 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd75888be0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800bcb0 tx=0x7f0d280107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cfd0ea45fddf81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d2cff9640 1 -- 172.21.15.49:0/4197865942 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d28004020 con 0x55fd754b81b0 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d2cff9640 1 -- 172.21.15.49:0/4197865942 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d280054d0 con 0x55fd754b81b0 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.317+0000 7f0d2cff9640 1 -- 172.21.15.49:0/4197865942 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d28004be0 con 0x55fd754b81b0 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d3eb95740 1 -- 172.21.15.49:0/4197865942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 msgr2=0x55fd75888be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d36bbe640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0d180b6680 0x7f0d180b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0d20006010 tx=0x7f0d2009b950 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd75888be0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800bcb0 tx=0x7f0d280107a0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d3eb95740 1 -- 172.21.15.49:0/4197865942 shutdown_connections 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 0x55fd75889120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd75888be0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/4197865942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd758886a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d3eb95740 1 -- 172.21.15.49:0/4197865942 >> 172.21.15.49:0/4197865942 conn(0x55fd754d5460 msgr2=0x55fd75886590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d3eb95740 1 -- 172.21.15.49:0/4197865942 shutdown_connections 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.318+0000 7f0d3eb95740 1 -- 172.21.15.49:0/4197865942 wait complete. 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d3eb95740 1 -- start start 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d3eb95740 1 Processor -- start 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 0x55fd75893cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754c0390 0x55fd75894230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd75894770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fd7564f700 con 0x55fd754c0390 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fd75789160 con 0x55fd754e1070 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fd75896e80 con 0x55fd754b81b0 2024-09-21T06:39:32.326 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d3eb95740 10 client.0 _ll_register_callbacks cb 0x55fd757a29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d363bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754c0390 0x55fd75894230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d363bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754c0390 0x55fd75894230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58084/0 (socket says 172.21.15.49:58084) 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d363bd640 1 -- 172.21.15.49:0/2845003788 learned_addr learned my addr 172.21.15.49:0/2845003788 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.319+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 0x55fd75893cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd75894770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d363bd640 1 -- 172.21.15.49:0/2845003788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 msgr2=0x55fd75893cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d363bd640 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 0x55fd75893cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d363bd640 1 -- 172.21.15.49:0/2845003788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 msgr2=0x55fd75894770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d363bd640 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd75894770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d363bd640 1 -- 172.21.15.49:0/2845003788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd757b6c90 con 0x55fd754c0390 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d363bd640 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754c0390 0x55fd75894230 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0d28000c00 tx=0x7f0d28005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c35f259229ced7f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2845003788 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2802b060 con 0x55fd754c0390 2024-09-21T06:39:32.327 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2845003788 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0d28004940 con 0x55fd754c0390 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2845003788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d280054d0 con 0x55fd754c0390 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2845003788 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0d28004b40 con 0x55fd754c0390 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d3eb95740 10 client.16230 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.320+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2845003788 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fd758a2b00 con 0x55fd754c0390 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.321+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2845003788 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d280054d0 con 0x55fd754c0390 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.321+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2845003788 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f0d28011930 con 0x55fd754c0390 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.321+0000 7f0d3eb95740 10 client.16230 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.321+0000 7f0d3eb95740 10 client.16230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.321+0000 7f0d3eb95740 20 client.16230 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.321+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fd7549f9f0 0x55fd758a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.321+0000 7f0d3eb95740 4 client.16230 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.321+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2845003788 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd75800df0 con 0x55fd7549f9f0 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.321+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fd7549f9f0 0x55fd758a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.322+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fd7549f9f0 0x55fd758a5e60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f618331305254b0f server_cookie=70466354792eaf56 in_seq=0 out_seq=0 2024-09-21T06:39:32.328 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.322+0000 7f0d15ffb640 10 client.16230 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.322+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2845003788 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd75800df0 con 0x55fd7549f9f0 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.322+0000 7f0d15ffb640 10 client.16230 handle_command_reply: tid=0 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.322+0000 7f0d3eb95740 1 client.16230 shutdown 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2845003788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754c0390 msgr2=0x55fd75894230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754c0390 0x55fd75894230 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0d28000c00 tx=0x7f0d28005680 comp rx=0 tx=0).stop 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2845003788 shutdown_connections 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fd7549f9f0 0x55fd758a5e60 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd75894770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754c0390 0x55fd75894230 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2845003788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 0x55fd75893cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2845003788 >> 172.21.15.49:0/2845003788 conn(0x55fd754d5460 msgr2=0x55fd7588b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d15ffb640 0 client.16230 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:32.330 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2845003788 shutdown_connections 2024-09-21T06:39:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2845003788 wait complete. 2024-09-21T06:39:32.331 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.323+0000 7f0d3eb95740 20 client.16230 trim_cache size 0 max 16384 2024-09-21T06:39:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.336+0000 7f0d3eb95740 1 Processor -- start 2024-09-21T06:39:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.336+0000 7f0d3eb95740 1 -- start start 2024-09-21T06:39:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd7588a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 0x55fd75895920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd75890ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301b2150 con 0x55fd754b81b0 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301afa20 con 0x55fd754e1070 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301ad890 con 0x55fd754c0390 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d35bbc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd7588a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d35bbc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd7588a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58098/0 (socket says 172.21.15.49:58098) 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d35bbc640 1 -- 172.21.15.49:0/3363327610 learned_addr learned my addr 172.21.15.49:0/3363327610 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d363bd640 1 --2- 172.21.15.49:0/3363327610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 0x55fd75895920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d35bbc640 1 -- 172.21.15.49:0/3363327610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 msgr2=0x55fd75895920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/3363327610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 0x55fd75895920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d35bbc640 1 -- 172.21.15.49:0/3363327610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 msgr2=0x55fd75890ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:32.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/3363327610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd75890ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d35bbc640 1 -- 172.21.15.49:0/3363327610 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd7588b500 con 0x55fd754b81b0 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/3363327610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd7588a090 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0d3006aaa0 tx=0x7f0d2400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e041128a2106fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d17fff640 1 -- 172.21.15.49:0/3363327610 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24024030 con 0x55fd754b81b0 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d17fff640 1 -- 172.21.15.49:0/3363327610 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d24011dc0 con 0x55fd754b81b0 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.337+0000 7f0d17fff640 1 -- 172.21.15.49:0/3363327610 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2400fda0 con 0x55fd754b81b0 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.338+0000 7f0d3eb95740 1 -- 172.21.15.49:0/3363327610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 msgr2=0x55fd7588a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.338+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/3363327610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd7588a090 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0d3006aaa0 tx=0x7f0d2400c430 comp rx=0 tx=0).stop 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.338+0000 7f0d3eb95740 1 -- 172.21.15.49:0/3363327610 shutdown_connections 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.338+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/3363327610 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754e1070 0x55fd75890ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.338+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/3363327610 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754c0390 0x55fd75895920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.338+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/3363327610 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754b81b0 0x55fd7588a090 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.338+0000 7f0d3eb95740 1 -- 172.21.15.49:0/3363327610 >> 172.21.15.49:0/3363327610 conn(0x55fd754d5460 msgr2=0x55fd75895210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.338+0000 7f0d3eb95740 1 -- 172.21.15.49:0/3363327610 shutdown_connections 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.338+0000 7f0d3eb95740 1 -- 172.21.15.49:0/3363327610 wait complete. 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d3eb95740 1 -- start start 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d3eb95740 1 Processor -- start 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 0x55fd758a93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754c0390 0x55fd758a6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d3eb95740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754e1070 0x55fd758a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301adee0 con 0x55fd754e1070 2024-09-21T06:39:32.348 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301af350 con 0x55fd754c0390 2024-09-21T06:39:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d3eb95740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0d301ae5b0 con 0x55fd754b81b0 2024-09-21T06:39:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d3eb95740 10 client.0 _ll_register_callbacks cb 0x7f0d2400c9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d35bbc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754e1070 0x55fd758a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d35bbc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754e1070 0x55fd758a6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58110/0 (socket says 172.21.15.49:58110) 2024-09-21T06:39:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d35bbc640 1 -- 172.21.15.49:0/2388568341 learned_addr learned my addr 172.21.15.49:0/2388568341 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 0x55fd758a93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.339+0000 7f0d363bd640 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754c0390 0x55fd758a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d35bbc640 1 -- 172.21.15.49:0/2388568341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 msgr2=0x55fd758a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:32.349 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 0x55fd758a93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d35bbc640 1 -- 172.21.15.49:0/2388568341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754c0390 msgr2=0x55fd758a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:32.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754c0390 0x55fd758a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d35bbc640 1 -- 172.21.15.49:0/2388568341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd758a7300 con 0x55fd754e1070 2024-09-21T06:39:32.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d35bbc640 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754e1070 0x55fd758a6dc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0d24005d00 tx=0x7f0d2400f900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b40ae4c9a22049 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:32.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2388568341 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24024070 con 0x55fd754e1070 2024-09-21T06:39:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2388568341 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0d2400fb40 con 0x55fd754e1070 2024-09-21T06:39:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2388568341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0d24011dc0 con 0x55fd754e1070 2024-09-21T06:39:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2388568341 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0d2403c050 con 0x55fd754e1070 2024-09-21T06:39:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d3eb95740 10 client.16236 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2388568341 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fd75910250 con 0x55fd754e1070 2024-09-21T06:39:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.340+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2388568341 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0d24011dc0 con 0x55fd754e1070 2024-09-21T06:39:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2388568341 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f0d2401f070 con 0x55fd754e1070 2024-09-21T06:39:32.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d3eb95740 10 client.16236 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d3eb95740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d3eb95740 20 client.16236 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fd75474da0 0x55fd759129b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d3eb95740 4 client.16236 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2388568341 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd757fc8a0 con 0x55fd75474da0 2024-09-21T06:39:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d363bd640 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fd75474da0 0x55fd759129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d15ffb640 10 client.16236 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:32.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d363bd640 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fd75474da0 0x55fd759129b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313264f08238f4c8 server_cookie=ee6f8f7882ade90b in_seq=0 out_seq=0 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d15ffb640 1 -- 172.21.15.49:0/2388568341 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd757fc8a0 con 0x55fd75474da0 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d15ffb640 10 client.16236 handle_command_reply: tid=0 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.341+0000 7f0d3eb95740 1 client.16236 shutdown 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2388568341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754e1070 msgr2=0x55fd758a6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754e1070 0x55fd758a6dc0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0d24005d00 tx=0x7f0d2400f900 comp rx=0 tx=0).stop 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2388568341 shutdown_connections 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55fd75474da0 0x55fd759129b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fd754e1070 0x55fd758a6dc0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fd754c0390 0x55fd758a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 --2- 172.21.15.49:0/2388568341 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fd754b81b0 0x55fd758a93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d15ffb640 0 client.16236 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:32.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2388568341 >> 172.21.15.49:0/2388568341 conn(0x55fd754d5460 msgr2=0x55fd75889e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:32.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2388568341 shutdown_connections 2024-09-21T06:39:32.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 1 -- 172.21.15.49:0/2388568341 wait complete. 2024-09-21T06:39:32.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d3eb95740 20 client.16236 trim_cache size 0 max 16384 2024-09-21T06:39:32.355 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:39:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 -- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0d180b6680 msgr2=0x7f0d180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0d180b6680 0x7f0d180b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0d20006010 tx=0x7f0d2009b950 comp rx=0 tx=0).stop 2024-09-21T06:39:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 -- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 msgr2=0x7f0d3019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 0x7f0d3019fd00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0d20005cc0 tx=0x7f0d2002f380 comp rx=0 tx=0).stop 2024-09-21T06:39:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 -- 172.21.15.49:0/3500488330 shutdown_connections 2024-09-21T06:39:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0d180b6680 0x7f0d180b8b90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0d3010ddf0 0x7f0d3019fd00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0d30105270 0x7f0d3019aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 --2- 172.21.15.49:0/3500488330 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0d30104840 0x7f0d3019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.342+0000 7f0d38621640 1 -- 172.21.15.49:0/3500488330 >> 172.21.15.49:0/3500488330 conn(0x7f0d30079730 msgr2=0x7f0d30107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.343+0000 7f0d38621640 1 -- 172.21.15.49:0/3500488330 shutdown_connections 2024-09-21T06:39:32.357 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:32.343+0000 7f0d38621640 1 -- 172.21.15.49:0/3500488330 wait complete. 2024-09-21T06:39:34.049 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:39:34.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:39:34.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:33 smithi049 ceph-mon[31177]: pgmap v406: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-21T06:39:34.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:33 smithi098 ceph-mon[34704]: pgmap v406: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-21T06:39:34.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:33 smithi079 ceph-mon[34346]: pgmap v406: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-21T06:39:34.323 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.885+0000 7f8a89c21640 1 -- 172.21.15.49:0/2812692585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84105380 msgr2=0x7f8a8410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.885+0000 7f8a89c21640 1 --2- 172.21.15.49:0/2812692585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84105380 0x7f8a8410d8d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f8a78009900 tx=0x7f8a7802a410 comp rx=0 tx=0).stop 2024-09-21T06:39:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.885+0000 7f8a89c21640 1 -- 172.21.15.49:0/2812692585 shutdown_connections 2024-09-21T06:39:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.885+0000 7f8a89c21640 1 --2- 172.21.15.49:0/2812692585 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a8410de60 0x7f8a84110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.885+0000 7f8a89c21640 1 --2- 172.21.15.49:0/2812692585 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84105380 0x7f8a8410d8d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.885+0000 7f8a89c21640 1 --2- 172.21.15.49:0/2812692585 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a84104a30 0x7f8a84104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.885+0000 7f8a89c21640 1 -- 172.21.15.49:0/2812692585 >> 172.21.15.49:0/2812692585 conn(0x7f8a84079760 msgr2=0x7f8a84079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.885+0000 7f8a89c21640 1 -- 172.21.15.49:0/2812692585 shutdown_connections 2024-09-21T06:39:34.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.885+0000 7f8a89c21640 1 -- 172.21.15.49:0/2812692585 wait complete. 2024-09-21T06:39:34.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.886+0000 7f8a89c21640 1 Processor -- start 2024-09-21T06:39:34.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.886+0000 7f8a89c21640 1 -- start start 2024-09-21T06:39:34.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.886+0000 7f8a89c21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84104a30 0x7f8a84102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.886+0000 7f8a89c21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a84105380 0x7f8a84102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.886+0000 7f8a89c21640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a8410de60 0x7f8a841031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.886+0000 7f8a89c21640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84113aa0 con 0x7f8a84104a30 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.886+0000 7f8a89c21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84113920 con 0x7f8a84105380 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.886+0000 7f8a89c21640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a84113c20 con 0x7f8a8410de60 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.886+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84104a30 0x7f8a84102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a837fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84104a30 0x7f8a84102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58128/0 (socket says 172.21.15.49:58128) 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a837fe640 1 -- 172.21.15.49:0/3739631534 learned_addr learned my addr 172.21.15.49:0/3739631534 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a84105380 0x7f8a84102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a83fff640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a8410de60 0x7f8a841031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a837fe640 1 -- 172.21.15.49:0/3739631534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a8410de60 msgr2=0x7f8a841031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a837fe640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a8410de60 0x7f8a841031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a837fe640 1 -- 172.21.15.49:0/3739631534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a84105380 msgr2=0x7f8a84102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a837fe640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a84105380 0x7f8a84102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a837fe640 1 -- 172.21.15.49:0/3739631534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a841a8770 con 0x7f8a84104a30 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a837fe640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84104a30 0x7f8a84102770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400e9c0 tx=0x7f8a7400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:34.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a80ff9640 1 -- 172.21.15.49:0/3739631534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7400cd80 con 0x7f8a84104a30 2024-09-21T06:39:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a80ff9640 1 -- 172.21.15.49:0/3739631534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a740035f0 con 0x7f8a84104a30 2024-09-21T06:39:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a89c21640 1 -- 172.21.15.49:0/3739631534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a841a8a60 con 0x7f8a84104a30 2024-09-21T06:39:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a80ff9640 1 -- 172.21.15.49:0/3739631534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74010690 con 0x7f8a84104a30 2024-09-21T06:39:34.891 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.887+0000 7f8a89c21640 1 -- 172.21.15.49:0/3739631534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a841a8f70 con 0x7f8a84104a30 2024-09-21T06:39:34.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.890+0000 7f8a90195740 1 Processor -- start 2024-09-21T06:39:34.892 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.890+0000 7f8a90195740 1 -- start start 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.890+0000 7f8a80ff9640 1 -- 172.21.15.49:0/3739631534 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8a740037a0 con 0x7f8a84104a30 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.890+0000 7f8a90195740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0eb2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.890+0000 7f8a90195740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 0x55c2e0eb2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.890+0000 7f8a90195740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 0x55c2e0eb2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.890+0000 7f8a90195740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c2e0e28e60 con 0x55c2e0b0b350 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.890+0000 7f8a90195740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c2e0e18290 con 0x55c2e0aea670 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.890+0000 7f8a90195740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c2e0e1c0a0 con 0x55c2e0ae2490 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0eb2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0eb2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58138/0 (socket says 172.21.15.49:58138) 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a83fff640 1 -- 172.21.15.49:0/242515314 learned_addr learned my addr 172.21.15.49:0/242515314 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a837fe640 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 0x55c2e0eb2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 0x55c2e0eb2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a83fff640 1 -- 172.21.15.49:0/242515314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 msgr2=0x55c2e0eb2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:34.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a83fff640 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 0x55c2e0eb2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a83fff640 1 -- 172.21.15.49:0/242515314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 msgr2=0x55c2e0eb2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a83fff640 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 0x55c2e0eb2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a83fff640 1 -- 172.21.15.49:0/242515314 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e0b76930 con 0x55c2e0b0b350 2024-09-21T06:39:34.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a837fe640 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 0x55c2e0eb2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:34.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a83fff640 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0eb2430 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c010370 tx=0x7f8a7c010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450ae06805fb637b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:34.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a69ffb640 1 -- 172.21.15.49:0/242515314 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c016070 con 0x55c2e0b0b350 2024-09-21T06:39:34.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a80ff9640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a6c0b6680 0x7f8a6c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a69ffb640 1 -- 172.21.15.49:0/242515314 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a7c004d20 con 0x55c2e0b0b350 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.891+0000 7f8a69ffb640 1 -- 172.21.15.49:0/242515314 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c005370 con 0x55c2e0b0b350 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a837fe640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a6c0b6680 0x7f8a6c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a80ff9640 1 -- 172.21.15.49:0/3739631534 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a740e7a90 con 0x7f8a84104a30 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a837fe640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a6c0b6680 0x7f8a6c0b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a740e5270 tx=0x7f8a74021000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a90195740 1 -- 172.21.15.49:0/242515314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 msgr2=0x55c2e0eb2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a90195740 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0eb2430 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c010370 tx=0x7f8a7c010830 comp rx=0 tx=0).stop 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a90195740 1 -- 172.21.15.49:0/242515314 shutdown_connections 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a90195740 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 0x55c2e0eb2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a90195740 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 0x55c2e0eb2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a90195740 1 --2- 172.21.15.49:0/242515314 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0eb2430 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a90195740 1 -- 172.21.15.49:0/242515314 >> 172.21.15.49:0/242515314 conn(0x55c2e0aff740 msgr2=0x55c2e0eb0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a90195740 1 -- 172.21.15.49:0/242515314 shutdown_connections 2024-09-21T06:39:34.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.892+0000 7f8a90195740 1 -- 172.21.15.49:0/242515314 wait complete. 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a90195740 1 -- start start 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a90195740 1 Processor -- start 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a90195740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 0x55c2e0ebe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a90195740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0aea670 0x55c2e0ebe5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a90195740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0ec9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a90195740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c2e0c79890 con 0x55c2e0b0b350 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a90195740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c2e0db2d40 con 0x55c2e0ae2490 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a90195740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c2e0ec0c10 con 0x55c2e0aea670 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a90195740 10 client.0 _ll_register_callbacks cb 0x55c2e0e16c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0ec9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0ec9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58154/0 (socket says 172.21.15.49:58154) 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.893+0000 7f8a83fff640 1 -- 172.21.15.49:0/320684736 learned_addr learned my addr 172.21.15.49:0/320684736 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:34.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a83fff640 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 0x55c2e0ebe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0aea670 0x55c2e0ebe5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a83fff640 1 -- 172.21.15.49:0/320684736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0aea670 msgr2=0x55c2e0ebe5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a83fff640 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0aea670 0x55c2e0ebe5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a83fff640 1 -- 172.21.15.49:0/320684736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 msgr2=0x55c2e0ebe030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a83fff640 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 0x55c2e0ebe030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a83fff640 1 -- 172.21.15.49:0/320684736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e0eca510 con 0x55c2e0b0b350 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a83fff640 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0ec9f00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009db0 tx=0x7f8a7c012ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5f3cc58fa4662f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a62ffd640 1 -- 172.21.15.49:0/320684736 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c01e030 con 0x55c2e0b0b350 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a62ffd640 1 -- 172.21.15.49:0/320684736 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a7c023070 con 0x55c2e0b0b350 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a90195740 1 -- 172.21.15.49:0/320684736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a7c004d20 con 0x55c2e0b0b350 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a62ffd640 1 -- 172.21.15.49:0/320684736 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8a7c016070 con 0x55c2e0b0b350 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a90195740 10 client.16248 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.894+0000 7f8a90195740 1 -- 172.21.15.49:0/320684736 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c2e0eccdb0 con 0x55c2e0b0b350 2024-09-21T06:39:34.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.895+0000 7f8a62ffd640 1 -- 172.21.15.49:0/320684736 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a7c004d20 con 0x55c2e0b0b350 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.895+0000 7f8a62ffd640 1 -- 172.21.15.49:0/320684736 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f8a7c00f040 con 0x55c2e0b0b350 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.895+0000 7f8a90195740 10 client.16248 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.895+0000 7f8a90195740 10 client.16248 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.895+0000 7f8a90195740 20 client.16248 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.895+0000 7f8a90195740 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c2e0ac9cd0 0x55c2e0ed0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.895+0000 7f8a90195740 4 client.16248 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.895+0000 7f8a90195740 1 -- 172.21.15.49:0/320684736 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2e0e2adb0 con 0x55c2e0ac9cd0 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.895+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c2e0ac9cd0 0x55c2e0ed0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.896+0000 7f8a62ffd640 10 client.16248 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:34.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.896+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c2e0ac9cd0 0x55c2e0ed0170 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c643262fabf6b416 server_cookie=d8351ae02c1e14a9 in_seq=0 out_seq=0 2024-09-21T06:39:34.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a62ffd640 1 -- 172.21.15.49:0/320684736 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2e0e2adb0 con 0x55c2e0ac9cd0 2024-09-21T06:39:34.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a62ffd640 10 client.16248 handle_command_reply: tid=0 2024-09-21T06:39:34.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 client.16248 shutdown 2024-09-21T06:39:34.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 -- 172.21.15.49:0/320684736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 msgr2=0x55c2e0ec9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0ec9f00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009db0 tx=0x7f8a7c012ee0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 -- 172.21.15.49:0/320684736 shutdown_connections 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c2e0ac9cd0 0x55c2e0ed0170 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0b0b350 0x55c2e0ec9f00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0aea670 0x55c2e0ebe5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a62ffd640 0 client.16248 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 --2- 172.21.15.49:0/320684736 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 0x55c2e0ebe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 -- 172.21.15.49:0/320684736 >> 172.21.15.49:0/320684736 conn(0x55c2e0aff740 msgr2=0x55c2e0eb5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 -- 172.21.15.49:0/320684736 shutdown_connections 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 1 -- 172.21.15.49:0/320684736 wait complete. 2024-09-21T06:39:34.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.897+0000 7f8a90195740 20 client.16248 trim_cache size 0 max 16384 2024-09-21T06:39:34.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a90195740 1 Processor -- start 2024-09-21T06:39:34.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a90195740 1 -- start start 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a90195740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0eb5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a90195740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 0x55c2e0eb3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a90195740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 0x55c2e0eb7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a90195740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841b4390 con 0x55c2e0ac9cd0 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a90195740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841b1c60 con 0x55c2e0aea670 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a90195740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841afad0 con 0x55c2e0ae2490 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0eb5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0eb5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58164/0 (socket says 172.21.15.49:58164) 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a83fff640 1 -- 172.21.15.49:0/2468747525 learned_addr learned my addr 172.21.15.49:0/2468747525 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.915+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/2468747525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 0x55c2e0eb3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a83fff640 1 --2- 172.21.15.49:0/2468747525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 0x55c2e0eb7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a83fff640 1 -- 172.21.15.49:0/2468747525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 msgr2=0x55c2e0eb3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a83fff640 1 --2- 172.21.15.49:0/2468747525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 0x55c2e0eb3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a83fff640 1 -- 172.21.15.49:0/2468747525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 msgr2=0x55c2e0eb7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:34.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a83fff640 1 --2- 172.21.15.49:0/2468747525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 0x55c2e0eb7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a83fff640 1 -- 172.21.15.49:0/2468747525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e0eab9e0 con 0x55c2e0ac9cd0 2024-09-21T06:39:34.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a83fff640 1 --2- 172.21.15.49:0/2468747525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0eb5ba0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009c80 tx=0x7f8a7c0096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13af661971f2e5b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:34.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a697fa640 1 -- 172.21.15.49:0/2468747525 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c03a070 con 0x55c2e0ac9cd0 2024-09-21T06:39:34.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a697fa640 1 -- 172.21.15.49:0/2468747525 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a7c01f040 con 0x55c2e0ac9cd0 2024-09-21T06:39:34.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.916+0000 7f8a697fa640 1 -- 172.21.15.49:0/2468747525 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c01e030 con 0x55c2e0ac9cd0 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 -- 172.21.15.49:0/2468747525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0ac9cd0 msgr2=0x55c2e0eb5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 --2- 172.21.15.49:0/2468747525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0eb5ba0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c009c80 tx=0x7f8a7c0096f0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 -- 172.21.15.49:0/2468747525 shutdown_connections 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 --2- 172.21.15.49:0/2468747525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0aea670 0x55c2e0eb7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 --2- 172.21.15.49:0/2468747525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ae2490 0x55c2e0eb3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 --2- 172.21.15.49:0/2468747525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0eb5ba0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 -- 172.21.15.49:0/2468747525 >> 172.21.15.49:0/2468747525 conn(0x55c2e0aff740 msgr2=0x55c2e0eb3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 -- 172.21.15.49:0/2468747525 shutdown_connections 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 -- 172.21.15.49:0/2468747525 wait complete. 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 -- start start 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.917+0000 7f8a90195740 1 Processor -- start 2024-09-21T06:39:34.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a90195740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0ec1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a90195740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 0x55c2e0ec23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a90195740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0aea670 0x55c2e0ec2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a90195740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841b0120 con 0x55c2e0aea670 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a90195740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841b1590 con 0x55c2e0ae2490 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a90195740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a841b07f0 con 0x55c2e0ac9cd0 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a90195740 10 client.0 _ll_register_callbacks cb 0x7f8a7c009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0aea670 0x55c2e0ec2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0aea670 0x55c2e0ec2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58174/0 (socket says 172.21.15.49:58174) 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a83fff640 1 -- 172.21.15.49:0/3772223815 learned_addr learned my addr 172.21.15.49:0/3772223815 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 0x55c2e0ec23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a83fff640 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0ec1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a82ffd640 1 -- 172.21.15.49:0/3772223815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ac9cd0 msgr2=0x55c2e0ec1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0ec1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a82ffd640 1 -- 172.21.15.49:0/3772223815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0aea670 msgr2=0x55c2e0ec2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:34.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0aea670 0x55c2e0ec2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a82ffd640 1 -- 172.21.15.49:0/3772223815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e0eb0860 con 0x55c2e0ae2490 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.918+0000 7f8a83fff640 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0aea670 0x55c2e0ec2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a82ffd640 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 0x55c2e0ec23c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8a7802a930 tx=0x7f8a78032da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1a2dc608fdbc862 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a62ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a62ffd640 1 -- 172.21.15.49:0/3772223815 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a78035040 con 0x55c2e0ae2490 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a90195740 1 -- 172.21.15.49:0/3772223815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a7c01f040 con 0x55c2e0ae2490 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a62ffd640 1 -- 172.21.15.49:0/3772223815 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a78004450 con 0x55c2e0ae2490 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a62ffd640 1 -- 172.21.15.49:0/3772223815 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8a78052050 con 0x55c2e0ae2490 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a90195740 10 client.25829 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a90195740 1 -- 172.21.15.49:0/3772223815 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c2e0f3ab60 con 0x55c2e0ae2490 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a62ffd640 1 -- 172.21.15.49:0/3772223815 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a7c01f040 con 0x55c2e0ae2490 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a62ffd640 1 -- 172.21.15.49:0/3772223815 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f8a78004c10 con 0x55c2e0ae2490 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a90195740 10 client.25829 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:34.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a90195740 10 client.25829 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.919+0000 7f8a90195740 20 client.25829 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.920+0000 7f8a90195740 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c2e0b0b350 0x55c2e0f3d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.920+0000 7f8a90195740 4 client.25829 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:39:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.920+0000 7f8a90195740 1 -- 172.21.15.49:0/3772223815 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c2e0e26860 con 0x55c2e0b0b350 2024-09-21T06:39:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.920+0000 7f8a83fff640 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c2e0b0b350 0x55c2e0f3d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.920+0000 7f8a62ffd640 10 client.25829 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:34.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.920+0000 7f8a83fff640 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c2e0b0b350 0x55c2e0f3d380 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eb3bda5ba01d9aa server_cookie=2082929836c2cc95 in_seq=0 out_seq=0 2024-09-21T06:39:34.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a62ffd640 1 -- 172.21.15.49:0/3772223815 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c2e0e26860 con 0x55c2e0b0b350 2024-09-21T06:39:34.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a62ffd640 10 client.25829 handle_command_reply: tid=0 2024-09-21T06:39:34.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 client.25829 shutdown 2024-09-21T06:39:34.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 -- 172.21.15.49:0/3772223815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 msgr2=0x55c2e0ec23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 0x55c2e0ec23c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8a7802a930 tx=0x7f8a78032da0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 -- 172.21.15.49:0/3772223815 shutdown_connections 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c2e0b0b350 0x55c2e0f3d380 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c2e0aea670 0x55c2e0ec2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c2e0ae2490 0x55c2e0ec23c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 --2- 172.21.15.49:0/3772223815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c2e0ac9cd0 0x55c2e0ec1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 -- 172.21.15.49:0/3772223815 >> 172.21.15.49:0/3772223815 conn(0x55c2e0aff740 msgr2=0x55c2e0ebf2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a62ffd640 0 client.25829 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 -- 172.21.15.49:0/3772223815 shutdown_connections 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 1 -- 172.21.15.49:0/3772223815 wait complete. 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.922+0000 7f8a90195740 20 client.25829 trim_cache size 0 max 16384 2024-09-21T06:39:34.927 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:39:34.928 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:39:34.928 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "4bd84fa8-1338-4afa-98e9-00f348e94a4e", 2024-09-21T06:39:34.928 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:39:34.928 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:39:34.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 -- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a6c0b6680 msgr2=0x7f8a6c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a6c0b6680 0x7f8a6c0b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f8a740e5270 tx=0x7f8a74021000 comp rx=0 tx=0).stop 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 -- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84104a30 msgr2=0x7f8a84102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84104a30 0x7f8a84102770 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400e9c0 tx=0x7f8a7400ee80 comp rx=0 tx=0).stop 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 -- 172.21.15.49:0/3739631534 shutdown_connections 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a6c0b6680 0x7f8a6c0b8b90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a8410de60 0x7f8a841031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a84105380 0x7f8a84102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 --2- 172.21.15.49:0/3739631534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a84104a30 0x7f8a84102770 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 -- 172.21.15.49:0/3739631534 >> 172.21.15.49:0/3739631534 conn(0x7f8a84079760 msgr2=0x7f8a841008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 -- 172.21.15.49:0/3739631534 shutdown_connections 2024-09-21T06:39:34.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:34.923+0000 7f8a89c21640 1 -- 172.21.15.49:0/3739631534 wait complete. 2024-09-21T06:39:35.833 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:39:36.099 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:36.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:35 smithi049 ceph-mon[31177]: pgmap v407: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:39:36.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:35 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:39:36.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:35 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:36.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:35 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:39:36.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:35 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:39:36.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:35 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:36.221 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:35 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:36.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:35 smithi098 ceph-mon[34704]: pgmap v407: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:39:36.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:35 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:39:36.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:35 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:36.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:35 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:39:36.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:35 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:39:36.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:35 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:36.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:35 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:36.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:35 smithi079 ceph-mon[34346]: pgmap v407: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:39:36.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:35 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:39:36.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:35 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:36.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:35 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:39:36.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:35 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:39:36.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:35 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:36.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:35 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:36.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.603+0000 7f9c36b66640 1 -- 172.21.15.49:0/3556204904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c301049b0 msgr2=0x7f9c30104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.603+0000 7f9c36b66640 1 --2- 172.21.15.49:0/3556204904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c301049b0 0x7f9c30104dc0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009900 tx=0x7f9c2402a410 comp rx=0 tx=0).stop 2024-09-21T06:39:36.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.603+0000 7f9c36b66640 1 -- 172.21.15.49:0/3556204904 shutdown_connections 2024-09-21T06:39:36.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.603+0000 7f9c36b66640 1 --2- 172.21.15.49:0/3556204904 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c3010de10 0x7f9c30110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.603+0000 7f9c36b66640 1 --2- 172.21.15.49:0/3556204904 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c30105300 0x7f9c3010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.603+0000 7f9c36b66640 1 --2- 172.21.15.49:0/3556204904 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c301049b0 0x7f9c30104dc0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.603+0000 7f9c36b66640 1 -- 172.21.15.49:0/3556204904 >> 172.21.15.49:0/3556204904 conn(0x7f9c30079730 msgr2=0x7f9c30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.603+0000 7f9c36b66640 1 -- 172.21.15.49:0/3556204904 shutdown_connections 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.603+0000 7f9c36b66640 1 -- 172.21.15.49:0/3556204904 wait complete. 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c36b66640 1 Processor -- start 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c36b66640 1 -- start start 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c36b66640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c301049b0 0x7f9c3019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c36b66640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c30105300 0x7f9c3019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c36b66640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c3010de10 0x7f9c3019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c36b66640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30113a70 con 0x7f9c30105300 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c36b66640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301138f0 con 0x7f9c301049b0 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c36b66640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c30113bf0 con 0x7f9c3010de10 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c30105300 0x7f9c3019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c30105300 0x7f9c3019aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40502/0 (socket says 172.21.15.49:40502) 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.604+0000 7f9c2ffff640 1 -- 172.21.15.49:0/453577208 learned_addr learned my addr 172.21.15.49:0/453577208 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c35103640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c3010de10 0x7f9c3019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c34902640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c301049b0 0x7f9c3019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c2ffff640 1 -- 172.21.15.49:0/453577208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c3010de10 msgr2=0x7f9c3019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c3010de10 0x7f9c3019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c2ffff640 1 -- 172.21.15.49:0/453577208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c301049b0 msgr2=0x7f9c3019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c301049b0 0x7f9c3019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c2ffff640 1 -- 172.21.15.49:0/453577208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c301a0390 con 0x7f9c30105300 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c34902640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c301049b0 0x7f9c3019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c35103640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c3010de10 0x7f9c3019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c30105300 0x7f9c3019aa80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00c970 tx=0x7f9c1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c2dffb640 1 -- 172.21.15.49:0/453577208 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c007bb0 con 0x7f9c30105300 2024-09-21T06:39:36.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c2dffb640 1 -- 172.21.15.49:0/453577208 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c1c007d50 con 0x7f9c30105300 2024-09-21T06:39:36.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c36b66640 1 -- 172.21.15.49:0/453577208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c301a0680 con 0x7f9c30105300 2024-09-21T06:39:36.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c2dffb640 1 -- 172.21.15.49:0/453577208 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00f450 con 0x7f9c30105300 2024-09-21T06:39:36.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.605+0000 7f9c36b66640 1 -- 172.21.15.49:0/453577208 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c301a6ea0 con 0x7f9c30105300 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c2dffb640 1 -- 172.21.15.49:0/453577208 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9c1c004eb0 con 0x7f9c30105300 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c3d0da740 1 Processor -- start 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c3d0da740 1 -- start start 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec1e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 0x55981ec1eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec1f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55981eb94e50 con 0x55981e877070 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55981eb84280 con 0x55981e84e1b0 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55981eb88090 con 0x55981e856390 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c35103640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec1e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.608+0000 7f9c35103640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec1e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40506/0 (socket says 172.21.15.49:40506) 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c35103640 1 -- 172.21.15.49:0/751482007 learned_addr learned my addr 172.21.15.49:0/751482007 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:36.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c34902640 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 0x55981ec1eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec1f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c2dffb640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9c200b66b0 0x7f9c200b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c35103640 1 -- 172.21.15.49:0/751482007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 msgr2=0x55981ec1f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c35103640 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec1f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c35103640 1 -- 172.21.15.49:0/751482007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 msgr2=0x55981ec1eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c35103640 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 0x55981ec1eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c35103640 1 -- 172.21.15.49:0/751482007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55981e8e2650 con 0x55981e877070 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec1f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c2dffb640 1 -- 172.21.15.49:0/453577208 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9c1c0e7500 con 0x7f9c30105300 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c35103640 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec1e650 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9c28008e60 tx=0x7f9c2800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a203b106b8ad04f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c35103640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9c200b66b0 0x7f9c200b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.609+0000 7f9c1affd640 1 -- 172.21.15.49:0/751482007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2800f870 con 0x55981e877070 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.610+0000 7f9c1affd640 1 -- 172.21.15.49:0/751482007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c2800fc70 con 0x55981e877070 2024-09-21T06:39:36.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.610+0000 7f9c1affd640 1 -- 172.21.15.49:0/751482007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c280177f0 con 0x55981e877070 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.610+0000 7f9c3d0da740 1 -- 172.21.15.49:0/751482007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 msgr2=0x55981ec1e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.610+0000 7f9c35103640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9c200b66b0 0x7f9c200b8bc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9c28008fd0 tx=0x7f9c28017e20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.610+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec1e650 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9c28008e60 tx=0x7f9c2800d710 comp rx=0 tx=0).stop 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.611+0000 7f9c3d0da740 1 -- 172.21.15.49:0/751482007 shutdown_connections 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.611+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec1f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.611+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 0x55981ec1eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.611+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/751482007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec1e650 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.611+0000 7f9c3d0da740 1 -- 172.21.15.49:0/751482007 >> 172.21.15.49:0/751482007 conn(0x55981e86b460 msgr2=0x55981ec1c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.611+0000 7f9c3d0da740 1 -- 172.21.15.49:0/751482007 shutdown_connections 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.611+0000 7f9c3d0da740 1 -- 172.21.15.49:0/751482007 wait complete. 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.611+0000 7f9c3d0da740 1 -- start start 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.611+0000 7f9c3d0da740 1 Processor -- start 2024-09-21T06:39:36.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e84e1b0 0x55981ec29d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec2a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 0x55981ec36120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55981e9e5700 con 0x55981e84e1b0 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55981eb1f110 con 0x55981e877070 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55981ec2ce30 con 0x55981e856390 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c3d0da740 10 client.0 _ll_register_callbacks cb 0x55981eb38990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c34902640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e84e1b0 0x55981ec29d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c34902640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e84e1b0 0x55981ec29d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40510/0 (socket says 172.21.15.49:40510) 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c34902640 1 -- 172.21.15.49:0/3771387696 learned_addr learned my addr 172.21.15.49:0/3771387696 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec2a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c35103640 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 0x55981ec36120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c34902640 1 -- 172.21.15.49:0/3771387696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 msgr2=0x55981ec2a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c34902640 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec2a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c34902640 1 -- 172.21.15.49:0/3771387696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 msgr2=0x55981ec36120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c34902640 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 0x55981ec36120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.612+0000 7f9c34902640 1 -- 172.21.15.49:0/3771387696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55981eb4cc40 con 0x55981e84e1b0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c34902640 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e84e1b0 0x55981ec29d40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009900 tx=0x7f9c240316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad06ba6c756a4f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3771387696 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c24040070 con 0x55981e84e1b0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3771387696 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9c24004250 con 0x55981e84e1b0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3771387696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c2800fc70 con 0x55981e84e1b0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3771387696 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9c24035040 con 0x55981e84e1b0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c3d0da740 10 client.16266 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3771387696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55981ec38b40 con 0x55981e84e1b0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3771387696 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c2800fc70 con 0x55981e84e1b0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3771387696 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f9c240049f0 con 0x55981e84e1b0 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c3d0da740 10 client.16266 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:36.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c3d0da740 10 client.16266 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c3d0da740 20 client.16266 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55981e8359f0 0x55981ec3c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c3d0da740 4 client.16266 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.613+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3771387696 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55981eb96da0 con 0x55981e8359f0 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.614+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55981e8359f0 0x55981ec3c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.614+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55981e8359f0 0x55981ec3c0a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e97d2b0e8b4d161 server_cookie=4d1ca43572502da9 in_seq=0 out_seq=0 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.614+0000 7f9c0ffff640 10 client.16266 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3771387696 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55981eb96da0 con 0x55981e8359f0 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c0ffff640 10 client.16266 handle_command_reply: tid=0 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c3d0da740 1 client.16266 shutdown 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3771387696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e84e1b0 msgr2=0x55981ec29d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e84e1b0 0x55981ec29d40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9c24009900 tx=0x7f9c240316d0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3771387696 shutdown_connections 2024-09-21T06:39:36.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55981e8359f0 0x55981ec3c0a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 0x55981ec36120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec2a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c0ffff640 0 client.16266 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3771387696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e84e1b0 0x55981ec29d40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.615+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3771387696 >> 172.21.15.49:0/3771387696 conn(0x55981e86b460 msgr2=0x55981ec21830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.616+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3771387696 shutdown_connections 2024-09-21T06:39:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.616+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3771387696 wait complete. 2024-09-21T06:39:36.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.616+0000 7f9c3d0da740 20 client.16266 trim_cache size 0 max 16384 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.633+0000 7f9c3d0da740 1 Processor -- start 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.633+0000 7f9c3d0da740 1 -- start start 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.633+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 0x55981ec1c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.633+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec36020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.633+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec21750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.633+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301b2140 con 0x55981e877070 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.633+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301afa10 con 0x55981e84e1b0 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.633+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301ad880 con 0x55981e856390 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.633+0000 7f9c35103640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec21750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c35103640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec21750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40522/0 (socket says 172.21.15.49:40522) 2024-09-21T06:39:36.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c35103640 1 -- 172.21.15.49:0/1883551315 learned_addr learned my addr 172.21.15.49:0/1883551315 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c34902640 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 0x55981ec1c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c35103640 1 -- 172.21.15.49:0/1883551315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 msgr2=0x55981ec36020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec36020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c35103640 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec36020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c35103640 1 -- 172.21.15.49:0/1883551315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 msgr2=0x55981ec1c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c35103640 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 0x55981ec1c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c35103640 1 -- 172.21.15.49:0/1883551315 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55981ec1f460 con 0x55981e877070 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c34902640 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 0x55981ec1c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c35103640 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec21750 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9c28008e30 tx=0x7f9c28024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4b790eaac40d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c1a7fc640 1 -- 172.21.15.49:0/1883551315 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2802a040 con 0x55981e877070 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c1a7fc640 1 -- 172.21.15.49:0/1883551315 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c28035070 con 0x55981e877070 2024-09-21T06:39:36.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.634+0000 7f9c1a7fc640 1 -- 172.21.15.49:0/1883551315 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c2800ee50 con 0x55981e877070 2024-09-21T06:39:36.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 -- 172.21.15.49:0/1883551315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 msgr2=0x55981ec21750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec21750 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9c28008e30 tx=0x7f9c28024000 comp rx=0 tx=0).stop 2024-09-21T06:39:36.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 -- 172.21.15.49:0/1883551315 shutdown_connections 2024-09-21T06:39:36.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e877070 0x55981ec21750 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e856390 0x55981ec36020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/1883551315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e84e1b0 0x55981ec1c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 -- 172.21.15.49:0/1883551315 >> 172.21.15.49:0/1883551315 conn(0x55981e86b460 msgr2=0x55981ec1bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:36.640 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 -- 172.21.15.49:0/1883551315 shutdown_connections 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 -- 172.21.15.49:0/1883551315 wait complete. 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.635+0000 7f9c3d0da740 1 -- start start 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c3d0da740 1 Processor -- start 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e84e1b0 0x55981ec2e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e856390 0x55981ec2e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c3d0da740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 0x55981eca9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301aded0 con 0x55981e856390 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301af340 con 0x55981e877070 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c3d0da740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9c301ae5a0 con 0x55981e84e1b0 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c3d0da740 10 client.0 _ll_register_callbacks cb 0x7f9c24005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e856390 0x55981ec2e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e856390 0x55981ec2e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40536/0 (socket says 172.21.15.49:40536) 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c2ffff640 1 -- 172.21.15.49:0/3715668288 learned_addr learned my addr 172.21.15.49:0/3715668288 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:36.641 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.636+0000 7f9c34902640 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e84e1b0 0x55981ec2e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c35103640 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 0x55981eca9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c2ffff640 1 -- 172.21.15.49:0/3715668288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e84e1b0 msgr2=0x55981ec2e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e84e1b0 0x55981ec2e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c2ffff640 1 -- 172.21.15.49:0/3715668288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 msgr2=0x55981eca9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 0x55981eca9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c2ffff640 1 -- 172.21.15.49:0/3715668288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55981ec2f0f0 con 0x55981e856390 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c2ffff640 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e856390 0x55981ec2e850 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ad030 tx=0x7f9c1c004910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a284fbe7075ab9ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3715668288 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c01d040 con 0x55981e856390 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3715668288 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9c1c0e4eb0 con 0x55981e856390 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3715668288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c28035070 con 0x55981e856390 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3715668288 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9c1c0ada30 con 0x55981e856390 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c3d0da740 10 client.16272 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:36.642 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3715668288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55981ecab410 con 0x55981e856390 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.637+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3715668288 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c28035070 con 0x55981e856390 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.638+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3715668288 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7f9c1c0051a0 con 0x55981e856390 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.638+0000 7f9c3d0da740 10 client.16272 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.638+0000 7f9c3d0da740 10 client.16272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.638+0000 7f9c3d0da740 20 client.16272 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.638+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55981e80ada0 0x55981ecadb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.638+0000 7f9c3d0da740 4 client.16272 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.638+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3715668288 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55981eb92850 con 0x55981e80ada0 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.638+0000 7f9c34902640 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55981e80ada0 0x55981ecadb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c34902640 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55981e80ada0 0x55981ecadb30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53bea55043b55745 server_cookie=898d1f44f9cdb195 in_seq=0 out_seq=0 2024-09-21T06:39:36.643 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c0ffff640 10 client.16272 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:36.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c0ffff640 1 -- 172.21.15.49:0/3715668288 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55981eb92850 con 0x55981e80ada0 2024-09-21T06:39:36.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c0ffff640 10 client.16272 handle_command_reply: tid=0 2024-09-21T06:39:36.644 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 client.16272 shutdown 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3715668288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e856390 msgr2=0x55981ec2e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e856390 0x55981ec2e850 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ad030 tx=0x7f9c1c004910 comp rx=0 tx=0).stop 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3715668288 shutdown_connections 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55981e80ada0 0x55981ecadb30 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55981e877070 0x55981eca9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55981e856390 0x55981ec2e850 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 --2- 172.21.15.49:0/3715668288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55981e84e1b0 0x55981ec2e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3715668288 >> 172.21.15.49:0/3715668288 conn(0x55981e86b460 msgr2=0x55981ec21750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c0ffff640 0 client.16272 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.639+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3715668288 shutdown_connections 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c3d0da740 1 -- 172.21.15.49:0/3715668288 wait complete. 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c3d0da740 20 client.16272 trim_cache size 0 max 16384 2024-09-21T06:39:36.645 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "4bd84fa8-1338-4afa-98e9-00f348e94a4e", 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:36.646 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:36.647 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:36.648 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:39:36.649 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:39:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 -- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9c200b66b0 msgr2=0x7f9c200b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9c200b66b0 0x7f9c200b8bc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9c28008fd0 tx=0x7f9c28017e20 comp rx=0 tx=0).stop 2024-09-21T06:39:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 -- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c30105300 msgr2=0x7f9c3019aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c30105300 0x7f9c3019aa80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00c970 tx=0x7f9c1c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:39:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 -- 172.21.15.49:0/453577208 shutdown_connections 2024-09-21T06:39:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9c200b66b0 0x7f9c200b8bc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9c3010de10 0x7f9c3019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9c30105300 0x7f9c3019aa80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 --2- 172.21.15.49:0/453577208 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9c301049b0 0x7f9c3019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 -- 172.21.15.49:0/453577208 >> 172.21.15.49:0/453577208 conn(0x7f9c30079730 msgr2=0x7f9c30100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 -- 172.21.15.49:0/453577208 shutdown_connections 2024-09-21T06:39:36.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:39:36.640+0000 7f9c36b66640 1 -- 172.21.15.49:0/453577208 wait complete. 2024-09-21T06:39:37.435 INFO:tasks.cephfs.filesystem:scrub status for tag:4bd84fa8-1338-4afa-98e9-00f348e94a4e - {'path': '/', 'tag': '4bd84fa8-1338-4afa-98e9-00f348e94a4e', 'options': 'recursive,force'} 2024-09-21T06:39:38.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:37 smithi049 ceph-mon[31177]: pgmap v408: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-21T06:39:38.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:37 smithi098 ceph-mon[34704]: pgmap v408: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-21T06:39:38.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:37 smithi079 ceph-mon[34346]: pgmap v408: 97 pgs: 97 active+clean; 2.6 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 KiB/s wr, 11 op/s 2024-09-21T06:39:40.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:39 smithi049 ceph-mon[31177]: pgmap v409: 97 pgs: 97 active+clean; 2.7 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-21T06:39:40.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:39 smithi098 ceph-mon[34704]: pgmap v409: 97 pgs: 97 active+clean; 2.7 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-21T06:39:40.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:39 smithi079 ceph-mon[34346]: pgmap v409: 97 pgs: 97 active+clean; 2.7 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 17 op/s 2024-09-21T06:39:42.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:41 smithi049 ceph-mon[31177]: pgmap v410: 97 pgs: 97 active+clean; 2.7 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-21T06:39:42.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:41 smithi098 ceph-mon[34704]: pgmap v410: 97 pgs: 97 active+clean; 2.7 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-21T06:39:42.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:41 smithi079 ceph-mon[34346]: pgmap v410: 97 pgs: 97 active+clean; 2.7 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-21T06:39:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.974+0000 7fce9b939640 1 -- 172.21.15.49:0/2937433873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce941029c0 msgr2=0x7fce94102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.974+0000 7fce9b939640 1 --2- 172.21.15.49:0/2937433873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce941029c0 0x7fce94102dd0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fce90009900 tx=0x7fce9002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.974+0000 7fce9b939640 1 -- 172.21.15.49:0/2937433873 shutdown_connections 2024-09-21T06:39:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.974+0000 7fce9b939640 1 --2- 172.21.15.49:0/2937433873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce94108c40 0x7fce9410f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.974+0000 7fce9b939640 1 --2- 172.21.15.49:0/2937433873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce941082f0 0x7fce94108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.974+0000 7fce9b939640 1 --2- 172.21.15.49:0/2937433873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce941029c0 0x7fce94102dd0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.974+0000 7fce9b939640 1 -- 172.21.15.49:0/2937433873 >> 172.21.15.49:0/2937433873 conn(0x7fce940fe3c0 msgr2=0x7fce94100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.974+0000 7fce9b939640 1 -- 172.21.15.49:0/2937433873 shutdown_connections 2024-09-21T06:39:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.974+0000 7fce9b939640 1 -- 172.21.15.49:0/2937433873 wait complete. 2024-09-21T06:39:42.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce9b939640 1 Processor -- start 2024-09-21T06:39:42.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce9b939640 1 -- start start 2024-09-21T06:39:42.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce9b939640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce941029c0 0x7fce9419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce9b939640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce941082f0 0x7fce9419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce9b939640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce94108c40 0x7fce9419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce9b939640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fce94112950 con 0x7fce94108c40 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce9b939640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce941127d0 con 0x7fce941029c0 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce9b939640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce94112ad0 con 0x7fce941082f0 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce99ed6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce94108c40 0x7fce9419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce99ed6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce94108c40 0x7fce9419fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40550/0 (socket says 172.21.15.49:40550) 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce99ed6640 1 -- 172.21.15.49:0/1552868554 learned_addr learned my addr 172.21.15.49:0/1552868554 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.975+0000 7fce996d5640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce941029c0 0x7fce9419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce98ed4640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce941082f0 0x7fce9419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce99ed6640 1 -- 172.21.15.49:0/1552868554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce941082f0 msgr2=0x7fce9419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce99ed6640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce941082f0 0x7fce9419aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce99ed6640 1 -- 172.21.15.49:0/1552868554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce941029c0 msgr2=0x7fce9419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce99ed6640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce941029c0 0x7fce9419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce99ed6640 1 -- 172.21.15.49:0/1552868554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce941a0470 con 0x7fce94108c40 2024-09-21T06:39:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce99ed6640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce94108c40 0x7fce9419fd70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00eaa0 tx=0x7fce8c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce8a7fc640 1 -- 172.21.15.49:0/1552868554 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c00cdb0 con 0x7fce94108c40 2024-09-21T06:39:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce9b939640 1 -- 172.21.15.49:0/1552868554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce941a0760 con 0x7fce94108c40 2024-09-21T06:39:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce8a7fc640 1 -- 172.21.15.49:0/1552868554 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce8c005020 con 0x7fce94108c40 2024-09-21T06:39:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce8a7fc640 1 -- 172.21.15.49:0/1552868554 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c0116d0 con 0x7fce94108c40 2024-09-21T06:39:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.976+0000 7fce9b939640 1 -- 172.21.15.49:0/1552868554 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce941a6ef0 con 0x7fce94108c40 2024-09-21T06:39:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.979+0000 7fcea28a5740 1 Processor -- start 2024-09-21T06:39:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.979+0000 7fce8a7fc640 1 -- 172.21.15.49:0/1552868554 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fce8c0051d0 con 0x7fce94108c40 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.979+0000 7fcea28a5740 1 -- start start 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003add61b0 0x56003b17b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adad2f0 0x56003b17bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003adb54d0 0x56003b17c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fcea28a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56003b0f06f0 con 0x56003add61b0 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fcea28a5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56003b0dfb20 con 0x56003adb54d0 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fcea28a5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56003b0e3930 con 0x56003adad2f0 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003add61b0 0x56003b17b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003add61b0 0x56003b17b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40554/0 (socket says 172.21.15.49:40554) 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 -- 172.21.15.49:0/1383905616 learned_addr learned my addr 172.21.15.49:0/1383905616 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce996d5640 1 --2- 172.21.15.49:0/1383905616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adad2f0 0x56003b17bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 --2- 172.21.15.49:0/1383905616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003adb54d0 0x56003b17c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce8a7fc640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce800b6680 0x7fce800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 -- 172.21.15.49:0/1383905616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adad2f0 msgr2=0x56003b17bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 --2- 172.21.15.49:0/1383905616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adad2f0 0x56003b17bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 -- 172.21.15.49:0/1383905616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003adb54d0 msgr2=0x56003b17c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 --2- 172.21.15.49:0/1383905616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003adb54d0 0x56003b17c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 -- 172.21.15.49:0/1383905616 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56003b0a5530 con 0x56003add61b0 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce99ed6640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce800b6680 0x7fce800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce8a7fc640 1 -- 172.21.15.49:0/1552868554 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fce8c0e78f0 con 0x7fce94108c40 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.980+0000 7fce98ed4640 1 --2- 172.21.15.49:0/1383905616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003add61b0 0x56003b17b9b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fce84012390 tx=0x7fce84009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51adeb219b997690 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.981+0000 7fce7f7fe640 1 -- 172.21.15.49:0/1383905616 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8401a030 con 0x56003add61b0 2024-09-21T06:39:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.981+0000 7fce7f7fe640 1 -- 172.21.15.49:0/1383905616 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce84012070 con 0x56003add61b0 2024-09-21T06:39:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.981+0000 7fce7f7fe640 1 -- 172.21.15.49:0/1383905616 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84003c50 con 0x56003add61b0 2024-09-21T06:39:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.981+0000 7fcea28a5740 1 -- 172.21.15.49:0/1383905616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003add61b0 msgr2=0x56003b17b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.981+0000 7fce99ed6640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce800b6680 0x7fce800b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0e50d0 tx=0x7fce8c0a1f80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.981+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1383905616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003add61b0 0x56003b17b9b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fce84012390 tx=0x7fce84009740 comp rx=0 tx=0).stop 2024-09-21T06:39:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.982+0000 7fcea28a5740 1 -- 172.21.15.49:0/1383905616 shutdown_connections 2024-09-21T06:39:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.982+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1383905616 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003adb54d0 0x56003b17c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.982+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1383905616 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adad2f0 0x56003b17bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.982+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1383905616 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003add61b0 0x56003b17b9b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.982+0000 7fcea28a5740 1 -- 172.21.15.49:0/1383905616 >> 172.21.15.49:0/1383905616 conn(0x56003adca300 msgr2=0x56003b1798a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.982+0000 7fcea28a5740 1 -- 172.21.15.49:0/1383905616 shutdown_connections 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.982+0000 7fcea28a5740 1 -- 172.21.15.49:0/1383905616 wait complete. 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.982+0000 7fcea28a5740 1 -- start start 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.982+0000 7fcea28a5740 1 Processor -- start 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b186ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b187530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b193450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fcea28a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56003b017ab0 con 0x56003adad2f0 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fcea28a5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56003b085730 con 0x56003add61b0 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fcea28a5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56003b18a130 con 0x56003adb54d0 2024-09-21T06:39:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fcea28a5740 10 client.0 _ll_register_callbacks cb 0x56003b0d96b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce98ed4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b186ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce98ed4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b186ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40564/0 (socket says 172.21.15.49:40564) 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce98ed4640 1 -- 172.21.15.49:0/1898370684 learned_addr learned my addr 172.21.15.49:0/1898370684 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce996d5640 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b187530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce98ed4640 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b193450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce98ed4640 1 -- 172.21.15.49:0/1898370684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 msgr2=0x56003b187530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce98ed4640 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b187530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce98ed4640 1 -- 172.21.15.49:0/1898370684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 msgr2=0x56003b193450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce98ed4640 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b193450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.983+0000 7fce98ed4640 1 -- 172.21.15.49:0/1898370684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56003ae41790 con 0x56003adad2f0 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fce98ed4640 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b186ff0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fce84009a50 tx=0x7fce84003830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d359e7a41d2c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fce7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fce7cff9640 1 -- 172.21.15.49:0/1898370684 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84005250 con 0x56003adad2f0 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fcea28a5740 1 -- 172.21.15.49:0/1898370684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce84012070 con 0x56003adad2f0 2024-09-21T06:39:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fce7cff9640 1 -- 172.21.15.49:0/1898370684 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fce840053f0 con 0x56003adad2f0 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fce7cff9640 1 -- 172.21.15.49:0/1898370684 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fce840055f0 con 0x56003adad2f0 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fcea28a5740 10 client.16284 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fcea28a5740 1 -- 172.21.15.49:0/1898370684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56003aeba620 con 0x56003adad2f0 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fce7cff9640 1 -- 172.21.15.49:0/1898370684 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce84012070 con 0x56003adad2f0 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.984+0000 7fce7cff9640 1 -- 172.21.15.49:0/1898370684 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fce8400f040 con 0x56003adad2f0 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.985+0000 7fcea28a5740 10 client.16284 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.985+0000 7fcea28a5740 10 client.16284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.985+0000 7fcea28a5740 20 client.16284 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.985+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56003ad94d80 0x56003b199060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.985+0000 7fcea28a5740 4 client.16284 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.985+0000 7fcea28a5740 1 -- 172.21.15.49:0/1898370684 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56003b0f2640 con 0x56003ad94d80 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.985+0000 7fce996d5640 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56003ad94d80 0x56003b199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.985+0000 7fce996d5640 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56003ad94d80 0x56003b199060 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13a05c14bb79b2db server_cookie=ec4fb2a0177546c8 in_seq=0 out_seq=0 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.985+0000 7fce7cff9640 10 client.16284 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fce7cff9640 1 -- 172.21.15.49:0/1898370684 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56003b0f2640 con 0x56003ad94d80 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fce7cff9640 10 client.16284 handle_command_reply: tid=0 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fcea28a5740 1 client.16284 shutdown 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fcea28a5740 1 -- 172.21.15.49:0/1898370684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 msgr2=0x56003b186ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b186ff0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fce84009a50 tx=0x7fce84003830 comp rx=0 tx=0).stop 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fcea28a5740 1 -- 172.21.15.49:0/1898370684 shutdown_connections 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56003ad94d80 0x56003b199060 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b193450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b187530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fcea28a5740 1 --2- 172.21.15.49:0/1898370684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b186ff0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fce7cff9640 0 client.16284 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.986+0000 7fcea28a5740 1 -- 172.21.15.49:0/1898370684 >> 172.21.15.49:0/1898370684 conn(0x56003adca300 msgr2=0x56003b17c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.987+0000 7fcea28a5740 1 -- 172.21.15.49:0/1898370684 shutdown_connections 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.987+0000 7fcea28a5740 1 -- 172.21.15.49:0/1898370684 wait complete. 2024-09-21T06:39:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:42.987+0000 7fcea28a5740 20 client.16284 trim_cache size 0 max 16384 2024-09-21T06:39:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.001+0000 7fcea28a5740 1 Processor -- start 2024-09-21T06:39:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.001+0000 7fcea28a5740 1 -- start start 2024-09-21T06:39:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b178860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b188c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b1841c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fcea28a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fce941b2230 con 0x56003adad2f0 2024-09-21T06:39:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fcea28a5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce941afb00 con 0x56003add61b0 2024-09-21T06:39:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fcea28a5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce941ad970 con 0x56003adb54d0 2024-09-21T06:39:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b178860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b178860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40570/0 (socket says 172.21.15.49:40570) 2024-09-21T06:39:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 -- 172.21.15.49:0/4096156517 learned_addr learned my addr 172.21.15.49:0/4096156517 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 --2- 172.21.15.49:0/4096156517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b1841c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce996d5640 1 --2- 172.21.15.49:0/4096156517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b188c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 -- 172.21.15.49:0/4096156517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 msgr2=0x56003b188c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 --2- 172.21.15.49:0/4096156517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b188c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 -- 172.21.15.49:0/4096156517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 msgr2=0x56003b1841c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 --2- 172.21.15.49:0/4096156517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b1841c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 -- 172.21.15.49:0/4096156517 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56003b1895d0 con 0x56003adad2f0 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce98ed4640 1 --2- 172.21.15.49:0/4096156517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b178860 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fce84005db0 tx=0x7fce84005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987a58feaeea9ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.002+0000 7fce7effd640 1 -- 172.21.15.49:0/4096156517 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8401a070 con 0x56003adad2f0 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fce7effd640 1 -- 172.21.15.49:0/4096156517 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce8401b040 con 0x56003adad2f0 2024-09-21T06:39:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fce7effd640 1 -- 172.21.15.49:0/4096156517 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84009c40 con 0x56003adad2f0 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fcea28a5740 1 -- 172.21.15.49:0/4096156517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 msgr2=0x56003b178860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fcea28a5740 1 --2- 172.21.15.49:0/4096156517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b178860 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fce84005db0 tx=0x7fce84005f90 comp rx=0 tx=0).stop 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fcea28a5740 1 -- 172.21.15.49:0/4096156517 shutdown_connections 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fcea28a5740 1 --2- 172.21.15.49:0/4096156517 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b1841c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fcea28a5740 1 --2- 172.21.15.49:0/4096156517 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b188c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fcea28a5740 1 --2- 172.21.15.49:0/4096156517 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b178860 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fcea28a5740 1 -- 172.21.15.49:0/4096156517 >> 172.21.15.49:0/4096156517 conn(0x56003adca300 msgr2=0x56003b188510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fcea28a5740 1 -- 172.21.15.49:0/4096156517 shutdown_connections 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.003+0000 7fcea28a5740 1 -- 172.21.15.49:0/4096156517 wait complete. 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fcea28a5740 1 -- start start 2024-09-21T06:39:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fcea28a5740 1 Processor -- start 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b18cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b18d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fcea28a5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b2018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fcea28a5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fce941adfc0 con 0x56003adad2f0 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fcea28a5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce941af430 con 0x56003add61b0 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fcea28a5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce941ae690 con 0x56003adb54d0 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fcea28a5740 10 client.0 _ll_register_callbacks cb 0x7fce84005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.004+0000 7fce98ed4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b18cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce98ed4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b18cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40574/0 (socket says 172.21.15.49:40574) 2024-09-21T06:39:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce98ed4640 1 -- 172.21.15.49:0/3697550730 learned_addr learned my addr 172.21.15.49:0/3697550730 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce996d5640 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b18d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce98ed4640 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b2018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce98ed4640 1 -- 172.21.15.49:0/3697550730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 msgr2=0x56003b18d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce98ed4640 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b18d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce98ed4640 1 -- 172.21.15.49:0/3697550730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 msgr2=0x56003b2018c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce98ed4640 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b2018c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce98ed4640 1 -- 172.21.15.49:0/3697550730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56003b201f00 con 0x56003adad2f0 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce98ed4640 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b18cc10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fce84004610 tx=0x7fce84012fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af165c9b0e16cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce7cff9640 1 -- 172.21.15.49:0/3697550730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8401a030 con 0x56003adad2f0 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce7cff9640 1 -- 172.21.15.49:0/3697550730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fce84005030 con 0x56003adad2f0 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fcea28a5740 1 -- 172.21.15.49:0/3697550730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce8401b040 con 0x56003adad2f0 2024-09-21T06:39:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fce7cff9640 1 -- 172.21.15.49:0/3697550730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fce84005230 con 0x56003adad2f0 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fcea28a5740 10 client.16290 fetch_fsmap learned FSMap version 26 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.005+0000 7fcea28a5740 1 -- 172.21.15.49:0/3697550730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56003b203170 con 0x56003adad2f0 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fce7cff9640 1 -- 172.21.15.49:0/3697550730 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce8401b040 con 0x56003adad2f0 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fce7cff9640 1 -- 172.21.15.49:0/3697550730 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 26) ==== 8350+0+0 (secure 0 0 0) 0x7fce840207f0 con 0x56003adad2f0 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fcea28a5740 10 client.16290 fetch_fsmap finished waiting for FSMap version 26 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fcea28a5740 10 client.16290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fcea28a5740 20 client.16290 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fcea28a5740 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56003ad6a1c0 0x56003b205880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fcea28a5740 4 client.16290 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fcea28a5740 1 -- 172.21.15.49:0/3697550730 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56003b0ee0f0 con 0x56003ad6a1c0 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fce996d5640 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56003ad6a1c0 0x56003b205880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fce7cff9640 10 client.16290 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.006+0000 7fce996d5640 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56003ad6a1c0 0x56003b205880 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41e67b1dfda13ade server_cookie=5272ff51ade5dd3a in_seq=0 out_seq=0 2024-09-21T06:39:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fce7cff9640 1 -- 172.21.15.49:0/3697550730 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56003b0ee0f0 con 0x56003ad6a1c0 2024-09-21T06:39:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fce7cff9640 10 client.16290 handle_command_reply: tid=0 2024-09-21T06:39:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 client.16290 shutdown 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 -- 172.21.15.49:0/3697550730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 msgr2=0x56003b18cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b18cc10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fce84004610 tx=0x7fce84012fb0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 -- 172.21.15.49:0/3697550730 shutdown_connections 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56003ad6a1c0 0x56003b205880 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56003add61b0 0x56003b2018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56003adb54d0 0x56003b18d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fce7cff9640 0 client.16290 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 --2- 172.21.15.49:0/3697550730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56003adad2f0 0x56003b18cc10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 -- 172.21.15.49:0/3697550730 >> 172.21.15.49:0/3697550730 conn(0x56003adca300 msgr2=0x56003b178630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 -- 172.21.15.49:0/3697550730 shutdown_connections 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 1 -- 172.21.15.49:0/3697550730 wait complete. 2024-09-21T06:39:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.014+0000 7fcea28a5740 20 client.16290 trim_cache size 0 max 16384 2024-09-21T06:39:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:39:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:39:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:39:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 -- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce800b6680 msgr2=0x7fce800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce800b6680 0x7fce800b8b90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0e50d0 tx=0x7fce8c0a1f80 comp rx=0 tx=0).stop 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 -- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce94108c40 msgr2=0x7fce9419fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce94108c40 0x7fce9419fd70 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fce8c00eaa0 tx=0x7fce8c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 -- 172.21.15.49:0/1552868554 shutdown_connections 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce800b6680 0x7fce800b8b90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce94108c40 0x7fce9419fd70 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce941082f0 0x7fce9419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 --2- 172.21.15.49:0/1552868554 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce941029c0 0x7fce9419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 -- 172.21.15.49:0/1552868554 >> 172.21.15.49:0/1552868554 conn(0x7fce940fe3c0 msgr2=0x7fce94107950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 -- 172.21.15.49:0/1552868554 shutdown_connections 2024-09-21T06:39:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:43.015+0000 7fce9b939640 1 -- 172.21.15.49:0/1552868554 wait complete. 2024-09-21T06:39:44.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:43 smithi049 ceph-mon[31177]: pgmap v411: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:39:44.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:43 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:39:44.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:43 smithi098 ceph-mon[34704]: pgmap v411: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:39:44.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:43 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:39:44.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:43 smithi079 ceph-mon[34346]: pgmap v411: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T06:39:44.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:43 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:39:45.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:44 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:39:45.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:44 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:39:45.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:44 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:39:46.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:45 smithi049 ceph-mon[31177]: pgmap v412: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:39:46.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:45 smithi098 ceph-mon[34704]: pgmap v412: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:39:46.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:45 smithi079 ceph-mon[34346]: pgmap v412: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:39:48.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:47 smithi049 ceph-mon[31177]: pgmap v413: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T06:39:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:47 smithi098 ceph-mon[34704]: pgmap v413: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T06:39:48.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:47 smithi079 ceph-mon[34346]: pgmap v413: 97 pgs: 97 active+clean; 2.7 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T06:39:49.842 INFO:tasks.workunit.client.0.smithi049.stdout:64/600: open fd = 3 2024-09-21T06:39:49.842 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.842 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.842 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:65/600: open fd = 3 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:66/600: open fd = 3 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:67/600: open fd = 3 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.843 INFO:tasks.workunit.client.0.smithi049.stdout:68/600: open fd = 3 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:69/600: open fd = 3 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:70/600: open fd = 3 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:71/600: open fd = 3 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.844 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:72/600: open fd = 3 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:73/600: open fd = 3 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:74/600: open fd = 3 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:75/600: open fd = 3 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.845 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:76/600: open fd = 3 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:77/600: open fd = 3 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:78/600: open fd = 3 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.846 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:79/600: open fd = 3 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:80/600: open fd = 3 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:81/600: open fd = 3 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:82/600: open fd = 3 2024-09-21T06:39:49.847 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:83/600: open fd = 3 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:84/600: open fd = 3 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.848 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:85/600: open fd = 3 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:86/600: open fd = 3 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:87/600: open fd = 3 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.849 INFO:tasks.workunit.client.0.smithi049.stdout:88/600: open fd = 3 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:89/600: open fd = 3 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:90/600: open fd = 3 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:91/600: open fd = 3 2024-09-21T06:39:49.850 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:92/600: open fd = 3 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:93/600: open fd = 3 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:94/600: open fd = 3 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.851 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:95/600: open fd = 3 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:96/600: open fd = 3 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:97/600: open fd = 3 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:98/600: open fd = 3 2024-09-21T06:39:49.852 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:99/600: open fd = 3 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:100/600: open fd = 3 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:101/600: open fd = 3 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.853 INFO:tasks.workunit.client.0.smithi049.stdout:102/600: open fd = 3 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:103/600: open fd = 3 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:104/600: open fd = 3 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:105/600: open fd = 3 2024-09-21T06:39:49.854 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:106/600: open fd = 3 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:107/600: open fd = 3 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:108/600: open fd = 3 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.855 INFO:tasks.workunit.client.0.smithi049.stdout:109/600: open fd = 3 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:110/600: open fd = 3 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:111/600: open fd = 3 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:112/600: open fd = 3 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.856 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:113/600: open fd = 3 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:114/600: open fd = 3 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:115/600: open fd = 3 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:116/600: open fd = 3 2024-09-21T06:39:49.857 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:117/600: open fd = 3 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:118/600: open fd = 3 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:119/600: open fd = 3 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.858 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:120/600: open fd = 3 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:121/600: open fd = 3 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:122/600: open fd = 3 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:123/600: open fd = 3 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.859 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:124/600: open fd = 3 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:125/600: open fd = 3 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:126/600: open fd = 3 2024-09-21T06:39:49.860 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:39:50.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:49 smithi049 ceph-mon[31177]: pgmap v414: 97 pgs: 97 active+clean; 2.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-21T06:39:50.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:49 smithi098 ceph-mon[34704]: pgmap v414: 97 pgs: 97 active+clean; 2.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-21T06:39:50.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:49 smithi079 ceph-mon[34346]: pgmap v414: 97 pgs: 97 active+clean; 2.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 17 op/s 2024-09-21T06:39:52.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:51 smithi049 ceph-mon[31177]: pgmap v415: 97 pgs: 97 active+clean; 2.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:39:52.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:51 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:39:52.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:51 smithi098 ceph-mon[34704]: pgmap v415: 97 pgs: 97 active+clean; 2.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:39:52.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:51 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:39:52.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:51 smithi079 ceph-mon[34346]: pgmap v415: 97 pgs: 97 active+clean; 2.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:39:52.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:51 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:39:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:39:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:39:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:52 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:39:53.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:39:53.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:39:53.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:52 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:39:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:39:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:39:53.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:52 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:39:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:53 smithi049 ceph-mon[31177]: pgmap v416: 97 pgs: 97 active+clean; 2.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T06:39:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:53 smithi098 ceph-mon[34704]: pgmap v416: 97 pgs: 97 active+clean; 2.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T06:39:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:53 smithi079 ceph-mon[34346]: pgmap v416: 97 pgs: 97 active+clean; 2.8 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T06:39:55.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:54 smithi049 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:39:55.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:54 smithi098 ceph-mon[34704]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:39:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:54 smithi079 ceph-mon[34346]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:39:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.127+0000 7f43b3ad5640 1 -- 172.21.15.49:0/976490892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108300 msgr2=0x7f43ac108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.127+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/976490892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108300 0x7f43ac108710 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f43a0009900 tx=0x7f43a002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.127+0000 7f43b3ad5640 1 -- 172.21.15.49:0/976490892 shutdown_connections 2024-09-21T06:39:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.127+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/976490892 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac108c50 0x7f43ac10f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.127+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/976490892 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108300 0x7f43ac108710 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.127+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/976490892 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43ac1029d0 0x7f43ac102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.127+0000 7f43b3ad5640 1 -- 172.21.15.49:0/976490892 >> 172.21.15.49:0/976490892 conn(0x7f43ac07a710 msgr2=0x7f43ac07ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:56.130 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.127+0000 7f43b3ad5640 1 -- 172.21.15.49:0/976490892 shutdown_connections 2024-09-21T06:39:56.131 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.127+0000 7f43b3ad5640 1 -- 172.21.15.49:0/976490892 wait complete. 2024-09-21T06:39:56.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b3ad5640 1 Processor -- start 2024-09-21T06:39:56.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b3ad5640 1 -- start start 2024-09-21T06:39:56.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b3ad5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac1029d0 0x7f43ac19b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b3ad5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43ac108300 0x7f43ac19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b3ad5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108c50 0x7f43ac19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b3ad5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac112960 con 0x7f43ac108c50 2024-09-21T06:39:56.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b3ad5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1127e0 con 0x7f43ac1029d0 2024-09-21T06:39:56.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b3ad5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac112ae0 con 0x7f43ac108300 2024-09-21T06:39:56.133 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b2072640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108c50 0x7f43ac19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b2072640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108c50 0x7f43ac19bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55258/0 (socket says 172.21.15.49:55258) 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b2072640 1 -- 172.21.15.49:0/2771721040 learned_addr learned my addr 172.21.15.49:0/2771721040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.128+0000 7f43b1070640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43ac108300 0x7f43ac19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43b1871640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac1029d0 0x7f43ac19b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43b2072640 1 -- 172.21.15.49:0/2771721040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43ac108300 msgr2=0x7f43ac19b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43b2072640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43ac108300 0x7f43ac19b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43b2072640 1 -- 172.21.15.49:0/2771721040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac1029d0 msgr2=0x7f43ac19b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43b2072640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac1029d0 0x7f43ac19b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43b2072640 1 -- 172.21.15.49:0/2771721040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43ac1a6490 con 0x7f43ac108c50 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43b2072640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108c50 0x7f43ac19bc50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f43a400d750 tx=0x7f43a400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43aaffd640 1 -- 172.21.15.49:0/2771721040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4017070 con 0x7f43ac108c50 2024-09-21T06:39:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43aaffd640 1 -- 172.21.15.49:0/2771721040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a40054d0 con 0x7f43ac108c50 2024-09-21T06:39:56.135 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43b3ad5640 1 -- 172.21.15.49:0/2771721040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43ac1a6780 con 0x7f43ac108c50 2024-09-21T06:39:56.135 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43aaffd640 1 -- 172.21.15.49:0/2771721040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4004c60 con 0x7f43ac108c50 2024-09-21T06:39:56.135 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.129+0000 7f43b3ad5640 1 -- 172.21.15.49:0/2771721040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43ac1a6ca0 con 0x7f43ac108c50 2024-09-21T06:39:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.132+0000 7f43baa3e740 1 Processor -- start 2024-09-21T06:39:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.132+0000 7f43aaffd640 1 -- 172.21.15.49:0/2771721040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f43a4009bd0 con 0x7f43ac108c50 2024-09-21T06:39:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43baa3e740 1 -- start start 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 0x563a6c32d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c32def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c32e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43baa3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563a6c2a26f0 con 0x563a6bf5f2f0 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43baa3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563a6c291b20 con 0x563a6bf881b0 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43baa3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563a6c295930 con 0x563a6bf674d0 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43b1871640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c32def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43b1871640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c32def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55264/0 (socket says 172.21.15.49:55264) 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43b1871640 1 -- 172.21.15.49:0/1181034913 learned_addr learned my addr 172.21.15.49:0/1181034913 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.133+0000 7f43b1070640 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c32e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43b1070640 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 0x563a6c32d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43b1871640 1 -- 172.21.15.49:0/1181034913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 msgr2=0x563a6c32e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43b1871640 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c32e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43b1871640 1 -- 172.21.15.49:0/1181034913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 msgr2=0x563a6c32d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43b1871640 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 0x563a6c32d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43b1871640 1 -- 172.21.15.49:0/1181034913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a6c257530 con 0x563a6bf5f2f0 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43b1070640 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 0x563a6c32d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43aaffd640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43940b6700 0x7f43940b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43b1871640 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c32def0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f439c009f40 tx=0x7f439c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2841edbadfb615a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43b1070640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43940b6700 0x7f43940b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f43aaffd640 1 -- 172.21.15.49:0/2771721040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f43a40e70c0 con 0x7f43ac108c50 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f4393fff640 1 -- 172.21.15.49:0/1181034913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c016070 con 0x563a6bf5f2f0 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f4393fff640 1 -- 172.21.15.49:0/1181034913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f439c012900 con 0x563a6bf5f2f0 2024-09-21T06:39:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.134+0000 7f4393fff640 1 -- 172.21.15.49:0/1181034913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c011940 con 0x563a6bf5f2f0 2024-09-21T06:39:56.144 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43baa3e740 1 -- 172.21.15.49:0/1181034913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 msgr2=0x563a6c32def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:56.144 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43b1070640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43940b6700 0x7f43940b8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f43a0031440 tx=0x7f43a0005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:56.144 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43baa3e740 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c32def0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f439c009f40 tx=0x7f439c010800 comp rx=0 tx=0).stop 2024-09-21T06:39:56.144 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43baa3e740 1 -- 172.21.15.49:0/1181034913 shutdown_connections 2024-09-21T06:39:56.144 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43baa3e740 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c32e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.144 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43baa3e740 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c32def0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43baa3e740 1 --2- 172.21.15.49:0/1181034913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 0x563a6c32d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43baa3e740 1 -- 172.21.15.49:0/1181034913 >> 172.21.15.49:0/1181034913 conn(0x563a6bf7c300 msgr2=0x563a6c32b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43baa3e740 1 -- 172.21.15.49:0/1181034913 shutdown_connections 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.135+0000 7f43baa3e740 1 -- 172.21.15.49:0/1181034913 wait complete. 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.136+0000 7f43baa3e740 1 -- start start 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.136+0000 7f43baa3e740 1 Processor -- start 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.136+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c339060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.136+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c3395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.136+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 0x563a6c345450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.136+0000 7f43baa3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563a6c1c9ab0 con 0x563a6bf5f2f0 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.136+0000 7f43baa3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563a6c237730 con 0x563a6bf881b0 2024-09-21T06:39:56.145 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.136+0000 7f43baa3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563a6c33c130 con 0x563a6bf674d0 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43baa3e740 10 client.0 _ll_register_callbacks cb 0x563a6c28b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1871640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c339060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1871640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c339060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55278/0 (socket says 172.21.15.49:55278) 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1871640 1 -- 172.21.15.49:0/3638120931 learned_addr learned my addr 172.21.15.49:0/3638120931 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1070640 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c3395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b2072640 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 0x563a6c345450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1871640 1 -- 172.21.15.49:0/3638120931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 msgr2=0x563a6c3395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1871640 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c3395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1871640 1 -- 172.21.15.49:0/3638120931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 msgr2=0x563a6c345450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1871640 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 0x563a6c345450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1871640 1 -- 172.21.15.49:0/3638120931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a6bff3790 con 0x563a6bf5f2f0 2024-09-21T06:39:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1070640 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c3395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43b1871640 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c339060 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f439c0114c0 tx=0x7f439c012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432c66c5236dcf72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43917fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43917fa640 1 -- 172.21.15.49:0/3638120931 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c016040 con 0x563a6bf5f2f0 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43917fa640 1 -- 172.21.15.49:0/3638120931 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f439c0116c0 con 0x563a6bf5f2f0 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43baa3e740 1 -- 172.21.15.49:0/3638120931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f439c012900 con 0x563a6bf5f2f0 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43917fa640 1 -- 172.21.15.49:0/3638120931 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f439c0118c0 con 0x563a6bf5f2f0 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.137+0000 7f43baa3e740 10 client.16302 fetch_fsmap learned FSMap version 27 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43baa3e740 1 -- 172.21.15.49:0/3638120931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563a6c06c620 con 0x563a6bf5f2f0 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43917fa640 1 -- 172.21.15.49:0/3638120931 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f439c012900 con 0x563a6bf5f2f0 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43917fa640 1 -- 172.21.15.49:0/3638120931 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f439c00f040 con 0x563a6bf5f2f0 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43baa3e740 10 client.16302 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43baa3e740 10 client.16302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43baa3e740 20 client.16302 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563a6bf46d80 0x563a6c34b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43baa3e740 4 client.16302 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43baa3e740 1 -- 172.21.15.49:0/3638120931 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a6c2a4640 con 0x563a6bf46d80 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.138+0000 7f43b1070640 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563a6bf46d80 0x563a6c34b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.139+0000 7f43917fa640 10 client.16302 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.139+0000 7f43b1070640 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563a6bf46d80 0x563a6c34b020 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=208bbadee904847f server_cookie=ba0397001b51b3a4 in_seq=0 out_seq=0 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43917fa640 1 -- 172.21.15.49:0/3638120931 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563a6c2a4640 con 0x563a6bf46d80 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43917fa640 10 client.16302 handle_command_reply: tid=0 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 client.16302 shutdown 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 -- 172.21.15.49:0/3638120931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 msgr2=0x563a6c339060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c339060 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f439c0114c0 tx=0x7f439c012700 comp rx=0 tx=0).stop 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 -- 172.21.15.49:0/3638120931 shutdown_connections 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563a6bf46d80 0x563a6c34b020 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf881b0 0x563a6c345450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c3395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3638120931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf5f2f0 0x563a6c339060 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43917fa640 0 client.16302 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 -- 172.21.15.49:0/3638120931 >> 172.21.15.49:0/3638120931 conn(0x563a6bf7c300 msgr2=0x563a6c32e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 -- 172.21.15.49:0/3638120931 shutdown_connections 2024-09-21T06:39:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 1 -- 172.21.15.49:0/3638120931 wait complete. 2024-09-21T06:39:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.140+0000 7f43baa3e740 20 client.16302 trim_cache size 0 max 16384 2024-09-21T06:39:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43baa3e740 1 Processor -- start 2024-09-21T06:39:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43baa3e740 1 -- start start 2024-09-21T06:39:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 0x563a6c32f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c345350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf881b0 0x563a6c336230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43baa3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1b1fe0 con 0x563a6bf881b0 2024-09-21T06:39:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43baa3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1af8b0 con 0x563a6bf5f2f0 2024-09-21T06:39:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43baa3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1ad720 con 0x563a6bf674d0 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43b2072640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf881b0 0x563a6c336230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43b2072640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf881b0 0x563a6c336230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55280/0 (socket says 172.21.15.49:55280) 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43b2072640 1 -- 172.21.15.49:0/4120311204 learned_addr learned my addr 172.21.15.49:0/4120311204 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.155+0000 7f43b1070640 1 --2- 172.21.15.49:0/4120311204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c345350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43b1871640 1 --2- 172.21.15.49:0/4120311204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 0x563a6c32f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43b2072640 1 -- 172.21.15.49:0/4120311204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 msgr2=0x563a6c345350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43b2072640 1 --2- 172.21.15.49:0/4120311204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c345350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43b2072640 1 -- 172.21.15.49:0/4120311204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 msgr2=0x563a6c32f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43b2072640 1 --2- 172.21.15.49:0/4120311204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 0x563a6c32f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43b2072640 1 -- 172.21.15.49:0/4120311204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a6c32f6b0 con 0x563a6bf881b0 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43b2072640 1 --2- 172.21.15.49:0/4120311204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf881b0 0x563a6c336230 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f43a40e4850 tx=0x7f43a40ac660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b25a7c5ddea71b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43937fe640 1 -- 172.21.15.49:0/4120311204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4020070 con 0x563a6bf881b0 2024-09-21T06:39:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43937fe640 1 -- 172.21.15.49:0/4120311204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a4005680 con 0x563a6bf881b0 2024-09-21T06:39:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.156+0000 7f43937fe640 1 -- 172.21.15.49:0/4120311204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a4094360 con 0x563a6bf881b0 2024-09-21T06:39:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 -- 172.21.15.49:0/4120311204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf881b0 msgr2=0x563a6c336230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 --2- 172.21.15.49:0/4120311204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf881b0 0x563a6c336230 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f43a40e4850 tx=0x7f43a40ac660 comp rx=0 tx=0).stop 2024-09-21T06:39:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 -- 172.21.15.49:0/4120311204 shutdown_connections 2024-09-21T06:39:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 --2- 172.21.15.49:0/4120311204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf881b0 0x563a6c336230 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 --2- 172.21.15.49:0/4120311204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf674d0 0x563a6c345350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 --2- 172.21.15.49:0/4120311204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 0x563a6c32f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 -- 172.21.15.49:0/4120311204 >> 172.21.15.49:0/4120311204 conn(0x563a6bf7c300 msgr2=0x563a6c32e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 -- 172.21.15.49:0/4120311204 shutdown_connections 2024-09-21T06:39:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 -- 172.21.15.49:0/4120311204 wait complete. 2024-09-21T06:39:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 -- start start 2024-09-21T06:39:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.157+0000 7f43baa3e740 1 Processor -- start 2024-09-21T06:39:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 0x563a6c341a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf674d0 0x563a6c33ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43baa3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf881b0 0x563a6c33f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43baa3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1add70 con 0x563a6bf674d0 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43baa3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1af1e0 con 0x563a6bf5f2f0 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43baa3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f43ac1ae440 con 0x563a6bf881b0 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43baa3e740 10 client.0 _ll_register_callbacks cb 0x7f439c009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b1070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf674d0 0x563a6c33ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b1070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf674d0 0x563a6c33ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55288/0 (socket says 172.21.15.49:55288) 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b1070640 1 -- 172.21.15.49:0/3286867046 learned_addr learned my addr 172.21.15.49:0/3286867046 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b1871640 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 0x563a6c341a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b2072640 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf881b0 0x563a6c33f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b1070640 1 -- 172.21.15.49:0/3286867046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf881b0 msgr2=0x563a6c33f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b1070640 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf881b0 0x563a6c33f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b1070640 1 -- 172.21.15.49:0/3286867046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 msgr2=0x563a6c341a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b1070640 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 0x563a6c341a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.158+0000 7f43b1070640 1 -- 172.21.15.49:0/3286867046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a6c33fa40 con 0x563a6bf674d0 2024-09-21T06:39:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43b1070640 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf674d0 0x563a6c33ef10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f43a0006010 tx=0x7f43a0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e6adcc5da09d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43917fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:39:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43917fa640 1 -- 172.21.15.49:0/3286867046 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a005f060 con 0x563a6bf674d0 2024-09-21T06:39:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43917fa640 1 -- 172.21.15.49:0/3286867046 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f43a00316a0 con 0x563a6bf674d0 2024-09-21T06:39:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43baa3e740 1 -- 172.21.15.49:0/3286867046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43a4005680 con 0x563a6bf674d0 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43917fa640 1 -- 172.21.15.49:0/3286867046 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f43a0035040 con 0x563a6bf674d0 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43baa3e740 10 client.16308 fetch_fsmap learned FSMap version 27 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43baa3e740 1 -- 172.21.15.49:0/3286867046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563a6c3b5670 con 0x563a6bf674d0 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43917fa640 1 -- 172.21.15.49:0/3286867046 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43a4005680 con 0x563a6bf674d0 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43917fa640 1 -- 172.21.15.49:0/3286867046 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f43a003d780 con 0x563a6bf674d0 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43baa3e740 10 client.16308 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43baa3e740 10 client.16308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43baa3e740 20 client.16308 populate_metadata read hostname 'smithi049' 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563a6bf1c1c0 0x563a6c3b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43baa3e740 4 client.16308 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.159+0000 7f43baa3e740 1 -- 172.21.15.49:0/3286867046 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563a6c2a00f0 con 0x563a6bf1c1c0 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.160+0000 7f43b1871640 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563a6bf1c1c0 0x563a6c3b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.160+0000 7f43917fa640 10 client.16308 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.160+0000 7f43b1871640 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563a6bf1c1c0 0x563a6c3b7e10 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59510d8e4b5ef75 server_cookie=74726668337d63f in_seq=0 out_seq=0 2024-09-21T06:39:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43917fa640 1 -- 172.21.15.49:0/3286867046 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563a6c2a00f0 con 0x563a6bf1c1c0 2024-09-21T06:39:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43917fa640 10 client.16308 handle_command_reply: tid=0 2024-09-21T06:39:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 client.16308 shutdown 2024-09-21T06:39:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 -- 172.21.15.49:0/3286867046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf674d0 msgr2=0x563a6c33ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf674d0 0x563a6c33ef10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f43a0006010 tx=0x7f43a0005780 comp rx=0 tx=0).stop 2024-09-21T06:39:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 -- 172.21.15.49:0/3286867046 shutdown_connections 2024-09-21T06:39:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563a6bf1c1c0 0x563a6c3b7e10 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563a6bf881b0 0x563a6c33f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563a6bf674d0 0x563a6c33ef10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 --2- 172.21.15.49:0/3286867046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563a6bf5f2f0 0x563a6c341a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43917fa640 0 client.16308 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 -- 172.21.15.49:0/3286867046 >> 172.21.15.49:0/3286867046 conn(0x563a6bf7c300 msgr2=0x563a6c329ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 -- 172.21.15.49:0/3286867046 shutdown_connections 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 1 -- 172.21.15.49:0/3286867046 wait complete. 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.168+0000 7f43baa3e740 20 client.16308 trim_cache size 0 max 16384 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:39:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 -- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43940b6700 msgr2=0x7f43940b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43940b6700 0x7f43940b8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f43a0031440 tx=0x7f43a0005a20 comp rx=0 tx=0).stop 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 -- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108c50 msgr2=0x7f43ac19bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108c50 0x7f43ac19bc50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f43a400d750 tx=0x7f43a400dc10 comp rx=0 tx=0).stop 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 -- 172.21.15.49:0/2771721040 shutdown_connections 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f43940b6700 0x7f43940b8c10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f43ac108c50 0x7f43ac19bc50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f43ac108300 0x7f43ac19b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 --2- 172.21.15.49:0/2771721040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f43ac1029d0 0x7f43ac19b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 -- 172.21.15.49:0/2771721040 >> 172.21.15.49:0/2771721040 conn(0x7f43ac07a710 msgr2=0x7f43ac104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:56.175 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 -- 172.21.15.49:0/2771721040 shutdown_connections 2024-09-21T06:39:56.175 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:39:56.169+0000 7f43b3ad5640 1 -- 172.21.15.49:0/2771721040 wait complete. 2024-09-21T06:39:56.197 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:55 smithi098 ceph-mon[34704]: pgmap v417: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:39:56.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:55 smithi049 ceph-mon[31177]: pgmap v417: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:39:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:55 smithi079 ceph-mon[34346]: pgmap v417: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 14 op/s 2024-09-21T06:39:58.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:57 smithi049 ceph-mon[31177]: pgmap v418: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:39:58.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:57 smithi098 ceph-mon[34704]: pgmap v418: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:39:58.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:57 smithi079 ceph-mon[34346]: pgmap v418: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:40:00.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:39:59 smithi049 ceph-mon[31177]: pgmap v419: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-21T06:40:00.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:39:59 smithi098 ceph-mon[34704]: pgmap v419: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-21T06:40:00.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:39:59 smithi079 ceph-mon[34346]: pgmap v419: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 23 KiB/s wr, 17 op/s 2024-09-21T06:40:01.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:00 smithi049 ceph-mon[31177]: overall HEALTH_OK 2024-09-21T06:40:01.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:00 smithi098 ceph-mon[34704]: overall HEALTH_OK 2024-09-21T06:40:01.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:00 smithi079 ceph-mon[34346]: overall HEALTH_OK 2024-09-21T06:40:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:01 smithi049 ceph-mon[31177]: pgmap v420: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:40:02.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:01 smithi098 ceph-mon[34704]: pgmap v420: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:40:02.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:01 smithi079 ceph-mon[34346]: pgmap v420: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:40:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:03 smithi049 ceph-mon[31177]: pgmap v421: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:40:04.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:03 smithi098 ceph-mon[34704]: pgmap v421: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:40:04.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:03 smithi079 ceph-mon[34346]: pgmap v421: 97 pgs: 97 active+clean; 2.9 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:40:06.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:05 smithi049 ceph-mon[31177]: pgmap v422: 97 pgs: 97 active+clean; 3.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 42 KiB/s wr, 29 op/s 2024-09-21T06:40:06.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:05 smithi098 ceph-mon[34704]: pgmap v422: 97 pgs: 97 active+clean; 3.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 42 KiB/s wr, 29 op/s 2024-09-21T06:40:06.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:05 smithi079 ceph-mon[34346]: pgmap v422: 97 pgs: 97 active+clean; 3.0 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 42 KiB/s wr, 29 op/s 2024-09-21T06:40:07.437 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:40:07.710 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:08.100 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:07 smithi049 ceph-mon[31177]: pgmap v423: 97 pgs: 97 active+clean; 3.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-09-21T06:40:08.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 -- 172.21.15.49:0/1264828095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 msgr2=0x7f748c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 --2- 172.21.15.49:0/1264828095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 0x7f748c10f540 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7484009ca0 tx=0x7f748402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 -- 172.21.15.49:0/1264828095 shutdown_connections 2024-09-21T06:40:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 --2- 172.21.15.49:0/1264828095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 0x7f748c10f540 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 --2- 172.21.15.49:0/1264828095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c1083c0 0x7f748c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 --2- 172.21.15.49:0/1264828095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f748c102a80 0x7f748c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 -- 172.21.15.49:0/1264828095 >> 172.21.15.49:0/1264828095 conn(0x7f748c079740 msgr2=0x7f748c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 -- 172.21.15.49:0/1264828095 shutdown_connections 2024-09-21T06:40:08.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 -- 172.21.15.49:0/1264828095 wait complete. 2024-09-21T06:40:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.195+0000 7f74914a8640 1 Processor -- start 2024-09-21T06:40:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f74914a8640 1 -- start start 2024-09-21T06:40:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f74914a8640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c102a80 0x7f748c19c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f74914a8640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f748c1083c0 0x7f748c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f74914a8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 0x7f748c1a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f74914a8640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f748c112980 con 0x7f748c108d10 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f74914a8640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f748c112800 con 0x7f748c1083c0 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f74914a8640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f748c112b00 con 0x7f748c102a80 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f748b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 0x7f748c1a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f748affd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c102a80 0x7f748c19c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f748b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 0x7f748c1a1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60358/0 (socket says 172.21.15.49:60358) 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f748b7fe640 1 -- 172.21.15.49:0/2814514713 learned_addr learned my addr 172.21.15.49:0/2814514713 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.196+0000 7f74827fc640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f748c1083c0 0x7f748c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f748b7fe640 1 -- 172.21.15.49:0/2814514713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c102a80 msgr2=0x7f748c19c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f748b7fe640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c102a80 0x7f748c19c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f748b7fe640 1 -- 172.21.15.49:0/2814514713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f748c1083c0 msgr2=0x7f748c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f748b7fe640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f748c1083c0 0x7f748c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f748b7fe640 1 -- 172.21.15.49:0/2814514713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f748c1a2560 con 0x7f748c108d10 2024-09-21T06:40:08.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f74827fc640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f748c1083c0 0x7f748c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f748b7fe640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 0x7f748c1a1ef0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7484005cc0 tx=0x7f748402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f7488ff9640 1 -- 172.21.15.49:0/2814514713 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7484003bf0 con 0x7f748c108d10 2024-09-21T06:40:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f74914a8640 1 -- 172.21.15.49:0/2814514713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f748c1a27f0 con 0x7f748c108d10 2024-09-21T06:40:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f7488ff9640 1 -- 172.21.15.49:0/2814514713 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7484003d90 con 0x7f748c108d10 2024-09-21T06:40:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f7488ff9640 1 -- 172.21.15.49:0/2814514713 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748402fb20 con 0x7f748c108d10 2024-09-21T06:40:08.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.197+0000 7f74914a8640 1 -- 172.21.15.49:0/2814514713 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f748c1a9070 con 0x7f748c108d10 2024-09-21T06:40:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.201+0000 7f7497a1c740 1 Processor -- start 2024-09-21T06:40:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.201+0000 7f7488ff9640 1 -- 172.21.15.49:0/2814514713 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f7484004580 con 0x7f748c108d10 2024-09-21T06:40:08.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.201+0000 7f7497a1c740 1 -- start start 2024-09-21T06:40:08.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.201+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e824070 0x556b2ebcb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.201+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebcbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.201+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebcc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.201+0000 7f7497a1c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556b2eb41e50 con 0x556b2e803390 2024-09-21T06:40:08.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.201+0000 7f7497a1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556b2eb31280 con 0x556b2e7fb1b0 2024-09-21T06:40:08.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.201+0000 7f7497a1c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556b2eb35090 con 0x556b2e824070 2024-09-21T06:40:08.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebcc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebcc0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60372/0 (socket says 172.21.15.49:60372) 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 -- 172.21.15.49:0/4166911799 learned_addr learned my addr 172.21.15.49:0/4166911799 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 --2- 172.21.15.49:0/4166911799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e824070 0x556b2ebcb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f748affd640 1 --2- 172.21.15.49:0/4166911799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebcbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 -- 172.21.15.49:0/4166911799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e824070 msgr2=0x556b2ebcb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 --2- 172.21.15.49:0/4166911799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e824070 0x556b2ebcb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 -- 172.21.15.49:0/4166911799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 msgr2=0x556b2ebcbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 --2- 172.21.15.49:0/4166911799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebcbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 -- 172.21.15.49:0/4166911799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b2e88f650 con 0x556b2e803390 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74827fc640 1 --2- 172.21.15.49:0/4166911799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebcc0d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f74740149a0 tx=0x7f747400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3675af25f94f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f7488ff9640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f74780b66b0 0x7f74780b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.202+0000 7f74817fa640 1 -- 172.21.15.49:0/4166911799 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74740142d0 con 0x556b2e803390 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.203+0000 7f748affd640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f74780b66b0 0x7f74780b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.203+0000 7f74817fa640 1 -- 172.21.15.49:0/4166911799 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74740054d0 con 0x556b2e803390 2024-09-21T06:40:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.203+0000 7f74817fa640 1 -- 172.21.15.49:0/4166911799 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474004e50 con 0x556b2e803390 2024-09-21T06:40:08.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.203+0000 7f7488ff9640 1 -- 172.21.15.49:0/2814514713 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f7484108cc0 con 0x7f748c108d10 2024-09-21T06:40:08.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.203+0000 7f748affd640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f74780b66b0 0x7f74780b8bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x556b2ebca2d0 tx=0x7f747c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.203+0000 7f7497a1c740 1 -- 172.21.15.49:0/4166911799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 msgr2=0x556b2ebcc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.203+0000 7f7497a1c740 1 --2- 172.21.15.49:0/4166911799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebcc0d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f74740149a0 tx=0x7f747400c4d0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 -- 172.21.15.49:0/4166911799 shutdown_connections 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 --2- 172.21.15.49:0/4166911799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebcc0d0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 --2- 172.21.15.49:0/4166911799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebcbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 --2- 172.21.15.49:0/4166911799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e824070 0x556b2ebcb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 -- 172.21.15.49:0/4166911799 >> 172.21.15.49:0/4166911799 conn(0x556b2e818460 msgr2=0x556b2ebc9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 -- 172.21.15.49:0/4166911799 shutdown_connections 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 -- 172.21.15.49:0/4166911799 wait complete. 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 -- start start 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 Processor -- start 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebd6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.204+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 0x556b2ebd7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebe30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f7497a1c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556b2e992700 con 0x556b2e824070 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f7497a1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556b2eacc110 con 0x556b2e7fb1b0 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f7497a1c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556b2ebd9dd0 con 0x556b2e803390 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f7497a1c740 10 client.0 _ll_register_callbacks cb 0x556b2eae5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebe30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebe30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60376/0 (socket says 172.21.15.49:60376) 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748b7fe640 1 -- 172.21.15.49:0/804053681 learned_addr learned my addr 172.21.15.49:0/804053681 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f74827fc640 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 0x556b2ebd7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748affd640 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebd6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748b7fe640 1 -- 172.21.15.49:0/804053681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 msgr2=0x556b2ebd7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748b7fe640 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 0x556b2ebd7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748b7fe640 1 -- 172.21.15.49:0/804053681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 msgr2=0x556b2ebd6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748b7fe640 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebd6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748b7fe640 1 -- 172.21.15.49:0/804053681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b2eaf9c40 con 0x556b2e824070 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f748b7fe640 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebe30f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f74840cb0c0 tx=0x7f74840ce9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31a50e23d031479 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f74727fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f74727fc640 1 -- 172.21.15.49:0/804053681 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748402fec0 con 0x556b2e824070 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f74727fc640 1 -- 172.21.15.49:0/804053681 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f74840d31b0 con 0x556b2e824070 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.205+0000 7f7497a1c740 1 -- 172.21.15.49:0/804053681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74740054d0 con 0x556b2e824070 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f74727fc640 1 -- 172.21.15.49:0/804053681 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f74840098d0 con 0x556b2e824070 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f7497a1c740 10 client.16320 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f7497a1c740 1 -- 172.21.15.49:0/804053681 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556b2ebe5ad0 con 0x556b2e824070 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f74727fc640 1 -- 172.21.15.49:0/804053681 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74740054d0 con 0x556b2e824070 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f74727fc640 1 -- 172.21.15.49:0/804053681 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f74840cdd50 con 0x556b2e824070 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f7497a1c740 10 client.16320 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f7497a1c740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:08.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f7497a1c740 20 client.16320 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f7497a1c740 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b2e7e29f0 0x556b2ebe8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f7497a1c740 4 client.16320 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.206+0000 7f7497a1c740 1 -- 172.21.15.49:0/804053681 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b2eb43da0 con 0x556b2e7e29f0 2024-09-21T06:40:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.207+0000 7f748affd640 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b2e7e29f0 0x556b2ebe8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.207+0000 7f74727fc640 10 client.16320 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:08.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.207+0000 7f748affd640 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b2e7e29f0 0x556b2ebe8f90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ef7ab07b01df053 server_cookie=123d8fa8464f1492 in_seq=0 out_seq=0 2024-09-21T06:40:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f74727fc640 1 -- 172.21.15.49:0/804053681 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556b2eb43da0 con 0x556b2e7e29f0 2024-09-21T06:40:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f74727fc640 10 client.16320 handle_command_reply: tid=0 2024-09-21T06:40:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 client.16320 shutdown 2024-09-21T06:40:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 -- 172.21.15.49:0/804053681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 msgr2=0x556b2ebe30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebe30f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f74840cb0c0 tx=0x7f74840ce9a0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 -- 172.21.15.49:0/804053681 shutdown_connections 2024-09-21T06:40:08.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b2e7e29f0 0x556b2ebe8f90 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebe30f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 0x556b2ebd7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 --2- 172.21.15.49:0/804053681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebd6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 -- 172.21.15.49:0/804053681 >> 172.21.15.49:0/804053681 conn(0x556b2e818460 msgr2=0x556b2ebce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f74727fc640 0 client.16320 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 -- 172.21.15.49:0/804053681 shutdown_connections 2024-09-21T06:40:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 1 -- 172.21.15.49:0/804053681 wait complete. 2024-09-21T06:40:08.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.208+0000 7f7497a1c740 20 client.16320 trim_cache size 0 max 16384 2024-09-21T06:40:08.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f7497a1c740 1 Processor -- start 2024-09-21T06:40:08.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f7497a1c740 1 -- start start 2024-09-21T06:40:08.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e7fb1b0 0x556b2ebd7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebe2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e824070 0x556b2ebd3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f7497a1c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f748c1b4150 con 0x556b2e803390 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f7497a1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f748c1b1a20 con 0x556b2e824070 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f7497a1c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f748c1af890 con 0x556b2e7fb1b0 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f74827fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebe2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f74827fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebe2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60380/0 (socket says 172.21.15.49:60380) 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f74827fc640 1 -- 172.21.15.49:0/2968786463 learned_addr learned my addr 172.21.15.49:0/2968786463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f748b7fe640 1 --2- 172.21.15.49:0/2968786463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e824070 0x556b2ebd3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.226+0000 7f748affd640 1 --2- 172.21.15.49:0/2968786463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e7fb1b0 0x556b2ebd7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.227+0000 7f74827fc640 1 -- 172.21.15.49:0/2968786463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e7fb1b0 msgr2=0x556b2ebd7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.227+0000 7f74827fc640 1 --2- 172.21.15.49:0/2968786463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e7fb1b0 0x556b2ebd7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.227+0000 7f74827fc640 1 -- 172.21.15.49:0/2968786463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e824070 msgr2=0x556b2ebd3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.227+0000 7f74827fc640 1 --2- 172.21.15.49:0/2968786463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e824070 0x556b2ebd3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.227+0000 7f74827fc640 1 -- 172.21.15.49:0/2968786463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b2ebd7f90 con 0x556b2e803390 2024-09-21T06:40:08.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.227+0000 7f74827fc640 1 --2- 172.21.15.49:0/2968786463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebe2ff0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7474004a00 tx=0x7f747400cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c170e0beb13c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.227+0000 7f7480ff9640 1 -- 172.21.15.49:0/2968786463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f747400cc60 con 0x556b2e803390 2024-09-21T06:40:08.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.227+0000 7f7480ff9640 1 -- 172.21.15.49:0/2968786463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7474004680 con 0x556b2e803390 2024-09-21T06:40:08.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.227+0000 7f7480ff9640 1 -- 172.21.15.49:0/2968786463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7474012450 con 0x556b2e803390 2024-09-21T06:40:08.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 -- 172.21.15.49:0/2968786463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 msgr2=0x556b2ebe2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 --2- 172.21.15.49:0/2968786463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebe2ff0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f7474004a00 tx=0x7f747400cab0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 -- 172.21.15.49:0/2968786463 shutdown_connections 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 --2- 172.21.15.49:0/2968786463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e824070 0x556b2ebd3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 --2- 172.21.15.49:0/2968786463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e803390 0x556b2ebe2ff0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 --2- 172.21.15.49:0/2968786463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e7fb1b0 0x556b2ebd7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 -- 172.21.15.49:0/2968786463 >> 172.21.15.49:0/2968786463 conn(0x556b2e818460 msgr2=0x556b2ebd6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 -- 172.21.15.49:0/2968786463 shutdown_connections 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 -- 172.21.15.49:0/2968786463 wait complete. 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 -- start start 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.228+0000 7f7497a1c740 1 Processor -- start 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebdf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 0x556b2ebdae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f7497a1c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebdb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f7497a1c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f748c1afee0 con 0x556b2e824070 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f7497a1c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f748c1b1350 con 0x556b2e7fb1b0 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f7497a1c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f748c1b05b0 con 0x556b2e803390 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f7497a1c740 10 client.0 _ll_register_callbacks cb 0x7f7484009430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebdb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebdb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60384/0 (socket says 172.21.15.49:60384) 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748b7fe640 1 -- 172.21.15.49:0/745853016 learned_addr learned my addr 172.21.15.49:0/745853016 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f74827fc640 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 0x556b2ebdae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748affd640 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebdf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748b7fe640 1 -- 172.21.15.49:0/745853016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 msgr2=0x556b2ebdae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748b7fe640 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 0x556b2ebdae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748b7fe640 1 -- 172.21.15.49:0/745853016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 msgr2=0x556b2ebdf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748b7fe640 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebdf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748b7fe640 1 -- 172.21.15.49:0/745853016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b2ebdbc40 con 0x556b2e824070 2024-09-21T06:40:08.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f748b7fe640 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebdb4b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7484005e30 tx=0x7f7484004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561950cad7aa9a98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.229+0000 7f74727fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f74727fc640 1 -- 172.21.15.49:0/745853016 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74840ce260 con 0x556b2e824070 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f74727fc640 1 -- 172.21.15.49:0/745853016 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f7484106d40 con 0x556b2e824070 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f7497a1c740 1 -- 172.21.15.49:0/745853016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7474004680 con 0x556b2e824070 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f74727fc640 1 -- 172.21.15.49:0/745853016 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f74840d8510 con 0x556b2e824070 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f7497a1c740 10 client.16326 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f7497a1c740 1 -- 172.21.15.49:0/745853016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556b2ec539c0 con 0x556b2e824070 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f74727fc640 1 -- 172.21.15.49:0/745853016 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7474004680 con 0x556b2e824070 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f74727fc640 1 -- 172.21.15.49:0/745853016 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7484004040 con 0x556b2e824070 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f7497a1c740 10 client.16326 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f7497a1c740 10 client.16326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f7497a1c740 20 client.16326 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f7497a1c740 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b2e7b7da0 0x556b2ec56040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f7497a1c740 4 client.16326 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.230+0000 7f7497a1c740 1 -- 172.21.15.49:0/745853016 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556b2eb3f850 con 0x556b2e7b7da0 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.231+0000 7f748affd640 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b2e7b7da0 0x556b2ec56040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.231+0000 7f74727fc640 10 client.16326 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.231+0000 7f748affd640 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b2e7b7da0 0x556b2ec56040 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=882b6724125593a0 server_cookie=324baaa34231b4a7 in_seq=0 out_seq=0 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.231+0000 7f74727fc640 1 -- 172.21.15.49:0/745853016 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x556b2eb3f850 con 0x556b2e7b7da0 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f74727fc640 10 client.16326 handle_command_reply: tid=0 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 client.16326 shutdown 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 -- 172.21.15.49:0/745853016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 msgr2=0x556b2ebdb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebdb4b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7484005e30 tx=0x7f7484004920 comp rx=0 tx=0).stop 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 -- 172.21.15.49:0/745853016 shutdown_connections 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556b2e7b7da0 0x556b2ec56040 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556b2e824070 0x556b2ebdb4b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556b2e803390 0x556b2ebdae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 --2- 172.21.15.49:0/745853016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556b2e7fb1b0 0x556b2ebdf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 -- 172.21.15.49:0/745853016 >> 172.21.15.49:0/745853016 conn(0x556b2e818460 msgr2=0x556b2ebd8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f74727fc640 0 client.16326 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:08.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 -- 172.21.15.49:0/745853016 shutdown_connections 2024-09-21T06:40:08.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 1 -- 172.21.15.49:0/745853016 wait complete. 2024-09-21T06:40:08.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.232+0000 7f7497a1c740 20 client.16326 trim_cache size 0 max 16384 2024-09-21T06:40:08.238 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:40:08.238 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:40:08.238 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:08.239 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:08.240 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:40:08.241 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:40:08.242 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:08.242 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:08.242 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:08.242 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:08.242 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:08.242 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:40:08.242 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:40:08.242 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:40:08.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 -- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f74780b66b0 msgr2=0x7f74780b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f74780b66b0 0x7f74780b8bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x556b2ebca2d0 tx=0x7f747c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 -- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 msgr2=0x7f748c1a1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 0x7f748c1a1ef0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f7484005cc0 tx=0x7f748402f380 comp rx=0 tx=0).stop 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 -- 172.21.15.49:0/2814514713 shutdown_connections 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f74780b66b0 0x7f74780b8bc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f748c108d10 0x7f748c1a1ef0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f748c1083c0 0x7f748c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 --2- 172.21.15.49:0/2814514713 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f748c102a80 0x7f748c19c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 -- 172.21.15.49:0/2814514713 >> 172.21.15.49:0/2814514713 conn(0x7f748c079740 msgr2=0x7f748c06bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 -- 172.21.15.49:0/2814514713 shutdown_connections 2024-09-21T06:40:08.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:08.233+0000 7f74914a8640 1 -- 172.21.15.49:0/2814514713 wait complete. 2024-09-21T06:40:08.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:07 smithi098 ceph-mon[34704]: pgmap v423: 97 pgs: 97 active+clean; 3.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-09-21T06:40:08.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:07 smithi079 ceph-mon[34346]: pgmap v423: 97 pgs: 97 active+clean; 3.0 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 37 KiB/s wr, 26 op/s 2024-09-21T06:40:09.059 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:40:09.060 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:40:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.282+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3733214705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd078105260 msgr2=0x7fd07810d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.282+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3733214705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd078105260 0x7fd07810d7a0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fd06c009900 tx=0x7fd06c02a410 comp rx=0 tx=0).stop 2024-09-21T06:40:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.283+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3733214705 shutdown_connections 2024-09-21T06:40:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.283+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3733214705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd07810dd70 0x7fd078110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.288 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.283+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3733214705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd078105260 0x7fd07810d7a0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.283+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3733214705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd078104910 0x7fd078104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.283+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3733214705 >> 172.21.15.49:0/3733214705 conn(0x7fd0780fe3c0 msgr2=0x7fd078100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.283+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3733214705 shutdown_connections 2024-09-21T06:40:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.283+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3733214705 wait complete. 2024-09-21T06:40:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.283+0000 7fd07d9c3640 1 Processor -- start 2024-09-21T06:40:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.283+0000 7fd07d9c3640 1 -- start start 2024-09-21T06:40:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd07d9c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd078104910 0x7fd07819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd07d9c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd078105260 0x7fd07819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd07d9c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd07810dd70 0x7fd07819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd07d9c3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781139d0 con 0x7fd07810dd70 2024-09-21T06:40:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd07d9c3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd078113850 con 0x7fd078105260 2024-09-21T06:40:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd07d9c3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd078113b50 con 0x7fd078104910 2024-09-21T06:40:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd0777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd07810dd70 0x7fd07819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd0777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd07810dd70 0x7fd07819fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60398/0 (socket says 172.21.15.49:60398) 2024-09-21T06:40:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd0777fe640 1 -- 172.21.15.49:0/3614434848 learned_addr learned my addr 172.21.15.49:0/3614434848 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd0767fc640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd078105260 0x7fd07819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd076ffd640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd078104910 0x7fd07819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd0777fe640 1 -- 172.21.15.49:0/3614434848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd078104910 msgr2=0x7fd07819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd0777fe640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd078104910 0x7fd07819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd0777fe640 1 -- 172.21.15.49:0/3614434848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd078105260 msgr2=0x7fd07819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd0777fe640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd078105260 0x7fd07819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.284+0000 7fd0777fe640 1 -- 172.21.15.49:0/3614434848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0781a0360 con 0x7fd07810dd70 2024-09-21T06:40:09.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.285+0000 7fd0777fe640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd07810dd70 0x7fd07819fc60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd07000eb10 tx=0x7fd07000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.285+0000 7fd07c9c1640 1 -- 172.21.15.49:0/3614434848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070004b20 con 0x7fd07810dd70 2024-09-21T06:40:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.285+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3614434848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0781a0650 con 0x7fd07810dd70 2024-09-21T06:40:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.285+0000 7fd07c9c1640 1 -- 172.21.15.49:0/3614434848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd070004cc0 con 0x7fd07810dd70 2024-09-21T06:40:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.285+0000 7fd07c9c1640 1 -- 172.21.15.49:0/3614434848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd070010670 con 0x7fd07810dd70 2024-09-21T06:40:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.285+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3614434848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0781a6de0 con 0x7fd07810dd70 2024-09-21T06:40:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.288+0000 7fd084a0a740 1 Processor -- start 2024-09-21T06:40:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.288+0000 7fd07c9c1640 1 -- 172.21.15.49:0/3614434848 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd070010830 con 0x7fd07810dd70 2024-09-21T06:40:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.288+0000 7fd084a0a740 1 -- start start 2024-09-21T06:40:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.288+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49411b0 0x55a8e4ce69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.288+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.288+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49204d0 0x55a8e4ce7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.288+0000 7fd084a0a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a8e4c5b6f0 con 0x55a8e49182f0 2024-09-21T06:40:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.288+0000 7fd084a0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8e4c4ab20 con 0x55a8e49204d0 2024-09-21T06:40:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd084a0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a8e4c4e930 con 0x55a8e49411b0 2024-09-21T06:40:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60400/0 (socket says 172.21.15.49:60400) 2024-09-21T06:40:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd076ffd640 1 -- 172.21.15.49:0/2485967909 learned_addr learned my addr 172.21.15.49:0/2485967909 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd0767fc640 1 --2- 172.21.15.49:0/2485967909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49204d0 0x55a8e4ce7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd0767fc640 1 --2- 172.21.15.49:0/2485967909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49411b0 0x55a8e4ce69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd07c9c1640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0600b6680 0x7fd0600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd076ffd640 1 -- 172.21.15.49:0/2485967909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49411b0 msgr2=0x55a8e4ce69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd076ffd640 1 --2- 172.21.15.49:0/2485967909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49411b0 0x55a8e4ce69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd076ffd640 1 -- 172.21.15.49:0/2485967909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49204d0 msgr2=0x55a8e4ce7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd076ffd640 1 --2- 172.21.15.49:0/2485967909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49204d0 0x55a8e4ce7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd076ffd640 1 -- 172.21.15.49:0/2485967909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e4c10530 con 0x55a8e49182f0 2024-09-21T06:40:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd0777fe640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0600b6680 0x7fd0600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd07c9c1640 1 -- 172.21.15.49:0/3614434848 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd0700e7d20 con 0x7fd07810dd70 2024-09-21T06:40:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.289+0000 7fd076ffd640 1 --2- 172.21.15.49:0/2485967909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce6ef0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd068009d20 tx=0x7fd068011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2578191d4991c31d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.290+0000 7fd05dffb640 1 -- 172.21.15.49:0/2485967909 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06801e070 con 0x55a8e49182f0 2024-09-21T06:40:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.290+0000 7fd05dffb640 1 -- 172.21.15.49:0/2485967909 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd068019ae0 con 0x55a8e49182f0 2024-09-21T06:40:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.290+0000 7fd05dffb640 1 -- 172.21.15.49:0/2485967909 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06800ea10 con 0x55a8e49182f0 2024-09-21T06:40:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.290+0000 7fd0777fe640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0600b6680 0x7fd0600b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0700e5a50 tx=0x7fd07007a800 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 -- 172.21.15.49:0/2485967909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 msgr2=0x55a8e4ce6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 --2- 172.21.15.49:0/2485967909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce6ef0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd068009d20 tx=0x7fd068011810 comp rx=0 tx=0).stop 2024-09-21T06:40:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 -- 172.21.15.49:0/2485967909 shutdown_connections 2024-09-21T06:40:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 --2- 172.21.15.49:0/2485967909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49204d0 0x55a8e4ce7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 --2- 172.21.15.49:0/2485967909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce6ef0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 --2- 172.21.15.49:0/2485967909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49411b0 0x55a8e4ce69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 -- 172.21.15.49:0/2485967909 >> 172.21.15.49:0/2485967909 conn(0x55a8e4935300 msgr2=0x55a8e4ce48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 -- 172.21.15.49:0/2485967909 shutdown_connections 2024-09-21T06:40:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 -- 172.21.15.49:0/2485967909 wait complete. 2024-09-21T06:40:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.291+0000 7fd084a0a740 1 -- start start 2024-09-21T06:40:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd084a0a740 1 Processor -- start 2024-09-21T06:40:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 0x55a8e4cf2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4cfe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd084a0a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a8e4b82ab0 con 0x55a8e49204d0 2024-09-21T06:40:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd084a0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a8e4bf0730 con 0x55a8e49411b0 2024-09-21T06:40:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd084a0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a8e4cf5130 con 0x55a8e49182f0 2024-09-21T06:40:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd084a0a740 10 client.0 _ll_register_callbacks cb 0x55a8e4c446b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60416/0 (socket says 172.21.15.49:60416) 2024-09-21T06:40:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd076ffd640 1 -- 172.21.15.49:0/1244771884 learned_addr learned my addr 172.21.15.49:0/1244771884 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd0767fc640 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4cfe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd0767fc640 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 0x55a8e4cf2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd0767fc640 1 -- 172.21.15.49:0/1244771884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 msgr2=0x55a8e4cf2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.292+0000 7fd0767fc640 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 0x55a8e4cf2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.293+0000 7fd0767fc640 1 -- 172.21.15.49:0/1244771884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 msgr2=0x55a8e4cf2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.293+0000 7fd0767fc640 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.293+0000 7fd0767fc640 1 -- 172.21.15.49:0/1244771884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8e49ac790 con 0x55a8e49411b0 2024-09-21T06:40:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.293+0000 7fd076ffd640 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.293+0000 7fd0767fc640 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4cfe480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd06c02a930 tx=0x7fd06c02a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7dc507102dc7129 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.293+0000 7fd056ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:40:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.293+0000 7fd056ffd640 1 -- 172.21.15.49:0/1244771884 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c035040 con 0x55a8e49411b0 2024-09-21T06:40:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.293+0000 7fd056ffd640 1 -- 172.21.15.49:0/1244771884 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd06c031de0 con 0x55a8e49411b0 2024-09-21T06:40:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.293+0000 7fd084a0a740 1 -- 172.21.15.49:0/1244771884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd068019ae0 con 0x55a8e49411b0 2024-09-21T06:40:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd056ffd640 1 -- 172.21.15.49:0/1244771884 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd06c004020 con 0x55a8e49411b0 2024-09-21T06:40:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd084a0a740 10 client.25895 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd084a0a740 1 -- 172.21.15.49:0/1244771884 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a8e4a25620 con 0x55a8e49411b0 2024-09-21T06:40:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd056ffd640 1 -- 172.21.15.49:0/1244771884 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd068019ae0 con 0x55a8e49411b0 2024-09-21T06:40:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd056ffd640 1 -- 172.21.15.49:0/1244771884 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd06c04b070 con 0x55a8e49411b0 2024-09-21T06:40:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd084a0a740 10 client.25895 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd084a0a740 10 client.25895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd084a0a740 20 client.25895 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd084a0a740 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a8e48ffd80 0x55a8e4d04180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd084a0a740 4 client.25895 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd084a0a740 1 -- 172.21.15.49:0/1244771884 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8e4c5d640 con 0x55a8e48ffd80 2024-09-21T06:40:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.294+0000 7fd076ffd640 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a8e48ffd80 0x55a8e4d04180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.295+0000 7fd056ffd640 10 client.25895 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.295+0000 7fd076ffd640 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a8e48ffd80 0x55a8e4d04180 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb50b66792af1175 server_cookie=ca62977e7408e627 in_seq=0 out_seq=0 2024-09-21T06:40:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd056ffd640 1 -- 172.21.15.49:0/1244771884 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8e4c5d640 con 0x55a8e48ffd80 2024-09-21T06:40:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd056ffd640 10 client.25895 handle_command_reply: tid=0 2024-09-21T06:40:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 client.25895 shutdown 2024-09-21T06:40:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 -- 172.21.15.49:0/1244771884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 msgr2=0x55a8e4cfe480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4cfe480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd06c02a930 tx=0x7fd06c02a410 comp rx=0 tx=0).stop 2024-09-21T06:40:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 -- 172.21.15.49:0/1244771884 shutdown_connections 2024-09-21T06:40:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a8e48ffd80 0x55a8e4d04180 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4cfe480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 --2- 172.21.15.49:0/1244771884 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 0x55a8e4cf2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd056ffd640 0 client.25895 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 -- 172.21.15.49:0/1244771884 >> 172.21.15.49:0/1244771884 conn(0x55a8e4935300 msgr2=0x55a8e4ce79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 -- 172.21.15.49:0/1244771884 shutdown_connections 2024-09-21T06:40:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 1 -- 172.21.15.49:0/1244771884 wait complete. 2024-09-21T06:40:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.296+0000 7fd084a0a740 20 client.25895 trim_cache size 0 max 16384 2024-09-21T06:40:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd084a0a740 1 Processor -- start 2024-09-21T06:40:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd084a0a740 1 -- start start 2024-09-21T06:40:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49204d0 0x55a8e4cf3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4cfe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd084a0a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781b20b0 con 0x55a8e49182f0 2024-09-21T06:40:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd084a0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781af980 con 0x55a8e49411b0 2024-09-21T06:40:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd084a0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ad7f0 con 0x55a8e49204d0 2024-09-21T06:40:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd0767fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd0767fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60422/0 (socket says 172.21.15.49:60422) 2024-09-21T06:40:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd0767fc640 1 -- 172.21.15.49:0/2008985115 learned_addr learned my addr 172.21.15.49:0/2008985115 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.312+0000 7fd076ffd640 1 --2- 172.21.15.49:0/2008985115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49204d0 0x55a8e4cf3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd0767fc640 1 --2- 172.21.15.49:0/2008985115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4cfe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd0767fc640 1 -- 172.21.15.49:0/2008985115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49204d0 msgr2=0x55a8e4cf3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd0767fc640 1 --2- 172.21.15.49:0/2008985115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49204d0 0x55a8e4cf3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd0767fc640 1 -- 172.21.15.49:0/2008985115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 msgr2=0x55a8e4cfe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd0767fc640 1 --2- 172.21.15.49:0/2008985115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4cfe380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd0767fc640 1 -- 172.21.15.49:0/2008985115 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8e4d044b0 con 0x55a8e49182f0 2024-09-21T06:40:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd0767fc640 1 --2- 172.21.15.49:0/2008985115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce83a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd06c001eb0 tx=0x7fd06c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72a3db40fcbbb1a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd05d7fa640 1 -- 172.21.15.49:0/2008985115 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c035040 con 0x55a8e49182f0 2024-09-21T06:40:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd05d7fa640 1 -- 172.21.15.49:0/2008985115 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd06c0043c0 con 0x55a8e49182f0 2024-09-21T06:40:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.313+0000 7fd05d7fa640 1 -- 172.21.15.49:0/2008985115 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c004750 con 0x55a8e49182f0 2024-09-21T06:40:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.314+0000 7fd084a0a740 1 -- 172.21.15.49:0/2008985115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 msgr2=0x55a8e4ce83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.314+0000 7fd084a0a740 1 --2- 172.21.15.49:0/2008985115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce83a0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd06c001eb0 tx=0x7fd06c005fd0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.314+0000 7fd084a0a740 1 -- 172.21.15.49:0/2008985115 shutdown_connections 2024-09-21T06:40:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.314+0000 7fd084a0a740 1 --2- 172.21.15.49:0/2008985115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4cfe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.314+0000 7fd084a0a740 1 --2- 172.21.15.49:0/2008985115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49204d0 0x55a8e4cf3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.314+0000 7fd084a0a740 1 --2- 172.21.15.49:0/2008985115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49182f0 0x55a8e4ce83a0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.315+0000 7fd084a0a740 1 -- 172.21.15.49:0/2008985115 >> 172.21.15.49:0/2008985115 conn(0x55a8e4935300 msgr2=0x55a8e4cf3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.315+0000 7fd084a0a740 1 -- 172.21.15.49:0/2008985115 shutdown_connections 2024-09-21T06:40:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.315+0000 7fd084a0a740 1 -- 172.21.15.49:0/2008985115 wait complete. 2024-09-21T06:40:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.315+0000 7fd084a0a740 1 -- start start 2024-09-21T06:40:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.315+0000 7fd084a0a740 1 Processor -- start 2024-09-21T06:40:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 0x55a8e4cf7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd084a0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4d66c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd084a0a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ade40 con 0x55a8e49204d0 2024-09-21T06:40:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd084a0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781af2b0 con 0x55a8e49411b0 2024-09-21T06:40:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd084a0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ae510 con 0x55a8e49182f0 2024-09-21T06:40:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd084a0a740 10 client.0 _ll_register_callbacks cb 0x7fd06c0316a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60426/0 (socket says 172.21.15.49:60426) 2024-09-21T06:40:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd076ffd640 1 -- 172.21.15.49:0/3373630128 learned_addr learned my addr 172.21.15.49:0/3373630128 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd0767fc640 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 0x55a8e4cf7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd0767fc640 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4d66c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd076ffd640 1 -- 172.21.15.49:0/3373630128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 msgr2=0x55a8e4cf7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd076ffd640 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 0x55a8e4cf7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd076ffd640 1 -- 172.21.15.49:0/3373630128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 msgr2=0x55a8e4d66c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd076ffd640 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4d66c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd076ffd640 1 -- 172.21.15.49:0/3373630128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8e4d67300 con 0x55a8e49204d0 2024-09-21T06:40:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.316+0000 7fd0767fc640 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 0x55a8e4cf7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd076ffd640 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf8560 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd0680058c0 tx=0x7fd0680098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f854917c0ee852b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd056ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd056ffd640 1 -- 172.21.15.49:0/3373630128 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06801e040 con 0x55a8e49204d0 2024-09-21T06:40:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd056ffd640 1 -- 172.21.15.49:0/3373630128 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd0680055c0 con 0x55a8e49204d0 2024-09-21T06:40:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd084a0a740 1 -- 172.21.15.49:0/3373630128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd06c0043c0 con 0x55a8e49204d0 2024-09-21T06:40:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd056ffd640 1 -- 172.21.15.49:0/3373630128 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd06803b050 con 0x55a8e49204d0 2024-09-21T06:40:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd084a0a740 10 client.16344 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd084a0a740 1 -- 172.21.15.49:0/3373630128 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a8e4d6e720 con 0x55a8e49204d0 2024-09-21T06:40:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd056ffd640 1 -- 172.21.15.49:0/3373630128 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd06c0043c0 con 0x55a8e49204d0 2024-09-21T06:40:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.317+0000 7fd056ffd640 1 -- 172.21.15.49:0/3373630128 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd068036030 con 0x55a8e49204d0 2024-09-21T06:40:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.318+0000 7fd084a0a740 10 client.16344 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.318+0000 7fd084a0a740 10 client.16344 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.318+0000 7fd084a0a740 20 client.16344 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.318+0000 7fd084a0a740 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a8e48d51c0 0x55a8e4d70da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.318+0000 7fd084a0a740 4 client.16344 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:40:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.318+0000 7fd084a0a740 1 -- 172.21.15.49:0/3373630128 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a8e4c590f0 con 0x55a8e48d51c0 2024-09-21T06:40:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.318+0000 7fd0767fc640 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a8e48d51c0 0x55a8e4d70da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.318+0000 7fd056ffd640 10 client.16344 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.318+0000 7fd0767fc640 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a8e48d51c0 0x55a8e4d70da0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd3474f829081aaa server_cookie=434ba45928f8585a in_seq=0 out_seq=0 2024-09-21T06:40:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd056ffd640 1 -- 172.21.15.49:0/3373630128 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a8e4c590f0 con 0x55a8e48d51c0 2024-09-21T06:40:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd056ffd640 10 client.16344 handle_command_reply: tid=0 2024-09-21T06:40:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd084a0a740 1 client.16344 shutdown 2024-09-21T06:40:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd084a0a740 1 -- 172.21.15.49:0/3373630128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 msgr2=0x55a8e4cf8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd084a0a740 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf8560 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd0680058c0 tx=0x7fd0680098f0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd084a0a740 1 -- 172.21.15.49:0/3373630128 shutdown_connections 2024-09-21T06:40:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd084a0a740 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a8e48d51c0 0x55a8e4d70da0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd084a0a740 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a8e49411b0 0x55a8e4d66c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd084a0a740 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a8e49204d0 0x55a8e4cf8560 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd084a0a740 1 --2- 172.21.15.49:0/3373630128 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a8e49182f0 0x55a8e4cf7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd084a0a740 1 -- 172.21.15.49:0/3373630128 >> 172.21.15.49:0/3373630128 conn(0x55a8e4935300 msgr2=0x55a8e4cf3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.326+0000 7fd056ffd640 0 client.16344 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd084a0a740 1 -- 172.21.15.49:0/3373630128 shutdown_connections 2024-09-21T06:40:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd084a0a740 1 -- 172.21.15.49:0/3373630128 wait complete. 2024-09-21T06:40:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd084a0a740 20 client.16344 trim_cache size 0 max 16384 2024-09-21T06:40:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:40:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:40:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:40:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:40:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0600b6680 msgr2=0x7fd0600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0600b6680 0x7fd0600b8b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0700e5a50 tx=0x7fd07007a800 comp rx=0 tx=0).stop 2024-09-21T06:40:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd07810dd70 msgr2=0x7fd07819fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd07810dd70 0x7fd07819fc60 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fd07000eb10 tx=0x7fd07000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3614434848 shutdown_connections 2024-09-21T06:40:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0600b6680 0x7fd0600b8b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd07810dd70 0x7fd07819fc60 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd078105260 0x7fd07819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 --2- 172.21.15.49:0/3614434848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd078104910 0x7fd07819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.327+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3614434848 >> 172.21.15.49:0/3614434848 conn(0x7fd0780fe3c0 msgr2=0x7fd078106770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.328+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3614434848 shutdown_connections 2024-09-21T06:40:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:09.328+0000 7fd07d9c3640 1 -- 172.21.15.49:0/3614434848 wait complete. 2024-09-21T06:40:09.345 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:09.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.877+0000 7f2833086640 1 -- 172.21.15.49:0/1585744575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 msgr2=0x7f282c1033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.877+0000 7f2833086640 1 --2- 172.21.15.49:0/1585744575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 0x7f282c1033b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f2818009900 tx=0x7f281802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.877+0000 7f2833086640 1 -- 172.21.15.49:0/1585744575 shutdown_connections 2024-09-21T06:40:09.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.877+0000 7f2833086640 1 --2- 172.21.15.49:0/1585744575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c1038f0 0x7f282c10f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.877+0000 7f2833086640 1 --2- 172.21.15.49:0/1585744575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 0x7f282c1033b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.877+0000 7f2833086640 1 --2- 172.21.15.49:0/1585744575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c107630 0x7f282c107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.877+0000 7f2833086640 1 -- 172.21.15.49:0/1585744575 >> 172.21.15.49:0/1585744575 conn(0x7f282c079e40 msgr2=0x7f282c07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.877+0000 7f2833086640 1 -- 172.21.15.49:0/1585744575 shutdown_connections 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.877+0000 7f2833086640 1 -- 172.21.15.49:0/1585744575 wait complete. 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2833086640 1 Processor -- start 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2833086640 1 -- start start 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2833086640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 0x7f282c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2833086640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c1038f0 0x7f282c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2833086640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c107630 0x7f282c19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2833086640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f282c1129e0 con 0x7f282c102fa0 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2833086640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f282c112860 con 0x7f282c1038f0 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2833086640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f282c112b60 con 0x7f282c107630 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2830e22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 0x7f282c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2830e22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 0x7f282c19b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60442/0 (socket says 172.21.15.49:60442) 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2830e22640 1 -- 172.21.15.49:0/3443800920 learned_addr learned my addr 172.21.15.49:0/3443800920 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:09.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f282bfff640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c1038f0 0x7f282c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.878+0000 7f2831623640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c107630 0x7f282c19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2830e22640 1 -- 172.21.15.49:0/3443800920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c107630 msgr2=0x7f282c19bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2830e22640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c107630 0x7f282c19bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2830e22640 1 -- 172.21.15.49:0/3443800920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c1038f0 msgr2=0x7f282c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2830e22640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c1038f0 0x7f282c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2830e22640 1 -- 172.21.15.49:0/3443800920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c1a6670 con 0x7f282c102fa0 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2831623640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c107630 0x7f282c19bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2830e22640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 0x7f282c19b470 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f282000d770 tx=0x7f282000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2829ffb640 1 -- 172.21.15.49:0/3443800920 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820017070 con 0x7f282c102fa0 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2829ffb640 1 -- 172.21.15.49:0/3443800920 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28200054d0 con 0x7f282c102fa0 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282c1a6960 con 0x7f282c102fa0 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2829ffb640 1 -- 172.21.15.49:0/3443800920 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820004c30 con 0x7f282c102fa0 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.879+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282c1a6e70 con 0x7f282c102fa0 2024-09-21T06:40:09.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.880+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282c1033b0 con 0x7f282c102fa0 2024-09-21T06:40:09.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.882+0000 7f2829ffb640 1 -- 172.21.15.49:0/3443800920 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2820004dd0 con 0x7f282c102fa0 2024-09-21T06:40:09.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.883+0000 7f2829ffb640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f281c0b6730 0x7f281c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:09.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.883+0000 7f282bfff640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f281c0b6730 0x7f281c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:09.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.883+0000 7f2829ffb640 1 -- 172.21.15.49:0/3443800920 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f28200e74b0 con 0x7f282c102fa0 2024-09-21T06:40:09.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.883+0000 7f282bfff640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f281c0b6730 0x7f281c0b8c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2818009230 tx=0x7f2818031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:09.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:09.886+0000 7f2829ffb640 1 -- 172.21.15.49:0/3443800920 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28200ada60 con 0x7f282c102fa0 2024-09-21T06:40:10.115 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.113+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f282c1022a0 con 0x7f282c102fa0 2024-09-21T06:40:10.115 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:09 smithi049 ceph-mon[31177]: pgmap v424: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 44 KiB/s wr, 31 op/s 2024-09-21T06:40:10.116 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.114+0000 7f2829ffb640 1 -- 172.21.15.49:0/3443800920 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f282c1022a0 con 0x7f282c102fa0 2024-09-21T06:40:10.116 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:40:10.116 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:40:10.116 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:40:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f281c0b6730 msgr2=0x7f281c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f281c0b6730 0x7f281c0b8c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2818009230 tx=0x7f2818031400 comp rx=0 tx=0).stop 2024-09-21T06:40:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 msgr2=0x7f282c19b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 0x7f282c19b470 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f282000d770 tx=0x7f282000dc30 comp rx=0 tx=0).stop 2024-09-21T06:40:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 shutdown_connections 2024-09-21T06:40:10.118 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f281c0b6730 0x7f281c0b8c40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f282c107630 0x7f282c19bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f282c1038f0 0x7f282c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 --2- 172.21.15.49:0/3443800920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f282c102fa0 0x7f282c19b470 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 >> 172.21.15.49:0/3443800920 conn(0x7f282c079e40 msgr2=0x7f282c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:10.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 shutdown_connections 2024-09-21T06:40:10.119 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:10.116+0000 7f2833086640 1 -- 172.21.15.49:0/3443800920 wait complete. 2024-09-21T06:40:10.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:09 smithi098 ceph-mon[34704]: pgmap v424: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 44 KiB/s wr, 31 op/s 2024-09-21T06:40:10.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:09 smithi079 ceph-mon[34346]: pgmap v424: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 44 KiB/s wr, 31 op/s 2024-09-21T06:40:10.827 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:40:11.089 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:11.210 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:10 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3443800920' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:11.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:10 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3443800920' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:11.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:10 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3443800920' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:11.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.545+0000 7fee9351a640 1 -- 172.21.15.49:0/634612793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 msgr2=0x7fee8c1026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.545+0000 7fee9351a640 1 --2- 172.21.15.49:0/634612793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 0x7fee8c1026b0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fee88009900 tx=0x7fee8802a410 comp rx=0 tx=0).stop 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.545+0000 7fee9351a640 1 -- 172.21.15.49:0/634612793 shutdown_connections 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.545+0000 7fee9351a640 1 --2- 172.21.15.49:0/634612793 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee8c108530 0x7fee8c10ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.545+0000 7fee9351a640 1 --2- 172.21.15.49:0/634612793 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee8c107be0 0x7fee8c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.545+0000 7fee9351a640 1 --2- 172.21.15.49:0/634612793 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 0x7fee8c1026b0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.545+0000 7fee9351a640 1 -- 172.21.15.49:0/634612793 >> 172.21.15.49:0/634612793 conn(0x7fee8c079ec0 msgr2=0x7fee8c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.545+0000 7fee9351a640 1 -- 172.21.15.49:0/634612793 shutdown_connections 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.545+0000 7fee9351a640 1 -- 172.21.15.49:0/634612793 wait complete. 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee9351a640 1 Processor -- start 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee9351a640 1 -- start start 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee9351a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 0x7fee8c19b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee9351a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee8c107be0 0x7fee8c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee9351a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee8c108530 0x7fee8c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee9351a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c112250 con 0x7fee8c1022a0 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee9351a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c1120d0 con 0x7fee8c108530 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee9351a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c1123d0 con 0x7fee8c107be0 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee912b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 0x7fee8c19b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee912b6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 0x7fee8c19b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60458/0 (socket says 172.21.15.49:60458) 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.546+0000 7fee912b6640 1 -- 172.21.15.49:0/3634811909 learned_addr learned my addr 172.21.15.49:0/3634811909 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee912b6640 1 -- 172.21.15.49:0/3634811909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee8c107be0 msgr2=0x7fee8c19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee90ab5640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee8c107be0 0x7fee8c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee91ab7640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee8c108530 0x7fee8c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee912b6640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee8c107be0 0x7fee8c19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee912b6640 1 -- 172.21.15.49:0/3634811909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee8c108530 msgr2=0x7fee8c19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee912b6640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee8c108530 0x7fee8c19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee912b6640 1 -- 172.21.15.49:0/3634811909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8c1a6640 con 0x7fee8c1022a0 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee91ab7640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee8c108530 0x7fee8c19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee912b6640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 0x7fee8c19b410 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fee88006010 tx=0x7fee880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee827fc640 1 -- 172.21.15.49:0/3634811909 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8803f030 con 0x7fee8c1022a0 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee827fc640 1 -- 172.21.15.49:0/3634811909 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee88003800 con 0x7fee8c1022a0 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee9351a640 1 -- 172.21.15.49:0/3634811909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8c1a68d0 con 0x7fee8c1022a0 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee827fc640 1 -- 172.21.15.49:0/3634811909 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88035070 con 0x7fee8c1022a0 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.547+0000 7fee9351a640 1 -- 172.21.15.49:0/3634811909 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8c1a6e00 con 0x7fee8c1022a0 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee99a8e740 1 Processor -- start 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee99a8e740 1 -- start start 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee827fc640 1 -- 172.21.15.49:0/3634811909 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fee88003cb0 con 0x7fee8c1022a0 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0ead070 0x55d3f12546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 0x55d3f1254be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0e8c390 0x55d3f1255120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee99a8e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d3f11caea0 con 0x55d3f0e8c390 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee99a8e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d3f11ba2d0 con 0x55d3f0e841b0 2024-09-21T06:40:11.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee99a8e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d3f11be0e0 con 0x55d3f0ead070 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee90ab5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0e8c390 0x55d3f1255120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee90ab5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0e8c390 0x55d3f1255120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60468/0 (socket says 172.21.15.49:60468) 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.550+0000 7fee90ab5640 1 -- 172.21.15.49:0/1868287566 learned_addr learned my addr 172.21.15.49:0/1868287566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee91ab7640 1 --2- 172.21.15.49:0/1868287566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0ead070 0x55d3f12546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee912b6640 1 --2- 172.21.15.49:0/1868287566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 0x55d3f1254be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee90ab5640 1 -- 172.21.15.49:0/1868287566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0ead070 msgr2=0x55d3f12546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee90ab5640 1 --2- 172.21.15.49:0/1868287566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0ead070 0x55d3f12546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee90ab5640 1 -- 172.21.15.49:0/1868287566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 msgr2=0x55d3f1254be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee90ab5640 1 --2- 172.21.15.49:0/1868287566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 0x55d3f1254be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee90ab5640 1 -- 172.21.15.49:0/1868287566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3f0f18650 con 0x55d3f0e8c390 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee827fc640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fee780b6700 0x7fee780b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee90ab5640 1 --2- 172.21.15.49:0/1868287566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0e8c390 0x55d3f1255120 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00baa0 tx=0x7fee7c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398be8b53a86e34b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.551+0000 7fee827fc640 1 -- 172.21.15.49:0/3634811909 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fee88108110 con 0x7fee8c1022a0 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.552+0000 7fee91ab7640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fee780b6700 0x7fee780b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.552+0000 7fee777fe640 1 -- 172.21.15.49:0/1868287566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c017420 con 0x55d3f0e8c390 2024-09-21T06:40:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.552+0000 7fee777fe640 1 -- 172.21.15.49:0/1868287566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee7c017a70 con 0x55d3f0e8c390 2024-09-21T06:40:11.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.552+0000 7fee777fe640 1 -- 172.21.15.49:0/1868287566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7c00fa00 con 0x55d3f0e8c390 2024-09-21T06:40:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 -- 172.21.15.49:0/1868287566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0e8c390 msgr2=0x55d3f1255120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee91ab7640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fee780b6700 0x7fee780b8c10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee8400f4c0 tx=0x7fee84007740 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1868287566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0e8c390 0x55d3f1255120 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fee7c00baa0 tx=0x7fee7c00bf60 comp rx=0 tx=0).stop 2024-09-21T06:40:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 -- 172.21.15.49:0/1868287566 shutdown_connections 2024-09-21T06:40:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1868287566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0e8c390 0x55d3f1255120 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1868287566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 0x55d3f1254be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1868287566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0ead070 0x55d3f12546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 -- 172.21.15.49:0/1868287566 >> 172.21.15.49:0/1868287566 conn(0x55d3f0ea1460 msgr2=0x55d3f1252590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 -- 172.21.15.49:0/1868287566 shutdown_connections 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 -- 172.21.15.49:0/1868287566 wait complete. 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.553+0000 7fee99a8e740 1 -- start start 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee99a8e740 1 Processor -- start 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 0x55d3f12641e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e8c390 0x55d3f1264720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee99a8e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d3f101b700 con 0x55d3f0ead070 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee99a8e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d3f1155160 con 0x55d3f0e841b0 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee99a8e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d3f12671e0 con 0x55d3f0e8c390 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee99a8e740 10 client.0 _ll_register_callbacks cb 0x55d3f116e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee91ab7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee91ab7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60472/0 (socket says 172.21.15.49:60472) 2024-09-21T06:40:11.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee91ab7640 1 -- 172.21.15.49:0/1464433299 learned_addr learned my addr 172.21.15.49:0/1464433299 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee90ab5640 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e8c390 0x55d3f1264720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.554+0000 7fee912b6640 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 0x55d3f12641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee91ab7640 1 -- 172.21.15.49:0/1464433299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e8c390 msgr2=0x55d3f1264720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee91ab7640 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e8c390 0x55d3f1264720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee91ab7640 1 -- 172.21.15.49:0/1464433299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 msgr2=0x55d3f12641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee91ab7640 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 0x55d3f12641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee91ab7640 1 -- 172.21.15.49:0/1464433299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3f1182c90 con 0x55d3f0ead070 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee90ab5640 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e8c390 0x55d3f1264720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee91ab7640 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270510 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fee84010eb0 tx=0x7fee84004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cab23097c67b4f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee74ff9640 1 -- 172.21.15.49:0/1464433299 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84026680 con 0x55d3f0ead070 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee99a8e740 1 -- 172.21.15.49:0/1464433299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee7c017a70 con 0x55d3f0ead070 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee74ff9640 1 -- 172.21.15.49:0/1464433299 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fee84026820 con 0x55d3f0ead070 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee74ff9640 1 -- 172.21.15.49:0/1464433299 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee84026a20 con 0x55d3f0ead070 2024-09-21T06:40:11.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee99a8e740 10 client.16362 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.555+0000 7fee99a8e740 1 -- 172.21.15.49:0/1464433299 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d3f1272ff0 con 0x55d3f0ead070 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.556+0000 7fee74ff9640 1 -- 172.21.15.49:0/1464433299 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee7c017a70 con 0x55d3f0ead070 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.556+0000 7fee74ff9640 1 -- 172.21.15.49:0/1464433299 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fee8401dca0 con 0x55d3f0ead070 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.556+0000 7fee99a8e740 10 client.16362 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.556+0000 7fee99a8e740 10 client.16362 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.556+0000 7fee99a8e740 20 client.16362 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.556+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d3f0e6b9f0 0x55d3f1276560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.556+0000 7fee99a8e740 4 client.16362 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.556+0000 7fee99a8e740 1 -- 172.21.15.49:0/1464433299 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3f11ccdf0 con 0x55d3f0e6b9f0 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.556+0000 7fee912b6640 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d3f0e6b9f0 0x55d3f1276560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.557+0000 7fee912b6640 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d3f0e6b9f0 0x55d3f1276560 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b196ccb780644d5 server_cookie=9b2ba612b09c2534 in_seq=0 out_seq=0 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.557+0000 7fee74ff9640 10 client.16362 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:40:11.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.557+0000 7fee74ff9640 1 -- 172.21.15.49:0/1464433299 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d3f11ccdf0 con 0x55d3f0e6b9f0 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.557+0000 7fee74ff9640 10 client.16362 handle_command_reply: tid=0 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.557+0000 7fee99a8e740 1 client.16362 shutdown 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 -- 172.21.15.49:0/1464433299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 msgr2=0x55d3f1270510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270510 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fee84010eb0 tx=0x7fee84004b50 comp rx=0 tx=0).stop 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 -- 172.21.15.49:0/1464433299 shutdown_connections 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d3f0e6b9f0 0x55d3f1276560 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee74ff9640 0 client.16362 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270510 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e8c390 0x55d3f1264720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 --2- 172.21.15.49:0/1464433299 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e841b0 0x55d3f12641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 -- 172.21.15.49:0/1464433299 >> 172.21.15.49:0/1464433299 conn(0x55d3f0ea1460 msgr2=0x55d3f1256090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 -- 172.21.15.49:0/1464433299 shutdown_connections 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 1 -- 172.21.15.49:0/1464433299 wait complete. 2024-09-21T06:40:11.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.558+0000 7fee99a8e740 20 client.16362 trim_cache size 0 max 16384 2024-09-21T06:40:11.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.571+0000 7fee99a8e740 1 Processor -- start 2024-09-21T06:40:11.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.571+0000 7fee99a8e740 1 -- start start 2024-09-21T06:40:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 0x55d3f12646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 0x55d3f1270410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee99a8e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c1afe80 con 0x55d3f0ead070 2024-09-21T06:40:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee99a8e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c1ad750 con 0x55d3f0e8c390 2024-09-21T06:40:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee99a8e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c1ab5c0 con 0x55d3f0e841b0 2024-09-21T06:40:11.574 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee91ab7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee91ab7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60480/0 (socket says 172.21.15.49:60480) 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee91ab7640 1 -- 172.21.15.49:0/457027023 learned_addr learned my addr 172.21.15.49:0/457027023 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee90ab5640 1 --2- 172.21.15.49:0/457027023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 0x55d3f1270410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee912b6640 1 --2- 172.21.15.49:0/457027023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 0x55d3f12646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee91ab7640 1 -- 172.21.15.49:0/457027023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 msgr2=0x55d3f12646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee91ab7640 1 --2- 172.21.15.49:0/457027023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 0x55d3f12646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee91ab7640 1 -- 172.21.15.49:0/457027023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 msgr2=0x55d3f1270410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee91ab7640 1 --2- 172.21.15.49:0/457027023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 0x55d3f1270410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee91ab7640 1 -- 172.21.15.49:0/457027023 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3f1255490 con 0x55d3f0ead070 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.572+0000 7fee91ab7640 1 --2- 172.21.15.49:0/457027023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270950 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fee84007da0 tx=0x7fee84007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9edac8c5e28446 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee76ffd640 1 -- 172.21.15.49:0/457027023 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84033040 con 0x55d3f0ead070 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee76ffd640 1 -- 172.21.15.49:0/457027023 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee8402e710 con 0x55d3f0ead070 2024-09-21T06:40:11.575 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee76ffd640 1 -- 172.21.15.49:0/457027023 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8402f6b0 con 0x55d3f0ead070 2024-09-21T06:40:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee99a8e740 1 -- 172.21.15.49:0/457027023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 msgr2=0x55d3f1270950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee99a8e740 1 --2- 172.21.15.49:0/457027023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270950 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fee84007da0 tx=0x7fee84007dd0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee99a8e740 1 -- 172.21.15.49:0/457027023 shutdown_connections 2024-09-21T06:40:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee99a8e740 1 --2- 172.21.15.49:0/457027023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f1270950 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee99a8e740 1 --2- 172.21.15.49:0/457027023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 0x55d3f1270410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee99a8e740 1 --2- 172.21.15.49:0/457027023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 0x55d3f12646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee99a8e740 1 -- 172.21.15.49:0/457027023 >> 172.21.15.49:0/457027023 conn(0x55d3f0ea1460 msgr2=0x55d3f1263f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.573+0000 7fee99a8e740 1 -- 172.21.15.49:0/457027023 shutdown_connections 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 1 -- 172.21.15.49:0/457027023 wait complete. 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 1 -- start start 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 1 Processor -- start 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 0x55d3f1268700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 0x55d3f1268c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f12dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c1abc10 con 0x55d3f0ead070 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c1ad080 con 0x55d3f0e8c390 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c1ac2e0 con 0x55d3f0e841b0 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.574+0000 7fee99a8e740 10 client.0 _ll_register_callbacks cb 0x7fee84007cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee91ab7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f12dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee90ab5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 0x55d3f1268c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee91ab7640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f12dff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60482/0 (socket says 172.21.15.49:60482) 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee91ab7640 1 -- 172.21.15.49:0/306838216 learned_addr learned my addr 172.21.15.49:0/306838216 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee912b6640 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 0x55d3f1268700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee91ab7640 1 -- 172.21.15.49:0/306838216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 msgr2=0x55d3f1268700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee91ab7640 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 0x55d3f1268700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee91ab7640 1 -- 172.21.15.49:0/306838216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 msgr2=0x55d3f1268c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee91ab7640 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 0x55d3f1268c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee91ab7640 1 -- 172.21.15.49:0/306838216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3f12694e0 con 0x55d3f0ead070 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee91ab7640 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f12dff60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fee84010eb0 tx=0x7fee84026480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4b2a0b1a40d722 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee74ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee74ff9640 1 -- 172.21.15.49:0/306838216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee84033040 con 0x55d3f0ead070 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee74ff9640 1 -- 172.21.15.49:0/306838216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fee8402e8c0 con 0x55d3f0ead070 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.575+0000 7fee99a8e740 1 -- 172.21.15.49:0/306838216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee8402e710 con 0x55d3f0ead070 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee74ff9640 1 -- 172.21.15.49:0/306838216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fee8404e050 con 0x55d3f0ead070 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee99a8e740 10 client.16368 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:11.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee99a8e740 1 -- 172.21.15.49:0/306838216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d3f12e1490 con 0x55d3f0ead070 2024-09-21T06:40:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee74ff9640 1 -- 172.21.15.49:0/306838216 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee8402e710 con 0x55d3f0ead070 2024-09-21T06:40:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee74ff9640 1 -- 172.21.15.49:0/306838216 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fee84036070 con 0x55d3f0ead070 2024-09-21T06:40:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee99a8e740 10 client.16368 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee99a8e740 10 client.16368 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:40:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee99a8e740 20 client.16368 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee99a8e740 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d3f0e40da0 0x55d3f12e3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee99a8e740 4 client.16368 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee99a8e740 1 -- 172.21.15.49:0/306838216 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d3f11c88a0 con 0x55d3f0e40da0 2024-09-21T06:40:11.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.576+0000 7fee912b6640 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d3f0e40da0 0x55d3f12e3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee912b6640 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d3f0e40da0 0x55d3f12e3b00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9057c4cea31a02a server_cookie=3aebcd93b25ce885 in_seq=0 out_seq=0 2024-09-21T06:40:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee74ff9640 10 client.16368 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:40:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee74ff9640 1 -- 172.21.15.49:0/306838216 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d3f11c88a0 con 0x55d3f0e40da0 2024-09-21T06:40:11.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee74ff9640 10 client.16368 handle_command_reply: tid=0 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee99a8e740 1 client.16368 shutdown 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee99a8e740 1 -- 172.21.15.49:0/306838216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 msgr2=0x55d3f12dff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee99a8e740 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f12dff60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fee84010eb0 tx=0x7fee84026480 comp rx=0 tx=0).stop 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee99a8e740 1 -- 172.21.15.49:0/306838216 shutdown_connections 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee99a8e740 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d3f0e40da0 0x55d3f12e3b00 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee99a8e740 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d3f0ead070 0x55d3f12dff60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee99a8e740 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d3f0e8c390 0x55d3f1268c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee99a8e740 1 --2- 172.21.15.49:0/306838216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d3f0e841b0 0x55d3f1268700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee99a8e740 1 -- 172.21.15.49:0/306838216 >> 172.21.15.49:0/306838216 conn(0x55d3f0ea1460 msgr2=0x55d3f1251e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.577+0000 7fee74ff9640 0 client.16368 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee99a8e740 1 -- 172.21.15.49:0/306838216 shutdown_connections 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee99a8e740 1 -- 172.21.15.49:0/306838216 wait complete. 2024-09-21T06:40:11.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee99a8e740 20 client.16368 trim_cache size 0 max 16384 2024-09-21T06:40:11.584 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:40:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 -- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fee780b6700 msgr2=0x7fee780b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fee780b6700 0x7fee780b8c10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fee8400f4c0 tx=0x7fee84007740 comp rx=0 tx=0).stop 2024-09-21T06:40:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 -- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 msgr2=0x7fee8c19b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 0x7fee8c19b410 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fee88006010 tx=0x7fee880042f0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 -- 172.21.15.49:0/3634811909 shutdown_connections 2024-09-21T06:40:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fee780b6700 0x7fee780b8c10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fee8c108530 0x7fee8c19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fee8c107be0 0x7fee8c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 --2- 172.21.15.49:0/3634811909 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fee8c1022a0 0x7fee8c19b410 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 -- 172.21.15.49:0/3634811909 >> 172.21.15.49:0/3634811909 conn(0x7fee8c079ec0 msgr2=0x7fee8c1059f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.578+0000 7fee9351a640 1 -- 172.21.15.49:0/3634811909 shutdown_connections 2024-09-21T06:40:11.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:11.579+0000 7fee9351a640 1 -- 172.21.15.49:0/3634811909 wait complete. 2024-09-21T06:40:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:11 smithi049 ceph-mon[31177]: pgmap v425: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 35 KiB/s wr, 25 op/s 2024-09-21T06:40:12.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:11 smithi098 ceph-mon[34704]: pgmap v425: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 35 KiB/s wr, 25 op/s 2024-09-21T06:40:12.316 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:40:12.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:11 smithi079 ceph-mon[34346]: pgmap v425: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 35 KiB/s wr, 25 op/s 2024-09-21T06:40:12.578 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.062+0000 7f6e8adbe640 1 -- 172.21.15.49:0/471366621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e84108d10 msgr2=0x7f6e8410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.062+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/471366621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e84108d10 0x7f6e8410f540 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009ca0 tx=0x7f6e7c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.062+0000 7f6e8adbe640 1 -- 172.21.15.49:0/471366621 shutdown_connections 2024-09-21T06:40:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.062+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/471366621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e84108d10 0x7f6e8410f540 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.062+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/471366621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e841083c0 0x7f6e841087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.062+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/471366621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e84102a80 0x7f6e84102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.062+0000 7f6e8adbe640 1 -- 172.21.15.49:0/471366621 >> 172.21.15.49:0/471366621 conn(0x7f6e84079740 msgr2=0x7f6e84079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.062+0000 7f6e8adbe640 1 -- 172.21.15.49:0/471366621 shutdown_connections 2024-09-21T06:40:13.071 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.062+0000 7f6e8adbe640 1 -- 172.21.15.49:0/471366621 wait complete. 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.063+0000 7f6e8adbe640 1 Processor -- start 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.063+0000 7f6e8adbe640 1 -- start start 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.063+0000 7f6e8adbe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e84102a80 0x7f6e8419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.063+0000 7f6e8adbe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e841083c0 0x7f6e8419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.063+0000 7f6e8adbe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e84108d10 0x7f6e8419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.063+0000 7f6e8adbe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6e84112980 con 0x7f6e841083c0 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.063+0000 7f6e8adbe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e84112800 con 0x7f6e84102a80 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.063+0000 7f6e8adbe640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e84112b00 con 0x7f6e84108d10 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e841083c0 0x7f6e8419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e841083c0 0x7f6e8419b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60500/0 (socket says 172.21.15.49:60500) 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e83fff640 1 -- 172.21.15.49:0/1186495246 learned_addr learned my addr 172.21.15.49:0/1186495246 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e84102a80 0x7f6e8419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e8935b640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e84108d10 0x7f6e8419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e83fff640 1 -- 172.21.15.49:0/1186495246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e84108d10 msgr2=0x7f6e8419bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e83fff640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e84108d10 0x7f6e8419bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e83fff640 1 -- 172.21.15.49:0/1186495246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e84102a80 msgr2=0x7f6e8419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e83fff640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e84102a80 0x7f6e8419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e83fff640 1 -- 172.21.15.49:0/1186495246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e841a6610 con 0x7f6e841083c0 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e84102a80 0x7f6e8419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e83fff640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e841083c0 0x7f6e8419b890 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9f0 tx=0x7f6e7800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e81ffb640 1 -- 172.21.15.49:0/1186495246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800ccc0 con 0x7f6e841083c0 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e81ffb640 1 -- 172.21.15.49:0/1186495246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e780054d0 con 0x7f6e841083c0 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e8adbe640 1 -- 172.21.15.49:0/1186495246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e841a6900 con 0x7f6e841083c0 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.064+0000 7f6e81ffb640 1 -- 172.21.15.49:0/1186495246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78010430 con 0x7f6e841083c0 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.065+0000 7f6e8adbe640 1 -- 172.21.15.49:0/1186495246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e841a6e40 con 0x7f6e841083c0 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.067+0000 7f6e81ffb640 1 -- 172.21.15.49:0/1186495246 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6e780046c0 con 0x7f6e841083c0 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.067+0000 7f6e91332740 1 Processor -- start 2024-09-21T06:40:13.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.067+0000 7f6e91332740 1 -- start start 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e91332740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f3a070 0x5557512e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e91332740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 0x5557512e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e91332740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512e2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e91332740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555751257ea0 con 0x555750f19390 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e91332740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5557512472d0 con 0x555750f3a070 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e91332740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55575124b0e0 con 0x555750f111b0 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512e2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e8935b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f3a070 0x5557512e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512e2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60502/0 (socket says 172.21.15.49:60502) 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e8935b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f3a070 0x5557512e16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:37002/0 (socket says 172.21.15.49:37002) 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e83fff640 1 -- 172.21.15.49:0/1599986306 learned_addr learned my addr 172.21.15.49:0/1599986306 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e81ffb640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6e6c0b6700 0x7f6e6c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/1599986306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 0x5557512e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e8935b640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6e6c0b6700 0x7f6e6c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e81ffb640 1 -- 172.21.15.49:0/1186495246 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6e780e79f0 con 0x7f6e841083c0 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e8935b640 1 -- 172.21.15.49:0/1599986306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 msgr2=0x5557512e1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e8935b640 1 --2- 172.21.15.49:0/1599986306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 0x5557512e1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e8935b640 1 -- 172.21.15.49:0/1599986306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 msgr2=0x5557512e2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e8935b640 1 --2- 172.21.15.49:0/1599986306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512e2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e8935b640 1 -- 172.21.15.49:0/1599986306 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555750fa5650 con 0x555750f3a070 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.068+0000 7f6e83fff640 1 --2- 172.21.15.49:0/1599986306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.069+0000 7f6e8935b640 1 --2- 172.21.15.49:0/1599986306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f3a070 0x5557512e16a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c005e30 tx=0x7f6e7c031d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e38694a5a305228 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.069+0000 7f6e6affd640 1 -- 172.21.15.49:0/1599986306 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c004d40 con 0x555750f3a070 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.069+0000 7f6e8935b640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6e6c0b6700 0x7f6e6c0b8c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c04e000 tx=0x7f6e7c04c000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.069+0000 7f6e6affd640 1 -- 172.21.15.49:0/1599986306 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e7c036070 con 0x555750f3a070 2024-09-21T06:40:13.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.069+0000 7f6e6affd640 1 -- 172.21.15.49:0/1599986306 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c004500 con 0x555750f3a070 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 -- 172.21.15.49:0/1599986306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f3a070 msgr2=0x5557512e16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 --2- 172.21.15.49:0/1599986306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f3a070 0x5557512e16a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c005e30 tx=0x7f6e7c031d90 comp rx=0 tx=0).stop 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 -- 172.21.15.49:0/1599986306 shutdown_connections 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 --2- 172.21.15.49:0/1599986306 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512e2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 --2- 172.21.15.49:0/1599986306 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 0x5557512e1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 --2- 172.21.15.49:0/1599986306 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f3a070 0x5557512e16a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 -- 172.21.15.49:0/1599986306 >> 172.21.15.49:0/1599986306 conn(0x555750f2e460 msgr2=0x5557512df590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 -- 172.21.15.49:0/1599986306 shutdown_connections 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 -- 172.21.15.49:0/1599986306 wait complete. 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 -- start start 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.070+0000 7f6e91332740 1 Processor -- start 2024-09-21T06:40:13.079 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e91332740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 0x5557512ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e91332740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e91332740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f3a070 0x5557512f9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e91332740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5557510a8700 con 0x555750f19390 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e91332740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5557511e2160 con 0x555750f111b0 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e91332740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5557512efd00 con 0x555750f3a070 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e91332740 10 client.0 _ll_register_callbacks cb 0x5557511fb9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e88b5a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 0x5557512ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512ed2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60514/0 (socket says 172.21.15.49:60514) 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e83fff640 1 -- 172.21.15.49:0/2476935712 learned_addr learned my addr 172.21.15.49:0/2476935712 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.071+0000 7f6e8935b640 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f3a070 0x5557512f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e83fff640 1 -- 172.21.15.49:0/2476935712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f3a070 msgr2=0x5557512f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:13.080 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e83fff640 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f3a070 0x5557512f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e83fff640 1 -- 172.21.15.49:0/2476935712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 msgr2=0x5557512ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e83fff640 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 0x5557512ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e83fff640 1 -- 172.21.15.49:0/2476935712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55575120fc90 con 0x555750f19390 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e83fff640 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512ed2b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9c0 tx=0x7f6e780b7030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7a6f74b86d8512 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e63fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e63fff640 1 -- 172.21.15.49:0/2476935712 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780ad5f0 con 0x555750f19390 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e63fff640 1 -- 172.21.15.49:0/2476935712 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6e780a9170 con 0x555750f19390 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e91332740 1 -- 172.21.15.49:0/2476935712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e7c036070 con 0x555750f19390 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e63fff640 1 -- 172.21.15.49:0/2476935712 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6e780acf90 con 0x555750f19390 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e91332740 10 client.16380 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e91332740 1 -- 172.21.15.49:0/2476935712 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5557512fbab0 con 0x555750f19390 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.072+0000 7f6e63fff640 1 -- 172.21.15.49:0/2476935712 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e7c036070 con 0x555750f19390 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e63fff640 1 -- 172.21.15.49:0/2476935712 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6e780b3490 con 0x555750f19390 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e91332740 10 client.16380 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:13.081 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e91332740 10 client.16380 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e91332740 20 client.16380 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e91332740 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555750ef89f0 0x5557512fef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e91332740 4 client.16380 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e91332740 1 -- 172.21.15.49:0/2476935712 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555751259df0 con 0x555750ef89f0 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555750ef89f0 0x5557512fef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e63fff640 10 client.16380 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.073+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555750ef89f0 0x5557512fef40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9683c290eea8d6d9 server_cookie=cc6655bb7376db4 in_seq=0 out_seq=0 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.074+0000 7f6e63fff640 1 -- 172.21.15.49:0/2476935712 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555751259df0 con 0x555750ef89f0 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.074+0000 7f6e63fff640 10 client.16380 handle_command_reply: tid=0 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.074+0000 7f6e91332740 1 client.16380 shutdown 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.074+0000 7f6e91332740 1 -- 172.21.15.49:0/2476935712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 msgr2=0x5557512ed2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.074+0000 7f6e91332740 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512ed2b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9c0 tx=0x7f6e780b7030 comp rx=0 tx=0).stop 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.074+0000 7f6e91332740 1 -- 172.21.15.49:0/2476935712 shutdown_connections 2024-09-21T06:40:13.082 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.074+0000 7f6e91332740 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555750ef89f0 0x5557512fef40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.075+0000 7f6e63fff640 0 client.16380 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:40:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.075+0000 7f6e91332740 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f3a070 0x5557512f9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.075+0000 7f6e91332740 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512ed2b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.075+0000 7f6e91332740 1 --2- 172.21.15.49:0/2476935712 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 0x5557512ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.075+0000 7f6e91332740 1 -- 172.21.15.49:0/2476935712 >> 172.21.15.49:0/2476935712 conn(0x555750f2e460 msgr2=0x5557512e4830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.075+0000 7f6e91332740 1 -- 172.21.15.49:0/2476935712 shutdown_connections 2024-09-21T06:40:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.075+0000 7f6e91332740 1 -- 172.21.15.49:0/2476935712 wait complete. 2024-09-21T06:40:13.083 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.075+0000 7f6e91332740 20 client.16380 trim_cache size 0 max 16384 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.088+0000 7f6e91332740 1 Processor -- start 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.088+0000 7f6e91332740 1 -- start start 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.088+0000 7f6e91332740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750ef89f0 0x5557512eed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.088+0000 7f6e91332740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 0x5557512e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e91332740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e91332740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6e841b20e0 con 0x555750f19390 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e91332740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e841af9b0 con 0x555750ef89f0 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e91332740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e841ad820 con 0x555750f111b0 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e8935b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e8935b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512f8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60530/0 (socket says 172.21.15.49:60530) 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e8935b640 1 -- 172.21.15.49:0/3077143872 learned_addr learned my addr 172.21.15.49:0/3077143872 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e83fff640 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 0x5557512e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750ef89f0 0x5557512eed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e83fff640 1 -- 172.21.15.49:0/3077143872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750ef89f0 msgr2=0x5557512eed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:13.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e83fff640 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750ef89f0 0x5557512eed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e83fff640 1 -- 172.21.15.49:0/3077143872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 msgr2=0x5557512f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:13.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e83fff640 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e83fff640 1 -- 172.21.15.49:0/3077143872 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557512e3990 con 0x555750f111b0 2024-09-21T06:40:13.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750ef89f0 0x5557512eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:13.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e8935b640 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:13.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.089+0000 7f6e83fff640 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 0x5557512e3090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e780b3900 tx=0x7f6e78004a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c0547670d1119a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:13.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e6a7fc640 1 -- 172.21.15.49:0/3077143872 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780ad170 con 0x555750f111b0 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e6a7fc640 1 -- 172.21.15.49:0/3077143872 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e78005680 con 0x555750f111b0 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e6a7fc640 1 -- 172.21.15.49:0/3077143872 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780ad5f0 con 0x555750f111b0 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e91332740 1 -- 172.21.15.49:0/3077143872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 msgr2=0x5557512e3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e91332740 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 0x5557512e3090 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6e780b3900 tx=0x7f6e78004a60 comp rx=0 tx=0).stop 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e91332740 1 -- 172.21.15.49:0/3077143872 shutdown_connections 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e91332740 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750f19390 0x5557512f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e91332740 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f111b0 0x5557512e3090 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e91332740 1 --2- 172.21.15.49:0/3077143872 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750ef89f0 0x5557512eed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e91332740 1 -- 172.21.15.49:0/3077143872 >> 172.21.15.49:0/3077143872 conn(0x555750f2e460 msgr2=0x5557512e67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.090+0000 7f6e91332740 1 -- 172.21.15.49:0/3077143872 shutdown_connections 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.091+0000 7f6e91332740 1 -- 172.21.15.49:0/3077143872 wait complete. 2024-09-21T06:40:13.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.091+0000 7f6e91332740 1 -- start start 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.091+0000 7f6e91332740 1 Processor -- start 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.091+0000 7f6e91332740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750ef89f0 0x5557512f1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.091+0000 7f6e91332740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 0x5557512f1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.091+0000 7f6e91332740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f19390 0x5557512f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.091+0000 7f6e91332740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6e841ade70 con 0x555750ef89f0 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.091+0000 7f6e91332740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6e841af2e0 con 0x555750f111b0 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.091+0000 7f6e91332740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6e841ae540 con 0x555750f19390 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e88b5a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750ef89f0 0x5557512f1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e88b5a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750ef89f0 0x5557512f1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60534/0 (socket says 172.21.15.49:60534) 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e88b5a640 1 -- 172.21.15.49:0/3336748996 learned_addr learned my addr 172.21.15.49:0/3336748996 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e91332740 10 client.0 _ll_register_callbacks cb 0x7f6e780a97b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e8935b640 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f19390 0x5557512f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e83fff640 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 0x5557512f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e88b5a640 1 -- 172.21.15.49:0/3336748996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f19390 msgr2=0x5557512f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f19390 0x5557512f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e88b5a640 1 -- 172.21.15.49:0/3336748996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 msgr2=0x5557512f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 0x5557512f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e88b5a640 1 -- 172.21.15.49:0/3336748996 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557513689d0 con 0x555750ef89f0 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e8935b640 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f19390 0x5557512f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e88b5a640 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750ef89f0 0x5557512f1030 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x5557512d1740 tx=0x7f6e74012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51692ccdda55b7a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e63fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e63fff640 1 -- 172.21.15.49:0/3336748996 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74029030 con 0x555750ef89f0 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e63fff640 1 -- 172.21.15.49:0/3336748996 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6e74010b10 con 0x555750ef89f0 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.092+0000 7f6e91332740 1 -- 172.21.15.49:0/3336748996 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e78005680 con 0x555750ef89f0 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e63fff640 1 -- 172.21.15.49:0/3336748996 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6e74033050 con 0x555750ef89f0 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e91332740 10 client.16386 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:13.099 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e91332740 1 -- 172.21.15.49:0/3336748996 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555751369ca0 con 0x555750ef89f0 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e63fff640 1 -- 172.21.15.49:0/3336748996 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e78005680 con 0x555750ef89f0 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e63fff640 1 -- 172.21.15.49:0/3336748996 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6e74025c60 con 0x555750ef89f0 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e91332740 10 client.16386 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e91332740 10 client.16386 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e91332740 20 client.16386 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e91332740 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555750f3a070 0x55575136c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e91332740 4 client.16386 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e91332740 1 -- 172.21.15.49:0/3336748996 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557512558a0 con 0x555750f3a070 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.093+0000 7f6e83fff640 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555750f3a070 0x55575136c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e63fff640 10 client.16386 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e83fff640 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555750f3a070 0x55575136c490 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e5257d47ebf5cbff server_cookie=ec9e98cd0e0cd71b in_seq=0 out_seq=0 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e63fff640 1 -- 172.21.15.49:0/3336748996 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557512558a0 con 0x555750f3a070 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e63fff640 10 client.16386 handle_command_reply: tid=0 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 client.16386 shutdown 2024-09-21T06:40:13.100 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 -- 172.21.15.49:0/3336748996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750ef89f0 msgr2=0x5557512f1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750ef89f0 0x5557512f1030 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x5557512d1740 tx=0x7f6e74012bc0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 -- 172.21.15.49:0/3336748996 shutdown_connections 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555750f3a070 0x55575136c490 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555750f19390 0x5557512f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555750f111b0 0x5557512f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e63fff640 0 client.16386 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 --2- 172.21.15.49:0/3336748996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555750ef89f0 0x5557512f1030 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 -- 172.21.15.49:0/3336748996 >> 172.21.15.49:0/3336748996 conn(0x555750f2e460 msgr2=0x5557512e2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 -- 172.21.15.49:0/3336748996 shutdown_connections 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 1 -- 172.21.15.49:0/3336748996 wait complete. 2024-09-21T06:40:13.101 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.094+0000 7f6e91332740 20 client.16386 trim_cache size 0 max 16384 2024-09-21T06:40:13.102 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:40:13.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 -- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6e6c0b6700 msgr2=0x7f6e6c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:13.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6e6c0b6700 0x7f6e6c0b8c10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c04e000 tx=0x7f6e7c04c000 comp rx=0 tx=0).stop 2024-09-21T06:40:13.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 -- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e841083c0 msgr2=0x7f6e8419b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:13.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e841083c0 0x7f6e8419b890 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9f0 tx=0x7f6e7800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 -- 172.21.15.49:0/1186495246 shutdown_connections 2024-09-21T06:40:13.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6e6c0b6700 0x7f6e6c0b8c10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6e84108d10 0x7f6e8419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6e841083c0 0x7f6e8419b890 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 --2- 172.21.15.49:0/1186495246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6e84102a80 0x7f6e8419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:13.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 -- 172.21.15.49:0/1186495246 >> 172.21.15.49:0/1186495246 conn(0x7f6e84079740 msgr2=0x7f6e84104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:13.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 -- 172.21.15.49:0/1186495246 shutdown_connections 2024-09-21T06:40:13.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:13.095+0000 7f6e8adbe640 1 -- 172.21.15.49:0/1186495246 wait complete. 2024-09-21T06:40:13.836 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:40:14.093 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:14.214 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:13 smithi049 ceph-mon[31177]: pgmap v426: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 KiB/s wr, 28 op/s 2024-09-21T06:40:14.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:13 smithi098 ceph-mon[34704]: pgmap v426: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 KiB/s wr, 28 op/s 2024-09-21T06:40:14.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:13 smithi079 ceph-mon[34346]: pgmap v426: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 KiB/s wr, 28 op/s 2024-09-21T06:40:14.598 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.596+0000 7f0e80d08640 1 -- 172.21.15.49:0/3376900560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 msgr2=0x7f0e7c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.596+0000 7f0e80d08640 1 --2- 172.21.15.49:0/3376900560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 0x7f0e7c102e70 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c009ca0 tx=0x7f0e6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.597+0000 7f0e80d08640 1 -- 172.21.15.49:0/3376900560 shutdown_connections 2024-09-21T06:40:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.597+0000 7f0e80d08640 1 --2- 172.21.15.49:0/3376900560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e7c108cf0 0x7f0e7c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.597+0000 7f0e80d08640 1 --2- 172.21.15.49:0/3376900560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e7c1083a0 0x7f0e7c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.597+0000 7f0e80d08640 1 --2- 172.21.15.49:0/3376900560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 0x7f0e7c102e70 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.597+0000 7f0e80d08640 1 -- 172.21.15.49:0/3376900560 >> 172.21.15.49:0/3376900560 conn(0x7f0e7c079730 msgr2=0x7f0e7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.597+0000 7f0e80d08640 1 -- 172.21.15.49:0/3376900560 shutdown_connections 2024-09-21T06:40:14.599 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.597+0000 7f0e80d08640 1 -- 172.21.15.49:0/3376900560 wait complete. 2024-09-21T06:40:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e80d08640 1 Processor -- start 2024-09-21T06:40:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e80d08640 1 -- start start 2024-09-21T06:40:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e80d08640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 0x7f0e7c19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e80d08640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e7c1083a0 0x7f0e7c19b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e80d08640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e7c108cf0 0x7f0e7c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.601 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e80d08640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c112960 con 0x7f0e7c102a60 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e80d08640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c1127e0 con 0x7f0e7c108cf0 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e80d08640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c112ae0 con 0x7f0e7c1083a0 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e7a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 0x7f0e7c19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e7a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 0x7f0e7c19b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60552/0 (socket says 172.21.15.49:60552) 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e7a59c640 1 -- 172.21.15.49:0/2090790821 learned_addr learned my addr 172.21.15.49:0/2090790821 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.598+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e7c1083a0 0x7f0e7c19b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e7ad9d640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e7c108cf0 0x7f0e7c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e7a59c640 1 -- 172.21.15.49:0/2090790821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e7c1083a0 msgr2=0x7f0e7c19b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e7c1083a0 0x7f0e7c19b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e7a59c640 1 -- 172.21.15.49:0/2090790821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e7c108cf0 msgr2=0x7f0e7c19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e7c108cf0 0x7f0e7c19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e7a59c640 1 -- 172.21.15.49:0/2090790821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7c1a6560 con 0x7f0e7c102a60 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e7c1083a0 0x7f0e7c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 0x7f0e7c19b2d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c02ade0 tx=0x7f0e6c031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.602 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e6b7fe640 1 -- 172.21.15.49:0/2090790821 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c003b70 con 0x7f0e7c102a60 2024-09-21T06:40:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e80d08640 1 -- 172.21.15.49:0/2090790821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e7c1a67f0 con 0x7f0e7c102a60 2024-09-21T06:40:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e6b7fe640 1 -- 172.21.15.49:0/2090790821 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e6c003d10 con 0x7f0e7c102a60 2024-09-21T06:40:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e6b7fe640 1 -- 172.21.15.49:0/2090790821 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c02fa50 con 0x7f0e7c102a60 2024-09-21T06:40:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.599+0000 7f0e80d08640 1 -- 172.21.15.49:0/2090790821 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e7c1a6d80 con 0x7f0e7c102a60 2024-09-21T06:40:14.603 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.602+0000 7f0e6b7fe640 1 -- 172.21.15.49:0/2090790821 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0e6c02fbf0 con 0x7f0e7c102a60 2024-09-21T06:40:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.602+0000 7f0e8727c740 1 Processor -- start 2024-09-21T06:40:14.604 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.602+0000 7f0e8727c740 1 -- start start 2024-09-21T06:40:14.605 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439280070 0x5614396272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5614392571b0 0x561439627800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56143925f390 0x561439627d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e8727c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56143959dea0 con 0x56143925f390 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e8727c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56143958d2d0 con 0x561439280070 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e8727c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5614395910e0 con 0x5614392571b0 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e79d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56143925f390 0x561439627d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e79d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56143925f390 0x561439627d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60568/0 (socket says 172.21.15.49:60568) 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e79d9b640 1 -- 172.21.15.49:0/1771374224 learned_addr learned my addr 172.21.15.49:0/1771374224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e7ad9d640 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439280070 0x5614396272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e6b7fe640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e640b66b0 0x7f0e640b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5614392571b0 0x561439627800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e7ad9d640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e640b66b0 0x7f0e640b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.606 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e79d9b640 1 -- 172.21.15.49:0/1771374224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5614392571b0 msgr2=0x561439627800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5614392571b0 0x561439627800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e79d9b640 1 -- 172.21.15.49:0/1771374224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439280070 msgr2=0x5614396272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439280070 0x5614396272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e6b7fe640 1 -- 172.21.15.49:0/2090790821 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0e6c108b10 con 0x7f0e7c102a60 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e79d9b640 1 -- 172.21.15.49:0/1771374224 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614392eb650 con 0x56143925f390 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.603+0000 7f0e7ad9d640 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439280070 0x5614396272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.604+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56143925f390 0x561439627d40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009cb0 tx=0x7f0e700117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa51084252aa3d9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.604+0000 7f0e7ad9d640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e640b66b0 0x7f0e640b8bc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0e74005fd0 tx=0x7f0e74004730 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.604+0000 7f0e68ff9640 1 -- 172.21.15.49:0/1771374224 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70012450 con 0x56143925f390 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.604+0000 7f0e68ff9640 1 -- 172.21.15.49:0/1771374224 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e70012aa0 con 0x56143925f390 2024-09-21T06:40:14.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.604+0000 7f0e68ff9640 1 -- 172.21.15.49:0/1771374224 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000fba0 con 0x56143925f390 2024-09-21T06:40:14.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 -- 172.21.15.49:0/1771374224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56143925f390 msgr2=0x561439627d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56143925f390 0x561439627d40 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009cb0 tx=0x7f0e700117b0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 -- 172.21.15.49:0/1771374224 shutdown_connections 2024-09-21T06:40:14.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56143925f390 0x561439627d40 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5614392571b0 0x561439627800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1771374224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439280070 0x5614396272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 -- 172.21.15.49:0/1771374224 >> 172.21.15.49:0/1771374224 conn(0x561439274460 msgr2=0x5614396251b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 -- 172.21.15.49:0/1771374224 shutdown_connections 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 -- 172.21.15.49:0/1771374224 wait complete. 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.605+0000 7f0e8727c740 1 -- start start 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e8727c740 1 Processor -- start 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5614392571b0 0x561439632950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 0x561439632e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 0x56143963ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e8727c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5614393ee700 con 0x5614392571b0 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e8727c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561439528160 con 0x56143925f390 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e8727c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561439635aa0 con 0x561439280070 2024-09-21T06:40:14.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e8727c740 10 client.0 _ll_register_callbacks cb 0x5614395419e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e7a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5614392571b0 0x561439632950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e7a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5614392571b0 0x561439632950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60580/0 (socket says 172.21.15.49:60580) 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e7a59c640 1 -- 172.21.15.49:0/611740146 learned_addr learned my addr 172.21.15.49:0/611740146 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e7ad9d640 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 0x56143963ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 0x561439632e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e7a59c640 1 -- 172.21.15.49:0/611740146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 msgr2=0x56143963ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 0x56143963ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e7a59c640 1 -- 172.21.15.49:0/611740146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 msgr2=0x561439632e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 0x561439632e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.606+0000 7f0e7a59c640 1 -- 172.21.15.49:0/611740146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561439555c90 con 0x5614392571b0 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5614392571b0 0x561439632950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0caeb0 tx=0x7f0e6c039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d6d22ffbac3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e61ffb640 1 -- 172.21.15.49:0/611740146 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c0ce6b0 con 0x5614392571b0 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e61ffb640 1 -- 172.21.15.49:0/611740146 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0e6c0d8070 con 0x5614392571b0 2024-09-21T06:40:14.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e8727c740 1 -- 172.21.15.49:0/611740146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e70012aa0 con 0x5614392571b0 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e61ffb640 1 -- 172.21.15.49:0/611740146 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0e6c106670 con 0x5614392571b0 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e8727c740 10 client.16398 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e8727c740 1 -- 172.21.15.49:0/611740146 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561439641780 con 0x5614392571b0 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e61ffb640 1 -- 172.21.15.49:0/611740146 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e6c036040 con 0x5614392571b0 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e61ffb640 1 -- 172.21.15.49:0/611740146 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0e6c0cdb40 con 0x5614392571b0 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e8727c740 10 client.16398 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e8727c740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e8727c740 20 client.16398 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.607+0000 7f0e8727c740 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56143923e9f0 0x561439644c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.608+0000 7f0e8727c740 4 client.16398 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.608+0000 7f0e8727c740 1 -- 172.21.15.49:0/611740146 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0e70012aa0 con 0x56143923e9f0 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.608+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56143923e9f0 0x561439644c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.608+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56143923e9f0 0x561439644c70 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18dae9b4b4df8878 server_cookie=ad71c166d8dc5be0 in_seq=0 out_seq=0 2024-09-21T06:40:14.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.608+0000 7f0e61ffb640 10 client.16398 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:14.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e61ffb640 1 -- 172.21.15.49:0/611740146 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0e70012aa0 con 0x56143923e9f0 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e61ffb640 10 client.16398 handle_command_reply: tid=0 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e8727c740 1 client.16398 shutdown 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e8727c740 1 -- 172.21.15.49:0/611740146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5614392571b0 msgr2=0x561439632950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e8727c740 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5614392571b0 0x561439632950 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0caeb0 tx=0x7f0e6c039000 comp rx=0 tx=0).stop 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e8727c740 1 -- 172.21.15.49:0/611740146 shutdown_connections 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e8727c740 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56143923e9f0 0x561439644c70 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e8727c740 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 0x56143963ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e8727c740 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 0x561439632e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e8727c740 1 --2- 172.21.15.49:0/611740146 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5614392571b0 0x561439632950 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e8727c740 1 -- 172.21.15.49:0/611740146 >> 172.21.15.49:0/611740146 conn(0x561439274460 msgr2=0x56143962a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.609+0000 7f0e61ffb640 0 client.16398 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.610+0000 7f0e8727c740 1 -- 172.21.15.49:0/611740146 shutdown_connections 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.610+0000 7f0e8727c740 1 -- 172.21.15.49:0/611740146 wait complete. 2024-09-21T06:40:14.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.610+0000 7f0e8727c740 20 client.16398 trim_cache size 0 max 16384 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e8727c740 1 Processor -- start 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e8727c740 1 -- start start 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56143925f390 0x561439632e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439280070 0x56143963ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439213da0 0x56143962fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e8727c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c1b2010 con 0x561439280070 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e8727c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c1af8e0 con 0x561439213da0 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e8727c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c1ad750 con 0x56143925f390 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e79d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439280070 0x56143963ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e79d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439280070 0x56143963ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60582/0 (socket says 172.21.15.49:60582) 2024-09-21T06:40:14.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e79d9b640 1 -- 172.21.15.49:0/300209066 learned_addr learned my addr 172.21.15.49:0/300209066 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.623+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56143925f390 0x561439632e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e7ad9d640 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439213da0 0x56143962fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e79d9b640 1 -- 172.21.15.49:0/300209066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56143925f390 msgr2=0x561439632e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56143925f390 0x561439632e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e79d9b640 1 -- 172.21.15.49:0/300209066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439213da0 msgr2=0x56143962fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439213da0 0x56143962fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e79d9b640 1 -- 172.21.15.49:0/300209066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143923ec20 con 0x561439280070 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e7ad9d640 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439213da0 0x56143962fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439280070 0x56143963ec90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009840 tx=0x7f0e70014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5380802ce4bd7042 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e63fff640 1 -- 172.21.15.49:0/300209066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000f440 con 0x561439280070 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e63fff640 1 -- 172.21.15.49:0/300209066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e70033070 con 0x561439280070 2024-09-21T06:40:14.627 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.624+0000 7f0e63fff640 1 -- 172.21.15.49:0/300209066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000fa80 con 0x561439280070 2024-09-21T06:40:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 -- 172.21.15.49:0/300209066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439280070 msgr2=0x56143963ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439280070 0x56143963ec90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009840 tx=0x7f0e70014040 comp rx=0 tx=0).stop 2024-09-21T06:40:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 -- 172.21.15.49:0/300209066 shutdown_connections 2024-09-21T06:40:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561439213da0 0x56143962fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439280070 0x56143963ec90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 --2- 172.21.15.49:0/300209066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56143925f390 0x561439632e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 -- 172.21.15.49:0/300209066 >> 172.21.15.49:0/300209066 conn(0x561439274460 msgr2=0x561439632700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 -- 172.21.15.49:0/300209066 shutdown_connections 2024-09-21T06:40:14.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 -- 172.21.15.49:0/300209066 wait complete. 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 -- start start 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.625+0000 7f0e8727c740 1 Processor -- start 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439213da0 0x561439636dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 0x561439637310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e8727c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 0x561439637850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e8727c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c1adda0 con 0x561439213da0 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e8727c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c1af210 con 0x56143925f390 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e8727c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7c1ae470 con 0x561439280070 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e8727c740 10 client.0 _ll_register_callbacks cb 0x7f0e6c009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439213da0 0x561439636dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7a59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439213da0 0x561439636dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60584/0 (socket says 172.21.15.49:60584) 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7a59c640 1 -- 172.21.15.49:0/1164589317 learned_addr learned my addr 172.21.15.49:0/1164589317 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 0x561439637310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7ad9d640 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 0x561439637850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7a59c640 1 -- 172.21.15.49:0/1164589317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 msgr2=0x561439637850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 0x561439637850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7a59c640 1 -- 172.21.15.49:0/1164589317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 msgr2=0x561439637310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 0x561439637310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7a59c640 1 -- 172.21.15.49:0/1164589317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614396ae650 con 0x561439213da0 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e7a59c640 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439213da0 0x561439636dd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0f2110 tx=0x7f0e6c0d80a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71021aadbe447c76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.626+0000 7f0e61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e61ffb640 1 -- 172.21.15.49:0/1164589317 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e6c0ce050 con 0x561439213da0 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e61ffb640 1 -- 172.21.15.49:0/1164589317 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0e6c004040 con 0x561439213da0 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e8727c740 1 -- 172.21.15.49:0/1164589317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e70033070 con 0x561439213da0 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e61ffb640 1 -- 172.21.15.49:0/1164589317 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0e6c092050 con 0x561439213da0 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e8727c740 10 client.16404 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e8727c740 1 -- 172.21.15.49:0/1164589317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5614396af840 con 0x561439213da0 2024-09-21T06:40:14.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e61ffb640 1 -- 172.21.15.49:0/1164589317 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e70033070 con 0x561439213da0 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e61ffb640 1 -- 172.21.15.49:0/1164589317 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0e6c004240 con 0x561439213da0 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e8727c740 10 client.16404 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e8727c740 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e8727c740 20 client.16404 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5614396afe30 0x5614396b2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e8727c740 4 client.16404 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.627+0000 7f0e8727c740 1 -- 172.21.15.49:0/1164589317 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56143959fdf0 con 0x5614396afe30 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5614396afe30 0x5614396b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e79d9b640 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5614396afe30 0x5614396b2250 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8abb96279811f7c4 server_cookie=19ec0b9cc82d0ea0 in_seq=0 out_seq=0 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e61ffb640 10 client.16404 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e61ffb640 1 -- 172.21.15.49:0/1164589317 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56143959fdf0 con 0x5614396afe30 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e61ffb640 10 client.16404 handle_command_reply: tid=0 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e8727c740 1 client.16404 shutdown 2024-09-21T06:40:14.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e8727c740 1 -- 172.21.15.49:0/1164589317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439213da0 msgr2=0x561439636dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439213da0 0x561439636dd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0f2110 tx=0x7f0e6c0d80a0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e8727c740 1 -- 172.21.15.49:0/1164589317 shutdown_connections 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5614396afe30 0x5614396b2250 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.628+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561439280070 0x561439637850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56143925f390 0x561439637310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e8727c740 1 --2- 172.21.15.49:0/1164589317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561439213da0 0x561439636dd0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e8727c740 1 -- 172.21.15.49:0/1164589317 >> 172.21.15.49:0/1164589317 conn(0x561439274460 msgr2=0x5614396280d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e61ffb640 0 client.16404 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e8727c740 1 -- 172.21.15.49:0/1164589317 shutdown_connections 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e8727c740 1 -- 172.21.15.49:0/1164589317 wait complete. 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e8727c740 20 client.16404 trim_cache size 0 max 16384 2024-09-21T06:40:14.635 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:40:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 -- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e640b66b0 msgr2=0x7f0e640b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e640b66b0 0x7f0e640b8bc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0e74005fd0 tx=0x7f0e74004730 comp rx=0 tx=0).stop 2024-09-21T06:40:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 -- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 msgr2=0x7f0e7c19b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 0x7f0e7c19b2d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c02ade0 tx=0x7f0e6c031770 comp rx=0 tx=0).stop 2024-09-21T06:40:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 -- 172.21.15.49:0/2090790821 shutdown_connections 2024-09-21T06:40:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0e640b66b0 0x7f0e640b8bc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0e7c108cf0 0x7f0e7c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0e7c1083a0 0x7f0e7c19b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 --2- 172.21.15.49:0/2090790821 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0e7c102a60 0x7f0e7c19b2d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 -- 172.21.15.49:0/2090790821 >> 172.21.15.49:0/2090790821 conn(0x7f0e7c079730 msgr2=0x7f0e7c101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 -- 172.21.15.49:0/2090790821 shutdown_connections 2024-09-21T06:40:14.637 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:14.629+0000 7f0e80d08640 1 -- 172.21.15.49:0/2090790821 wait complete. 2024-09-21T06:40:16.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:15 smithi049 ceph-mon[31177]: pgmap v427: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 KiB/s wr, 29 op/s 2024-09-21T06:40:16.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:15 smithi098 ceph-mon[34704]: pgmap v427: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 KiB/s wr, 29 op/s 2024-09-21T06:40:16.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:15 smithi079 ceph-mon[34346]: pgmap v427: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 43 KiB/s wr, 29 op/s 2024-09-21T06:40:16.438 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:40:16.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:40:16.711 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:17.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.174+0000 7f7de11f3640 1 -- 172.21.15.49:0/2351765868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc109df0 msgr2=0x7f7ddc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:17.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.174+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2351765868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc109df0 0x7f7ddc110620 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009ca0 tx=0x7f7dcc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.174+0000 7f7de11f3640 1 -- 172.21.15.49:0/2351765868 shutdown_connections 2024-09-21T06:40:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.174+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2351765868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc109df0 0x7f7ddc110620 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.174+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2351765868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ddc1094a0 0x7f7ddc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.174+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2351765868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc103b60 0x7f7ddc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.175+0000 7f7de11f3640 1 -- 172.21.15.49:0/2351765868 >> 172.21.15.49:0/2351765868 conn(0x7f7ddc07b850 msgr2=0x7f7ddc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.175+0000 7f7de11f3640 1 -- 172.21.15.49:0/2351765868 shutdown_connections 2024-09-21T06:40:17.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.175+0000 7f7de11f3640 1 -- 172.21.15.49:0/2351765868 wait complete. 2024-09-21T06:40:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.175+0000 7f7de11f3640 1 Processor -- start 2024-09-21T06:40:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7de11f3640 1 -- start start 2024-09-21T06:40:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7de11f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc103b60 0x7f7ddc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7de11f3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ddc1094a0 0x7f7ddc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7de11f3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc109df0 0x7f7ddc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7de11f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc113ab0 con 0x7f7ddc103b60 2024-09-21T06:40:17.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7de11f3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc113930 con 0x7f7ddc109df0 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7de11f3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc113c30 con 0x7f7ddc1094a0 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc103b60 0x7f7ddc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc103b60 0x7f7ddc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56616/0 (socket says 172.21.15.49:56616) 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7ddad9d640 1 -- 172.21.15.49:0/2873309074 learned_addr learned my addr 172.21.15.49:0/2873309074 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc109df0 0x7f7ddc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.176+0000 7f7dda59c640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ddc1094a0 0x7f7ddc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7ddad9d640 1 -- 172.21.15.49:0/2873309074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ddc1094a0 msgr2=0x7f7ddc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7ddad9d640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ddc1094a0 0x7f7ddc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7ddad9d640 1 -- 172.21.15.49:0/2873309074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc109df0 msgr2=0x7f7ddc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7ddad9d640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc109df0 0x7f7ddc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7ddad9d640 1 -- 172.21.15.49:0/2873309074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ddc1a8700 con 0x7f7ddc103b60 2024-09-21T06:40:17.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7ddad9d640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc103b60 0x7f7ddc075710 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400d950 tx=0x7f7dd400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7dd3fff640 1 -- 172.21.15.49:0/2873309074 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4017070 con 0x7f7ddc103b60 2024-09-21T06:40:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7dd3fff640 1 -- 172.21.15.49:0/2873309074 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dd4009c30 con 0x7f7ddc103b60 2024-09-21T06:40:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7de11f3640 1 -- 172.21.15.49:0/2873309074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ddc1a89f0 con 0x7f7ddc103b60 2024-09-21T06:40:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7dd3fff640 1 -- 172.21.15.49:0/2873309074 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd400f620 con 0x7f7ddc103b60 2024-09-21T06:40:17.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.177+0000 7f7de11f3640 1 -- 172.21.15.49:0/2873309074 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ddc1a8f30 con 0x7f7ddc103b60 2024-09-21T06:40:17.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.180+0000 7f7de7767740 1 Processor -- start 2024-09-21T06:40:17.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.180+0000 7f7de7767740 1 -- start start 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7de7767740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e47a350 0x55936e821430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7de7767740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e821970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7de7767740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e821eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7de7767740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55936e797e60 con 0x55936e451490 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7de7767740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55936e787290 con 0x55936e47a350 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7de7767740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55936e78b0a0 con 0x55936e459670 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7dd3fff640 1 -- 172.21.15.49:0/2873309074 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f7dd4010460 con 0x7f7ddc103b60 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e821970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7ddad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e821970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56624/0 (socket says 172.21.15.49:56624) 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7ddad9d640 1 -- 172.21.15.49:0/2669862317 learned_addr learned my addr 172.21.15.49:0/2669862317 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:17.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/2669862317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e47a350 0x55936e821430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.181+0000 7f7dda59c640 1 --2- 172.21.15.49:0/2669862317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e821eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7ddb59e640 1 -- 172.21.15.49:0/2669862317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 msgr2=0x55936e821eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/2669862317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e821eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7ddb59e640 1 -- 172.21.15.49:0/2669862317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 msgr2=0x55936e821970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/2669862317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e821970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7ddb59e640 1 -- 172.21.15.49:0/2669862317 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936e4e5930 con 0x55936e47a350 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/2669862317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e47a350 0x55936e821430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc005e30 tx=0x7f7dcc0098b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82e8727349c44010 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7dd3fff640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7dc80b6680 0x7f7dc80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7dd17fa640 1 -- 172.21.15.49:0/2669862317 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc031db0 con 0x55936e47a350 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7ddad9d640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7dc80b6680 0x7f7dc80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7dd17fa640 1 -- 172.21.15.49:0/2669862317 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dcc036030 con 0x55936e47a350 2024-09-21T06:40:17.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7dd17fa640 1 -- 172.21.15.49:0/2669862317 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0042a0 con 0x55936e47a350 2024-09-21T06:40:17.186 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.182+0000 7f7dd3fff640 1 -- 172.21.15.49:0/2873309074 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f7dd40e73b0 con 0x7f7ddc103b60 2024-09-21T06:40:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7de7767740 1 -- 172.21.15.49:0/2669862317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e47a350 msgr2=0x55936e821430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7ddad9d640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7dc80b6680 0x7f7dc80b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ad170 tx=0x7f7dd40eaf00 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7de7767740 1 --2- 172.21.15.49:0/2669862317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e47a350 0x55936e821430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc005e30 tx=0x7f7dcc0098b0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7de7767740 1 -- 172.21.15.49:0/2669862317 shutdown_connections 2024-09-21T06:40:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7de7767740 1 --2- 172.21.15.49:0/2669862317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e821eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7de7767740 1 --2- 172.21.15.49:0/2669862317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e821970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7de7767740 1 --2- 172.21.15.49:0/2669862317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e47a350 0x55936e821430 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7de7767740 1 -- 172.21.15.49:0/2669862317 >> 172.21.15.49:0/2669862317 conn(0x55936e46e740 msgr2=0x55936e81f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:17.190 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7de7767740 1 -- 172.21.15.49:0/2669862317 shutdown_connections 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.183+0000 7f7de7767740 1 -- 172.21.15.49:0/2669862317 wait complete. 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7de7767740 1 -- start start 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7de7767740 1 Processor -- start 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7de7767740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 0x55936e82d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7de7767740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e82d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7de7767740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e47a350 0x55936e838d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7de7767740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55936e5e8890 con 0x55936e47a350 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7de7767740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55936e721d40 con 0x55936e451490 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7de7767740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55936e82fa30 con 0x55936e459670 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7de7767740 10 client.0 _ll_register_callbacks cb 0x55936e785c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7ddb59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e47a350 0x55936e838d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.191 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7ddb59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e47a350 0x55936e838d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56634/0 (socket says 172.21.15.49:56634) 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.184+0000 7f7ddb59e640 1 -- 172.21.15.49:0/399215223 learned_addr learned my addr 172.21.15.49:0/399215223 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7dda59c640 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e82d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 0x55936e82d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7ddb59e640 1 -- 172.21.15.49:0/399215223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 msgr2=0x55936e82d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e82d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7ddb59e640 1 -- 172.21.15.49:0/399215223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 msgr2=0x55936e82d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 0x55936e82d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7ddb59e640 1 -- 172.21.15.49:0/399215223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936e839340 con 0x55936e47a350 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e47a350 0x55936e838d50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc003cc0 tx=0x7f7dcc003dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38833142782201fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7dc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:17.192 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7dc27fc640 1 -- 172.21.15.49:0/399215223 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc058060 con 0x55936e47a350 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7dc27fc640 1 -- 172.21.15.49:0/399215223 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f7dcc031650 con 0x55936e47a350 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7de7767740 1 -- 172.21.15.49:0/399215223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dcc036030 con 0x55936e47a350 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7dc27fc640 1 -- 172.21.15.49:0/399215223 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7dcc031850 con 0x55936e47a350 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7de7767740 10 client.16416 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.185+0000 7f7de7767740 1 -- 172.21.15.49:0/399215223 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55936e83bc50 con 0x55936e47a350 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.186+0000 7f7dc27fc640 1 -- 172.21.15.49:0/399215223 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dcc036030 con 0x55936e47a350 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.186+0000 7f7dc27fc640 1 -- 172.21.15.49:0/399215223 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7dcc050070 con 0x55936e47a350 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.186+0000 7f7de7767740 10 client.16416 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.186+0000 7f7de7767740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.186+0000 7f7de7767740 20 client.16416 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:17.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.186+0000 7f7de7767740 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55936e438cd0 0x55936e83efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.186+0000 7f7de7767740 4 client.16416 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.186+0000 7f7de7767740 1 -- 172.21.15.49:0/399215223 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55936e799db0 con 0x55936e438cd0 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.186+0000 7f7dda59c640 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55936e438cd0 0x55936e83efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.187+0000 7f7dc27fc640 10 client.16416 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.187+0000 7f7dda59c640 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55936e438cd0 0x55936e83efb0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=973e3ce7112a3674 server_cookie=c21065aafcc73bfb in_seq=0 out_seq=0 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.187+0000 7f7dc27fc640 1 -- 172.21.15.49:0/399215223 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55936e799db0 con 0x55936e438cd0 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7dc27fc640 10 client.16416 handle_command_reply: tid=0 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 client.16416 shutdown 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 -- 172.21.15.49:0/399215223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e47a350 msgr2=0x55936e838d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e47a350 0x55936e838d50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc003cc0 tx=0x7f7dcc003dc0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 -- 172.21.15.49:0/399215223 shutdown_connections 2024-09-21T06:40:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55936e438cd0 0x55936e83efb0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e47a350 0x55936e838d50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e82d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7dc27fc640 0 client.16416 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 --2- 172.21.15.49:0/399215223 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 0x55936e82d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 -- 172.21.15.49:0/399215223 >> 172.21.15.49:0/399215223 conn(0x55936e46e740 msgr2=0x55936e8245c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 -- 172.21.15.49:0/399215223 shutdown_connections 2024-09-21T06:40:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 1 -- 172.21.15.49:0/399215223 wait complete. 2024-09-21T06:40:17.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.188+0000 7f7de7767740 20 client.16416 trim_cache size 0 max 16384 2024-09-21T06:40:17.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7de7767740 1 Processor -- start 2024-09-21T06:40:17.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7de7767740 1 -- start start 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7de7767740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e438cd0 0x55936e826540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7de7767740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 0x55936e826a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7de7767740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e82a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7de7767740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b4270 con 0x55936e438cd0 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7de7767740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b1b40 con 0x55936e451490 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7de7767740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1af9b0 con 0x55936e459670 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7ddb59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e438cd0 0x55936e826540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7ddb59e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e438cd0 0x55936e826540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56636/0 (socket says 172.21.15.49:56636) 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7ddb59e640 1 -- 172.21.15.49:0/1956013552 learned_addr learned my addr 172.21.15.49:0/1956013552 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.206+0000 7f7dda59c640 1 --2- 172.21.15.49:0/1956013552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 0x55936e826a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.207+0000 7f7ddb59e640 1 -- 172.21.15.49:0/1956013552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 msgr2=0x55936e82a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.207+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/1956013552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e82a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.207+0000 7f7ddb59e640 1 -- 172.21.15.49:0/1956013552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 msgr2=0x55936e826a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.207+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/1956013552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 0x55936e826a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.207+0000 7f7ddb59e640 1 -- 172.21.15.49:0/1956013552 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55936e823720 con 0x55936e438cd0 2024-09-21T06:40:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.207+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/1956013552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e438cd0 0x55936e826540 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc030040 tx=0x7f7dcc02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a504b19f1a859c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.207+0000 7f7dd0ff9640 1 -- 172.21.15.49:0/1956013552 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc058070 con 0x55936e438cd0 2024-09-21T06:40:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.207+0000 7f7dd0ff9640 1 -- 172.21.15.49:0/1956013552 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dcc036040 con 0x55936e438cd0 2024-09-21T06:40:17.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.207+0000 7f7dd0ff9640 1 -- 172.21.15.49:0/1956013552 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc004250 con 0x55936e438cd0 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 -- 172.21.15.49:0/1956013552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e438cd0 msgr2=0x55936e826540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 --2- 172.21.15.49:0/1956013552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e438cd0 0x55936e826540 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc030040 tx=0x7f7dcc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 -- 172.21.15.49:0/1956013552 shutdown_connections 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 --2- 172.21.15.49:0/1956013552 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e82a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 --2- 172.21.15.49:0/1956013552 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e451490 0x55936e826a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 --2- 172.21.15.49:0/1956013552 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e438cd0 0x55936e826540 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 -- 172.21.15.49:0/1956013552 >> 172.21.15.49:0/1956013552 conn(0x55936e46e740 msgr2=0x55936e82b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 -- 172.21.15.49:0/1956013552 shutdown_connections 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 -- 172.21.15.49:0/1956013552 wait complete. 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.208+0000 7f7de7767740 1 -- start start 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7de7767740 1 Processor -- start 2024-09-21T06:40:17.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7de7767740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e438cd0 0x55936e835170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7de7767740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e831630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7de7767740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e831b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7de7767740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b0000 con 0x55936e451490 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7de7767740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b1470 con 0x55936e438cd0 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7de7767740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ddc1b06d0 con 0x55936e459670 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7dda59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e831630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7de7767740 10 client.0 _ll_register_callbacks cb 0x7f7dd40eadd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7dda59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e831630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56652/0 (socket says 172.21.15.49:56652) 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7dda59c640 1 -- 172.21.15.49:0/1857901569 learned_addr learned my addr 172.21.15.49:0/1857901569 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e438cd0 0x55936e835170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e831b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7dda59c640 1 -- 172.21.15.49:0/1857901569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 msgr2=0x55936e831b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7dda59c640 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e831b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7dda59c640 1 -- 172.21.15.49:0/1857901569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e438cd0 msgr2=0x55936e835170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7dda59c640 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e438cd0 0x55936e835170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.209+0000 7f7dda59c640 1 -- 172.21.15.49:0/1857901569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55936e8320b0 con 0x55936e451490 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7dda59c640 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e831630 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc06c760 tx=0x7f7dc4013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2cda7c70c50acd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7dc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7dc27fc640 1 -- 172.21.15.49:0/1857901569 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4004030 con 0x55936e451490 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7dc27fc640 1 -- 172.21.15.49:0/1857901569 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f7dc40041d0 con 0x55936e451490 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7de7767740 1 -- 172.21.15.49:0/1857901569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dcc036040 con 0x55936e451490 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7dc27fc640 1 -- 172.21.15.49:0/1857901569 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7dc40043d0 con 0x55936e451490 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7de7767740 10 client.16422 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7de7767740 1 -- 172.21.15.49:0/1857901569 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55936e8aa460 con 0x55936e451490 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7dc27fc640 1 -- 172.21.15.49:0/1857901569 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7dcc036040 con 0x55936e451490 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.210+0000 7f7dc27fc640 1 -- 172.21.15.49:0/1857901569 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7dc40114d0 con 0x55936e451490 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.211+0000 7f7de7767740 10 client.16422 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.211+0000 7f7de7767740 10 client.16422 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.211+0000 7f7de7767740 20 client.16422 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:17.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.211+0000 7f7de7767740 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55936e47a350 0x55936e8acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:17.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.211+0000 7f7de7767740 4 client.16422 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:40:17.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.211+0000 7f7de7767740 1 -- 172.21.15.49:0/1857901569 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55936e795860 con 0x55936e47a350 2024-09-21T06:40:17.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.211+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55936e47a350 0x55936e8acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:17.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.211+0000 7f7dc27fc640 10 client.16422 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:17.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.211+0000 7f7ddb59e640 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55936e47a350 0x55936e8acc80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e5b1a41a4c726ef server_cookie=7ab37f55520d556 in_seq=0 out_seq=0 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7dc27fc640 1 -- 172.21.15.49:0/1857901569 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55936e795860 con 0x55936e47a350 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7dc27fc640 10 client.16422 handle_command_reply: tid=0 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 client.16422 shutdown 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 -- 172.21.15.49:0/1857901569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 msgr2=0x55936e831630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e831630 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc06c760 tx=0x7f7dc4013830 comp rx=0 tx=0).stop 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 -- 172.21.15.49:0/1857901569 shutdown_connections 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55936e47a350 0x55936e8acc80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55936e459670 0x55936e831b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7dc27fc640 0 client.16422 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55936e451490 0x55936e831630 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 --2- 172.21.15.49:0/1857901569 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55936e438cd0 0x55936e835170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 -- 172.21.15.49:0/1857901569 >> 172.21.15.49:0/1857901569 conn(0x55936e46e740 msgr2=0x55936e82b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:17.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 -- 172.21.15.49:0/1857901569 shutdown_connections 2024-09-21T06:40:17.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.213+0000 7f7de7767740 1 -- 172.21.15.49:0/1857901569 wait complete. 2024-09-21T06:40:17.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de7767740 20 client.16422 trim_cache size 0 max 16384 2024-09-21T06:40:17.218 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:40:17.218 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:40:17.218 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff", 2024-09-21T06:40:17.218 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:40:17.218 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:40:17.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 -- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7dc80b6680 msgr2=0x7f7dc80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:17.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7dc80b6680 0x7f7dc80b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7dd40ad170 tx=0x7f7dd40eaf00 comp rx=0 tx=0).stop 2024-09-21T06:40:17.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 -- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc103b60 msgr2=0x7f7ddc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:17.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc103b60 0x7f7ddc075710 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400d950 tx=0x7f7dd400de10 comp rx=0 tx=0).stop 2024-09-21T06:40:17.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 -- 172.21.15.49:0/2873309074 shutdown_connections 2024-09-21T06:40:17.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7dc80b6680 0x7f7dc80b8b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ddc109df0 0x7f7ddc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ddc1094a0 0x7f7ddc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 --2- 172.21.15.49:0/2873309074 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ddc103b60 0x7f7ddc075710 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:17.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 -- 172.21.15.49:0/2873309074 >> 172.21.15.49:0/2873309074 conn(0x7f7ddc07b850 msgr2=0x7f7ddc105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:17.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 -- 172.21.15.49:0/2873309074 shutdown_connections 2024-09-21T06:40:17.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:17.214+0000 7f7de11f3640 1 -- 172.21.15.49:0/2873309074 wait complete. 2024-09-21T06:40:18.026 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:40:18.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:17 smithi049 ceph-mon[31177]: pgmap v428: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:18.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:17 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:40:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:17 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:17 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:40:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:17 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:18.287 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:18.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:17 smithi098 ceph-mon[34704]: pgmap v428: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:18.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:17 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:40:18.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:17 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:18.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:17 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:40:18.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:17 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:17 smithi079 ceph-mon[34346]: pgmap v428: 97 pgs: 97 active+clean; 3.1 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:17 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:40:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:17 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:17 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:40:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:17 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.798+0000 7f568d637640 1 -- 172.21.15.49:0/3827058716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688102fa0 msgr2=0x7f568810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.798+0000 7f568d637640 1 --2- 172.21.15.49:0/3827058716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688102fa0 0x7f568810fcc0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5670009900 tx=0x7f567002a480 comp rx=0 tx=0).stop 2024-09-21T06:40:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.798+0000 7f568d637640 1 -- 172.21.15.49:0/3827058716 shutdown_connections 2024-09-21T06:40:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.798+0000 7f568d637640 1 --2- 172.21.15.49:0/3827058716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688110200 0x7f5688112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.798+0000 7f568d637640 1 --2- 172.21.15.49:0/3827058716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688102fa0 0x7f568810fcc0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.798+0000 7f568d637640 1 --2- 172.21.15.49:0/3827058716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5688102650 0x7f5688102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.798+0000 7f568d637640 1 -- 172.21.15.49:0/3827058716 >> 172.21.15.49:0/3827058716 conn(0x7f5688079730 msgr2=0x7f5688079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.798+0000 7f568d637640 1 -- 172.21.15.49:0/3827058716 shutdown_connections 2024-09-21T06:40:18.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.798+0000 7f568d637640 1 -- 172.21.15.49:0/3827058716 wait complete. 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f568d637640 1 Processor -- start 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f568d637640 1 -- start start 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f568d637640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688102650 0x7f568819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f568d637640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5688102fa0 0x7f568819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f568d637640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688110200 0x7f56881a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f568d637640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5688115c70 con 0x7f5688110200 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f568d637640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5688115af0 con 0x7f5688102650 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f568d637640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5688115df0 con 0x7f5688102fa0 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f56877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688110200 0x7f56881a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f56877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688110200 0x7f56881a1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56680/0 (socket says 172.21.15.49:56680) 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.799+0000 7f56877fe640 1 -- 172.21.15.49:0/4164361194 learned_addr learned my addr 172.21.15.49:0/4164361194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f56867fc640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5688102fa0 0x7f568819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f5686ffd640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688102650 0x7f568819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f56877fe640 1 -- 172.21.15.49:0/4164361194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5688102fa0 msgr2=0x7f568819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:18.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f56877fe640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5688102fa0 0x7f568819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f56877fe640 1 -- 172.21.15.49:0/4164361194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688102650 msgr2=0x7f568819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f56877fe640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688102650 0x7f568819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f56877fe640 1 -- 172.21.15.49:0/4164361194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56881a25d0 con 0x7f5688110200 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f56867fc640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5688102fa0 0x7f568819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f56877fe640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688110200 0x7f56881a1ea0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5678009fd0 tx=0x7f567800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f567ffff640 1 -- 172.21.15.49:0/4164361194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678017070 con 0x7f5688110200 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f568d637640 1 -- 172.21.15.49:0/4164361194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56881a28c0 con 0x7f5688110200 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f567ffff640 1 -- 172.21.15.49:0/4164361194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5678003e20 con 0x7f5688110200 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f567ffff640 1 -- 172.21.15.49:0/4164361194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678010460 con 0x7f5688110200 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.800+0000 7f568d637640 1 -- 172.21.15.49:0/4164361194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56881a9020 con 0x7f5688110200 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.803+0000 7f5693bab740 1 Processor -- start 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f567ffff640 1 -- 172.21.15.49:0/4164361194 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5678003970 con 0x7f5688110200 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f5693bab740 1 -- start start 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f5693bab740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f141270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f5693bab740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed711b0 0x55cb5f1417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f5693bab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 0x55cb5f141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f5693bab740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cb5f0b7e50 con 0x55cb5ed9a070 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f5693bab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cb5f0a7280 con 0x55cb5ed79390 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f5693bab740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55cb5f0ab090 con 0x55cb5ed711b0 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f56867fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f56867fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f141270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56696/0 (socket says 172.21.15.49:56696) 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f56867fc640 1 -- 172.21.15.49:0/2913815191 learned_addr learned my addr 172.21.15.49:0/2913815191 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.804+0000 7f5686ffd640 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed711b0 0x55cb5f1417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f56867fc640 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 0x55cb5f141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f56867fc640 1 -- 172.21.15.49:0/2913815191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed711b0 msgr2=0x55cb5f1417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f56867fc640 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed711b0 0x55cb5f1417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f56867fc640 1 -- 172.21.15.49:0/2913815191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 msgr2=0x55cb5f141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f56867fc640 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 0x55cb5f141cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f56867fc640 1 -- 172.21.15.49:0/2913815191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb5ee05650 con 0x55cb5ed9a070 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f5686ffd640 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed711b0 0x55cb5f1417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f567ffff640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56740b6680 0x7f56740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f5686ffd640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56740b6680 0x7f56740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f56867fc640 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f141270 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f567002a9a0 tx=0x7f56700058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83c8c503d4dc103b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f567ffff640 1 -- 172.21.15.49:0/4164361194 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f56780e7560 con 0x7f5688110200 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f567d7fa640 1 -- 172.21.15.49:0/2913815191 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670035050 con 0x55cb5ed9a070 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f567d7fa640 1 -- 172.21.15.49:0/2913815191 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5670041070 con 0x55cb5ed9a070 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.805+0000 7f567d7fa640 1 -- 172.21.15.49:0/2913815191 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56700046c0 con 0x55cb5ed9a070 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5693bab740 1 -- 172.21.15.49:0/2913815191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 msgr2=0x55cb5f141270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5693bab740 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f141270 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f567002a9a0 tx=0x7f56700058b0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5686ffd640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56740b6680 0x7f56740b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55cb5f13fef0 tx=0x7f568000c330 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5693bab740 1 -- 172.21.15.49:0/2913815191 shutdown_connections 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5693bab740 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 0x55cb5f141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5693bab740 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed711b0 0x55cb5f1417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5693bab740 1 --2- 172.21.15.49:0/2913815191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f141270 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5693bab740 1 -- 172.21.15.49:0/2913815191 >> 172.21.15.49:0/2913815191 conn(0x55cb5ed8e460 msgr2=0x55cb5f13f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5693bab740 1 -- 172.21.15.49:0/2913815191 shutdown_connections 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.806+0000 7f5693bab740 1 -- 172.21.15.49:0/2913815191 wait complete. 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5693bab740 1 -- start start 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5693bab740 1 Processor -- start 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5693bab740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed711b0 0x55cb5f14c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5693bab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 0x55cb5f14ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5693bab740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 0x55cb5f158d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5693bab740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cb5ef08700 con 0x55cb5ed711b0 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5693bab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cb5f042110 con 0x55cb5ed79390 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5693bab740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55cb5f14f9f0 con 0x55cb5ed9a070 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5693bab740 10 client.0 _ll_register_callbacks cb 0x55cb5f05b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5686ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed711b0 0x55cb5f14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5686ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed711b0 0x55cb5f14c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56700/0 (socket says 172.21.15.49:56700) 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5686ffd640 1 -- 172.21.15.49:0/359692153 learned_addr learned my addr 172.21.15.49:0/359692153 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f56867fc640 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 0x55cb5f14ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f56877fe640 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 0x55cb5f158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.807+0000 7f5686ffd640 1 -- 172.21.15.49:0/359692153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 msgr2=0x55cb5f158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f5686ffd640 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 0x55cb5f158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f5686ffd640 1 -- 172.21.15.49:0/359692153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 msgr2=0x55cb5f14ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f5686ffd640 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 0x55cb5f14ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f5686ffd640 1 -- 172.21.15.49:0/359692153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb5f06fc40 con 0x55cb5ed711b0 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f56867fc640 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 0x55cb5f14ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f5686ffd640 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed711b0 0x55cb5f14c930 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5680011010 tx=0x7f56800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dd0b07628d642b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f566e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f566e7fc640 1 -- 172.21.15.49:0/359692153 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568001e420 con 0x55cb5ed711b0 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f566e7fc640 1 -- 172.21.15.49:0/359692153 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f568001e5c0 con 0x55cb5ed711b0 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f5693bab740 1 -- 172.21.15.49:0/359692153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5670041070 con 0x55cb5ed711b0 2024-09-21T06:40:18.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f566e7fc640 1 -- 172.21.15.49:0/359692153 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f568001e7c0 con 0x55cb5ed711b0 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f5693bab740 10 client.16434 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f5693bab740 1 -- 172.21.15.49:0/359692153 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cb5f15b780 con 0x55cb5ed711b0 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f566e7fc640 1 -- 172.21.15.49:0/359692153 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5670041070 con 0x55cb5ed711b0 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.808+0000 7f566e7fc640 1 -- 172.21.15.49:0/359692153 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5680026880 con 0x55cb5ed711b0 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.809+0000 7f5693bab740 10 client.16434 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.809+0000 7f5693bab740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.809+0000 7f5693bab740 20 client.16434 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.809+0000 7f5693bab740 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cb5ed589f0 0x55cb5f15ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.809+0000 7f5693bab740 4 client.16434 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.809+0000 7f5693bab740 1 -- 172.21.15.49:0/359692153 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb5f0b9da0 con 0x55cb5ed589f0 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.809+0000 7f56867fc640 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cb5ed589f0 0x55cb5f15ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.809+0000 7f566e7fc640 10 client.16434 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.809+0000 7f56867fc640 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cb5ed589f0 0x55cb5f15ed00 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=352465b27c9076e8 server_cookie=a0054c31f7880c23 in_seq=0 out_seq=0 2024-09-21T06:40:18.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.810+0000 7f566e7fc640 1 -- 172.21.15.49:0/359692153 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cb5f0b9da0 con 0x55cb5ed589f0 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.810+0000 7f566e7fc640 10 client.16434 handle_command_reply: tid=0 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.810+0000 7f5693bab740 1 client.16434 shutdown 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 -- 172.21.15.49:0/359692153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed711b0 msgr2=0x55cb5f14c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed711b0 0x55cb5f14c930 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f5680011010 tx=0x7f56800046c0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 -- 172.21.15.49:0/359692153 shutdown_connections 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cb5ed589f0 0x55cb5f15ed00 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 0x55cb5f158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed79390 0x55cb5f14ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f566e7fc640 0 client.16434 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 --2- 172.21.15.49:0/359692153 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed711b0 0x55cb5f14c930 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 -- 172.21.15.49:0/359692153 >> 172.21.15.49:0/359692153 conn(0x55cb5ed8e460 msgr2=0x55cb5f144450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 -- 172.21.15.49:0/359692153 shutdown_connections 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 1 -- 172.21.15.49:0/359692153 wait complete. 2024-09-21T06:40:18.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.811+0000 7f5693bab740 20 client.16434 trim_cache size 0 max 16384 2024-09-21T06:40:18.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.828+0000 7f5693bab740 1 Processor -- start 2024-09-21T06:40:18.830 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f5693bab740 1 -- start start 2024-09-21T06:40:18.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f5693bab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 0x55cb5f1429b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f5693bab740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed79390 0x55cb5f13e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f5693bab740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 0x55cb5f13ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f5693bab740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f56881b4130 con 0x55cb5ed79390 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f5693bab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56881b1a00 con 0x55cb5ed711b0 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f5693bab740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56881af870 con 0x55cb5ed9a070 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56867fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed79390 0x55cb5f13e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56867fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed79390 0x55cb5f13e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56710/0 (socket says 172.21.15.49:56710) 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56867fc640 1 -- 172.21.15.49:0/459355282 learned_addr learned my addr 172.21.15.49:0/459355282 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f5686ffd640 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 0x55cb5f1429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56877fe640 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 0x55cb5f13ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56867fc640 1 -- 172.21.15.49:0/459355282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 msgr2=0x55cb5f13ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:18.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56867fc640 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 0x55cb5f13ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56867fc640 1 -- 172.21.15.49:0/459355282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 msgr2=0x55cb5f1429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56867fc640 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 0x55cb5f1429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56867fc640 1 -- 172.21.15.49:0/459355282 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb5f1439c0 con 0x55cb5ed79390 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.829+0000 7f56877fe640 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 0x55cb5f13ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.830+0000 7f56867fc640 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed79390 0x55cb5f13e710 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5670009900 tx=0x7f5670005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e21e04aab94fd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.830+0000 7f567cff9640 1 -- 172.21.15.49:0/459355282 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5670035040 con 0x55cb5ed79390 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.830+0000 7f567cff9640 1 -- 172.21.15.49:0/459355282 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5670041070 con 0x55cb5ed79390 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.830+0000 7f567cff9640 1 -- 172.21.15.49:0/459355282 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56700319b0 con 0x55cb5ed79390 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 -- 172.21.15.49:0/459355282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed79390 msgr2=0x55cb5f13e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed79390 0x55cb5f13e710 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f5670009900 tx=0x7f5670005330 comp rx=0 tx=0).stop 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 -- 172.21.15.49:0/459355282 shutdown_connections 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed9a070 0x55cb5f13ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed79390 0x55cb5f13e710 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 --2- 172.21.15.49:0/459355282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 0x55cb5f1429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 -- 172.21.15.49:0/459355282 >> 172.21.15.49:0/459355282 conn(0x55cb5ed8e460 msgr2=0x55cb5f1422a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 -- 172.21.15.49:0/459355282 shutdown_connections 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 -- 172.21.15.49:0/459355282 wait complete. 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 -- start start 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.831+0000 7f5693bab740 1 Processor -- start 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f5693bab740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 0x55cb5f150d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f5693bab740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed79390 0x55cb5f1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f5693bab740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f151800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f5693bab740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f56881afec0 con 0x55cb5ed9a070 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f5693bab740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f56881b1330 con 0x55cb5ed711b0 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f5693bab740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f56881b0590 con 0x55cb5ed79390 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f5693bab740 10 client.0 _ll_register_callbacks cb 0x7f568000c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56877fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56714/0 (socket says 172.21.15.49:56714) 2024-09-21T06:40:18.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56877fe640 1 -- 172.21.15.49:0/2366516309 learned_addr learned my addr 172.21.15.49:0/2366516309 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f5686ffd640 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 0x55cb5f150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56867fc640 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed79390 0x55cb5f1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56877fe640 1 -- 172.21.15.49:0/2366516309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed79390 msgr2=0x55cb5f1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56877fe640 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed79390 0x55cb5f1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56877fe640 1 -- 172.21.15.49:0/2366516309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 msgr2=0x55cb5f150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56877fe640 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 0x55cb5f150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56877fe640 1 -- 172.21.15.49:0/2366516309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb5f1c87f0 con 0x55cb5ed9a070 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f56877fe640 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f151800 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f567800dfd0 tx=0x7f56780042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2a267ce9e4dd91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.832+0000 7f566e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f566e7fc640 1 -- 172.21.15.49:0/2366516309 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678020030 con 0x55cb5ed9a070 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f566e7fc640 1 -- 172.21.15.49:0/2366516309 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f56780e7250 con 0x55cb5ed9a070 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f5693bab740 1 -- 172.21.15.49:0/2366516309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5670041070 con 0x55cb5ed9a070 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f566e7fc640 1 -- 172.21.15.49:0/2366516309 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f56780acea0 con 0x55cb5ed9a070 2024-09-21T06:40:18.840 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f5693bab740 10 client.16440 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f5693bab740 1 -- 172.21.15.49:0/2366516309 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cb5f1c99f0 con 0x55cb5ed9a070 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f566e7fc640 1 -- 172.21.15.49:0/2366516309 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5670041070 con 0x55cb5ed9a070 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f566e7fc640 1 -- 172.21.15.49:0/2366516309 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5678094ad0 con 0x55cb5ed9a070 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f5693bab740 10 client.16440 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f5693bab740 10 client.16440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f5693bab740 20 client.16440 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f5693bab740 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cb5ed2dda0 0x55cb5f1cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f5693bab740 4 client.16440 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.833+0000 7f5693bab740 1 -- 172.21.15.49:0/2366516309 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb5f0b5850 con 0x55cb5ed2dda0 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.834+0000 7f5686ffd640 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cb5ed2dda0 0x55cb5f1cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.834+0000 7f566e7fc640 10 client.16440 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.834+0000 7f5686ffd640 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cb5ed2dda0 0x55cb5f1cc180 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac275522e3f242e5 server_cookie=2da96997e4020013 in_seq=0 out_seq=0 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.834+0000 7f566e7fc640 1 -- 172.21.15.49:0/2366516309 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x55cb5f0b5850 con 0x55cb5ed2dda0 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.834+0000 7f566e7fc640 10 client.16440 handle_command_reply: tid=0 2024-09-21T06:40:18.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.834+0000 7f5693bab740 1 client.16440 shutdown 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 -- 172.21.15.49:0/2366516309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 msgr2=0x55cb5f151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f151800 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f567800dfd0 tx=0x7f56780042c0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 -- 172.21.15.49:0/2366516309 shutdown_connections 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cb5ed2dda0 0x55cb5f1cc180 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cb5ed9a070 0x55cb5f151800 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f566e7fc640 0 client.16440 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cb5ed79390 0x55cb5f1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 --2- 172.21.15.49:0/2366516309 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cb5ed711b0 0x55cb5f150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 -- 172.21.15.49:0/2366516309 >> 172.21.15.49:0/2366516309 conn(0x55cb5ed8e460 msgr2=0x55cb5f14dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 -- 172.21.15.49:0/2366516309 shutdown_connections 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 1 -- 172.21.15.49:0/2366516309 wait complete. 2024-09-21T06:40:18.842 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f5693bab740 20 client.16440 trim_cache size 0 max 16384 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff", 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:40:18.843 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:40:18.844 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:40:18.845 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:18.846 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:40:18.847 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:40:18.847 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:18.847 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:18.847 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:18.847 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:18.847 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:18.847 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:40:18.847 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:40:18.847 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f568d637640 1 -- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56740b6680 msgr2=0x7f56740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f568d637640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56740b6680 0x7f56740b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55cb5f13fef0 tx=0x7f568000c330 comp rx=0 tx=0).stop 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f568d637640 1 -- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688110200 msgr2=0x7f56881a1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.835+0000 7f568d637640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688110200 0x7f56881a1ea0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5678009fd0 tx=0x7f567800b260 comp rx=0 tx=0).stop 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.836+0000 7f568d637640 1 -- 172.21.15.49:0/4164361194 shutdown_connections 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.836+0000 7f568d637640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f56740b6680 0x7f56740b8b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.836+0000 7f568d637640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5688110200 0x7f56881a1ea0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.836+0000 7f568d637640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5688102fa0 0x7f568819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.836+0000 7f568d637640 1 --2- 172.21.15.49:0/4164361194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5688102650 0x7f568819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.836+0000 7f568d637640 1 -- 172.21.15.49:0/4164361194 >> 172.21.15.49:0/4164361194 conn(0x7f5688079730 msgr2=0x7f5688108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.836+0000 7f568d637640 1 -- 172.21.15.49:0/4164361194 shutdown_connections 2024-09-21T06:40:18.848 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:18.836+0000 7f568d637640 1 -- 172.21.15.49:0/4164361194 wait complete. 2024-09-21T06:40:18.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:18 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:40:18.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:18 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:19.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:18 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:40:19.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:18 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:19.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:18 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:40:19.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:18 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:19.639 INFO:tasks.cephfs.filesystem:scrub status for tag:cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff - {'path': '/', 'tag': 'cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff', 'options': 'recursive,force'} 2024-09-21T06:40:20.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:19 smithi049 ceph-mon[31177]: pgmap v429: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T06:40:20.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:19 smithi098 ceph-mon[34704]: pgmap v429: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T06:40:20.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:19 smithi079 ceph-mon[34346]: pgmap v429: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 17 op/s 2024-09-21T06:40:22.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:21 smithi049 ceph-mon[31177]: pgmap v430: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-21T06:40:22.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:21 smithi098 ceph-mon[34704]: pgmap v430: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-21T06:40:22.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:21 smithi079 ceph-mon[34346]: pgmap v430: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 12 op/s 2024-09-21T06:40:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.441+0000 7f61b8132640 1 -- 172.21.15.49:0/992865463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b010dd70 msgr2=0x7f61b0110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.441+0000 7f61b8132640 1 --2- 172.21.15.49:0/992865463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b010dd70 0x7f61b0110260 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009ca0 tx=0x7f61a802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.442+0000 7f61b8132640 1 -- 172.21.15.49:0/992865463 shutdown_connections 2024-09-21T06:40:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.442+0000 7f61b8132640 1 --2- 172.21.15.49:0/992865463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b010dd70 0x7f61b0110260 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.442+0000 7f61b8132640 1 --2- 172.21.15.49:0/992865463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0105260 0x7f61b010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.442+0000 7f61b8132640 1 --2- 172.21.15.49:0/992865463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b0104910 0x7f61b0104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.442+0000 7f61b8132640 1 -- 172.21.15.49:0/992865463 >> 172.21.15.49:0/992865463 conn(0x7f61b00fe3c0 msgr2=0x7f61b0100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.442+0000 7f61b8132640 1 -- 172.21.15.49:0/992865463 shutdown_connections 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.442+0000 7f61b8132640 1 -- 172.21.15.49:0/992865463 wait complete. 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.442+0000 7f61b8132640 1 Processor -- start 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.442+0000 7f61b8132640 1 -- start start 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b8132640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b0104910 0x7f61b019a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b8132640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0105260 0x7f61b019a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b8132640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b010dd70 0x7f61b019fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b8132640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01139d0 con 0x7f61b0104910 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b8132640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61b0113850 con 0x7f61b0105260 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b8132640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61b0113b50 con 0x7f61b010dd70 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b5ece640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b0104910 0x7f61b019a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b5ece640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b0104910 0x7f61b019a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56730/0 (socket says 172.21.15.49:56730) 2024-09-21T06:40:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b5ece640 1 -- 172.21.15.49:0/3195372640 learned_addr learned my addr 172.21.15.49:0/3195372640 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b56cd640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0105260 0x7f61b019a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b66cf640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b010dd70 0x7f61b019fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b5ece640 1 -- 172.21.15.49:0/3195372640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b010dd70 msgr2=0x7f61b019fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b5ece640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b010dd70 0x7f61b019fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b5ece640 1 -- 172.21.15.49:0/3195372640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0105260 msgr2=0x7f61b019a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b5ece640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0105260 0x7f61b019a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b5ece640 1 -- 172.21.15.49:0/3195372640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b01a0230 con 0x7f61b0104910 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.443+0000 7f61b5ece640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b0104910 0x7f61b019a390 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00c920 tx=0x7f61ac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.444+0000 7f61a6ffd640 1 -- 172.21.15.49:0/3195372640 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac007c70 con 0x7f61b0104910 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.444+0000 7f61b8132640 1 -- 172.21.15.49:0/3195372640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b01a0520 con 0x7f61b0104910 2024-09-21T06:40:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.444+0000 7f61a6ffd640 1 -- 172.21.15.49:0/3195372640 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61ac007e10 con 0x7f61b0104910 2024-09-21T06:40:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.444+0000 7f61a6ffd640 1 -- 172.21.15.49:0/3195372640 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac018820 con 0x7f61b0104910 2024-09-21T06:40:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.444+0000 7f61b8132640 1 -- 172.21.15.49:0/3195372640 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b01a6d40 con 0x7f61b0104910 2024-09-21T06:40:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.447+0000 7f61bf09f740 1 Processor -- start 2024-09-21T06:40:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.447+0000 7f61bf09f740 1 -- start start 2024-09-21T06:40:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.447+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dc69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.447+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 0x5595d6dc6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.447+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a004d0 0x5595d6dc7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.447+0000 7f61bf09f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5595d6d3b6f0 con 0x5595d6a211b0 2024-09-21T06:40:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.447+0000 7f61bf09f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5595d6d2ab20 con 0x5595d69f82f0 2024-09-21T06:40:22.452 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.447+0000 7f61bf09f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5595d6d2e930 con 0x5595d6a004d0 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b66cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dc69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b66cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dc69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56732/0 (socket says 172.21.15.49:56732) 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b66cf640 1 -- 172.21.15.49:0/1706146026 learned_addr learned my addr 172.21.15.49:0/1706146026 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61a6ffd640 1 -- 172.21.15.49:0/3195372640 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f61ac00f450 con 0x7f61b0104910 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b56cd640 1 --2- 172.21.15.49:0/1706146026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a004d0 0x5595d6dc7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b66cf640 1 -- 172.21.15.49:0/1706146026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a004d0 msgr2=0x5595d6dc7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b66cf640 1 --2- 172.21.15.49:0/1706146026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a004d0 0x5595d6dc7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b66cf640 1 -- 172.21.15.49:0/1706146026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 msgr2=0x5595d6dc6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b66cf640 1 --2- 172.21.15.49:0/1706146026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 0x5595d6dc6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b66cf640 1 -- 172.21.15.49:0/1706146026 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d6cf0530 con 0x5595d6a211b0 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.448+0000 7f61b66cf640 1 --2- 172.21.15.49:0/1706146026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dc69b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009930 tx=0x7f61a8009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6644c26cbf5f6a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.449+0000 7f619bfff640 1 -- 172.21.15.49:0/1706146026 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8031df0 con 0x5595d6a211b0 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.449+0000 7f619bfff640 1 -- 172.21.15.49:0/1706146026 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a8036040 con 0x5595d6a211b0 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.449+0000 7f619bfff640 1 -- 172.21.15.49:0/1706146026 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a80042a0 con 0x5595d6a211b0 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.449+0000 7f61a6ffd640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f619c0b6680 0x7f619c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.449+0000 7f61b5ece640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f619c0b6680 0x7f619c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.449+0000 7f61a6ffd640 1 -- 172.21.15.49:0/3195372640 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f61ac0e78c0 con 0x7f61b0104910 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.449+0000 7f61bf09f740 1 -- 172.21.15.49:0/1706146026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 msgr2=0x5595d6dc69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.449+0000 7f61bf09f740 1 --2- 172.21.15.49:0/1706146026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dc69b0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009930 tx=0x7f61a8009960 comp rx=0 tx=0).stop 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.449+0000 7f61b5ece640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f619c0b6680 0x7f619c0b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x5595d6dc5630 tx=0x7f61ac07a9d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.450+0000 7f61bf09f740 1 -- 172.21.15.49:0/1706146026 shutdown_connections 2024-09-21T06:40:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.450+0000 7f61bf09f740 1 --2- 172.21.15.49:0/1706146026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a004d0 0x5595d6dc7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.450+0000 7f61bf09f740 1 --2- 172.21.15.49:0/1706146026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 0x5595d6dc6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.450+0000 7f61bf09f740 1 --2- 172.21.15.49:0/1706146026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dc69b0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.450+0000 7f61bf09f740 1 -- 172.21.15.49:0/1706146026 >> 172.21.15.49:0/1706146026 conn(0x5595d6a15300 msgr2=0x5595d6dc48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.450+0000 7f61bf09f740 1 -- 172.21.15.49:0/1706146026 shutdown_connections 2024-09-21T06:40:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.450+0000 7f61bf09f740 1 -- 172.21.15.49:0/1706146026 wait complete. 2024-09-21T06:40:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.450+0000 7f61bf09f740 1 -- start start 2024-09-21T06:40:22.455 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.450+0000 7f61bf09f740 1 Processor -- start 2024-09-21T06:40:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d69f82f0 0x5595d6dd2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 0x5595d6dd2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a211b0 0x5595d6dde420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61bf09f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5595d6c62ab0 con 0x5595d69f82f0 2024-09-21T06:40:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61bf09f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5595d6cd0730 con 0x5595d6a004d0 2024-09-21T06:40:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61bf09f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5595d6dd50d0 con 0x5595d6a211b0 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61bf09f740 10 client.0 _ll_register_callbacks cb 0x5595d6d246b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b66cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d69f82f0 0x5595d6dd2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b66cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d69f82f0 0x5595d6dd2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56744/0 (socket says 172.21.15.49:56744) 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b66cf640 1 -- 172.21.15.49:0/2781999207 learned_addr learned my addr 172.21.15.49:0/2781999207 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b56cd640 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 0x5595d6dd2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b66cf640 1 -- 172.21.15.49:0/2781999207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a211b0 msgr2=0x5595d6dde420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b66cf640 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a211b0 0x5595d6dde420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b66cf640 1 -- 172.21.15.49:0/2781999207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 msgr2=0x5595d6dd2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b66cf640 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 0x5595d6dd2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b66cf640 1 -- 172.21.15.49:0/2781999207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d6a8c790 con 0x5595d69f82f0 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61b66cf640 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d69f82f0 0x5595d6dd2000 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f61a8003de0 tx=0x7f61a8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc702c185f17aec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.451+0000 7f61997fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61997fa640 1 -- 172.21.15.49:0/2781999207 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8055060 con 0x5595d69f82f0 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61997fa640 1 -- 172.21.15.49:0/2781999207 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f61a80316e0 con 0x5595d69f82f0 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61bf09f740 1 -- 172.21.15.49:0/2781999207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61a8036040 con 0x5595d69f82f0 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61997fa640 1 -- 172.21.15.49:0/2781999207 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f61a80318e0 con 0x5595d69f82f0 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61bf09f740 10 client.16452 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61bf09f740 1 -- 172.21.15.49:0/2781999207 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5595d6b05620 con 0x5595d69f82f0 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61997fa640 1 -- 172.21.15.49:0/2781999207 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a8036040 con 0x5595d69f82f0 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61997fa640 1 -- 172.21.15.49:0/2781999207 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f61a80042b0 con 0x5595d69f82f0 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61bf09f740 10 client.16452 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61bf09f740 10 client.16452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61bf09f740 20 client.16452 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61bf09f740 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595d69dfd80 0x5595d6de3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61bf09f740 4 client.16452 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.452+0000 7f61bf09f740 1 -- 172.21.15.49:0/2781999207 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595d6d3d640 con 0x5595d69dfd80 2024-09-21T06:40:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.453+0000 7f61b56cd640 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595d69dfd80 0x5595d6de3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.453+0000 7f61997fa640 10 client.16452 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.453+0000 7f61b56cd640 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595d69dfd80 0x5595d6de3f70 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e62790c5c688a7ce server_cookie=7d20bb18eb35a8d2 in_seq=0 out_seq=0 2024-09-21T06:40:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61997fa640 1 -- 172.21.15.49:0/2781999207 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595d6d3d640 con 0x5595d69dfd80 2024-09-21T06:40:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61997fa640 10 client.16452 handle_command_reply: tid=0 2024-09-21T06:40:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 client.16452 shutdown 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 -- 172.21.15.49:0/2781999207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d69f82f0 msgr2=0x5595d6dd2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d69f82f0 0x5595d6dd2000 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f61a8003de0 tx=0x7f61a8009360 comp rx=0 tx=0).stop 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 -- 172.21.15.49:0/2781999207 shutdown_connections 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595d69dfd80 0x5595d6de3f70 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a211b0 0x5595d6dde420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 0x5595d6dd2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 --2- 172.21.15.49:0/2781999207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d69f82f0 0x5595d6dd2000 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61997fa640 0 client.16452 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 -- 172.21.15.49:0/2781999207 >> 172.21.15.49:0/2781999207 conn(0x5595d6a15300 msgr2=0x5595d6dc79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 -- 172.21.15.49:0/2781999207 shutdown_connections 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 1 -- 172.21.15.49:0/2781999207 wait complete. 2024-09-21T06:40:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.454+0000 7f61bf09f740 20 client.16452 trim_cache size 0 max 16384 2024-09-21T06:40:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.469+0000 7f61bf09f740 1 Processor -- start 2024-09-21T06:40:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.469+0000 7f61bf09f740 1 -- start start 2024-09-21T06:40:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.469+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d69f82f0 0x5595d6dc3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.469+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 0x5595d6dd3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.469+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dde390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.469+0000 7f61bf09f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01b1fa0 con 0x5595d6a211b0 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.469+0000 7f61bf09f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01af870 con 0x5595d6a004d0 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.469+0000 7f61bf09f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01ad6e0 con 0x5595d69f82f0 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.469+0000 7f61b66cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dde390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b66cf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dde390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56754/0 (socket says 172.21.15.49:56754) 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b66cf640 1 -- 172.21.15.49:0/3951162456 learned_addr learned my addr 172.21.15.49:0/3951162456 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b66cf640 1 --2- 172.21.15.49:0/3951162456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d69f82f0 0x5595d6dc3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b66cf640 1 -- 172.21.15.49:0/3951162456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d69f82f0 msgr2=0x5595d6dc3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b66cf640 1 --2- 172.21.15.49:0/3951162456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d69f82f0 0x5595d6dc3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b56cd640 1 --2- 172.21.15.49:0/3951162456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 0x5595d6dd3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b66cf640 1 -- 172.21.15.49:0/3951162456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 msgr2=0x5595d6dd3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b66cf640 1 --2- 172.21.15.49:0/3951162456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 0x5595d6dd3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b66cf640 1 -- 172.21.15.49:0/3951162456 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d6dd45e0 con 0x5595d6a211b0 2024-09-21T06:40:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f61b66cf640 1 --2- 172.21.15.49:0/3951162456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dde390 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f61a8003a10 tx=0x7f61a8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e165babcb5fa2953 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f619b7fe640 1 -- 172.21.15.49:0/3951162456 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8055070 con 0x5595d6a211b0 2024-09-21T06:40:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f619b7fe640 1 -- 172.21.15.49:0/3951162456 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a8036040 con 0x5595d6a211b0 2024-09-21T06:40:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.470+0000 7f619b7fe640 1 -- 172.21.15.49:0/3951162456 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a80041a0 con 0x5595d6a211b0 2024-09-21T06:40:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 -- 172.21.15.49:0/3951162456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 msgr2=0x5595d6dde390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 --2- 172.21.15.49:0/3951162456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dde390 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f61a8003a10 tx=0x7f61a8005fd0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 -- 172.21.15.49:0/3951162456 shutdown_connections 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 --2- 172.21.15.49:0/3951162456 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a211b0 0x5595d6dde390 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 --2- 172.21.15.49:0/3951162456 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d6a004d0 0x5595d6dd3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 --2- 172.21.15.49:0/3951162456 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d69f82f0 0x5595d6dc3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 -- 172.21.15.49:0/3951162456 >> 172.21.15.49:0/3951162456 conn(0x5595d6a15300 msgr2=0x5595d6dd14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 -- 172.21.15.49:0/3951162456 shutdown_connections 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 -- 172.21.15.49:0/3951162456 wait complete. 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 -- start start 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.471+0000 7f61bf09f740 1 Processor -- start 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 0x5595d6de6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a004d0 0x5595d6de7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61bf09f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a211b0 0x5595d6e43990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61bf09f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01add30 con 0x5595d6a004d0 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61bf09f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01af1a0 con 0x5595d69f82f0 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61bf09f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61b01ae400 con 0x5595d6a211b0 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61bf09f740 10 client.0 _ll_register_callbacks cb 0x7f61a8009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b56cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a004d0 0x5595d6de7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b56cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a004d0 0x5595d6de7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56762/0 (socket says 172.21.15.49:56762) 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b56cd640 1 -- 172.21.15.49:0/690548158 learned_addr learned my addr 172.21.15.49:0/690548158 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b66cf640 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a211b0 0x5595d6e43990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b66cf640 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 0x5595d6de6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b56cd640 1 -- 172.21.15.49:0/690548158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a211b0 msgr2=0x5595d6e43990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b56cd640 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a211b0 0x5595d6e43990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b56cd640 1 -- 172.21.15.49:0/690548158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 msgr2=0x5595d6de6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b56cd640 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 0x5595d6de6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b56cd640 1 -- 172.21.15.49:0/690548158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d6e44030 con 0x5595d6a004d0 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.472+0000 7f61b66cf640 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 0x5595d6de6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61b56cd640 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a004d0 0x5595d6de7460 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f61a0000c00 tx=0x7f61a000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132e3673b1392d36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61997fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61997fa640 1 -- 172.21.15.49:0/690548158 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a001d420 con 0x5595d6a004d0 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61997fa640 1 -- 172.21.15.49:0/690548158 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f61a001d5c0 con 0x5595d6a004d0 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61bf09f740 1 -- 172.21.15.49:0/690548158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61a8036040 con 0x5595d6a004d0 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61997fa640 1 -- 172.21.15.49:0/690548158 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f61a001d7c0 con 0x5595d6a004d0 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61bf09f740 10 client.16458 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61bf09f740 1 -- 172.21.15.49:0/690548158 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5595d6e4e6f0 con 0x5595d6a004d0 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61997fa640 1 -- 172.21.15.49:0/690548158 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a8036040 con 0x5595d6a004d0 2024-09-21T06:40:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61997fa640 1 -- 172.21.15.49:0/690548158 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f61a0024b10 con 0x5595d6a004d0 2024-09-21T06:40:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61bf09f740 10 client.16458 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61bf09f740 10 client.16458 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61bf09f740 20 client.16458 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61bf09f740 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595d69b51c0 0x5595d6e50ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61bf09f740 4 client.16458 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:40:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.473+0000 7f61bf09f740 1 -- 172.21.15.49:0/690548158 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5595d6d390f0 con 0x5595d69b51c0 2024-09-21T06:40:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.474+0000 7f61b66cf640 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595d69b51c0 0x5595d6e50ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.474+0000 7f61997fa640 10 client.16458 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.474+0000 7f61b66cf640 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595d69b51c0 0x5595d6e50ee0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53b36251fd2bbe28 server_cookie=fda9ae60a74be15f in_seq=0 out_seq=0 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61997fa640 1 -- 172.21.15.49:0/690548158 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5595d6d390f0 con 0x5595d69b51c0 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61997fa640 10 client.16458 handle_command_reply: tid=0 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 client.16458 shutdown 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 -- 172.21.15.49:0/690548158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a004d0 msgr2=0x5595d6de7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a004d0 0x5595d6de7460 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f61a0000c00 tx=0x7f61a000bd60 comp rx=0 tx=0).stop 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 -- 172.21.15.49:0/690548158 shutdown_connections 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5595d69b51c0 0x5595d6e50ee0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595d6a211b0 0x5595d6e43990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595d6a004d0 0x5595d6de7460 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 --2- 172.21.15.49:0/690548158 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595d69f82f0 0x5595d6de6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61997fa640 0 client.16458 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 -- 172.21.15.49:0/690548158 >> 172.21.15.49:0/690548158 conn(0x5595d6a15300 msgr2=0x5595d6dd3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 -- 172.21.15.49:0/690548158 shutdown_connections 2024-09-21T06:40:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 1 -- 172.21.15.49:0/690548158 wait complete. 2024-09-21T06:40:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.482+0000 7f61bf09f740 20 client.16458 trim_cache size 0 max 16384 2024-09-21T06:40:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:40:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:40:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:40:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:40:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 -- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f619c0b6680 msgr2=0x7f619c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f619c0b6680 0x7f619c0b8b90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x5595d6dc5630 tx=0x7f61ac07a9d0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 -- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b0104910 msgr2=0x7f61b019a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b0104910 0x7f61b019a390 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f61ac00c920 tx=0x7f61ac00cde0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 -- 172.21.15.49:0/3195372640 shutdown_connections 2024-09-21T06:40:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f619c0b6680 0x7f619c0b8b90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b010dd70 0x7f61b019fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b0105260 0x7f61b019a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 --2- 172.21.15.49:0/3195372640 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b0104910 0x7f61b019a390 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 -- 172.21.15.49:0/3195372640 >> 172.21.15.49:0/3195372640 conn(0x7f61b00fe3c0 msgr2=0x7f61b0105740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 -- 172.21.15.49:0/3195372640 shutdown_connections 2024-09-21T06:40:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:22.483+0000 7f61b8132640 1 -- 172.21.15.49:0/3195372640 wait complete. 2024-09-21T06:40:24.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:23 smithi049 ceph-mon[31177]: pgmap v431: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:40:24.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:23 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:40:24.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:23 smithi098 ceph-mon[34704]: pgmap v431: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:40:24.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:23 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:40:24.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:23 smithi079 ceph-mon[34346]: pgmap v431: 97 pgs: 97 active+clean; 3.2 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:40:24.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:23 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:40:25.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:24 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:40:25.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:24 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:40:25.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:24 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:40:26.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:25 smithi049 ceph-mon[31177]: pgmap v432: 97 pgs: 97 active+clean; 3.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-09-21T06:40:26.228 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:25 smithi098 ceph-mon[34704]: pgmap v432: 97 pgs: 97 active+clean; 3.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-09-21T06:40:26.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:25 smithi079 ceph-mon[34346]: pgmap v432: 97 pgs: 97 active+clean; 3.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-09-21T06:40:28.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:27 smithi049 ceph-mon[31177]: pgmap v433: 97 pgs: 97 active+clean; 3.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:40:28.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:27 smithi098 ceph-mon[34704]: pgmap v433: 97 pgs: 97 active+clean; 3.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:40:28.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:27 smithi079 ceph-mon[34346]: pgmap v433: 97 pgs: 97 active+clean; 3.3 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 11 op/s 2024-09-21T06:40:30.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:29 smithi049 ceph-mon[31177]: pgmap v434: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 17 op/s 2024-09-21T06:40:30.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:29 smithi098 ceph-mon[34704]: pgmap v434: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 17 op/s 2024-09-21T06:40:30.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:29 smithi079 ceph-mon[34346]: pgmap v434: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 17 op/s 2024-09-21T06:40:31.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:31 smithi098 ceph-mon[34704]: pgmap v435: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-21T06:40:31.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:31 smithi079 ceph-mon[34346]: pgmap v435: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-21T06:40:31.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:31 smithi049 ceph-mon[31177]: pgmap v435: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-09-21T06:40:33.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:33 smithi098 ceph-mon[34704]: pgmap v436: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-21T06:40:33.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:33 smithi079 ceph-mon[34346]: pgmap v436: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-21T06:40:33.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:33 smithi049 ceph-mon[31177]: pgmap v436: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 13 op/s 2024-09-21T06:40:35.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:35 smithi098 ceph-mon[34704]: pgmap v437: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-09-21T06:40:35.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:35 smithi079 ceph-mon[34346]: pgmap v437: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-09-21T06:40:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.595+0000 7f8a9c907640 1 -- 172.21.15.49:0/2877321017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 msgr2=0x7f8a9810f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.595+0000 7f8a9c907640 1 --2- 172.21.15.49:0/2877321017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 0x7f8a9810f470 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8a90009ca0 tx=0x7f8a9002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.596+0000 7f8a9c907640 1 -- 172.21.15.49:0/2877321017 shutdown_connections 2024-09-21T06:40:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.596+0000 7f8a9c907640 1 --2- 172.21.15.49:0/2877321017 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 0x7f8a9810f470 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.596+0000 7f8a9c907640 1 --2- 172.21.15.49:0/2877321017 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a981082f0 0x7f8a98108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.596+0000 7f8a9c907640 1 --2- 172.21.15.49:0/2877321017 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a981029c0 0x7f8a98102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.596+0000 7f8a9c907640 1 -- 172.21.15.49:0/2877321017 >> 172.21.15.49:0/2877321017 conn(0x7f8a980fe3c0 msgr2=0x7f8a98100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.596+0000 7f8a9c907640 1 -- 172.21.15.49:0/2877321017 shutdown_connections 2024-09-21T06:40:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.596+0000 7f8a9c907640 1 -- 172.21.15.49:0/2877321017 wait complete. 2024-09-21T06:40:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.596+0000 7f8a9c907640 1 Processor -- start 2024-09-21T06:40:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a9c907640 1 -- start start 2024-09-21T06:40:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a9c907640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a981029c0 0x7f8a9819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a9c907640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a981082f0 0x7f8a9819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a9c907640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 0x7f8a9819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a9c907640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98112950 con 0x7f8a98108c40 2024-09-21T06:40:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a9c907640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981127d0 con 0x7f8a981029c0 2024-09-21T06:40:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a9c907640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98112ad0 con 0x7f8a981082f0 2024-09-21T06:40:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a96d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 0x7f8a9819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a96d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 0x7f8a9819fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33168/0 (socket says 172.21.15.49:33168) 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a96d9d640 1 -- 172.21.15.49:0/1760052737 learned_addr learned my addr 172.21.15.49:0/1760052737 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a981082f0 0x7f8a9819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a9659c640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a981029c0 0x7f8a9819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a96d9d640 1 -- 172.21.15.49:0/1760052737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a981082f0 msgr2=0x7f8a9819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a96d9d640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a981082f0 0x7f8a9819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a96d9d640 1 -- 172.21.15.49:0/1760052737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a981029c0 msgr2=0x7f8a9819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a96d9d640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a981029c0 0x7f8a9819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.597+0000 7f8a96d9d640 1 -- 172.21.15.49:0/1760052737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a981a0280 con 0x7f8a98108c40 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.598+0000 7f8a96d9d640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 0x7f8a9819fc10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8a90009430 tx=0x7f8a900319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.598+0000 7f8a877fe640 1 -- 172.21.15.49:0/1760052737 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a90003b70 con 0x7f8a98108c40 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.598+0000 7f8a877fe640 1 -- 172.21.15.49:0/1760052737 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a90003d10 con 0x7f8a98108c40 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.598+0000 7f8a9c907640 1 -- 172.21.15.49:0/1760052737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a981a0510 con 0x7f8a98108c40 2024-09-21T06:40:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.598+0000 7f8a877fe640 1 -- 172.21.15.49:0/1760052737 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9002fa30 con 0x7f8a98108c40 2024-09-21T06:40:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.598+0000 7f8a9c907640 1 -- 172.21.15.49:0/1760052737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a981a6d90 con 0x7f8a98108c40 2024-09-21T06:40:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8aa3871740 1 Processor -- start 2024-09-21T06:40:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8a877fe640 1 -- 172.21.15.49:0/1760052737 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8a9002fbd0 con 0x7f8a98108c40 2024-09-21T06:40:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8aa3871740 1 -- start start 2024-09-21T06:40:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 0x5640ee2349b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede662f0 0x5640ee234ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede6e4d0 0x5640ee235430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8aa3871740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5640ee1a96f0 con 0x5640ede662f0 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8aa3871740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5640ee198b20 con 0x5640ede8f1b0 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8aa3871740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5640ee19c930 con 0x5640ede6e4d0 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.601+0000 7f8a9659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede662f0 0x5640ee234ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a9659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede662f0 0x5640ee234ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33178/0 (socket says 172.21.15.49:33178) 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a9659c640 1 -- 172.21.15.49:0/2858782459 learned_addr learned my addr 172.21.15.49:0/2858782459 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 0x5640ee2349b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede6e4d0 0x5640ee235430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a9659c640 1 -- 172.21.15.49:0/2858782459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede6e4d0 msgr2=0x5640ee235430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a9659c640 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede6e4d0 0x5640ee235430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a9659c640 1 -- 172.21.15.49:0/2858782459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 msgr2=0x5640ee2349b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a9659c640 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 0x5640ee2349b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a9659c640 1 -- 172.21.15.49:0/2858782459 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ee15e530 con 0x5640ede662f0 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 0x5640ee2349b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a877fe640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a800b6680 0x7f8a800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a9659c640 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede662f0 0x5640ee234ef0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800bd10 tx=0x7f8a880107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d155544b2f5039 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a800b6680 0x7f8a800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a877fe640 1 -- 172.21.15.49:0/1760052737 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a90108980 con 0x7f8a98108c40 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a84ff9640 1 -- 172.21.15.49:0/2858782459 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88004030 con 0x5640ede662f0 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a84ff9640 1 -- 172.21.15.49:0/2858782459 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a880035f0 con 0x5640ede662f0 2024-09-21T06:40:35.607 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.602+0000 7f8a84ff9640 1 -- 172.21.15.49:0/2858782459 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a88011770 con 0x5640ede662f0 2024-09-21T06:40:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.603+0000 7f8aa3871740 1 -- 172.21.15.49:0/2858782459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede662f0 msgr2=0x5640ee234ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.603+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a800b6680 0x7f8a800b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a9806abb0 tx=0x7f8a8c00a6c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.603+0000 7f8aa3871740 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede662f0 0x5640ee234ef0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800bd10 tx=0x7f8a880107a0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.603+0000 7f8aa3871740 1 -- 172.21.15.49:0/2858782459 shutdown_connections 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.603+0000 7f8aa3871740 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede6e4d0 0x5640ee235430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.603+0000 7f8aa3871740 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede662f0 0x5640ee234ef0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.603+0000 7f8aa3871740 1 --2- 172.21.15.49:0/2858782459 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 0x5640ee2349b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.603+0000 7f8aa3871740 1 -- 172.21.15.49:0/2858782459 >> 172.21.15.49:0/2858782459 conn(0x5640ede83300 msgr2=0x5640ee2328a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 -- 172.21.15.49:0/2858782459 shutdown_connections 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 -- 172.21.15.49:0/2858782459 wait complete. 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 -- start start 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 Processor -- start 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee240060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee2405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 0x5640ee24c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5640ee0d0ab0 con 0x5640ede6e4d0 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5640ee13e730 con 0x5640ede662f0 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.604+0000 7f8aa3871740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5640ee243130 con 0x5640ede8f1b0 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8aa3871740 10 client.0 _ll_register_callbacks cb 0x5640ee1926b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee2405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee2405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33190/0 (socket says 172.21.15.49:33190) 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a95d9b640 1 -- 172.21.15.49:0/3403883125 learned_addr learned my addr 172.21.15.49:0/3403883125 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a9659c640 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee240060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a95d9b640 1 -- 172.21.15.49:0/3403883125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 msgr2=0x5640ee24c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a96d9d640 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 0x5640ee24c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 0x5640ee24c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a95d9b640 1 -- 172.21.15.49:0/3403883125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 msgr2=0x5640ee240060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee240060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a95d9b640 1 -- 172.21.15.49:0/3403883125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640edefa790 con 0x5640ede6e4d0 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a9659c640 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee240060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee2405a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c01fb80 tx=0x7f8a8c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912dc48de2d1db82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a7dffb640 1 -- 172.21.15.49:0/3403883125 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c02e060 con 0x5640ede6e4d0 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a7dffb640 1 -- 172.21.15.49:0/3403883125 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a8c01dab0 con 0x5640ede6e4d0 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8aa3871740 1 -- 172.21.15.49:0/3403883125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a880035f0 con 0x5640ede6e4d0 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.605+0000 7f8a7dffb640 1 -- 172.21.15.49:0/3403883125 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c01dcb0 con 0x5640ede6e4d0 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8aa3871740 10 client.16470 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8aa3871740 1 -- 172.21.15.49:0/3403883125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5640edf73620 con 0x5640ede6e4d0 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8a7dffb640 1 -- 172.21.15.49:0/3403883125 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a880035f0 con 0x5640ede6e4d0 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8a7dffb640 1 -- 172.21.15.49:0/3403883125 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8a8c0295b0 con 0x5640ede6e4d0 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8aa3871740 10 client.16470 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8aa3871740 10 client.16470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8aa3871740 20 client.16470 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8aa3871740 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5640ede4dd80 0x5640ee252280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8aa3871740 4 client.16470 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8aa3871740 1 -- 172.21.15.49:0/3403883125 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640ee1ab640 con 0x5640ede4dd80 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.606+0000 7f8a9659c640 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5640ede4dd80 0x5640ee252280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.607+0000 7f8a7dffb640 10 client.16470 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.607+0000 7f8a9659c640 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5640ede4dd80 0x5640ee252280 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c591cf3a3933efe9 server_cookie=60f274cf17dd5c86 in_seq=0 out_seq=0 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8a7dffb640 1 -- 172.21.15.49:0/3403883125 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5640ee1ab640 con 0x5640ede4dd80 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8a7dffb640 10 client.16470 handle_command_reply: tid=0 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 client.16470 shutdown 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 -- 172.21.15.49:0/3403883125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 msgr2=0x5640ee2405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee2405a0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c01fb80 tx=0x7f8a8c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 -- 172.21.15.49:0/3403883125 shutdown_connections 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5640ede4dd80 0x5640ee252280 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 0x5640ee24c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee2405a0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8a7dffb640 0 client.16470 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 --2- 172.21.15.49:0/3403883125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee240060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 -- 172.21.15.49:0/3403883125 >> 172.21.15.49:0/3403883125 conn(0x5640ede83300 msgr2=0x5640ee2359e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 -- 172.21.15.49:0/3403883125 shutdown_connections 2024-09-21T06:40:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 1 -- 172.21.15.49:0/3403883125 wait complete. 2024-09-21T06:40:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.608+0000 7f8aa3871740 20 client.16470 trim_cache size 0 max 16384 2024-09-21T06:40:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8aa3871740 1 Processor -- start 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8aa3871740 1 -- start start 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede662f0 0x5640ee2360f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee24c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 0x5640ee23d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8aa3871740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981b2060 con 0x5640ede6e4d0 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8aa3871740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981af930 con 0x5640ede8f1b0 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8aa3871740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981ad7a0 con 0x5640ede662f0 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8a95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee24c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8a95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee24c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33192/0 (socket says 172.21.15.49:33192) 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.623+0000 7f8a95d9b640 1 -- 172.21.15.49:0/2390247226 learned_addr learned my addr 172.21.15.49:0/2390247226 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a9659c640 1 --2- 172.21.15.49:0/2390247226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede662f0 0x5640ee2360f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a95d9b640 1 -- 172.21.15.49:0/2390247226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede662f0 msgr2=0x5640ee2360f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/2390247226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede662f0 0x5640ee2360f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a96d9d640 1 --2- 172.21.15.49:0/2390247226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 0x5640ee23d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a95d9b640 1 -- 172.21.15.49:0/2390247226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 msgr2=0x5640ee23d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/2390247226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 0x5640ee23d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a95d9b640 1 -- 172.21.15.49:0/2390247226 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640ee240ef0 con 0x5640ede6e4d0 2024-09-21T06:40:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/2390247226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee24c350 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c005720 tx=0x7f8a8c01de50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5841f5a743fdba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a7ffff640 1 -- 172.21.15.49:0/2390247226 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c029420 con 0x5640ede6e4d0 2024-09-21T06:40:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a7ffff640 1 -- 172.21.15.49:0/2390247226 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a8c03f070 con 0x5640ede6e4d0 2024-09-21T06:40:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.624+0000 7f8a7ffff640 1 -- 172.21.15.49:0/2390247226 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c032a60 con 0x5640ede6e4d0 2024-09-21T06:40:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 -- 172.21.15.49:0/2390247226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 msgr2=0x5640ee24c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 --2- 172.21.15.49:0/2390247226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee24c350 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c005720 tx=0x7f8a8c01de50 comp rx=0 tx=0).stop 2024-09-21T06:40:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 -- 172.21.15.49:0/2390247226 shutdown_connections 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 --2- 172.21.15.49:0/2390247226 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede8f1b0 0x5640ee23d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 --2- 172.21.15.49:0/2390247226 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee24c350 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 --2- 172.21.15.49:0/2390247226 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede662f0 0x5640ee2360f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 -- 172.21.15.49:0/2390247226 >> 172.21.15.49:0/2390247226 conn(0x5640ede83300 msgr2=0x5640ee2359e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 -- 172.21.15.49:0/2390247226 shutdown_connections 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 -- 172.21.15.49:0/2390247226 wait complete. 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 -- start start 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.625+0000 7f8aa3871740 1 Processor -- start 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee245c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee246210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8aa3871740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 0x5640ee2bac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8aa3871740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981addf0 con 0x5640ede6e4d0 2024-09-21T06:40:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8aa3871740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981af260 con 0x5640ede662f0 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8aa3871740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981ae4c0 con 0x5640ede8f1b0 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8aa3871740 10 client.0 _ll_register_callbacks cb 0x7f8a8c01f830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee246210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a95d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee246210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33196/0 (socket says 172.21.15.49:33196) 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a95d9b640 1 -- 172.21.15.49:0/1866978426 learned_addr learned my addr 172.21.15.49:0/1866978426 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a9659c640 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee245c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a96d9d640 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 0x5640ee2bac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a95d9b640 1 -- 172.21.15.49:0/1866978426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 msgr2=0x5640ee2bac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 0x5640ee2bac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a95d9b640 1 -- 172.21.15.49:0/1866978426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 msgr2=0x5640ee245c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee245c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a95d9b640 1 -- 172.21.15.49:0/1866978426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640ee2bb300 con 0x5640ede6e4d0 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a9659c640 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee245c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a95d9b640 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee246210 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c029980 tx=0x7f8a8c029ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7326e06c2e15e194 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a7dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.626+0000 7f8a7dffb640 1 -- 172.21.15.49:0/1866978426 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c02e020 con 0x5640ede6e4d0 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8a7dffb640 1 -- 172.21.15.49:0/1866978426 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8a8c01d780 con 0x5640ede6e4d0 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8aa3871740 1 -- 172.21.15.49:0/1866978426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a8c03f070 con 0x5640ede6e4d0 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8a7dffb640 1 -- 172.21.15.49:0/1866978426 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8a8c050050 con 0x5640ede6e4d0 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8aa3871740 10 client.16476 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8aa3871740 1 -- 172.21.15.49:0/1866978426 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5640ee2bc590 con 0x5640ede6e4d0 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8a7dffb640 1 -- 172.21.15.49:0/1866978426 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a8c03f070 con 0x5640ede6e4d0 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8a7dffb640 1 -- 172.21.15.49:0/1866978426 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8a8c043450 con 0x5640ede6e4d0 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8aa3871740 10 client.16476 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8aa3871740 10 client.16476 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8aa3871740 20 client.16476 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8aa3871740 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5640ede231c0 0x5640ee2bec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8aa3871740 4 client.16476 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:40:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8aa3871740 1 -- 172.21.15.49:0/1866978426 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5640ee1a70f0 con 0x5640ede231c0 2024-09-21T06:40:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.627+0000 7f8a9659c640 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5640ede231c0 0x5640ee2bec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.628+0000 7f8a9659c640 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5640ede231c0 0x5640ee2bec30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af22090f8a7c4dd0 server_cookie=2610ac0588d9f97 in_seq=0 out_seq=0 2024-09-21T06:40:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.628+0000 7f8a7dffb640 10 client.16476 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.635+0000 7f8a7dffb640 1 -- 172.21.15.49:0/1866978426 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5640ee1a70f0 con 0x5640ede231c0 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.635+0000 7f8a7dffb640 10 client.16476 handle_command_reply: tid=0 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 client.16476 shutdown 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 -- 172.21.15.49:0/1866978426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 msgr2=0x5640ee246210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee246210 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c029980 tx=0x7f8a8c029ea0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 -- 172.21.15.49:0/1866978426 shutdown_connections 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5640ede231c0 0x5640ee2bec30 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5640ede8f1b0 0x5640ee2bac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5640ede6e4d0 0x5640ee246210 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8a7dffb640 0 client.16476 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 --2- 172.21.15.49:0/1866978426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5640ede662f0 0x5640ee245c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 -- 172.21.15.49:0/1866978426 >> 172.21.15.49:0/1866978426 conn(0x5640ede83300 msgr2=0x5640ee232880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 -- 172.21.15.49:0/1866978426 shutdown_connections 2024-09-21T06:40:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 1 -- 172.21.15.49:0/1866978426 wait complete. 2024-09-21T06:40:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8aa3871740 20 client.16476 trim_cache size 0 max 16384 2024-09-21T06:40:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:40:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:40:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:40:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:40:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8a9c907640 1 -- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a800b6680 msgr2=0x7f8a800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8a9c907640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a800b6680 0x7f8a800b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8a9806abb0 tx=0x7f8a8c00a6c0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8a9c907640 1 -- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 msgr2=0x7f8a9819fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.636+0000 7f8a9c907640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 0x7f8a9819fc10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8a90009430 tx=0x7f8a900319f0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.637+0000 7f8a9c907640 1 -- 172.21.15.49:0/1760052737 shutdown_connections 2024-09-21T06:40:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.637+0000 7f8a9c907640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8a800b6680 0x7f8a800b8b90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.637+0000 7f8a9c907640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8a98108c40 0x7f8a9819fc10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.637+0000 7f8a9c907640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8a981082f0 0x7f8a9819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.637+0000 7f8a9c907640 1 --2- 172.21.15.49:0/1760052737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8a981029c0 0x7f8a9819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.637+0000 7f8a9c907640 1 -- 172.21.15.49:0/1760052737 >> 172.21.15.49:0/1760052737 conn(0x7f8a980fe3c0 msgr2=0x7f8a9806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.637+0000 7f8a9c907640 1 -- 172.21.15.49:0/1760052737 shutdown_connections 2024-09-21T06:40:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:35.637+0000 7f8a9c907640 1 -- 172.21.15.49:0/1760052737 wait complete. 2024-09-21T06:40:35.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:35 smithi049 ceph-mon[31177]: pgmap v437: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 14 op/s 2024-09-21T06:40:37.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:37 smithi098 ceph-mon[34704]: pgmap v438: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:37.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:37 smithi079 ceph-mon[34346]: pgmap v438: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:37.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:37 smithi049 ceph-mon[31177]: pgmap v438: 97 pgs: 97 active+clean; 3.4 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:39.525 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:39 smithi049 ceph-mon[31177]: pgmap v439: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-09-21T06:40:39.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:39 smithi098 ceph-mon[34704]: pgmap v439: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-09-21T06:40:39.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:39 smithi079 ceph-mon[34346]: pgmap v439: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 17 op/s 2024-09-21T06:40:41.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:41 smithi098 ceph-mon[34704]: pgmap v440: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:41.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:41 smithi079 ceph-mon[34346]: pgmap v440: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:41.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:41 smithi049 ceph-mon[31177]: pgmap v440: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:43.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:43 smithi098 ceph-mon[34704]: pgmap v441: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:40:43.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:43 smithi079 ceph-mon[34346]: pgmap v441: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:40:43.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:43 smithi049 ceph-mon[31177]: pgmap v441: 97 pgs: 97 active+clean; 3.5 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 13 op/s 2024-09-21T06:40:45.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:45 smithi098 ceph-mon[34704]: pgmap v442: 97 pgs: 97 active+clean; 3.6 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-09-21T06:40:45.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:45 smithi079 ceph-mon[34346]: pgmap v442: 97 pgs: 97 active+clean; 3.6 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-09-21T06:40:45.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:45 smithi049 ceph-mon[31177]: pgmap v442: 97 pgs: 97 active+clean; 3.6 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-09-21T06:40:47.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:47 smithi098 ceph-mon[34704]: pgmap v443: 97 pgs: 97 active+clean; 3.6 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:47.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:47 smithi079 ceph-mon[34346]: pgmap v443: 97 pgs: 97 active+clean; 3.6 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:47.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:47 smithi049 ceph-mon[31177]: pgmap v443: 97 pgs: 97 active+clean; 3.6 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.752+0000 7f1a7d238640 1 -- 172.21.15.49:0/1978007852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a78104950 msgr2=0x7f1a78104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.752+0000 7f1a7d238640 1 --2- 172.21.15.49:0/1978007852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a78104950 0x7f1a78104d60 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009900 tx=0x7f1a6802a410 comp rx=0 tx=0).stop 2024-09-21T06:40:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.752+0000 7f1a7d238640 1 -- 172.21.15.49:0/1978007852 shutdown_connections 2024-09-21T06:40:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.752+0000 7f1a7d238640 1 --2- 172.21.15.49:0/1978007852 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a7810ddb0 0x7f1a781102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.752+0000 7f1a7d238640 1 --2- 172.21.15.49:0/1978007852 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a781052a0 0x7f1a7810d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.752+0000 7f1a7d238640 1 --2- 172.21.15.49:0/1978007852 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a78104950 0x7f1a78104d60 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.752+0000 7f1a7d238640 1 -- 172.21.15.49:0/1978007852 >> 172.21.15.49:0/1978007852 conn(0x7f1a780fe400 msgr2=0x7f1a78100850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.752+0000 7f1a7d238640 1 -- 172.21.15.49:0/1978007852 shutdown_connections 2024-09-21T06:40:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.752+0000 7f1a7d238640 1 -- 172.21.15.49:0/1978007852 wait complete. 2024-09-21T06:40:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.753+0000 7f1a7d238640 1 Processor -- start 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.753+0000 7f1a7d238640 1 -- start start 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.753+0000 7f1a7d238640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a78104950 0x7f1a7819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.753+0000 7f1a7d238640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a781052a0 0x7f1a7819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.753+0000 7f1a7d238640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a7810ddb0 0x7f1a7819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.753+0000 7f1a7d238640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78113a10 con 0x7f1a7810ddb0 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.753+0000 7f1a7d238640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78113890 con 0x7f1a78104950 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.753+0000 7f1a7d238640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78113b90 con 0x7f1a781052a0 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a7810ddb0 0x7f1a7819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a7810ddb0 0x7f1a7819fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34730/0 (socket says 172.21.15.49:34730) 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7759e640 1 -- 172.21.15.49:0/4253490295 learned_addr learned my addr 172.21.15.49:0/4253490295 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7659c640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a781052a0 0x7f1a7819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a78104950 0x7f1a7819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7759e640 1 -- 172.21.15.49:0/4253490295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a781052a0 msgr2=0x7f1a7819aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7759e640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a781052a0 0x7f1a7819aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7759e640 1 -- 172.21.15.49:0/4253490295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a78104950 msgr2=0x7f1a7819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7759e640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a78104950 0x7f1a7819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7759e640 1 -- 172.21.15.49:0/4253490295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a781a03a0 con 0x7f1a7810ddb0 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a78104950 0x7f1a7819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a7759e640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a7810ddb0 0x7f1a7819fca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009fd0 tx=0x7f1a7000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.754+0000 7f1a5ffff640 1 -- 172.21.15.49:0/4253490295 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70017070 con 0x7f1a7810ddb0 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.755+0000 7f1a7d238640 1 -- 172.21.15.49:0/4253490295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a781a0690 con 0x7f1a7810ddb0 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.755+0000 7f1a5ffff640 1 -- 172.21.15.49:0/4253490295 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a70003e20 con 0x7f1a7810ddb0 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.755+0000 7f1a5ffff640 1 -- 172.21.15.49:0/4253490295 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70010460 con 0x7f1a7810ddb0 2024-09-21T06:40:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.755+0000 7f1a7d238640 1 -- 172.21.15.49:0/4253490295 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a781a6e20 con 0x7f1a7810ddb0 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.758+0000 7f1a84284740 1 Processor -- start 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.758+0000 7f1a5ffff640 1 -- 172.21.15.49:0/4253490295 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f1a700106c0 con 0x7f1a7810ddb0 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.758+0000 7f1a84284740 1 -- start start 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.758+0000 7f1a84284740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 0x5631795c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.758+0000 7f1a84284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 0x5631795c3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.758+0000 7f1a84284740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.758+0000 7f1a84284740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5631795386f0 con 0x5631791fd4d0 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.758+0000 7f1a84284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563179527b20 con 0x5631791f52f0 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.758+0000 7f1a84284740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56317952b930 con 0x56317921e1b0 2024-09-21T06:40:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34734/0 (socket says 172.21.15.49:34734) 2024-09-21T06:40:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 -- 172.21.15.49:0/703636092 learned_addr learned my addr 172.21.15.49:0/703636092 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 --2- 172.21.15.49:0/703636092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 0x5631795c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/703636092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 0x5631795c3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a5ffff640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1a600b6680 0x7f1a600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 -- 172.21.15.49:0/703636092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 msgr2=0x5631795c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 --2- 172.21.15.49:0/703636092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 0x5631795c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 -- 172.21.15.49:0/703636092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 msgr2=0x5631795c3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 --2- 172.21.15.49:0/703636092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 0x5631795c3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 -- 172.21.15.49:0/703636092 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631794ed530 con 0x5631791fd4d0 2024-09-21T06:40:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7759e640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1a600b6680 0x7f1a600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a5ffff640 1 -- 172.21.15.49:0/4253490295 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1a700e7510 con 0x7f1a7810ddb0 2024-09-21T06:40:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.759+0000 7f1a7659c640 1 --2- 172.21.15.49:0/703636092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795c4430 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c013780 tx=0x7f1a6c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9127bfd94cadabc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.760+0000 7f1a5d7fa640 1 -- 172.21.15.49:0/703636092 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c013dc0 con 0x5631791fd4d0 2024-09-21T06:40:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.760+0000 7f1a5d7fa640 1 -- 172.21.15.49:0/703636092 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a6c011c90 con 0x5631791fd4d0 2024-09-21T06:40:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.760+0000 7f1a5d7fa640 1 -- 172.21.15.49:0/703636092 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c01fbc0 con 0x5631791fd4d0 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.760+0000 7f1a84284740 1 -- 172.21.15.49:0/703636092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 msgr2=0x5631795c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.760+0000 7f1a7759e640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1a600b6680 0x7f1a600b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1a700aa5b0 tx=0x7f1a70015f20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.760+0000 7f1a84284740 1 --2- 172.21.15.49:0/703636092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795c4430 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c013780 tx=0x7f1a6c005850 comp rx=0 tx=0).stop 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 -- 172.21.15.49:0/703636092 shutdown_connections 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 --2- 172.21.15.49:0/703636092 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795c4430 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 --2- 172.21.15.49:0/703636092 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 0x5631795c3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 --2- 172.21.15.49:0/703636092 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 0x5631795c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 -- 172.21.15.49:0/703636092 >> 172.21.15.49:0/703636092 conn(0x563179212300 msgr2=0x5631795c18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 -- 172.21.15.49:0/703636092 shutdown_connections 2024-09-21T06:40:48.777 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 -- 172.21.15.49:0/703636092 wait complete. 2024-09-21T06:40:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 -- start start 2024-09-21T06:40:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 Processor -- start 2024-09-21T06:40:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791f52f0 0x5631795cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791fd4d0 0x5631795cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 0x5631795db420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56317945fab0 con 0x5631791f52f0 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5631794cd730 con 0x5631791fd4d0 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5631795d2130 con 0x56317921e1b0 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.761+0000 7f1a84284740 10 client.0 _ll_register_callbacks cb 0x5631795216b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791f52f0 0x5631795cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791f52f0 0x5631795cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34746/0 (socket says 172.21.15.49:34746) 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 -- 172.21.15.49:0/3681810868 learned_addr learned my addr 172.21.15.49:0/3681810868 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791fd4d0 0x5631795cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 0x5631795db420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 -- 172.21.15.49:0/3681810868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 msgr2=0x5631795db420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 0x5631795db420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 -- 172.21.15.49:0/3681810868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791fd4d0 msgr2=0x5631795cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791fd4d0 0x5631795cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 -- 172.21.15.49:0/3681810868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563179289790 con 0x5631791f52f0 2024-09-21T06:40:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a7659c640 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791f52f0 0x5631795cf010 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c01f7a0 tx=0x7f1a6c01f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7b1ee79a6c237 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a5aff5640 1 -- 172.21.15.49:0/3681810868 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c025040 con 0x5631791f52f0 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a84284740 1 -- 172.21.15.49:0/3681810868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a6c011c90 con 0x5631791f52f0 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.762+0000 7f1a5aff5640 1 -- 172.21.15.49:0/3681810868 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1a6c01fbb0 con 0x5631791f52f0 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a5aff5640 1 -- 172.21.15.49:0/3681810868 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1a6c01fdb0 con 0x5631791f52f0 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a84284740 10 client.16488 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a84284740 1 -- 172.21.15.49:0/3681810868 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563179302620 con 0x5631791f52f0 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a5aff5640 1 -- 172.21.15.49:0/3681810868 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a6c011c90 con 0x5631791f52f0 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a5aff5640 1 -- 172.21.15.49:0/3681810868 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1a6c0048f0 con 0x5631791f52f0 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a84284740 10 client.16488 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a84284740 10 client.16488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a84284740 20 client.16488 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a84284740 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631791dcd80 0x5631795e0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a84284740 4 client.16488 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a84284740 1 -- 172.21.15.49:0/3681810868 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56317953a640 con 0x5631791dcd80 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.763+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631791dcd80 0x5631795e0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.764+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631791dcd80 0x5631795e0f90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f258a33b692f0a2 server_cookie=c6140b8003b12eab in_seq=0 out_seq=0 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.764+0000 7f1a5aff5640 10 client.16488 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a5aff5640 1 -- 172.21.15.49:0/3681810868 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56317953a640 con 0x5631791dcd80 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a5aff5640 10 client.16488 handle_command_reply: tid=0 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 client.16488 shutdown 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 -- 172.21.15.49:0/3681810868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791f52f0 msgr2=0x5631795cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791f52f0 0x5631795cf010 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c01f7a0 tx=0x7f1a6c01f3e0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 -- 172.21.15.49:0/3681810868 shutdown_connections 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631791dcd80 0x5631795e0f90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56317921e1b0 0x5631795db420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791fd4d0 0x5631795cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 --2- 172.21.15.49:0/3681810868 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791f52f0 0x5631795cf010 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 -- 172.21.15.49:0/3681810868 >> 172.21.15.49:0/3681810868 conn(0x563179212300 msgr2=0x5631795c49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a5aff5640 0 client.16488 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 -- 172.21.15.49:0/3681810868 shutdown_connections 2024-09-21T06:40:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 1 -- 172.21.15.49:0/3681810868 wait complete. 2024-09-21T06:40:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.765+0000 7f1a84284740 20 client.16488 trim_cache size 0 max 16384 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a84284740 1 Processor -- start 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a84284740 1 -- start start 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a84284740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791f52f0 0x5631795c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a84284740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795db320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a84284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317921e1b0 0x5631795cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a84284740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781b2160 con 0x5631791fd4d0 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a84284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781afa30 con 0x56317921e1b0 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a84284740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781ad8a0 con 0x5631791f52f0 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a76d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795db320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a76d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795db320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34760/0 (socket says 172.21.15.49:34760) 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a76d9d640 1 -- 172.21.15.49:0/1380151286 learned_addr learned my addr 172.21.15.49:0/1380151286 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:48.787 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a7659c640 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791f52f0 0x5631795c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.780+0000 7f1a7659c640 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317921e1b0 0x5631795cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a76d9d640 1 -- 172.21.15.49:0/1380151286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791f52f0 msgr2=0x5631795c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791f52f0 0x5631795c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a76d9d640 1 -- 172.21.15.49:0/1380151286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317921e1b0 msgr2=0x5631795cc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317921e1b0 0x5631795cc1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a76d9d640 1 -- 172.21.15.49:0/1380151286 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631795c5ee0 con 0x5631791fd4d0 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a7659c640 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317921e1b0 0x5631795cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795db320 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1a6802a930 tx=0x7f1a680058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f118f39d7607310 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a5cff9640 1 -- 172.21.15.49:0/1380151286 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68035040 con 0x5631791fd4d0 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a5cff9640 1 -- 172.21.15.49:0/1380151286 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a680054f0 con 0x5631791fd4d0 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.781+0000 7f1a5cff9640 1 -- 172.21.15.49:0/1380151286 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a680035f0 con 0x5631791fd4d0 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 -- 172.21.15.49:0/1380151286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 msgr2=0x5631795db320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795db320 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1a6802a930 tx=0x7f1a680058b0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 -- 172.21.15.49:0/1380151286 shutdown_connections 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56317921e1b0 0x5631795cc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5631791fd4d0 0x5631795db320 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 --2- 172.21.15.49:0/1380151286 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791f52f0 0x5631795c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 -- 172.21.15.49:0/1380151286 >> 172.21.15.49:0/1380151286 conn(0x563179212300 msgr2=0x5631795c4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 -- 172.21.15.49:0/1380151286 shutdown_connections 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 -- 172.21.15.49:0/1380151286 wait complete. 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 -- start start 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.782+0000 7f1a84284740 1 Processor -- start 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a84284740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 0x5631795d4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a84284740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791fd4d0 0x5631795d4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a84284740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56317921e1b0 0x5631796497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a84284740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781adef0 con 0x56317921e1b0 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a84284740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781af360 con 0x5631791f52f0 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a84284740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1a781ae5c0 con 0x5631791fd4d0 2024-09-21T06:40:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a84284740 10 client.0 _ll_register_callbacks cb 0x7f1a6c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56317921e1b0 0x5631796497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56317921e1b0 0x5631796497c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34774/0 (socket says 172.21.15.49:34774) 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 -- 172.21.15.49:0/2994303754 learned_addr learned my addr 172.21.15.49:0/2994303754 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 0x5631795d4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791fd4d0 0x5631795d4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 -- 172.21.15.49:0/2994303754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791fd4d0 msgr2=0x5631795d4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791fd4d0 0x5631795d4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 -- 172.21.15.49:0/2994303754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 msgr2=0x5631795d4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 0x5631795d4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 -- 172.21.15.49:0/2994303754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563179649d00 con 0x56317921e1b0 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a7659c640 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56317921e1b0 0x5631796497c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c004cc0 tx=0x7f1a6c01f3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f1096e6382fee6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.783+0000 7f1a5aff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a5aff5640 1 -- 172.21.15.49:0/2994303754 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c038040 con 0x56317921e1b0 2024-09-21T06:40:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a5aff5640 1 -- 172.21.15.49:0/2994303754 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1a6c01c040 con 0x56317921e1b0 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a84284740 1 -- 172.21.15.49:0/2994303754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a680054f0 con 0x56317921e1b0 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a5aff5640 1 -- 172.21.15.49:0/2994303754 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1a6c01f7d0 con 0x56317921e1b0 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a84284740 10 client.16494 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a84284740 1 -- 172.21.15.49:0/2994303754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56317964ae90 con 0x56317921e1b0 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a5aff5640 1 -- 172.21.15.49:0/2994303754 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a680054f0 con 0x56317921e1b0 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a5aff5640 1 -- 172.21.15.49:0/2994303754 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1a6c0035f0 con 0x56317921e1b0 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a84284740 10 client.16494 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a84284740 10 client.16494 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a84284740 20 client.16494 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a84284740 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631791b21c0 0x56317964d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a84284740 4 client.16494 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.784+0000 7f1a84284740 1 -- 172.21.15.49:0/2994303754 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5631795360f0 con 0x5631791b21c0 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.785+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631791b21c0 0x56317964d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.785+0000 7f1a5aff5640 10 client.16494 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.785+0000 7f1a76d9d640 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631791b21c0 0x56317964d540 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e76c7bcb68be4f2 server_cookie=5079648261872e5e in_seq=0 out_seq=0 2024-09-21T06:40:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.792+0000 7f1a5aff5640 1 -- 172.21.15.49:0/2994303754 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631795360f0 con 0x5631791b21c0 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a5aff5640 10 client.16494 handle_command_reply: tid=0 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 client.16494 shutdown 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 -- 172.21.15.49:0/2994303754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56317921e1b0 msgr2=0x5631796497c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56317921e1b0 0x5631796497c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c004cc0 tx=0x7f1a6c01f3e0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 -- 172.21.15.49:0/2994303754 shutdown_connections 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5631791b21c0 0x56317964d540 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56317921e1b0 0x5631796497c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5631791fd4d0 0x5631795d4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 --2- 172.21.15.49:0/2994303754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5631791f52f0 0x5631795d4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a5aff5640 0 client.16494 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 -- 172.21.15.49:0/2994303754 >> 172.21.15.49:0/2994303754 conn(0x563179212300 msgr2=0x5631795c1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 -- 172.21.15.49:0/2994303754 shutdown_connections 2024-09-21T06:40:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 1 -- 172.21.15.49:0/2994303754 wait complete. 2024-09-21T06:40:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a84284740 20 client.16494 trim_cache size 0 max 16384 2024-09-21T06:40:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:40:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:40:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:40:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a7d238640 1 -- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1a600b6680 msgr2=0x7f1a600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a7d238640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1a600b6680 0x7f1a600b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1a700aa5b0 tx=0x7f1a70015f20 comp rx=0 tx=0).stop 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a7d238640 1 -- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a7810ddb0 msgr2=0x7f1a7819fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.793+0000 7f1a7d238640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a7810ddb0 0x7f1a7819fca0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009fd0 tx=0x7f1a7000b260 comp rx=0 tx=0).stop 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.794+0000 7f1a7d238640 1 -- 172.21.15.49:0/4253490295 shutdown_connections 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.794+0000 7f1a7d238640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1a600b6680 0x7f1a600b8b90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.794+0000 7f1a7d238640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1a7810ddb0 0x7f1a7819fca0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.794+0000 7f1a7d238640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1a781052a0 0x7f1a7819aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.794+0000 7f1a7d238640 1 --2- 172.21.15.49:0/4253490295 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1a78104950 0x7f1a7819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.794+0000 7f1a7d238640 1 -- 172.21.15.49:0/4253490295 >> 172.21.15.49:0/4253490295 conn(0x7f1a780fe400 msgr2=0x7f1a781078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.794+0000 7f1a7d238640 1 -- 172.21.15.49:0/4253490295 shutdown_connections 2024-09-21T06:40:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:40:48.794+0000 7f1a7d238640 1 -- 172.21.15.49:0/4253490295 wait complete. 2024-09-21T06:40:49.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:49 smithi098 ceph-mon[34704]: pgmap v444: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-21T06:40:49.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:49 smithi079 ceph-mon[34346]: pgmap v444: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-21T06:40:49.641 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:40:49.671 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:49 smithi049 ceph-mon[31177]: pgmap v444: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 15 op/s 2024-09-21T06:40:49.915 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:50.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 -- 172.21.15.49:0/528910652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105240 msgr2=0x7f1d70105650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 --2- 172.21.15.49:0/528910652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105240 0x7f1d70105650 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009900 tx=0x7f1d6002a410 comp rx=0 tx=0).stop 2024-09-21T06:40:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 -- 172.21.15.49:0/528910652 shutdown_connections 2024-09-21T06:40:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 --2- 172.21.15.49:0/528910652 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d70105b90 0x7f1d7010f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 --2- 172.21.15.49:0/528910652 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105240 0x7f1d70105650 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 --2- 172.21.15.49:0/528910652 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d70103270 0x7f1d70103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 -- 172.21.15.49:0/528910652 >> 172.21.15.49:0/528910652 conn(0x7f1d70079ec0 msgr2=0x7f1d7007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 -- 172.21.15.49:0/528910652 shutdown_connections 2024-09-21T06:40:50.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 -- 172.21.15.49:0/528910652 wait complete. 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 Processor -- start 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.507+0000 7f1d787ca640 1 -- start start 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d787ca640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d70103270 0x7f1d7019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d787ca640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d70105240 0x7f1d7019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d787ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105b90 0x7f1d7019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d787ca640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d70113b70 con 0x7f1d70105b90 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d787ca640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d701139f0 con 0x7f1d70103270 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d787ca640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1d70113cf0 con 0x7f1d70105240 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d76d67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105b90 0x7f1d7019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d76d67640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105b90 0x7f1d7019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34792/0 (socket says 172.21.15.49:34792) 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d76d67640 1 -- 172.21.15.49:0/3852533931 learned_addr learned my addr 172.21.15.49:0/3852533931 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:50.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d76566640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d70103270 0x7f1d7019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d75d65640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d70105240 0x7f1d7019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d76d67640 1 -- 172.21.15.49:0/3852533931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d70105240 msgr2=0x7f1d7019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d76d67640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d70105240 0x7f1d7019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d76d67640 1 -- 172.21.15.49:0/3852533931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d70103270 msgr2=0x7f1d7019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d76d67640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d70103270 0x7f1d7019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.508+0000 7f1d76d67640 1 -- 172.21.15.49:0/3852533931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d701a03f0 con 0x7f1d70105b90 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.509+0000 7f1d76d67640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105b90 0x7f1d7019fd80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800b970 tx=0x7f1d6800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.509+0000 7f1d677fe640 1 -- 172.21.15.49:0/3852533931 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d68019070 con 0x7f1d70105b90 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.509+0000 7f1d677fe640 1 -- 172.21.15.49:0/3852533931 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d68014440 con 0x7f1d70105b90 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.509+0000 7f1d677fe640 1 -- 172.21.15.49:0/3852533931 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d680075d0 con 0x7f1d70105b90 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.509+0000 7f1d787ca640 1 -- 172.21.15.49:0/3852533931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d701a06e0 con 0x7f1d70105b90 2024-09-21T06:40:50.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.509+0000 7f1d787ca640 1 -- 172.21.15.49:0/3852533931 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d701a6f00 con 0x7f1d70105b90 2024-09-21T06:40:50.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.512+0000 7f1d7ed3e740 1 Processor -- start 2024-09-21T06:40:50.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.512+0000 7f1d677fe640 1 -- 172.21.15.49:0/3852533931 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f1d6801c070 con 0x7f1d70105b90 2024-09-21T06:40:50.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d7ed3e740 1 -- start start 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f989070 0x56366fd30650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd30b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f968390 0x56366fd310d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56366fca6e50 con 0x56366f968390 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56366fc96280 con 0x56366f9601b0 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56366fc9a090 con 0x56366f989070 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d75d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f968390 0x56366fd310d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d75d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f968390 0x56366fd310d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34802/0 (socket says 172.21.15.49:34802) 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d75d65640 1 -- 172.21.15.49:0/1995961096 learned_addr learned my addr 172.21.15.49:0/1995961096 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d75d65640 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f989070 0x56366fd30650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d76566640 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd30b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.513+0000 7f1d677fe640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d5c0b6730 0x7f1d5c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d75d65640 1 -- 172.21.15.49:0/1995961096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f989070 msgr2=0x56366fd30650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d75d65640 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f989070 0x56366fd30650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d75d65640 1 -- 172.21.15.49:0/1995961096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 msgr2=0x56366fd30b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d75d65640 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd30b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d75d65640 1 -- 172.21.15.49:0/1995961096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366f9f4650 con 0x56366f968390 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d76566640 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd30b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d76d67640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d5c0b6730 0x7f1d5c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d677fe640 1 -- 172.21.15.49:0/3852533931 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1d680e6a40 con 0x7f1d70105b90 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d75d65640 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f968390 0x56366fd310d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1d60033000 tx=0x7f1d60009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b53f684bd6c63aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d64ff9640 1 -- 172.21.15.49:0/1995961096 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60035070 con 0x56366f968390 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d64ff9640 1 -- 172.21.15.49:0/1995961096 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d60031d10 con 0x56366f968390 2024-09-21T06:40:50.517 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.514+0000 7f1d64ff9640 1 -- 172.21.15.49:0/1995961096 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60005620 con 0x56366f968390 2024-09-21T06:40:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1995961096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f968390 msgr2=0x56366fd310d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d76d67640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d5c0b6730 0x7f1d5c0b8c40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800cfd0 tx=0x7f1d680d0040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f968390 0x56366fd310d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1d60033000 tx=0x7f1d60009560 comp rx=0 tx=0).stop 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1995961096 shutdown_connections 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f968390 0x56366fd310d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd30b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/1995961096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f989070 0x56366fd30650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1995961096 >> 172.21.15.49:0/1995961096 conn(0x56366f97d460 msgr2=0x56366fd2e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1995961096 shutdown_connections 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.515+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1995961096 wait complete. 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d7ed3e740 1 -- start start 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d7ed3e740 1 Processor -- start 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f9601b0 0x56366fd40110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f968390 0x56366fd40650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd4c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56366faf7700 con 0x56366f989070 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56366fc31110 con 0x56366f968390 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56366fd430a0 con 0x56366f9601b0 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d7ed3e740 10 client.0 _ll_register_callbacks cb 0x56366fc4a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.516+0000 7f1d75d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd4c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d75d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd4c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34816/0 (socket says 172.21.15.49:34816) 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d75d65640 1 -- 172.21.15.49:0/2939292706 learned_addr learned my addr 172.21.15.49:0/2939292706 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d75d65640 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f9601b0 0x56366fd40110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d76566640 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f968390 0x56366fd40650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d75d65640 1 -- 172.21.15.49:0/2939292706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f9601b0 msgr2=0x56366fd40110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d75d65640 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f9601b0 0x56366fd40110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d75d65640 1 -- 172.21.15.49:0/2939292706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f968390 msgr2=0x56366fd40650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d75d65640 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f968390 0x56366fd40650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d75d65640 1 -- 172.21.15.49:0/2939292706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366fc5ec40 con 0x56366f989070 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d75d65640 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd4c430 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009900 tx=0x7f1d600052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322dd5c075a201ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2939292706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60051070 con 0x56366f989070 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2939292706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1d600055f0 con 0x56366f989070 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2939292706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d60031d10 con 0x56366f989070 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2939292706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1d6005d050 con 0x56366f989070 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d7ed3e740 10 client.16506 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.517+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2939292706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56366fd4ee50 con 0x56366f989070 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.518+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2939292706 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d60031d10 con 0x56366f989070 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.518+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2939292706 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1d6003d890 con 0x56366f989070 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.518+0000 7f1d7ed3e740 10 client.16506 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.518+0000 7f1d7ed3e740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.518+0000 7f1d7ed3e740 20 client.16506 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.518+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56366f9479f0 0x56366fd521b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.518+0000 7f1d7ed3e740 4 client.16506 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:50.523 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.518+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2939292706 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56366fca8da0 con 0x56366f9479f0 2024-09-21T06:40:50.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.518+0000 7f1d76566640 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56366f9479f0 0x56366fd521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.519+0000 7f1d76566640 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56366f9479f0 0x56366fd521b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c60e0c36705b3d5 server_cookie=8df53fe9089b1182 in_seq=0 out_seq=0 2024-09-21T06:40:50.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.519+0000 7f1d59ffb640 10 client.16506 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.519+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2939292706 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56366fca8da0 con 0x56366f9479f0 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.519+0000 7f1d59ffb640 10 client.16506 handle_command_reply: tid=0 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.519+0000 7f1d7ed3e740 1 client.16506 shutdown 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2939292706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 msgr2=0x56366fd4c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd4c430 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009900 tx=0x7f1d600052e0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2939292706 shutdown_connections 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56366f9479f0 0x56366fd521b0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd4c430 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f968390 0x56366fd40650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d59ffb640 0 client.16506 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2939292706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f9601b0 0x56366fd40110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2939292706 >> 172.21.15.49:0/2939292706 conn(0x56366f97d460 msgr2=0x56366fd337a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2939292706 shutdown_connections 2024-09-21T06:40:50.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2939292706 wait complete. 2024-09-21T06:40:50.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.520+0000 7f1d7ed3e740 20 client.16506 trim_cache size 0 max 16384 2024-09-21T06:40:50.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.537+0000 7f1d7ed3e740 1 Processor -- start 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d7ed3e740 1 -- start start 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd41ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 0x56366fd31d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd2db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d701afde0 con 0x56366f989070 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d701ad6b0 con 0x56366f9601b0 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1d701ab520 con 0x56366f968390 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d75d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd2db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d75d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd2db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34826/0 (socket says 172.21.15.49:34826) 2024-09-21T06:40:50.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d75d65640 1 -- 172.21.15.49:0/1211538479 learned_addr learned my addr 172.21.15.49:0/1211538479 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d76566640 1 --2- 172.21.15.49:0/1211538479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 0x56366fd31d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d75d65640 1 -- 172.21.15.49:0/1211538479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 msgr2=0x56366fd31d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d75d65640 1 --2- 172.21.15.49:0/1211538479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 0x56366fd31d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d75d65640 1 -- 172.21.15.49:0/1211538479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 msgr2=0x56366fd41ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d75d65640 1 --2- 172.21.15.49:0/1211538479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd41ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d75d65640 1 -- 172.21.15.49:0/1211538479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366fd3e610 con 0x56366f989070 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d76566640 1 --2- 172.21.15.49:0/1211538479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 0x56366fd31d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.538+0000 7f1d75d65640 1 --2- 172.21.15.49:0/1211538479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd2db70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1d6002a930 tx=0x7f1d60009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35b7cd1a95514d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d5bfff640 1 -- 172.21.15.49:0/1211538479 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60051040 con 0x56366f989070 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d5bfff640 1 -- 172.21.15.49:0/1211538479 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d60004e60 con 0x56366f989070 2024-09-21T06:40:50.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d5bfff640 1 -- 172.21.15.49:0/1211538479 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60035040 con 0x56366f989070 2024-09-21T06:40:50.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1211538479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 msgr2=0x56366fd2db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/1211538479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd2db70 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1d6002a930 tx=0x7f1d60009560 comp rx=0 tx=0).stop 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1211538479 shutdown_connections 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/1211538479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd2db70 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/1211538479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 0x56366fd31d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/1211538479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd41ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1211538479 >> 172.21.15.49:0/1211538479 conn(0x56366f97d460 msgr2=0x56366fd31680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1211538479 shutdown_connections 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.539+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/1211538479 wait complete. 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d7ed3e740 1 -- start start 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d7ed3e740 1 Processor -- start 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd53110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 0x56366fd53650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d7ed3e740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd53b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1d701abb70 con 0x56366f989070 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1d701acfe0 con 0x56366f9601b0 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d7ed3e740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1d701ac240 con 0x56366f968390 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d7ed3e740 10 client.0 _ll_register_callbacks cb 0x7f1d6c00a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d75d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd53b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d75d65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd53b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34832/0 (socket says 172.21.15.49:34832) 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.540+0000 7f1d75d65640 1 -- 172.21.15.49:0/2620836886 learned_addr learned my addr 172.21.15.49:0/2620836886 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d76566640 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 0x56366fd53650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d75d65640 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd53110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d75d65640 1 -- 172.21.15.49:0/2620836886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 msgr2=0x56366fd53650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d75d65640 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 0x56366fd53650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d75d65640 1 -- 172.21.15.49:0/2620836886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 msgr2=0x56366fd53110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:50.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d75d65640 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd53110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d75d65640 1 -- 172.21.15.49:0/2620836886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366fdbb930 con 0x56366f989070 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d75d65640 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd53b90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x56366fc34750 tx=0x7f1d6003df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b158dad9be89eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2620836886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d60065020 con 0x56366f989070 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2620836886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1d60004bb0 con 0x56366f989070 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.541+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2620836886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1d60004e60 con 0x56366f989070 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2620836886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1d60051070 con 0x56366f989070 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d7ed3e740 10 client.16512 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2620836886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56366fdbca60 con 0x56366f989070 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2620836886 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d60004e60 con 0x56366f989070 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2620836886 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1d6003cad0 con 0x56366f989070 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d7ed3e740 10 client.16512 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d7ed3e740 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d7ed3e740 20 client.16512 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:50.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56366f91cda0 0x56366fdbf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d7ed3e740 4 client.16512 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2620836886 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56366fca4850 con 0x56366f91cda0 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.542+0000 7f1d76566640 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56366f91cda0 0x56366fdbf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d76566640 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56366f91cda0 0x56366fdbf080 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7769801081093900 server_cookie=412272f474c95ff0 in_seq=0 out_seq=0 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d59ffb640 10 client.16512 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d59ffb640 1 -- 172.21.15.49:0/2620836886 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x56366fca4850 con 0x56366f91cda0 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d59ffb640 10 client.16512 handle_command_reply: tid=0 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d7ed3e740 1 client.16512 shutdown 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2620836886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 msgr2=0x56366fd53b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd53b90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x56366fc34750 tx=0x7f1d6003df00 comp rx=0 tx=0).stop 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2620836886 shutdown_connections 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56366f91cda0 0x56366fdbf080 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d59ffb640 0 client.16512 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56366f989070 0x56366fd53b90 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56366f968390 0x56366fd53650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d7ed3e740 1 --2- 172.21.15.49:0/2620836886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56366f9601b0 0x56366fd53110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.543+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2620836886 >> 172.21.15.49:0/2620836886 conn(0x56366f97d460 msgr2=0x56366fd33f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2620836886 shutdown_connections 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d7ed3e740 1 -- 172.21.15.49:0/2620836886 wait complete. 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d7ed3e740 20 client.16512 trim_cache size 0 max 16384 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:40:50.550 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:50.551 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:50.552 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:50.553 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:40:50.554 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:40:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 -- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d5c0b6730 msgr2=0x7f1d5c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d5c0b6730 0x7f1d5c0b8c40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800cfd0 tx=0x7f1d680d0040 comp rx=0 tx=0).stop 2024-09-21T06:40:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 -- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105b90 msgr2=0x7f1d7019fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105b90 0x7f1d7019fd80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800b970 tx=0x7f1d6800bd70 comp rx=0 tx=0).stop 2024-09-21T06:40:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 -- 172.21.15.49:0/3852533931 shutdown_connections 2024-09-21T06:40:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1d5c0b6730 0x7f1d5c0b8c40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1d70105b90 0x7f1d7019fd80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1d70105240 0x7f1d7019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 --2- 172.21.15.49:0/3852533931 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1d70103270 0x7f1d7019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 -- 172.21.15.49:0/3852533931 >> 172.21.15.49:0/3852533931 conn(0x7f1d70079ec0 msgr2=0x7f1d701064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.544+0000 7f1d787ca640 1 -- 172.21.15.49:0/3852533931 shutdown_connections 2024-09-21T06:40:50.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:50.545+0000 7f1d787ca640 1 -- 172.21.15.49:0/3852533931 wait complete. 2024-09-21T06:40:51.400 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:40:51.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:40:51.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:51 smithi098 ceph-mon[34704]: pgmap v445: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T06:40:51.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:51 smithi079 ceph-mon[34346]: pgmap v445: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T06:40:51.702 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:51.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:51 smithi049 ceph-mon[31177]: pgmap v445: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-09-21T06:40:52.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 -- 172.21.15.49:0/763936557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 msgr2=0x7f307c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 --2- 172.21.15.49:0/763936557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 0x7f307c102e70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f3078009900 tx=0x7f307802a410 comp rx=0 tx=0).stop 2024-09-21T06:40:52.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 -- 172.21.15.49:0/763936557 shutdown_connections 2024-09-21T06:40:52.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 --2- 172.21.15.49:0/763936557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c108cf0 0x7f307c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 --2- 172.21.15.49:0/763936557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c1083a0 0x7f307c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 --2- 172.21.15.49:0/763936557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 0x7f307c102e70 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 -- 172.21.15.49:0/763936557 >> 172.21.15.49:0/763936557 conn(0x7f307c079730 msgr2=0x7f307c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 -- 172.21.15.49:0/763936557 shutdown_connections 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 -- 172.21.15.49:0/763936557 wait complete. 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 Processor -- start 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.163+0000 7f3083dab640 1 -- start start 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3083dab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 0x7f307c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3083dab640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c1083a0 0x7f307c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3083dab640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c108cf0 0x7f307c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3083dab640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f307c112960 con 0x7f307c102a60 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3083dab640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f307c1127e0 con 0x7f307c1083a0 2024-09-21T06:40:52.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3083dab640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f307c112ae0 con 0x7f307c108cf0 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081b47640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 0x7f307c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081b47640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 0x7f307c19a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34842/0 (socket says 172.21.15.49:34842) 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081b47640 1 -- 172.21.15.49:0/4293490071 learned_addr learned my addr 172.21.15.49:0/4293490071 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081346640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c1083a0 0x7f307c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3082348640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c108cf0 0x7f307c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081b47640 1 -- 172.21.15.49:0/4293490071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c108cf0 msgr2=0x7f307c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081b47640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c108cf0 0x7f307c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081b47640 1 -- 172.21.15.49:0/4293490071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c1083a0 msgr2=0x7f307c19ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081b47640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c1083a0 0x7f307c19ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081b47640 1 -- 172.21.15.49:0/4293490071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c1a04d0 con 0x7f307c102a60 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.164+0000 7f3081b47640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 0x7f307c19a560 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3078005940 tx=0x7f30780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.165+0000 7f3072ffd640 1 -- 172.21.15.49:0/4293490071 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307803f030 con 0x7f307c102a60 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.165+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c1a0760 con 0x7f307c102a60 2024-09-21T06:40:52.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.165+0000 7f3072ffd640 1 -- 172.21.15.49:0/4293490071 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3078003cb0 con 0x7f307c102a60 2024-09-21T06:40:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.165+0000 7f3072ffd640 1 -- 172.21.15.49:0/4293490071 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078035070 con 0x7f307c102a60 2024-09-21T06:40:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.165+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c1a6f20 con 0x7f307c102a60 2024-09-21T06:40:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.166+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307c102e70 con 0x7f307c102a60 2024-09-21T06:40:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.167+0000 7f3072ffd640 1 -- 172.21.15.49:0/4293490071 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f3078042030 con 0x7f307c102a60 2024-09-21T06:40:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.168+0000 7f3072ffd640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f30680b6680 0x7f30680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.168+0000 7f3081346640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f30680b6680 0x7f30680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.168+0000 7f3072ffd640 1 -- 172.21.15.49:0/4293490071 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f30781082f0 con 0x7f307c102a60 2024-09-21T06:40:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.169+0000 7f3081346640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f30680b6680 0x7f30680b8b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f307c100cc0 tx=0x7f306c00a250 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:52.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.171+0000 7f3072ffd640 1 -- 172.21.15.49:0/4293490071 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30780ce820 con 0x7f307c102a60 2024-09-21T06:40:52.287 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.287 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:127/600: open fd = 3 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:128/600: open fd = 3 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:129/600: open fd = 3 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:130/600: open fd = 3 2024-09-21T06:40:52.288 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:131/600: open fd = 3 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:132/600: open fd = 3 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:133/600: open fd = 3 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:134/600: open fd = 3 2024-09-21T06:40:52.289 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:135/600: open fd = 3 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:136/600: open fd = 3 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:137/600: open fd = 3 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.290 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:138/600: open fd = 3 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:139/600: open fd = 3 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:140/600: open fd = 3 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:141/600: open fd = 3 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.291 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:142/600: open fd = 3 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:143/600: open fd = 3 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:144/600: open fd = 3 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:145/600: open fd = 3 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.292 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:146/600: open fd = 3 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:147/600: open fd = 3 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:148/600: open fd = 3 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:149/600: open fd = 3 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.293 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:150/600: open fd = 3 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:151/600: open fd = 3 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:152/600: open fd = 3 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:153/600: open fd = 3 2024-09-21T06:40:52.294 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:154/600: open fd = 3 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:155/600: open fd = 3 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:156/600: open fd = 3 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.295 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:157/600: open fd = 3 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:158/600: open fd = 3 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:159/600: open fd = 3 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:160/600: open fd = 3 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.296 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:161/600: open fd = 3 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:162/600: open fd = 3 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:163/600: open fd = 3 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:164/600: open fd = 3 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.297 INFO:tasks.workunit.client.0.smithi049.stdout:165/600: open fd = 3 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:166/600: open fd = 3 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:167/600: open fd = 3 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:168/600: open fd = 3 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.298 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:169/600: open fd = 3 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:170/600: open fd = 3 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:171/600: open fd = 3 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:172/600: open fd = 3 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.299 INFO:tasks.workunit.client.0.smithi049.stdout:173/600: open fd = 3 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:174/600: open fd = 3 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:175/600: open fd = 3 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:176/600: open fd = 3 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.300 INFO:tasks.workunit.client.0.smithi049.stdout:177/600: open fd = 3 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:178/600: open fd = 3 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:179/600: open fd = 3 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:180/600: open fd = 3 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:181/600: open fd = 3 2024-09-21T06:40:52.301 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:182/600: open fd = 3 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:183/600: open fd = 3 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:184/600: open fd = 3 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.302 INFO:tasks.workunit.client.0.smithi049.stdout:185/600: open fd = 3 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:186/600: open fd = 3 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:187/600: open fd = 3 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:188/600: open fd = 3 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.303 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:40:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.400+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f307c1a70f0 con 0x7f307c102a60 2024-09-21T06:40:52.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.401+0000 7f3072ffd640 1 -- 172.21.15.49:0/4293490071 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f30780d2c00 con 0x7f307c102a60 2024-09-21T06:40:52.403 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:40:52.403 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:40:52.403 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:40:52.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f30680b6680 msgr2=0x7f30680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f30680b6680 0x7f30680b8b90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f307c100cc0 tx=0x7f306c00a250 comp rx=0 tx=0).stop 2024-09-21T06:40:52.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 msgr2=0x7f307c19a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 0x7f307c19a560 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3078005940 tx=0x7f30780042f0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 shutdown_connections 2024-09-21T06:40:52.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f30680b6680 0x7f30680b8b90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f307c108cf0 0x7f307c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f307c1083a0 0x7f307c19ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 --2- 172.21.15.49:0/4293490071 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f307c102a60 0x7f307c19a560 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.403+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 >> 172.21.15.49:0/4293490071 conn(0x7f307c079730 msgr2=0x7f307c106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:52.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.404+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 shutdown_connections 2024-09-21T06:40:52.406 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:52.404+0000 7f3083dab640 1 -- 172.21.15.49:0/4293490071 wait complete. 2024-09-21T06:40:53.132 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:40:53.390 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:53.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:53 smithi049 ceph-mon[31177]: pgmap v446: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T06:40:53.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:40:53.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:53 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4293490071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:53.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:40:53.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:40:53.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:40:53.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:53 smithi098 ceph-mon[34704]: pgmap v446: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T06:40:53.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:40:53.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:53 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4293490071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:53.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:40:53.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:40:53.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:40:53.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:53 smithi079 ceph-mon[34346]: pgmap v446: 97 pgs: 97 active+clean; 3.7 MiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-09-21T06:40:53.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:40:53.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:53 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4293490071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:53.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:40:53.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:40:53.569 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:40:53.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.851+0000 7f8cb0459640 1 -- 172.21.15.49:0/1274109849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8103b60 msgr2=0x7f8ca8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:53.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.851+0000 7f8cb0459640 1 --2- 172.21.15.49:0/1274109849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8103b60 0x7f8ca8103f70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009900 tx=0x7f8ca402a410 comp rx=0 tx=0).stop 2024-09-21T06:40:53.857 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.851+0000 7f8cb0459640 1 -- 172.21.15.49:0/1274109849 shutdown_connections 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.851+0000 7f8cb0459640 1 --2- 172.21.15.49:0/1274109849 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca8109df0 0x7f8ca8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.851+0000 7f8cb0459640 1 --2- 172.21.15.49:0/1274109849 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca81094a0 0x7f8ca81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.851+0000 7f8cb0459640 1 --2- 172.21.15.49:0/1274109849 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8103b60 0x7f8ca8103f70 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.851+0000 7f8cb0459640 1 -- 172.21.15.49:0/1274109849 >> 172.21.15.49:0/1274109849 conn(0x7f8ca807b850 msgr2=0x7f8ca807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.851+0000 7f8cb0459640 1 -- 172.21.15.49:0/1274109849 shutdown_connections 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.851+0000 7f8cb0459640 1 -- 172.21.15.49:0/1274109849 wait complete. 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cb0459640 1 Processor -- start 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cb0459640 1 -- start start 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cb0459640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca8103b60 0x7f8ca819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cb0459640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca81094a0 0x7f8ca819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cb0459640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8109df0 0x7f8ca819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cb0459640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca8113ab0 con 0x7f8ca8109df0 2024-09-21T06:40:53.858 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cb0459640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca8113930 con 0x7f8ca8103b60 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cb0459640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca8113c30 con 0x7f8ca81094a0 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cae9f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8109df0 0x7f8ca819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cae9f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8109df0 0x7f8ca819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34860/0 (socket says 172.21.15.49:34860) 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.852+0000 7f8cae9f6640 1 -- 172.21.15.49:0/3123084386 learned_addr learned my addr 172.21.15.49:0/3123084386 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca8103b60 0x7f8ca819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca81094a0 0x7f8ca819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cae9f6640 1 -- 172.21.15.49:0/3123084386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca81094a0 msgr2=0x7f8ca819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca81094a0 0x7f8ca819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cae9f6640 1 -- 172.21.15.49:0/3123084386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca8103b60 msgr2=0x7f8ca819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca8103b60 0x7f8ca819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cae9f6640 1 -- 172.21.15.49:0/3123084386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca81a03b0 con 0x7f8ca8109df0 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8109df0 0x7f8ca819fd40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000cce0 tx=0x7f8ca000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8c9b7fe640 1 -- 172.21.15.49:0/3123084386 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca000f450 con 0x7f8ca8109df0 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cb0459640 1 -- 172.21.15.49:0/3123084386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca81a06a0 con 0x7f8ca8109df0 2024-09-21T06:40:53.859 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8c9b7fe640 1 -- 172.21.15.49:0/3123084386 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ca000faa0 con 0x7f8ca8109df0 2024-09-21T06:40:53.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8c9b7fe640 1 -- 172.21.15.49:0/3123084386 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0018b70 con 0x7f8ca8109df0 2024-09-21T06:40:53.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.853+0000 7f8cb0459640 1 -- 172.21.15.49:0/3123084386 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca81a6ec0 con 0x7f8ca8109df0 2024-09-21T06:40:53.860 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.856+0000 7f8cb69cd740 1 Processor -- start 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.856+0000 7f8c9b7fe640 1 -- 172.21.15.49:0/3123084386 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8ca0018d10 con 0x7f8ca8109df0 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.856+0000 7f8cb69cd740 1 -- start start 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab2770070 0x55fab2b176a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b17be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab274f390 0x55fab2b18120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fab2a8dea0 con 0x55fab27471b0 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fab2a7d2d0 con 0x55fab274f390 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fab2a810e0 con 0x55fab2770070 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cae1f5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b17be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cae1f5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b17be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34874/0 (socket says 172.21.15.49:34874) 2024-09-21T06:40:53.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cae1f5640 1 -- 172.21.15.49:0/4188726254 learned_addr learned my addr 172.21.15.49:0/4188726254 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab2770070 0x55fab2b176a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab274f390 0x55fab2b18120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cad9f4640 1 -- 172.21.15.49:0/4188726254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab274f390 msgr2=0x55fab2b18120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab274f390 0x55fab2b18120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cad9f4640 1 -- 172.21.15.49:0/4188726254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 msgr2=0x55fab2b17be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b17be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cad9f4640 1 -- 172.21.15.49:0/4188726254 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fab27db650 con 0x55fab2770070 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b17be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.857+0000 7f8c9b7fe640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8c940b66b0 0x7f8c940b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.858+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab2770070 0x55fab2b176a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c005fd0 tx=0x7f8c9c00c630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2513c904d7961221 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.858+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8c940b66b0 0x7f8c940b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.858+0000 7f8c9b7fe640 1 -- 172.21.15.49:0/3123084386 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8ca00e7b30 con 0x7f8ca8109df0 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.858+0000 7f8c98d9a640 1 -- 172.21.15.49:0/4188726254 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c019030 con 0x55fab2770070 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.858+0000 7f8c98d9a640 1 -- 172.21.15.49:0/4188726254 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c9c0054d0 con 0x55fab2770070 2024-09-21T06:40:53.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.858+0000 7f8c98d9a640 1 -- 172.21.15.49:0/4188726254 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c0114a0 con 0x55fab2770070 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 -- 172.21.15.49:0/4188726254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab2770070 msgr2=0x55fab2b176a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab2770070 0x55fab2b176a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c005fd0 tx=0x7f8c9c00c630 comp rx=0 tx=0).stop 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8c940b66b0 0x7f8c940b8bc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4005e20 tx=0x7f8ca4005db0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 -- 172.21.15.49:0/4188726254 shutdown_connections 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab274f390 0x55fab2b18120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b17be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/4188726254 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab2770070 0x55fab2b176a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 -- 172.21.15.49:0/4188726254 >> 172.21.15.49:0/4188726254 conn(0x55fab2764460 msgr2=0x55fab2b15590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 -- 172.21.15.49:0/4188726254 shutdown_connections 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 -- 172.21.15.49:0/4188726254 wait complete. 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 -- start start 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.859+0000 7f8cb69cd740 1 Processor -- start 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b22ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 0x55fab2b23220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b23760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fab28de700 con 0x55fab27471b0 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fab2a18160 con 0x55fab2770070 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fab2b25e80 con 0x55fab274f390 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cb69cd740 10 client.0 _ll_register_callbacks cb 0x55fab2a319e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae1f5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b22ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae1f5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b22ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34884/0 (socket says 172.21.15.49:34884) 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae1f5640 1 -- 172.21.15.49:0/969003317 learned_addr learned my addr 172.21.15.49:0/969003317 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 0x55fab2b23220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b23760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae1f5640 1 -- 172.21.15.49:0/969003317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 msgr2=0x55fab2b23220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 0x55fab2b23220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae1f5640 1 -- 172.21.15.49:0/969003317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 msgr2=0x55fab2b23760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b23760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae1f5640 1 -- 172.21.15.49:0/969003317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fab2a45c90 con 0x55fab27471b0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b23760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 0x55fab2b23220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b22ce0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4006010 tx=0x7f8ca4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bac54d42f46f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.860+0000 7f8c91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8c91ffb640 1 -- 172.21.15.49:0/969003317 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca404d070 con 0x55fab27471b0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8c91ffb640 1 -- 172.21.15.49:0/969003317 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8ca4005230 con 0x55fab27471b0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8cb69cd740 1 -- 172.21.15.49:0/969003317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c0054d0 con 0x55fab27471b0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8c91ffb640 1 -- 172.21.15.49:0/969003317 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8ca4059050 con 0x55fab27471b0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8cb69cd740 10 client.16530 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8cb69cd740 1 -- 172.21.15.49:0/969003317 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fab2b31ae0 con 0x55fab27471b0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8c91ffb640 1 -- 172.21.15.49:0/969003317 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c9c0054d0 con 0x55fab27471b0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8c91ffb640 1 -- 172.21.15.49:0/969003317 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8ca4003680 con 0x55fab27471b0 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8cb69cd740 10 client.16530 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.861+0000 7f8cb69cd740 10 client.16530 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.862+0000 7f8cb69cd740 20 client.16530 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:53.868 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.862+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55fab272e9f0 0x55fab2b34f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.862+0000 7f8cb69cd740 4 client.16530 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:53.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.862+0000 7f8cb69cd740 1 -- 172.21.15.49:0/969003317 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fab2a8fdf0 con 0x55fab272e9f0 2024-09-21T06:40:53.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.862+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55fab272e9f0 0x55fab2b34f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.862+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55fab272e9f0 0x55fab2b34f30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7fc9c84bb1d4954b server_cookie=6209c62ad73cb497 in_seq=0 out_seq=0 2024-09-21T06:40:53.869 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.862+0000 7f8c91ffb640 10 client.16530 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8c91ffb640 1 -- 172.21.15.49:0/969003317 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fab2a8fdf0 con 0x55fab272e9f0 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8c91ffb640 10 client.16530 handle_command_reply: tid=0 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 client.16530 shutdown 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 -- 172.21.15.49:0/969003317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 msgr2=0x55fab2b22ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b22ce0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4006010 tx=0x7f8ca4009260 comp rx=0 tx=0).stop 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 -- 172.21.15.49:0/969003317 shutdown_connections 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55fab272e9f0 0x55fab2b34f30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b23760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 0x55fab2b23220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.870 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8c91ffb640 0 client.16530 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:40:53.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/969003317 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab27471b0 0x55fab2b22ce0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 -- 172.21.15.49:0/969003317 >> 172.21.15.49:0/969003317 conn(0x55fab2764460 msgr2=0x55fab2b1a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:53.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 -- 172.21.15.49:0/969003317 shutdown_connections 2024-09-21T06:40:53.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 1 -- 172.21.15.49:0/969003317 wait complete. 2024-09-21T06:40:53.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.863+0000 7f8cb69cd740 20 client.16530 trim_cache size 0 max 16384 2024-09-21T06:40:53.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cb69cd740 1 Processor -- start 2024-09-21T06:40:53.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cb69cd740 1 -- start start 2024-09-21T06:40:53.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab27471b0 0x55fab2b24cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.879 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab274f390 0x55fab2b14bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b15100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81b1fa0 con 0x55fab274f390 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81af870 con 0x55fab2770070 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81ad6e0 con 0x55fab27471b0 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cad9f4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab274f390 0x55fab2b14bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cad9f4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab274f390 0x55fab2b14bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34888/0 (socket says 172.21.15.49:34888) 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cad9f4640 1 -- 172.21.15.49:0/1705607968 learned_addr learned my addr 172.21.15.49:0/1705607968 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab27471b0 0x55fab2b24cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b15100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cad9f4640 1 -- 172.21.15.49:0/1705607968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab27471b0 msgr2=0x55fab2b24cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab27471b0 0x55fab2b24cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cad9f4640 1 -- 172.21.15.49:0/1705607968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 msgr2=0x55fab2b15100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b15100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cad9f4640 1 -- 172.21.15.49:0/1705607968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fab2b1a500 con 0x55fab274f390 2024-09-21T06:40:53.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.877+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b15100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:53.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.878+0000 7f8cad9f4640 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab274f390 0x55fab2b14bc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00c420 tx=0x7f8c9c004ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e09520353aad628 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:53.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.878+0000 7f8c93fff640 1 -- 172.21.15.49:0/1705607968 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c02d040 con 0x55fab274f390 2024-09-21T06:40:53.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.878+0000 7f8c93fff640 1 -- 172.21.15.49:0/1705607968 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c9c004450 con 0x55fab274f390 2024-09-21T06:40:53.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.878+0000 7f8c93fff640 1 -- 172.21.15.49:0/1705607968 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c019040 con 0x55fab274f390 2024-09-21T06:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1705607968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab274f390 msgr2=0x55fab2b14bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab274f390 0x55fab2b14bc0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00c420 tx=0x7f8c9c004ae0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1705607968 shutdown_connections 2024-09-21T06:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab2770070 0x55fab2b15100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab274f390 0x55fab2b14bc0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1705607968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab27471b0 0x55fab2b24cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1705607968 >> 172.21.15.49:0/1705607968 conn(0x55fab2764460 msgr2=0x55fab2b2ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1705607968 shutdown_connections 2024-09-21T06:40:53.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1705607968 wait complete. 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 -- start start 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.879+0000 7f8cb69cd740 1 Processor -- start 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab27471b0 0x55fab2b278e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 0x55fab2b27e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cb69cd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab2770070 0x55fab2b9e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81add30 con 0x55fab2770070 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81af1a0 con 0x55fab27471b0 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cb69cd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca81ae400 con 0x55fab274f390 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cb69cd740 10 client.0 _ll_register_callbacks cb 0x7f8ca4005e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae9f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab2770070 0x55fab2b9e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cad9f4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 0x55fab2b27e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae9f6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab2770070 0x55fab2b9e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34900/0 (socket says 172.21.15.49:34900) 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae9f6640 1 -- 172.21.15.49:0/1332688443 learned_addr learned my addr 172.21.15.49:0/1332688443 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab27471b0 0x55fab2b278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae9f6640 1 -- 172.21.15.49:0/1332688443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 msgr2=0x55fab2b27e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 0x55fab2b27e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae9f6640 1 -- 172.21.15.49:0/1332688443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab27471b0 msgr2=0x55fab2b278e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab27471b0 0x55fab2b278e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae9f6640 1 -- 172.21.15.49:0/1332688443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fab2b9ef00 con 0x55fab2770070 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8cae9f6640 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab2770070 0x55fab2b9e8f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000ccb0 tx=0x7f8ca00a98c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96155d42d0e8a3dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8c91ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.880+0000 7f8c91ffb640 1 -- 172.21.15.49:0/1332688443 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00a90d0 con 0x55fab2770070 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8c91ffb640 1 -- 172.21.15.49:0/1332688443 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8ca00acbc0 con 0x55fab2770070 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1332688443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c004450 con 0x55fab2770070 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8c91ffb640 1 -- 172.21.15.49:0/1332688443 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8ca00ad470 con 0x55fab2770070 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cb69cd740 10 client.16536 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1332688443 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fab2ba01e0 con 0x55fab2770070 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8c91ffb640 1 -- 172.21.15.49:0/1332688443 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c9c004450 con 0x55fab2770070 2024-09-21T06:40:53.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8c91ffb640 1 -- 172.21.15.49:0/1332688443 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8ca00a92b0 con 0x55fab2770070 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cb69cd740 10 client.16536 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cb69cd740 10 client.16536 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cb69cd740 20 client.16536 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55fab2703da0 0x55fab2ba29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cb69cd740 4 client.16536 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1332688443 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fab2a8b8a0 con 0x55fab2703da0 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.881+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55fab2703da0 0x55fab2ba29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cae1f5640 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55fab2703da0 0x55fab2ba29c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5d5b77a6cad809e server_cookie=3fae3b2210a08418 in_seq=0 out_seq=0 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8c91ffb640 10 client.16536 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8c91ffb640 1 -- 172.21.15.49:0/1332688443 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fab2a8b8a0 con 0x55fab2703da0 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8c91ffb640 10 client.16536 handle_command_reply: tid=0 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 client.16536 shutdown 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1332688443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab2770070 msgr2=0x55fab2b9e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:53.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab2770070 0x55fab2b9e8f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000ccb0 tx=0x7f8ca00a98c0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1332688443 shutdown_connections 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55fab2703da0 0x55fab2ba29c0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fab2770070 0x55fab2b9e8f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fab274f390 0x55fab2b27e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8c91ffb640 0 client.16536 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 --2- 172.21.15.49:0/1332688443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fab27471b0 0x55fab2b278e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1332688443 >> 172.21.15.49:0/1332688443 conn(0x55fab2764460 msgr2=0x55fab2b1c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1332688443 shutdown_connections 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 1 -- 172.21.15.49:0/1332688443 wait complete. 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.882+0000 7f8cb69cd740 20 client.16536 trim_cache size 0 max 16384 2024-09-21T06:40:53.888 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:40:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 -- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8c940b66b0 msgr2=0x7f8c940b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8c940b66b0 0x7f8c940b8bc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4005e20 tx=0x7f8ca4005db0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 -- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8109df0 msgr2=0x7f8ca819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8109df0 0x7f8ca819fd40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000cce0 tx=0x7f8ca000a620 comp rx=0 tx=0).stop 2024-09-21T06:40:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 -- 172.21.15.49:0/3123084386 shutdown_connections 2024-09-21T06:40:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8c940b66b0 0x7f8c940b8bc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8ca8109df0 0x7f8ca819fd40 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8ca81094a0 0x7f8ca819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 --2- 172.21.15.49:0/3123084386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8ca8103b60 0x7f8ca819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 -- 172.21.15.49:0/3123084386 >> 172.21.15.49:0/3123084386 conn(0x7f8ca807b850 msgr2=0x7f8ca81075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 -- 172.21.15.49:0/3123084386 shutdown_connections 2024-09-21T06:40:53.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:53.883+0000 7f8cb0459640 1 -- 172.21.15.49:0/3123084386 wait complete. 2024-09-21T06:40:54.640 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:40:54.896 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:55.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.384+0000 7f55fd6e5640 1 -- 172.21.15.49:0/3351792867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 msgr2=0x7f55f810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.384+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/3351792867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 0x7f55f810d860 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f55e0009900 tx=0x7f55e002a410 comp rx=0 tx=0).stop 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.384+0000 7f55fd6e5640 1 -- 172.21.15.49:0/3351792867 shutdown_connections 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.384+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/3351792867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f810de20 0x7f55f8110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.384+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/3351792867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 0x7f55f810d860 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.384+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/3351792867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55f81049c0 0x7f55f8104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.384+0000 7f55fd6e5640 1 -- 172.21.15.49:0/3351792867 >> 172.21.15.49:0/3351792867 conn(0x7f55f8079730 msgr2=0x7f55f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.384+0000 7f55fd6e5640 1 -- 172.21.15.49:0/3351792867 shutdown_connections 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.384+0000 7f55fd6e5640 1 -- 172.21.15.49:0/3351792867 wait complete. 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55fd6e5640 1 Processor -- start 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55fd6e5640 1 -- start start 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55fd6e5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55f81049c0 0x7f55f819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55fd6e5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 0x7f55f819aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55fd6e5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f810de20 0x7f55f819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.393 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55fd6e5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8113a80 con 0x7f55f8105310 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55fd6e5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8113900 con 0x7f55f810de20 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55fd6e5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8113c00 con 0x7f55f81049c0 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55ee7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 0x7f55f819aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55ee7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 0x7f55f819aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34920/0 (socket says 172.21.15.49:34920) 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55ee7fc640 1 -- 172.21.15.49:0/4008212352 learned_addr learned my addr 172.21.15.49:0/4008212352 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.385+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55f81049c0 0x7f55f819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55f77fe640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f810de20 0x7f55f819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55ee7fc640 1 -- 172.21.15.49:0/4008212352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55f81049c0 msgr2=0x7f55f819a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55f81049c0 0x7f55f819a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55ee7fc640 1 -- 172.21.15.49:0/4008212352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f810de20 msgr2=0x7f55f819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f810de20 0x7f55f819fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.394 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55ee7fc640 1 -- 172.21.15.49:0/4008212352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f81a04c0 con 0x7f55f8105310 2024-09-21T06:40:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 0x7f55f819aaf0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f55e002a930 tx=0x7f55e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55f4ff9640 1 -- 172.21.15.49:0/4008212352 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e003f030 con 0x7f55f8105310 2024-09-21T06:40:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55f4ff9640 1 -- 172.21.15.49:0/4008212352 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e0003aa0 con 0x7f55f8105310 2024-09-21T06:40:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55fd6e5640 1 -- 172.21.15.49:0/4008212352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f81a0750 con 0x7f55f8105310 2024-09-21T06:40:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55f4ff9640 1 -- 172.21.15.49:0/4008212352 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0035070 con 0x7f55f8105310 2024-09-21T06:40:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.386+0000 7f55fd6e5640 1 -- 172.21.15.49:0/4008212352 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f81a6f10 con 0x7f55f8105310 2024-09-21T06:40:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f5603c59740 1 Processor -- start 2024-09-21T06:40:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f5603c59740 1 -- start start 2024-09-21T06:40:55.395 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f55f4ff9640 1 -- 172.21.15.49:0/4008212352 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f55e0042030 con 0x7f55f8105310 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f5603c59740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de7db6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f5603c59740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 0x5595de7dbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f5603c59740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7dc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f5603c59740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5595de74dea0 con 0x5595de430070 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f5603c59740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5595de73d2d0 con 0x5595de40f390 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f5603c59740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5595de7410e0 con 0x5595de4071b0 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.389+0000 7f55f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de7db6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de7db6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34934/0 (socket says 172.21.15.49:34934) 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f77fe640 1 -- 172.21.15.49:0/3536017584 learned_addr learned my addr 172.21.15.49:0/3536017584 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 0x5595de7dbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f77fe640 1 -- 172.21.15.49:0/3536017584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 msgr2=0x5595de7dbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f77fe640 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 0x5595de7dbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f77fe640 1 -- 172.21.15.49:0/3536017584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 msgr2=0x5595de7dc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f77fe640 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7dc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f77fe640 1 -- 172.21.15.49:0/3536017584 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595de49b650 con 0x5595de430070 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 0x5595de7dbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f77fe640 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de7db6d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009e60 tx=0x7f55f0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=269fd4e0f42356f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55f4ff9640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55e40b6680 0x7f55e40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.390+0000 7f55ed7fa640 1 -- 172.21.15.49:0/3536017584 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0016070 con 0x5595de430070 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.391+0000 7f55ed7fa640 1 -- 172.21.15.49:0/3536017584 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f0004d20 con 0x5595de430070 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.391+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55e40b6680 0x7f55e40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.391+0000 7f55ed7fa640 1 -- 172.21.15.49:0/3536017584 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f0012740 con 0x5595de430070 2024-09-21T06:40:55.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.391+0000 7f55f4ff9640 1 -- 172.21.15.49:0/4008212352 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f55e0107e70 con 0x7f55f8105310 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55e40b6680 0x7f55e40b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5595de7da350 tx=0x7f55e800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 -- 172.21.15.49:0/3536017584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 msgr2=0x5595de7db6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de7db6d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009e60 tx=0x7f55f0010740 comp rx=0 tx=0).stop 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 -- 172.21.15.49:0/3536017584 shutdown_connections 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 0x5595de7dbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 --2- 172.21.15.49:0/3536017584 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de7db6d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 -- 172.21.15.49:0/3536017584 >> 172.21.15.49:0/3536017584 conn(0x5595de424460 msgr2=0x5595de7d95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 -- 172.21.15.49:0/3536017584 shutdown_connections 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 -- 172.21.15.49:0/3536017584 wait complete. 2024-09-21T06:40:55.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 -- start start 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.392+0000 7f5603c59740 1 Processor -- start 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f5603c59740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de4071b0 0x5595de7e6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f5603c59740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de40f390 0x5595de7e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f5603c59740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 0x5595de7f3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f5603c59740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5595de59e700 con 0x5595de40f390 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f5603c59740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5595de6d8160 con 0x5595de4071b0 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f5603c59740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5595de7e9eb0 con 0x5595de430070 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f5603c59740 10 client.0 _ll_register_callbacks cb 0x5595de6f19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55ee7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de40f390 0x5595de7e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55ee7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de40f390 0x5595de7e72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34936/0 (socket says 172.21.15.49:34936) 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55ee7fc640 1 -- 172.21.15.49:0/1453898955 learned_addr learned my addr 172.21.15.49:0/1453898955 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de4071b0 0x5595de7e6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55f77fe640 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 0x5595de7f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55ee7fc640 1 -- 172.21.15.49:0/1453898955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 msgr2=0x5595de7f3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 0x5595de7f3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55ee7fc640 1 -- 172.21.15.49:0/1453898955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de4071b0 msgr2=0x5595de7e6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de4071b0 0x5595de7e6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55ee7fc640 1 -- 172.21.15.49:0/1453898955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595de705c90 con 0x5595de40f390 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de40f390 0x5595de7e72d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f55e0031440 tx=0x7f55e003b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e16fe6cd6d9afcd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.393+0000 7f55de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f55de7fc640 1 -- 172.21.15.49:0/1453898955 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e0049070 con 0x5595de40f390 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f55de7fc640 1 -- 172.21.15.49:0/1453898955 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f55e00c9f10 con 0x5595de40f390 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f5603c59740 1 -- 172.21.15.49:0/1453898955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55f0004d20 con 0x5595de40f390 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f55de7fc640 1 -- 172.21.15.49:0/1453898955 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f55e00cd410 con 0x5595de40f390 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f5603c59740 10 client.16548 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f5603c59740 1 -- 172.21.15.49:0/1453898955 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5595de7f5bc0 con 0x5595de40f390 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f55de7fc640 1 -- 172.21.15.49:0/1453898955 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55f0004d20 con 0x5595de40f390 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f55de7fc640 1 -- 172.21.15.49:0/1453898955 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f55e007d0d0 con 0x5595de40f390 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f5603c59740 10 client.16548 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:55.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f5603c59740 10 client.16548 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f5603c59740 20 client.16548 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f5603c59740 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5595de3ee9f0 0x5595de7f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f5603c59740 4 client.16548 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.394+0000 7f5603c59740 1 -- 172.21.15.49:0/1453898955 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595de74fdf0 con 0x5595de3ee9f0 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.395+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5595de3ee9f0 0x5595de7f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.395+0000 7f55de7fc640 10 client.16548 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.395+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5595de3ee9f0 0x5595de7f9140 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e0f1c866bf772dd server_cookie=f022bd8031070f74 in_seq=0 out_seq=0 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f55de7fc640 1 -- 172.21.15.49:0/1453898955 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595de74fdf0 con 0x5595de3ee9f0 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f55de7fc640 10 client.16548 handle_command_reply: tid=0 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 client.16548 shutdown 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 -- 172.21.15.49:0/1453898955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de40f390 msgr2=0x5595de7e72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de40f390 0x5595de7e72d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f55e0031440 tx=0x7f55e003b6b0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 -- 172.21.15.49:0/1453898955 shutdown_connections 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5595de3ee9f0 0x5595de7f9140 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.404 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 0x5595de7f3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de40f390 0x5595de7e72d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f55de7fc640 0 client.16548 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:40:55.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 --2- 172.21.15.49:0/1453898955 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de4071b0 0x5595de7e6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 -- 172.21.15.49:0/1453898955 >> 172.21.15.49:0/1453898955 conn(0x5595de424460 msgr2=0x5595de7de8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 -- 172.21.15.49:0/1453898955 shutdown_connections 2024-09-21T06:40:55.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 1 -- 172.21.15.49:0/1453898955 wait complete. 2024-09-21T06:40:55.405 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.396+0000 7f5603c59740 20 client.16548 trim_cache size 0 max 16384 2024-09-21T06:40:55.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.409+0000 7f5603c59740 1 Processor -- start 2024-09-21T06:40:55.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.409+0000 7f5603c59740 1 -- start start 2024-09-21T06:40:55.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f5603c59740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de4071b0 0x5595de7e7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f5603c59740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7f3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f5603c59740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 0x5595de7e3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f5603c59740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81afee0 con 0x5595de4071b0 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f5603c59740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81ad7b0 con 0x5595de40f390 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f5603c59740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81ab620 con 0x5595de430070 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de4071b0 0x5595de7e7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de4071b0 0x5595de7e7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34938/0 (socket says 172.21.15.49:34938) 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f6ffd640 1 -- 172.21.15.49:0/1762196034 learned_addr learned my addr 172.21.15.49:0/1762196034 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f77fe640 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 0x5595de7e3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f6ffd640 1 -- 172.21.15.49:0/1762196034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 msgr2=0x5595de7e3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 0x5595de7e3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f6ffd640 1 -- 172.21.15.49:0/1762196034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 msgr2=0x5595de7f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f6ffd640 1 -- 172.21.15.49:0/1762196034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595de7e7870 con 0x5595de4071b0 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.410+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de4071b0 0x5595de7e7250 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x5595de7da020 tx=0x7f55e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd829c531df47a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.411+0000 7f55ecff9640 1 -- 172.21.15.49:0/1762196034 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e802d070 con 0x5595de4071b0 2024-09-21T06:40:55.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.411+0000 7f55ecff9640 1 -- 172.21.15.49:0/1762196034 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e8003c40 con 0x5595de4071b0 2024-09-21T06:40:55.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.411+0000 7f55ecff9640 1 -- 172.21.15.49:0/1762196034 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55e80106a0 con 0x5595de4071b0 2024-09-21T06:40:55.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.411+0000 7f5603c59740 1 -- 172.21.15.49:0/1762196034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de4071b0 msgr2=0x5595de7e7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.411+0000 7f5603c59740 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de4071b0 0x5595de7e7250 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x5595de7da020 tx=0x7f55e8015000 comp rx=0 tx=0).stop 2024-09-21T06:40:55.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 -- 172.21.15.49:0/1762196034 shutdown_connections 2024-09-21T06:40:55.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de430070 0x5595de7e3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 --2- 172.21.15.49:0/1762196034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de4071b0 0x5595de7e7250 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 -- 172.21.15.49:0/1762196034 >> 172.21.15.49:0/1762196034 conn(0x5595de424460 msgr2=0x5595de7e6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 -- 172.21.15.49:0/1762196034 shutdown_connections 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 -- 172.21.15.49:0/1762196034 wait complete. 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 -- start start 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 Processor -- start 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.412+0000 7f5603c59740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 0x5595de7ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f5603c59740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f5603c59740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de85cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f5603c59740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81abc70 con 0x5595de430070 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f5603c59740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81ad0e0 con 0x5595de40f390 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f5603c59740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f55f81ac340 con 0x5595de4071b0 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f5603c59740 10 client.0 _ll_register_callbacks cb 0x7f55e0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de85cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de85cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34944/0 (socket says 172.21.15.49:34944) 2024-09-21T06:40:55.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f77fe640 1 -- 172.21.15.49:0/1615213664 learned_addr learned my addr 172.21.15.49:0/1615213664 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 0x5595de7ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55ee7fc640 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f77fe640 1 -- 172.21.15.49:0/1615213664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 msgr2=0x5595de7ebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f77fe640 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 0x5595de7ebbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f77fe640 1 -- 172.21.15.49:0/1615213664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 msgr2=0x5595de7ec1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f77fe640 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7ec1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f77fe640 1 -- 172.21.15.49:0/1615213664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595de85d1d0 con 0x5595de430070 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55f77fe640 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de85cb60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009e60 tx=0x7f55f0012680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3048a5f821ee9683 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55de7fc640 1 -- 172.21.15.49:0/1615213664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f002b060 con 0x5595de430070 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f55de7fc640 1 -- 172.21.15.49:0/1615213664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f55f0012c00 con 0x5595de430070 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.413+0000 7f5603c59740 1 -- 172.21.15.49:0/1615213664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55e8003c40 con 0x5595de430070 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f55de7fc640 1 -- 172.21.15.49:0/1615213664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f55f0016040 con 0x5595de430070 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f5603c59740 10 client.16554 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:55.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f5603c59740 1 -- 172.21.15.49:0/1615213664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5595de864530 con 0x5595de430070 2024-09-21T06:40:55.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f55de7fc640 1 -- 172.21.15.49:0/1615213664 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55e8003c40 con 0x5595de430070 2024-09-21T06:40:55.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f55de7fc640 1 -- 172.21.15.49:0/1615213664 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f55f000f040 con 0x5595de430070 2024-09-21T06:40:55.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f5603c59740 10 client.16554 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:55.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f5603c59740 10 client.16554 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:40:55.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f5603c59740 20 client.16554 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:55.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f5603c59740 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5595de3c3da0 0x5595de8669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f5603c59740 4 client.16554 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:55.419 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.414+0000 7f5603c59740 1 -- 172.21.15.49:0/1615213664 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5595de74b8a0 con 0x5595de3c3da0 2024-09-21T06:40:55.419 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:55 smithi049 ceph-mon[31177]: pgmap v447: 97 pgs: 97 active+clean; 3.7 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-09-21T06:40:55.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.415+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5595de3c3da0 0x5595de8669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.415+0000 7f55f6ffd640 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5595de3c3da0 0x5595de8669b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f4b5144fe5c09c45 server_cookie=64a97c3cd3928e7c in_seq=0 out_seq=0 2024-09-21T06:40:55.420 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.415+0000 7f55de7fc640 10 client.16554 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.415+0000 7f55de7fc640 1 -- 172.21.15.49:0/1615213664 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5595de74b8a0 con 0x5595de3c3da0 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.415+0000 7f55de7fc640 10 client.16554 handle_command_reply: tid=0 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.415+0000 7f5603c59740 1 client.16554 shutdown 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 -- 172.21.15.49:0/1615213664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 msgr2=0x5595de85cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de85cb60 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f55f0009e60 tx=0x7f55f0012680 comp rx=0 tx=0).stop 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 -- 172.21.15.49:0/1615213664 shutdown_connections 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5595de3c3da0 0x5595de8669b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5595de430070 0x5595de85cb60 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5595de40f390 0x5595de7ec1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 --2- 172.21.15.49:0/1615213664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5595de4071b0 0x5595de7ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 -- 172.21.15.49:0/1615213664 >> 172.21.15.49:0/1615213664 conn(0x5595de424460 msgr2=0x5595de7e8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f55de7fc640 0 client.16554 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 -- 172.21.15.49:0/1615213664 shutdown_connections 2024-09-21T06:40:55.421 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 1 -- 172.21.15.49:0/1615213664 wait complete. 2024-09-21T06:40:55.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f5603c59740 20 client.16554 trim_cache size 0 max 16384 2024-09-21T06:40:55.422 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:40:55.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f55fd6e5640 1 -- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55e40b6680 msgr2=0x7f55e40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.416+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55e40b6680 0x7f55e40b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x5595de7da350 tx=0x7f55e800b390 comp rx=0 tx=0).stop 2024-09-21T06:40:55.422 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 -- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 msgr2=0x7f55f819aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 0x7f55f819aaf0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f55e002a930 tx=0x7f55e0004270 comp rx=0 tx=0).stop 2024-09-21T06:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 -- 172.21.15.49:0/4008212352 shutdown_connections 2024-09-21T06:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f55e40b6680 0x7f55e40b8b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f55f810de20 0x7f55f819fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f55f8105310 0x7f55f819aaf0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 --2- 172.21.15.49:0/4008212352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f55f81049c0 0x7f55f819a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 -- 172.21.15.49:0/4008212352 >> 172.21.15.49:0/4008212352 conn(0x7f55f8079730 msgr2=0x7f55f80ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 -- 172.21.15.49:0/4008212352 shutdown_connections 2024-09-21T06:40:55.423 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:55.417+0000 7f55fd6e5640 1 -- 172.21.15.49:0/4008212352 wait complete. 2024-09-21T06:40:55.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:55 smithi098 ceph-mon[34704]: pgmap v447: 97 pgs: 97 active+clean; 3.7 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-09-21T06:40:55.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:55 smithi079 ceph-mon[34346]: pgmap v447: 97 pgs: 97 active+clean; 3.7 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 14 op/s 2024-09-21T06:40:56.166 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:40:56.431 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.910+0000 7f6ddad16640 1 -- 172.21.15.49:0/3867026102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd4104a30 msgr2=0x7f6dd4104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.910+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3867026102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd4104a30 0x7f6dd4104e40 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009900 tx=0x7f6dc402a410 comp rx=0 tx=0).stop 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.911+0000 7f6ddad16640 1 -- 172.21.15.49:0/3867026102 shutdown_connections 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.911+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3867026102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd410de60 0x7f6dd4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.911+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3867026102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd4105380 0x7f6dd410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.911+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3867026102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd4104a30 0x7f6dd4104e40 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.911+0000 7f6ddad16640 1 -- 172.21.15.49:0/3867026102 >> 172.21.15.49:0/3867026102 conn(0x7f6dd4079760 msgr2=0x7f6dd4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.911+0000 7f6ddad16640 1 -- 172.21.15.49:0/3867026102 shutdown_connections 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.911+0000 7f6ddad16640 1 -- 172.21.15.49:0/3867026102 wait complete. 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.911+0000 7f6ddad16640 1 Processor -- start 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.911+0000 7f6ddad16640 1 -- start start 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6ddad16640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd4104a30 0x7f6dd419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6ddad16640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd4105380 0x7f6dd419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6ddad16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd410de60 0x7f6dd419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6ddad16640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4113b70 con 0x7f6dd410de60 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6ddad16640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41139f0 con 0x7f6dd4105380 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6ddad16640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd4113cf0 con 0x7f6dd4104a30 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd92b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd410de60 0x7f6dd419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd92b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd410de60 0x7f6dd419fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57908/0 (socket says 172.21.15.49:57908) 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd92b3640 1 -- 172.21.15.49:0/3015568684 learned_addr learned my addr 172.21.15.49:0/3015568684 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd4105380 0x7f6dd419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd4104a30 0x7f6dd419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd92b3640 1 -- 172.21.15.49:0/3015568684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd4104a30 msgr2=0x7f6dd419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd92b3640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd4104a30 0x7f6dd419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd92b3640 1 -- 172.21.15.49:0/3015568684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd4105380 msgr2=0x7f6dd419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd92b3640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd4105380 0x7f6dd419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd92b3640 1 -- 172.21.15.49:0/3015568684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd41a0570 con 0x7f6dd410de60 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd92b3640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd410de60 0x7f6dd419fe40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00b970 tx=0x7f6dcc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.912+0000 7f6dd1ffb640 1 -- 172.21.15.49:0/3015568684 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc019070 con 0x7f6dd410de60 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.913+0000 7f6dd1ffb640 1 -- 172.21.15.49:0/3015568684 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dcc014440 con 0x7f6dd410de60 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.913+0000 7f6dd1ffb640 1 -- 172.21.15.49:0/3015568684 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0075d0 con 0x7f6dd410de60 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.913+0000 7f6ddad16640 1 -- 172.21.15.49:0/3015568684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd41a0860 con 0x7f6dd410de60 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.913+0000 7f6ddad16640 1 -- 172.21.15.49:0/3015568684 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd41a6fc0 con 0x7f6dd410de60 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6dd1ffb640 1 -- 172.21.15.49:0/3015568684 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6dcc01c070 con 0x7f6dd410de60 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6de128a740 1 Processor -- start 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6de128a740 1 -- start start 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6de128a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x56531210f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6de128a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 0x56531210f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6de128a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531210fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6de128a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x565312085ea0 con 0x565311d68070 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6de128a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5653120752d0 con 0x565311d47390 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6de128a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5653120790e0 con 0x565311d3f1b0 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x56531210f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x56531210f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57922/0 (socket says 172.21.15.49:57922) 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6dd3fff640 1 -- 172.21.15.49:0/220300698 learned_addr learned my addr 172.21.15.49:0/220300698 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/220300698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 0x56531210f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.916+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/220300698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531210fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd1ffb640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6680 0x7f6dbc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd3fff640 1 -- 172.21.15.49:0/220300698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 msgr2=0x56531210f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/220300698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 0x56531210f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd3fff640 1 -- 172.21.15.49:0/220300698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 msgr2=0x56531210fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/220300698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531210fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd3fff640 1 -- 172.21.15.49:0/220300698 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565311dd3650 con 0x565311d68070 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd92b3640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6680 0x7f6dbc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd1ffb640 1 -- 172.21.15.49:0/3015568684 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6dcc0e6c40 con 0x7f6dd410de60 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/220300698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x56531210f2c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8013890 tx=0x7f6dc800a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84895626970253 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dbaffd640 1 -- 172.21.15.49:0/220300698 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80110d0 con 0x565311d68070 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dbaffd640 1 -- 172.21.15.49:0/220300698 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc8005020 con 0x565311d68070 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dbaffd640 1 -- 172.21.15.49:0/220300698 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8004a00 con 0x565311d68070 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.917+0000 7f6dd92b3640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6680 0x7f6dbc0b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc04f2f0 tx=0x7f6dcc0a7040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.918+0000 7f6de128a740 1 -- 172.21.15.49:0/220300698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 msgr2=0x56531210f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.918+0000 7f6de128a740 1 --2- 172.21.15.49:0/220300698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x56531210f2c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8013890 tx=0x7f6dc800a6e0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.918+0000 7f6de128a740 1 -- 172.21.15.49:0/220300698 shutdown_connections 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.918+0000 7f6de128a740 1 --2- 172.21.15.49:0/220300698 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531210fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.918+0000 7f6de128a740 1 --2- 172.21.15.49:0/220300698 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 0x56531210f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.918+0000 7f6de128a740 1 --2- 172.21.15.49:0/220300698 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x56531210f2c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.918+0000 7f6de128a740 1 -- 172.21.15.49:0/220300698 >> 172.21.15.49:0/220300698 conn(0x565311d5c460 msgr2=0x56531210d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.918+0000 7f6de128a740 1 -- 172.21.15.49:0/220300698 shutdown_connections 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.918+0000 7f6de128a740 1 -- 172.21.15.49:0/220300698 wait complete. 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.919+0000 7f6de128a740 1 -- start start 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.919+0000 7f6de128a740 1 Processor -- start 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.919+0000 7f6de128a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 0x56531211a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.919+0000 7f6de128a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531211aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.919+0000 7f6de128a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x565312126d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.919+0000 7f6de128a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x565311ed6700 con 0x565311d68070 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.919+0000 7f6de128a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x565312010160 con 0x565311d47390 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.919+0000 7f6de128a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56531211da40 con 0x565311d3f1b0 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.919+0000 7f6de128a740 10 client.0 _ll_register_callbacks cb 0x5653120299e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x565312126d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x565312126d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57930/0 (socket says 172.21.15.49:57930) 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 -- 172.21.15.49:0/196779968 learned_addr learned my addr 172.21.15.49:0/196779968 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 0x56531211a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531211aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 -- 172.21.15.49:0/196779968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 msgr2=0x56531211a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 0x56531211a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 -- 172.21.15.49:0/196779968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 msgr2=0x56531211aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531211aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 -- 172.21.15.49:0/196779968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56531203dc90 con 0x565311d68070 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x565312126d60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80113b0 tx=0x7f6dc8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd54146560c40b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6db3fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6db3fff640 1 -- 172.21.15.49:0/196779968 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80048d0 con 0x565311d68070 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6db3fff640 1 -- 172.21.15.49:0/196779968 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6dc8004a70 con 0x565311d68070 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.920+0000 7f6de128a740 1 -- 172.21.15.49:0/196779968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc8005020 con 0x565311d68070 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6db3fff640 1 -- 172.21.15.49:0/196779968 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6dc80051d0 con 0x565311d68070 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6de128a740 10 client.16566 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6de128a740 1 -- 172.21.15.49:0/196779968 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565312129720 con 0x565311d68070 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6db3fff640 1 -- 172.21.15.49:0/196779968 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc8005020 con 0x565311d68070 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6db3fff640 1 -- 172.21.15.49:0/196779968 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6dc801d040 con 0x565311d68070 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6de128a740 10 client.16566 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6de128a740 10 client.16566 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6de128a740 20 client.16566 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6de128a740 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565311d269f0 0x56531212ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6de128a740 4 client.16566 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.921+0000 7f6de128a740 1 -- 172.21.15.49:0/196779968 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565312087df0 con 0x565311d269f0 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.922+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565311d269f0 0x56531212ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.922+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565311d269f0 0x56531212ca80 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69e57d800b907bde server_cookie=ba8207ee73a822f1 in_seq=0 out_seq=0 2024-09-21T06:40:56.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.922+0000 7f6db3fff640 10 client.16566 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6db3fff640 1 -- 172.21.15.49:0/196779968 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x565312087df0 con 0x565311d269f0 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6db3fff640 10 client.16566 handle_command_reply: tid=0 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 client.16566 shutdown 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 -- 172.21.15.49:0/196779968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 msgr2=0x565312126d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x565312126d60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80113b0 tx=0x7f6dc8005740 comp rx=0 tx=0).stop 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 -- 172.21.15.49:0/196779968 shutdown_connections 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565311d269f0 0x56531212ca80 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d68070 0x565312126d60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531211aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 --2- 172.21.15.49:0/196779968 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d3f1b0 0x56531211a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 -- 172.21.15.49:0/196779968 >> 172.21.15.49:0/196779968 conn(0x565311d5c460 msgr2=0x5653121124a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6db3fff640 0 client.16566 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 -- 172.21.15.49:0/196779968 shutdown_connections 2024-09-21T06:40:56.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 1 -- 172.21.15.49:0/196779968 wait complete. 2024-09-21T06:40:56.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.923+0000 7f6de128a740 20 client.16566 trim_cache size 0 max 16384 2024-09-21T06:40:56.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6de128a740 1 Processor -- start 2024-09-21T06:40:56.939 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6de128a740 1 -- start start 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6de128a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312110dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6de128a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d47390 0x56531211c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6de128a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d68070 0x565312126cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6de128a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41b2180 con 0x565311d3f1b0 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6de128a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41afa50 con 0x565311d68070 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6de128a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41ad8c0 con 0x565311d47390 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312110dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312110dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57946/0 (socket says 172.21.15.49:57946) 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd3fff640 1 -- 172.21.15.49:0/3459505298 learned_addr learned my addr 172.21.15.49:0/3459505298 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:56.940 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/3459505298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d47390 0x56531211c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/3459505298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d68070 0x565312126cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd3fff640 1 -- 172.21.15.49:0/3459505298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d47390 msgr2=0x56531211c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/3459505298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d47390 0x56531211c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd3fff640 1 -- 172.21.15.49:0/3459505298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d68070 msgr2=0x565312126cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/3459505298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d68070 0x565312126cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.937+0000 7f6dd3fff640 1 -- 172.21.15.49:0/3459505298 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565312112120 con 0x565311d3f1b0 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.938+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/3459505298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312110dc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8016040 tx=0x7f6dc800add0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaacbaa6398d88c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.938+0000 7f6dba7fc640 1 -- 172.21.15.49:0/3459505298 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8005000 con 0x565311d3f1b0 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.938+0000 7f6dba7fc640 1 -- 172.21.15.49:0/3459505298 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc800ab40 con 0x565311d3f1b0 2024-09-21T06:40:56.941 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.938+0000 7f6dba7fc640 1 -- 172.21.15.49:0/3459505298 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8004b30 con 0x565311d3f1b0 2024-09-21T06:40:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.938+0000 7f6de128a740 1 -- 172.21.15.49:0/3459505298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 msgr2=0x565312110dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.938+0000 7f6de128a740 1 --2- 172.21.15.49:0/3459505298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312110dc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8016040 tx=0x7f6dc800add0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.939+0000 7f6de128a740 1 -- 172.21.15.49:0/3459505298 shutdown_connections 2024-09-21T06:40:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.939+0000 7f6de128a740 1 --2- 172.21.15.49:0/3459505298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d68070 0x565312126cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.939+0000 7f6de128a740 1 --2- 172.21.15.49:0/3459505298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d47390 0x56531211c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.939+0000 7f6de128a740 1 --2- 172.21.15.49:0/3459505298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312110dc0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.939+0000 7f6de128a740 1 -- 172.21.15.49:0/3459505298 >> 172.21.15.49:0/3459505298 conn(0x565311d5c460 msgr2=0x5653121190d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.939+0000 7f6de128a740 1 -- 172.21.15.49:0/3459505298 shutdown_connections 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.939+0000 7f6de128a740 1 -- 172.21.15.49:0/3459505298 wait complete. 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.939+0000 7f6de128a740 1 -- start start 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.939+0000 7f6de128a740 1 Processor -- start 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6de128a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312130270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6de128a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531212d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6de128a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d68070 0x56531212dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6de128a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41adf10 con 0x565311d3f1b0 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6de128a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41af380 con 0x565311d47390 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6de128a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd41ae5e0 con 0x565311d68070 2024-09-21T06:40:56.946 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6de128a740 10 client.0 _ll_register_callbacks cb 0x7f6dc800ad20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312130270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312130270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57958/0 (socket says 172.21.15.49:57958) 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 -- 172.21.15.49:0/517606446 learned_addr learned my addr 172.21.15.49:0/517606446 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d68070 0x56531212dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531212d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 -- 172.21.15.49:0/517606446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d68070 msgr2=0x56531212dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d68070 0x56531212dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 -- 172.21.15.49:0/517606446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 msgr2=0x56531212d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531212d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 -- 172.21.15.49:0/517606446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565312107460 con 0x565311d3f1b0 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531212d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:56.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6dd3fff640 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312130270 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800f5c0 tx=0x7f6dc8005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e980f1ab7af45fba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6db3fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.940+0000 7f6db3fff640 1 -- 172.21.15.49:0/517606446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800f850 con 0x565311d3f1b0 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6db3fff640 1 -- 172.21.15.49:0/517606446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6dc8005370 con 0x565311d3f1b0 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6de128a740 1 -- 172.21.15.49:0/517606446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc800ab40 con 0x565311d3f1b0 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6db3fff640 1 -- 172.21.15.49:0/517606446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6dc8005570 con 0x565311d3f1b0 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6de128a740 10 client.16572 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6de128a740 1 -- 172.21.15.49:0/517606446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x565312196f50 con 0x565311d3f1b0 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6db3fff640 1 -- 172.21.15.49:0/517606446 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc800ab40 con 0x565311d3f1b0 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6db3fff640 1 -- 172.21.15.49:0/517606446 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6dc801d070 con 0x565311d3f1b0 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6de128a740 10 client.16572 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6de128a740 10 client.16572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:56.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6de128a740 20 client.16572 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6de128a740 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565311cfbda0 0x5653121996b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6de128a740 4 client.16572 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6de128a740 1 -- 172.21.15.49:0/517606446 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653120838a0 con 0x565311cfbda0 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.941+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565311cfbda0 0x5653121996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6dd8ab2640 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565311cfbda0 0x5653121996b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7bc4b1f96e232f9 server_cookie=e0d65240aa0e80e8 in_seq=0 out_seq=0 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6db3fff640 10 client.16572 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6db3fff640 1 -- 172.21.15.49:0/517606446 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653120838a0 con 0x565311cfbda0 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6db3fff640 10 client.16572 handle_command_reply: tid=0 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 client.16572 shutdown 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 -- 172.21.15.49:0/517606446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 msgr2=0x565312130270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312130270 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800f5c0 tx=0x7f6dc8005fa0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 -- 172.21.15.49:0/517606446 shutdown_connections 2024-09-21T06:40:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x565311cfbda0 0x5653121996b0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x565311d68070 0x56531212dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6db3fff640 0 client.16572 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x565311d47390 0x56531212d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 --2- 172.21.15.49:0/517606446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x565311d3f1b0 0x565312130270 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 -- 172.21.15.49:0/517606446 >> 172.21.15.49:0/517606446 conn(0x565311d5c460 msgr2=0x5653121190d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 -- 172.21.15.49:0/517606446 shutdown_connections 2024-09-21T06:40:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.942+0000 7f6de128a740 1 -- 172.21.15.49:0/517606446 wait complete. 2024-09-21T06:40:56.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6de128a740 20 client.16572 trim_cache size 0 max 16384 2024-09-21T06:40:56.951 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:40:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 -- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6680 msgr2=0x7f6dbc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6680 0x7f6dbc0b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc04f2f0 tx=0x7f6dcc0a7040 comp rx=0 tx=0).stop 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 -- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd410de60 msgr2=0x7f6dd419fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd410de60 0x7f6dd419fe40 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00b970 tx=0x7f6dcc00be30 comp rx=0 tx=0).stop 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 -- 172.21.15.49:0/3015568684 shutdown_connections 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dbc0b6680 0x7f6dbc0b8b90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6dd410de60 0x7f6dd419fe40 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6dd4105380 0x7f6dd419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 --2- 172.21.15.49:0/3015568684 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6dd4104a30 0x7f6dd419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 -- 172.21.15.49:0/3015568684 >> 172.21.15.49:0/3015568684 conn(0x7f6dd4079760 msgr2=0x7f6dd41068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 -- 172.21.15.49:0/3015568684 shutdown_connections 2024-09-21T06:40:56.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:56.943+0000 7f6ddad16640 1 -- 172.21.15.49:0/3015568684 wait complete. 2024-09-21T06:40:57.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:57 smithi079 ceph-mon[34346]: pgmap v448: 97 pgs: 97 active+clean; 3.7 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:57.575 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:57 smithi049 ceph-mon[31177]: pgmap v448: 97 pgs: 97 active+clean; 3.7 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:57.623 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:57 smithi098 ceph-mon[34704]: pgmap v448: 97 pgs: 97 active+clean; 3.7 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:40:58.744 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:40:58.744 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:40:59.016 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:59.434 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:40:59 smithi049 ceph-mon[31177]: pgmap v449: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T06:40:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.463+0000 7f5a841fc640 1 -- 172.21.15.49:0/170585182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 msgr2=0x7f5a7c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.463+0000 7f5a841fc640 1 --2- 172.21.15.49:0/170585182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 0x7f5a7c10f520 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009ca0 tx=0x7f5a7402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.463+0000 7f5a841fc640 1 -- 172.21.15.49:0/170585182 shutdown_connections 2024-09-21T06:40:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.463+0000 7f5a841fc640 1 --2- 172.21.15.49:0/170585182 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 0x7f5a7c10f520 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.463+0000 7f5a841fc640 1 --2- 172.21.15.49:0/170585182 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a7c1083a0 0x7f5a7c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.463+0000 7f5a841fc640 1 --2- 172.21.15.49:0/170585182 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7c102a60 0x7f5a7c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.463+0000 7f5a841fc640 1 -- 172.21.15.49:0/170585182 >> 172.21.15.49:0/170585182 conn(0x7f5a7c079730 msgr2=0x7f5a7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.463+0000 7f5a841fc640 1 -- 172.21.15.49:0/170585182 shutdown_connections 2024-09-21T06:40:59.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.463+0000 7f5a841fc640 1 -- 172.21.15.49:0/170585182 wait complete. 2024-09-21T06:40:59.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a841fc640 1 Processor -- start 2024-09-21T06:40:59.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a841fc640 1 -- start start 2024-09-21T06:40:59.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a841fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a7c102a60 0x7f5a7c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a841fc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7c1083a0 0x7f5a7c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.467 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a841fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 0x7f5a7c19fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a841fc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c113a80 con 0x7f5a7c108cf0 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a841fc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c113900 con 0x7f5a7c1083a0 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a841fc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c113c00 con 0x7f5a7c102a60 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a82799640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 0x7f5a7c19fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.464+0000 7f5a81797640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7c1083a0 0x7f5a7c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a82799640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 0x7f5a7c19fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57978/0 (socket says 172.21.15.49:57978) 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a82799640 1 -- 172.21.15.49:0/1350298578 learned_addr learned my addr 172.21.15.49:0/1350298578 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a81f98640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a7c102a60 0x7f5a7c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a81797640 1 -- 172.21.15.49:0/1350298578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a7c102a60 msgr2=0x7f5a7c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a81797640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a7c102a60 0x7f5a7c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a81797640 1 -- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 msgr2=0x7f5a7c19fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a81797640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 0x7f5a7c19fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a81797640 1 -- 172.21.15.49:0/1350298578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c1a0380 con 0x7f5a7c1083a0 2024-09-21T06:40:59.468 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a82799640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 0x7f5a7c19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a81797640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7c1083a0 0x7f5a7c19a9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00d6a0 tx=0x7f5a6c00db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a72ffd640 1 -- 172.21.15.49:0/1350298578 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c017070 con 0x7f5a7c1083a0 2024-09-21T06:40:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a841fc640 1 -- 172.21.15.49:0/1350298578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c1a0670 con 0x7f5a7c1083a0 2024-09-21T06:40:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a72ffd640 1 -- 172.21.15.49:0/1350298578 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a6c009820 con 0x7f5a7c1083a0 2024-09-21T06:40:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.465+0000 7f5a72ffd640 1 -- 172.21.15.49:0/1350298578 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c004c40 con 0x7f5a7c1083a0 2024-09-21T06:40:59.469 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.466+0000 7f5a841fc640 1 -- 172.21.15.49:0/1350298578 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c1a6dd0 con 0x7f5a7c1083a0 2024-09-21T06:40:59.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a8a770740 1 Processor -- start 2024-09-21T06:40:59.470 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a8a770740 1 -- start start 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39fa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 0x5590d39fa970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39faeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a8a770740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5590d3970e60 con 0x5590d3632670 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a8a770740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5590d3960290 con 0x5590d3653350 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a8a770740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5590d39640a0 con 0x5590d362a490 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a82799640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a82799640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39fa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:44626/0 (socket says 172.21.15.49:44626) 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a82799640 1 -- 172.21.15.49:0/4069615644 learned_addr learned my addr 172.21.15.49:0/4069615644 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:59.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a81f98640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 0x5590d39fa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.469+0000 7f5a72ffd640 1 -- 172.21.15.49:0/1350298578 <== mon.2 v2:172.21.15.79:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5a6c005220 con 0x7f5a7c1083a0 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a81797640 1 --2- 172.21.15.49:0/4069615644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39faeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a82799640 1 -- 172.21.15.49:0/4069615644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 msgr2=0x5590d39fa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a82799640 1 --2- 172.21.15.49:0/4069615644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 0x5590d39fa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a82799640 1 -- 172.21.15.49:0/4069615644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 msgr2=0x5590d39faeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a82799640 1 --2- 172.21.15.49:0/4069615644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39faeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a82799640 1 -- 172.21.15.49:0/4069615644 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590d36be930 con 0x5590d3653350 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a81f98640 1 --2- 172.21.15.49:0/4069615644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 0x5590d39fa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a82799640 1 --2- 172.21.15.49:0/4069615644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39fa430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a74033040 tx=0x7f5a7402f440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90a79e5e968082bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a67fff640 1 -- 172.21.15.49:0/4069615644 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74031650 con 0x5590d3653350 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a67fff640 1 -- 172.21.15.49:0/4069615644 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a74036040 con 0x5590d3653350 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.470+0000 7f5a67fff640 1 -- 172.21.15.49:0/4069615644 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74004670 con 0x5590d3653350 2024-09-21T06:40:59.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a72ffd640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5a680b6680 0x7f5a680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a81f98640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5a680b6680 0x7f5a680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a72ffd640 1 -- 172.21.15.49:0/1350298578 <== mon.2 v2:172.21.15.79:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f5a6c0e6fc0 con 0x7f5a7c1083a0 2024-09-21T06:40:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a8a770740 1 -- 172.21.15.49:0/4069615644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 msgr2=0x5590d39fa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a81f98640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5a680b6680 0x7f5a680b8b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5590d39f90b0 tx=0x7f5a7800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:59.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a8a770740 1 --2- 172.21.15.49:0/4069615644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39fa430 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5a74033040 tx=0x7f5a7402f440 comp rx=0 tx=0).stop 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a8a770740 1 -- 172.21.15.49:0/4069615644 shutdown_connections 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a8a770740 1 --2- 172.21.15.49:0/4069615644 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39faeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a8a770740 1 --2- 172.21.15.49:0/4069615644 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 0x5590d39fa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a8a770740 1 --2- 172.21.15.49:0/4069615644 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39fa430 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.471+0000 7f5a8a770740 1 -- 172.21.15.49:0/4069615644 >> 172.21.15.49:0/4069615644 conn(0x5590d3647740 msgr2=0x5590d39f8320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.472+0000 7f5a8a770740 1 -- 172.21.15.49:0/4069615644 shutdown_connections 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.472+0000 7f5a8a770740 1 -- 172.21.15.49:0/4069615644 wait complete. 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.472+0000 7f5a8a770740 1 -- start start 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.472+0000 7f5a8a770740 1 Processor -- start 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d362a490 0x5590d3a06050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3632670 0x5590d3a065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3653350 0x5590d3a11d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a8a770740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5590d37c1890 con 0x5590d362a490 2024-09-21T06:40:59.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a8a770740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5590d38fad40 con 0x5590d3632670 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a8a770740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5590d3a08a30 con 0x5590d3653350 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a8a770740 10 client.0 _ll_register_callbacks cb 0x5590d395ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81f98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d362a490 0x5590d3a06050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81f98640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d362a490 0x5590d3a06050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57998/0 (socket says 172.21.15.49:57998) 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81f98640 1 -- 172.21.15.49:0/1251787761 learned_addr learned my addr 172.21.15.49:0/1251787761 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81797640 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3632670 0x5590d3a065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a82799640 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3653350 0x5590d3a11d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81f98640 1 -- 172.21.15.49:0/1251787761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3653350 msgr2=0x5590d3a11d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81f98640 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3653350 0x5590d3a11d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81f98640 1 -- 172.21.15.49:0/1251787761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3632670 msgr2=0x5590d3a065f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81f98640 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3632670 0x5590d3a065f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81f98640 1 -- 172.21.15.49:0/1251787761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590d3a12360 con 0x5590d362a490 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81797640 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3632670 0x5590d3a065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a81f98640 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d362a490 0x5590d3a06050 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5a78003d30 tx=0x7f5a78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eca9119eecf96ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:59.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.473+0000 7f5a657fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a657fa640 1 -- 172.21.15.49:0/1251787761 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7802c060 con 0x5590d362a490 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a657fa640 1 -- 172.21.15.49:0/1251787761 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f5a78017030 con 0x5590d362a490 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a8a770740 1 -- 172.21.15.49:0/1251787761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a74036040 con 0x5590d362a490 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a657fa640 1 -- 172.21.15.49:0/1251787761 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5a78030430 con 0x5590d362a490 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a8a770740 10 client.16584 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a8a770740 1 -- 172.21.15.49:0/1251787761 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590d3a14cf0 con 0x5590d362a490 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a657fa640 1 -- 172.21.15.49:0/1251787761 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a74036040 con 0x5590d362a490 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a657fa640 1 -- 172.21.15.49:0/1251787761 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5a7801c3f0 con 0x5590d362a490 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a8a770740 10 client.16584 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.474+0000 7f5a8a770740 10 client.16584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.475+0000 7f5a8a770740 20 client.16584 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.475+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5590d3611cd0 0x5590d3a18270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.475+0000 7f5a8a770740 4 client.16584 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:59.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.475+0000 7f5a8a770740 1 -- 172.21.15.49:0/1251787761 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590d3972db0 con 0x5590d3611cd0 2024-09-21T06:40:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.475+0000 7f5a81797640 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5590d3611cd0 0x5590d3a18270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.475+0000 7f5a81797640 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5590d3611cd0 0x5590d3a18270 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baf91a18045e9fea server_cookie=b0d5019f1d699789 in_seq=0 out_seq=0 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.475+0000 7f5a657fa640 10 client.16584 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a657fa640 1 -- 172.21.15.49:0/1251787761 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5590d3972db0 con 0x5590d3611cd0 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a657fa640 10 client.16584 handle_command_reply: tid=0 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a8a770740 1 client.16584 shutdown 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a8a770740 1 -- 172.21.15.49:0/1251787761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d362a490 msgr2=0x5590d3a06050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d362a490 0x5590d3a06050 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5a78003d30 tx=0x7f5a78004730 comp rx=0 tx=0).stop 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a8a770740 1 -- 172.21.15.49:0/1251787761 shutdown_connections 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5590d3611cd0 0x5590d3a18270 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3653350 0x5590d3a11d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3632670 0x5590d3a065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a657fa640 0 client.16584 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1251787761 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d362a490 0x5590d3a06050 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.476+0000 7f5a8a770740 1 -- 172.21.15.49:0/1251787761 >> 172.21.15.49:0/1251787761 conn(0x5590d3647740 msgr2=0x5590d39fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:59.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.477+0000 7f5a8a770740 1 -- 172.21.15.49:0/1251787761 shutdown_connections 2024-09-21T06:40:59.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.477+0000 7f5a8a770740 1 -- 172.21.15.49:0/1251787761 wait complete. 2024-09-21T06:40:59.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.477+0000 7f5a8a770740 20 client.16584 trim_cache size 0 max 16384 2024-09-21T06:40:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.494+0000 7f5a8a770740 1 Processor -- start 2024-09-21T06:40:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.494+0000 7f5a8a770740 1 -- start start 2024-09-21T06:40:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.494+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 0x5590d3a11c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.494+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39ff540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.494+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39ffa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.494+0000 7f5a8a770740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c1b1f60 con 0x5590d3632670 2024-09-21T06:40:59.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.494+0000 7f5a8a770740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c1af830 con 0x5590d3653350 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.494+0000 7f5a8a770740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c1ad6a0 con 0x5590d362a490 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81797640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81797640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39ff540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58012/0 (socket says 172.21.15.49:58012) 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81797640 1 -- 172.21.15.49:0/1438290813 learned_addr learned my addr 172.21.15.49:0/1438290813 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a82799640 1 --2- 172.21.15.49:0/1438290813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39ffa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81f98640 1 --2- 172.21.15.49:0/1438290813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 0x5590d3a11c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81797640 1 -- 172.21.15.49:0/1438290813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 msgr2=0x5590d3a11c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81797640 1 --2- 172.21.15.49:0/1438290813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 0x5590d3a11c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81797640 1 -- 172.21.15.49:0/1438290813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 msgr2=0x5590d39ffa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81797640 1 --2- 172.21.15.49:0/1438290813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39ffa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81797640 1 -- 172.21.15.49:0/1438290813 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590d39fc720 con 0x5590d3632670 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a81797640 1 --2- 172.21.15.49:0/1438290813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39ff540 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009610 tx=0x7f5a6c0e9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4870bed5a23fbb1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a677fe640 1 -- 172.21.15.49:0/1438290813 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c020040 con 0x5590d3632670 2024-09-21T06:40:59.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a677fe640 1 -- 172.21.15.49:0/1438290813 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a6c0b6810 con 0x5590d3632670 2024-09-21T06:40:59.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.495+0000 7f5a677fe640 1 -- 172.21.15.49:0/1438290813 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0e4970 con 0x5590d3632670 2024-09-21T06:40:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.496+0000 7f5a8a770740 1 -- 172.21.15.49:0/1438290813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 msgr2=0x5590d39ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.496+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1438290813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39ff540 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009610 tx=0x7f5a6c0e9040 comp rx=0 tx=0).stop 2024-09-21T06:40:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.496+0000 7f5a8a770740 1 -- 172.21.15.49:0/1438290813 shutdown_connections 2024-09-21T06:40:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.496+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1438290813 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d3653350 0x5590d39ffa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.496+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1438290813 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3632670 0x5590d39ff540 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.496+0000 7f5a8a770740 1 --2- 172.21.15.49:0/1438290813 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d362a490 0x5590d3a11c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.496+0000 7f5a8a770740 1 -- 172.21.15.49:0/1438290813 >> 172.21.15.49:0/1438290813 conn(0x5590d3647740 msgr2=0x5590d3a046d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.496+0000 7f5a8a770740 1 -- 172.21.15.49:0/1438290813 shutdown_connections 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.496+0000 7f5a8a770740 1 -- 172.21.15.49:0/1438290813 wait complete. 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a8a770740 1 -- start start 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a8a770740 1 Processor -- start 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d362a490 0x5590d3a0acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3632670 0x5590d3a0b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a8a770740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3653350 0x5590d3a0b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a8a770740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c1adcf0 con 0x5590d3653350 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a8a770740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c1af160 con 0x5590d362a490 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a8a770740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c1ae3c0 con 0x5590d3632670 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a8a770740 10 client.0 _ll_register_callbacks cb 0x7f5a7800b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a82799640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3653350 0x5590d3a0b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.497+0000 7f5a82799640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3653350 0x5590d3a0b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58020/0 (socket says 172.21.15.49:58020) 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a82799640 1 -- 172.21.15.49:0/3507676926 learned_addr learned my addr 172.21.15.49:0/3507676926 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a81797640 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3632670 0x5590d3a0b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a81f98640 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d362a490 0x5590d3a0acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a82799640 1 -- 172.21.15.49:0/3507676926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3632670 msgr2=0x5590d3a0b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a82799640 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3632670 0x5590d3a0b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a82799640 1 -- 172.21.15.49:0/3507676926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d362a490 msgr2=0x5590d3a0acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a82799640 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d362a490 0x5590d3a0acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a82799640 1 -- 172.21.15.49:0/3507676926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590d3a87090 con 0x5590d3653350 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a82799640 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3653350 0x5590d3a0b730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009a60 tx=0x7f5a74003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73be3aa3cd329fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a657fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a657fa640 1 -- 172.21.15.49:0/3507676926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74052020 con 0x5590d3653350 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a657fa640 1 -- 172.21.15.49:0/3507676926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f5a7402f660 con 0x5590d3653350 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a8a770740 1 -- 172.21.15.49:0/3507676926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a6c0b6810 con 0x5590d3653350 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.498+0000 7f5a657fa640 1 -- 172.21.15.49:0/3507676926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5a7405d050 con 0x5590d3653350 2024-09-21T06:40:59.503 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a8a770740 10 client.16590 fetch_fsmap learned FSMap version 27 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a8a770740 1 -- 172.21.15.49:0/3507676926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5590d3a88350 con 0x5590d3653350 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a657fa640 1 -- 172.21.15.49:0/3507676926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a6c0b6810 con 0x5590d3653350 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a657fa640 1 -- 172.21.15.49:0/3507676926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5a74044070 con 0x5590d3653350 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a8a770740 10 client.16590 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a8a770740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a8a770740 20 client.16590 populate_metadata read hostname 'smithi049' 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a8a770740 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5590d35e7080 0x5590d3a8a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a8a770740 4 client.16590 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a8a770740 1 -- 172.21.15.49:0/3507676926 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5590d396e860 con 0x5590d35e7080 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.499+0000 7f5a81f98640 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5590d35e7080 0x5590d3a8a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.500+0000 7f5a81f98640 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5590d35e7080 0x5590d3a8a930 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5bbbdc25a62cd73 server_cookie=92ca67b401957825 in_seq=0 out_seq=0 2024-09-21T06:40:59.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.500+0000 7f5a657fa640 10 client.16590 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.501+0000 7f5a657fa640 1 -- 172.21.15.49:0/3507676926 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5590d396e860 con 0x5590d35e7080 2024-09-21T06:40:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.501+0000 7f5a657fa640 10 client.16590 handle_command_reply: tid=0 2024-09-21T06:40:59.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.501+0000 7f5a8a770740 1 client.16590 shutdown 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.501+0000 7f5a8a770740 1 -- 172.21.15.49:0/3507676926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3653350 msgr2=0x5590d3a0b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.501+0000 7f5a8a770740 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3653350 0x5590d3a0b730 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009a60 tx=0x7f5a74003ba0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a8a770740 1 -- 172.21.15.49:0/3507676926 shutdown_connections 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a8a770740 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5590d35e7080 0x5590d3a8a930 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a8a770740 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5590d3653350 0x5590d3a0b730 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a8a770740 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5590d3632670 0x5590d3a0b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a8a770740 1 --2- 172.21.15.49:0/3507676926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5590d362a490 0x5590d3a0acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a657fa640 0 client.16590 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a8a770740 1 -- 172.21.15.49:0/3507676926 >> 172.21.15.49:0/3507676926 conn(0x5590d3647740 msgr2=0x5590d39ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a8a770740 1 -- 172.21.15.49:0/3507676926 shutdown_connections 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a8a770740 1 -- 172.21.15.49:0/3507676926 wait complete. 2024-09-21T06:40:59.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a8a770740 20 client.16590 trim_cache size 0 max 16384 2024-09-21T06:40:59.507 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:40:59.507 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:40:59.507 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "762c431b-f378-45a0-941b-80d0b2dfc4da", 2024-09-21T06:40:59.507 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:40:59.507 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a841fc640 1 -- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5a680b6680 msgr2=0x7f5a680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a841fc640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5a680b6680 0x7f5a680b8b90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5590d39f90b0 tx=0x7f5a7800b390 comp rx=0 tx=0).stop 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a841fc640 1 -- 172.21.15.49:0/1350298578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7c1083a0 msgr2=0x7f5a7c19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.502+0000 7f5a841fc640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7c1083a0 0x7f5a7c19a9b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00d6a0 tx=0x7f5a6c00db60 comp rx=0 tx=0).stop 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.503+0000 7f5a841fc640 1 -- 172.21.15.49:0/1350298578 shutdown_connections 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.503+0000 7f5a841fc640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5a680b6680 0x7f5a680b8b90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.503+0000 7f5a841fc640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5a7c108cf0 0x7f5a7c19fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.503+0000 7f5a841fc640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5a7c1083a0 0x7f5a7c19a9b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.503+0000 7f5a841fc640 1 --2- 172.21.15.49:0/1350298578 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5a7c102a60 0x7f5a7c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.503+0000 7f5a841fc640 1 -- 172.21.15.49:0/1350298578 >> 172.21.15.49:0/1350298578 conn(0x7f5a7c079730 msgr2=0x7f5a7c104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:59.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.503+0000 7f5a841fc640 1 -- 172.21.15.49:0/1350298578 shutdown_connections 2024-09-21T06:40:59.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:40:59.503+0000 7f5a841fc640 1 -- 172.21.15.49:0/1350298578 wait complete. 2024-09-21T06:40:59.568 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:40:59 smithi079 ceph-mon[34346]: pgmap v449: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T06:40:59.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:40:59 smithi098 ceph-mon[34704]: pgmap v449: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 16 op/s 2024-09-21T06:41:00.295 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:41:00.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:00 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:41:00.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:00 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:00.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:00 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:41:00.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:00 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:41:00.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:00 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:00.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:00 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:00.554 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:00.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:00 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:41:00.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:00 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:00.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:00 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:41:00.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:00 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:41:00.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:00 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:00.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:00 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:00 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:41:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:00 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:00 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:41:00.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:00 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:41:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:00 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:00.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:00 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 -- 172.21.15.49:0/1102087826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b40109df0 msgr2=0x7f9b40110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 --2- 172.21.15.49:0/1102087826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b40109df0 0x7f9b40110620 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009ca0 tx=0x7f9b3802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 -- 172.21.15.49:0/1102087826 shutdown_connections 2024-09-21T06:41:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 --2- 172.21.15.49:0/1102087826 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b40109df0 0x7f9b40110620 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 --2- 172.21.15.49:0/1102087826 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b401094a0 0x7f9b401098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 --2- 172.21.15.49:0/1102087826 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b40103b60 0x7f9b40103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.052 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 -- 172.21.15.49:0/1102087826 >> 172.21.15.49:0/1102087826 conn(0x7f9b4007b850 msgr2=0x7f9b4007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 -- 172.21.15.49:0/1102087826 shutdown_connections 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 -- 172.21.15.49:0/1102087826 wait complete. 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.036+0000 7f9b4539f640 1 Processor -- start 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b4539f640 1 -- start start 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b4539f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b40103b60 0x7f9b40075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b4539f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b401094a0 0x7f9b40075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b4539f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b40109df0 0x7f9b40076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b4539f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40113ab0 con 0x7f9b401094a0 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b4539f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40113930 con 0x7f9b40103b60 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b4539f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9b40113c30 con 0x7f9b40109df0 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b3e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b401094a0 0x7f9b40075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b3e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b401094a0 0x7f9b40075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58040/0 (socket says 172.21.15.49:58040) 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/3355908054 learned_addr learned my addr 172.21.15.49:0/3355908054 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b3f7fe640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b40109df0 0x7f9b40076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.053 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b3effd640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b40103b60 0x7f9b40075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/3355908054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b40109df0 msgr2=0x7f9b40076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b40109df0 0x7f9b40076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/3355908054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b40103b60 msgr2=0x7f9b40075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.037+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b40103b60 0x7f9b40075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.038+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/3355908054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b401a8700 con 0x7f9b401094a0 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.038+0000 7f9b3effd640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b40103b60 0x7f9b40075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.038+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b401094a0 0x7f9b40075c50 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400d740 tx=0x7f9b3400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.038+0000 7f9b27fff640 1 -- 172.21.15.49:0/3355908054 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34017070 con 0x7f9b401094a0 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.038+0000 7f9b27fff640 1 -- 172.21.15.49:0/3355908054 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b3400de50 con 0x7f9b401094a0 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.038+0000 7f9b4539f640 1 -- 172.21.15.49:0/3355908054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b401a89f0 con 0x7f9b401094a0 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.038+0000 7f9b27fff640 1 -- 172.21.15.49:0/3355908054 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3400f620 con 0x7f9b401094a0 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.038+0000 7f9b4539f640 1 -- 172.21.15.49:0/3355908054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b401a8f30 con 0x7f9b401094a0 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b4b913740 1 Processor -- start 2024-09-21T06:41:01.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b27fff640 1 -- 172.21.15.49:0/3355908054 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9b3401a070 con 0x7f9b401094a0 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b4b913740 1 -- start start 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd55070 0x55650d0fc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d0fc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd34390 0x55650d0fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b4b913740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55650d072e50 con 0x55650cd2c1b0 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b4b913740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55650d062280 con 0x55650cd34390 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b4b913740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55650d066090 con 0x55650cd55070 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b3effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d0fc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b3effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d0fc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58044/0 (socket says 172.21.15.49:58044) 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b3effd640 1 -- 172.21.15.49:0/282650951 learned_addr learned my addr 172.21.15.49:0/282650951 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b3f7fe640 1 --2- 172.21.15.49:0/282650951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd55070 0x55650d0fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/282650951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd34390 0x55650d0fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b3effd640 1 -- 172.21.15.49:0/282650951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd55070 msgr2=0x55650d0fc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.041+0000 7f9b3effd640 1 --2- 172.21.15.49:0/282650951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd55070 0x55650d0fc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b3effd640 1 -- 172.21.15.49:0/282650951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd34390 msgr2=0x55650d0fccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b3effd640 1 --2- 172.21.15.49:0/282650951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd34390 0x55650d0fccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b3effd640 1 -- 172.21.15.49:0/282650951 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55650cdc0650 con 0x55650cd2c1b0 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b27fff640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b280b6680 0x7f9b280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b3f7fe640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b280b6680 0x7f9b280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b3effd640 1 --2- 172.21.15.49:0/282650951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d0fc7b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000bd30 tx=0x7f9b3000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e1e01b76fa3403 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b27fff640 1 -- 172.21.15.49:0/3355908054 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9b340e7170 con 0x7f9b401094a0 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b257fa640 1 -- 172.21.15.49:0/282650951 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30015070 con 0x55650cd2c1b0 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b257fa640 1 -- 172.21.15.49:0/282650951 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b3000be20 con 0x55650cd2c1b0 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.042+0000 7f9b257fa640 1 -- 172.21.15.49:0/282650951 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b300116a0 con 0x55650cd2c1b0 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 -- 172.21.15.49:0/282650951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 msgr2=0x55650d0fc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b3f7fe640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b280b6680 0x7f9b280b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802f500 tx=0x7f9b3802f350 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 --2- 172.21.15.49:0/282650951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d0fc7b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000bd30 tx=0x7f9b3000f730 comp rx=0 tx=0).stop 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 -- 172.21.15.49:0/282650951 shutdown_connections 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 --2- 172.21.15.49:0/282650951 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd34390 0x55650d0fccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 --2- 172.21.15.49:0/282650951 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d0fc7b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 --2- 172.21.15.49:0/282650951 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd55070 0x55650d0fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 -- 172.21.15.49:0/282650951 >> 172.21.15.49:0/282650951 conn(0x55650cd49460 msgr2=0x55650d0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 -- 172.21.15.49:0/282650951 shutdown_connections 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 -- 172.21.15.49:0/282650951 wait complete. 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.043+0000 7f9b4b913740 1 -- start start 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b4b913740 1 Processor -- start 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd2c1b0 0x55650d1079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d107ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd55070 0x55650d113da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b4b913740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55650cec3700 con 0x55650cd34390 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b4b913740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55650cffd110 con 0x55650cd55070 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b4b913740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55650d10aa50 con 0x55650cd2c1b0 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b4b913740 10 client.0 _ll_register_callbacks cb 0x55650d016990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:01.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d107ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d107ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58046/0 (socket says 172.21.15.49:58046) 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/308125737 learned_addr learned my addr 172.21.15.49:0/308125737 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3effd640 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd2c1b0 0x55650d1079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3f7fe640 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd55070 0x55650d113da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/308125737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd2c1b0 msgr2=0x55650d1079a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd2c1b0 0x55650d1079a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/308125737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd55070 msgr2=0x55650d113da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd55070 0x55650d113da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/308125737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55650d02ac40 con 0x55650cd34390 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.044+0000 7f9b3f7fe640 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd55070 0x55650d113da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:01.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d107ee0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009610 tx=0x7f9b340a9720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e38b69ec1da94cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b22ff5640 1 -- 172.21.15.49:0/308125737 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34021030 con 0x55650cd34390 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b22ff5640 1 -- 172.21.15.49:0/308125737 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9b340a88f0 con 0x55650cd34390 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b4b913740 1 -- 172.21.15.49:0/308125737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b3000be20 con 0x55650cd34390 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b22ff5640 1 -- 172.21.15.49:0/308125737 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b340ac8f0 con 0x55650cd34390 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b4b913740 10 client.16602 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b4b913740 1 -- 172.21.15.49:0/308125737 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55650d1167d0 con 0x55650cd34390 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b22ff5640 1 -- 172.21.15.49:0/308125737 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b3000be20 con 0x55650cd34390 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b22ff5640 1 -- 172.21.15.49:0/308125737 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9b340a8af0 con 0x55650cd34390 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b4b913740 10 client.16602 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b4b913740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b4b913740 20 client.16602 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b4b913740 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55650cd139f0 0x55650d119bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b4b913740 4 client.16602 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.045+0000 7f9b4b913740 1 -- 172.21.15.49:0/308125737 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55650d074da0 con 0x55650cd139f0 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.046+0000 7f9b3effd640 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55650cd139f0 0x55650d119bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.046+0000 7f9b3effd640 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55650cd139f0 0x55650d119bf0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5b6f3e165b24f64 server_cookie=e5825eec0e452ce in_seq=0 out_seq=0 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.046+0000 7f9b22ff5640 10 client.16602 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b22ff5640 1 -- 172.21.15.49:0/308125737 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55650d074da0 con 0x55650cd139f0 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b22ff5640 10 client.16602 handle_command_reply: tid=0 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 client.16602 shutdown 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 -- 172.21.15.49:0/308125737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 msgr2=0x55650d107ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d107ee0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009610 tx=0x7f9b340a9720 comp rx=0 tx=0).stop 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 -- 172.21.15.49:0/308125737 shutdown_connections 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55650cd139f0 0x55650d119bf0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd55070 0x55650d113da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d107ee0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b22ff5640 0 client.16602 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 --2- 172.21.15.49:0/308125737 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd2c1b0 0x55650d1079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 -- 172.21.15.49:0/308125737 >> 172.21.15.49:0/308125737 conn(0x55650cd49460 msgr2=0x55650d0ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.047+0000 7f9b4b913740 1 -- 172.21.15.49:0/308125737 shutdown_connections 2024-09-21T06:41:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.048+0000 7f9b4b913740 1 -- 172.21.15.49:0/308125737 wait complete. 2024-09-21T06:41:01.061 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.048+0000 7f9b4b913740 20 client.16602 trim_cache size 0 max 16384 2024-09-21T06:41:01.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.065+0000 7f9b4b913740 1 Processor -- start 2024-09-21T06:41:01.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.065+0000 7f9b4b913740 1 -- start start 2024-09-21T06:41:01.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd139f0 0x55650d107f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd2c1b0 0x55650d0fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d1095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b4b913740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401b4210 con 0x55650cd34390 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b4b913740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401b1ae0 con 0x55650cd2c1b0 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b4b913740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401af950 con 0x55650cd139f0 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d1095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d1095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58062/0 (socket says 172.21.15.49:58062) 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3f7fe640 1 -- 172.21.15.49:0/4286218606 learned_addr learned my addr 172.21.15.49:0/4286218606 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/4286218606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd2c1b0 0x55650d0fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3effd640 1 --2- 172.21.15.49:0/4286218606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd139f0 0x55650d107f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/4286218606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd139f0 msgr2=0x55650d107f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/4286218606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd139f0 0x55650d107f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/4286218606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 msgr2=0x55650d1095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/4286218606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d1095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.066+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/4286218606 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55650d10a0e0 con 0x55650cd2c1b0 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.067+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/4286218606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd2c1b0 0x55650d0fdc60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b340acf30 tx=0x7f9b340b69c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c76a43cf0591cab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.069 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.067+0000 7f9b24ff9640 1 -- 172.21.15.49:0/4286218606 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34021030 con 0x55650cd2c1b0 2024-09-21T06:41:01.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.067+0000 7f9b24ff9640 1 -- 172.21.15.49:0/4286218606 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b34098020 con 0x55650cd2c1b0 2024-09-21T06:41:01.070 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.067+0000 7f9b24ff9640 1 -- 172.21.15.49:0/4286218606 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b340ac710 con 0x55650cd2c1b0 2024-09-21T06:41:01.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.067+0000 7f9b4b913740 1 -- 172.21.15.49:0/4286218606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd2c1b0 msgr2=0x55650d0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.072 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.067+0000 7f9b4b913740 1 --2- 172.21.15.49:0/4286218606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd2c1b0 0x55650d0fdc60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9b340acf30 tx=0x7f9b340b69c0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 -- 172.21.15.49:0/4286218606 shutdown_connections 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 --2- 172.21.15.49:0/4286218606 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd34390 0x55650d1095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 --2- 172.21.15.49:0/4286218606 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd2c1b0 0x55650d0fdc60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 --2- 172.21.15.49:0/4286218606 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd139f0 0x55650d107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 -- 172.21.15.49:0/4286218606 >> 172.21.15.49:0/4286218606 conn(0x55650cd49460 msgr2=0x55650d108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 -- 172.21.15.49:0/4286218606 shutdown_connections 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 -- 172.21.15.49:0/4286218606 wait complete. 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 -- start start 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 Processor -- start 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd139f0 0x55650d10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d10c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd34390 0x55650d183570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401affa0 con 0x55650cd2c1b0 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401b1410 con 0x55650cd139f0 2024-09-21T06:41:01.073 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.068+0000 7f9b4b913740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9b401b0670 con 0x55650cd34390 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b4b913740 10 client.0 _ll_register_callbacks cb 0x7f9b34009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d10c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d10c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58074/0 (socket says 172.21.15.49:58074) 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/1064591246 learned_addr learned my addr 172.21.15.49:0/1064591246 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3effd640 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd139f0 0x55650d10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3f7fe640 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd34390 0x55650d183570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/1064591246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd34390 msgr2=0x55650d183570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd34390 0x55650d183570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/1064591246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd139f0 msgr2=0x55650d10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd139f0 0x55650d10bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3e7fc640 1 -- 172.21.15.49:0/1064591246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55650d10cd70 con 0x55650cd2c1b0 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3effd640 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd139f0 0x55650d10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b3e7fc640 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d10c4d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9b340acca0 tx=0x7f9b340a9720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce549449ec581f86 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b22ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:01.074 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b22ff5640 1 -- 172.21.15.49:0/1064591246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34021070 con 0x55650cd2c1b0 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b22ff5640 1 -- 172.21.15.49:0/1064591246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9b340940c0 con 0x55650cd2c1b0 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.069+0000 7f9b4b913740 1 -- 172.21.15.49:0/1064591246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b34098020 con 0x55650cd2c1b0 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b22ff5640 1 -- 172.21.15.49:0/1064591246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9b340eb020 con 0x55650cd2c1b0 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b4b913740 10 client.16608 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b4b913740 1 -- 172.21.15.49:0/1064591246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55650d184ab0 con 0x55650cd2c1b0 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b22ff5640 1 -- 172.21.15.49:0/1064591246 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b34098020 con 0x55650cd2c1b0 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b22ff5640 1 -- 172.21.15.49:0/1064591246 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9b340d41b0 con 0x55650cd2c1b0 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b4b913740 10 client.16608 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b4b913740 10 client.16608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b4b913740 20 client.16608 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b4b913740 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55650cd55070 0x55650d186ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b4b913740 4 client.16608 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b4b913740 1 -- 172.21.15.49:0/1064591246 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55650d0fa370 con 0x55650cd55070 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.070+0000 7f9b3effd640 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55650cd55070 0x55650d186ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b22ff5640 10 client.16608 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:01.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b3effd640 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55650cd55070 0x55650d186ea0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a19ae8faff61aa server_cookie=aae46d6a4a079b1f in_seq=0 out_seq=0 2024-09-21T06:41:01.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b22ff5640 1 -- 172.21.15.49:0/1064591246 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55650d0fa370 con 0x55650cd55070 2024-09-21T06:41:01.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b22ff5640 10 client.16608 handle_command_reply: tid=0 2024-09-21T06:41:01.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b4b913740 1 client.16608 shutdown 2024-09-21T06:41:01.076 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b4b913740 1 -- 172.21.15.49:0/1064591246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 msgr2=0x55650d10c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b4b913740 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d10c4d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9b340acca0 tx=0x7f9b340a9720 comp rx=0 tx=0).stop 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b4b913740 1 -- 172.21.15.49:0/1064591246 shutdown_connections 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b4b913740 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55650cd55070 0x55650d186ea0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b4b913740 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55650cd34390 0x55650d183570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b4b913740 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55650cd2c1b0 0x55650d10c4d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b4b913740 1 --2- 172.21.15.49:0/1064591246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55650cd139f0 0x55650d10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b22ff5640 0 client.16608 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.071+0000 7f9b4b913740 1 -- 172.21.15.49:0/1064591246 >> 172.21.15.49:0/1064591246 conn(0x55650cd49460 msgr2=0x55650d0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4b913740 1 -- 172.21.15.49:0/1064591246 shutdown_connections 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4b913740 1 -- 172.21.15.49:0/1064591246 wait complete. 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4b913740 20 client.16608 trim_cache size 0 max 16384 2024-09-21T06:41:01.077 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "762c431b-f378-45a0-941b-80d0b2dfc4da", 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:01.078 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:01.079 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:01.080 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:41:01.081 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:41:01.082 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:41:01.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 -- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b280b6680 msgr2=0x7f9b280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b280b6680 0x7f9b280b8b90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9b3802f500 tx=0x7f9b3802f350 comp rx=0 tx=0).stop 2024-09-21T06:41:01.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 -- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b401094a0 msgr2=0x7f9b40075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b401094a0 0x7f9b40075c50 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400d740 tx=0x7f9b3400dc00 comp rx=0 tx=0).stop 2024-09-21T06:41:01.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 -- 172.21.15.49:0/3355908054 shutdown_connections 2024-09-21T06:41:01.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9b280b6680 0x7f9b280b8b90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9b40109df0 0x7f9b40076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9b401094a0 0x7f9b40075c50 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.084 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 --2- 172.21.15.49:0/3355908054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9b40103b60 0x7f9b40075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 -- 172.21.15.49:0/3355908054 >> 172.21.15.49:0/3355908054 conn(0x7f9b4007b850 msgr2=0x7f9b40105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 -- 172.21.15.49:0/3355908054 shutdown_connections 2024-09-21T06:41:01.085 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:01.072+0000 7f9b4539f640 1 -- 172.21.15.49:0/3355908054 wait complete. 2024-09-21T06:41:01.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:01 smithi049 ceph-mon[31177]: pgmap v450: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:41:01.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:01 smithi098 ceph-mon[34704]: pgmap v450: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:41:01.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:01 smithi079 ceph-mon[34346]: pgmap v450: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-09-21T06:41:01.831 INFO:tasks.cephfs.filesystem:scrub status for tag:762c431b-f378-45a0-941b-80d0b2dfc4da - {'path': '/', 'tag': '762c431b-f378-45a0-941b-80d0b2dfc4da', 'options': 'recursive,force'} 2024-09-21T06:41:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.899+0000 7fef98694640 1 -- 172.21.15.49:0/3250063365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef90108c40 msgr2=0x7fef9010f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.899+0000 7fef98694640 1 --2- 172.21.15.49:0/3250063365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef90108c40 0x7fef9010f470 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fef88009ca0 tx=0x7fef8802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.899+0000 7fef98694640 1 -- 172.21.15.49:0/3250063365 shutdown_connections 2024-09-21T06:41:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.899+0000 7fef98694640 1 --2- 172.21.15.49:0/3250063365 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef90108c40 0x7fef9010f470 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.899+0000 7fef98694640 1 --2- 172.21.15.49:0/3250063365 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef901082f0 0x7fef90108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.899+0000 7fef98694640 1 --2- 172.21.15.49:0/3250063365 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef901029c0 0x7fef90102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.899+0000 7fef98694640 1 -- 172.21.15.49:0/3250063365 >> 172.21.15.49:0/3250063365 conn(0x7fef900fe3c0 msgr2=0x7fef90100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.899+0000 7fef98694640 1 -- 172.21.15.49:0/3250063365 shutdown_connections 2024-09-21T06:41:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.899+0000 7fef98694640 1 -- 172.21.15.49:0/3250063365 wait complete. 2024-09-21T06:41:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef98694640 1 Processor -- start 2024-09-21T06:41:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef98694640 1 -- start start 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef98694640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef901029c0 0x7fef9019b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef98694640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef901082f0 0x7fef9019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef98694640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef90108c40 0x7fef9019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef98694640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fef90112900 con 0x7fef901082f0 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef98694640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef90112780 con 0x7fef901029c0 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef98694640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fef90112a80 con 0x7fef90108c40 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef95c2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef901082f0 0x7fef9019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef95c2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef901082f0 0x7fef9019b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58092/0 (socket says 172.21.15.49:58092) 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.900+0000 7fef95c2f640 1 -- 172.21.15.49:0/4290318029 learned_addr learned my addr 172.21.15.49:0/4290318029 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.904 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef96430640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef901029c0 0x7fef9019b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef95c2f640 1 -- 172.21.15.49:0/4290318029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef90108c40 msgr2=0x7fef9019bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef95c2f640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef90108c40 0x7fef9019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef95c2f640 1 -- 172.21.15.49:0/4290318029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef901029c0 msgr2=0x7fef9019b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef95c2f640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef901029c0 0x7fef9019b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef95c2f640 1 -- 172.21.15.49:0/4290318029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef901a6490 con 0x7fef901082f0 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef95c2f640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef901082f0 0x7fef9019b710 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fef8000e9c0 tx=0x7fef8000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef877fe640 1 -- 172.21.15.49:0/4290318029 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8000ccc0 con 0x7fef901082f0 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef877fe640 1 -- 172.21.15.49:0/4290318029 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef800054d0 con 0x7fef901082f0 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef98694640 1 -- 172.21.15.49:0/4290318029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef901a6780 con 0x7fef901082f0 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef877fe640 1 -- 172.21.15.49:0/4290318029 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80010430 con 0x7fef901082f0 2024-09-21T06:41:01.905 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.901+0000 7fef98694640 1 -- 172.21.15.49:0/4290318029 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef901a6c80 con 0x7fef901082f0 2024-09-21T06:41:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef9f604740 1 Processor -- start 2024-09-21T06:41:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef9f604740 1 -- start start 2024-09-21T06:41:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef877fe640 1 -- 172.21.15.49:0/4290318029 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fef80005020 con 0x7fef901082f0 2024-09-21T06:41:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef9f604740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660ef849b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef9f604740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660ef84ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef9f604740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef85430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef9f604740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55660eef96f0 con 0x55660ebbe4d0 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef9f604740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55660eee8b20 con 0x55660ebdf1b0 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef9f604740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55660eeec930 con 0x55660ebb62f0 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef95c2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef85430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef95c2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef85430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58096/0 (socket says 172.21.15.49:58096) 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef95c2f640 1 -- 172.21.15.49:0/493000041 learned_addr learned my addr 172.21.15.49:0/493000041 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.904+0000 7fef96430640 1 --2- 172.21.15.49:0/493000041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660ef84ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef96c31640 1 --2- 172.21.15.49:0/493000041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660ef849b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef95c2f640 1 -- 172.21.15.49:0/493000041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 msgr2=0x55660ef84ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef95c2f640 1 --2- 172.21.15.49:0/493000041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660ef84ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef95c2f640 1 -- 172.21.15.49:0/493000041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 msgr2=0x55660ef849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef95c2f640 1 --2- 172.21.15.49:0/493000041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660ef849b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef95c2f640 1 -- 172.21.15.49:0/493000041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660eeae530 con 0x55660ebbe4d0 2024-09-21T06:41:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef95c2f640 1 --2- 172.21.15.49:0/493000041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef85430 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fef800e52b0 tx=0x7fef800ebd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c870eda73a44855d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef877fe640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fef7c0b6680 0x7fef7c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef96c31640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fef7c0b6680 0x7fef7c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef84bfe640 1 -- 172.21.15.49:0/493000041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef800aa090 con 0x55660ebbe4d0 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef877fe640 1 -- 172.21.15.49:0/4290318029 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fef800e7c10 con 0x7fef901082f0 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef84bfe640 1 -- 172.21.15.49:0/493000041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef800f5070 con 0x55660ebbe4d0 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.905+0000 7fef84bfe640 1 -- 172.21.15.49:0/493000041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef800ad1b0 con 0x55660ebbe4d0 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.906+0000 7fef9f604740 1 -- 172.21.15.49:0/493000041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 msgr2=0x55660ef85430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.906+0000 7fef96c31640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fef7c0b6680 0x7fef7c0b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fef88005e30 tx=0x7fef88005c50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.906+0000 7fef9f604740 1 --2- 172.21.15.49:0/493000041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef85430 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fef800e52b0 tx=0x7fef800ebd50 comp rx=0 tx=0).stop 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.906+0000 7fef9f604740 1 -- 172.21.15.49:0/493000041 shutdown_connections 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.906+0000 7fef9f604740 1 --2- 172.21.15.49:0/493000041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef85430 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.906+0000 7fef9f604740 1 --2- 172.21.15.49:0/493000041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660ef84ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.906+0000 7fef9f604740 1 --2- 172.21.15.49:0/493000041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660ef849b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.906+0000 7fef9f604740 1 -- 172.21.15.49:0/493000041 >> 172.21.15.49:0/493000041 conn(0x55660ebd3300 msgr2=0x55660ef828a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.906+0000 7fef9f604740 1 -- 172.21.15.49:0/493000041 shutdown_connections 2024-09-21T06:41:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 1 -- 172.21.15.49:0/493000041 wait complete. 2024-09-21T06:41:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 1 -- start start 2024-09-21T06:41:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 1 Processor -- start 2024-09-21T06:41:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660ef90080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef905c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660ef9c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55660ee20ab0 con 0x55660ebbe4d0 2024-09-21T06:41:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55660ee8e730 con 0x55660ebdf1b0 2024-09-21T06:41:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55660ef93130 con 0x55660ebb62f0 2024-09-21T06:41:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef9f604740 10 client.0 _ll_register_callbacks cb 0x55660eee26b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.907+0000 7fef95c2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef95c2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef905c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58110/0 (socket says 172.21.15.49:58110) 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef95c2f640 1 -- 172.21.15.49:0/2145551783 learned_addr learned my addr 172.21.15.49:0/2145551783 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef96c31640 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660ef9c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef96430640 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660ef90080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef95c2f640 1 -- 172.21.15.49:0/2145551783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 msgr2=0x55660ef90080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef95c2f640 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660ef90080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef95c2f640 1 -- 172.21.15.49:0/2145551783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 msgr2=0x55660ef9c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef95c2f640 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660ef9c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef95c2f640 1 -- 172.21.15.49:0/2145551783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660ec4a790 con 0x55660ebbe4d0 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef95c2f640 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef905c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fef800e53f0 tx=0x7fef800eba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9089963e2fa987b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef79ffb640 1 -- 172.21.15.49:0/2145551783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef800ad390 con 0x55660ebbe4d0 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef79ffb640 1 -- 172.21.15.49:0/2145551783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fef800b2230 con 0x55660ebbe4d0 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef9f604740 1 -- 172.21.15.49:0/2145551783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef800f5070 con 0x55660ebbe4d0 2024-09-21T06:41:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef79ffb640 1 -- 172.21.15.49:0/2145551783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef800ad580 con 0x55660ebbe4d0 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef9f604740 10 client.16620 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.908+0000 7fef9f604740 1 -- 172.21.15.49:0/2145551783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55660ecc3620 con 0x55660ebbe4d0 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef79ffb640 1 -- 172.21.15.49:0/2145551783 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef800f5070 con 0x55660ebbe4d0 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef79ffb640 1 -- 172.21.15.49:0/2145551783 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fef800a9cb0 con 0x55660ebbe4d0 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef9f604740 10 client.16620 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef9f604740 10 client.16620 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef9f604740 20 client.16620 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef9f604740 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55660eb9dd80 0x55660efa2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef9f604740 4 client.16620 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef9f604740 1 -- 172.21.15.49:0/2145551783 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55660eefb640 con 0x55660eb9dd80 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef96430640 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55660eb9dd80 0x55660efa2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef79ffb640 10 client.16620 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.909+0000 7fef96430640 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55660eb9dd80 0x55660efa2030 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ffb3afe2dd0600f server_cookie=4fe935a7efdfd321 in_seq=0 out_seq=0 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef79ffb640 1 -- 172.21.15.49:0/2145551783 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55660eefb640 con 0x55660eb9dd80 2024-09-21T06:41:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef79ffb640 10 client.16620 handle_command_reply: tid=0 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 client.16620 shutdown 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 -- 172.21.15.49:0/2145551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 msgr2=0x55660ef905c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef905c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fef800e53f0 tx=0x7fef800eba10 comp rx=0 tx=0).stop 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 -- 172.21.15.49:0/2145551783 shutdown_connections 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55660eb9dd80 0x55660efa2030 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660ef9c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660ef905c0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 --2- 172.21.15.49:0/2145551783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660ef90080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef79ffb640 0 client.16620 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 -- 172.21.15.49:0/2145551783 >> 172.21.15.49:0/2145551783 conn(0x55660ebd3300 msgr2=0x55660ef859e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.910+0000 7fef9f604740 1 -- 172.21.15.49:0/2145551783 shutdown_connections 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.911+0000 7fef9f604740 1 -- 172.21.15.49:0/2145551783 wait complete. 2024-09-21T06:41:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.911+0000 7fef9f604740 20 client.16620 trim_cache size 0 max 16384 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef9f604740 1 Processor -- start 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef9f604740 1 -- start start 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef9f604740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebb62f0 0x55660ef9c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef9f604740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebbe4d0 0x55660ef85fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef9f604740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebdf1b0 0x55660ef8d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef9f604740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fef901b2060 con 0x55660ebb62f0 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef9f604740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef901af930 con 0x55660ebbe4d0 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef9f604740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fef901ad7a0 con 0x55660ebdf1b0 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef96430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebb62f0 0x55660ef9c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef96430640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebb62f0 0x55660ef9c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58122/0 (socket says 172.21.15.49:58122) 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.925+0000 7fef96430640 1 -- 172.21.15.49:0/2127309678 learned_addr learned my addr 172.21.15.49:0/2127309678 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef95c2f640 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebbe4d0 0x55660ef85fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef96c31640 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebdf1b0 0x55660ef8d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef96430640 1 -- 172.21.15.49:0/2127309678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebdf1b0 msgr2=0x55660ef8d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef96430640 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebdf1b0 0x55660ef8d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef96430640 1 -- 172.21.15.49:0/2127309678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebbe4d0 msgr2=0x55660ef85fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef96430640 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebbe4d0 0x55660ef85fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef96430640 1 -- 172.21.15.49:0/2127309678 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660ef86cb0 con 0x55660ebb62f0 2024-09-21T06:41:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef96c31640 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebdf1b0 0x55660ef8d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef96430640 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebb62f0 0x55660ef9c3c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x55660eef97e0 tx=0x7fef8c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e007555c82d0ba2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef7bfff640 1 -- 172.21.15.49:0/2127309678 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c005020 con 0x55660ebb62f0 2024-09-21T06:41:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef7bfff640 1 -- 172.21.15.49:0/2127309678 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef8c0047a0 con 0x55660ebb62f0 2024-09-21T06:41:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.926+0000 7fef7bfff640 1 -- 172.21.15.49:0/2127309678 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8c01e7a0 con 0x55660ebb62f0 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 -- 172.21.15.49:0/2127309678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebb62f0 msgr2=0x55660ef9c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebb62f0 0x55660ef9c3c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x55660eef97e0 tx=0x7fef8c012820 comp rx=0 tx=0).stop 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 -- 172.21.15.49:0/2127309678 shutdown_connections 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebdf1b0 0x55660ef8d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebbe4d0 0x55660ef85fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 --2- 172.21.15.49:0/2127309678 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebb62f0 0x55660ef9c3c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 -- 172.21.15.49:0/2127309678 >> 172.21.15.49:0/2127309678 conn(0x55660ebd3300 msgr2=0x55660ef85890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 -- 172.21.15.49:0/2127309678 shutdown_connections 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 -- 172.21.15.49:0/2127309678 wait complete. 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 -- start start 2024-09-21T06:41:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.927+0000 7fef9f604740 1 Processor -- start 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660efa4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660efa4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660f00a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fef901addf0 con 0x55660ebbe4d0 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fef901af260 con 0x55660ebdf1b0 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fef901ae4c0 con 0x55660ebb62f0 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 10 client.0 _ll_register_callbacks cb 0x7fef8c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef95c2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660efa4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef95c2f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660efa4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58132/0 (socket says 172.21.15.49:58132) 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef95c2f640 1 -- 172.21.15.49:0/209914740 learned_addr learned my addr 172.21.15.49:0/209914740 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef96c31640 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660f00a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef96430640 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660efa4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef95c2f640 1 -- 172.21.15.49:0/209914740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 msgr2=0x55660efa4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef95c2f640 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660efa4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef95c2f640 1 -- 172.21.15.49:0/209914740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 msgr2=0x55660f00a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef95c2f640 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660f00a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef95c2f640 1 -- 172.21.15.49:0/209914740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660f00acf0 con 0x55660ebbe4d0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef96c31640 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660f00a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef95c2f640 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660efa4950 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fef800e5940 tx=0x7fef800eb820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81f4e089dff6d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef79ffb640 1 -- 172.21.15.49:0/209914740 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef800ad810 con 0x55660ebbe4d0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef79ffb640 1 -- 172.21.15.49:0/209914740 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fef80016330 con 0x55660ebbe4d0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 1 -- 172.21.15.49:0/209914740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef8c0047a0 con 0x55660ebbe4d0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef79ffb640 1 -- 172.21.15.49:0/209914740 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fef800a9390 con 0x55660ebbe4d0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 10 client.16626 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.928+0000 7fef9f604740 1 -- 172.21.15.49:0/209914740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55660f00bd60 con 0x55660ebbe4d0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.929+0000 7fef79ffb640 1 -- 172.21.15.49:0/209914740 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fef8c0047a0 con 0x55660ebbe4d0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.929+0000 7fef79ffb640 1 -- 172.21.15.49:0/209914740 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fef800b6fd0 con 0x55660ebbe4d0 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.929+0000 7fef9f604740 10 client.16626 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.929+0000 7fef9f604740 10 client.16626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:01.934 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.929+0000 7fef9f604740 20 client.16626 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.929+0000 7fef9f604740 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55660eb731c0 0x55660f00e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.929+0000 7fef9f604740 4 client.16626 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:41:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.929+0000 7fef9f604740 1 -- 172.21.15.49:0/209914740 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55660eef70f0 con 0x55660eb731c0 2024-09-21T06:41:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.929+0000 7fef96430640 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55660eb731c0 0x55660f00e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.930+0000 7fef79ffb640 10 client.16626 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:01.935 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:01.930+0000 7fef96430640 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55660eb731c0 0x55660f00e1e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5ea31180cd4d470 server_cookie=45a448ab32add076 in_seq=0 out_seq=0 2024-09-21T06:41:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef79ffb640 1 -- 172.21.15.49:0/209914740 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55660eef70f0 con 0x55660eb731c0 2024-09-21T06:41:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef79ffb640 10 client.16626 handle_command_reply: tid=0 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 client.16626 shutdown 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 -- 172.21.15.49:0/209914740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 msgr2=0x55660efa4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660efa4950 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fef800e5940 tx=0x7fef800eb820 comp rx=0 tx=0).stop 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 -- 172.21.15.49:0/209914740 shutdown_connections 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55660eb731c0 0x55660f00e1e0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55660ebdf1b0 0x55660f00a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55660ebbe4d0 0x55660efa4950 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 --2- 172.21.15.49:0/209914740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55660ebb62f0 0x55660efa4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 -- 172.21.15.49:0/209914740 >> 172.21.15.49:0/209914740 conn(0x55660ebd3300 msgr2=0x55660ef85890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef79ffb640 0 client.16626 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 -- 172.21.15.49:0/209914740 shutdown_connections 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 1 -- 172.21.15.49:0/209914740 wait complete. 2024-09-21T06:41:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.560+0000 7fef9f604740 20 client.16626 trim_cache size 0 max 16384 2024-09-21T06:41:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:41:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:41:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:41:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:41:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 -- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fef7c0b6680 msgr2=0x7fef7c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fef7c0b6680 0x7fef7c0b8b90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fef88005e30 tx=0x7fef88005c50 comp rx=0 tx=0).stop 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 -- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef901082f0 msgr2=0x7fef9019b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef901082f0 0x7fef9019b710 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fef8000e9c0 tx=0x7fef8000ee80 comp rx=0 tx=0).stop 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 -- 172.21.15.49:0/4290318029 shutdown_connections 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fef7c0b6680 0x7fef7c0b8b90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fef90108c40 0x7fef9019bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fef901082f0 0x7fef9019b710 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 --2- 172.21.15.49:0/4290318029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fef901029c0 0x7fef9019b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 -- 172.21.15.49:0/4290318029 >> 172.21.15.49:0/4290318029 conn(0x7fef900fe3c0 msgr2=0x7fef901068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 -- 172.21.15.49:0/4290318029 shutdown_connections 2024-09-21T06:41:03.564 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:03.561+0000 7fef98694640 1 -- 172.21.15.49:0/4290318029 wait complete. 2024-09-21T06:41:03.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:03 smithi049 ceph-mon[31177]: pgmap v451: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:41:03.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:03 smithi098 ceph-mon[34704]: pgmap v451: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:41:03.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:03 smithi079 ceph-mon[34346]: pgmap v451: 97 pgs: 97 active+clean; 3.8 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-21T06:41:05.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:05 smithi049 ceph-mon[31177]: pgmap v452: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-09-21T06:41:05.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:05 smithi098 ceph-mon[34704]: pgmap v452: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-09-21T06:41:05.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:05 smithi079 ceph-mon[34346]: pgmap v452: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 44 KiB/s wr, 30 op/s 2024-09-21T06:41:07.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:07 smithi049 ceph-mon[31177]: pgmap v453: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 KiB/s wr, 27 op/s 2024-09-21T06:41:07.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:07 smithi098 ceph-mon[34704]: pgmap v453: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 KiB/s wr, 27 op/s 2024-09-21T06:41:07.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:07 smithi079 ceph-mon[34346]: pgmap v453: 97 pgs: 97 active+clean; 3.9 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 38 KiB/s wr, 27 op/s 2024-09-21T06:41:09.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:09 smithi049 ceph-mon[31177]: pgmap v454: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 32 op/s 2024-09-21T06:41:09.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:09 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:41:09.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:09 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:41:09.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:09 smithi098 ceph-mon[34704]: pgmap v454: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 32 op/s 2024-09-21T06:41:09.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:09 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:41:09.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:09 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:41:09.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:09 smithi079 ceph-mon[34346]: pgmap v454: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 32 op/s 2024-09-21T06:41:09.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:09 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:41:09.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:09 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:41:11.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:11 smithi049 ceph-mon[31177]: pgmap v455: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 KiB/s wr, 27 op/s 2024-09-21T06:41:11.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:11 smithi098 ceph-mon[34704]: pgmap v455: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 KiB/s wr, 27 op/s 2024-09-21T06:41:11.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:11 smithi079 ceph-mon[34346]: pgmap v455: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 40 KiB/s wr, 27 op/s 2024-09-21T06:41:13.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:13 smithi049 ceph-mon[31177]: pgmap v456: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 KiB/s wr, 29 op/s 2024-09-21T06:41:13.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:13 smithi098 ceph-mon[34704]: pgmap v456: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 KiB/s wr, 29 op/s 2024-09-21T06:41:13.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:13 smithi079 ceph-mon[34346]: pgmap v456: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 42 KiB/s wr, 29 op/s 2024-09-21T06:41:15.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:15 smithi049 ceph-mon[31177]: pgmap v457: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 46 KiB/s wr, 30 op/s 2024-09-21T06:41:15.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:15 smithi098 ceph-mon[34704]: pgmap v457: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 46 KiB/s wr, 30 op/s 2024-09-21T06:41:15.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:15 smithi079 ceph-mon[34346]: pgmap v457: 97 pgs: 97 active+clean; 4.0 MiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 46 KiB/s wr, 30 op/s 2024-09-21T06:41:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.680+0000 7f8f57757640 1 -- 172.21.15.49:0/4272642013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f501082f0 msgr2=0x7f8f50108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.680+0000 7f8f57757640 1 --2- 172.21.15.49:0/4272642013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f501082f0 0x7f8f50108700 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009900 tx=0x7f8f4002a410 comp rx=0 tx=0).stop 2024-09-21T06:41:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.680+0000 7f8f57757640 1 -- 172.21.15.49:0/4272642013 shutdown_connections 2024-09-21T06:41:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.680+0000 7f8f57757640 1 --2- 172.21.15.49:0/4272642013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f50108c40 0x7f8f5010f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.680+0000 7f8f57757640 1 --2- 172.21.15.49:0/4272642013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f501082f0 0x7f8f50108700 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.680+0000 7f8f57757640 1 --2- 172.21.15.49:0/4272642013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f501029c0 0x7f8f50102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.680+0000 7f8f57757640 1 -- 172.21.15.49:0/4272642013 >> 172.21.15.49:0/4272642013 conn(0x7f8f500fe3c0 msgr2=0x7f8f50100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.680+0000 7f8f57757640 1 -- 172.21.15.49:0/4272642013 shutdown_connections 2024-09-21T06:41:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.680+0000 7f8f57757640 1 -- 172.21.15.49:0/4272642013 wait complete. 2024-09-21T06:41:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f57757640 1 Processor -- start 2024-09-21T06:41:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f57757640 1 -- start start 2024-09-21T06:41:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f57757640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f501029c0 0x7f8f50199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f57757640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f501082f0 0x7f8f501998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f57757640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50108c40 0x7f8f5019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f57757640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50112900 con 0x7f8f50108c40 2024-09-21T06:41:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f57757640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50112780 con 0x7f8f501082f0 2024-09-21T06:41:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f57757640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50112a80 con 0x7f8f501029c0 2024-09-21T06:41:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f55cf4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50108c40 0x7f8f5019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f55cf4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50108c40 0x7f8f5019eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39018/0 (socket says 172.21.15.49:39018) 2024-09-21T06:41:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f55cf4640 1 -- 172.21.15.49:0/2121303567 learned_addr learned my addr 172.21.15.49:0/2121303567 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f554f3640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f501029c0 0x7f8f50199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.681+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f501082f0 0x7f8f501998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f55cf4640 1 -- 172.21.15.49:0/2121303567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f501029c0 msgr2=0x7f8f50199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f55cf4640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f501029c0 0x7f8f50199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f55cf4640 1 -- 172.21.15.49:0/2121303567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f501082f0 msgr2=0x7f8f501998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f55cf4640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f501082f0 0x7f8f501998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f55cf4640 1 -- 172.21.15.49:0/2121303567 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5019f250 con 0x7f8f50108c40 2024-09-21T06:41:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f501082f0 0x7f8f501998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f55cf4640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50108c40 0x7f8f5019eb50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800eaa0 tx=0x7f8f4800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f467fc640 1 -- 172.21.15.49:0/2121303567 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800cdb0 con 0x7f8f50108c40 2024-09-21T06:41:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f467fc640 1 -- 172.21.15.49:0/2121303567 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f48005020 con 0x7f8f50108c40 2024-09-21T06:41:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f57757640 1 -- 172.21.15.49:0/2121303567 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f5019f540 con 0x7f8f50108c40 2024-09-21T06:41:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f467fc640 1 -- 172.21.15.49:0/2121303567 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f480116d0 con 0x7f8f50108c40 2024-09-21T06:41:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.682+0000 7f8f57757640 1 -- 172.21.15.49:0/2121303567 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f501a5cd0 con 0x7f8f50108c40 2024-09-21T06:41:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.685+0000 7f8f467fc640 1 -- 172.21.15.49:0/2121303567 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8f480051d0 con 0x7f8f50108c40 2024-09-21T06:41:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.685+0000 7f8f5e6c6740 1 Processor -- start 2024-09-21T06:41:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.685+0000 7f8f5e6c6740 1 -- start start 2024-09-21T06:41:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.685+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4541b0 0x55c89b7f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.685+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b42b2f0 0x55c89b7f9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.685+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b7fa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.685+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c89b76e6f0 con 0x55c89b42b2f0 2024-09-21T06:41:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.685+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c89b75db20 con 0x55c89b4541b0 2024-09-21T06:41:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.685+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c89b761930 con 0x55c89b4334d0 2024-09-21T06:41:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f554f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b42b2f0 0x55c89b7f9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f554f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b42b2f0 0x55c89b7f9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39034/0 (socket says 172.21.15.49:39034) 2024-09-21T06:41:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f554f3640 1 -- 172.21.15.49:0/3266169390 learned_addr learned my addr 172.21.15.49:0/3266169390 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4541b0 0x55c89b7f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f467fc640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8f3c0b6700 0x7f8f3c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b7fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.705 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f554f3640 1 -- 172.21.15.49:0/3266169390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 msgr2=0x55c89b7fa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f554f3640 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b7fa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f554f3640 1 -- 172.21.15.49:0/3266169390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4541b0 msgr2=0x55c89b7f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f554f3640 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4541b0 0x55c89b7f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f554f3640 1 -- 172.21.15.49:0/3266169390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c89b723530 con 0x55c89b42b2f0 2024-09-21T06:41:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4541b0 0x55c89b7f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:16.706 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f55cf4640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8f3c0b6700 0x7f8f3c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f467fc640 1 -- 172.21.15.49:0/2121303567 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8f480e7850 con 0x7f8f50108c40 2024-09-21T06:41:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f554f3640 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b42b2f0 0x55c89b7f9ef0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00bd40 tx=0x7f8f4c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cede417187bf63fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f3b7fe640 1 -- 172.21.15.49:0/3266169390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c004230 con 0x55c89b42b2f0 2024-09-21T06:41:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.686+0000 7f8f3b7fe640 1 -- 172.21.15.49:0/3266169390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4c00be30 con 0x55c89b42b2f0 2024-09-21T06:41:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f3b7fe640 1 -- 172.21.15.49:0/3266169390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c01a740 con 0x55c89b42b2f0 2024-09-21T06:41:16.707 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3266169390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b42b2f0 msgr2=0x55c89b7f9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f55cf4640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8f3c0b6700 0x7f8f3c0b8c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8f480ad380 tx=0x7f8f4807a960 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b42b2f0 0x55c89b7f9ef0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00bd40 tx=0x7f8f4c0107a0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3266169390 shutdown_connections 2024-09-21T06:41:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b7fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b42b2f0 0x55c89b7f9ef0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.708 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/3266169390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4541b0 0x55c89b7f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3266169390 >> 172.21.15.49:0/3266169390 conn(0x55c89b448300 msgr2=0x55c89b7f78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3266169390 shutdown_connections 2024-09-21T06:41:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.687+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3266169390 wait complete. 2024-09-21T06:41:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.688+0000 7f8f5e6c6740 1 -- start start 2024-09-21T06:41:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.688+0000 7f8f5e6c6740 1 Processor -- start 2024-09-21T06:41:16.709 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.688+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 0x55c89b807210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.688+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b807750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.688+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b813670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.688+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c89b695ab0 con 0x55c89b4541b0 2024-09-21T06:41:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.688+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c89b703730 con 0x55c89b42b2f0 2024-09-21T06:41:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c89b80a310 con 0x55c89b4334d0 2024-09-21T06:41:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f5e6c6740 10 client.0 _ll_register_callbacks cb 0x55c89b7576b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b813670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b813670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39040/0 (socket says 172.21.15.49:39040) 2024-09-21T06:41:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 -- 172.21.15.49:0/625162428 learned_addr learned my addr 172.21.15.49:0/625162428 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f554f3640 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b807750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 0x55c89b807210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 -- 172.21.15.49:0/625162428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 msgr2=0x55c89b807750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b807750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 -- 172.21.15.49:0/625162428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 msgr2=0x55c89b807210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 0x55c89b807210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 -- 172.21.15.49:0/625162428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c89b4bf790 con 0x55c89b4541b0 2024-09-21T06:41:16.712 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b813670 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8f40005ab0 tx=0x7f8f4002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b119fc4f7dbb404 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.689+0000 7f8f38ff9640 1 -- 172.21.15.49:0/625162428 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40035040 con 0x55c89b4541b0 2024-09-21T06:41:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/625162428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f4c00be30 con 0x55c89b4541b0 2024-09-21T06:41:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f38ff9640 1 -- 172.21.15.49:0/625162428 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8f40005220 con 0x55c89b4541b0 2024-09-21T06:41:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f38ff9640 1 -- 172.21.15.49:0/625162428 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8f4004f050 con 0x55c89b4541b0 2024-09-21T06:41:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f5e6c6740 10 client.16638 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/625162428 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c89b538620 con 0x55c89b4541b0 2024-09-21T06:41:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f38ff9640 1 -- 172.21.15.49:0/625162428 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4c00be30 con 0x55c89b4541b0 2024-09-21T06:41:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f38ff9640 1 -- 172.21.15.49:0/625162428 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8f40047020 con 0x55c89b4541b0 2024-09-21T06:41:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f5e6c6740 10 client.16638 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f5e6c6740 10 client.16638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f5e6c6740 20 client.16638 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c89b412d80 0x55c89b8192a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f5e6c6740 4 client.16638 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/625162428 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c89b770640 con 0x55c89b412d80 2024-09-21T06:41:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.690+0000 7f8f554f3640 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c89b412d80 0x55c89b8192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.691+0000 7f8f554f3640 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c89b412d80 0x55c89b8192a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d74bfe2a1f2bb9d server_cookie=b15ffc0c63bc043f in_seq=0 out_seq=0 2024-09-21T06:41:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.691+0000 7f8f38ff9640 10 client.16638 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f38ff9640 1 -- 172.21.15.49:0/625162428 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c89b770640 con 0x55c89b412d80 2024-09-21T06:41:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f38ff9640 10 client.16638 handle_command_reply: tid=0 2024-09-21T06:41:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 client.16638 shutdown 2024-09-21T06:41:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/625162428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 msgr2=0x55c89b813670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b813670 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8f40005ab0 tx=0x7f8f4002a410 comp rx=0 tx=0).stop 2024-09-21T06:41:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/625162428 shutdown_connections 2024-09-21T06:41:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c89b412d80 0x55c89b8192a0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b813670 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b807750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/625162428 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 0x55c89b807210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f38ff9640 0 client.16638 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/625162428 >> 172.21.15.49:0/625162428 conn(0x55c89b448300 msgr2=0x55c89b7fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/625162428 shutdown_connections 2024-09-21T06:41:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/625162428 wait complete. 2024-09-21T06:41:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.692+0000 7f8f5e6c6740 20 client.16638 trim_cache size 0 max 16384 2024-09-21T06:41:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.707+0000 7f8f5e6c6740 1 Processor -- start 2024-09-21T06:41:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.707+0000 7f8f5e6c6740 1 -- start start 2024-09-21T06:41:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b42b2f0 0x55c89b8076f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4334d0 0x55c89b7f6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b802600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501aff40 con 0x55c89b4541b0 2024-09-21T06:41:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501ad810 con 0x55c89b4334d0 2024-09-21T06:41:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501ab680 con 0x55c89b42b2f0 2024-09-21T06:41:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f54cf2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b802600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f54cf2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b802600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39042/0 (socket says 172.21.15.49:39042) 2024-09-21T06:41:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f54cf2640 1 -- 172.21.15.49:0/3508794311 learned_addr learned my addr 172.21.15.49:0/3508794311 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f54cf2640 1 -- 172.21.15.49:0/3508794311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b42b2f0 msgr2=0x55c89b8076f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/3508794311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b42b2f0 0x55c89b8076f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f54cf2640 1 -- 172.21.15.49:0/3508794311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4334d0 msgr2=0x55c89b7f6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/3508794311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4334d0 0x55c89b7f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f54cf2640 1 -- 172.21.15.49:0/3508794311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c89b806330 con 0x55c89b4541b0 2024-09-21T06:41:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/3508794311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b802600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8f4003d480 tx=0x7f8f40005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff34da41d0faf6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f3affd640 1 -- 172.21.15.49:0/3508794311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40035040 con 0x55c89b4541b0 2024-09-21T06:41:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f3affd640 1 -- 172.21.15.49:0/3508794311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4003d8f0 con 0x55c89b4541b0 2024-09-21T06:41:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.708+0000 7f8f3affd640 1 -- 172.21.15.49:0/3508794311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40005280 con 0x55c89b4541b0 2024-09-21T06:41:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3508794311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 msgr2=0x55c89b802600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/3508794311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b802600 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f8f4003d480 tx=0x7f8f40005d50 comp rx=0 tx=0).stop 2024-09-21T06:41:16.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3508794311 shutdown_connections 2024-09-21T06:41:16.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/3508794311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b802600 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/3508794311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b4334d0 0x55c89b7f6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/3508794311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b42b2f0 0x55c89b8076f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3508794311 >> 172.21.15.49:0/3508794311 conn(0x55c89b448300 msgr2=0x55c89b801ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:16.730 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3508794311 shutdown_connections 2024-09-21T06:41:16.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/3508794311 wait complete. 2024-09-21T06:41:16.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.709+0000 7f8f5e6c6740 1 -- start start 2024-09-21T06:41:16.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f5e6c6740 1 Processor -- start 2024-09-21T06:41:16.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 0x55c89b80fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b80b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.731 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f5e6c6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b80b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501abcd0 con 0x55c89b4541b0 2024-09-21T06:41:16.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501ad140 con 0x55c89b42b2f0 2024-09-21T06:41:16.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f5e6c6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501ac3a0 con 0x55c89b4334d0 2024-09-21T06:41:16.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f5e6c6740 10 client.0 _ll_register_callbacks cb 0x7f8f40009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:16.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f54cf2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b80b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.732 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f54cf2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b80b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:39050/0 (socket says 172.21.15.49:39050) 2024-09-21T06:41:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f54cf2640 1 -- 172.21.15.49:0/694069732 learned_addr learned my addr 172.21.15.49:0/694069732 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.710+0000 7f8f554f3640 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b80b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 0x55c89b80fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f54cf2640 1 -- 172.21.15.49:0/694069732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 msgr2=0x55c89b80b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b80b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.733 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f54cf2640 1 -- 172.21.15.49:0/694069732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 msgr2=0x55c89b80fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 0x55c89b80fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f54cf2640 1 -- 172.21.15.49:0/694069732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c89b80baf0 con 0x55c89b4541b0 2024-09-21T06:41:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f54cf2640 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b80b580 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8f4003d670 tx=0x7f8f40005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98bd1252e7370db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f38ff9640 1 -- 172.21.15.49:0/694069732 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40035070 con 0x55c89b4541b0 2024-09-21T06:41:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f38ff9640 1 -- 172.21.15.49:0/694069732 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f8f40054480 con 0x55c89b4541b0 2024-09-21T06:41:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/694069732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f4003d8f0 con 0x55c89b4541b0 2024-09-21T06:41:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f38ff9640 1 -- 172.21.15.49:0/694069732 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8f40054680 con 0x55c89b4541b0 2024-09-21T06:41:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f5e6c6740 10 client.16644 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/694069732 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c89b883990 con 0x55c89b4541b0 2024-09-21T06:41:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.711+0000 7f8f38ff9640 1 -- 172.21.15.49:0/694069732 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f4003d8f0 con 0x55c89b4541b0 2024-09-21T06:41:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.712+0000 7f8f38ff9640 1 -- 172.21.15.49:0/694069732 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8f40047070 con 0x55c89b4541b0 2024-09-21T06:41:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.712+0000 7f8f5e6c6740 10 client.16644 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.712+0000 7f8f5e6c6740 10 client.16644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.712+0000 7f8f5e6c6740 20 client.16644 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.712+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c89b3e81c0 0x55c89b885f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.712+0000 7f8f5e6c6740 4 client.16644 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:41:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.712+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/694069732 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c89b76c0f0 con 0x55c89b3e81c0 2024-09-21T06:41:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.712+0000 7f8f554f3640 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c89b3e81c0 0x55c89b885f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.713+0000 7f8f38ff9640 10 client.16644 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.713+0000 7f8f554f3640 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c89b3e81c0 0x55c89b885f90 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d9f1e16fc64d7af server_cookie=7d89c3c64902f3e5 in_seq=0 out_seq=0 2024-09-21T06:41:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f38ff9640 1 -- 172.21.15.49:0/694069732 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c89b76c0f0 con 0x55c89b3e81c0 2024-09-21T06:41:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f38ff9640 10 client.16644 handle_command_reply: tid=0 2024-09-21T06:41:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 client.16644 shutdown 2024-09-21T06:41:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/694069732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 msgr2=0x55c89b80b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b80b580 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f8f4003d670 tx=0x7f8f40005c90 comp rx=0 tx=0).stop 2024-09-21T06:41:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/694069732 shutdown_connections 2024-09-21T06:41:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c89b3e81c0 0x55c89b885f90 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c89b4541b0 0x55c89b80b580 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c89b4334d0 0x55c89b80b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.738 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 --2- 172.21.15.49:0/694069732 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c89b42b2f0 0x55c89b80fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f38ff9640 0 client.16644 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/694069732 >> 172.21.15.49:0/694069732 conn(0x55c89b448300 msgr2=0x55c89b7f6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/694069732 shutdown_connections 2024-09-21T06:41:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.720+0000 7f8f5e6c6740 1 -- 172.21.15.49:0/694069732 wait complete. 2024-09-21T06:41:16.739 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f5e6c6740 20 client.16644 trim_cache size 0 max 16384 2024-09-21T06:41:16.740 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:41:16.740 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:41:16.740 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:41:16.740 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:41:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 -- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8f3c0b6700 msgr2=0x7f8f3c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8f3c0b6700 0x7f8f3c0b8c10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8f480ad380 tx=0x7f8f4807a960 comp rx=0 tx=0).stop 2024-09-21T06:41:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 -- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50108c40 msgr2=0x7f8f5019eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50108c40 0x7f8f5019eb50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800eaa0 tx=0x7f8f4800ef60 comp rx=0 tx=0).stop 2024-09-21T06:41:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 -- 172.21.15.49:0/2121303567 shutdown_connections 2024-09-21T06:41:16.742 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8f3c0b6700 0x7f8f3c0b8c10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8f50108c40 0x7f8f5019eb50 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8f501082f0 0x7f8f501998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 --2- 172.21.15.49:0/2121303567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8f501029c0 0x7f8f50199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 -- 172.21.15.49:0/2121303567 >> 172.21.15.49:0/2121303567 conn(0x7f8f500fe3c0 msgr2=0x7f8f501058e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:16.743 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 -- 172.21.15.49:0/2121303567 shutdown_connections 2024-09-21T06:41:16.744 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:16.721+0000 7f8f57757640 1 -- 172.21.15.49:0/2121303567 wait complete. 2024-09-21T06:41:17.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:17 smithi049 ceph-mon[31177]: pgmap v458: 97 pgs: 97 active+clean; 4.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T06:41:17.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:17 smithi098 ceph-mon[34704]: pgmap v458: 97 pgs: 97 active+clean; 4.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T06:41:17.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:17 smithi079 ceph-mon[34346]: pgmap v458: 97 pgs: 97 active+clean; 4.0 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T06:41:19.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:19 smithi049 ceph-mon[31177]: pgmap v459: 97 pgs: 97 active+clean; 4.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-21T06:41:19.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:19 smithi098 ceph-mon[34704]: pgmap v459: 97 pgs: 97 active+clean; 4.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-21T06:41:19.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:19 smithi079 ceph-mon[34346]: pgmap v459: 97 pgs: 97 active+clean; 4.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-21T06:41:21.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:21 smithi049 ceph-mon[31177]: pgmap v460: 97 pgs: 97 active+clean; 4.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-09-21T06:41:21.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:21 smithi098 ceph-mon[34704]: pgmap v460: 97 pgs: 97 active+clean; 4.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-09-21T06:41:21.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:21 smithi079 ceph-mon[34346]: pgmap v460: 97 pgs: 97 active+clean; 4.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-09-21T06:41:23.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:23 smithi049 ceph-mon[31177]: pgmap v461: 97 pgs: 97 active+clean; 4.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-21T06:41:23.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:23 smithi098 ceph-mon[34704]: pgmap v461: 97 pgs: 97 active+clean; 4.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-21T06:41:23.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:23 smithi079 ceph-mon[34346]: pgmap v461: 97 pgs: 97 active+clean; 4.1 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-21T06:41:25.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:25 smithi049 ceph-mon[31177]: pgmap v462: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:41:25.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:25 smithi098 ceph-mon[34704]: pgmap v462: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:41:25.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:25 smithi079 ceph-mon[34346]: pgmap v462: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:41:27.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:27 smithi049 ceph-mon[31177]: pgmap v463: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T06:41:27.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:27 smithi098 ceph-mon[34704]: pgmap v463: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T06:41:27.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:27 smithi079 ceph-mon[34346]: pgmap v463: 97 pgs: 97 active+clean; 4.2 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T06:41:29.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:29 smithi049 ceph-mon[31177]: pgmap v464: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-21T06:41:29.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:29 smithi098 ceph-mon[34704]: pgmap v464: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-21T06:41:29.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:29 smithi079 ceph-mon[34346]: pgmap v464: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-21T06:41:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.834+0000 7f205a921640 1 -- 172.21.15.49:0/1912874006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2054108320 msgr2=0x7f2054108730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.834+0000 7f205a921640 1 --2- 172.21.15.49:0/1912874006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2054108320 0x7f2054108730 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2048009900 tx=0x7f204802a410 comp rx=0 tx=0).stop 2024-09-21T06:41:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.834+0000 7f205a921640 1 -- 172.21.15.49:0/1912874006 shutdown_connections 2024-09-21T06:41:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.834+0000 7f205a921640 1 --2- 172.21.15.49:0/1912874006 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054108c70 0x7f205410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.834+0000 7f205a921640 1 --2- 172.21.15.49:0/1912874006 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2054108320 0x7f2054108730 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.834+0000 7f205a921640 1 --2- 172.21.15.49:0/1912874006 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f20541029f0 0x7f2054102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.834+0000 7f205a921640 1 -- 172.21.15.49:0/1912874006 >> 172.21.15.49:0/1912874006 conn(0x7f20540fe3b0 msgr2=0x7f2054100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.834+0000 7f205a921640 1 -- 172.21.15.49:0/1912874006 shutdown_connections 2024-09-21T06:41:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.834+0000 7f205a921640 1 -- 172.21.15.49:0/1912874006 wait complete. 2024-09-21T06:41:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.835+0000 7f205a921640 1 Processor -- start 2024-09-21T06:41:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.835+0000 7f205a921640 1 -- start start 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f205a921640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20541029f0 0x7f205419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f205a921640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054108320 0x7f205419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f205a921640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2054108c70 0x7f205419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f205a921640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2054112930 con 0x7f20541029f0 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f205a921640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20541127b0 con 0x7f2054108320 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f205a921640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2054112ab0 con 0x7f2054108c70 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2053fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20541029f0 0x7f205419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2053fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20541029f0 0x7f205419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57916/0 (socket says 172.21.15.49:57916) 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2053fff640 1 -- 172.21.15.49:0/714890159 learned_addr learned my addr 172.21.15.49:0/714890159 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f20537fe640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054108320 0x7f205419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2058ebe640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2054108c70 0x7f205419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2053fff640 1 -- 172.21.15.49:0/714890159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2054108c70 msgr2=0x7f205419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2053fff640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2054108c70 0x7f205419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2053fff640 1 -- 172.21.15.49:0/714890159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054108320 msgr2=0x7f205419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2053fff640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054108320 0x7f205419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2053fff640 1 -- 172.21.15.49:0/714890159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20541a0410 con 0x7f20541029f0 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f2053fff640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20541029f0 0x7f205419a4e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f204400e9f0 tx=0x7f204400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.836+0000 7f20517fa640 1 -- 172.21.15.49:0/714890159 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204400cd80 con 0x7f20541029f0 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.837+0000 7f20517fa640 1 -- 172.21.15.49:0/714890159 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20440054d0 con 0x7f20541029f0 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.837+0000 7f20517fa640 1 -- 172.21.15.49:0/714890159 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2044010690 con 0x7f20541029f0 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.837+0000 7f205a921640 1 -- 172.21.15.49:0/714890159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20541a0700 con 0x7f20541029f0 2024-09-21T06:41:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.837+0000 7f205a921640 1 -- 172.21.15.49:0/714890159 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20541a6e90 con 0x7f20541029f0 2024-09-21T06:41:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.839+0000 7f2061889740 1 Processor -- start 2024-09-21T06:41:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.839+0000 7f2061889740 1 -- start start 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f20517fa640 1 -- 172.21.15.49:0/714890159 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2044010830 con 0x7f20541029f0 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2061889740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b216c1b0 0x55a0b25119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2061889740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 0x55a0b2511ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2061889740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 0x55a0b2512430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2061889740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a0b24866f0 con 0x55a0b216c1b0 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2061889740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a0b2475b20 con 0x55a0b21432f0 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2061889740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a0b2479930 con 0x55a0b214b4d0 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2058ebe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b216c1b0 0x55a0b25119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2058ebe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b216c1b0 0x55a0b25119b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57918/0 (socket says 172.21.15.49:57918) 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2058ebe640 1 -- 172.21.15.49:0/2173796629 learned_addr learned my addr 172.21.15.49:0/2173796629 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2053fff640 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 0x55a0b2511ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f20537fe640 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 0x55a0b2512430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2058ebe640 1 -- 172.21.15.49:0/2173796629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 msgr2=0x55a0b2512430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2058ebe640 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 0x55a0b2512430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2058ebe640 1 -- 172.21.15.49:0/2173796629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 msgr2=0x55a0b2511ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2058ebe640 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 0x55a0b2511ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2058ebe640 1 -- 172.21.15.49:0/2173796629 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b243b530 con 0x55a0b216c1b0 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f20537fe640 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 0x55a0b2512430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.840+0000 7f2058ebe640 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b216c1b0 0x55a0b25119b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f204c009e60 tx=0x7f204c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20731e2c49b7e14d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.841+0000 7f203a7fc640 1 -- 172.21.15.49:0/2173796629 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c016070 con 0x55a0b216c1b0 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.841+0000 7f203a7fc640 1 -- 172.21.15.49:0/2173796629 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c004d20 con 0x55a0b216c1b0 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.841+0000 7f20517fa640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f203c0b6680 0x7f203c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.841+0000 7f203a7fc640 1 -- 172.21.15.49:0/2173796629 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c012740 con 0x55a0b216c1b0 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.841+0000 7f2053fff640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f203c0b6680 0x7f203c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.841+0000 7f20517fa640 1 -- 172.21.15.49:0/714890159 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f20440e7c00 con 0x7f20541029f0 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 -- 172.21.15.49:0/2173796629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b216c1b0 msgr2=0x55a0b25119b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2053fff640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f203c0b6680 0x7f203c0b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f20440e53e0 tx=0x7f20440eb750 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b216c1b0 0x55a0b25119b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f204c009e60 tx=0x7f204c010740 comp rx=0 tx=0).stop 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 -- 172.21.15.49:0/2173796629 shutdown_connections 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 0x55a0b2512430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 0x55a0b2511ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 --2- 172.21.15.49:0/2173796629 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b216c1b0 0x55a0b25119b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 -- 172.21.15.49:0/2173796629 >> 172.21.15.49:0/2173796629 conn(0x55a0b2160300 msgr2=0x55a0b250f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 -- 172.21.15.49:0/2173796629 shutdown_connections 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 -- 172.21.15.49:0/2173796629 wait complete. 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 -- start start 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.842+0000 7f2061889740 1 Processor -- start 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2061889740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b251d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2061889740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b214b4d0 0x55a0b251d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2061889740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b216c1b0 0x55a0b2529450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2061889740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a0b23adab0 con 0x55a0b21432f0 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2061889740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a0b241b730 con 0x55a0b214b4d0 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2061889740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a0b2520130 con 0x55a0b216c1b0 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2061889740 10 client.0 _ll_register_callbacks cb 0x55a0b246f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2058ebe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b251d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2058ebe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b251d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57926/0 (socket says 172.21.15.49:57926) 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2058ebe640 1 -- 172.21.15.49:0/3289113265 learned_addr learned my addr 172.21.15.49:0/3289113265 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f20537fe640 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b214b4d0 0x55a0b251d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2058ebe640 1 -- 172.21.15.49:0/3289113265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b216c1b0 msgr2=0x55a0b2529450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2058ebe640 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b216c1b0 0x55a0b2529450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2058ebe640 1 -- 172.21.15.49:0/3289113265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b214b4d0 msgr2=0x55a0b251d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2058ebe640 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b214b4d0 0x55a0b251d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f2058ebe640 1 -- 172.21.15.49:0/3289113265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b21d7790 con 0x55a0b21432f0 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.843+0000 7f20537fe640 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b214b4d0 0x55a0b251d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2058ebe640 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b251d090 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f204c011010 tx=0x7f204c004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cad09b9d6131bd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f20337fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f20337fe640 1 -- 172.21.15.49:0/3289113265 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c016050 con 0x55a0b21432f0 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f20337fe640 1 -- 172.21.15.49:0/3289113265 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f204c0052e0 con 0x55a0b21432f0 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2061889740 1 -- 172.21.15.49:0/3289113265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204c004d20 con 0x55a0b21432f0 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f20337fe640 1 -- 172.21.15.49:0/3289113265 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f204c0124c0 con 0x55a0b21432f0 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2061889740 10 client.16656 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2061889740 1 -- 172.21.15.49:0/3289113265 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a0b2250620 con 0x55a0b21432f0 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f20337fe640 1 -- 172.21.15.49:0/3289113265 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c004d20 con 0x55a0b21432f0 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f20337fe640 1 -- 172.21.15.49:0/3289113265 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f204c00f040 con 0x55a0b21432f0 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2061889740 10 client.16656 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2061889740 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2061889740 20 client.16656 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2061889740 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a0b212ad80 0x55a0b252f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2061889740 4 client.16656 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.844+0000 7f2061889740 1 -- 172.21.15.49:0/3289113265 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0b2488640 con 0x55a0b212ad80 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.845+0000 7f20537fe640 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a0b212ad80 0x55a0b252f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.845+0000 7f20537fe640 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a0b212ad80 0x55a0b252f0e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f324efae2f5f944 server_cookie=ecdc78ad497f2e1a in_seq=0 out_seq=0 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.845+0000 7f20337fe640 10 client.16656 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f20337fe640 1 -- 172.21.15.49:0/3289113265 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0b2488640 con 0x55a0b212ad80 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f20337fe640 10 client.16656 handle_command_reply: tid=0 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 client.16656 shutdown 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 -- 172.21.15.49:0/3289113265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 msgr2=0x55a0b251d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b251d090 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f204c011010 tx=0x7f204c004c70 comp rx=0 tx=0).stop 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 -- 172.21.15.49:0/3289113265 shutdown_connections 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a0b212ad80 0x55a0b252f0e0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b216c1b0 0x55a0b2529450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b214b4d0 0x55a0b251d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f20337fe640 0 client.16656 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 --2- 172.21.15.49:0/3289113265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b251d090 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 -- 172.21.15.49:0/3289113265 >> 172.21.15.49:0/3289113265 conn(0x55a0b2160300 msgr2=0x55a0b25129e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 -- 172.21.15.49:0/3289113265 shutdown_connections 2024-09-21T06:41:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.846+0000 7f2061889740 1 -- 172.21.15.49:0/3289113265 wait complete. 2024-09-21T06:41:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.847+0000 7f2061889740 20 client.16656 trim_cache size 0 max 16384 2024-09-21T06:41:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.861+0000 7f2061889740 1 Processor -- start 2024-09-21T06:41:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.861+0000 7f2061889740 1 -- start start 2024-09-21T06:41:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.861+0000 7f2061889740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b212ad80 0x55a0b251d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.861+0000 7f2061889740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 0x55a0b250f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.861+0000 7f2061889740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b214b4d0 0x55a0b2529350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.861+0000 7f2061889740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20541b2150 con 0x55a0b214b4d0 2024-09-21T06:41:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.861+0000 7f2061889740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20541afa20 con 0x55a0b21432f0 2024-09-21T06:41:29.864 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.861+0000 7f2061889740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20541ad890 con 0x55a0b212ad80 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b214b4d0 0x55a0b2529350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b214b4d0 0x55a0b2529350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57932/0 (socket says 172.21.15.49:57932) 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 -- 172.21.15.49:0/3732888142 learned_addr learned my addr 172.21.15.49:0/3732888142 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f20537fe640 1 --2- 172.21.15.49:0/3732888142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 0x55a0b250f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 --2- 172.21.15.49:0/3732888142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b212ad80 0x55a0b251d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 -- 172.21.15.49:0/3732888142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b212ad80 msgr2=0x55a0b251d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 --2- 172.21.15.49:0/3732888142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b212ad80 0x55a0b251d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 -- 172.21.15.49:0/3732888142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 msgr2=0x55a0b250f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 --2- 172.21.15.49:0/3732888142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 0x55a0b250f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 -- 172.21.15.49:0/3732888142 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0b2513cb0 con 0x55a0b214b4d0 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2058ebe640 1 --2- 172.21.15.49:0/3732888142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b214b4d0 0x55a0b2529350 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f204c009c20 tx=0x7f204c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f26b4c6cfd82a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2039ffb640 1 -- 172.21.15.49:0/3732888142 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c016030 con 0x55a0b214b4d0 2024-09-21T06:41:29.865 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2039ffb640 1 -- 172.21.15.49:0/3732888142 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c021070 con 0x55a0b214b4d0 2024-09-21T06:41:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.862+0000 7f2039ffb640 1 -- 172.21.15.49:0/3732888142 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f204c012660 con 0x55a0b214b4d0 2024-09-21T06:41:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.863+0000 7f2061889740 1 -- 172.21.15.49:0/3732888142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b214b4d0 msgr2=0x55a0b2529350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.863+0000 7f2061889740 1 --2- 172.21.15.49:0/3732888142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b214b4d0 0x55a0b2529350 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f204c009c20 tx=0x7f204c010740 comp rx=0 tx=0).stop 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.863+0000 7f2061889740 1 -- 172.21.15.49:0/3732888142 shutdown_connections 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.863+0000 7f2061889740 1 --2- 172.21.15.49:0/3732888142 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b214b4d0 0x55a0b2529350 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.863+0000 7f2061889740 1 --2- 172.21.15.49:0/3732888142 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b21432f0 0x55a0b250f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.863+0000 7f2061889740 1 --2- 172.21.15.49:0/3732888142 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b212ad80 0x55a0b251d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.863+0000 7f2061889740 1 -- 172.21.15.49:0/3732888142 >> 172.21.15.49:0/3732888142 conn(0x55a0b2160300 msgr2=0x55a0b250f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.863+0000 7f2061889740 1 -- 172.21.15.49:0/3732888142 shutdown_connections 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.863+0000 7f2061889740 1 -- 172.21.15.49:0/3732888142 wait complete. 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2061889740 1 -- start start 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2061889740 1 Processor -- start 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2061889740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b212ad80 0x55a0b2520bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2061889740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b25210f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2061889740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 0x55a0b2597870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2061889740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f20541adee0 con 0x55a0b21432f0 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2061889740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f20541af350 con 0x55a0b212ad80 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2061889740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f20541ae5b0 con 0x55a0b214b4d0 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2061889740 10 client.0 _ll_register_callbacks cb 0x7f20440eb620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f20537fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b25210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f20537fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b25210f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57948/0 (socket says 172.21.15.49:57948) 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f20537fe640 1 -- 172.21.15.49:0/2596493213 learned_addr learned my addr 172.21.15.49:0/2596493213 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.864+0000 7f2058ebe640 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b212ad80 0x55a0b2520bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f2058ebe640 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 0x55a0b2597870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20537fe640 1 -- 172.21.15.49:0/2596493213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 msgr2=0x55a0b2597870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20537fe640 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 0x55a0b2597870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20537fe640 1 -- 172.21.15.49:0/2596493213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b212ad80 msgr2=0x55a0b2520bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20537fe640 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b212ad80 0x55a0b2520bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20537fe640 1 -- 172.21.15.49:0/2596493213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0b2597e30 con 0x55a0b21432f0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20537fe640 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b25210f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2048009900 tx=0x7f2048000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ee67f3ea1c42bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20337fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20337fe640 1 -- 172.21.15.49:0/2596493213 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2048035040 con 0x55a0b21432f0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20337fe640 1 -- 172.21.15.49:0/2596493213 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f2048005590 con 0x55a0b21432f0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f2061889740 1 -- 172.21.15.49:0/2596493213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f204c021070 con 0x55a0b21432f0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f20337fe640 1 -- 172.21.15.49:0/2596493213 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2048004750 con 0x55a0b21432f0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f2061889740 10 client.16662 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.865+0000 7f2061889740 1 -- 172.21.15.49:0/2596493213 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a0b25990e0 con 0x55a0b21432f0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f20337fe640 1 -- 172.21.15.49:0/2596493213 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f204c021070 con 0x55a0b21432f0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f20337fe640 1 -- 172.21.15.49:0/2596493213 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2048032740 con 0x55a0b21432f0 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f2061889740 10 client.16662 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f2061889740 10 client.16662 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f2061889740 20 client.16662 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f2061889740 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a0b216c1b0 0x55a0b259b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f2061889740 4 client.16662 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:41:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f2061889740 1 -- 172.21.15.49:0/2596493213 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a0b24840f0 con 0x55a0b216c1b0 2024-09-21T06:41:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f2058ebe640 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a0b216c1b0 0x55a0b259b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f2058ebe640 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a0b216c1b0 0x55a0b259b900 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6da61185ad30775 server_cookie=928cfadf812344f9 in_seq=0 out_seq=0 2024-09-21T06:41:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.866+0000 7f20337fe640 10 client.16662 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f20337fe640 1 -- 172.21.15.49:0/2596493213 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a0b24840f0 con 0x55a0b216c1b0 2024-09-21T06:41:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f20337fe640 10 client.16662 handle_command_reply: tid=0 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 client.16662 shutdown 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 -- 172.21.15.49:0/2596493213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 msgr2=0x55a0b25210f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b25210f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f2048009900 tx=0x7f2048000bc0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 -- 172.21.15.49:0/2596493213 shutdown_connections 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a0b216c1b0 0x55a0b259b900 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a0b214b4d0 0x55a0b2597870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a0b21432f0 0x55a0b25210f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 --2- 172.21.15.49:0/2596493213 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a0b212ad80 0x55a0b2520bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f20337fe640 0 client.16662 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 -- 172.21.15.49:0/2596493213 >> 172.21.15.49:0/2596493213 conn(0x55a0b2160300 msgr2=0x55a0b25129c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 -- 172.21.15.49:0/2596493213 shutdown_connections 2024-09-21T06:41:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.874+0000 7f2061889740 1 -- 172.21.15.49:0/2596493213 wait complete. 2024-09-21T06:41:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f2061889740 20 client.16662 trim_cache size 0 max 16384 2024-09-21T06:41:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:41:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:41:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:41:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:41:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 -- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f203c0b6680 msgr2=0x7f203c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f203c0b6680 0x7f203c0b8b90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f20440e53e0 tx=0x7f20440eb750 comp rx=0 tx=0).stop 2024-09-21T06:41:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 -- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20541029f0 msgr2=0x7f205419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20541029f0 0x7f205419a4e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f204400e9f0 tx=0x7f204400edf0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 -- 172.21.15.49:0/714890159 shutdown_connections 2024-09-21T06:41:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f203c0b6680 0x7f203c0b8b90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2054108c70 0x7f205419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2054108320 0x7f205419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 --2- 172.21.15.49:0/714890159 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f20541029f0 0x7f205419a4e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 -- 172.21.15.49:0/714890159 >> 172.21.15.49:0/714890159 conn(0x7f20540fe3b0 msgr2=0x7f205406bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 -- 172.21.15.49:0/714890159 shutdown_connections 2024-09-21T06:41:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:29.875+0000 7f205a921640 1 -- 172.21.15.49:0/714890159 wait complete. 2024-09-21T06:41:31.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:31 smithi049 ceph-mon[31177]: pgmap v465: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T06:41:31.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:31 smithi098 ceph-mon[34704]: pgmap v465: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T06:41:31.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:31 smithi079 ceph-mon[34346]: pgmap v465: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T06:41:31.832 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:41:32.109 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:32.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.545+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/1938328820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 msgr2=0x7ff2f410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:32.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.545+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/1938328820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 0x7ff2f410f520 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec009ca0 tx=0x7ff2ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.545+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/1938328820 shutdown_connections 2024-09-21T06:41:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.545+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/1938328820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 0x7ff2f410f520 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.545+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/1938328820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f41083a0 0x7ff2f41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.545+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/1938328820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f4102a60 0x7ff2f4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.545+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/1938328820 >> 172.21.15.49:0/1938328820 conn(0x7ff2f4079730 msgr2=0x7ff2f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.545+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/1938328820 shutdown_connections 2024-09-21T06:41:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.545+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/1938328820 wait complete. 2024-09-21T06:41:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fc0ae640 1 Processor -- start 2024-09-21T06:41:32.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fc0ae640 1 -- start start 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fc0ae640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f4102a60 0x7ff2f419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fc0ae640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f41083a0 0x7ff2f419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fc0ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 0x7ff2f419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fc0ae640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f4112960 con 0x7ff2f4108cf0 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fc0ae640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f41127e0 con 0x7ff2f41083a0 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fc0ae640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f4112ae0 con 0x7ff2f4102a60 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fa64b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 0x7ff2f419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fa64b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 0x7ff2f419bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57964/0 (socket says 172.21.15.49:57964) 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2fa64b640 1 -- 172.21.15.49:0/572908513 learned_addr learned my addr 172.21.15.49:0/572908513 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.546+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f4102a60 0x7ff2f419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2f9649640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f41083a0 0x7ff2f419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2fa64b640 1 -- 172.21.15.49:0/572908513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f4102a60 msgr2=0x7ff2f419b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2fa64b640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f4102a60 0x7ff2f419b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2fa64b640 1 -- 172.21.15.49:0/572908513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f41083a0 msgr2=0x7ff2f419b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2fa64b640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f41083a0 0x7ff2f419b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2fa64b640 1 -- 172.21.15.49:0/572908513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f41a6530 con 0x7ff2f4108cf0 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2fa64b640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 0x7ff2f419bcf0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec005cc0 tx=0x7ff2ec031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2eaffd640 1 -- 172.21.15.49:0/572908513 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec003b70 con 0x7ff2f4108cf0 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2eaffd640 1 -- 172.21.15.49:0/572908513 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2ec0318f0 con 0x7ff2f4108cf0 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/572908513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f4199060 con 0x7ff2f4108cf0 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2eaffd640 1 -- 172.21.15.49:0/572908513 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ec02f950 con 0x7ff2f4108cf0 2024-09-21T06:41:32.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.547+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/572908513 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f41995a0 con 0x7ff2f4108cf0 2024-09-21T06:41:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.550+0000 7ff302622740 1 Processor -- start 2024-09-21T06:41:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.550+0000 7ff2eaffd640 1 -- 172.21.15.49:0/572908513 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ff2ec02fb50 con 0x7ff2f4108cf0 2024-09-21T06:41:32.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.550+0000 7ff302622740 1 -- start start 2024-09-21T06:41:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff302622740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x55589419d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff302622740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dcd1b0 0x55589419d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff302622740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dd5390 0x55589419dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff302622740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555894113e50 con 0x555893df6070 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff302622740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555894103280 con 0x555893dcd1b0 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff302622740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555894107090 con 0x555893dd5390 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x55589419d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x55589419d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57980/0 (socket says 172.21.15.49:57980) 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9649640 1 -- 172.21.15.49:0/1085484175 learned_addr learned my addr 172.21.15.49:0/1085484175 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/1085484175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dcd1b0 0x55589419d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2eaffd640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff2e00b6680 0x7ff2e00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9e4a640 1 -- 172.21.15.49:0/1085484175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dd5390 msgr2=0x55589419dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/1085484175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dd5390 0x55589419dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9e4a640 1 -- 172.21.15.49:0/1085484175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 msgr2=0x55589419d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/1085484175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x55589419d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9e4a640 1 -- 172.21.15.49:0/1085484175 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555893e61650 con 0x555893dcd1b0 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.551+0000 7ff2f9649640 1 --2- 172.21.15.49:0/1085484175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x55589419d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:32.554 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.552+0000 7ff2fa64b640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff2e00b6680 0x7ff2e00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.552+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/1085484175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dcd1b0 0x55589419d7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009bd0 tx=0x7ff2f0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a5783ace5bfe72 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.552+0000 7ff2eaffd640 1 -- 172.21.15.49:0/572908513 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff2ec1088b0 con 0x7ff2f4108cf0 2024-09-21T06:41:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.552+0000 7ff2dffff640 1 -- 172.21.15.49:0/1085484175 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0004230 con 0x555893dcd1b0 2024-09-21T06:41:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.552+0000 7ff2dffff640 1 -- 172.21.15.49:0/1085484175 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2f0009e40 con 0x555893dcd1b0 2024-09-21T06:41:32.555 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.552+0000 7ff2dffff640 1 -- 172.21.15.49:0/1085484175 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0004d00 con 0x555893dcd1b0 2024-09-21T06:41:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 -- 172.21.15.49:0/1085484175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dcd1b0 msgr2=0x55589419d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff2fa64b640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff2e00b6680 0x7ff2e00b8b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec106090 tx=0x7ff2ec09bad0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 --2- 172.21.15.49:0/1085484175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dcd1b0 0x55589419d7b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009bd0 tx=0x7ff2f0011810 comp rx=0 tx=0).stop 2024-09-21T06:41:32.556 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 -- 172.21.15.49:0/1085484175 shutdown_connections 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 --2- 172.21.15.49:0/1085484175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dd5390 0x55589419dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 --2- 172.21.15.49:0/1085484175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dcd1b0 0x55589419d7b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 --2- 172.21.15.49:0/1085484175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x55589419d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 -- 172.21.15.49:0/1085484175 >> 172.21.15.49:0/1085484175 conn(0x555893dea460 msgr2=0x55589419b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 -- 172.21.15.49:0/1085484175 shutdown_connections 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 -- 172.21.15.49:0/1085484175 wait complete. 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.553+0000 7ff302622740 1 -- start start 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff302622740 1 Processor -- start 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff302622740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dcd1b0 0x5558941a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff302622740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 0x5558941a8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff302622740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x5558941b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff302622740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555893f64700 con 0x555893df6070 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff302622740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55589409e110 con 0x555893dd5390 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff302622740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5558941aba50 con 0x555893dcd1b0 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff302622740 10 client.0 _ll_register_callbacks cb 0x5558940b7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:32.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff2f9649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x5558941b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff2f9649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x5558941b4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57994/0 (socket says 172.21.15.49:57994) 2024-09-21T06:41:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff2f9649640 1 -- 172.21.15.49:0/2742925445 learned_addr learned my addr 172.21.15.49:0/2742925445 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff2f9649640 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dcd1b0 0x5558941a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.554+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 0x5558941a8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2f9649640 1 -- 172.21.15.49:0/2742925445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dcd1b0 msgr2=0x5558941a8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2f9649640 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dcd1b0 0x5558941a8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2f9649640 1 -- 172.21.15.49:0/2742925445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 msgr2=0x5558941a8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2f9649640 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 0x5558941a8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2f9649640 1 -- 172.21.15.49:0/2742925445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558940cbc40 con 0x555893df6070 2024-09-21T06:41:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 0x5558941a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2f9649640 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x5558941b4d40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4013dd0 tx=0x7ff2e40097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c23d6e75956f0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:32.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/2742925445 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4010d60 con 0x555893df6070 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/2742925445 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff2e4013110 con 0x555893df6070 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff302622740 1 -- 172.21.15.49:0/2742925445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555894115da0 con 0x555893df6070 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/2742925445 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff2e4026050 con 0x555893df6070 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff302622740 10 client.16674 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.555+0000 7ff302622740 1 -- 172.21.15.49:0/2742925445 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5558941b7840 con 0x555893df6070 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.556+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/2742925445 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555894115da0 con 0x555893df6070 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.556+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/2742925445 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff2e4003710 con 0x555893df6070 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.556+0000 7ff302622740 10 client.16674 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.556+0000 7ff302622740 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.556+0000 7ff302622740 20 client.16674 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.556+0000 7ff302622740 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555893db49f0 0x5558941bad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.556+0000 7ff302622740 4 client.16674 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.556+0000 7ff302622740 1 -- 172.21.15.49:0/2742925445 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555894111850 con 0x555893db49f0 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.556+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555893db49f0 0x5558941bad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.557+0000 7ff2dd7fa640 10 client.16674 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.557+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555893db49f0 0x5558941bad10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8deb1c0fd554a9be server_cookie=9912360610eb184a in_seq=0 out_seq=0 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.557+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/2742925445 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555894111850 con 0x555893db49f0 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.557+0000 7ff2dd7fa640 10 client.16674 handle_command_reply: tid=0 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.557+0000 7ff302622740 1 client.16674 shutdown 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 -- 172.21.15.49:0/2742925445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 msgr2=0x5558941b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x5558941b4d40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4013dd0 tx=0x7ff2e40097f0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 -- 172.21.15.49:0/2742925445 shutdown_connections 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555893db49f0 0x5558941bad10 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893df6070 0x5558941b4d40 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 0x5558941a8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff2dd7fa640 0 client.16674 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 --2- 172.21.15.49:0/2742925445 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dcd1b0 0x5558941a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 -- 172.21.15.49:0/2742925445 >> 172.21.15.49:0/2742925445 conn(0x555893dea460 msgr2=0x5558941a0450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 -- 172.21.15.49:0/2742925445 shutdown_connections 2024-09-21T06:41:32.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 1 -- 172.21.15.49:0/2742925445 wait complete. 2024-09-21T06:41:32.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.558+0000 7ff302622740 20 client.16674 trim_cache size 0 max 16384 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff302622740 1 Processor -- start 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff302622740 1 -- start start 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff302622740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941a0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff302622740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dd5390 0x5558941a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff302622740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893df6070 0x5558941a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff302622740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f41b4270 con 0x555893dcd1b0 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff302622740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f41b1b40 con 0x555893df6070 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff302622740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f41af9b0 con 0x555893dd5390 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff2f9649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff2f9649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58010/0 (socket says 172.21.15.49:58010) 2024-09-21T06:41:32.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff2f9649640 1 -- 172.21.15.49:0/627280105 learned_addr learned my addr 172.21.15.49:0/627280105 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:32.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.576+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/627280105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dd5390 0x5558941a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2f9649640 1 --2- 172.21.15.49:0/627280105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893df6070 0x5558941a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2f9649640 1 -- 172.21.15.49:0/627280105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dd5390 msgr2=0x5558941a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2f9649640 1 --2- 172.21.15.49:0/627280105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dd5390 0x5558941a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2f9649640 1 -- 172.21.15.49:0/627280105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893df6070 msgr2=0x5558941a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2f9649640 1 --2- 172.21.15.49:0/627280105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893df6070 0x5558941a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2f9649640 1 -- 172.21.15.49:0/627280105 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558941a6f00 con 0x555893dcd1b0 2024-09-21T06:41:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2f9649640 1 --2- 172.21.15.49:0/627280105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941a0370 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40092e0 tx=0x7ff2e4013870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f77579aaa5612ec server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2df7fe640 1 -- 172.21.15.49:0/627280105 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4013210 con 0x555893dcd1b0 2024-09-21T06:41:32.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2df7fe640 1 -- 172.21.15.49:0/627280105 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2e4005570 con 0x555893dcd1b0 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.577+0000 7ff2df7fe640 1 -- 172.21.15.49:0/627280105 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40035f0 con 0x555893dcd1b0 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.578+0000 7ff302622740 1 -- 172.21.15.49:0/627280105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 msgr2=0x5558941a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.578+0000 7ff302622740 1 --2- 172.21.15.49:0/627280105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941a0370 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40092e0 tx=0x7ff2e4013870 comp rx=0 tx=0).stop 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.578+0000 7ff302622740 1 -- 172.21.15.49:0/627280105 shutdown_connections 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.578+0000 7ff302622740 1 --2- 172.21.15.49:0/627280105 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893df6070 0x5558941a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.578+0000 7ff302622740 1 --2- 172.21.15.49:0/627280105 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893dd5390 0x5558941a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.578+0000 7ff302622740 1 --2- 172.21.15.49:0/627280105 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941a0370 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.578+0000 7ff302622740 1 -- 172.21.15.49:0/627280105 >> 172.21.15.49:0/627280105 conn(0x555893dea460 msgr2=0x5558941a7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.578+0000 7ff302622740 1 -- 172.21.15.49:0/627280105 shutdown_connections 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.578+0000 7ff302622740 1 -- 172.21.15.49:0/627280105 wait complete. 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff302622740 1 -- start start 2024-09-21T06:41:32.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff302622740 1 Processor -- start 2024-09-21T06:41:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff302622740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff302622740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 0x5558941ad360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff302622740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893df6070 0x5558941ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff302622740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f41b0000 con 0x555893dcd1b0 2024-09-21T06:41:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff302622740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f41b1470 con 0x555893dd5390 2024-09-21T06:41:32.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff302622740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f41b06d0 con 0x555893df6070 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff302622740 10 client.0 _ll_register_callbacks cb 0x7ff2e4013a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff2f9649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff2f9649640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941ace20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58022/0 (socket says 172.21.15.49:58022) 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.579+0000 7ff2f9649640 1 -- 172.21.15.49:0/668785133 learned_addr learned my addr 172.21.15.49:0/668785133 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2f9649640 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893df6070 0x5558941ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 0x5558941ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2f9649640 1 -- 172.21.15.49:0/668785133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 msgr2=0x5558941ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2f9649640 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 0x5558941ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2f9649640 1 -- 172.21.15.49:0/668785133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 msgr2=0x5558941ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2f9649640 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2f9649640 1 -- 172.21.15.49:0/668785133 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558942248d0 con 0x555893df6070 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2f9649640 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893df6070 0x5558941ad8a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff2e402f040 tx=0x7ff2e4003dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aa5815d850bf32a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2dd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T06:41:32.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/668785133 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40035f0 con 0x555893df6070 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff302622740 1 -- 172.21.15.49:0/668785133 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2e4005570 con 0x555893df6070 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.580+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/668785133 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff2e4003790 con 0x555893df6070 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/668785133 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff2e40050c0 con 0x555893df6070 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff302622740 10 client.26143 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff302622740 1 -- 172.21.15.49:0/668785133 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555894225b60 con 0x555893df6070 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/668785133 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2e4005570 con 0x555893df6070 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/668785133 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff2e4011bf0 con 0x555893df6070 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff302622740 10 client.26143 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff302622740 10 client.26143 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff302622740 20 client.26143 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff302622740 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555893d89da0 0x555894228330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff302622740 4 client.26143 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff302622740 1 -- 172.21.15.49:0/668785133 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55589410ec80 con 0x555893d89da0 2024-09-21T06:41:32.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.581+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555893d89da0 0x555894228330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff2f9e4a640 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555893d89da0 0x555894228330 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7de4de4e8228395 server_cookie=6131ff4fae1b276c in_seq=0 out_seq=0 2024-09-21T06:41:32.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff2dd7fa640 10 client.26143 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff2dd7fa640 1 -- 172.21.15.49:0/668785133 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x55589410ec80 con 0x555893d89da0 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff2dd7fa640 10 client.26143 handle_command_reply: tid=0 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff302622740 1 client.26143 shutdown 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff302622740 1 -- 172.21.15.49:0/668785133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893df6070 msgr2=0x5558941ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff302622740 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893df6070 0x5558941ad8a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff2e402f040 tx=0x7ff2e4003dd0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff302622740 1 -- 172.21.15.49:0/668785133 shutdown_connections 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff302622740 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555893d89da0 0x555894228330 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff302622740 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555893df6070 0x5558941ad8a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff302622740 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555893dd5390 0x5558941ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff2dd7fa640 0 client.26143 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff302622740 1 --2- 172.21.15.49:0/668785133 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555893dcd1b0 0x5558941ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.582+0000 7ff302622740 1 -- 172.21.15.49:0/668785133 >> 172.21.15.49:0/668785133 conn(0x555893dea460 msgr2=0x5558941a0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:32.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff302622740 1 -- 172.21.15.49:0/668785133 shutdown_connections 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff302622740 1 -- 172.21.15.49:0/668785133 wait complete. 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff302622740 20 client.26143 trim_cache size 0 max 16384 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:32.588 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:32.589 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:41:32.590 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:41:32.591 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:41:32.592 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:41:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff2e00b6680 msgr2=0x7ff2e00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff2e00b6680 0x7ff2e00b8b90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec106090 tx=0x7ff2ec09bad0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 msgr2=0x7ff2f419bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:32.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 0x7ff2f419bcf0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec005cc0 tx=0x7ff2ec031700 comp rx=0 tx=0).stop 2024-09-21T06:41:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/572908513 shutdown_connections 2024-09-21T06:41:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff2e00b6680 0x7ff2e00b8b90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff2f4108cf0 0x7ff2f419bcf0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff2f41083a0 0x7ff2f419b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 --2- 172.21.15.49:0/572908513 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff2f4102a60 0x7ff2f419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.583+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/572908513 >> 172.21.15.49:0/572908513 conn(0x7ff2f4079730 msgr2=0x7ff2f4104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.584+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/572908513 shutdown_connections 2024-09-21T06:41:32.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:32.584+0000 7ff2fc0ae640 1 -- 172.21.15.49:0/572908513 wait complete. 2024-09-21T06:41:33.403 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:41:33.404 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:41:33.669 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:33.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:33 smithi049 ceph-mon[31177]: pgmap v466: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:41:33.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:33 smithi098 ceph-mon[34704]: pgmap v466: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:41:33.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:33 smithi079 ceph-mon[34346]: pgmap v466: 97 pgs: 97 active+clean; 4.3 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:41:34.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.160+0000 7fca5a913640 1 -- 172.21.15.49:0/122557398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 msgr2=0x7fca54102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.160+0000 7fca5a913640 1 --2- 172.21.15.49:0/122557398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 0x7fca54102e70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fca44009900 tx=0x7fca4402a410 comp rx=0 tx=0).stop 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.160+0000 7fca5a913640 1 -- 172.21.15.49:0/122557398 shutdown_connections 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.160+0000 7fca5a913640 1 --2- 172.21.15.49:0/122557398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca54108cf0 0x7fca5410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.160+0000 7fca5a913640 1 --2- 172.21.15.49:0/122557398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca541083a0 0x7fca541087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.160+0000 7fca5a913640 1 --2- 172.21.15.49:0/122557398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 0x7fca54102e70 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.160+0000 7fca5a913640 1 -- 172.21.15.49:0/122557398 >> 172.21.15.49:0/122557398 conn(0x7fca54079730 msgr2=0x7fca54079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.160+0000 7fca5a913640 1 -- 172.21.15.49:0/122557398 shutdown_connections 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.160+0000 7fca5a913640 1 -- 172.21.15.49:0/122557398 wait complete. 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.161+0000 7fca5a913640 1 Processor -- start 2024-09-21T06:41:34.163 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.161+0000 7fca5a913640 1 -- start start 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca5a913640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 0x7fca5419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca5a913640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca541083a0 0x7fca5419a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca5a913640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca54108cf0 0x7fca5419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca5a913640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fca54112960 con 0x7fca54102a60 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca5a913640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fca541127e0 con 0x7fca54108cf0 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca5a913640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fca54112ae0 con 0x7fca541083a0 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 0x7fca5419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca53fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 0x7fca5419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58042/0 (socket says 172.21.15.49:58042) 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca53fff640 1 -- 172.21.15.49:0/3633465619 learned_addr learned my addr 172.21.15.49:0/3633465619 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:34.165 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca537fe640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca541083a0 0x7fca5419a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca58eb0640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca54108cf0 0x7fca5419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca53fff640 1 -- 172.21.15.49:0/3633465619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca541083a0 msgr2=0x7fca5419a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca53fff640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca541083a0 0x7fca5419a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca53fff640 1 -- 172.21.15.49:0/3633465619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca54108cf0 msgr2=0x7fca5419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca53fff640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca54108cf0 0x7fca5419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca53fff640 1 -- 172.21.15.49:0/3633465619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca541a03b0 con 0x7fca54102a60 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca53fff640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 0x7fca5419a440 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fca44005940 tx=0x7fca44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.162+0000 7fca517fa640 1 -- 172.21.15.49:0/3633465619 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4403f030 con 0x7fca54102a60 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.163+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca541a0640 con 0x7fca54102a60 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.163+0000 7fca517fa640 1 -- 172.21.15.49:0/3633465619 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca44003aa0 con 0x7fca54102a60 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.163+0000 7fca517fa640 1 -- 172.21.15.49:0/3633465619 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44035070 con 0x7fca54102a60 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.163+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca541a6e00 con 0x7fca54102a60 2024-09-21T06:41:34.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.164+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca54102e70 con 0x7fca54102a60 2024-09-21T06:41:34.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.165+0000 7fca517fa640 1 -- 172.21.15.49:0/3633465619 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fca44042030 con 0x7fca54102a60 2024-09-21T06:41:34.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.166+0000 7fca517fa640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca3c0b6680 0x7fca3c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:34.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.166+0000 7fca537fe640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca3c0b6680 0x7fca3c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:34.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.166+0000 7fca517fa640 1 -- 172.21.15.49:0/3633465619 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fca441080f0 con 0x7fca54102a60 2024-09-21T06:41:34.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.167+0000 7fca537fe640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca3c0b6680 0x7fca3c0b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fca54100e00 tx=0x7fca48005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:34.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.169+0000 7fca517fa640 1 -- 172.21.15.49:0/3633465619 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca440d29a0 con 0x7fca54102a60 2024-09-21T06:41:34.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.395+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca541a7000 con 0x7fca54102a60 2024-09-21T06:41:34.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.396+0000 7fca517fa640 1 -- 172.21.15.49:0/3633465619 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7fca440d78e0 con 0x7fca54102a60 2024-09-21T06:41:34.398 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:41:34.398 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:41:34.398 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:41:34.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca3c0b6680 msgr2=0x7fca3c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:34.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca3c0b6680 0x7fca3c0b8b90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fca54100e00 tx=0x7fca48005f90 comp rx=0 tx=0).stop 2024-09-21T06:41:34.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 msgr2=0x7fca5419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:34.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 0x7fca5419a440 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fca44005940 tx=0x7fca44004270 comp rx=0 tx=0).stop 2024-09-21T06:41:34.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 shutdown_connections 2024-09-21T06:41:34.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fca3c0b6680 0x7fca3c0b8b90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:34.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fca54108cf0 0x7fca5419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:34.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fca541083a0 0x7fca5419a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:34.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 --2- 172.21.15.49:0/3633465619 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fca54102a60 0x7fca5419a440 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:34.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 >> 172.21.15.49:0/3633465619 conn(0x7fca54079730 msgr2=0x7fca54101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:34.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 shutdown_connections 2024-09-21T06:41:34.401 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:34.398+0000 7fca5a913640 1 -- 172.21.15.49:0/3633465619 wait complete. 2024-09-21T06:41:35.053 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:41:35.314 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:35.667 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:35 smithi049 ceph-mon[31177]: pgmap v467: 97 pgs: 97 active+clean; 4.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:41:35.668 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:35 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3633465619' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:41:35.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:35 smithi098 ceph-mon[34704]: pgmap v467: 97 pgs: 97 active+clean; 4.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:41:35.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:35 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3633465619' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:41:35.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.759+0000 7f41cf504640 1 -- 172.21.15.49:0/2229095754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c81048b0 msgr2=0x7f41c8104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.759+0000 7f41cf504640 1 --2- 172.21.15.49:0/2229095754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c81048b0 0x7f41c8104cc0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009900 tx=0x7f41c002a410 comp rx=0 tx=0).stop 2024-09-21T06:41:35.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.759+0000 7f41cf504640 1 -- 172.21.15.49:0/2229095754 shutdown_connections 2024-09-21T06:41:35.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.759+0000 7f41cf504640 1 --2- 172.21.15.49:0/2229095754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c810de60 0x7f41c8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.759+0000 7f41cf504640 1 --2- 172.21.15.49:0/2229095754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c8105290 0x7f41c810d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.759+0000 7f41cf504640 1 --2- 172.21.15.49:0/2229095754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c81048b0 0x7f41c8104cc0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.759+0000 7f41cf504640 1 -- 172.21.15.49:0/2229095754 >> 172.21.15.49:0/2229095754 conn(0x7f41c80796d0 msgr2=0x7f41c8079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.759+0000 7f41cf504640 1 -- 172.21.15.49:0/2229095754 shutdown_connections 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.759+0000 7f41cf504640 1 -- 172.21.15.49:0/2229095754 wait complete. 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cf504640 1 Processor -- start 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cf504640 1 -- start start 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cf504640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c81048b0 0x7f41c819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cf504640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c8105290 0x7f41c819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cf504640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c810de60 0x7f41c819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cf504640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f41c8113b20 con 0x7f41c8105290 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cf504640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41c81139a0 con 0x7f41c810de60 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cf504640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41c8113ca0 con 0x7f41c81048b0 2024-09-21T06:41:35.802 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cca9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c8105290 0x7f41c819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cca9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c8105290 0x7f41c819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58058/0 (socket says 172.21.15.49:58058) 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.760+0000 7f41cca9f640 1 -- 172.21.15.49:0/199913525 learned_addr learned my addr 172.21.15.49:0/199913525 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c810de60 0x7f41c819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c81048b0 0x7f41c819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cca9f640 1 -- 172.21.15.49:0/199913525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c81048b0 msgr2=0x7f41c819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cca9f640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c81048b0 0x7f41c819a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cca9f640 1 -- 172.21.15.49:0/199913525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c810de60 msgr2=0x7f41c819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cca9f640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c810de60 0x7f41c819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cca9f640 1 -- 172.21.15.49:0/199913525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c81a03c0 con 0x7f41c8105290 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c810de60 0x7f41c819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cca9f640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c8105290 0x7f41c819aab0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c8c0 tx=0x7f41bc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41c67fc640 1 -- 172.21.15.49:0/199913525 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc007bb0 con 0x7f41c8105290 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41c67fc640 1 -- 172.21.15.49:0/199913525 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41bc007d50 con 0x7f41c8105290 2024-09-21T06:41:35.803 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41c67fc640 1 -- 172.21.15.49:0/199913525 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0187c0 con 0x7f41c8105290 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cf504640 1 -- 172.21.15.49:0/199913525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c81a06b0 con 0x7f41c8105290 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.761+0000 7f41cf504640 1 -- 172.21.15.49:0/199913525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c81a6ed0 con 0x7f41c8105290 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41d5a78740 1 Processor -- start 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41d5a78740 1 -- start start 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41c67fc640 1 -- 172.21.15.49:0/199913525 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f41bc00fa20 con 0x7f41c8105290 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9e8070 0x560a0ed8f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed8f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed8fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41d5a78740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560a0ed05ea0 con 0x560a0e9bf1b0 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41d5a78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a0ecf52d0 con 0x560a0e9e8070 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41d5a78740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a0ecf90e0 con 0x560a0e9c7390 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41cd2a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed8f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41cd2a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed8f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58062/0 (socket says 172.21.15.49:58062) 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.764+0000 7f41cd2a0640 1 -- 172.21.15.49:0/314876007 learned_addr learned my addr 172.21.15.49:0/314876007 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:35.804 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9e8070 0x560a0ed8f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41cca9f640 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed8fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41cd2a0640 1 -- 172.21.15.49:0/314876007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 msgr2=0x560a0ed8fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed8fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41cd2a0640 1 -- 172.21.15.49:0/314876007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9e8070 msgr2=0x560a0ed8f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9e8070 0x560a0ed8f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41cd2a0640 1 -- 172.21.15.49:0/314876007 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a0ea53650 con 0x560a0e9bf1b0 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9e8070 0x560a0ed8f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed8f800 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f41c002a930 tx=0x7f41c0032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0b4b5cb8d6dae0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41af7fe640 1 -- 172.21.15.49:0/314876007 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c003f070 con 0x560a0e9bf1b0 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41af7fe640 1 -- 172.21.15.49:0/314876007 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41c0031760 con 0x560a0e9bf1b0 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41af7fe640 1 -- 172.21.15.49:0/314876007 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0035070 con 0x560a0e9bf1b0 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.765+0000 7f41c67fc640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f41b00b66b0 0x7f41b00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f41b00b66b0 0x7f41b00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.805 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41c67fc640 1 -- 172.21.15.49:0/199913525 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f41bc0e7890 con 0x7f41c8105290 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41d5a78740 1 -- 172.21.15.49:0/314876007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 msgr2=0x560a0ed8f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f41b00b66b0 0x7f41b00b8bc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f41b800e390 tx=0x7f41b80075e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41d5a78740 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed8f800 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f41c002a930 tx=0x7f41c0032d60 comp rx=0 tx=0).stop 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41d5a78740 1 -- 172.21.15.49:0/314876007 shutdown_connections 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41d5a78740 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed8fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41d5a78740 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed8f800 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41d5a78740 1 --2- 172.21.15.49:0/314876007 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9e8070 0x560a0ed8f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41d5a78740 1 -- 172.21.15.49:0/314876007 >> 172.21.15.49:0/314876007 conn(0x560a0e9dc460 msgr2=0x560a0ed8d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41d5a78740 1 -- 172.21.15.49:0/314876007 shutdown_connections 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.766+0000 7f41d5a78740 1 -- 172.21.15.49:0/314876007 wait complete. 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41d5a78740 1 -- start start 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41d5a78740 1 Processor -- start 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 0x560a0ed9a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.806 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed9ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41d5a78740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560a0eb56700 con 0x560a0e9e8070 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41d5a78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a0ec90160 con 0x560a0e9bf1b0 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41d5a78740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a0ed9da40 con 0x560a0e9c7390 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41d5a78740 10 client.0 _ll_register_callbacks cb 0x560a0eca99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41cdaa1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41cdaa1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58076/0 (socket says 172.21.15.49:58076) 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.767+0000 7f41cdaa1640 1 -- 172.21.15.49:0/2549253372 learned_addr learned my addr 172.21.15.49:0/2549253372 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 0x560a0ed9a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41cca9f640 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed9ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41cdaa1640 1 -- 172.21.15.49:0/2549253372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 msgr2=0x560a0ed9ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed9ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41cdaa1640 1 -- 172.21.15.49:0/2549253372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 msgr2=0x560a0ed9a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.807 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 0x560a0ed9a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41cdaa1640 1 -- 172.21.15.49:0/2549253372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a0ecbdc90 con 0x560a0e9e8070 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9b360 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f41b8010e20 tx=0x7f41b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213777a0fc43b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41acff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41acff9640 1 -- 172.21.15.49:0/2549253372 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8021070 con 0x560a0e9e8070 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41acff9640 1 -- 172.21.15.49:0/2549253372 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f41b801d650 con 0x560a0e9e8070 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41d5a78740 1 -- 172.21.15.49:0/2549253372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41c0031760 con 0x560a0e9e8070 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41acff9640 1 -- 172.21.15.49:0/2549253372 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f41b802d050 con 0x560a0e9e8070 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41d5a78740 10 client.16698 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.768+0000 7f41d5a78740 1 -- 172.21.15.49:0/2549253372 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560a0eda9700 con 0x560a0e9e8070 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.769+0000 7f41acff9640 1 -- 172.21.15.49:0/2549253372 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41c0031760 con 0x560a0e9e8070 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.769+0000 7f41acff9640 1 -- 172.21.15.49:0/2549253372 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f41b80256a0 con 0x560a0e9e8070 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.769+0000 7f41d5a78740 10 client.16698 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.769+0000 7f41d5a78740 10 client.16698 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.769+0000 7f41d5a78740 20 client.16698 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:35.808 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.769+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x560a0e9a69f0 0x560a0edacd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.769+0000 7f41d5a78740 4 client.16698 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.769+0000 7f41d5a78740 1 -- 172.21.15.49:0/2549253372 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a0ed07df0 con 0x560a0e9a69f0 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.769+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x560a0e9a69f0 0x560a0edacd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.770+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x560a0e9a69f0 0x560a0edacd10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=674b547067fdac38 server_cookie=90ea888467a9a3fe in_seq=0 out_seq=0 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.770+0000 7f41acff9640 10 client.16698 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.770+0000 7f41acff9640 1 -- 172.21.15.49:0/2549253372 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a0ed07df0 con 0x560a0e9a69f0 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.770+0000 7f41acff9640 10 client.16698 handle_command_reply: tid=0 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.770+0000 7f41d5a78740 1 client.16698 shutdown 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 -- 172.21.15.49:0/2549253372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 msgr2=0x560a0ed9b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9b360 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f41b8010e20 tx=0x7f41b8004a40 comp rx=0 tx=0).stop 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 -- 172.21.15.49:0/2549253372 shutdown_connections 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x560a0e9a69f0 0x560a0edacd10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9b360 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.809 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed9ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41acff9640 0 client.16698 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2549253372 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 0x560a0ed9a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 -- 172.21.15.49:0/2549253372 >> 172.21.15.49:0/2549253372 conn(0x560a0e9dc460 msgr2=0x560a0ed924a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 -- 172.21.15.49:0/2549253372 shutdown_connections 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 1 -- 172.21.15.49:0/2549253372 wait complete. 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.771+0000 7f41d5a78740 20 client.16698 trim_cache size 0 max 16384 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41d5a78740 1 Processor -- start 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41d5a78740 1 -- start start 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed90cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9c7390 0x560a0ed9c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9e8070 0x560a0ed8c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41d5a78740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f41c81b2060 con 0x560a0e9bf1b0 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41d5a78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41c81af930 con 0x560a0e9c7390 2024-09-21T06:41:35.810 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41d5a78740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41c81ad7a0 con 0x560a0e9e8070 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cd2a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed90cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cd2a0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed90cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58082/0 (socket says 172.21.15.49:58082) 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cd2a0640 1 -- 172.21.15.49:0/2089937458 learned_addr learned my addr 172.21.15.49:0/2089937458 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cca9f640 1 --2- 172.21.15.49:0/2089937458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9c7390 0x560a0ed9c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cd2a0640 1 -- 172.21.15.49:0/2089937458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9e8070 msgr2=0x560a0ed8c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/2089937458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9e8070 0x560a0ed8c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cd2a0640 1 -- 172.21.15.49:0/2089937458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9c7390 msgr2=0x560a0ed9c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/2089937458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9c7390 0x560a0ed9c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cd2a0640 1 -- 172.21.15.49:0/2089937458 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a0ed87440 con 0x560a0e9bf1b0 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.785+0000 7f41cca9f640 1 --2- 172.21.15.49:0/2089937458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9c7390 0x560a0ed9c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.786+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/2089937458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed90cb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f41c002a450 tx=0x7f41c0005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b446aa86470b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.786+0000 7f41aeffd640 1 -- 172.21.15.49:0/2089937458 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c0050020 con 0x560a0e9bf1b0 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.786+0000 7f41aeffd640 1 -- 172.21.15.49:0/2089937458 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41c0031760 con 0x560a0e9bf1b0 2024-09-21T06:41:35.811 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.786+0000 7f41aeffd640 1 -- 172.21.15.49:0/2089937458 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41c003f040 con 0x560a0e9bf1b0 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 -- 172.21.15.49:0/2089937458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 msgr2=0x560a0ed90cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2089937458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed90cb0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f41c002a450 tx=0x7f41c0005380 comp rx=0 tx=0).stop 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 -- 172.21.15.49:0/2089937458 shutdown_connections 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2089937458 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9e8070 0x560a0ed8c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2089937458 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9c7390 0x560a0ed9c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 --2- 172.21.15.49:0/2089937458 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9bf1b0 0x560a0ed90cb0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 -- 172.21.15.49:0/2089937458 >> 172.21.15.49:0/2089937458 conn(0x560a0e9dc460 msgr2=0x560a0ed9be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 -- 172.21.15.49:0/2089937458 shutdown_connections 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 -- 172.21.15.49:0/2089937458 wait complete. 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 -- start start 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 Processor -- start 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.787+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 0x560a0eda34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.812 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed9e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41d5a78740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41d5a78740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f41c81addf0 con 0x560a0e9e8070 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41d5a78740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f41c81af260 con 0x560a0e9bf1b0 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41d5a78740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f41c81ae4c0 con 0x560a0e9c7390 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41d5a78740 10 client.0 _ll_register_callbacks cb 0x7f41b8014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cdaa1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cdaa1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58084/0 (socket says 172.21.15.49:58084) 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cdaa1640 1 -- 172.21.15.49:0/1149331242 learned_addr learned my addr 172.21.15.49:0/1149331242 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 0x560a0eda34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cca9f640 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed9e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cdaa1640 1 -- 172.21.15.49:0/1149331242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 msgr2=0x560a0ed9e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed9e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cdaa1640 1 -- 172.21.15.49:0/1149331242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 msgr2=0x560a0eda34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.813 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 0x560a0eda34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cdaa1640 1 -- 172.21.15.49:0/1149331242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a0ed9f640 con 0x560a0e9e8070 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cca9f640 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed9e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41cdaa1640 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9eeb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f41b80075b0 tx=0x7f41b8025f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6470747694468eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41acff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41acff9640 1 -- 172.21.15.49:0/1149331242 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b8021070 con 0x560a0e9e8070 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41acff9640 1 -- 172.21.15.49:0/1149331242 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f41b80257c0 con 0x560a0e9e8070 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.788+0000 7f41d5a78740 1 -- 172.21.15.49:0/1149331242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41c0031760 con 0x560a0e9e8070 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41acff9640 1 -- 172.21.15.49:0/1149331242 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f41b803f050 con 0x560a0e9e8070 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41d5a78740 10 client.16704 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41d5a78740 1 -- 172.21.15.49:0/1149331242 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560a0ee175a0 con 0x560a0e9e8070 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41acff9640 1 -- 172.21.15.49:0/1149331242 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41c0031760 con 0x560a0e9e8070 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41acff9640 1 -- 172.21.15.49:0/1149331242 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f41b8026440 con 0x560a0e9e8070 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41d5a78740 10 client.16704 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:35.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41d5a78740 10 client.16704 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:41:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41d5a78740 20 client.16704 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:35.815 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:41:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41d5a78740 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x560a0e97bda0 0x560a0ee19d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41d5a78740 4 client.16704 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:41:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41d5a78740 1 -- 172.21.15.49:0/1149331242 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a0ed038a0 con 0x560a0e97bda0 2024-09-21T06:41:35.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.789+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x560a0e97bda0 0x560a0ee19d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41acff9640 10 client.16704 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41cd2a0640 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x560a0e97bda0 0x560a0ee19d80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d1d52223b817707c server_cookie=3140f4ad79fc3879 in_seq=0 out_seq=0 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41acff9640 1 -- 172.21.15.49:0/1149331242 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a0ed038a0 con 0x560a0e97bda0 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41acff9640 10 client.16704 handle_command_reply: tid=0 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 client.16704 shutdown 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 -- 172.21.15.49:0/1149331242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 msgr2=0x560a0ed9eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9eeb0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f41b80075b0 tx=0x7f41b8025f10 comp rx=0 tx=0).stop 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 -- 172.21.15.49:0/1149331242 shutdown_connections 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x560a0e97bda0 0x560a0ee19d80 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a0e9e8070 0x560a0ed9eeb0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a0e9c7390 0x560a0ed9e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 --2- 172.21.15.49:0/1149331242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a0e9bf1b0 0x560a0eda34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 -- 172.21.15.49:0/1149331242 >> 172.21.15.49:0/1149331242 conn(0x560a0e9dc460 msgr2=0x560a0ed90930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41acff9640 0 client.16704 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 -- 172.21.15.49:0/1149331242 shutdown_connections 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 1 -- 172.21.15.49:0/1149331242 wait complete. 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.790+0000 7f41d5a78740 20 client.16704 trim_cache size 0 max 16384 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 -- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f41b00b66b0 msgr2=0x7f41b00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f41b00b66b0 0x7f41b00b8bc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f41b800e390 tx=0x7f41b80075e0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 -- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c8105290 msgr2=0x7f41c819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c8105290 0x7f41c819aab0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f41bc00c8c0 tx=0x7f41bc00cd80 comp rx=0 tx=0).stop 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 -- 172.21.15.49:0/199913525 shutdown_connections 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f41b00b66b0 0x7f41b00b8bc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f41c810de60 0x7f41c819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f41c8105290 0x7f41c819aab0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 --2- 172.21.15.49:0/199913525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f41c81048b0 0x7f41c819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 -- 172.21.15.49:0/199913525 >> 172.21.15.49:0/199913525 conn(0x7f41c80796d0 msgr2=0x7f41c81006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.817 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 -- 172.21.15.49:0/199913525 shutdown_connections 2024-09-21T06:41:35.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:35.791+0000 7f41cf504640 1 -- 172.21.15.49:0/199913525 wait complete. 2024-09-21T06:41:35.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:35 smithi079 ceph-mon[34346]: pgmap v467: 97 pgs: 97 active+clean; 4.4 MiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:41:35.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:35 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3633465619' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:41:36.552 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:41:36.810 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.281+0000 7f523f8cd640 1 -- 172.21.15.49:0/1472150850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5238102ae0 msgr2=0x7f5238102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.281+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1472150850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5238102ae0 0x7f5238102ef0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5234009900 tx=0x7f523402a410 comp rx=0 tx=0).stop 2024-09-21T06:41:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.281+0000 7f523f8cd640 1 -- 172.21.15.49:0/1472150850 shutdown_connections 2024-09-21T06:41:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.281+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1472150850 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5238108d20 0x7f523810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.281+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1472150850 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f52381083d0 0x7f52381087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.281+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1472150850 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5238102ae0 0x7f5238102ef0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.281+0000 7f523f8cd640 1 -- 172.21.15.49:0/1472150850 >> 172.21.15.49:0/1472150850 conn(0x7f5238079760 msgr2=0x7f5238079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.281+0000 7f523f8cd640 1 -- 172.21.15.49:0/1472150850 shutdown_connections 2024-09-21T06:41:37.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.281+0000 7f523f8cd640 1 -- 172.21.15.49:0/1472150850 wait complete. 2024-09-21T06:41:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523f8cd640 1 Processor -- start 2024-09-21T06:41:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523f8cd640 1 -- start start 2024-09-21T06:41:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523f8cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5238102ae0 0x7f5238104280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523f8cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52381083d0 0x7f52381047c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523f8cd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5238108d20 0x7f5238104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523f8cd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5238112990 con 0x7f52381083d0 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523f8cd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5238112810 con 0x7f5238102ae0 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523f8cd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5238112b10 con 0x7f5238108d20 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523ce68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52381083d0 0x7f52381047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523ce68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52381083d0 0x7f52381047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57526/0 (socket says 172.21.15.49:57526) 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523ce68640 1 -- 172.21.15.49:0/1241968631 learned_addr learned my addr 172.21.15.49:0/1241968631 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523d669640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5238102ae0 0x7f5238104280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.282+0000 7f523de6a640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5238108d20 0x7f5238104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f523ce68640 1 -- 172.21.15.49:0/1241968631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5238108d20 msgr2=0x7f5238104d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f523ce68640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5238108d20 0x7f5238104d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f523ce68640 1 -- 172.21.15.49:0/1241968631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5238102ae0 msgr2=0x7f5238104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f523ce68640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5238102ae0 0x7f5238104280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f523ce68640 1 -- 172.21.15.49:0/1241968631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52381a8680 con 0x7f52381083d0 2024-09-21T06:41:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f523ce68640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52381083d0 0x7f52381047c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f522800c970 tx=0x7f522800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f522e7fc640 1 -- 172.21.15.49:0/1241968631 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228014070 con 0x7f52381083d0 2024-09-21T06:41:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f522e7fc640 1 -- 172.21.15.49:0/1241968631 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5228004440 con 0x7f52381083d0 2024-09-21T06:41:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f523f8cd640 1 -- 172.21.15.49:0/1241968631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52381a8970 con 0x7f52381083d0 2024-09-21T06:41:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f522e7fc640 1 -- 172.21.15.49:0/1241968631 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5228003e50 con 0x7f52381083d0 2024-09-21T06:41:37.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.283+0000 7f523f8cd640 1 -- 172.21.15.49:0/1241968631 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52381a8eb0 con 0x7f52381083d0 2024-09-21T06:41:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f5245e41740 1 Processor -- start 2024-09-21T06:41:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f5245e41740 1 -- start start 2024-09-21T06:41:37.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f522e7fc640 1 -- 172.21.15.49:0/1241968631 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5228017070 con 0x7f52381083d0 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f5245e41740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2077b070 0x55ab20b222c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f5245e41740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b22800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f5245e41740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2075a390 0x55ab20b22d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f5245e41740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ab20a98ea0 con 0x55ab207521b0 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f5245e41740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ab20a882d0 con 0x55ab2077b070 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f5245e41740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ab20a8c0e0 con 0x55ab2075a390 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f523d669640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b22800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f523d669640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b22800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57536/0 (socket says 172.21.15.49:57536) 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.286+0000 7f523d669640 1 -- 172.21.15.49:0/3165123896 learned_addr learned my addr 172.21.15.49:0/3165123896 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523de6a640 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2077b070 0x55ab20b222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523ce68640 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2075a390 0x55ab20b22d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523d669640 1 -- 172.21.15.49:0/3165123896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2075a390 msgr2=0x55ab20b22d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523d669640 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2075a390 0x55ab20b22d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523d669640 1 -- 172.21.15.49:0/3165123896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2077b070 msgr2=0x55ab20b222c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523d669640 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2077b070 0x55ab20b222c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523d669640 1 -- 172.21.15.49:0/3165123896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab207e6650 con 0x55ab207521b0 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523de6a640 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2077b070 0x55ab20b222c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f522e7fc640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f52240b6820 0x7f52240b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523d669640 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b22800 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5234009900 tx=0x7f5234032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75aa94da4db47f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f523de6a640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f52240b6820 0x7f52240b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.287+0000 7f522e7fc640 1 -- 172.21.15.49:0/1241968631 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f52280e7200 con 0x7f52381083d0 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.288+0000 7f52237fe640 1 -- 172.21.15.49:0/3165123896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234040070 con 0x55ab207521b0 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.288+0000 7f52237fe640 1 -- 172.21.15.49:0/3165123896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5234005db0 con 0x55ab207521b0 2024-09-21T06:41:37.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.288+0000 7f52237fe640 1 -- 172.21.15.49:0/3165123896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234035040 con 0x55ab207521b0 2024-09-21T06:41:37.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 -- 172.21.15.49:0/3165123896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 msgr2=0x55ab20b22800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f523de6a640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f52240b6820 0x7f52240b8d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5230005fd0 tx=0x7f5230009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b22800 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5234009900 tx=0x7f5234032df0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 -- 172.21.15.49:0/3165123896 shutdown_connections 2024-09-21T06:41:37.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2075a390 0x55ab20b22d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b22800 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 --2- 172.21.15.49:0/3165123896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2077b070 0x55ab20b222c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 -- 172.21.15.49:0/3165123896 >> 172.21.15.49:0/3165123896 conn(0x55ab2076f460 msgr2=0x55ab20b201b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 -- 172.21.15.49:0/3165123896 shutdown_connections 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 -- 172.21.15.49:0/3165123896 wait complete. 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 -- start start 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.289+0000 7f5245e41740 1 Processor -- start 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f5245e41740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab207521b0 0x55ab20b2d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f5245e41740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 0x55ab20b2dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f5245e41740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2077b070 0x55ab20b39d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f5245e41740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ab208e9700 con 0x55ab2077b070 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f5245e41740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ab20a23160 con 0x55ab2075a390 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f5245e41740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ab20b30a40 con 0x55ab207521b0 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f5245e41740 10 client.0 _ll_register_callbacks cb 0x55ab20a3c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:37.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523de6a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2077b070 0x55ab20b39d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523d669640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab207521b0 0x55ab20b2d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523de6a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2077b070 0x55ab20b39d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57538/0 (socket says 172.21.15.49:57538) 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523de6a640 1 -- 172.21.15.49:0/2532820089 learned_addr learned my addr 172.21.15.49:0/2532820089 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523ce68640 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 0x55ab20b2dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523de6a640 1 -- 172.21.15.49:0/2532820089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab207521b0 msgr2=0x55ab20b2d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523de6a640 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab207521b0 0x55ab20b2d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523de6a640 1 -- 172.21.15.49:0/2532820089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 msgr2=0x55ab20b2dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523de6a640 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 0x55ab20b2dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523de6a640 1 -- 172.21.15.49:0/2532820089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab20a50c90 con 0x55ab2077b070 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.290+0000 7f523d669640 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab207521b0 0x55ab20b2d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f523de6a640 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2077b070 0x55ab20b39d60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5230009b40 tx=0x7f5230004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a578c1779feac9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5220ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5220ff9640 1 -- 172.21.15.49:0/2532820089 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5230020620 con 0x55ab2077b070 2024-09-21T06:41:37.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5220ff9640 1 -- 172.21.15.49:0/2532820089 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f52300207c0 con 0x55ab2077b070 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5245e41740 1 -- 172.21.15.49:0/2532820089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5234005db0 con 0x55ab2077b070 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5220ff9640 1 -- 172.21.15.49:0/2532820089 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f52300209c0 con 0x55ab2077b070 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5245e41740 10 client.16716 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5245e41740 1 -- 172.21.15.49:0/2532820089 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ab20b3c7a0 con 0x55ab2077b070 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5220ff9640 1 -- 172.21.15.49:0/2532820089 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5234005db0 con 0x55ab2077b070 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5220ff9640 1 -- 172.21.15.49:0/2532820089 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f523000f040 con 0x55ab2077b070 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5245e41740 10 client.16716 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.291+0000 7f5245e41740 10 client.16716 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.292+0000 7f5245e41740 20 client.16716 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.292+0000 7f5245e41740 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55ab207399f0 0x55ab20b3fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.292+0000 7f5245e41740 4 client.16716 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.292+0000 7f5245e41740 1 -- 172.21.15.49:0/2532820089 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab20a9adf0 con 0x55ab207399f0 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.292+0000 7f523d669640 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55ab207399f0 0x55ab20b3fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.292+0000 7f523d669640 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55ab207399f0 0x55ab20b3fd20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e1e5435d9ddb2cf server_cookie=303d34d343ba346b in_seq=0 out_seq=0 2024-09-21T06:41:37.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.292+0000 7f5220ff9640 10 client.16716 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:41:37.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.293+0000 7f5220ff9640 1 -- 172.21.15.49:0/2532820089 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab20a9adf0 con 0x55ab207399f0 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.293+0000 7f5220ff9640 10 client.16716 handle_command_reply: tid=0 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.293+0000 7f5245e41740 1 client.16716 shutdown 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 -- 172.21.15.49:0/2532820089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2077b070 msgr2=0x55ab20b39d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2077b070 0x55ab20b39d60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5230009b40 tx=0x7f5230004a40 comp rx=0 tx=0).stop 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 -- 172.21.15.49:0/2532820089 shutdown_connections 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55ab207399f0 0x55ab20b3fd20 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2077b070 0x55ab20b39d60 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 0x55ab20b2dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 --2- 172.21.15.49:0/2532820089 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab207521b0 0x55ab20b2d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 -- 172.21.15.49:0/2532820089 >> 172.21.15.49:0/2532820089 conn(0x55ab2076f460 msgr2=0x55ab20b25450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5220ff9640 0 client.16716 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 -- 172.21.15.49:0/2532820089 shutdown_connections 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 1 -- 172.21.15.49:0/2532820089 wait complete. 2024-09-21T06:41:37.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.294+0000 7f5245e41740 20 client.16716 trim_cache size 0 max 16384 2024-09-21T06:41:37.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.307+0000 7f5245e41740 1 Processor -- start 2024-09-21T06:41:37.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.307+0000 7f5245e41740 1 -- start start 2024-09-21T06:41:37.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f5245e41740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab207521b0 0x55ab20b2de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f5245e41740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2075a390 0x55ab20b39c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f5245e41740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 0x55ab20b2ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.310 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f5245e41740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f52381b4270 con 0x55ab2075a390 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f5245e41740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52381b1b40 con 0x55ab207521b0 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f5245e41740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f52381af9b0 con 0x55ab2077b070 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523ce68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2075a390 0x55ab20b39c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523ce68640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2075a390 0x55ab20b39c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57542/0 (socket says 172.21.15.49:57542) 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523ce68640 1 -- 172.21.15.49:0/1903125238 learned_addr learned my addr 172.21.15.49:0/1903125238 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523d669640 1 --2- 172.21.15.49:0/1903125238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab207521b0 0x55ab20b2de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523de6a640 1 --2- 172.21.15.49:0/1903125238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 0x55ab20b2ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523ce68640 1 -- 172.21.15.49:0/1903125238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 msgr2=0x55ab20b2ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523ce68640 1 --2- 172.21.15.49:0/1903125238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 0x55ab20b2ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523ce68640 1 -- 172.21.15.49:0/1903125238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab207521b0 msgr2=0x55ab20b2de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523ce68640 1 --2- 172.21.15.49:0/1903125238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab207521b0 0x55ab20b2de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523ce68640 1 -- 172.21.15.49:0/1903125238 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab20739c20 con 0x55ab2075a390 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f523ce68640 1 --2- 172.21.15.49:0/1903125238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2075a390 0x55ab20b39c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f52280a9600 tx=0x7f52280ead50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46001069c46c0965 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.308+0000 7f5222ffd640 1 -- 172.21.15.49:0/1903125238 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52280a8ed0 con 0x55ab2075a390 2024-09-21T06:41:37.311 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5222ffd640 1 -- 172.21.15.49:0/1903125238 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52280acb40 con 0x55ab2075a390 2024-09-21T06:41:37.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5222ffd640 1 -- 172.21.15.49:0/1903125238 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52280ac7a0 con 0x55ab2075a390 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5245e41740 1 -- 172.21.15.49:0/1903125238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2075a390 msgr2=0x55ab20b39c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5245e41740 1 --2- 172.21.15.49:0/1903125238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2075a390 0x55ab20b39c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f52280a9600 tx=0x7f52280ead50 comp rx=0 tx=0).stop 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5245e41740 1 -- 172.21.15.49:0/1903125238 shutdown_connections 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5245e41740 1 --2- 172.21.15.49:0/1903125238 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 0x55ab20b2ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5245e41740 1 --2- 172.21.15.49:0/1903125238 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab2075a390 0x55ab20b39c60 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5245e41740 1 --2- 172.21.15.49:0/1903125238 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab207521b0 0x55ab20b2de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5245e41740 1 -- 172.21.15.49:0/1903125238 >> 172.21.15.49:0/1903125238 conn(0x55ab2076f460 msgr2=0x55ab20b2d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5245e41740 1 -- 172.21.15.49:0/1903125238 shutdown_connections 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.309+0000 7f5245e41740 1 -- 172.21.15.49:0/1903125238 wait complete. 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f5245e41740 1 -- start start 2024-09-21T06:41:37.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f5245e41740 1 Processor -- start 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f5245e41740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b36270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f5245e41740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 0x55ab20b31770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f5245e41740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 0x55ab20b31cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f5245e41740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f52381b0000 con 0x55ab207521b0 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f5245e41740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f52381b1470 con 0x55ab2075a390 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f5245e41740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f52381b06d0 con 0x55ab2077b070 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f5245e41740 10 client.0 _ll_register_callbacks cb 0x7f5230009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.310+0000 7f523d669640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b36270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523d669640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b36270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57550/0 (socket says 172.21.15.49:57550) 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523d669640 1 -- 172.21.15.49:0/2514627511 learned_addr learned my addr 172.21.15.49:0/2514627511 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523ce68640 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 0x55ab20b31770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523de6a640 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 0x55ab20b31cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523d669640 1 -- 172.21.15.49:0/2514627511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 msgr2=0x55ab20b31cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523d669640 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 0x55ab20b31cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523d669640 1 -- 172.21.15.49:0/2514627511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 msgr2=0x55ab20b31770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523d669640 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 0x55ab20b31770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523d669640 1 -- 172.21.15.49:0/2514627511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab20b32220 con 0x55ab207521b0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f523d669640 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b36270 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f52340052d0 tx=0x7f52340051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3389b7a1dec7b2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f5220ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f5220ff9640 1 -- 172.21.15.49:0/2514627511 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234035040 con 0x55ab207521b0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f5245e41740 1 -- 172.21.15.49:0/2514627511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52280acb40 con 0x55ab207521b0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f5220ff9640 1 -- 172.21.15.49:0/2514627511 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f52340316b0 con 0x55ab207521b0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f5220ff9640 1 -- 172.21.15.49:0/2514627511 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5234040040 con 0x55ab207521b0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f5245e41740 10 client.16722 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.311+0000 7f5245e41740 1 -- 172.21.15.49:0/2514627511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ab20baa490 con 0x55ab207521b0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.312+0000 7f5220ff9640 1 -- 172.21.15.49:0/2514627511 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52280acb40 con 0x55ab207521b0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.312+0000 7f5220ff9640 1 -- 172.21.15.49:0/2514627511 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5234003950 con 0x55ab207521b0 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.312+0000 7f5245e41740 10 client.16722 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:37.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.312+0000 7f5245e41740 10 client.16722 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.312+0000 7f5245e41740 20 client.16722 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.312+0000 7f5245e41740 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55ab2070eda0 0x55ab20bac730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.312+0000 7f5245e41740 4 client.16722 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.312+0000 7f5245e41740 1 -- 172.21.15.49:0/2514627511 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab20a968a0 con 0x55ab2070eda0 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.312+0000 7f523ce68640 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55ab2070eda0 0x55ab20bac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5220ff9640 10 client.16722 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f523ce68640 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55ab2070eda0 0x55ab20bac730 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a2d324099c7bfb74 server_cookie=a8387c0b87d07791 in_seq=0 out_seq=0 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5220ff9640 1 -- 172.21.15.49:0/2514627511 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab20a968a0 con 0x55ab2070eda0 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5220ff9640 10 client.16722 handle_command_reply: tid=0 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 client.16722 shutdown 2024-09-21T06:41:37.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 -- 172.21.15.49:0/2514627511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 msgr2=0x55ab20b36270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b36270 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f52340052d0 tx=0x7f52340051c0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 -- 172.21.15.49:0/2514627511 shutdown_connections 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55ab2070eda0 0x55ab20bac730 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ab2077b070 0x55ab20b31cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ab2075a390 0x55ab20b31770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 --2- 172.21.15.49:0/2514627511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ab207521b0 0x55ab20b36270 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 -- 172.21.15.49:0/2514627511 >> 172.21.15.49:0/2514627511 conn(0x55ab2076f460 msgr2=0x55ab20b232a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5220ff9640 0 client.16722 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 -- 172.21.15.49:0/2514627511 shutdown_connections 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 1 -- 172.21.15.49:0/2514627511 wait complete. 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.313+0000 7f5245e41740 20 client.16722 trim_cache size 0 max 16384 2024-09-21T06:41:37.319 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:41:37.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 -- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f52240b6820 msgr2=0x7f52240b8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f52240b6820 0x7f52240b8d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5230005fd0 tx=0x7f5230009600 comp rx=0 tx=0).stop 2024-09-21T06:41:37.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 -- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52381083d0 msgr2=0x7f52381047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52381083d0 0x7f52381047c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f522800c970 tx=0x7f522800ce30 comp rx=0 tx=0).stop 2024-09-21T06:41:37.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 -- 172.21.15.49:0/1241968631 shutdown_connections 2024-09-21T06:41:37.320 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f52240b6820 0x7f52240b8d30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5238108d20 0x7f5238104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f52381083d0 0x7f52381047c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 --2- 172.21.15.49:0/1241968631 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5238102ae0 0x7f5238104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 -- 172.21.15.49:0/1241968631 >> 172.21.15.49:0/1241968631 conn(0x7f5238079760 msgr2=0x7f5238101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 -- 172.21.15.49:0/1241968631 shutdown_connections 2024-09-21T06:41:37.321 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:37.314+0000 7f523f8cd640 1 -- 172.21.15.49:0/1241968631 wait complete. 2024-09-21T06:41:37.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:37 smithi049 ceph-mon[31177]: pgmap v468: 97 pgs: 97 active+clean; 4.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:41:37.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:37 smithi098 ceph-mon[34704]: pgmap v468: 97 pgs: 97 active+clean; 4.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:41:37.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:37 smithi079 ceph-mon[34346]: pgmap v468: 97 pgs: 97 active+clean; 4.4 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:41:38.027 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:41:38.285 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:38.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.710+0000 7fd790583640 1 -- 172.21.15.49:0/3253283575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 msgr2=0x7fd7881098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.710+0000 7fd790583640 1 --2- 172.21.15.49:0/3253283575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 0x7fd7881098c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd77c009900 tx=0x7fd77c02a410 comp rx=0 tx=0).stop 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.710+0000 7fd790583640 1 -- 172.21.15.49:0/3253283575 shutdown_connections 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.710+0000 7fd790583640 1 --2- 172.21.15.49:0/3253283575 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd788109e00 0x7fd788110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.710+0000 7fd790583640 1 --2- 172.21.15.49:0/3253283575 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 0x7fd7881098c0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.710+0000 7fd790583640 1 --2- 172.21.15.49:0/3253283575 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd788103bc0 0x7fd788103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.710+0000 7fd790583640 1 -- 172.21.15.49:0/3253283575 >> 172.21.15.49:0/3253283575 conn(0x7fd78807b910 msgr2=0x7fd78807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.710+0000 7fd790583640 1 -- 172.21.15.49:0/3253283575 shutdown_connections 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.710+0000 7fd790583640 1 -- 172.21.15.49:0/3253283575 wait complete. 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.711+0000 7fd790583640 1 Processor -- start 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.711+0000 7fd790583640 1 -- start start 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.711+0000 7fd790583640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd788103bc0 0x7fd788198f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd790583640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 0x7fd788199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd790583640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd788109e00 0x7fd78819ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd790583640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd788113ac0 con 0x7fd7881094b0 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd790583640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd788113940 con 0x7fd788103bc0 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd790583640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd788113c40 con 0x7fd788109e00 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78db1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 0x7fd788199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78db1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 0x7fd788199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57574/0 (socket says 172.21.15.49:57574) 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78db1e640 1 -- 172.21.15.49:0/3892143778 learned_addr learned my addr 172.21.15.49:0/3892143778 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78e31f640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd788103bc0 0x7fd788198f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd788109e00 0x7fd78819ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78db1e640 1 -- 172.21.15.49:0/3892143778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd788109e00 msgr2=0x7fd78819ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd788109e00 0x7fd78819ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78db1e640 1 -- 172.21.15.49:0/3892143778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd788103bc0 msgr2=0x7fd788198f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd788103bc0 0x7fd788198f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78db1e640 1 -- 172.21.15.49:0/3892143778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd788199d80 con 0x7fd7881094b0 2024-09-21T06:41:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd788109e00 0x7fd78819ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 0x7fd788199490 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd77c02a930 tx=0x7fd77c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.712+0000 7fd7877fe640 1 -- 172.21.15.49:0/3892143778 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c03f030 con 0x7fd7881094b0 2024-09-21T06:41:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.713+0000 7fd7877fe640 1 -- 172.21.15.49:0/3892143778 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd77c003aa0 con 0x7fd7881094b0 2024-09-21T06:41:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.713+0000 7fd790583640 1 -- 172.21.15.49:0/3892143778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7881a05b0 con 0x7fd7881094b0 2024-09-21T06:41:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.713+0000 7fd7877fe640 1 -- 172.21.15.49:0/3892143778 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c035070 con 0x7fd7881094b0 2024-09-21T06:41:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.713+0000 7fd790583640 1 -- 172.21.15.49:0/3892143778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7881a0ae0 con 0x7fd7881094b0 2024-09-21T06:41:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd796af7740 1 Processor -- start 2024-09-21T06:41:38.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd796af7740 1 -- start start 2024-09-21T06:41:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd796af7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fef070 0x55a4b83966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd796af7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fc61b0 0x55a4b8396be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd7877fe640 1 -- 172.21.15.49:0/3892143778 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd77c042030 con 0x7fd7881094b0 2024-09-21T06:41:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd796af7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b8397120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd796af7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a4b830cea0 con 0x55a4b7fce390 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd796af7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a4b82fc2d0 con 0x55a4b7fc61b0 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd796af7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a4b83000e0 con 0x55a4b7fef070 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.716+0000 7fd78db1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b8397120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78db1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b8397120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57586/0 (socket says 172.21.15.49:57586) 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78db1e640 1 -- 172.21.15.49:0/3902780370 learned_addr learned my addr 172.21.15.49:0/3902780370 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78e31f640 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fc61b0 0x55a4b8396be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fef070 0x55a4b83966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78db1e640 1 -- 172.21.15.49:0/3902780370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fef070 msgr2=0x55a4b83966a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fef070 0x55a4b83966a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78db1e640 1 -- 172.21.15.49:0/3902780370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fc61b0 msgr2=0x55a4b8396be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:38.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fc61b0 0x55a4b8396be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78db1e640 1 -- 172.21.15.49:0/3902780370 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b805a650 con 0x55a4b7fce390 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78e31f640 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fc61b0 0x55a4b8396be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.717+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b8397120 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd77c105480 tx=0x7fd77c1101a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52039fd80fd91729 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.718+0000 7fd784ff9640 1 -- 172.21.15.49:0/3902780370 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c110980 con 0x55a4b7fce390 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.718+0000 7fd7877fe640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7700b6700 0x7fd7700b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.718+0000 7fd784ff9640 1 -- 172.21.15.49:0/3902780370 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd77c115070 con 0x55a4b7fce390 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.718+0000 7fd784ff9640 1 -- 172.21.15.49:0/3902780370 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c118370 con 0x55a4b7fce390 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.718+0000 7fd7877fe640 1 -- 172.21.15.49:0/3892143778 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd77c107de0 con 0x7fd7881094b0 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.718+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7700b6700 0x7fd7700b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7700b6700 0x7fd7700b8c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd778005fd0 tx=0x7fd778009800 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:38.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 -- 172.21.15.49:0/3902780370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 msgr2=0x55a4b8397120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b8397120 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd77c105480 tx=0x7fd77c1101a0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 -- 172.21.15.49:0/3902780370 shutdown_connections 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b8397120 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fc61b0 0x55a4b8396be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 --2- 172.21.15.49:0/3902780370 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fef070 0x55a4b83966a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 -- 172.21.15.49:0/3902780370 >> 172.21.15.49:0/3902780370 conn(0x55a4b7fe3460 msgr2=0x55a4b8394590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 -- 172.21.15.49:0/3902780370 shutdown_connections 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 -- 172.21.15.49:0/3902780370 wait complete. 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 -- start start 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.719+0000 7fd796af7740 1 Processor -- start 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd796af7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 0x55a4b83a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd796af7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83a2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd796af7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fef070 0x55a4b83adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd796af7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a4b815d700 con 0x55a4b7fef070 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd796af7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a4b8297160 con 0x55a4b7fce390 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd796af7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a4b83a4c40 con 0x55a4b7fc61b0 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd796af7740 10 client.0 _ll_register_callbacks cb 0x55a4b82b09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78eb20640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fef070 0x55a4b83adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78eb20640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fef070 0x55a4b83adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57592/0 (socket says 172.21.15.49:57592) 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78eb20640 1 -- 172.21.15.49:0/758151754 learned_addr learned my addr 172.21.15.49:0/758151754 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78e31f640 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 0x55a4b83a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78db1e640 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78eb20640 1 -- 172.21.15.49:0/758151754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 msgr2=0x55a4b83a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78eb20640 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 0x55a4b83a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78eb20640 1 -- 172.21.15.49:0/758151754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 msgr2=0x55a4b83a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78eb20640 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83a2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78eb20640 1 -- 172.21.15.49:0/758151754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4b82c4c90 con 0x55a4b7fef070 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.720+0000 7fd78db1e640 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:38.728 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.721+0000 7fd78eb20640 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fef070 0x55a4b83adea0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd778011d40 tx=0x7fd778004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8981bde1a3ada046 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.721+0000 7fd76dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.721+0000 7fd76dffb640 1 -- 172.21.15.49:0/758151754 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77801ed30 con 0x55a4b7fef070 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.721+0000 7fd76dffb640 1 -- 172.21.15.49:0/758151754 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd77802a480 con 0x55a4b7fef070 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.721+0000 7fd796af7740 1 -- 172.21.15.49:0/758151754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd77c115070 con 0x55a4b7fef070 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.721+0000 7fd76dffb640 1 -- 172.21.15.49:0/758151754 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd77802a680 con 0x55a4b7fef070 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.721+0000 7fd796af7740 10 client.16734 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.721+0000 7fd796af7740 1 -- 172.21.15.49:0/758151754 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a4b83b0980 con 0x55a4b7fef070 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.721+0000 7fd76dffb640 1 -- 172.21.15.49:0/758151754 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd77c115070 con 0x55a4b7fef070 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd76dffb640 1 -- 172.21.15.49:0/758151754 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd77800f040 con 0x55a4b7fef070 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd796af7740 10 client.16734 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd796af7740 10 client.16734 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd796af7740 20 client.16734 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd796af7740 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a4b7fad9f0 0x55a4b83b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd796af7740 4 client.16734 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:38.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd796af7740 1 -- 172.21.15.49:0/758151754 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4b830edf0 con 0x55a4b7fad9f0 2024-09-21T06:41:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd78e31f640 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a4b7fad9f0 0x55a4b83b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd78e31f640 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a4b7fad9f0 0x55a4b83b3ed0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=922c3839e190503f server_cookie=c7fb7cb47f85c74c in_seq=0 out_seq=0 2024-09-21T06:41:38.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.722+0000 7fd76dffb640 10 client.16734 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd76dffb640 1 -- 172.21.15.49:0/758151754 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a4b830edf0 con 0x55a4b7fad9f0 2024-09-21T06:41:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd76dffb640 10 client.16734 handle_command_reply: tid=0 2024-09-21T06:41:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd796af7740 1 client.16734 shutdown 2024-09-21T06:41:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd796af7740 1 -- 172.21.15.49:0/758151754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fef070 msgr2=0x55a4b83adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd796af7740 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fef070 0x55a4b83adea0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fd778011d40 tx=0x7fd778004a40 comp rx=0 tx=0).stop 2024-09-21T06:41:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd796af7740 1 -- 172.21.15.49:0/758151754 shutdown_connections 2024-09-21T06:41:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd796af7740 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a4b7fad9f0 0x55a4b83b3ed0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd76dffb640 0 client.16734 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:38.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd796af7740 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fef070 0x55a4b83adea0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd796af7740 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83a2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd796af7740 1 --2- 172.21.15.49:0/758151754 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 0x55a4b83a1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.723+0000 7fd796af7740 1 -- 172.21.15.49:0/758151754 >> 172.21.15.49:0/758151754 conn(0x55a4b7fe3460 msgr2=0x55a4b8399830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:38.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.724+0000 7fd796af7740 1 -- 172.21.15.49:0/758151754 shutdown_connections 2024-09-21T06:41:38.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.724+0000 7fd796af7740 1 -- 172.21.15.49:0/758151754 wait complete. 2024-09-21T06:41:38.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.724+0000 7fd796af7740 20 client.16734 trim_cache size 0 max 16384 2024-09-21T06:41:38.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.737+0000 7fd796af7740 1 Processor -- start 2024-09-21T06:41:38.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.737+0000 7fd796af7740 1 -- start start 2024-09-21T06:41:38.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.737+0000 7fd796af7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fad9f0 0x55a4b83a2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.737+0000 7fd796af7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fc61b0 0x55a4b83add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.737+0000 7fd796af7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.737+0000 7fd796af7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7881c0f00 con 0x55a4b7fc61b0 2024-09-21T06:41:38.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.737+0000 7fd796af7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7881be7d0 con 0x55a4b7fce390 2024-09-21T06:41:38.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.737+0000 7fd796af7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7881bc640 con 0x55a4b7fad9f0 2024-09-21T06:41:38.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.737+0000 7fd78db1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fc61b0 0x55a4b83add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78db1e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fc61b0 0x55a4b83add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57606/0 (socket says 172.21.15.49:57606) 2024-09-21T06:41:38.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78db1e640 1 -- 172.21.15.49:0/3957144344 learned_addr learned my addr 172.21.15.49:0/3957144344 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:38.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78e31f640 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fad9f0 0x55a4b83a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78db1e640 1 -- 172.21.15.49:0/3957144344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fad9f0 msgr2=0x55a4b83a2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fad9f0 0x55a4b83a2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78db1e640 1 -- 172.21.15.49:0/3957144344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 msgr2=0x55a4b83ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78db1e640 1 -- 172.21.15.49:0/3957144344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4b83a02c0 con 0x55a4b7fc61b0 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fc61b0 0x55a4b83add60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd77c10cfd0 tx=0x7fd77c003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d205b59b219837b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd76ffff640 1 -- 172.21.15.49:0/3957144344 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c049070 con 0x55a4b7fc61b0 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd76ffff640 1 -- 172.21.15.49:0/3957144344 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd77c115070 con 0x55a4b7fc61b0 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.738+0000 7fd76ffff640 1 -- 172.21.15.49:0/3957144344 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0cd560 con 0x55a4b7fc61b0 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.739+0000 7fd796af7740 1 -- 172.21.15.49:0/3957144344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fc61b0 msgr2=0x55a4b83add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.739+0000 7fd796af7740 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fc61b0 0x55a4b83add60 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd77c10cfd0 tx=0x7fd77c003f50 comp rx=0 tx=0).stop 2024-09-21T06:41:38.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.739+0000 7fd796af7740 1 -- 172.21.15.49:0/3957144344 shutdown_connections 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.739+0000 7fd796af7740 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fce390 0x55a4b83ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.739+0000 7fd796af7740 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fc61b0 0x55a4b83add60 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.739+0000 7fd796af7740 1 --2- 172.21.15.49:0/3957144344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fad9f0 0x55a4b83a2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.739+0000 7fd796af7740 1 -- 172.21.15.49:0/3957144344 >> 172.21.15.49:0/3957144344 conn(0x55a4b7fe3460 msgr2=0x55a4b83a1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.739+0000 7fd796af7740 1 -- 172.21.15.49:0/3957144344 shutdown_connections 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.739+0000 7fd796af7740 1 -- 172.21.15.49:0/3957144344 wait complete. 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd796af7740 1 -- start start 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd796af7740 1 Processor -- start 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd796af7740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fad9f0 0x55a4b83aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd796af7740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 0x55a4b83a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd796af7740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b83a6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd796af7740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7881bcc90 con 0x55a4b7fce390 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd796af7740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7881be100 con 0x55a4b7fad9f0 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd796af7740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7881bd360 con 0x55a4b7fc61b0 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd796af7740 10 client.0 _ll_register_callbacks cb 0x7fd778009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:38.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd78eb20640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b83a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd78eb20640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b83a6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57612/0 (socket says 172.21.15.49:57612) 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd78eb20640 1 -- 172.21.15.49:0/3717586568 learned_addr learned my addr 172.21.15.49:0/3717586568 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.740+0000 7fd78e31f640 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fad9f0 0x55a4b83aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd78db1e640 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 0x55a4b83a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd78eb20640 1 -- 172.21.15.49:0/3717586568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 msgr2=0x55a4b83a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 0x55a4b83a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd78eb20640 1 -- 172.21.15.49:0/3717586568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fad9f0 msgr2=0x55a4b83aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fad9f0 0x55a4b83aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd78eb20640 1 -- 172.21.15.49:0/3717586568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4b841d8b0 con 0x55a4b7fce390 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd78eb20640 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b83a6400 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd778013d10 tx=0x7fd77801f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6799aea316cb96a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd76dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd76dffb640 1 -- 172.21.15.49:0/3717586568 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd778036070 con 0x55a4b7fce390 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd76dffb640 1 -- 172.21.15.49:0/3717586568 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd77801ed40 con 0x55a4b7fce390 2024-09-21T06:41:38.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd796af7740 1 -- 172.21.15.49:0/3717586568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd77c115070 con 0x55a4b7fce390 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd76dffb640 1 -- 172.21.15.49:0/3717586568 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd778004ab0 con 0x55a4b7fce390 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd796af7740 10 client.16740 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.741+0000 7fd796af7740 1 -- 172.21.15.49:0/3717586568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a4b841e9a0 con 0x55a4b7fce390 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.742+0000 7fd76dffb640 1 -- 172.21.15.49:0/3717586568 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd77c115070 con 0x55a4b7fce390 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.742+0000 7fd76dffb640 1 -- 172.21.15.49:0/3717586568 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd778045480 con 0x55a4b7fce390 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.742+0000 7fd796af7740 10 client.16740 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.742+0000 7fd796af7740 10 client.16740 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.742+0000 7fd796af7740 20 client.16740 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.742+0000 7fd796af7740 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a4b7fef070 0x55a4b8421190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.742+0000 7fd796af7740 4 client.16740 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.742+0000 7fd796af7740 1 -- 172.21.15.49:0/3717586568 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4b830a8a0 con 0x55a4b7fef070 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.742+0000 7fd78e31f640 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a4b7fef070 0x55a4b8421190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd76dffb640 10 client.16740 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd78e31f640 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a4b7fef070 0x55a4b8421190 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f118bacd58c0f158 server_cookie=e3eab7e97df961eb in_seq=0 out_seq=0 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd76dffb640 1 -- 172.21.15.49:0/3717586568 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4b830a8a0 con 0x55a4b7fef070 2024-09-21T06:41:38.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd76dffb640 10 client.16740 handle_command_reply: tid=0 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 client.16740 shutdown 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 -- 172.21.15.49:0/3717586568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 msgr2=0x55a4b83a6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b83a6400 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd778013d10 tx=0x7fd77801f640 comp rx=0 tx=0).stop 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 -- 172.21.15.49:0/3717586568 shutdown_connections 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a4b7fef070 0x55a4b8421190 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a4b7fce390 0x55a4b83a6400 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a4b7fc61b0 0x55a4b83a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd76dffb640 0 client.16740 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 --2- 172.21.15.49:0/3717586568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a4b7fad9f0 0x55a4b83aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 -- 172.21.15.49:0/3717586568 >> 172.21.15.49:0/3717586568 conn(0x55a4b7fe3460 msgr2=0x55a4b83976d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 -- 172.21.15.49:0/3717586568 shutdown_connections 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 1 -- 172.21.15.49:0/3717586568 wait complete. 2024-09-21T06:41:38.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.743+0000 7fd796af7740 20 client.16740 trim_cache size 0 max 16384 2024-09-21T06:41:38.751 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:41:38.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 -- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7700b6700 msgr2=0x7fd7700b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:38.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7700b6700 0x7fd7700b8c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd778005fd0 tx=0x7fd778009800 comp rx=0 tx=0).stop 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 -- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 msgr2=0x7fd788199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 0x7fd788199490 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd77c02a930 tx=0x7fd77c004270 comp rx=0 tx=0).stop 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 -- 172.21.15.49:0/3892143778 shutdown_connections 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7700b6700 0x7fd7700b8c10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd788109e00 0x7fd78819ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7881094b0 0x7fd788199490 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 --2- 172.21.15.49:0/3892143778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd788103bc0 0x7fd788198f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 -- 172.21.15.49:0/3892143778 >> 172.21.15.49:0/3892143778 conn(0x7fd78807b910 msgr2=0x7fd788107460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 -- 172.21.15.49:0/3892143778 shutdown_connections 2024-09-21T06:41:38.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:38.744+0000 7fd790583640 1 -- 172.21.15.49:0/3892143778 wait complete. 2024-09-21T06:41:39.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:39 smithi049 ceph-mon[31177]: pgmap v469: 97 pgs: 97 active+clean; 4.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-21T06:41:39.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:39 smithi098 ceph-mon[34704]: pgmap v469: 97 pgs: 97 active+clean; 4.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-21T06:41:39.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:39 smithi079 ceph-mon[34346]: pgmap v469: 97 pgs: 97 active+clean; 4.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 16 op/s 2024-09-21T06:41:40.402 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:41:40.403 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:41:40.679 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.162+0000 7f3a3becf640 1 -- 172.21.15.49:0/3270868134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102fa0 msgr2=0x7f3a3410fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.162+0000 7f3a3becf640 1 --2- 172.21.15.49:0/3270868134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102fa0 0x7f3a3410fcc0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009900 tx=0x7f3a2402a480 comp rx=0 tx=0).stop 2024-09-21T06:41:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.162+0000 7f3a3becf640 1 -- 172.21.15.49:0/3270868134 shutdown_connections 2024-09-21T06:41:41.176 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.162+0000 7f3a3becf640 1 --2- 172.21.15.49:0/3270868134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34110200 0x7f3a34112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.162+0000 7f3a3becf640 1 --2- 172.21.15.49:0/3270868134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102fa0 0x7f3a3410fcc0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.162+0000 7f3a3becf640 1 --2- 172.21.15.49:0/3270868134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a34102650 0x7f3a34102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.162+0000 7f3a3becf640 1 -- 172.21.15.49:0/3270868134 >> 172.21.15.49:0/3270868134 conn(0x7f3a34079760 msgr2=0x7f3a34079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.162+0000 7f3a3becf640 1 -- 172.21.15.49:0/3270868134 shutdown_connections 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.162+0000 7f3a3becf640 1 -- 172.21.15.49:0/3270868134 wait complete. 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3becf640 1 Processor -- start 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3becf640 1 -- start start 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3becf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102650 0x7f3a3419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3becf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34102fa0 0x7f3a3419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3becf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a34110200 0x7f3a341a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3becf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34115ca0 con 0x7f3a34102650 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3becf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34115b20 con 0x7f3a34102fa0 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3becf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3a34115e20 con 0x7f3a34110200 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a39c6b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102650 0x7f3a3419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.177 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a39c6b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102650 0x7f3a3419c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57626/0 (socket says 172.21.15.49:57626) 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a39c6b640 1 -- 172.21.15.49:0/1963782072 learned_addr learned my addr 172.21.15.49:0/1963782072 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3946a640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34102fa0 0x7f3a3419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a34110200 0x7f3a341a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a39c6b640 1 -- 172.21.15.49:0/1963782072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a34110200 msgr2=0x7f3a341a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a34110200 0x7f3a341a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a39c6b640 1 -- 172.21.15.49:0/1963782072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34102fa0 msgr2=0x7f3a3419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34102fa0 0x7f3a3419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a39c6b640 1 -- 172.21.15.49:0/1963782072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a341a25c0 con 0x7f3a34102650 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a34110200 0x7f3a341a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.163+0000 7f3a3946a640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34102fa0 0x7f3a3419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.164+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102650 0x7f3a3419c650 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000e9f0 tx=0x7f3a3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.164+0000 7f3a2affd640 1 -- 172.21.15.49:0/1963782072 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a3000cd80 con 0x7f3a34102650 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.164+0000 7f3a2affd640 1 -- 172.21.15.49:0/1963782072 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a300054d0 con 0x7f3a34102650 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.164+0000 7f3a3becf640 1 -- 172.21.15.49:0/1963782072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a341a28b0 con 0x7f3a34102650 2024-09-21T06:41:41.178 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.164+0000 7f3a2affd640 1 -- 172.21.15.49:0/1963782072 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a30010690 con 0x7f3a34102650 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.164+0000 7f3a3becf640 1 -- 172.21.15.49:0/1963782072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a341a9010 con 0x7f3a34102650 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.166+0000 7f3a2affd640 1 -- 172.21.15.49:0/1963782072 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f3a30004e90 con 0x7f3a34102650 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a42443740 1 Processor -- start 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a42443740 1 -- start start 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a42443740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2340350 0x5630b26e7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a42443740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2317490 0x5630b26e7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a42443740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 0x5630b26e7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a42443740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5630b265de60 con 0x5630b2317490 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a42443740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5630b264d290 con 0x5630b231f670 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a42443740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5630b26510a0 con 0x5630b2340350 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a39c6b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2317490 0x5630b26e7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a39c6b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2317490 0x5630b26e7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57636/0 (socket says 172.21.15.49:57636) 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a39c6b640 1 -- 172.21.15.49:0/3773745742 learned_addr learned my addr 172.21.15.49:0/3773745742 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.167+0000 7f3a2affd640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3a200b6700 0x7f3a200b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/3773745742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2340350 0x5630b26e7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.179 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a3946a640 1 --2- 172.21.15.49:0/3773745742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 0x5630b26e7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3a200b6700 0x7f3a200b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a2affd640 1 -- 172.21.15.49:0/1963782072 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f3a300e7bf0 con 0x7f3a34102650 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a39c6b640 1 -- 172.21.15.49:0/3773745742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2340350 msgr2=0x5630b26e7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/3773745742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2340350 0x5630b26e7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a39c6b640 1 -- 172.21.15.49:0/3773745742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 msgr2=0x5630b26e7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/3773745742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 0x5630b26e7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a39c6b640 1 -- 172.21.15.49:0/3773745742 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b23ab930 con 0x5630b2317490 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/3773745742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2317490 0x5630b26e7970 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3a300aac90 tx=0x7f3a30071630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f05c290aa551b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3a200b6700 0x7f3a200b8c10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009270 tx=0x7f3a2c005bd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a1ffff640 1 -- 172.21.15.49:0/3773745742 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a300ad370 con 0x5630b2317490 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a1ffff640 1 -- 172.21.15.49:0/3773745742 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a300d10d0 con 0x5630b2317490 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.168+0000 7f3a1ffff640 1 -- 172.21.15.49:0/3773745742 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a30005180 con 0x5630b2317490 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.169+0000 7f3a42443740 1 -- 172.21.15.49:0/3773745742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2317490 msgr2=0x5630b26e7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:41.180 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.169+0000 7f3a42443740 1 --2- 172.21.15.49:0/3773745742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2317490 0x5630b26e7970 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3a300aac90 tx=0x7f3a30071630 comp rx=0 tx=0).stop 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.169+0000 7f3a42443740 1 -- 172.21.15.49:0/3773745742 shutdown_connections 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.169+0000 7f3a42443740 1 --2- 172.21.15.49:0/3773745742 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 0x5630b26e7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.169+0000 7f3a42443740 1 --2- 172.21.15.49:0/3773745742 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2317490 0x5630b26e7970 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.169+0000 7f3a42443740 1 --2- 172.21.15.49:0/3773745742 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2340350 0x5630b26e7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.169+0000 7f3a42443740 1 -- 172.21.15.49:0/3773745742 >> 172.21.15.49:0/3773745742 conn(0x5630b2334740 msgr2=0x5630b26e5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.169+0000 7f3a42443740 1 -- 172.21.15.49:0/3773745742 shutdown_connections 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.169+0000 7f3a42443740 1 -- 172.21.15.49:0/3773745742 wait complete. 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a42443740 1 -- start start 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a42443740 1 Processor -- start 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a42443740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26f2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a42443740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26f3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a42443740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 0x5630b26fef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a42443740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5630b24ae890 con 0x5630b231f670 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a42443740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5630b25e7d40 con 0x5630b2340350 2024-09-21T06:41:41.181 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a42443740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5630b26f5bb0 con 0x5630b2317490 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a42443740 10 client.0 _ll_register_callbacks cb 0x5630b264bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.170+0000 7f3a3946a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3946a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26f3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57644/0 (socket says 172.21.15.49:57644) 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3946a640 1 -- 172.21.15.49:0/4148863040 learned_addr learned my addr 172.21.15.49:0/4148863040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26f2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 0x5630b26fef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3946a640 1 -- 172.21.15.49:0/4148863040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 msgr2=0x5630b26f2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3946a640 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26f2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3946a640 1 -- 172.21.15.49:0/4148863040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 msgr2=0x5630b26fef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3946a640 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 0x5630b26fef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3946a640 1 -- 172.21.15.49:0/4148863040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b26ff440 con 0x5630b231f670 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 0x5630b26fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:41.182 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a3946a640 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26f3450 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009900 tx=0x7f3a24032eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffddea1804f40d2d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4148863040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24040070 con 0x5630b231f670 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4148863040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f3a24004040 con 0x5630b231f670 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.171+0000 7f3a42443740 1 -- 172.21.15.49:0/4148863040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a300d10d0 con 0x5630b231f670 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4148863040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a24035040 con 0x5630b231f670 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a42443740 10 client.16752 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a42443740 1 -- 172.21.15.49:0/4148863040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5630b2701cb0 con 0x5630b231f670 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4148863040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a300d10d0 con 0x5630b231f670 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4148863040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3a24004880 con 0x5630b231f670 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a42443740 10 client.16752 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a42443740 10 client.16752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a42443740 20 client.16752 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:41.183 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a42443740 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5630b22fecd0 0x5630b27051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a42443740 4 client.16752 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a42443740 1 -- 172.21.15.49:0/4148863040 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630b265fdb0 con 0x5630b22fecd0 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.172+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5630b22fecd0 0x5630b27051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.173+0000 7f3a1d7fa640 10 client.16752 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.173+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5630b22fecd0 0x5630b27051d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=240c3210a925928b server_cookie=6d9a94e148dfe4b5 in_seq=0 out_seq=0 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4148863040 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630b265fdb0 con 0x5630b22fecd0 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a1d7fa640 10 client.16752 handle_command_reply: tid=0 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 client.16752 shutdown 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 -- 172.21.15.49:0/4148863040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 msgr2=0x5630b26f3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26f3450 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009900 tx=0x7f3a24032eb0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 -- 172.21.15.49:0/4148863040 shutdown_connections 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5630b22fecd0 0x5630b27051d0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 0x5630b26fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a1d7fa640 0 client.16752 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:41.184 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26f3450 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 --2- 172.21.15.49:0/4148863040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26f2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 -- 172.21.15.49:0/4148863040 >> 172.21.15.49:0/4148863040 conn(0x5630b2334740 msgr2=0x5630b26ea5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:41.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 -- 172.21.15.49:0/4148863040 shutdown_connections 2024-09-21T06:41:41.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 1 -- 172.21.15.49:0/4148863040 wait complete. 2024-09-21T06:41:41.185 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.174+0000 7f3a42443740 20 client.16752 trim_cache size 0 max 16384 2024-09-21T06:41:41.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a42443740 1 Processor -- start 2024-09-21T06:41:41.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a42443740 1 -- start start 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a42443740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26ed550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a42443740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26fee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a42443740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 0x5630b26eff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a42443740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b42b0 con 0x5630b231f670 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a42443740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b1b80 con 0x5630b2340350 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a42443740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341af9f0 con 0x5630b2317490 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a3946a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26fee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a3946a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26fee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57648/0 (socket says 172.21.15.49:57648) 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.192+0000 7f3a3946a640 1 -- 172.21.15.49:0/1703014183 learned_addr learned my addr 172.21.15.49:0/1703014183 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/1703014183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a3946a640 1 -- 172.21.15.49:0/1703014183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 msgr2=0x5630b26ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/1703014183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 0x5630b26eff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a3946a640 1 --2- 172.21.15.49:0/1703014183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a3946a640 1 -- 172.21.15.49:0/1703014183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 msgr2=0x5630b26eff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a3946a640 1 --2- 172.21.15.49:0/1703014183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 0x5630b26eff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a3946a640 1 -- 172.21.15.49:0/1703014183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630b26ea290 con 0x5630b231f670 2024-09-21T06:41:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a3946a640 1 --2- 172.21.15.49:0/1703014183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26fee00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009850 tx=0x7f3a2402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b76b25ead989779 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a1f7fe640 1 -- 172.21.15.49:0/1703014183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24051040 con 0x5630b231f670 2024-09-21T06:41:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a1f7fe640 1 -- 172.21.15.49:0/1703014183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a24031cc0 con 0x5630b231f670 2024-09-21T06:41:41.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.193+0000 7f3a1f7fe640 1 -- 172.21.15.49:0/1703014183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24040040 con 0x5630b231f670 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.194+0000 7f3a42443740 1 -- 172.21.15.49:0/1703014183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 msgr2=0x5630b26fee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.194+0000 7f3a42443740 1 --2- 172.21.15.49:0/1703014183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26fee00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009850 tx=0x7f3a2402a480 comp rx=0 tx=0).stop 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.194+0000 7f3a42443740 1 -- 172.21.15.49:0/1703014183 shutdown_connections 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.194+0000 7f3a42443740 1 --2- 172.21.15.49:0/1703014183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b2340350 0x5630b26eff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.194+0000 7f3a42443740 1 --2- 172.21.15.49:0/1703014183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b231f670 0x5630b26fee00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.194+0000 7f3a42443740 1 --2- 172.21.15.49:0/1703014183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26ed550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.194+0000 7f3a42443740 1 -- 172.21.15.49:0/1703014183 >> 172.21.15.49:0/1703014183 conn(0x5630b2334740 msgr2=0x5630b26f1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.194+0000 7f3a42443740 1 -- 172.21.15.49:0/1703014183 shutdown_connections 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.194+0000 7f3a42443740 1 -- 172.21.15.49:0/1703014183 wait complete. 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a42443740 1 -- start start 2024-09-21T06:41:41.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a42443740 1 Processor -- start 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a42443740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26f7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a42443740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 0x5630b26f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a42443740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2340350 0x5630b2768bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a42443740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b0040 con 0x5630b2340350 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a42443740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b14b0 con 0x5630b231f670 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a42443740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3a341b0710 con 0x5630b2317490 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a42443740 10 client.0 _ll_register_callbacks cb 0x7f3a24009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a3a46c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2340350 0x5630b2768bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a3a46c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2340350 0x5630b2768bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57652/0 (socket says 172.21.15.49:57652) 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a3a46c640 1 -- 172.21.15.49:0/4063840196 learned_addr learned my addr 172.21.15.49:0/4063840196 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.195+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26f7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a3946a640 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 0x5630b26f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a3a46c640 1 -- 172.21.15.49:0/4063840196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 msgr2=0x5630b26f7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:41.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26f7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a3a46c640 1 -- 172.21.15.49:0/4063840196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 msgr2=0x5630b26f7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 0x5630b26f7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a3a46c640 1 -- 172.21.15.49:0/4063840196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630b2769240 con 0x5630b2340350 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a3a46c640 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2340350 0x5630b2768bd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c011b60 tx=0x7f3a2c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639ce71e15a0958 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4063840196 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c01fd50 con 0x5630b2340350 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4063840196 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f3a2c004b20 con 0x5630b2340350 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a42443740 1 -- 172.21.15.49:0/4063840196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a24031cc0 con 0x5630b2340350 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4063840196 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3a2c004d20 con 0x5630b2340350 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a42443740 10 client.16758 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.196+0000 7f3a42443740 1 -- 172.21.15.49:0/4063840196 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5630b27705d0 con 0x5630b2340350 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4063840196 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a24031cc0 con 0x5630b2340350 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4063840196 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3a2c01d040 con 0x5630b2340350 2024-09-21T06:41:41.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a42443740 10 client.16758 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:41.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a42443740 10 client.16758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:41.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a42443740 20 client.16758 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:41.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a42443740 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5630b22d4080 0x5630b2772e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:41.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a42443740 4 client.16758 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:41:41.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a42443740 1 -- 172.21.15.49:0/4063840196 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5630b265b860 con 0x5630b22d4080 2024-09-21T06:41:41.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5630b22d4080 0x5630b2772e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:41.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a39c6b640 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5630b22d4080 0x5630b2772e40 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a779dcbfc54b66c server_cookie=d582c57ea2e03d90 in_seq=0 out_seq=0 2024-09-21T06:41:41.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.197+0000 7f3a1d7fa640 10 client.16758 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:41.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.199+0000 7f3a1d7fa640 1 -- 172.21.15.49:0/4063840196 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5630b265b860 con 0x5630b22d4080 2024-09-21T06:41:41.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.199+0000 7f3a1d7fa640 10 client.16758 handle_command_reply: tid=0 2024-09-21T06:41:41.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.199+0000 7f3a42443740 1 client.16758 shutdown 2024-09-21T06:41:41.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.199+0000 7f3a42443740 1 -- 172.21.15.49:0/4063840196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2340350 msgr2=0x5630b2768bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:41.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.199+0000 7f3a42443740 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2340350 0x5630b2768bd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c011b60 tx=0x7f3a2c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a42443740 1 -- 172.21.15.49:0/4063840196 shutdown_connections 2024-09-21T06:41:41.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a42443740 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5630b22d4080 0x5630b2772e40 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a42443740 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5630b2340350 0x5630b2768bd0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a42443740 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5630b231f670 0x5630b26f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a42443740 1 --2- 172.21.15.49:0/4063840196 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5630b2317490 0x5630b26f7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a1d7fa640 0 client.16758 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a42443740 1 -- 172.21.15.49:0/4063840196 >> 172.21.15.49:0/4063840196 conn(0x5630b2334740 msgr2=0x5630b26f1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a42443740 1 -- 172.21.15.49:0/4063840196 shutdown_connections 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a42443740 1 -- 172.21.15.49:0/4063840196 wait complete. 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a42443740 20 client.16758 trim_cache size 0 max 16384 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "e4c9e1ad-cb72-4032-a43d-11f4109274df", 2024-09-21T06:41:41.204 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:41:41.205 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:41:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.200+0000 7f3a3becf640 1 -- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3a200b6700 msgr2=0x7f3a200b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3a200b6700 0x7f3a200b8c10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c009270 tx=0x7f3a2c005bd0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 -- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102650 msgr2=0x7f3a3419c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:41.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102650 0x7f3a3419c650 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000e9f0 tx=0x7f3a3000edf0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 -- 172.21.15.49:0/1963782072 shutdown_connections 2024-09-21T06:41:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3a200b6700 0x7f3a200b8c10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3a34110200 0x7f3a341a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3a34102fa0 0x7f3a3419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 --2- 172.21.15.49:0/1963782072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3a34102650 0x7f3a3419c650 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 -- 172.21.15.49:0/1963782072 >> 172.21.15.49:0/1963782072 conn(0x7f3a34079760 msgr2=0x7f3a34109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 -- 172.21.15.49:0/1963782072 shutdown_connections 2024-09-21T06:41:41.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:41.201+0000 7f3a3becf640 1 -- 172.21.15.49:0/1963782072 wait complete. 2024-09-21T06:41:41.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:41 smithi049 ceph-mon[31177]: pgmap v470: 97 pgs: 97 active+clean; 4.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T06:41:41.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:41 smithi098 ceph-mon[34704]: pgmap v470: 97 pgs: 97 active+clean; 4.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T06:41:41.817 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:41:41.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:41 smithi079 ceph-mon[34346]: pgmap v470: 97 pgs: 97 active+clean; 4.4 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T06:41:42.076 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:42.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:42 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:41:42.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:42 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:42.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:42 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:41:42.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:42 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:41:42.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:42 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:42.474 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:42 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:42.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.517+0000 7f1c98f61640 1 -- 172.21.15.49:0/3953396107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94109e20 msgr2=0x7f1c94110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.517+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3953396107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94109e20 0x7f1c94110650 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009ca0 tx=0x7f1c8c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.517+0000 7f1c98f61640 1 -- 172.21.15.49:0/3953396107 shutdown_connections 2024-09-21T06:41:42.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.517+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3953396107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94109e20 0x7f1c94110650 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.517+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3953396107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c941094d0 0x7f1c941098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.517+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3953396107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c94103b90 0x7f1c94103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.517+0000 7f1c98f61640 1 -- 172.21.15.49:0/3953396107 >> 172.21.15.49:0/3953396107 conn(0x7f1c940ff620 msgr2=0x7f1c94101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:42.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.517+0000 7f1c98f61640 1 -- 172.21.15.49:0/3953396107 shutdown_connections 2024-09-21T06:41:42.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.517+0000 7f1c98f61640 1 -- 172.21.15.49:0/3953396107 wait complete. 2024-09-21T06:41:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.518+0000 7f1c98f61640 1 Processor -- start 2024-09-21T06:41:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.518+0000 7f1c98f61640 1 -- start start 2024-09-21T06:41:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c98f61640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94103b90 0x7f1c9419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c98f61640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c941094d0 0x7f1c9419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c98f61640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c94109e20 0x7f1c9419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c98f61640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1c94113ae0 con 0x7f1c94103b90 2024-09-21T06:41:42.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c98f61640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c94113960 con 0x7f1c94109e20 2024-09-21T06:41:42.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c98f61640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1c94113c60 con 0x7f1c941094d0 2024-09-21T06:41:42.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c9259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94103b90 0x7f1c9419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c9259c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94103b90 0x7f1c9419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57666/0 (socket says 172.21.15.49:57666) 2024-09-21T06:41:42.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c9259c640 1 -- 172.21.15.49:0/3421035705 learned_addr learned my addr 172.21.15.49:0/3421035705 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:42.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c94109e20 0x7f1c9419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.536 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c89d9b640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c941094d0 0x7f1c9419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c9259c640 1 -- 172.21.15.49:0/3421035705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c941094d0 msgr2=0x7f1c9419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c9259c640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c941094d0 0x7f1c9419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c9259c640 1 -- 172.21.15.49:0/3421035705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c94109e20 msgr2=0x7f1c9419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c9259c640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c94109e20 0x7f1c9419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c9259c640 1 -- 172.21.15.49:0/3421035705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c941a0380 con 0x7f1c94103b90 2024-09-21T06:41:42.537 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.519+0000 7f1c9259c640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94103b90 0x7f1c9419a410 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e9f0 tx=0x7f1c8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.520+0000 7f1c8bfff640 1 -- 172.21.15.49:0/3421035705 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8400cd80 con 0x7f1c94103b90 2024-09-21T06:41:42.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.520+0000 7f1c8bfff640 1 -- 172.21.15.49:0/3421035705 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c840108e0 con 0x7f1c94103b90 2024-09-21T06:41:42.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.520+0000 7f1c98f61640 1 -- 172.21.15.49:0/3421035705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c941a0670 con 0x7f1c94103b90 2024-09-21T06:41:42.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.520+0000 7f1c8bfff640 1 -- 172.21.15.49:0/3421035705 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c84018980 con 0x7f1c94103b90 2024-09-21T06:41:42.538 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.520+0000 7f1c98f61640 1 -- 172.21.15.49:0/3421035705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c941a6dd0 con 0x7f1c94103b90 2024-09-21T06:41:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.522+0000 7f1c9f4d5740 1 Processor -- start 2024-09-21T06:41:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c9f4d5740 1 -- start start 2024-09-21T06:41:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c8bfff640 1 -- 172.21.15.49:0/3421035705 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f1c84010430 con 0x7f1c94103b90 2024-09-21T06:41:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce32c070 0x558bce6d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce30b390 0x558bce6d40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.539 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558bce649e50 con 0x558bce32c070 2024-09-21T06:41:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558bce639280 con 0x558bce3031b0 2024-09-21T06:41:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558bce63d090 con 0x558bce30b390 2024-09-21T06:41:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c92d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce32c070 0x558bce6d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c92d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce32c070 0x558bce6d3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57682/0 (socket says 172.21.15.49:57682) 2024-09-21T06:41:42.540 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c92d9d640 1 -- 172.21.15.49:0/3371798075 learned_addr learned my addr 172.21.15.49:0/3371798075 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c9259c640 1 --2- 172.21.15.49:0/3371798075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c89d9b640 1 --2- 172.21.15.49:0/3371798075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce30b390 0x558bce6d40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.523+0000 7f1c92d9d640 1 -- 172.21.15.49:0/3371798075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce30b390 msgr2=0x558bce6d40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/3371798075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce30b390 0x558bce6d40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c92d9d640 1 -- 172.21.15.49:0/3371798075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 msgr2=0x558bce6d3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.541 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/3371798075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6d3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c92d9d640 1 -- 172.21.15.49:0/3371798075 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bce397650 con 0x558bce32c070 2024-09-21T06:41:42.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/3371798075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce32c070 0x558bce6d3650 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c02f4c0 tx=0x7f1c8c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81cafa686305762 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c8bfff640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1c800b6680 0x7f1c800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c88d99640 1 -- 172.21.15.49:0/3371798075 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c031cf0 con 0x558bce32c070 2024-09-21T06:41:42.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c88d99640 1 -- 172.21.15.49:0/3371798075 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c8c036030 con 0x558bce32c070 2024-09-21T06:41:42.542 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c88d99640 1 -- 172.21.15.49:0/3371798075 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c0042a0 con 0x558bce32c070 2024-09-21T06:41:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c9259c640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1c800b6680 0x7f1c800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.524+0000 7f1c8bfff640 1 -- 172.21.15.49:0/3421035705 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1c840e7a70 con 0x7f1c94103b90 2024-09-21T06:41:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3371798075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce32c070 msgr2=0x558bce6d3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/3371798075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce32c070 0x558bce6d3650 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c02f4c0 tx=0x7f1c8c009800 comp rx=0 tx=0).stop 2024-09-21T06:41:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9259c640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1c800b6680 0x7f1c800b8b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1c840e5250 tx=0x7f1c84000bc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3371798075 shutdown_connections 2024-09-21T06:41:42.543 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/3371798075 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce30b390 0x558bce6d40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/3371798075 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6d3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/3371798075 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce32c070 0x558bce6d3650 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3371798075 >> 172.21.15.49:0/3371798075 conn(0x558bce320460 msgr2=0x558bce6d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3371798075 shutdown_connections 2024-09-21T06:41:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.525+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3371798075 wait complete. 2024-09-21T06:41:42.544 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c9f4d5740 1 -- start start 2024-09-21T06:41:42.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c9f4d5740 1 Processor -- start 2024-09-21T06:41:42.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6e30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6e35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558bce49a700 con 0x558bce30b390 2024-09-21T06:41:42.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558bce5d4110 con 0x558bce3031b0 2024-09-21T06:41:42.545 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558bce6e5f80 con 0x558bce32c070 2024-09-21T06:41:42.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c9f4d5740 10 client.0 _ll_register_callbacks cb 0x558bce5ed990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:42.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c89d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6e35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c89d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6e35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57690/0 (socket says 172.21.15.49:57690) 2024-09-21T06:41:42.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.526+0000 7f1c89d9b640 1 -- 172.21.15.49:0/1224391775 learned_addr learned my addr 172.21.15.49:0/1224391775 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:42.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6e30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.546 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c89d9b640 1 -- 172.21.15.49:0/1224391775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 msgr2=0x558bce6ef2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c89d9b640 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6ef2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c89d9b640 1 -- 172.21.15.49:0/1224391775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 msgr2=0x558bce6e30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c89d9b640 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6e30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.547 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c89d9b640 1 -- 172.21.15.49:0/1224391775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bce601c40 con 0x558bce30b390 2024-09-21T06:41:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6ef2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c89d9b640 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6e35f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00ba20 tx=0x7f1c7c00bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8788c9aa2cbe9fb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1224391775 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c01b640 con 0x558bce30b390 2024-09-21T06:41:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1224391775 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1c7c01b7e0 con 0x558bce30b390 2024-09-21T06:41:42.548 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1224391775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c8c036030 con 0x558bce30b390 2024-09-21T06:41:42.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1224391775 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1c7c01b9e0 con 0x558bce30b390 2024-09-21T06:41:42.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c9f4d5740 10 client.16770 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:42.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.527+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1224391775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558bce6f1cd0 con 0x558bce30b390 2024-09-21T06:41:42.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.528+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1224391775 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c8c036030 con 0x558bce30b390 2024-09-21T06:41:42.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.528+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1224391775 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1c7c019020 con 0x558bce30b390 2024-09-21T06:41:42.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.528+0000 7f1c9f4d5740 10 client.16770 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:42.549 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.528+0000 7f1c9f4d5740 10 client.16770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.528+0000 7f1c9f4d5740 20 client.16770 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.528+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558bce2ea9f0 0x558bce6f5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.528+0000 7f1c9f4d5740 4 client.16770 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.528+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1224391775 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558bce64bda0 con 0x558bce2ea9f0 2024-09-21T06:41:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.528+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558bce2ea9f0 0x558bce6f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.550 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.529+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558bce2ea9f0 0x558bce6f5250 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61254d5b2b5f9932 server_cookie=7ae2bbe00bafb50b in_seq=0 out_seq=0 2024-09-21T06:41:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.529+0000 7f1c79ffb640 10 client.16770 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.529+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1224391775 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558bce64bda0 con 0x558bce2ea9f0 2024-09-21T06:41:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.529+0000 7f1c79ffb640 10 client.16770 handle_command_reply: tid=0 2024-09-21T06:41:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 client.16770 shutdown 2024-09-21T06:41:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1224391775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 msgr2=0x558bce6e35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.551 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6e35f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00ba20 tx=0x7f1c7c00bee0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1224391775 shutdown_connections 2024-09-21T06:41:42.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558bce2ea9f0 0x558bce6f5250 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6ef2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6e35f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1224391775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6e30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1224391775 >> 172.21.15.49:0/1224391775 conn(0x558bce320460 msgr2=0x558bce6cfb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:42.552 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c79ffb640 0 client.16770 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:42.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1224391775 shutdown_connections 2024-09-21T06:41:42.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1224391775 wait complete. 2024-09-21T06:41:42.553 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.530+0000 7f1c9f4d5740 20 client.16770 trim_cache size 0 max 16384 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.547+0000 7f1c9f4d5740 1 Processor -- start 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.547+0000 7f1c9f4d5740 1 -- start start 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce3031b0 0x558bce6ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce30b390 0x558bce6e2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6e33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1c941afe30 con 0x558bce3031b0 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c941ad700 con 0x558bce30b390 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1c941ab570 con 0x558bce32c070 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c92d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce3031b0 0x558bce6ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c92d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce3031b0 0x558bce6ef1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57706/0 (socket says 172.21.15.49:57706) 2024-09-21T06:41:42.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c92d9d640 1 -- 172.21.15.49:0/3189923157 learned_addr learned my addr 172.21.15.49:0/3189923157 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c89d9b640 1 --2- 172.21.15.49:0/3189923157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce30b390 0x558bce6e2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c92d9d640 1 -- 172.21.15.49:0/3189923157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 msgr2=0x558bce6e33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/3189923157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6e33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c92d9d640 1 -- 172.21.15.49:0/3189923157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce30b390 msgr2=0x558bce6e2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/3189923157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce30b390 0x558bce6e2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c92d9d640 1 -- 172.21.15.49:0/3189923157 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558bce6d1ec0 con 0x558bce3031b0 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/3189923157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce3031b0 0x558bce6ef1b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009a60 tx=0x7f1c8c003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aea0e4164f3c3252 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.548+0000 7f1c7bfff640 1 -- 172.21.15.49:0/3189923157 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c05d070 con 0x558bce3031b0 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c7bfff640 1 -- 172.21.15.49:0/3189923157 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c8c036070 con 0x558bce3031b0 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c7bfff640 1 -- 172.21.15.49:0/3189923157 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c0042a0 con 0x558bce3031b0 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3189923157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce3031b0 msgr2=0x558bce6ef1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/3189923157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce3031b0 0x558bce6ef1b0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009a60 tx=0x7f1c8c003c60 comp rx=0 tx=0).stop 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3189923157 shutdown_connections 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/3189923157 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6e33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/3189923157 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce30b390 0x558bce6e2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/3189923157 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce3031b0 0x558bce6ef1b0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3189923157 >> 172.21.15.49:0/3189923157 conn(0x558bce320460 msgr2=0x558bce6e1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3189923157 shutdown_connections 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.549+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/3189923157 wait complete. 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c9f4d5740 1 -- start start 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c9f4d5740 1 Processor -- start 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6eb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6d31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c9f4d5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6d3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1c941abbc0 con 0x558bce30b390 2024-09-21T06:41:42.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1c941ad030 con 0x558bce3031b0 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c9f4d5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1c941ac290 con 0x558bce32c070 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c9f4d5740 10 client.0 _ll_register_callbacks cb 0x7f1c7c004100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c89d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6d31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c89d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6d31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57712/0 (socket says 172.21.15.49:57712) 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c89d9b640 1 -- 172.21.15.49:0/1048622127 learned_addr learned my addr 172.21.15.49:0/1048622127 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.550+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6d3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c89d9b640 1 -- 172.21.15.49:0/1048622127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 msgr2=0x558bce6d3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c89d9b640 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6d3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c89d9b640 1 -- 172.21.15.49:0/1048622127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 msgr2=0x558bce6eb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c89d9b640 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6eb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c89d9b640 1 -- 172.21.15.49:0/1048622127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558bce6d3da0 con 0x558bce30b390 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6d3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c89d9b640 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6d31f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c000c00 tx=0x7f1c7c0045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70597cb8c4b273f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1048622127 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c027070 con 0x558bce30b390 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1048622127 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f1c7c011440 con 0x558bce30b390 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1048622127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c8c036070 con 0x558bce30b390 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1048622127 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1c7c011640 con 0x558bce30b390 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c9f4d5740 10 client.16776 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1048622127 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558bce6e8170 con 0x558bce30b390 2024-09-21T06:41:42.564 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.551+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1048622127 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c7c028040 con 0x558bce30b390 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1048622127 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1c7c019050 con 0x558bce30b390 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c9f4d5740 10 client.16776 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c9f4d5740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c9f4d5740 20 client.16776 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558bce2bfda0 0x558bce762220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c9f4d5740 4 client.16776 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1048622127 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f1c8c036070 con 0x558bce2bfda0 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558bce2bfda0 0x558bce762220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c79ffb640 10 client.16776 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:42.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.552+0000 7f1c92d9d640 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558bce2bfda0 0x558bce762220 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14cc519f10d44bf2 server_cookie=5c3153ffe43fad2a in_seq=0 out_seq=0 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c79ffb640 1 -- 172.21.15.49:0/1048622127 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x7f1c8c036070 con 0x558bce2bfda0 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c79ffb640 10 client.16776 handle_command_reply: tid=0 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 client.16776 shutdown 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1048622127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 msgr2=0x558bce6d31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6d31f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c000c00 tx=0x7f1c7c0045b0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1048622127 shutdown_connections 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558bce2bfda0 0x558bce762220 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558bce32c070 0x558bce6d3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558bce30b390 0x558bce6d31f0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 --2- 172.21.15.49:0/1048622127 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558bce3031b0 0x558bce6eb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1048622127 >> 172.21.15.49:0/1048622127 conn(0x558bce320460 msgr2=0x558bce6e2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c79ffb640 0 client.16776 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:42.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1048622127 shutdown_connections 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 1 -- 172.21.15.49:0/1048622127 wait complete. 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.553+0000 7f1c9f4d5740 20 client.16776 trim_cache size 0 max 16384 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "e4c9e1ad-cb72-4032-a43d-11f4109274df", 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:41:42.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:42.568 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:42.569 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:42.570 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:41:42.570 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:41:42.570 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.570 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:42.570 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:42.570 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:42.571 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:42.571 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:42.571 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:41:42.571 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:41:42.571 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.571 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:42.571 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:42.572 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:42.572 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:42.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:42.572 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:41:42.572 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:41:42.572 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.572 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:42.572 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:42.573 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:42.573 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:42.573 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:42.573 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:41:42.573 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:41:42.573 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.573 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:41:42.574 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:41:42.575 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:41:42.575 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:41:42.575 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:41:42.575 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:41:42.575 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:41:42.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:41:42.575 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:41:42.575 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:41:42.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 -- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1c800b6680 msgr2=0x7f1c800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1c800b6680 0x7f1c800b8b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1c840e5250 tx=0x7f1c84000bc0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 -- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94103b90 msgr2=0x7f1c9419a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94103b90 0x7f1c9419a410 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e9f0 tx=0x7f1c8400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 -- 172.21.15.49:0/3421035705 shutdown_connections 2024-09-21T06:41:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1c800b6680 0x7f1c800b8b90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1c94109e20 0x7f1c9419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1c941094d0 0x7f1c9419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 --2- 172.21.15.49:0/3421035705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1c94103b90 0x7f1c9419a410 secure :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e9f0 tx=0x7f1c8400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 -- 172.21.15.49:0/3421035705 >> 172.21.15.49:0/3421035705 conn(0x7f1c940ff620 msgr2=0x7f1c94106a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 -- 172.21.15.49:0/3421035705 shutdown_connections 2024-09-21T06:41:42.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:41:42.554+0000 7f1c98f61640 1 -- 172.21.15.49:0/3421035705 wait complete. 2024-09-21T06:41:42.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:42 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:41:42.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:42 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:42.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:42 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:41:42.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:42 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:41:42.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:42 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:42.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:42 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:42.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:42 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:41:42.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:42 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:42.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:42 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:41:42.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:42 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:41:42.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:42 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:42.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:42 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:42.978 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.975+0000 7fd0d3284640 1 -- 172.21.15.49:0/2136988143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108330 msgr2=0x7fd0cc108740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.975+0000 7fd0d3284640 1 --2- 172.21.15.49:0/2136988143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108330 0x7fd0cc108740 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009900 tx=0x7fd0bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.975+0000 7fd0d3284640 1 -- 172.21.15.49:0/2136988143 shutdown_connections 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.975+0000 7fd0d3284640 1 --2- 172.21.15.49:0/2136988143 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc108c80 0x7fd0cc10f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.975+0000 7fd0d3284640 1 --2- 172.21.15.49:0/2136988143 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108330 0x7fd0cc108740 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.975+0000 7fd0d3284640 1 --2- 172.21.15.49:0/2136988143 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0cc102a00 0x7fd0cc102e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.975+0000 7fd0d3284640 1 -- 172.21.15.49:0/2136988143 >> 172.21.15.49:0/2136988143 conn(0x7fd0cc07a710 msgr2=0x7fd0cc07ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.975+0000 7fd0d3284640 1 -- 172.21.15.49:0/2136988143 shutdown_connections 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.975+0000 7fd0d3284640 1 -- 172.21.15.49:0/2136988143 wait complete. 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.976+0000 7fd0d3284640 1 Processor -- start 2024-09-21T06:41:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.976+0000 7fd0d3284640 1 -- start start 2024-09-21T06:41:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.976+0000 7fd0d3284640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0cc102a00 0x7fd0cc1993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.976+0000 7fd0d3284640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc108330 0x7fd0cc199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.976+0000 7fd0d3284640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108c80 0x7fd0cc19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.976+0000 7fd0d3284640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc112940 con 0x7fd0cc108c80 2024-09-21T06:41:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.976+0000 7fd0d3284640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1127c0 con 0x7fd0cc102a00 2024-09-21T06:41:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.976+0000 7fd0d3284640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc112ac0 con 0x7fd0cc108330 2024-09-21T06:41:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1821640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108c80 0x7fd0cc19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1821640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108c80 0x7fd0cc19ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57728/0 (socket says 172.21.15.49:57728) 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1821640 1 -- 172.21.15.49:0/14650563 learned_addr learned my addr 172.21.15.49:0/14650563 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1020640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0cc102a00 0x7fd0cc1993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d081f640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc108330 0x7fd0cc199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1821640 1 -- 172.21.15.49:0/14650563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc108330 msgr2=0x7fd0cc199940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1821640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc108330 0x7fd0cc199940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1821640 1 -- 172.21.15.49:0/14650563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0cc102a00 msgr2=0x7fd0cc1993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1821640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0cc102a00 0x7fd0cc1993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1821640 1 -- 172.21.15.49:0/14650563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0cc19f2d0 con 0x7fd0cc108c80 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d1821640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108c80 0x7fd0cc19ebd0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400eb10 tx=0x7fd0c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0c27fc640 1 -- 172.21.15.49:0/14650563 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4004b20 con 0x7fd0cc108c80 2024-09-21T06:41:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0c27fc640 1 -- 172.21.15.49:0/14650563 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0c4004cc0 con 0x7fd0cc108c80 2024-09-21T06:41:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d3284640 1 -- 172.21.15.49:0/14650563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0cc19f5c0 con 0x7fd0cc108c80 2024-09-21T06:41:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0c27fc640 1 -- 172.21.15.49:0/14650563 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4010670 con 0x7fd0cc108c80 2024-09-21T06:41:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.977+0000 7fd0d3284640 1 -- 172.21.15.49:0/14650563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0cc1a5d50 con 0x7fd0cc108c80 2024-09-21T06:41:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.980+0000 7fd0da1f2740 1 Processor -- start 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.980+0000 7fd0c27fc640 1 -- 172.21.15.49:0/14650563 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd0c4005020 con 0x7fd0cc108c80 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.980+0000 7fd0da1f2740 1 -- start start 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be991b0 0x55b10c23e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 0x55b10c23eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be784d0 0x55b10c23f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b10c1b36f0 con 0x55b10be784d0 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b10c1a2b20 con 0x55b10be702f0 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b10c1a6930 con 0x55b10be991b0 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d081f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be784d0 0x55b10c23f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d081f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be784d0 0x55b10c23f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57734/0 (socket says 172.21.15.49:57734) 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d081f640 1 -- 172.21.15.49:0/1429243298 learned_addr learned my addr 172.21.15.49:0/1429243298 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d1020640 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 0x55b10c23eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d081f640 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be991b0 0x55b10c23e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d1020640 1 -- 172.21.15.49:0/1429243298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be991b0 msgr2=0x55b10c23e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d1020640 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be991b0 0x55b10c23e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d1020640 1 -- 172.21.15.49:0/1429243298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be784d0 msgr2=0x55b10c23f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d1020640 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be784d0 0x55b10c23f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d1020640 1 -- 172.21.15.49:0/1429243298 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b10c168530 con 0x55b10be702f0 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0d081f640 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be784d0 0x55b10c23f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.981+0000 7fd0c27fc640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0b80b6680 0x7fd0b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.982+0000 7fd0d1020640 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 0x55b10c23eef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009c50 tx=0x7fd0c8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c77510238f1c31d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.982+0000 7fd0d081f640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0b80b6680 0x7fd0b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.982+0000 7fd0c27fc640 1 -- 172.21.15.49:0/14650563 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd0c40e7d30 con 0x7fd0cc108c80 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.982+0000 7fd0b77fe640 1 -- 172.21.15.49:0/1429243298 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8004050 con 0x55b10be702f0 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.982+0000 7fd0b77fe640 1 -- 172.21.15.49:0/1429243298 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0c80054d0 con 0x55b10be702f0 2024-09-21T06:41:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.982+0000 7fd0b77fe640 1 -- 172.21.15.49:0/1429243298 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8004c60 con 0x55b10be702f0 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1429243298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 msgr2=0x55b10c23eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0d081f640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0b80b6680 0x7fd0b80b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0096c0 tx=0x7fd0bc040040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 0x55b10c23eef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009c50 tx=0x7fd0c8011810 comp rx=0 tx=0).stop 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1429243298 shutdown_connections 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be784d0 0x55b10c23f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 0x55b10c23eef0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1429243298 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be991b0 0x55b10c23e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1429243298 >> 172.21.15.49:0/1429243298 conn(0x55b10be8d300 msgr2=0x55b10c23c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1429243298 shutdown_connections 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1429243298 wait complete. 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 -- start start 2024-09-21T06:41:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.983+0000 7fd0da1f2740 1 Processor -- start 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be702f0 0x55b10c24a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be784d0 0x55b10c24a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be991b0 0x55b10c256450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b10c0daab0 con 0x55b10be991b0 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b10c148730 con 0x55b10be784d0 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b10c24d130 con 0x55b10be702f0 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0da1f2740 10 client.0 _ll_register_callbacks cb 0x55b10c19c6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1821640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be991b0 0x55b10c256450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1821640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be991b0 0x55b10c256450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57748/0 (socket says 172.21.15.49:57748) 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1821640 1 -- 172.21.15.49:0/1985942568 learned_addr learned my addr 172.21.15.49:0/1985942568 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d081f640 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be784d0 0x55b10c24a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1020640 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be702f0 0x55b10c24a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1821640 1 -- 172.21.15.49:0/1985942568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be702f0 msgr2=0x55b10c24a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1821640 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be702f0 0x55b10c24a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1821640 1 -- 172.21.15.49:0/1985942568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be784d0 msgr2=0x55b10c24a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1821640 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be784d0 0x55b10c24a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1821640 1 -- 172.21.15.49:0/1985942568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b10bf04790 con 0x55b10be991b0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0d1821640 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be991b0 0x55b10c256450 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40aa130 tx=0x7fd0c40d1350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a28fe30e9eee66d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.984+0000 7fd0b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/1985942568 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c40b2070 con 0x55b10be991b0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/1985942568 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd0c40b2210 con 0x55b10be991b0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1985942568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0c80054d0 con 0x55b10be991b0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/1985942568 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd0c40ad2d0 con 0x55b10be991b0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0da1f2740 10 client.16788 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1985942568 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b10bf7d620 con 0x55b10be991b0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/1985942568 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0c80054d0 con 0x55b10be991b0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/1985942568 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd0c40e5bb0 con 0x55b10be991b0 2024-09-21T06:41:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0da1f2740 10 client.16788 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0da1f2740 10 client.16788 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0da1f2740 20 client.16788 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b10be57d80 0x55b10c25c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0da1f2740 4 client.16788 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.985+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1985942568 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b10c1b5640 con 0x55b10be57d80 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.986+0000 7fd0d1020640 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b10be57d80 0x55b10c25c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.986+0000 7fd0b4ff9640 10 client.16788 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.986+0000 7fd0d1020640 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b10be57d80 0x55b10c25c200 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbf6b22232ac056 server_cookie=9d58d7b3f211e2f9 in_seq=0 out_seq=0 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/1985942568 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b10c1b5640 con 0x55b10be57d80 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0b4ff9640 10 client.16788 handle_command_reply: tid=0 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 client.16788 shutdown 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1985942568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be991b0 msgr2=0x55b10c256450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be991b0 0x55b10c256450 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40aa130 tx=0x7fd0c40d1350 comp rx=0 tx=0).stop 2024-09-21T06:41:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1985942568 shutdown_connections 2024-09-21T06:41:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b10be57d80 0x55b10c25c200 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be991b0 0x55b10c256450 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be784d0 0x55b10c24a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0b4ff9640 0 client.16788 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/1985942568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be702f0 0x55b10c24a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1985942568 >> 172.21.15.49:0/1985942568 conn(0x55b10be8d300 msgr2=0x55b10c23f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1985942568 shutdown_connections 2024-09-21T06:41:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 1 -- 172.21.15.49:0/1985942568 wait complete. 2024-09-21T06:41:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:42.987+0000 7fd0da1f2740 20 client.16788 trim_cache size 0 max 16384 2024-09-21T06:41:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0da1f2740 1 Processor -- start 2024-09-21T06:41:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0da1f2740 1 -- start start 2024-09-21T06:41:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be57d80 0x55b10c2457f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be702f0 0x55b10c2403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 0x55b10c256350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1b1030 con 0x55b10be702f0 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1ae900 con 0x55b10be57d80 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1ac770 con 0x55b10be784d0 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0d081f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be702f0 0x55b10c2403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0d081f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be702f0 0x55b10c2403a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57760/0 (socket says 172.21.15.49:57760) 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0d081f640 1 -- 172.21.15.49:0/2954931438 learned_addr learned my addr 172.21.15.49:0/2954931438 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0d1821640 1 --2- 172.21.15.49:0/2954931438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 0x55b10c256350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.003+0000 7fd0d1020640 1 --2- 172.21.15.49:0/2954931438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be57d80 0x55b10c2457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.004+0000 7fd0d081f640 1 -- 172.21.15.49:0/2954931438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 msgr2=0x55b10c256350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.004+0000 7fd0d081f640 1 --2- 172.21.15.49:0/2954931438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 0x55b10c256350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.004+0000 7fd0d081f640 1 -- 172.21.15.49:0/2954931438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be57d80 msgr2=0x55b10c2457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.004+0000 7fd0d081f640 1 --2- 172.21.15.49:0/2954931438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be57d80 0x55b10c2457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.004+0000 7fd0d081f640 1 -- 172.21.15.49:0/2954931438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b10c2445b0 con 0x55b10be702f0 2024-09-21T06:41:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.004+0000 7fd0d081f640 1 --2- 172.21.15.49:0/2954931438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be702f0 0x55b10c2403a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc006010 tx=0x7fd0bc031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762f82d0f9ae84e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.004+0000 7fd0b6ffd640 1 -- 172.21.15.49:0/2954931438 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc057070 con 0x55b10be702f0 2024-09-21T06:41:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.004+0000 7fd0b6ffd640 1 -- 172.21.15.49:0/2954931438 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0bc0035f0 con 0x55b10be702f0 2024-09-21T06:41:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.004+0000 7fd0b6ffd640 1 -- 172.21.15.49:0/2954931438 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc035040 con 0x55b10be702f0 2024-09-21T06:41:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 -- 172.21.15.49:0/2954931438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be702f0 msgr2=0x55b10c2403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/2954931438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be702f0 0x55b10c2403a0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc006010 tx=0x7fd0bc031400 comp rx=0 tx=0).stop 2024-09-21T06:41:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 -- 172.21.15.49:0/2954931438 shutdown_connections 2024-09-21T06:41:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/2954931438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 0x55b10c256350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/2954931438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be702f0 0x55b10c2403a0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/2954931438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be57d80 0x55b10c2457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 -- 172.21.15.49:0/2954931438 >> 172.21.15.49:0/2954931438 conn(0x55b10be8d300 msgr2=0x55b10c24b380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 -- 172.21.15.49:0/2954931438 shutdown_connections 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 -- 172.21.15.49:0/2954931438 wait complete. 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 -- start start 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.005+0000 7fd0da1f2740 1 Processor -- start 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be57d80 0x55b10c252c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 0x55b10c250130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0da1f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 0x55b10c250780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1acdc0 con 0x55b10be57d80 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1ae230 con 0x55b10be702f0 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0da1f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc1ad490 con 0x55b10be784d0 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0da1f2740 10 client.0 _ll_register_callbacks cb 0x7fd0c40a9fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1020640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be57d80 0x55b10c252c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1020640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be57d80 0x55b10c252c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57764/0 (socket says 172.21.15.49:57764) 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1020640 1 -- 172.21.15.49:0/3689741188 learned_addr learned my addr 172.21.15.49:0/3689741188 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1821640 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 0x55b10c250780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d081f640 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 0x55b10c250130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1020640 1 -- 172.21.15.49:0/3689741188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 msgr2=0x55b10c250780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1020640 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 0x55b10c250780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1020640 1 -- 172.21.15.49:0/3689741188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 msgr2=0x55b10c250130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1020640 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 0x55b10c250130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1020640 1 -- 172.21.15.49:0/3689741188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b10c250ef0 con 0x55b10be57d80 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0d1020640 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be57d80 0x55b10c252c70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009250 tx=0x7fd0c8011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589c287a85dbc466 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.006+0000 7fd0b4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/3689741188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8032070 con 0x55b10be57d80 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/3689741188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd0c8019430 con 0x55b10be57d80 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0da1f2740 1 -- 172.21.15.49:0/3689741188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0bc0035f0 con 0x55b10be57d80 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/3689741188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd0c803e050 con 0x55b10be57d80 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0da1f2740 10 client.16794 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0da1f2740 1 -- 172.21.15.49:0/3689741188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b10c2c8c60 con 0x55b10be57d80 2024-09-21T06:41:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/3689741188 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0bc0035f0 con 0x55b10be57d80 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/3689741188 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd0c8025420 con 0x55b10be57d80 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0da1f2740 10 client.16794 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0da1f2740 10 client.16794 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0da1f2740 20 client.16794 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b10be991b0 0x55b10c2cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0da1f2740 4 client.16794 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.007+0000 7fd0da1f2740 1 -- 172.21.15.49:0/3689741188 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b10c1b10f0 con 0x55b10be991b0 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.008+0000 7fd0d081f640 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b10be991b0 0x55b10c2cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.008+0000 7fd0d081f640 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b10be991b0 0x55b10c2cb290 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d75c090f5940fa60 server_cookie=8c4f0fd003f45d97 in_seq=0 out_seq=0 2024-09-21T06:41:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.008+0000 7fd0b4ff9640 10 client.16794 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0b4ff9640 1 -- 172.21.15.49:0/3689741188 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b10c1b10f0 con 0x55b10be991b0 2024-09-21T06:41:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0b4ff9640 10 client.16794 handle_command_reply: tid=0 2024-09-21T06:41:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0da1f2740 1 client.16794 shutdown 2024-09-21T06:41:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0da1f2740 1 -- 172.21.15.49:0/3689741188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be57d80 msgr2=0x55b10c252c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be57d80 0x55b10c252c70 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009250 tx=0x7fd0c8011d10 comp rx=0 tx=0).stop 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0da1f2740 1 -- 172.21.15.49:0/3689741188 shutdown_connections 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b10be991b0 0x55b10c2cb290 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b10be784d0 0x55b10c250780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b10be702f0 0x55b10c250130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0da1f2740 1 --2- 172.21.15.49:0/3689741188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b10be57d80 0x55b10c252c70 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0b4ff9640 0 client.16794 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.015+0000 7fd0da1f2740 1 -- 172.21.15.49:0/3689741188 >> 172.21.15.49:0/3689741188 conn(0x55b10be8d300 msgr2=0x55b10c240170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0da1f2740 1 -- 172.21.15.49:0/3689741188 shutdown_connections 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0da1f2740 1 -- 172.21.15.49:0/3689741188 wait complete. 2024-09-21T06:41:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0da1f2740 20 client.16794 trim_cache size 0 max 16384 2024-09-21T06:41:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:41:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:41:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:41:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 -- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0b80b6680 msgr2=0x7fd0b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0b80b6680 0x7fd0b80b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc0096c0 tx=0x7fd0bc040040 comp rx=0 tx=0).stop 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 -- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108c80 msgr2=0x7fd0cc19ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108c80 0x7fd0cc19ebd0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400eb10 tx=0x7fd0c400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 -- 172.21.15.49:0/14650563 shutdown_connections 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd0b80b6680 0x7fd0b80b8b90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd0cc108c80 0x7fd0cc19ebd0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd0cc108330 0x7fd0cc199940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 --2- 172.21.15.49:0/14650563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd0cc102a00 0x7fd0cc1993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 -- 172.21.15.49:0/14650563 >> 172.21.15.49:0/14650563 conn(0x7fd0cc07a710 msgr2=0x7fd0cc106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 -- 172.21.15.49:0/14650563 shutdown_connections 2024-09-21T06:41:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:43.016+0000 7fd0d3284640 1 -- 172.21.15.49:0/14650563 wait complete. 2024-09-21T06:41:43.259 INFO:tasks.cephfs.filesystem:scrub status for tag:e4c9e1ad-cb72-4032-a43d-11f4109274df - {'path': '/', 'tag': 'e4c9e1ad-cb72-4032-a43d-11f4109274df', 'options': 'recursive,force'} 2024-09-21T06:41:43.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:43 smithi049 ceph-mon[31177]: pgmap v471: 97 pgs: 97 active+clean; 4.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:41:43.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:43 smithi098 ceph-mon[34704]: pgmap v471: 97 pgs: 97 active+clean; 4.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:41:43.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:43 smithi079 ceph-mon[34346]: pgmap v471: 97 pgs: 97 active+clean; 4.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:41:45.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:45 smithi049 ceph-mon[31177]: pgmap v472: 97 pgs: 97 active+clean; 4.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:41:45.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:45 smithi098 ceph-mon[34704]: pgmap v472: 97 pgs: 97 active+clean; 4.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:41:45.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:45 smithi079 ceph-mon[34346]: pgmap v472: 97 pgs: 97 active+clean; 4.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:41:47.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:47 smithi049 ceph-mon[31177]: pgmap v473: 97 pgs: 97 active+clean; 4.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 11 op/s 2024-09-21T06:41:47.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:47 smithi098 ceph-mon[34704]: pgmap v473: 97 pgs: 97 active+clean; 4.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 11 op/s 2024-09-21T06:41:47.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:47 smithi079 ceph-mon[34346]: pgmap v473: 97 pgs: 97 active+clean; 4.5 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 17 KiB/s wr, 11 op/s 2024-09-21T06:41:49.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:49 smithi049 ceph-mon[31177]: pgmap v474: 97 pgs: 97 active+clean; 4.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-21T06:41:49.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:49 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:41:49.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:49 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:41:49.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:49 smithi098 ceph-mon[34704]: pgmap v474: 97 pgs: 97 active+clean; 4.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-21T06:41:49.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:49 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:41:49.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:49 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:41:49.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:49 smithi079 ceph-mon[34346]: pgmap v474: 97 pgs: 97 active+clean; 4.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 17 op/s 2024-09-21T06:41:49.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:49 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:41:49.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:49 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:41:51.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:51 smithi049 ceph-mon[31177]: pgmap v475: 97 pgs: 97 active+clean; 4.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-21T06:41:51.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:51 smithi098 ceph-mon[34704]: pgmap v475: 97 pgs: 97 active+clean; 4.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-21T06:41:51.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:51 smithi079 ceph-mon[34346]: pgmap v475: 97 pgs: 97 active+clean; 4.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-21T06:41:53.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:53 smithi049 ceph-mon[31177]: pgmap v476: 97 pgs: 97 active+clean; 4.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-09-21T06:41:53.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:41:53.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:41:53.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:41:53.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:41:53.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:53 smithi098 ceph-mon[34704]: pgmap v476: 97 pgs: 97 active+clean; 4.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-09-21T06:41:53.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:41:53.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:41:53.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:41:53.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:41:53.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:53 smithi079 ceph-mon[34346]: pgmap v476: 97 pgs: 97 active+clean; 4.6 MiB data, 385 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 14 op/s 2024-09-21T06:41:53.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:41:53.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:41:53.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:41:53.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:41:54.748 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.748 INFO:tasks.workunit.client.0.smithi049.stdout:189/600: open fd = 3 2024-09-21T06:41:54.748 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.748 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.748 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.748 INFO:tasks.workunit.client.0.smithi049.stdout:190/600: open fd = 3 2024-09-21T06:41:54.748 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.748 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.748 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:191/600: open fd = 3 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:192/600: open fd = 3 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:193/600: open fd = 3 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:194/600: open fd = 3 2024-09-21T06:41:54.749 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:195/600: open fd = 3 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:196/600: open fd = 3 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:197/600: open fd = 3 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.750 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:198/600: open fd = 3 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:199/600: open fd = 3 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:200/600: open fd = 3 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:201/600: open fd = 3 2024-09-21T06:41:54.751 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:202/600: open fd = 3 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:203/600: open fd = 3 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:204/600: open fd = 3 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.752 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:205/600: open fd = 3 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:206/600: open fd = 3 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:207/600: open fd = 3 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:208/600: open fd = 3 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.753 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:209/600: open fd = 3 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:210/600: open fd = 3 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:211/600: open fd = 3 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:212/600: open fd = 3 2024-09-21T06:41:54.754 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:213/600: open fd = 3 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:214/600: open fd = 3 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:215/600: open fd = 3 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.755 INFO:tasks.workunit.client.0.smithi049.stdout:216/600: open fd = 3 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:217/600: open fd = 3 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:218/600: open fd = 3 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:219/600: open fd = 3 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.756 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:220/600: open fd = 3 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:221/600: open fd = 3 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:222/600: open fd = 3 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:223/600: open fd = 3 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.757 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:224/600: open fd = 3 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:225/600: open fd = 3 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:226/600: open fd = 3 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:227/600: open fd = 3 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.758 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:228/600: open fd = 3 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:229/600: open fd = 3 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:230/600: open fd = 3 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:231/600: open fd = 3 2024-09-21T06:41:54.759 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:232/600: open fd = 3 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:233/600: open fd = 3 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:234/600: open fd = 3 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.760 INFO:tasks.workunit.client.0.smithi049.stdout:235/600: open fd = 3 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:236/600: open fd = 3 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:237/600: open fd = 3 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:238/600: open fd = 3 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.761 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:239/600: open fd = 3 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:240/600: open fd = 3 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:241/600: open fd = 3 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:242/600: open fd = 3 2024-09-21T06:41:54.762 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:243/600: open fd = 3 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:244/600: open fd = 3 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:245/600: open fd = 3 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.763 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:246/600: open fd = 3 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:247/600: open fd = 3 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:248/600: open fd = 3 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:249/600: open fd = 3 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.764 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.765 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:41:54.765 INFO:tasks.workunit.client.0.smithi049.stdout:250/600: open fd = 3 2024-09-21T06:41:54.765 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:54.765 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:41:55.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:55 smithi049 ceph-mon[31177]: pgmap v477: 97 pgs: 97 active+clean; 4.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-21T06:41:55.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:55 smithi098 ceph-mon[34704]: pgmap v477: 97 pgs: 97 active+clean; 4.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-21T06:41:55.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:55 smithi079 ceph-mon[34346]: pgmap v477: 97 pgs: 97 active+clean; 4.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 15 op/s 2024-09-21T06:41:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.132+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1302051193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48102560 msgr2=0x7f4d48102970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.132+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1302051193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48102560 0x7f4d48102970 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009900 tx=0x7f4d4402a480 comp rx=0 tx=0).stop 2024-09-21T06:41:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.132+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1302051193 shutdown_connections 2024-09-21T06:41:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.132+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1302051193 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d48110110 0x7f4d48112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.132+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1302051193 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d48102eb0 0x7f4d4810fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.132+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1302051193 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48102560 0x7f4d48102970 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.132+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1302051193 >> 172.21.15.49:0/1302051193 conn(0x7f4d4807a710 msgr2=0x7f4d4807ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.132+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1302051193 shutdown_connections 2024-09-21T06:41:56.134 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.132+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1302051193 wait complete. 2024-09-21T06:41:56.136 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4fad3640 1 Processor -- start 2024-09-21T06:41:56.136 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4fad3640 1 -- start start 2024-09-21T06:41:56.136 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4fad3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d48102560 0x7f4d4819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4fad3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d48102eb0 0x7f4d4819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4fad3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48110110 0x7f4d481a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4fad3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48115c00 con 0x7f4d48110110 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4fad3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48115a80 con 0x7f4d48102eb0 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4fad3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d48115d80 con 0x7f4d48102560 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4e070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48110110 0x7f4d481a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4e070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48110110 0x7f4d481a1e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36816/0 (socket says 172.21.15.49:36816) 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4e070640 1 -- 172.21.15.49:0/1958408750 learned_addr learned my addr 172.21.15.49:0/1958408750 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d48102560 0x7f4d4819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d48102eb0 0x7f4d4819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4e070640 1 -- 172.21.15.49:0/1958408750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d48102560 msgr2=0x7f4d4819c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4e070640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d48102560 0x7f4d4819c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.137 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4e070640 1 -- 172.21.15.49:0/1958408750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d48102eb0 msgr2=0x7f4d4819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4e070640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d48102eb0 0x7f4d4819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4e070640 1 -- 172.21.15.49:0/1958408750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d481a2590 con 0x7f4d48110110 2024-09-21T06:41:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.133+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d48102eb0 0x7f4d4819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.134+0000 7f4d4e070640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48110110 0x7f4d481a1e90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000eaa0 tx=0x7f4d4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.134+0000 7f4d3effd640 1 -- 172.21.15.49:0/1958408750 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4000cdb0 con 0x7f4d48110110 2024-09-21T06:41:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.134+0000 7f4d3effd640 1 -- 172.21.15.49:0/1958408750 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d40005020 con 0x7f4d48110110 2024-09-21T06:41:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.134+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1958408750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d481a2880 con 0x7f4d48110110 2024-09-21T06:41:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.134+0000 7f4d3effd640 1 -- 172.21.15.49:0/1958408750 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400116d0 con 0x7f4d48110110 2024-09-21T06:41:56.138 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.134+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1958408750 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d481a9010 con 0x7f4d48110110 2024-09-21T06:41:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.137+0000 7f4d56a45740 1 Processor -- start 2024-09-21T06:41:56.139 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.138+0000 7f4d3effd640 1 -- 172.21.15.49:0/1958408750 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f4d400051d0 con 0x7f4d48110110 2024-09-21T06:41:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.138+0000 7f4d56a45740 1 -- start start 2024-09-21T06:41:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.138+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce075f1b0 0x564ce0b049b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.138+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 0x564ce0b04ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.138+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce073e4d0 0x564ce0b05430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.138+0000 7f4d56a45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564ce0a796f0 con 0x564ce073e4d0 2024-09-21T06:41:56.141 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.138+0000 7f4d56a45740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564ce0a68b20 con 0x564ce07362f0 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.138+0000 7f4d56a45740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564ce0a6c930 con 0x564ce075f1b0 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.138+0000 7f4d4d06e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce073e4d0 0x564ce0b05430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d06e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce073e4d0 0x564ce0b05430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36820/0 (socket says 172.21.15.49:36820) 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d06e640 1 -- 172.21.15.49:0/1512842420 learned_addr learned my addr 172.21.15.49:0/1512842420 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/1512842420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 0x564ce0b04ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/1512842420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce075f1b0 0x564ce0b049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d06e640 1 -- 172.21.15.49:0/1512842420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce075f1b0 msgr2=0x564ce0b049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/1512842420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce075f1b0 0x564ce0b049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d06e640 1 -- 172.21.15.49:0/1512842420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 msgr2=0x564ce0b04ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/1512842420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 0x564ce0b04ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d06e640 1 -- 172.21.15.49:0/1512842420 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ce0a2e530 con 0x564ce073e4d0 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d3effd640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4d340b6700 0x7f4d340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/1512842420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce073e4d0 0x564ce0b05430 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4d38012470 tx=0x7f4d3800b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d52c55a34ec7685 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:56.142 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4d340b6700 0x7f4d340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.143 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d3effd640 1 -- 172.21.15.49:0/1958408750 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f4d400e7890 con 0x7f4d48110110 2024-09-21T06:41:56.143 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d33fff640 1 -- 172.21.15.49:0/1512842420 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d38018070 con 0x564ce073e4d0 2024-09-21T06:41:56.143 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d33fff640 1 -- 172.21.15.49:0/1512842420 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d3801db10 con 0x564ce073e4d0 2024-09-21T06:41:56.143 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.139+0000 7f4d33fff640 1 -- 172.21.15.49:0/1512842420 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d380109d0 con 0x564ce073e4d0 2024-09-21T06:41:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.140+0000 7f4d56a45740 1 -- 172.21.15.49:0/1512842420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce073e4d0 msgr2=0x564ce0b05430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.140+0000 7f4d56a45740 1 --2- 172.21.15.49:0/1512842420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce073e4d0 0x564ce0b05430 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f4d38012470 tx=0x7f4d3800b600 comp rx=0 tx=0).stop 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.140+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4d340b6700 0x7f4d340b8c10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4d44031440 tx=0x7f4d44005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.140+0000 7f4d56a45740 1 -- 172.21.15.49:0/1512842420 shutdown_connections 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.140+0000 7f4d56a45740 1 --2- 172.21.15.49:0/1512842420 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce073e4d0 0x564ce0b05430 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.140+0000 7f4d56a45740 1 --2- 172.21.15.49:0/1512842420 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 0x564ce0b04ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.140+0000 7f4d56a45740 1 --2- 172.21.15.49:0/1512842420 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce075f1b0 0x564ce0b049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.140+0000 7f4d56a45740 1 -- 172.21.15.49:0/1512842420 >> 172.21.15.49:0/1512842420 conn(0x564ce0753300 msgr2=0x564ce0b028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.141+0000 7f4d56a45740 1 -- 172.21.15.49:0/1512842420 shutdown_connections 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.141+0000 7f4d56a45740 1 -- 172.21.15.49:0/1512842420 wait complete. 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.141+0000 7f4d56a45740 1 -- start start 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.141+0000 7f4d56a45740 1 Processor -- start 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce07362f0 0x564ce0b10050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 0x564ce0b10590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.148 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce075f1b0 0x564ce0b1c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d56a45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564ce09a0ab0 con 0x564ce07362f0 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d56a45740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564ce0a0e730 con 0x564ce075f1b0 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d56a45740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564ce0b13130 con 0x564ce073e4d0 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d56a45740 10 client.0 _ll_register_callbacks cb 0x564ce0a626b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d86f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce07362f0 0x564ce0b10050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d86f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce07362f0 0x564ce0b10050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36830/0 (socket says 172.21.15.49:36830) 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d86f640 1 -- 172.21.15.49:0/3603061273 learned_addr learned my addr 172.21.15.49:0/3603061273 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 0x564ce0b10590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4e070640 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce075f1b0 0x564ce0b1c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d86f640 1 -- 172.21.15.49:0/3603061273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 msgr2=0x564ce0b10590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 0x564ce0b10590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d86f640 1 -- 172.21.15.49:0/3603061273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce075f1b0 msgr2=0x564ce0b1c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce075f1b0 0x564ce0b1c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d86f640 1 -- 172.21.15.49:0/3603061273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ce07ca790 con 0x564ce07362f0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4e070640 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce075f1b0 0x564ce0b1c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce07362f0 0x564ce0b10050 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009900 tx=0x7f4d44009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e311f3e7d6d7cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.142+0000 7f4d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d317fa640 1 -- 172.21.15.49:0/3603061273 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4404c070 con 0x564ce07362f0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d317fa640 1 -- 172.21.15.49:0/3603061273 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f4d44003cc0 con 0x564ce07362f0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d56a45740 1 -- 172.21.15.49:0/3603061273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d3801db10 con 0x564ce07362f0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d317fa640 1 -- 172.21.15.49:0/3603061273 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d44058050 con 0x564ce07362f0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d56a45740 10 client.16806 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d56a45740 1 -- 172.21.15.49:0/3603061273 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564ce0843620 con 0x564ce07362f0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d317fa640 1 -- 172.21.15.49:0/3603061273 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d3801db10 con 0x564ce07362f0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d317fa640 1 -- 172.21.15.49:0/3603061273 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d44004920 con 0x564ce07362f0 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d56a45740 10 client.16806 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d56a45740 10 client.16806 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d56a45740 20 client.16806 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564ce071dd80 0x564ce0b221b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d56a45740 4 client.16806 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.143+0000 7f4d56a45740 1 -- 172.21.15.49:0/3603061273 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ce0a7b640 con 0x564ce071dd80 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.144+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564ce071dd80 0x564ce0b221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.144+0000 7f4d317fa640 10 client.16806 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.144+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564ce071dd80 0x564ce0b221b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dde7ca4fc19dd94 server_cookie=17dba6a6cbc5fb66 in_seq=0 out_seq=0 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d317fa640 1 -- 172.21.15.49:0/3603061273 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564ce0a7b640 con 0x564ce071dd80 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d317fa640 10 client.16806 handle_command_reply: tid=0 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 client.16806 shutdown 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 -- 172.21.15.49:0/3603061273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce07362f0 msgr2=0x564ce0b10050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce07362f0 0x564ce0b10050 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009900 tx=0x7f4d44009260 comp rx=0 tx=0).stop 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 -- 172.21.15.49:0/3603061273 shutdown_connections 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564ce071dd80 0x564ce0b221b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce075f1b0 0x564ce0b1c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 0x564ce0b10590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3603061273 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce07362f0 0x564ce0b10050 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.152 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d317fa640 0 client.16806 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:56.152 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 -- 172.21.15.49:0/3603061273 >> 172.21.15.49:0/3603061273 conn(0x564ce0753300 msgr2=0x564ce0b059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:56.152 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 -- 172.21.15.49:0/3603061273 shutdown_connections 2024-09-21T06:41:56.152 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 1 -- 172.21.15.49:0/3603061273 wait complete. 2024-09-21T06:41:56.152 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.145+0000 7f4d56a45740 20 client.16806 trim_cache size 0 max 16384 2024-09-21T06:41:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d56a45740 1 Processor -- start 2024-09-21T06:41:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d56a45740 1 -- start start 2024-09-21T06:41:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 0x564ce0b063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 0x564ce0b11c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b0d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d56a45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b4390 con 0x564ce075f1b0 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d56a45740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b1c60 con 0x564ce07362f0 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d56a45740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481afad0 con 0x564ce073e4d0 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4e070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b0d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4e070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b0d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36840/0 (socket says 172.21.15.49:36840) 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4e070640 1 -- 172.21.15.49:0/3783765321 learned_addr learned my addr 172.21.15.49:0/3783765321 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/3783765321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 0x564ce0b063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/3783765321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 0x564ce0b11c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4e070640 1 -- 172.21.15.49:0/3783765321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 msgr2=0x564ce0b11c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4e070640 1 --2- 172.21.15.49:0/3783765321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 0x564ce0b11c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4e070640 1 -- 172.21.15.49:0/3783765321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 msgr2=0x564ce0b063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4e070640 1 --2- 172.21.15.49:0/3783765321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 0x564ce0b063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.161+0000 7f4d4e070640 1 -- 172.21.15.49:0/3783765321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ce0afdf50 con 0x564ce075f1b0 2024-09-21T06:41:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.162+0000 7f4d4e070640 1 --2- 172.21.15.49:0/3783765321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b0d220 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4d400e5070 tx=0x7f4d400ad290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d612edb194be04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.162+0000 7f4d337fe640 1 -- 172.21.15.49:0/3783765321 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4001f040 con 0x564ce075f1b0 2024-09-21T06:41:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.162+0000 7f4d337fe640 1 -- 172.21.15.49:0/3783765321 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d400b70e0 con 0x564ce075f1b0 2024-09-21T06:41:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.162+0000 7f4d337fe640 1 -- 172.21.15.49:0/3783765321 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400ac390 con 0x564ce075f1b0 2024-09-21T06:41:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 -- 172.21.15.49:0/3783765321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 msgr2=0x564ce0b0d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3783765321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b0d220 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4d400e5070 tx=0x7f4d400ad290 comp rx=0 tx=0).stop 2024-09-21T06:41:56.168 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 -- 172.21.15.49:0/3783765321 shutdown_connections 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3783765321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b0d220 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3783765321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce073e4d0 0x564ce0b11c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 --2- 172.21.15.49:0/3783765321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce07362f0 0x564ce0b063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 -- 172.21.15.49:0/3783765321 >> 172.21.15.49:0/3783765321 conn(0x564ce0753300 msgr2=0x564ce0b11570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 -- 172.21.15.49:0/3783765321 shutdown_connections 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 -- 172.21.15.49:0/3783765321 wait complete. 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 -- start start 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.163+0000 7f4d56a45740 1 Processor -- start 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce07362f0 0x564ce0b15df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce073e4d0 0x564ce0b163d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d56a45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b83b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d56a45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b0120 con 0x564ce075f1b0 2024-09-21T06:41:56.169 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d56a45740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b1590 con 0x564ce073e4d0 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d56a45740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4d481b07f0 con 0x564ce07362f0 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d56a45740 10 client.0 _ll_register_callbacks cb 0x7f4d44032f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4e070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b83b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4e070640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b83b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36856/0 (socket says 172.21.15.49:36856) 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4e070640 1 -- 172.21.15.49:0/467684052 learned_addr learned my addr 172.21.15.49:0/467684052 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce07362f0 0x564ce0b15df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4d06e640 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce073e4d0 0x564ce0b163d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4e070640 1 -- 172.21.15.49:0/467684052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce07362f0 msgr2=0x564ce0b15df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4e070640 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce07362f0 0x564ce0b15df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4e070640 1 -- 172.21.15.49:0/467684052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce073e4d0 msgr2=0x564ce0b163d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4e070640 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce073e4d0 0x564ce0b163d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4e070640 1 -- 172.21.15.49:0/467684052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ce0b06ee0 con 0x564ce075f1b0 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce07362f0 0x564ce0b15df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:56.170 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d4e070640 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b83b70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4d400092f0 tx=0x7f4d40005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2ed12430903ab7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.164+0000 7f4d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d317fa640 1 -- 172.21.15.49:0/467684052 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d400a9220 con 0x564ce075f1b0 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d317fa640 1 -- 172.21.15.49:0/467684052 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f4d400ac390 con 0x564ce075f1b0 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d56a45740 1 -- 172.21.15.49:0/467684052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d400b70e0 con 0x564ce075f1b0 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d317fa640 1 -- 172.21.15.49:0/467684052 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d400ac590 con 0x564ce075f1b0 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d56a45740 10 client.16812 fetch_fsmap learned FSMap version 27 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d56a45740 1 -- 172.21.15.49:0/467684052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564ce0b8c4c0 con 0x564ce075f1b0 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d317fa640 1 -- 172.21.15.49:0/467684052 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4d400b70e0 con 0x564ce075f1b0 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d317fa640 1 -- 172.21.15.49:0/467684052 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4d4000f040 con 0x564ce075f1b0 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d56a45740 10 client.16812 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d56a45740 10 client.16812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d56a45740 20 client.16812 populate_metadata read hostname 'smithi049' 2024-09-21T06:41:56.171 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d56a45740 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564ce06f31c0 0x564ce0b8eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d56a45740 4 client.16812 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:41:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d56a45740 1 -- 172.21.15.49:0/467684052 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564ce0a770f0 con 0x564ce06f31c0 2024-09-21T06:41:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.165+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564ce06f31c0 0x564ce0b8eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.166+0000 7f4d4d86f640 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564ce06f31c0 0x564ce0b8eb50 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89bc2fa19cc7c202 server_cookie=10ec47384cbed2d8 in_seq=0 out_seq=0 2024-09-21T06:41:56.172 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.166+0000 7f4d317fa640 10 client.16812 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:56.175 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d317fa640 1 -- 172.21.15.49:0/467684052 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564ce0a770f0 con 0x564ce06f31c0 2024-09-21T06:41:56.175 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d317fa640 10 client.16812 handle_command_reply: tid=0 2024-09-21T06:41:56.175 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d56a45740 1 client.16812 shutdown 2024-09-21T06:41:56.175 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d56a45740 1 -- 172.21.15.49:0/467684052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 msgr2=0x564ce0b83b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d56a45740 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b83b70 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f4d400092f0 tx=0x7f4d40005890 comp rx=0 tx=0).stop 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d56a45740 1 -- 172.21.15.49:0/467684052 shutdown_connections 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d56a45740 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564ce06f31c0 0x564ce0b8eb50 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d56a45740 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564ce075f1b0 0x564ce0b83b70 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d56a45740 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564ce073e4d0 0x564ce0b163d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d317fa640 0 client.16812 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d56a45740 1 --2- 172.21.15.49:0/467684052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564ce07362f0 0x564ce0b15df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.173+0000 7f4d56a45740 1 -- 172.21.15.49:0/467684052 >> 172.21.15.49:0/467684052 conn(0x564ce0753300 msgr2=0x564ce0b06170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d56a45740 1 -- 172.21.15.49:0/467684052 shutdown_connections 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d56a45740 1 -- 172.21.15.49:0/467684052 wait complete. 2024-09-21T06:41:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d56a45740 20 client.16812 trim_cache size 0 max 16384 2024-09-21T06:41:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:41:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:41:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:41:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:41:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4d340b6700 msgr2=0x7f4d340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4d340b6700 0x7f4d340b8c10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4d44031440 tx=0x7f4d44005a20 comp rx=0 tx=0).stop 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48110110 msgr2=0x7f4d481a1e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48110110 0x7f4d481a1e90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f4d4000eaa0 tx=0x7f4d4000ef60 comp rx=0 tx=0).stop 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1958408750 shutdown_connections 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4d340b6700 0x7f4d340b8c10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4d48110110 0x7f4d481a1e90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4d48102eb0 0x7f4d4819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 --2- 172.21.15.49:0/1958408750 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4d48102560 0x7f4d4819c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1958408750 >> 172.21.15.49:0/1958408750 conn(0x7f4d4807a710 msgr2=0x7f4d48109cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1958408750 shutdown_connections 2024-09-21T06:41:56.178 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:41:56.174+0000 7f4d4fad3640 1 -- 172.21.15.49:0/1958408750 wait complete. 2024-09-21T06:41:57.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:57 smithi049 ceph-mon[31177]: pgmap v478: 97 pgs: 97 active+clean; 4.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T06:41:57.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:57 smithi098 ceph-mon[34704]: pgmap v478: 97 pgs: 97 active+clean; 4.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T06:41:57.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:57 smithi079 ceph-mon[34346]: pgmap v478: 97 pgs: 97 active+clean; 4.7 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 11 op/s 2024-09-21T06:41:59.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:41:59 smithi049 ceph-mon[31177]: pgmap v479: 97 pgs: 97 active+clean; 4.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-09-21T06:41:59.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:41:59 smithi098 ceph-mon[34704]: pgmap v479: 97 pgs: 97 active+clean; 4.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-09-21T06:41:59.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:41:59 smithi079 ceph-mon[34346]: pgmap v479: 97 pgs: 97 active+clean; 4.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-09-21T06:42:01.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:01 smithi049 ceph-mon[31177]: pgmap v480: 97 pgs: 97 active+clean; 4.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T06:42:01.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:01 smithi098 ceph-mon[34704]: pgmap v480: 97 pgs: 97 active+clean; 4.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T06:42:01.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:01 smithi079 ceph-mon[34346]: pgmap v480: 97 pgs: 97 active+clean; 4.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 10 op/s 2024-09-21T06:42:03.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:03 smithi049 ceph-mon[31177]: pgmap v481: 97 pgs: 97 active+clean; 4.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-09-21T06:42:03.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:03 smithi098 ceph-mon[34704]: pgmap v481: 97 pgs: 97 active+clean; 4.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-09-21T06:42:03.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:03 smithi079 ceph-mon[34346]: pgmap v481: 97 pgs: 97 active+clean; 4.8 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 19 KiB/s wr, 13 op/s 2024-09-21T06:42:05.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:05 smithi049 ceph-mon[31177]: pgmap v482: 97 pgs: 97 active+clean; 4.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-09-21T06:42:05.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:05 smithi098 ceph-mon[34704]: pgmap v482: 97 pgs: 97 active+clean; 4.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-09-21T06:42:05.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:05 smithi079 ceph-mon[34346]: pgmap v482: 97 pgs: 97 active+clean; 4.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 28 op/s 2024-09-21T06:42:07.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:07 smithi049 ceph-mon[31177]: pgmap v483: 97 pgs: 97 active+clean; 4.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-09-21T06:42:07.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:07 smithi098 ceph-mon[34704]: pgmap v483: 97 pgs: 97 active+clean; 4.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-09-21T06:42:07.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:07 smithi079 ceph-mon[34346]: pgmap v483: 97 pgs: 97 active+clean; 4.9 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-09-21T06:42:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.286+0000 7f0f0f27e640 1 -- 172.21.15.49:0/884684562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f081029d0 msgr2=0x7f0f08102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/884684562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f081029d0 0x7f0f08102de0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009ca0 tx=0x7f0f0402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 -- 172.21.15.49:0/884684562 shutdown_connections 2024-09-21T06:42:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/884684562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08108c50 0x7f0f0810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/884684562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f08108300 0x7f0f08108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/884684562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f081029d0 0x7f0f08102de0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 -- 172.21.15.49:0/884684562 >> 172.21.15.49:0/884684562 conn(0x7f0f0807a710 msgr2=0x7f0f0807ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 -- 172.21.15.49:0/884684562 shutdown_connections 2024-09-21T06:42:09.289 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 -- 172.21.15.49:0/884684562 wait complete. 2024-09-21T06:42:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 Processor -- start 2024-09-21T06:42:09.290 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.287+0000 7f0f0f27e640 1 -- start start 2024-09-21T06:42:09.291 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0f27e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081029d0 0x7f0f0819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0f27e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08108300 0x7f0f0819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0f27e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f08108c50 0x7f0f0819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0f27e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0f08112910 con 0x7f0f08108c50 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0f27e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0f08112790 con 0x7f0f081029d0 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0f27e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f08112a90 con 0x7f0f08108300 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d81b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f08108c50 0x7f0f0819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d81b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f08108c50 0x7f0f0819bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57262/0 (socket says 172.21.15.49:57262) 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d81b640 1 -- 172.21.15.49:0/2671825894 learned_addr learned my addr 172.21.15.49:0/2671825894 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081029d0 0x7f0f0819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0c819640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08108300 0x7f0f0819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d81b640 1 -- 172.21.15.49:0/2671825894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08108300 msgr2=0x7f0f0819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d81b640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08108300 0x7f0f0819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d81b640 1 -- 172.21.15.49:0/2671825894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081029d0 msgr2=0x7f0f0819b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:09.292 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d81b640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081029d0 0x7f0f0819b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d81b640 1 -- 172.21.15.49:0/2671825894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f081a6480 con 0x7f0f08108c50 2024-09-21T06:42:09.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.288+0000 7f0f0d81b640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f08108c50 0x7f0f0819bd00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000c970 tx=0x7f0f0000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:09.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.289+0000 7f0efe7fc640 1 -- 172.21.15.49:0/2671825894 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00007bb0 con 0x7f0f08108c50 2024-09-21T06:42:09.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.289+0000 7f0efe7fc640 1 -- 172.21.15.49:0/2671825894 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f00007d50 con 0x7f0f08108c50 2024-09-21T06:42:09.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.289+0000 7f0f0f27e640 1 -- 172.21.15.49:0/2671825894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f081a6770 con 0x7f0f08108c50 2024-09-21T06:42:09.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.289+0000 7f0efe7fc640 1 -- 172.21.15.49:0/2671825894 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00004e60 con 0x7f0f08108c50 2024-09-21T06:42:09.293 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.289+0000 7f0f0f27e640 1 -- 172.21.15.49:0/2671825894 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f081a6cc0 con 0x7f0f08108c50 2024-09-21T06:42:09.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f161e9740 1 Processor -- start 2024-09-21T06:42:09.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0efe7fc640 1 -- 172.21.15.49:0/2671825894 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0f00005020 con 0x7f0f08108c50 2024-09-21T06:42:09.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f161e9740 1 -- start start 2024-09-21T06:42:09.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 0x559b2b2959b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.295 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b295ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 0x559b2b296430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f161e9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559b2b20a6f0 con 0x559b2aec72f0 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f161e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b2b1f9b20 con 0x559b2aef01b0 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f161e9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559b2b1fd930 con 0x559b2aecf4d0 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f0d01a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b295ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f0d01a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b295ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57268/0 (socket says 172.21.15.49:57268) 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.292+0000 7f0f0d01a640 1 -- 172.21.15.49:0/1280885739 learned_addr learned my addr 172.21.15.49:0/1280885739 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0f0c819640 1 --2- 172.21.15.49:0/1280885739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 0x559b2b296430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0f0c819640 1 --2- 172.21.15.49:0/1280885739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 0x559b2b2959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0efe7fc640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ef40b6700 0x7f0ef40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0f0d01a640 1 -- 172.21.15.49:0/1280885739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 msgr2=0x559b2b296430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/1280885739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 0x559b2b296430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0f0d01a640 1 -- 172.21.15.49:0/1280885739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 msgr2=0x559b2b2959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/1280885739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 0x559b2b2959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0f0d01a640 1 -- 172.21.15.49:0/1280885739 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2b1bf530 con 0x559b2aec72f0 2024-09-21T06:42:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0f0d81b640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ef40b6700 0x7f0ef40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0efe7fc640 1 -- 172.21.15.49:0/2671825894 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0f000e72e0 con 0x7f0f08108c50 2024-09-21T06:42:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/1280885739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b295ef0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009ca0 tx=0x7f0f04031af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b2bea51f3c4f2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0ef37fe640 1 -- 172.21.15.49:0/1280885739 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04031450 con 0x559b2aec72f0 2024-09-21T06:42:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0ef37fe640 1 -- 172.21.15.49:0/1280885739 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f04036030 con 0x559b2aec72f0 2024-09-21T06:42:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.293+0000 7f0ef37fe640 1 -- 172.21.15.49:0/1280885739 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04004440 con 0x559b2aec72f0 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f161e9740 1 -- 172.21.15.49:0/1280885739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 msgr2=0x559b2b295ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1280885739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b295ef0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009ca0 tx=0x7f0f04031af0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f0d81b640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ef40b6700 0x7f0ef40b8c10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0f000e5010 tx=0x7f0f000716a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f161e9740 1 -- 172.21.15.49:0/1280885739 shutdown_connections 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1280885739 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 0x559b2b296430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1280885739 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b295ef0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1280885739 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 0x559b2b2959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f161e9740 1 -- 172.21.15.49:0/1280885739 >> 172.21.15.49:0/1280885739 conn(0x559b2aee4300 msgr2=0x559b2b2938a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f161e9740 1 -- 172.21.15.49:0/1280885739 shutdown_connections 2024-09-21T06:42:09.301 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.294+0000 7f0f161e9740 1 -- 172.21.15.49:0/1280885739 wait complete. 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f161e9740 1 -- start start 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f161e9740 1 Processor -- start 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b2a1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aecf4d0 0x559b2b2a1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aef01b0 0x559b2b2ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f161e9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559b2b131ab0 con 0x559b2aec72f0 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f161e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559b2b19f730 con 0x559b2aecf4d0 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f161e9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559b2b2a3f50 con 0x559b2aef01b0 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f161e9740 10 client.0 _ll_register_callbacks cb 0x559b2b1f36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.295+0000 7f0f0c819640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b2a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0c819640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b2a1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57274/0 (socket says 172.21.15.49:57274) 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0c819640 1 -- 172.21.15.49:0/3752159052 learned_addr learned my addr 172.21.15.49:0/3752159052 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aecf4d0 0x559b2b2a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.302 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0c819640 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aef01b0 0x559b2b2ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0c819640 1 -- 172.21.15.49:0/3752159052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aef01b0 msgr2=0x559b2b2ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0c819640 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aef01b0 0x559b2b2ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0c819640 1 -- 172.21.15.49:0/3752159052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aecf4d0 msgr2=0x559b2b2a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0c819640 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aecf4d0 0x559b2b2a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0c819640 1 -- 172.21.15.49:0/3752159052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2af5b790 con 0x559b2aec72f0 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f0c819640 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b2a1000 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8014f50 tx=0x7f0ef800eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d15dee13974c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0ef0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/3752159052 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80130d0 con 0x559b2aec72f0 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/3752159052 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0ef8005020 con 0x559b2aec72f0 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f161e9740 1 -- 172.21.15.49:0/3752159052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f04036030 con 0x559b2aec72f0 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/3752159052 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ef8026050 con 0x559b2aec72f0 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f161e9740 10 client.16824 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.296+0000 7f0f161e9740 1 -- 172.21.15.49:0/3752159052 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b2afd4620 con 0x559b2aec72f0 2024-09-21T06:42:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.297+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/3752159052 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f04036030 con 0x559b2aec72f0 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.297+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/3752159052 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0ef8004c90 con 0x559b2aec72f0 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.297+0000 7f0f161e9740 10 client.16824 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.297+0000 7f0f161e9740 10 client.16824 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.297+0000 7f0f161e9740 20 client.16824 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.297+0000 7f0f161e9740 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x559b2aeaed80 0x559b2b2b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.297+0000 7f0f161e9740 4 client.16824 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.297+0000 7f0f161e9740 1 -- 172.21.15.49:0/3752159052 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b2b20c640 con 0x559b2aeaed80 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.297+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x559b2aeaed80 0x559b2b2b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.298+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x559b2aeaed80 0x559b2b2b2fb0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d17898c943159aa server_cookie=6eab296093a81128 in_seq=0 out_seq=0 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.298+0000 7f0ef0ff9640 10 client.16824 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.298+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/3752159052 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b2b20c640 con 0x559b2aeaed80 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.298+0000 7f0ef0ff9640 10 client.16824 handle_command_reply: tid=0 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.298+0000 7f0f161e9740 1 client.16824 shutdown 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 -- 172.21.15.49:0/3752159052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 msgr2=0x559b2b2a1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b2a1000 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8014f50 tx=0x7f0ef800eb30 comp rx=0 tx=0).stop 2024-09-21T06:42:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 -- 172.21.15.49:0/3752159052 shutdown_connections 2024-09-21T06:42:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x559b2aeaed80 0x559b2b2b2fb0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aef01b0 0x559b2b2ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0ef0ff9640 0 client.16824 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aecf4d0 0x559b2b2a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 --2- 172.21.15.49:0/3752159052 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aec72f0 0x559b2b2a1000 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 -- 172.21.15.49:0/3752159052 >> 172.21.15.49:0/3752159052 conn(0x559b2aee4300 msgr2=0x559b2b2969e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 -- 172.21.15.49:0/3752159052 shutdown_connections 2024-09-21T06:42:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 1 -- 172.21.15.49:0/3752159052 wait complete. 2024-09-21T06:42:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.299+0000 7f0f161e9740 20 client.16824 trim_cache size 0 max 16384 2024-09-21T06:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f161e9740 1 Processor -- start 2024-09-21T06:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f161e9740 1 -- start start 2024-09-21T06:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aec72f0 0x559b2b2ad170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aecf4d0 0x559b2b2a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 0x559b2b29e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f161e9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0f081b1fe0 con 0x559b2aecf4d0 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f161e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0f081af8b0 con 0x559b2aef01b0 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f161e9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f081ad720 con 0x559b2aec72f0 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0d01a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aecf4d0 0x559b2b2a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0d01a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aecf4d0 0x559b2b2a2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57284/0 (socket says 172.21.15.49:57284) 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0d01a640 1 -- 172.21.15.49:0/170490025 learned_addr learned my addr 172.21.15.49:0/170490025 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0c819640 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aec72f0 0x559b2b2ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0c819640 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 0x559b2b29e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0d01a640 1 -- 172.21.15.49:0/170490025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aec72f0 msgr2=0x559b2b2ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aec72f0 0x559b2b2ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0d01a640 1 -- 172.21.15.49:0/170490025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 msgr2=0x559b2b29e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 0x559b2b29e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0d01a640 1 -- 172.21.15.49:0/170490025 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b2b29f510 con 0x559b2aecf4d0 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.314+0000 7f0f0c819640 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 0x559b2b29e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.315+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aecf4d0 0x559b2b2a2c30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009a60 tx=0x7f0f040040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846073ed1f361cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.315+0000 7f0ef2ffd640 1 -- 172.21.15.49:0/170490025 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0404a040 con 0x559b2aecf4d0 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.315+0000 7f0ef2ffd640 1 -- 172.21.15.49:0/170490025 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f0405e070 con 0x559b2aecf4d0 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.315+0000 7f0ef2ffd640 1 -- 172.21.15.49:0/170490025 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040043b0 con 0x559b2aecf4d0 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.315+0000 7f0f161e9740 1 -- 172.21.15.49:0/170490025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aecf4d0 msgr2=0x559b2b2a2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.315+0000 7f0f161e9740 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aecf4d0 0x559b2b2a2c30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009a60 tx=0x7f0f040040e0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 -- 172.21.15.49:0/170490025 shutdown_connections 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aef01b0 0x559b2b29e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aecf4d0 0x559b2b2a2c30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 --2- 172.21.15.49:0/170490025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aec72f0 0x559b2b2ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 -- 172.21.15.49:0/170490025 >> 172.21.15.49:0/170490025 conn(0x559b2aee4300 msgr2=0x559b2b2a2520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 -- 172.21.15.49:0/170490025 shutdown_connections 2024-09-21T06:42:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 -- 172.21.15.49:0/170490025 wait complete. 2024-09-21T06:42:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 -- start start 2024-09-21T06:42:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 Processor -- start 2024-09-21T06:42:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aec72f0 0x559b2b2a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 0x559b2b2a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.316+0000 7f0f161e9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aef01b0 0x559b2b315a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f161e9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0f081add70 con 0x559b2aef01b0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f161e9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0f081af1e0 con 0x559b2aec72f0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f161e9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0f081ae440 con 0x559b2aecf4d0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f161e9740 10 client.0 _ll_register_callbacks cb 0x7f0ef800e830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aef01b0 0x559b2b315a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aef01b0 0x559b2b315a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57292/0 (socket says 172.21.15.49:57292) 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 -- 172.21.15.49:0/1535689296 learned_addr learned my addr 172.21.15.49:0/1535689296 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aec72f0 0x559b2b2a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 0x559b2b2a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 -- 172.21.15.49:0/1535689296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 msgr2=0x559b2b2a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 0x559b2b2a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 -- 172.21.15.49:0/1535689296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aec72f0 msgr2=0x559b2b2a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aec72f0 0x559b2b2a6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 -- 172.21.15.49:0/1535689296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b2b316070 con 0x559b2aef01b0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f0c819640 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aef01b0 0x559b2b315a00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8014f50 tx=0x7f0ef800eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881bd925182d0ada server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0ef0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/1535689296 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef8014260 con 0x559b2aef01b0 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/1535689296 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0ef80050c0 con 0x559b2aef01b0 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.317+0000 7f0f161e9740 1 -- 172.21.15.49:0/1535689296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f0405e070 con 0x559b2aef01b0 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/1535689296 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0ef803c050 con 0x559b2aef01b0 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0f161e9740 10 client.16830 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0f161e9740 1 -- 172.21.15.49:0/1535689296 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559b2b31d330 con 0x559b2aef01b0 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/1535689296 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f0405e070 con 0x559b2aef01b0 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/1535689296 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0ef800fc40 con 0x559b2aef01b0 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0f161e9740 10 client.16830 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0f161e9740 10 client.16830 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0f161e9740 20 client.16830 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x559b2ae841c0 0x559b2b31fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0f161e9740 4 client.16830 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0f161e9740 1 -- 172.21.15.49:0/1535689296 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559b2b2080f0 con 0x559b2ae841c0 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.318+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x559b2ae841c0 0x559b2b31fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.319+0000 7f0f0d01a640 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x559b2ae841c0 0x559b2b31fa90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96c6a9e53e5ff30b server_cookie=5848c619c269f2ac in_seq=0 out_seq=0 2024-09-21T06:42:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.319+0000 7f0ef0ff9640 10 client.16830 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0ef0ff9640 1 -- 172.21.15.49:0/1535689296 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559b2b2080f0 con 0x559b2ae841c0 2024-09-21T06:42:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0ef0ff9640 10 client.16830 handle_command_reply: tid=0 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 client.16830 shutdown 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 -- 172.21.15.49:0/1535689296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aef01b0 msgr2=0x559b2b315a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aef01b0 0x559b2b315a00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8014f50 tx=0x7f0ef800eb30 comp rx=0 tx=0).stop 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 -- 172.21.15.49:0/1535689296 shutdown_connections 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x559b2ae841c0 0x559b2b31fa90 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559b2aef01b0 0x559b2b315a00 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559b2aecf4d0 0x559b2b2a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0ef0ff9640 0 client.16830 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 --2- 172.21.15.49:0/1535689296 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559b2aec72f0 0x559b2b2a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 -- 172.21.15.49:0/1535689296 >> 172.21.15.49:0/1535689296 conn(0x559b2aee4300 msgr2=0x559b2b293880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 -- 172.21.15.49:0/1535689296 shutdown_connections 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.326+0000 7f0f161e9740 1 -- 172.21.15.49:0/1535689296 wait complete. 2024-09-21T06:42:09.329 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f161e9740 20 client.16830 trim_cache size 0 max 16384 2024-09-21T06:42:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:42:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:42:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:42:09.330 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:42:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 -- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ef40b6700 msgr2=0x7f0ef40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ef40b6700 0x7f0ef40b8c10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0f000e5010 tx=0x7f0f000716a0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 -- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f08108c50 msgr2=0x7f0f0819bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f08108c50 0x7f0f0819bd00 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000c970 tx=0x7f0f0000ce30 comp rx=0 tx=0).stop 2024-09-21T06:42:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 -- 172.21.15.49:0/2671825894 shutdown_connections 2024-09-21T06:42:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0ef40b6700 0x7f0ef40b8c10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0f08108c50 0x7f0f0819bd00 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0f08108300 0x7f0f0819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.331 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 --2- 172.21.15.49:0/2671825894 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0f081029d0 0x7f0f0819b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 -- 172.21.15.49:0/2671825894 >> 172.21.15.49:0/2671825894 conn(0x7f0f0807a710 msgr2=0x7f0f081013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 -- 172.21.15.49:0/2671825894 shutdown_connections 2024-09-21T06:42:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:09.327+0000 7f0f0f27e640 1 -- 172.21.15.49:0/2671825894 wait complete. 2024-09-21T06:42:09.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:09 smithi049 ceph-mon[31177]: pgmap v484: 97 pgs: 97 active+clean; 5.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-21T06:42:09.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:09 smithi098 ceph-mon[34704]: pgmap v484: 97 pgs: 97 active+clean; 5.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-21T06:42:09.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:09 smithi079 ceph-mon[34346]: pgmap v484: 97 pgs: 97 active+clean; 5.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 47 KiB/s wr, 31 op/s 2024-09-21T06:42:11.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:11 smithi049 ceph-mon[31177]: pgmap v485: 97 pgs: 97 active+clean; 5.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 KiB/s wr, 25 op/s 2024-09-21T06:42:11.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:11 smithi098 ceph-mon[34704]: pgmap v485: 97 pgs: 97 active+clean; 5.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 KiB/s wr, 25 op/s 2024-09-21T06:42:11.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:11 smithi079 ceph-mon[34346]: pgmap v485: 97 pgs: 97 active+clean; 5.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 38 KiB/s wr, 25 op/s 2024-09-21T06:42:13.259 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:42:13.535 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:13.656 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:13 smithi049 ceph-mon[31177]: pgmap v486: 97 pgs: 97 active+clean; 5.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 43 KiB/s wr, 28 op/s 2024-09-21T06:42:13.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:13 smithi098 ceph-mon[34704]: pgmap v486: 97 pgs: 97 active+clean; 5.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 43 KiB/s wr, 28 op/s 2024-09-21T06:42:13.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:13 smithi079 ceph-mon[34346]: pgmap v486: 97 pgs: 97 active+clean; 5.0 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 43 KiB/s wr, 28 op/s 2024-09-21T06:42:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.026+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4147306648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 msgr2=0x7f38b81087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.026+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4147306648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 0x7f38b81087f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009900 tx=0x7f38ac02a410 comp rx=0 tx=0).stop 2024-09-21T06:42:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.026+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4147306648 shutdown_connections 2024-09-21T06:42:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.026+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4147306648 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b8108d30 0x7f38b810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.026+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4147306648 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 0x7f38b81087f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.026+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4147306648 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38b8102aa0 0x7f38b8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.026+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4147306648 >> 172.21.15.49:0/4147306648 conn(0x7f38b8079750 msgr2=0x7f38b8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:14.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.026+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4147306648 shutdown_connections 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.026+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4147306648 wait complete. 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bf5bb640 1 Processor -- start 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bf5bb640 1 -- start start 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bf5bb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38b8102aa0 0x7f38b80ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bf5bb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 0x7f38b80ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bf5bb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b8108d30 0x7f38b81000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bf5bb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f38b81129f0 con 0x7f38b81083e0 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bf5bb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38b8112870 con 0x7f38b8102aa0 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bf5bb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38b8112b70 con 0x7f38b8108d30 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bcb56640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 0x7f38b80ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bcb56640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 0x7f38b80ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57310/0 (socket says 172.21.15.49:57310) 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bcb56640 1 -- 172.21.15.49:0/4158343085 learned_addr learned my addr 172.21.15.49:0/4158343085 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bdb58640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b8108d30 0x7f38b81000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bd357640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38b8102aa0 0x7f38b80ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bcb56640 1 -- 172.21.15.49:0/4158343085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b8108d30 msgr2=0x7f38b81000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bcb56640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b8108d30 0x7f38b81000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bcb56640 1 -- 172.21.15.49:0/4158343085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38b8102aa0 msgr2=0x7f38b80ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bcb56640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38b8102aa0 0x7f38b80ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.027+0000 7f38bcb56640 1 -- 172.21.15.49:0/4158343085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b81a8790 con 0x7f38b81083e0 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.028+0000 7f38bcb56640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 0x7f38b80ffbb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f38ac02a930 tx=0x7f38ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.028+0000 7f38b67fc640 1 -- 172.21.15.49:0/4158343085 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac03f030 con 0x7f38b81083e0 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.028+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4158343085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b81a8a20 con 0x7f38b81083e0 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.028+0000 7f38b67fc640 1 -- 172.21.15.49:0/4158343085 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38ac003aa0 con 0x7f38b81083e0 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.028+0000 7f38b67fc640 1 -- 172.21.15.49:0/4158343085 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac035070 con 0x7f38b81083e0 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.028+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4158343085 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b81a8f50 con 0x7f38b81083e0 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38b67fc640 1 -- 172.21.15.49:0/4158343085 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f38ac042030 con 0x7f38b81083e0 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38c5b2f740 1 Processor -- start 2024-09-21T06:42:14.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38c5b2f740 1 -- start start 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819664650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192941b0 0x558819664b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x5588196650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5588195dae50 con 0x5588192bd070 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5588195ca280 con 0x55881929c390 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5588195ce090 con 0x5588192941b0 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38bdb58640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819664650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38bdb58640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819664650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57322/0 (socket says 172.21.15.49:57322) 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.031+0000 7f38bdb58640 1 -- 172.21.15.49:0/1195412528 learned_addr learned my addr 172.21.15.49:0/1195412528 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bd357640 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192941b0 0x558819664b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bcb56640 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x5588196650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38b67fc640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f38a00b6680 0x7f38a00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bdb58640 1 -- 172.21.15.49:0/1195412528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192941b0 msgr2=0x558819664b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bdb58640 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192941b0 0x558819664b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bdb58640 1 -- 172.21.15.49:0/1195412528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 msgr2=0x5588196650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bdb58640 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x5588196650d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bdb58640 1 -- 172.21.15.49:0/1195412528 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558819328650 con 0x5588192bd070 2024-09-21T06:42:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bcb56640 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x5588196650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38b67fc640 1 -- 172.21.15.49:0/4158343085 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f38ac107ae0 con 0x7f38b81083e0 2024-09-21T06:42:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bdb58640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f38a00b6680 0x7f38a00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f38bdb58640 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819664650 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b700 tx=0x7f38b000bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d311f81b354182e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.032+0000 7f389f7fe640 1 -- 172.21.15.49:0/1195412528 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0022070 con 0x5588192bd070 2024-09-21T06:42:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.033+0000 7f389f7fe640 1 -- 172.21.15.49:0/1195412528 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b0015070 con 0x5588192bd070 2024-09-21T06:42:14.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.033+0000 7f389f7fe640 1 -- 172.21.15.49:0/1195412528 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0010680 con 0x5588192bd070 2024-09-21T06:42:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.033+0000 7f38c5b2f740 1 -- 172.21.15.49:0/1195412528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 msgr2=0x558819664650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.033+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819664650 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b700 tx=0x7f38b000bbc0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.033+0000 7f38bdb58640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f38a00b6680 0x7f38a00b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f38b001f000 tx=0x7f38b0020000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:14.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.033+0000 7f38c5b2f740 1 -- 172.21.15.49:0/1195412528 shutdown_connections 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.033+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x5588196650d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.033+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192941b0 0x558819664b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.033+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/1195412528 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819664650 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.034+0000 7f38c5b2f740 1 -- 172.21.15.49:0/1195412528 >> 172.21.15.49:0/1195412528 conn(0x5588192b1460 msgr2=0x558819662540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.034+0000 7f38c5b2f740 1 -- 172.21.15.49:0/1195412528 shutdown_connections 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.034+0000 7f38c5b2f740 1 -- 172.21.15.49:0/1195412528 wait complete. 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.034+0000 7f38c5b2f740 1 -- start start 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.034+0000 7f38c5b2f740 1 Processor -- start 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 0x55881966fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55881929c390 0x5588196702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192bd070 0x55881967c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55881942b700 con 0x55881929c390 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558819565110 con 0x5588192941b0 2024-09-21T06:42:14.042 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558819672e30 con 0x5588192bd070 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38c5b2f740 10 client.0 _ll_register_callbacks cb 0x55881957e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bcb56640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55881929c390 0x5588196702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bcb56640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55881929c390 0x5588196702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57336/0 (socket says 172.21.15.49:57336) 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bcb56640 1 -- 172.21.15.49:0/2684392740 learned_addr learned my addr 172.21.15.49:0/2684392740 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bd357640 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 0x55881966fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bdb58640 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192bd070 0x55881967c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bcb56640 1 -- 172.21.15.49:0/2684392740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192bd070 msgr2=0x55881967c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bcb56640 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192bd070 0x55881967c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bcb56640 1 -- 172.21.15.49:0/2684392740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 msgr2=0x55881966fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bcb56640 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 0x55881966fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bcb56640 1 -- 172.21.15.49:0/2684392740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558819592c40 con 0x55881929c390 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38bcb56640 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55881929c390 0x5588196702f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f38ac04a000 tx=0x7f38ac03b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430e0dde932a2932 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f389cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:14.043 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f389cff9640 1 -- 172.21.15.49:0/2684392740 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38ac049050 con 0x55881929c390 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f389cff9640 1 -- 172.21.15.49:0/2684392740 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f38ac0c9b80 con 0x55881929c390 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.035+0000 7f38c5b2f740 1 -- 172.21.15.49:0/2684392740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38b0015070 con 0x55881929c390 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f389cff9640 1 -- 172.21.15.49:0/2684392740 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38ac0c9080 con 0x55881929c390 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f38c5b2f740 10 client.16842 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f38c5b2f740 1 -- 172.21.15.49:0/2684392740 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55881967ead0 con 0x55881929c390 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f389cff9640 1 -- 172.21.15.49:0/2684392740 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b0015070 con 0x55881929c390 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f389cff9640 1 -- 172.21.15.49:0/2684392740 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f38ac0d6ea0 con 0x55881929c390 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f38c5b2f740 10 client.16842 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f38c5b2f740 10 client.16842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f38c5b2f740 20 client.16842 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55881927b9f0 0x558819682060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f38c5b2f740 4 client.16842 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.036+0000 7f38c5b2f740 1 -- 172.21.15.49:0/2684392740 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588195dcda0 con 0x55881927b9f0 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.037+0000 7f38bd357640 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55881927b9f0 0x558819682060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.044 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.037+0000 7f389cff9640 10 client.16842 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.037+0000 7f38bd357640 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55881927b9f0 0x558819682060 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0c620fadc286a03 server_cookie=1b84019380f74d03 in_seq=0 out_seq=0 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f389cff9640 1 -- 172.21.15.49:0/2684392740 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5588195dcda0 con 0x55881927b9f0 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f389cff9640 10 client.16842 handle_command_reply: tid=0 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 client.16842 shutdown 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 -- 172.21.15.49:0/2684392740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55881929c390 msgr2=0x5588196702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55881929c390 0x5588196702f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f38ac04a000 tx=0x7f38ac03b6b0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 -- 172.21.15.49:0/2684392740 shutdown_connections 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55881927b9f0 0x558819682060 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192bd070 0x55881967c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55881929c390 0x5588196702f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/2684392740 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 0x55881966fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 -- 172.21.15.49:0/2684392740 >> 172.21.15.49:0/2684392740 conn(0x5588192b1460 msgr2=0x558819667830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f389cff9640 0 client.16842 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:14.045 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 -- 172.21.15.49:0/2684392740 shutdown_connections 2024-09-21T06:42:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 1 -- 172.21.15.49:0/2684392740 wait complete. 2024-09-21T06:42:14.046 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.038+0000 7f38c5b2f740 20 client.16842 trim_cache size 0 max 16384 2024-09-21T06:42:14.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38c5b2f740 1 Processor -- start 2024-09-21T06:42:14.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38c5b2f740 1 -- start start 2024-09-21T06:42:14.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192941b0 0x558819670270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x55881967c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192bd070 0x558819661ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f38b81b4320 con 0x5588192941b0 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38b81b1bf0 con 0x55881929c390 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38b81afa60 con 0x5588192bd070 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bd357640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192941b0 0x558819670270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bd357640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192941b0 0x558819670270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57352/0 (socket says 172.21.15.49:57352) 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bd357640 1 -- 172.21.15.49:0/4067440363 learned_addr learned my addr 172.21.15.49:0/4067440363 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bcb56640 1 --2- 172.21.15.49:0/4067440363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x55881967c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bd357640 1 -- 172.21.15.49:0/4067440363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192bd070 msgr2=0x558819661ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bd357640 1 --2- 172.21.15.49:0/4067440363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192bd070 0x558819661ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bd357640 1 -- 172.21.15.49:0/4067440363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 msgr2=0x55881967c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bd357640 1 --2- 172.21.15.49:0/4067440363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x55881967c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bd357640 1 -- 172.21.15.49:0/4067440363 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588196674b0 con 0x5588192941b0 2024-09-21T06:42:14.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.056+0000 7f38bcb56640 1 --2- 172.21.15.49:0/4067440363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x55881967c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.057+0000 7f38bd357640 1 --2- 172.21.15.49:0/4067440363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192941b0 0x558819670270 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x5588196632d0 tx=0x7f38a8009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120d732199cdc05a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.057+0000 7f389effd640 1 -- 172.21.15.49:0/4067440363 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a8012450 con 0x5588192941b0 2024-09-21T06:42:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.057+0000 7f389effd640 1 -- 172.21.15.49:0/4067440363 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38a8012aa0 con 0x5588192941b0 2024-09-21T06:42:14.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.057+0000 7f389effd640 1 -- 172.21.15.49:0/4067440363 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a801db20 con 0x5588192941b0 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 -- 172.21.15.49:0/4067440363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192941b0 msgr2=0x558819670270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/4067440363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192941b0 0x558819670270 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x5588196632d0 tx=0x7f38a8009950 comp rx=0 tx=0).stop 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 -- 172.21.15.49:0/4067440363 shutdown_connections 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/4067440363 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5588192bd070 0x558819661ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/4067440363 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55881929c390 0x55881967c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/4067440363 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192941b0 0x558819670270 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 -- 172.21.15.49:0/4067440363 >> 172.21.15.49:0/4067440363 conn(0x5588192b1460 msgr2=0x55881966fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 -- 172.21.15.49:0/4067440363 shutdown_connections 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 -- 172.21.15.49:0/4067440363 wait complete. 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 -- start start 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.058+0000 7f38c5b2f740 1 Processor -- start 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 0x558819678980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.063 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55881929c390 0x558819673e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38c5b2f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819674430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f38b81b00b0 con 0x5588192bd070 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f38b81b1520 con 0x5588192941b0 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38c5b2f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f38b81b0780 con 0x55881929c390 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38c5b2f740 10 client.0 _ll_register_callbacks cb 0x7f38ac005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bdb58640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819674430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bdb58640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819674430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57354/0 (socket says 172.21.15.49:57354) 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bdb58640 1 -- 172.21.15.49:0/3708450730 learned_addr learned my addr 172.21.15.49:0/3708450730 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bd357640 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 0x558819678980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.064 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bcb56640 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55881929c390 0x558819673e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bdb58640 1 -- 172.21.15.49:0/3708450730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55881929c390 msgr2=0x558819673e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bdb58640 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55881929c390 0x558819673e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bdb58640 1 -- 172.21.15.49:0/3708450730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 msgr2=0x558819678980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bdb58640 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 0x558819678980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bdb58640 1 -- 172.21.15.49:0/3708450730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558819674c10 con 0x5588192bd070 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.059+0000 7f38bd357640 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 0x558819678980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.060+0000 7f38bdb58640 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819674430 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b4e0 tx=0x7f38b000b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8379eef966b3978 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.060+0000 7f389cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.060+0000 7f389cff9640 1 -- 172.21.15.49:0/3708450730 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0034060 con 0x5588192bd070 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.060+0000 7f389cff9640 1 -- 172.21.15.49:0/3708450730 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f38b0010980 con 0x5588192bd070 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.060+0000 7f38c5b2f740 1 -- 172.21.15.49:0/3708450730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38a8012aa0 con 0x5588192bd070 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.060+0000 7f389cff9640 1 -- 172.21.15.49:0/3708450730 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f38b0022040 con 0x5588192bd070 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.060+0000 7f38c5b2f740 10 client.16848 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:14.065 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.060+0000 7f38c5b2f740 1 -- 172.21.15.49:0/3708450730 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5588196ec990 con 0x5588192bd070 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.060+0000 7f389cff9640 1 -- 172.21.15.49:0/3708450730 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38a8012aa0 con 0x5588192bd070 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f389cff9640 1 -- 172.21.15.49:0/3708450730 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f38b001c7d0 con 0x5588192bd070 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f38c5b2f740 10 client.16848 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f38c5b2f740 10 client.16848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f38c5b2f740 20 client.16848 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558819250da0 0x5588196ef010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f38c5b2f740 4 client.16848 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f38c5b2f740 1 -- 172.21.15.49:0/3708450730 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5588195d8850 con 0x558819250da0 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f38bd357640 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558819250da0 0x5588196ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f38bd357640 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558819250da0 0x5588196ef010 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd4ccf36863f989e server_cookie=b98b437fe5cece83 in_seq=0 out_seq=0 2024-09-21T06:42:14.066 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.061+0000 7f389cff9640 10 client.16848 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:14.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f389cff9640 1 -- 172.21.15.49:0/3708450730 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x5588195d8850 con 0x558819250da0 2024-09-21T06:42:14.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f389cff9640 10 client.16848 handle_command_reply: tid=0 2024-09-21T06:42:14.067 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 client.16848 shutdown 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 -- 172.21.15.49:0/3708450730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 msgr2=0x558819674430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819674430 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f38b000b4e0 tx=0x7f38b000b510 comp rx=0 tx=0).stop 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 -- 172.21.15.49:0/3708450730 shutdown_connections 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558819250da0 0x5588196ef010 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5588192bd070 0x558819674430 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55881929c390 0x558819673e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 --2- 172.21.15.49:0/3708450730 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5588192941b0 0x558819678980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f389cff9640 0 client.16848 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 -- 172.21.15.49:0/3708450730 >> 172.21.15.49:0/3708450730 conn(0x5588192b1460 msgr2=0x558819667750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 -- 172.21.15.49:0/3708450730 shutdown_connections 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 1 -- 172.21.15.49:0/3708450730 wait complete. 2024-09-21T06:42:14.068 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.062+0000 7f38c5b2f740 20 client.16848 trim_cache size 0 max 16384 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:14.069 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:14.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:14.071 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:14.072 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:14.073 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:14.074 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:14.074 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:14.074 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:14.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:42:14.074 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:42:14.074 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f38a00b6680 msgr2=0x7f38a00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f38a00b6680 0x7f38a00b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f38b001f000 tx=0x7f38b0020000 comp rx=0 tx=0).stop 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 msgr2=0x7f38b80ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 0x7f38b80ffbb0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f38ac02a930 tx=0x7f38ac004270 comp rx=0 tx=0).stop 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4158343085 shutdown_connections 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f38a00b6680 0x7f38a00b8b90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f38b8108d30 0x7f38b81000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f38b81083e0 0x7f38b80ffbb0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 --2- 172.21.15.49:0/4158343085 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f38b8102aa0 0x7f38b80ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4158343085 >> 172.21.15.49:0/4158343085 conn(0x7f38b8079750 msgr2=0x7f38b8101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4158343085 shutdown_connections 2024-09-21T06:42:14.075 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:14.063+0000 7f38bf5bb640 1 -- 172.21.15.49:0/4158343085 wait complete. 2024-09-21T06:42:14.842 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:42:14.842 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:42:15.104 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:15.482 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:15 smithi049 ceph-mon[31177]: pgmap v487: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 KiB/s wr, 29 op/s 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.572+0000 7f9f2ec17640 1 -- 172.21.15.49:0/3656753275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f28107b70 msgr2=0x7f9f28107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.572+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/3656753275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f28107b70 0x7f9f28107f80 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009900 tx=0x7f9f1402a410 comp rx=0 tx=0).stop 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.572+0000 7f9f2ec17640 1 -- 172.21.15.49:0/3656753275 shutdown_connections 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.572+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/3656753275 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f281084c0 0x7f9f2810ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.572+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/3656753275 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f28107b70 0x7f9f28107f80 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.572+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/3656753275 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f28102230 0x7f9f28102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.572+0000 7f9f2ec17640 1 -- 172.21.15.49:0/3656753275 >> 172.21.15.49:0/3656753275 conn(0x7f9f28079e40 msgr2=0x7f9f2807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.572+0000 7f9f2ec17640 1 -- 172.21.15.49:0/3656753275 shutdown_connections 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.572+0000 7f9f2ec17640 1 -- 172.21.15.49:0/3656753275 wait complete. 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2ec17640 1 Processor -- start 2024-09-21T06:42:15.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2ec17640 1 -- start start 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2ec17640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f28102230 0x7f9f2819c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2ec17640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f28107b70 0x7f9f2819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2ec17640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f281084c0 0x7f9f281a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2ec17640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9f28112150 con 0x7f9f281084c0 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2ec17640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9f28111fd0 con 0x7f9f28107b70 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2ec17640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9f281122d0 con 0x7f9f28102230 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2d1b4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f281084c0 0x7f9f281a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2d1b4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f281084c0 0x7f9f281a1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57372/0 (socket says 172.21.15.49:57372) 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2d1b4640 1 -- 172.21.15.49:0/2646686405 learned_addr learned my addr 172.21.15.49:0/2646686405 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2c9b3640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f28102230 0x7f9f2819c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f27fff640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f28107b70 0x7f9f2819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2d1b4640 1 -- 172.21.15.49:0/2646686405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f28102230 msgr2=0x7f9f2819c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2d1b4640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f28102230 0x7f9f2819c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2d1b4640 1 -- 172.21.15.49:0/2646686405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f28107b70 msgr2=0x7f9f2819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2d1b4640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f28107b70 0x7f9f2819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f2d1b4640 1 -- 172.21.15.49:0/2646686405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f281a2690 con 0x7f9f281084c0 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.573+0000 7f9f27fff640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f28107b70 0x7f9f2819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.574+0000 7f9f2d1b4640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f281084c0 0x7f9f281a1f60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000cad0 tx=0x7f9f2000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.574+0000 7f9f25ffb640 1 -- 172.21.15.49:0/2646686405 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000ae20 con 0x7f9f281084c0 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.574+0000 7f9f25ffb640 1 -- 172.21.15.49:0/2646686405 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f20005020 con 0x7f9f281084c0 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.574+0000 7f9f25ffb640 1 -- 172.21.15.49:0/2646686405 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000f6b0 con 0x7f9f281084c0 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.574+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f281a2980 con 0x7f9f281084c0 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.574+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f281a90e0 con 0x7f9f281084c0 2024-09-21T06:42:15.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.575+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f28102640 con 0x7f9f281084c0 2024-09-21T06:42:15.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.578+0000 7f9f25ffb640 1 -- 172.21.15.49:0/2646686405 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9f200051d0 con 0x7f9f281084c0 2024-09-21T06:42:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.578+0000 7f9f25ffb640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f180b6700 0x7f9f180b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.578+0000 7f9f2c9b3640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f180b6700 0x7f9f180b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.579+0000 7f9f25ffb640 1 -- 172.21.15.49:0/2646686405 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9f200e7ae0 con 0x7f9f281084c0 2024-09-21T06:42:15.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.579+0000 7f9f2c9b3640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f180b6700 0x7f9f180b8c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0058c0 tx=0x7f9f1c00a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:15.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.582+0000 7f9f25ffb640 1 -- 172.21.15.49:0/2646686405 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f20014030 con 0x7f9f281084c0 2024-09-21T06:42:15.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:15 smithi098 ceph-mon[34704]: pgmap v487: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 KiB/s wr, 29 op/s 2024-09-21T06:42:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.812+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f2819d850 con 0x7f9f281084c0 2024-09-21T06:42:15.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.813+0000 7f9f25ffb640 1 -- 172.21.15.49:0/2646686405 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f9f200ae090 con 0x7f9f281084c0 2024-09-21T06:42:15.815 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:42:15.815 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:42:15.815 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:42:15.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:15 smithi079 ceph-mon[34346]: pgmap v487: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 KiB/s wr, 29 op/s 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.816+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f180b6700 msgr2=0x7f9f180b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.816+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f180b6700 0x7f9f180b8c10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c0058c0 tx=0x7f9f1c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.816+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f281084c0 msgr2=0x7f9f281a1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.816+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f281084c0 0x7f9f281a1f60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9f2000cad0 tx=0x7f9f2000cf90 comp rx=0 tx=0).stop 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.817+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 shutdown_connections 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.817+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9f180b6700 0x7f9f180b8c10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.817+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9f281084c0 0x7f9f281a1f60 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.817+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9f28107b70 0x7f9f2819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.817+0000 7f9f2ec17640 1 --2- 172.21.15.49:0/2646686405 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9f28102230 0x7f9f2819c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.817+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 >> 172.21.15.49:0/2646686405 conn(0x7f9f28079e40 msgr2=0x7f9f2810d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:15.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.817+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 shutdown_connections 2024-09-21T06:42:15.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:15.817+0000 7f9f2ec17640 1 -- 172.21.15.49:0/2646686405 wait complete. 2024-09-21T06:42:16.518 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:42:16.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:16 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2646686405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:16.779 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:16.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:16 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2646686405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:16.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:16 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2646686405' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:17.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.233+0000 7faee5f8c640 1 -- 172.21.15.49:0/926147766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 msgr2=0x7faee0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:17.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.233+0000 7faee5f8c640 1 --2- 172.21.15.49:0/926147766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 0x7faee0110620 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7faed8009ca0 tx=0x7faed802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.233+0000 7faee5f8c640 1 -- 172.21.15.49:0/926147766 shutdown_connections 2024-09-21T06:42:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.233+0000 7faee5f8c640 1 --2- 172.21.15.49:0/926147766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 0x7faee0110620 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.233+0000 7faee5f8c640 1 --2- 172.21.15.49:0/926147766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faee01094a0 0x7faee01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.233+0000 7faee5f8c640 1 --2- 172.21.15.49:0/926147766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0103b60 0x7faee0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.233+0000 7faee5f8c640 1 -- 172.21.15.49:0/926147766 >> 172.21.15.49:0/926147766 conn(0x7faee007b850 msgr2=0x7faee007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.233+0000 7faee5f8c640 1 -- 172.21.15.49:0/926147766 shutdown_connections 2024-09-21T06:42:17.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.233+0000 7faee5f8c640 1 -- 172.21.15.49:0/926147766 wait complete. 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.234+0000 7faee5f8c640 1 Processor -- start 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faee5f8c640 1 -- start start 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faee5f8c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0103b60 0x7faee019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faee5f8c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faee01094a0 0x7faee019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faee5f8c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 0x7faee019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faee5f8c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faee0113b00 con 0x7faee0109df0 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faee5f8c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee0113980 con 0x7faee0103b60 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faee5f8c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faee0113c80 con 0x7faee01094a0 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faedffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 0x7faee019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faedffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 0x7faee019fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58138/0 (socket says 172.21.15.49:58138) 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faedffff640 1 -- 172.21.15.49:0/3328955557 learned_addr learned my addr 172.21.15.49:0/3328955557 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faedf7fe640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0103b60 0x7faee019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.235+0000 7faedeffd640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faee01094a0 0x7faee019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faedffff640 1 -- 172.21.15.49:0/3328955557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faee01094a0 msgr2=0x7faee019a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faedffff640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faee01094a0 0x7faee019a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faedffff640 1 -- 172.21.15.49:0/3328955557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0103b60 msgr2=0x7faee019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faedffff640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0103b60 0x7faee019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faedffff640 1 -- 172.21.15.49:0/3328955557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee01a0380 con 0x7faee0109df0 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faedffff640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 0x7faee019fc50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7faed8009430 tx=0x7faed80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faedcff9640 1 -- 172.21.15.49:0/3328955557 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed8003c30 con 0x7faee0109df0 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faedcff9640 1 -- 172.21.15.49:0/3328955557 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed8003dd0 con 0x7faee0109df0 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faee5f8c640 1 -- 172.21.15.49:0/3328955557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee01a0610 con 0x7faee0109df0 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faedcff9640 1 -- 172.21.15.49:0/3328955557 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed802faa0 con 0x7faee0109df0 2024-09-21T06:42:17.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.236+0000 7faee5f8c640 1 -- 172.21.15.49:0/3328955557 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee01a6dd0 con 0x7faee0109df0 2024-09-21T06:42:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.239+0000 7faedcff9640 1 -- 172.21.15.49:0/3328955557 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7faed802fc40 con 0x7faee0109df0 2024-09-21T06:42:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.239+0000 7faeec500740 1 Processor -- start 2024-09-21T06:42:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.239+0000 7faeec500740 1 -- start start 2024-09-21T06:42:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.239+0000 7faeec500740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8157070 0x5624c84fe6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.239+0000 7faeec500740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 0x5624c84febe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.239+0000 7faeec500740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c84ff120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.239+0000 7faeec500740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5624c8474ea0 con 0x5624c8136390 2024-09-21T06:42:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.239+0000 7faeec500740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5624c84642d0 con 0x5624c8157070 2024-09-21T06:42:17.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.239+0000 7faeec500740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5624c84680e0 con 0x5624c812e1b0 2024-09-21T06:42:17.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c84ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c84ff120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58146/0 (socket says 172.21.15.49:58146) 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 -- 172.21.15.49:0/3360107799 learned_addr learned my addr 172.21.15.49:0/3360107799 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedf7fe640 1 --2- 172.21.15.49:0/3360107799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 0x5624c84febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 --2- 172.21.15.49:0/3360107799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8157070 0x5624c84fe6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedcff9640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faec80b6700 0x7faec80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 -- 172.21.15.49:0/3360107799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 msgr2=0x5624c84febe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 --2- 172.21.15.49:0/3360107799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 0x5624c84febe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 -- 172.21.15.49:0/3360107799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8157070 msgr2=0x5624c84fe6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 --2- 172.21.15.49:0/3360107799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8157070 0x5624c84fe6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 -- 172.21.15.49:0/3360107799 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624c81c2650 con 0x5624c8136390 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedffff640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faec80b6700 0x7faec80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedcff9640 1 -- 172.21.15.49:0/3328955557 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7faed8108aa0 con 0x7faee0109df0 2024-09-21T06:42:17.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faedeffd640 1 --2- 172.21.15.49:0/3360107799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c84ff120 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7faed40124c0 tx=0x7faed400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d818401edfd5d41c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:17.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.240+0000 7faec5ffb640 1 -- 172.21.15.49:0/3360107799 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4004230 con 0x5624c8136390 2024-09-21T06:42:17.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.241+0000 7faedffff640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faec80b6700 0x7faec80b8c10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faed80ce800 tx=0x7faed802a8c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:17.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.241+0000 7faec5ffb640 1 -- 172.21.15.49:0/3360107799 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed40043d0 con 0x5624c8136390 2024-09-21T06:42:17.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.241+0000 7faec5ffb640 1 -- 172.21.15.49:0/3360107799 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4010820 con 0x5624c8136390 2024-09-21T06:42:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.241+0000 7faeec500740 1 -- 172.21.15.49:0/3360107799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 msgr2=0x5624c84ff120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.241+0000 7faeec500740 1 --2- 172.21.15.49:0/3360107799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c84ff120 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7faed40124c0 tx=0x7faed400b790 comp rx=0 tx=0).stop 2024-09-21T06:42:17.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.242+0000 7faeec500740 1 -- 172.21.15.49:0/3360107799 shutdown_connections 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.242+0000 7faeec500740 1 --2- 172.21.15.49:0/3360107799 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c84ff120 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.242+0000 7faeec500740 1 --2- 172.21.15.49:0/3360107799 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 0x5624c84febe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.242+0000 7faeec500740 1 --2- 172.21.15.49:0/3360107799 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8157070 0x5624c84fe6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.242+0000 7faeec500740 1 -- 172.21.15.49:0/3360107799 >> 172.21.15.49:0/3360107799 conn(0x5624c814b460 msgr2=0x5624c84fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.242+0000 7faeec500740 1 -- 172.21.15.49:0/3360107799 shutdown_connections 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.242+0000 7faeec500740 1 -- 172.21.15.49:0/3360107799 wait complete. 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.242+0000 7faeec500740 1 -- start start 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.242+0000 7faeec500740 1 Processor -- start 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faeec500740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8509cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faeec500740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 0x5624c850a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faeec500740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c8157070 0x5624c850a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faeec500740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5624c82c5700 con 0x5624c812e1b0 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faeec500740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5624c83ff160 con 0x5624c8136390 2024-09-21T06:42:17.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faeec500740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5624c850ced0 con 0x5624c8157070 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faeec500740 10 client.0 _ll_register_callbacks cb 0x5624c84189e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8509cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8509cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58152/0 (socket says 172.21.15.49:58152) 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedeffd640 1 -- 172.21.15.49:0/1732209664 learned_addr learned my addr 172.21.15.49:0/1732209664 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedf7fe640 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 0x5624c850a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedeffd640 1 -- 172.21.15.49:0/1732209664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c8157070 msgr2=0x5624c850a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedeffd640 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c8157070 0x5624c850a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedeffd640 1 -- 172.21.15.49:0/1732209664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 msgr2=0x5624c850a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedeffd640 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 0x5624c850a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedeffd640 1 -- 172.21.15.49:0/1732209664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624c842cc90 con 0x5624c812e1b0 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.243+0000 7faedf7fe640 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 0x5624c850a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.244+0000 7faedeffd640 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8509cc0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7faed4005bc0 tx=0x7faed4005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99b9a4a16eeaa469 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.244+0000 7faebeffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:17.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.244+0000 7faebeffd640 1 -- 172.21.15.49:0/1732209664 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed4005250 con 0x5624c812e1b0 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.244+0000 7faebeffd640 1 -- 172.21.15.49:0/1732209664 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7faed40053f0 con 0x5624c812e1b0 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.244+0000 7faeec500740 1 -- 172.21.15.49:0/1732209664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed40043d0 con 0x5624c812e1b0 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.244+0000 7faebeffd640 1 -- 172.21.15.49:0/1732209664 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faed40055f0 con 0x5624c812e1b0 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.244+0000 7faeec500740 10 client.16866 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.244+0000 7faeec500740 1 -- 172.21.15.49:0/1732209664 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5624c8518b80 con 0x5624c812e1b0 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.244+0000 7faebeffd640 1 -- 172.21.15.49:0/1732209664 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed40043d0 con 0x5624c812e1b0 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.245+0000 7faebeffd640 1 -- 172.21.15.49:0/1732209664 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7faed40049c0 con 0x5624c812e1b0 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.245+0000 7faeec500740 10 client.16866 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.245+0000 7faeec500740 10 client.16866 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.245+0000 7faeec500740 20 client.16866 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.245+0000 7faeec500740 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5624c81159f0 0x5624c851bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.245+0000 7faeec500740 4 client.16866 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.245+0000 7faeec500740 1 -- 172.21.15.49:0/1732209664 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624c8476df0 con 0x5624c81159f0 2024-09-21T06:42:17.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.245+0000 7faedf7fe640 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5624c81159f0 0x5624c851bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.246+0000 7faebeffd640 10 client.16866 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:42:17.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.246+0000 7faedf7fe640 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5624c81159f0 0x5624c851bf40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=413dd4b07fb7160a server_cookie=62698acb7489acde in_seq=0 out_seq=0 2024-09-21T06:42:17.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.246+0000 7faebeffd640 1 -- 172.21.15.49:0/1732209664 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5624c8476df0 con 0x5624c81159f0 2024-09-21T06:42:17.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.246+0000 7faebeffd640 10 client.16866 handle_command_reply: tid=0 2024-09-21T06:42:17.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.246+0000 7faeec500740 1 client.16866 shutdown 2024-09-21T06:42:17.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 -- 172.21.15.49:0/1732209664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 msgr2=0x5624c8509cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:17.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8509cc0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7faed4005bc0 tx=0x7faed4005970 comp rx=0 tx=0).stop 2024-09-21T06:42:17.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 -- 172.21.15.49:0/1732209664 shutdown_connections 2024-09-21T06:42:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5624c81159f0 0x5624c851bf40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c8157070 0x5624c850a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 0x5624c850a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faebeffd640 0 client.16866 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:42:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 --2- 172.21.15.49:0/1732209664 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8509cc0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 -- 172.21.15.49:0/1732209664 >> 172.21.15.49:0/1732209664 conn(0x5624c814b460 msgr2=0x5624c8500090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 -- 172.21.15.49:0/1732209664 shutdown_connections 2024-09-21T06:42:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 1 -- 172.21.15.49:0/1732209664 wait complete. 2024-09-21T06:42:17.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.247+0000 7faeec500740 20 client.16866 trim_cache size 0 max 16384 2024-09-21T06:42:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.260+0000 7faeec500740 1 Processor -- start 2024-09-21T06:42:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.260+0000 7faeec500740 1 -- start start 2024-09-21T06:42:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faeec500740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c81159f0 0x5624c850a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faeec500740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8506eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faeec500740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 0x5624c85073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faeec500740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faee01b2010 con 0x5624c812e1b0 2024-09-21T06:42:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faeec500740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee01af8e0 con 0x5624c8136390 2024-09-21T06:42:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faeec500740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faee01ad750 con 0x5624c81159f0 2024-09-21T06:42:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8506eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedf7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8506eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58168/0 (socket says 172.21.15.49:58168) 2024-09-21T06:42:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedf7fe640 1 -- 172.21.15.49:0/4266691371 learned_addr learned my addr 172.21.15.49:0/4266691371 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedeffd640 1 --2- 172.21.15.49:0/4266691371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c81159f0 0x5624c850a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedf7fe640 1 -- 172.21.15.49:0/4266691371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c81159f0 msgr2=0x5624c850a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedf7fe640 1 --2- 172.21.15.49:0/4266691371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c81159f0 0x5624c850a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedf7fe640 1 -- 172.21.15.49:0/4266691371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 msgr2=0x5624c85073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:17.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedf7fe640 1 --2- 172.21.15.49:0/4266691371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 0x5624c85073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedf7fe640 1 -- 172.21.15.49:0/4266691371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624c85160f0 con 0x5624c812e1b0 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedeffd640 1 --2- 172.21.15.49:0/4266691371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c81159f0 0x5624c850a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faedf7fe640 1 --2- 172.21.15.49:0/4266691371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8506eb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7faed0005fd0 tx=0x7faed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe6316123d0a410 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faec57fa640 1 -- 172.21.15.49:0/4266691371 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0010990 con 0x5624c812e1b0 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faec57fa640 1 -- 172.21.15.49:0/4266691371 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed0005020 con 0x5624c812e1b0 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.261+0000 7faec57fa640 1 -- 172.21.15.49:0/4266691371 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0004cd0 con 0x5624c812e1b0 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.262+0000 7faeec500740 1 -- 172.21.15.49:0/4266691371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 msgr2=0x5624c8506eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.262+0000 7faeec500740 1 --2- 172.21.15.49:0/4266691371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8506eb0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7faed0005fd0 tx=0x7faed00046c0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.262+0000 7faeec500740 1 -- 172.21.15.49:0/4266691371 shutdown_connections 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.262+0000 7faeec500740 1 --2- 172.21.15.49:0/4266691371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c8136390 0x5624c85073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.262+0000 7faeec500740 1 --2- 172.21.15.49:0/4266691371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c812e1b0 0x5624c8506eb0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.262+0000 7faeec500740 1 --2- 172.21.15.49:0/4266691371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c81159f0 0x5624c850a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.262+0000 7faeec500740 1 -- 172.21.15.49:0/4266691371 >> 172.21.15.49:0/4266691371 conn(0x5624c814b460 msgr2=0x5624c8509a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.262+0000 7faeec500740 1 -- 172.21.15.49:0/4266691371 shutdown_connections 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.262+0000 7faeec500740 1 -- 172.21.15.49:0/4266691371 wait complete. 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faeec500740 1 -- start start 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faeec500740 1 Processor -- start 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faeec500740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c81159f0 0x5624c8512a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faeec500740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 0x5624c850ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faeec500740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c85105e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faeec500740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faee01adda0 con 0x5624c8136390 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faeec500740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faee01af210 con 0x5624c81159f0 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faeec500740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faee01ae470 con 0x5624c812e1b0 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faeec500740 10 client.0 _ll_register_callbacks cb 0x7faed400bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faedeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c85105e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faedeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c85105e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58178/0 (socket says 172.21.15.49:58178) 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.263+0000 7faedeffd640 1 -- 172.21.15.49:0/2247084958 learned_addr learned my addr 172.21.15.49:0/2247084958 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faedf7fe640 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 0x5624c850ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faedeffd640 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c81159f0 0x5624c8512a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faedeffd640 1 -- 172.21.15.49:0/2247084958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 msgr2=0x5624c850ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faedeffd640 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 0x5624c850ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faedeffd640 1 -- 172.21.15.49:0/2247084958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c81159f0 msgr2=0x5624c8512a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faedeffd640 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c81159f0 0x5624c8512a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faedeffd640 1 -- 172.21.15.49:0/2247084958 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624c8510d50 con 0x5624c8136390 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faedf7fe640 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 0x5624c850ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faedeffd640 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c85105e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7faed400bed0 tx=0x7faed400bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c3fa58b1c5ba09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faebeffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faebeffd640 1 -- 172.21.15.49:0/2247084958 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed40045b0 con 0x5624c8136390 2024-09-21T06:42:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faebeffd640 1 -- 172.21.15.49:0/2247084958 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7faed4004750 con 0x5624c8136390 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faeec500740 1 -- 172.21.15.49:0/2247084958 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faed0005020 con 0x5624c8136390 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faebeffd640 1 -- 172.21.15.49:0/2247084958 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faed4040050 con 0x5624c8136390 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faeec500740 10 client.16872 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.264+0000 7faeec500740 1 -- 172.21.15.49:0/2247084958 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5624c85867e0 con 0x5624c8136390 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.265+0000 7faebeffd640 1 -- 172.21.15.49:0/2247084958 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed0005020 con 0x5624c8136390 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.265+0000 7faebeffd640 1 -- 172.21.15.49:0/2247084958 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7faed4010530 con 0x5624c8136390 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.265+0000 7faeec500740 10 client.16872 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.265+0000 7faeec500740 10 client.16872 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.265+0000 7faeec500740 20 client.16872 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.265+0000 7faeec500740 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5624c8157070 0x5624c8588f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.265+0000 7faeec500740 4 client.16872 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.265+0000 7faeec500740 1 -- 172.21.15.49:0/2247084958 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5624c84728a0 con 0x5624c8157070 2024-09-21T06:42:17.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.265+0000 7faedf7fe640 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5624c8157070 0x5624c8588f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faebeffd640 10 client.16872 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:42:17.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faedf7fe640 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5624c8157070 0x5624c8588f40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=75fc6e94c78ff757 server_cookie=5fafd2d521b79af7 in_seq=0 out_seq=0 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faebeffd640 1 -- 172.21.15.49:0/2247084958 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5624c84728a0 con 0x5624c8157070 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faebeffd640 10 client.16872 handle_command_reply: tid=0 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 client.16872 shutdown 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 -- 172.21.15.49:0/2247084958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 msgr2=0x5624c85105e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c85105e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7faed400bed0 tx=0x7faed400bfb0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 -- 172.21.15.49:0/2247084958 shutdown_connections 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5624c8157070 0x5624c8588f40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5624c8136390 0x5624c85105e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5624c812e1b0 0x5624c850ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 --2- 172.21.15.49:0/2247084958 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5624c81159f0 0x5624c8512a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 -- 172.21.15.49:0/2247084958 >> 172.21.15.49:0/2247084958 conn(0x5624c814b460 msgr2=0x5624c850b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faebeffd640 0 client.16872 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 -- 172.21.15.49:0/2247084958 shutdown_connections 2024-09-21T06:42:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.266+0000 7faeec500740 1 -- 172.21.15.49:0/2247084958 wait complete. 2024-09-21T06:42:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faeec500740 20 client.16872 trim_cache size 0 max 16384 2024-09-21T06:42:17.274 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:42:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 -- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faec80b6700 msgr2=0x7faec80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faec80b6700 0x7faec80b8c10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7faed80ce800 tx=0x7faed802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 -- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 msgr2=0x7faee019fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 0x7faee019fc50 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7faed8009430 tx=0x7faed80319f0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 -- 172.21.15.49:0/3328955557 shutdown_connections 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faec80b6700 0x7faec80b8c10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faee0109df0 0x7faee019fc50 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faee01094a0 0x7faee019a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 --2- 172.21.15.49:0/3328955557 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faee0103b60 0x7faee019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 -- 172.21.15.49:0/3328955557 >> 172.21.15.49:0/3328955557 conn(0x7faee007b850 msgr2=0x7faee0107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 -- 172.21.15.49:0/3328955557 shutdown_connections 2024-09-21T06:42:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:17.267+0000 7faee5f8c640 1 -- 172.21.15.49:0/3328955557 wait complete. 2024-09-21T06:42:17.560 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:17 smithi049 ceph-mon[31177]: pgmap v488: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-21T06:42:17.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:17 smithi098 ceph-mon[34704]: pgmap v488: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-21T06:42:17.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:17 smithi079 ceph-mon[34346]: pgmap v488: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-21T06:42:18.041 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:42:18.299 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:18.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.708+0000 7f255c5af640 1 -- 172.21.15.49:0/2525415453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 msgr2=0x7f2554110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:18.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.708+0000 7f255c5af640 1 --2- 172.21.15.49:0/2525415453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 0x7f2554110330 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2544009ca0 tx=0x7f254402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.708+0000 7f255c5af640 1 -- 172.21.15.49:0/2525415453 shutdown_connections 2024-09-21T06:42:18.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.708+0000 7f255c5af640 1 --2- 172.21.15.49:0/2525415453 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 0x7f2554110330 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.708+0000 7f255c5af640 1 --2- 172.21.15.49:0/2525415453 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2554105380 0x7f255410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.708+0000 7f255c5af640 1 --2- 172.21.15.49:0/2525415453 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2554104a30 0x7f2554104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.708+0000 7f255c5af640 1 -- 172.21.15.49:0/2525415453 >> 172.21.15.49:0/2525415453 conn(0x7f25540797b0 msgr2=0x7f2554079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:18.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.708+0000 7f255c5af640 1 -- 172.21.15.49:0/2525415453 shutdown_connections 2024-09-21T06:42:18.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.708+0000 7f255c5af640 1 -- 172.21.15.49:0/2525415453 wait complete. 2024-09-21T06:42:18.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.709+0000 7f255c5af640 1 Processor -- start 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.709+0000 7f255c5af640 1 -- start start 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255c5af640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2554104a30 0x7f255419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255c5af640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2554105380 0x7f255419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255c5af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 0x7f255419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255c5af640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2554113aa0 con 0x7f255410de60 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255c5af640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2554113920 con 0x7f2554105380 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255c5af640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2554113c20 con 0x7f2554104a30 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255ab4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 0x7f255419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255ab4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 0x7f255419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58192/0 (socket says 172.21.15.49:58192) 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255ab4c640 1 -- 172.21.15.49:0/3808701463 learned_addr learned my addr 172.21.15.49:0/3808701463 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f2559b4a640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2554105380 0x7f255419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255a34b640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2554104a30 0x7f255419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255ab4c640 1 -- 172.21.15.49:0/3808701463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2554104a30 msgr2=0x7f255419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:18.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255ab4c640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2554104a30 0x7f255419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255ab4c640 1 -- 172.21.15.49:0/3808701463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2554105380 msgr2=0x7f255419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255ab4c640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2554105380 0x7f255419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255ab4c640 1 -- 172.21.15.49:0/3808701463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25541a03a0 con 0x7f255410de60 2024-09-21T06:42:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.710+0000 7f255ab4c640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 0x7f255419fd30 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2544005cc0 tx=0x7f254402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.711+0000 7f25537fe640 1 -- 172.21.15.49:0/3808701463 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544003bf0 con 0x7f255410de60 2024-09-21T06:42:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.711+0000 7f255c5af640 1 -- 172.21.15.49:0/3808701463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25541a0630 con 0x7f255410de60 2024-09-21T06:42:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.711+0000 7f25537fe640 1 -- 172.21.15.49:0/3808701463 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2544003d90 con 0x7f255410de60 2024-09-21T06:42:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.711+0000 7f25537fe640 1 -- 172.21.15.49:0/3808701463 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254402fb20 con 0x7f255410de60 2024-09-21T06:42:18.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.711+0000 7f255c5af640 1 -- 172.21.15.49:0/3808701463 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25541a0b70 con 0x7f255410de60 2024-09-21T06:42:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.713+0000 7f2562b23740 1 Processor -- start 2024-09-21T06:42:18.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.713+0000 7f25537fe640 1 -- 172.21.15.49:0/3808701463 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2544004580 con 0x7f255410de60 2024-09-21T06:42:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2562b23740 1 -- start start 2024-09-21T06:42:18.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2562b23740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55e2070 0x559af59896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2562b23740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af5989be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2562b23740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af598a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2562b23740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559af58ffea0 con 0x559af55c1390 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2562b23740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559af58ef2d0 con 0x559af55b91b0 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2562b23740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559af58f30e0 con 0x559af55e2070 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2559b4a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af598a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2559b4a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af598a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58200/0 (socket says 172.21.15.49:58200) 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2559b4a640 1 -- 172.21.15.49:0/1849725123 learned_addr learned my addr 172.21.15.49:0/1849725123 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2559b4a640 1 --2- 172.21.15.49:0/1849725123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55e2070 0x559af59896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f255a34b640 1 --2- 172.21.15.49:0/1849725123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af5989be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2559b4a640 1 -- 172.21.15.49:0/1849725123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55e2070 msgr2=0x559af59896a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2559b4a640 1 --2- 172.21.15.49:0/1849725123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55e2070 0x559af59896a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2559b4a640 1 -- 172.21.15.49:0/1849725123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 msgr2=0x559af5989be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:18.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2559b4a640 1 --2- 172.21.15.49:0/1849725123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af5989be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f25537fe640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f253c0b66b0 0x7f253c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.714+0000 7f2559b4a640 1 -- 172.21.15.49:0/1849725123 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af564d650 con 0x559af55c1390 2024-09-21T06:42:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.715+0000 7f25537fe640 1 -- 172.21.15.49:0/3808701463 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f25441089e0 con 0x7f255410de60 2024-09-21T06:42:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.715+0000 7f2559b4a640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f253c0b66b0 0x7f253c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.715+0000 7f2559b4a640 1 --2- 172.21.15.49:0/1849725123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af598a120 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f254800a5c0 tx=0x7f254800a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a50de697d32b0d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:18.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.715+0000 7f2550ff9640 1 -- 172.21.15.49:0/1849725123 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2548023070 con 0x559af55c1390 2024-09-21T06:42:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.715+0000 7f2550ff9640 1 -- 172.21.15.49:0/1849725123 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254801e450 con 0x559af55c1390 2024-09-21T06:42:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.715+0000 7f2550ff9640 1 -- 172.21.15.49:0/1849725123 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254801de60 con 0x559af55c1390 2024-09-21T06:42:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2562b23740 1 -- 172.21.15.49:0/1849725123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 msgr2=0x559af598a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:18.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2559b4a640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f253c0b66b0 0x7f253c0b8bc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2548020000 tx=0x7f254801d000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2562b23740 1 --2- 172.21.15.49:0/1849725123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af598a120 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f254800a5c0 tx=0x7f254800a730 comp rx=0 tx=0).stop 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2562b23740 1 -- 172.21.15.49:0/1849725123 shutdown_connections 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2562b23740 1 --2- 172.21.15.49:0/1849725123 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af598a120 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2562b23740 1 --2- 172.21.15.49:0/1849725123 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af5989be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2562b23740 1 --2- 172.21.15.49:0/1849725123 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55e2070 0x559af59896a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2562b23740 1 -- 172.21.15.49:0/1849725123 >> 172.21.15.49:0/1849725123 conn(0x559af55d6460 msgr2=0x559af5987590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2562b23740 1 -- 172.21.15.49:0/1849725123 shutdown_connections 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.716+0000 7f2562b23740 1 -- 172.21.15.49:0/1849725123 wait complete. 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2562b23740 1 -- start start 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2562b23740 1 Processor -- start 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2562b23740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af59990e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2562b23740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 0x559af5999620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2562b23740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55e2070 0x559af5999b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2562b23740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559af5750700 con 0x559af55e2070 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2562b23740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559af588a160 con 0x559af55b91b0 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2562b23740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559af599c1e0 con 0x559af55c1390 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2562b23740 10 client.0 _ll_register_callbacks cb 0x559af58a39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f255ab4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55e2070 0x559af5999b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f255ab4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55e2070 0x559af5999b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58212/0 (socket says 172.21.15.49:58212) 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f255ab4c640 1 -- 172.21.15.49:0/6508034 learned_addr learned my addr 172.21.15.49:0/6508034 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f255a34b640 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af59990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.717+0000 7f2559b4a640 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 0x559af5999620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f255ab4c640 1 -- 172.21.15.49:0/6508034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 msgr2=0x559af5999620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f255ab4c640 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 0x559af5999620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f255ab4c640 1 -- 172.21.15.49:0/6508034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 msgr2=0x559af59990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f255ab4c640 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af59990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f255ab4c640 1 -- 172.21.15.49:0/6508034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559af58b7c90 con 0x559af55e2070 2024-09-21T06:42:18.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f255ab4c640 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55e2070 0x559af5999b60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f25440cade0 tx=0x7f25440ce710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c6d8056c0796db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f2539ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f2539ffb640 1 -- 172.21.15.49:0/6508034 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254402fed0 con 0x559af55e2070 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f2539ffb640 1 -- 172.21.15.49:0/6508034 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f25440d7fa0 con 0x559af55e2070 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f2562b23740 1 -- 172.21.15.49:0/6508034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f254801e450 con 0x559af55e2070 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f2539ffb640 1 -- 172.21.15.49:0/6508034 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f25440e9050 con 0x559af55e2070 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f2562b23740 10 client.16884 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f2562b23740 1 -- 172.21.15.49:0/6508034 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559af59a7ea0 con 0x559af55e2070 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.718+0000 7f2539ffb640 1 -- 172.21.15.49:0/6508034 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254801e450 con 0x559af55e2070 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f2539ffb640 1 -- 172.21.15.49:0/6508034 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f25440cda70 con 0x559af55e2070 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f2562b23740 10 client.16884 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f2562b23740 10 client.16884 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f2562b23740 20 client.16884 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f2562b23740 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559af55a09f0 0x559af59ab400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f2562b23740 4 client.16884 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:18.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f2562b23740 1 -- 172.21.15.49:0/6508034 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559af5901df0 con 0x559af55a09f0 2024-09-21T06:42:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f255a34b640 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559af55a09f0 0x559af59ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f2539ffb640 10 client.16884 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:42:18.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.719+0000 7f255a34b640 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559af55a09f0 0x559af59ab400 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=858c1e824e1fac1b server_cookie=c96bd413e6b4e8e1 in_seq=0 out_seq=0 2024-09-21T06:42:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.720+0000 7f2539ffb640 1 -- 172.21.15.49:0/6508034 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559af5901df0 con 0x559af55a09f0 2024-09-21T06:42:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.720+0000 7f2539ffb640 10 client.16884 handle_command_reply: tid=0 2024-09-21T06:42:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.720+0000 7f2562b23740 1 client.16884 shutdown 2024-09-21T06:42:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.720+0000 7f2562b23740 1 -- 172.21.15.49:0/6508034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55e2070 msgr2=0x559af5999b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.720+0000 7f2562b23740 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55e2070 0x559af5999b60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f25440cade0 tx=0x7f25440ce710 comp rx=0 tx=0).stop 2024-09-21T06:42:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.720+0000 7f2562b23740 1 -- 172.21.15.49:0/6508034 shutdown_connections 2024-09-21T06:42:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.720+0000 7f2562b23740 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559af55a09f0 0x559af59ab400 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.721+0000 7f2539ffb640 0 client.16884 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:42:18.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.721+0000 7f2562b23740 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55e2070 0x559af5999b60 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.721+0000 7f2562b23740 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 0x559af5999620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.721+0000 7f2562b23740 1 --2- 172.21.15.49:0/6508034 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af59990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.721+0000 7f2562b23740 1 -- 172.21.15.49:0/6508034 >> 172.21.15.49:0/6508034 conn(0x559af55d6460 msgr2=0x559af598b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:18.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.721+0000 7f2562b23740 1 -- 172.21.15.49:0/6508034 shutdown_connections 2024-09-21T06:42:18.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.721+0000 7f2562b23740 1 -- 172.21.15.49:0/6508034 wait complete. 2024-09-21T06:42:18.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.721+0000 7f2562b23740 20 client.16884 trim_cache size 0 max 16384 2024-09-21T06:42:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f2562b23740 1 Processor -- start 2024-09-21T06:42:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f2562b23740 1 -- start start 2024-09-21T06:42:18.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f2562b23740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55a09f0 0x559af5996bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f2562b23740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af59b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f2562b23740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 0x559af59b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f2562b23740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f25541afdd0 con 0x559af55a09f0 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f2562b23740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25541ad6a0 con 0x559af55b91b0 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f2562b23740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f25541ab530 con 0x559af55c1390 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f255a34b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55a09f0 0x559af5996bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f255a34b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55a09f0 0x559af5996bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58214/0 (socket says 172.21.15.49:58214) 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f255a34b640 1 -- 172.21.15.49:0/1178864857 learned_addr learned my addr 172.21.15.49:0/1178864857 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f2559b4a640 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af59b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f255ab4c640 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 0x559af59b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f255a34b640 1 -- 172.21.15.49:0/1178864857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 msgr2=0x559af59b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.734+0000 7f255a34b640 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 0x559af59b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.735+0000 7f255a34b640 1 -- 172.21.15.49:0/1178864857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 msgr2=0x559af59b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:18.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.735+0000 7f255a34b640 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af59b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.735+0000 7f255a34b640 1 -- 172.21.15.49:0/1178864857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559af598a490 con 0x559af55a09f0 2024-09-21T06:42:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.735+0000 7f255ab4c640 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 0x559af59b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.735+0000 7f255a34b640 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55a09f0 0x559af5996bf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f254c004540 tx=0x7f254c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d454cb76c603f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.735+0000 7f253bfff640 1 -- 172.21.15.49:0/1178864857 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c003bb0 con 0x559af55a09f0 2024-09-21T06:42:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.735+0000 7f253bfff640 1 -- 172.21.15.49:0/1178864857 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254c003d50 con 0x559af55a09f0 2024-09-21T06:42:18.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.735+0000 7f253bfff640 1 -- 172.21.15.49:0/1178864857 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c0116a0 con 0x559af55a09f0 2024-09-21T06:42:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 -- 172.21.15.49:0/1178864857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55a09f0 msgr2=0x559af5996bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55a09f0 0x559af5996bf0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f254c004540 tx=0x7f254c004570 comp rx=0 tx=0).stop 2024-09-21T06:42:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 -- 172.21.15.49:0/1178864857 shutdown_connections 2024-09-21T06:42:18.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55c1390 0x559af59b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af59b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 --2- 172.21.15.49:0/1178864857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55a09f0 0x559af5996bf0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 -- 172.21.15.49:0/1178864857 >> 172.21.15.49:0/1178864857 conn(0x559af55d6460 msgr2=0x559af59964e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 -- 172.21.15.49:0/1178864857 shutdown_connections 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 -- 172.21.15.49:0/1178864857 wait complete. 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 -- start start 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.736+0000 7f2562b23740 1 Processor -- start 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2562b23740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55a09f0 0x559af599dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2562b23740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af599e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2562b23740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af5a14d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2562b23740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f25541abb80 con 0x559af55c1390 2024-09-21T06:42:18.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2562b23740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f25541acfd0 con 0x559af55b91b0 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2562b23740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f25541ac230 con 0x559af55a09f0 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2562b23740 10 client.0 _ll_register_callbacks cb 0x7f25441065c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255ab4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af5a14d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2559b4a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af599e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255ab4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af5a14d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58222/0 (socket says 172.21.15.49:58222) 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255ab4c640 1 -- 172.21.15.49:0/1640262923 learned_addr learned my addr 172.21.15.49:0/1640262923 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255a34b640 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55a09f0 0x559af599dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255ab4c640 1 -- 172.21.15.49:0/1640262923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55a09f0 msgr2=0x559af599dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255ab4c640 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55a09f0 0x559af599dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255ab4c640 1 -- 172.21.15.49:0/1640262923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 msgr2=0x559af599e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255ab4c640 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af599e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255ab4c640 1 -- 172.21.15.49:0/1640262923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559af59a5440 con 0x559af55c1390 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f255ab4c640 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af5a14d90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2544005e30 tx=0x7f25440ca160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c0a340053b59c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2539ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:18.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.737+0000 7f2539ffb640 1 -- 172.21.15.49:0/1640262923 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2544090070 con 0x559af55c1390 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2539ffb640 1 -- 172.21.15.49:0/1640262923 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f25440cfb40 con 0x559af55c1390 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2562b23740 1 -- 172.21.15.49:0/1640262923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f254c003d50 con 0x559af55c1390 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2539ffb640 1 -- 172.21.15.49:0/1640262923 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f25440f0050 con 0x559af55c1390 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2562b23740 10 client.16890 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2562b23740 1 -- 172.21.15.49:0/1640262923 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559af5a16380 con 0x559af55c1390 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2539ffb640 1 -- 172.21.15.49:0/1640262923 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f254c003d50 con 0x559af55c1390 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2539ffb640 1 -- 172.21.15.49:0/1640262923 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2544004040 con 0x559af55c1390 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2562b23740 10 client.16890 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2562b23740 10 client.16890 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2562b23740 20 client.16890 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2562b23740 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559af55e2070 0x559af5a188c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2562b23740 4 client.16890 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:18.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f2562b23740 1 -- 172.21.15.49:0/1640262923 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559af58fd8a0 con 0x559af55e2070 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.738+0000 7f255a34b640 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559af55e2070 0x559af5a188c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f255a34b640 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559af55e2070 0x559af5a188c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d9b6dd3d8215dc16 server_cookie=4f87c6c177f81f8 in_seq=0 out_seq=0 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2539ffb640 10 client.16890 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2539ffb640 1 -- 172.21.15.49:0/1640262923 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559af58fd8a0 con 0x559af55e2070 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2539ffb640 10 client.16890 handle_command_reply: tid=0 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 client.16890 shutdown 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 -- 172.21.15.49:0/1640262923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 msgr2=0x559af5a14d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af5a14d90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f2544005e30 tx=0x7f25440ca160 comp rx=0 tx=0).stop 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 -- 172.21.15.49:0/1640262923 shutdown_connections 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559af55e2070 0x559af5a188c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559af55c1390 0x559af5a14d90 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559af55b91b0 0x559af599e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 --2- 172.21.15.49:0/1640262923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559af55a09f0 0x559af599dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 -- 172.21.15.49:0/1640262923 >> 172.21.15.49:0/1640262923 conn(0x559af55d6460 msgr2=0x559af59a4430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2539ffb640 0 client.16890 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:42:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 -- 172.21.15.49:0/1640262923 shutdown_connections 2024-09-21T06:42:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 1 -- 172.21.15.49:0/1640262923 wait complete. 2024-09-21T06:42:18.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.739+0000 7f2562b23740 20 client.16890 trim_cache size 0 max 16384 2024-09-21T06:42:18.746 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 -- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f253c0b66b0 msgr2=0x7f253c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f253c0b66b0 0x7f253c0b8bc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2548020000 tx=0x7f254801d000 comp rx=0 tx=0).stop 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 -- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 msgr2=0x7f255419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 0x7f255419fd30 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f2544005cc0 tx=0x7f254402f380 comp rx=0 tx=0).stop 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 -- 172.21.15.49:0/3808701463 shutdown_connections 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f253c0b66b0 0x7f253c0b8bc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f255410de60 0x7f255419fd30 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2554105380 0x7f255419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 --2- 172.21.15.49:0/3808701463 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2554104a30 0x7f255419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 -- 172.21.15.49:0/3808701463 >> 172.21.15.49:0/3808701463 conn(0x7f25540797b0 msgr2=0x7f25541068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:18.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 -- 172.21.15.49:0/3808701463 shutdown_connections 2024-09-21T06:42:18.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:18.740+0000 7f255c5af640 1 -- 172.21.15.49:0/3808701463 wait complete. 2024-09-21T06:42:19.534 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:42:19.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:19 smithi049 ceph-mon[31177]: pgmap v489: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:42:19.791 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:19.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:19 smithi098 ceph-mon[34704]: pgmap v489: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:42:19.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:19 smithi079 ceph-mon[34346]: pgmap v489: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:42:20.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.215+0000 7f7858489640 1 -- 172.21.15.49:0/1661924480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850102ae0 msgr2=0x7f7850102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.215+0000 7f7858489640 1 --2- 172.21.15.49:0/1661924480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850102ae0 0x7f7850102ef0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f784c009900 tx=0x7f784c02a410 comp rx=0 tx=0).stop 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.215+0000 7f7858489640 1 -- 172.21.15.49:0/1661924480 shutdown_connections 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.215+0000 7f7858489640 1 --2- 172.21.15.49:0/1661924480 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7850108d20 0x7f785010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.215+0000 7f7858489640 1 --2- 172.21.15.49:0/1661924480 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f78501083d0 0x7f78501087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.215+0000 7f7858489640 1 --2- 172.21.15.49:0/1661924480 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850102ae0 0x7f7850102ef0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.215+0000 7f7858489640 1 -- 172.21.15.49:0/1661924480 >> 172.21.15.49:0/1661924480 conn(0x7f7850079760 msgr2=0x7f7850079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.215+0000 7f7858489640 1 -- 172.21.15.49:0/1661924480 shutdown_connections 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.215+0000 7f7858489640 1 -- 172.21.15.49:0/1661924480 wait complete. 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.216+0000 7f7858489640 1 Processor -- start 2024-09-21T06:42:20.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.216+0000 7f7858489640 1 -- start start 2024-09-21T06:42:20.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.216+0000 7f7858489640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7850102ae0 0x7f785019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.216+0000 7f7858489640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78501083d0 0x7f785019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.216+0000 7f7858489640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850108d20 0x7f785019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.216+0000 7f7858489640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7850113ab0 con 0x7f7850108d20 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.216+0000 7f7858489640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7850113930 con 0x7f7850102ae0 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.216+0000 7f7858489640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7850113c30 con 0x7f78501083d0 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856a26640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850108d20 0x7f785019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856a26640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850108d20 0x7f785019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58244/0 (socket says 172.21.15.49:58244) 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856a26640 1 -- 172.21.15.49:0/3474971783 learned_addr learned my addr 172.21.15.49:0/3474971783 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7855a24640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78501083d0 0x7f785019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856225640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7850102ae0 0x7f785019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856a26640 1 -- 172.21.15.49:0/3474971783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78501083d0 msgr2=0x7f785019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856a26640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78501083d0 0x7f785019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856a26640 1 -- 172.21.15.49:0/3474971783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7850102ae0 msgr2=0x7f785019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856a26640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7850102ae0 0x7f785019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856a26640 1 -- 172.21.15.49:0/3474971783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78501a0450 con 0x7f7850108d20 2024-09-21T06:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7856a26640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850108d20 0x7f785019fd20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f784800eaa0 tx=0x7f784800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f78477fe640 1 -- 172.21.15.49:0/3474971783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784800cdb0 con 0x7f7850108d20 2024-09-21T06:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f78477fe640 1 -- 172.21.15.49:0/3474971783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7848005020 con 0x7f7850108d20 2024-09-21T06:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7858489640 1 -- 172.21.15.49:0/3474971783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78501a0740 con 0x7f7850108d20 2024-09-21T06:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f78477fe640 1 -- 172.21.15.49:0/3474971783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78480116d0 con 0x7f7850108d20 2024-09-21T06:42:20.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.217+0000 7f7858489640 1 -- 172.21.15.49:0/3474971783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78501a6ea0 con 0x7f7850108d20 2024-09-21T06:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.220+0000 7f785e9fd740 1 Processor -- start 2024-09-21T06:42:20.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.220+0000 7f78477fe640 1 -- 172.21.15.49:0/3474971783 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f7848004b20 con 0x7f7850108d20 2024-09-21T06:42:20.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f785e9fd740 1 -- start start 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 0x563b4f19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 0x563b4f1a0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f785e9fd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563b4f115ea0 con 0x563b4edf8070 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f785e9fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563b4f1052d0 con 0x563b4edcf1b0 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f785e9fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563b4f1090e0 con 0x563b4edd7390 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f7855a24640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f7855a24640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58252/0 (socket says 172.21.15.49:58252) 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f7855a24640 1 -- 172.21.15.49:0/2143579471 learned_addr learned my addr 172.21.15.49:0/2143579471 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f7856225640 1 --2- 172.21.15.49:0/2143579471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 0x563b4f19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.221+0000 7f7855a24640 1 --2- 172.21.15.49:0/2143579471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 0x563b4f1a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7855a24640 1 -- 172.21.15.49:0/2143579471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 msgr2=0x563b4f1a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7855a24640 1 --2- 172.21.15.49:0/2143579471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 0x563b4f1a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7855a24640 1 -- 172.21.15.49:0/2143579471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 msgr2=0x563b4f19fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7855a24640 1 --2- 172.21.15.49:0/2143579471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 0x563b4f19fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f78477fe640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f783c0b6700 0x7f783c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7855a24640 1 -- 172.21.15.49:0/2143579471 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4ee63650 con 0x563b4edf8070 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7856a26640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f783c0b6700 0x7f783c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7855a24640 1 --2- 172.21.15.49:0/2143579471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19f6a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f78400124f0 tx=0x7f784000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06f659e6135eb6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f78477fe640 1 -- 172.21.15.49:0/3474971783 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f78480e77d0 con 0x7f7850108d20 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7844d9a640 1 -- 172.21.15.49:0/2143579471 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840004020 con 0x563b4edf8070 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7844d9a640 1 -- 172.21.15.49:0/2143579471 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7840004c50 con 0x563b4edf8070 2024-09-21T06:42:20.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.222+0000 7f7844d9a640 1 -- 172.21.15.49:0/2143579471 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840005280 con 0x563b4edf8070 2024-09-21T06:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f785e9fd740 1 -- 172.21.15.49:0/2143579471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 msgr2=0x563b4f19f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f7856a26640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f783c0b6700 0x7f783c0b8c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f78480e5500 tx=0x7f784801ef40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f785e9fd740 1 --2- 172.21.15.49:0/2143579471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19f6a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f78400124f0 tx=0x7f784000b650 comp rx=0 tx=0).stop 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f785e9fd740 1 -- 172.21.15.49:0/2143579471 shutdown_connections 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f785e9fd740 1 --2- 172.21.15.49:0/2143579471 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 0x563b4f1a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f785e9fd740 1 --2- 172.21.15.49:0/2143579471 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 0x563b4f19fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f785e9fd740 1 --2- 172.21.15.49:0/2143579471 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19f6a0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f785e9fd740 1 -- 172.21.15.49:0/2143579471 >> 172.21.15.49:0/2143579471 conn(0x563b4edec460 msgr2=0x563b4f19d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f785e9fd740 1 -- 172.21.15.49:0/2143579471 shutdown_connections 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.223+0000 7f785e9fd740 1 -- 172.21.15.49:0/2143579471 wait complete. 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f785e9fd740 1 -- start start 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f785e9fd740 1 Processor -- start 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 0x563b4f1aad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edd7390 0x563b4f1ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.230 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f1bb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f785e9fd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563b4ef66700 con 0x563b4edf8070 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f785e9fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563b4f0a0160 con 0x563b4edd7390 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f785e9fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563b4f1b2290 con 0x563b4edcf1b0 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f785e9fd740 10 client.0 _ll_register_callbacks cb 0x563b4f0b99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f7855a24640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f1bb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f7855a24640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f1bb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58258/0 (socket says 172.21.15.49:58258) 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f7855a24640 1 -- 172.21.15.49:0/600351956 learned_addr learned my addr 172.21.15.49:0/600351956 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f7856225640 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edd7390 0x563b4f1ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.224+0000 7f7855a24640 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 0x563b4f1aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7855a24640 1 -- 172.21.15.49:0/600351956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 msgr2=0x563b4f1aad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7855a24640 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 0x563b4f1aad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7855a24640 1 -- 172.21.15.49:0/600351956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edd7390 msgr2=0x563b4f1ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7855a24640 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edd7390 0x563b4f1ab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7855a24640 1 -- 172.21.15.49:0/600351956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4f0cdc90 con 0x563b4edf8070 2024-09-21T06:42:20.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7855a24640 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f1bb580 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x563b4f18f740 tx=0x7f7840004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0805035ae2658cb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7839ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7839ffb640 1 -- 172.21.15.49:0/600351956 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840023060 con 0x563b4edf8070 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7839ffb640 1 -- 172.21.15.49:0/600351956 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f7840004950 con 0x563b4edf8070 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f785e9fd740 1 -- 172.21.15.49:0/600351956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7840004c50 con 0x563b4edf8070 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7839ffb640 1 -- 172.21.15.49:0/600351956 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7840004fe0 con 0x563b4edf8070 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f785e9fd740 10 client.16902 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f785e9fd740 1 -- 172.21.15.49:0/600351956 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563b4f1bdf60 con 0x563b4edf8070 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.225+0000 7f7839ffb640 1 -- 172.21.15.49:0/600351956 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7840004c50 con 0x563b4edf8070 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.226+0000 7f7839ffb640 1 -- 172.21.15.49:0/600351956 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7840010720 con 0x563b4edf8070 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.226+0000 7f785e9fd740 10 client.16902 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.226+0000 7f785e9fd740 10 client.16902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.226+0000 7f785e9fd740 20 client.16902 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.226+0000 7f785e9fd740 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563b4edb69f0 0x563b4f1c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.226+0000 7f785e9fd740 4 client.16902 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:20.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.226+0000 7f785e9fd740 1 -- 172.21.15.49:0/600351956 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b4f117df0 con 0x563b4edb69f0 2024-09-21T06:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.226+0000 7f7856225640 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563b4edb69f0 0x563b4f1c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.227+0000 7f7856225640 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563b4edb69f0 0x563b4f1c12c0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8c59e5fc92e5698 server_cookie=27f79d2f430328e1 in_seq=0 out_seq=0 2024-09-21T06:42:20.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.227+0000 7f7839ffb640 10 client.16902 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.227+0000 7f7839ffb640 1 -- 172.21.15.49:0/600351956 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563b4f117df0 con 0x563b4edb69f0 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.227+0000 7f7839ffb640 10 client.16902 handle_command_reply: tid=0 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.227+0000 7f785e9fd740 1 client.16902 shutdown 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 -- 172.21.15.49:0/600351956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 msgr2=0x563b4f1bb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f1bb580 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x563b4f18f740 tx=0x7f7840004520 comp rx=0 tx=0).stop 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 -- 172.21.15.49:0/600351956 shutdown_connections 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563b4edb69f0 0x563b4f1c12c0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f1bb580 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edd7390 0x563b4f1ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f7839ffb640 0 client.16902 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 --2- 172.21.15.49:0/600351956 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 0x563b4f1aad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 -- 172.21.15.49:0/600351956 >> 172.21.15.49:0/600351956 conn(0x563b4edec460 msgr2=0x563b4f1a2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 -- 172.21.15.49:0/600351956 shutdown_connections 2024-09-21T06:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 1 -- 172.21.15.49:0/600351956 wait complete. 2024-09-21T06:42:20.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.228+0000 7f785e9fd740 20 client.16902 trim_cache size 0 max 16384 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.241+0000 7f785e9fd740 1 Processor -- start 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.241+0000 7f785e9fd740 1 -- start start 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 0x563b4f1a1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 0x563b4f1ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f785e9fd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f78501aff80 con 0x563b4edf8070 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f785e9fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78501ad850 con 0x563b4edcf1b0 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f785e9fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78501ab6c0 con 0x563b4edd7390 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58262/0 (socket says 172.21.15.49:58262) 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 -- 172.21.15.49:0/1310322540 learned_addr learned my addr 172.21.15.49:0/1310322540 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7856225640 1 --2- 172.21.15.49:0/1310322540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 0x563b4f1ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 --2- 172.21.15.49:0/1310322540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 0x563b4f1a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 -- 172.21.15.49:0/1310322540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 msgr2=0x563b4f1ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 --2- 172.21.15.49:0/1310322540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 0x563b4f1ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 -- 172.21.15.49:0/1310322540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 msgr2=0x563b4f1a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 --2- 172.21.15.49:0/1310322540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 0x563b4f1a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 -- 172.21.15.49:0/1310322540 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b4f1a2500 con 0x563b4edf8070 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f7855a24640 1 --2- 172.21.15.49:0/1310322540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19cbc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7840004610 tx=0x7f784000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29bdeb5e4084702 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f783bfff640 1 -- 172.21.15.49:0/1310322540 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840023040 con 0x563b4edf8070 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f783bfff640 1 -- 172.21.15.49:0/1310322540 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7840034040 con 0x563b4edf8070 2024-09-21T06:42:20.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.242+0000 7f783bfff640 1 -- 172.21.15.49:0/1310322540 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400107d0 con 0x563b4edf8070 2024-09-21T06:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.243+0000 7f785e9fd740 1 -- 172.21.15.49:0/1310322540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 msgr2=0x563b4f19cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.243+0000 7f785e9fd740 1 --2- 172.21.15.49:0/1310322540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19cbc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7840004610 tx=0x7f784000bf50 comp rx=0 tx=0).stop 2024-09-21T06:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.243+0000 7f785e9fd740 1 -- 172.21.15.49:0/1310322540 shutdown_connections 2024-09-21T06:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.243+0000 7f785e9fd740 1 --2- 172.21.15.49:0/1310322540 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edf8070 0x563b4f19cbc0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.243+0000 7f785e9fd740 1 --2- 172.21.15.49:0/1310322540 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edd7390 0x563b4f1ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.243+0000 7f785e9fd740 1 --2- 172.21.15.49:0/1310322540 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edcf1b0 0x563b4f1a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.243+0000 7f785e9fd740 1 -- 172.21.15.49:0/1310322540 >> 172.21.15.49:0/1310322540 conn(0x563b4edec460 msgr2=0x563b4f1ac2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.243+0000 7f785e9fd740 1 -- 172.21.15.49:0/1310322540 shutdown_connections 2024-09-21T06:42:20.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.243+0000 7f785e9fd740 1 -- 172.21.15.49:0/1310322540 wait complete. 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f785e9fd740 1 -- start start 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f785e9fd740 1 Processor -- start 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 0x563b4f1b7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edd7390 0x563b4f1b3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f785e9fd740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edf8070 0x563b4f1b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f785e9fd740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f78501abd10 con 0x563b4edd7390 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f785e9fd740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f78501ad180 con 0x563b4edf8070 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f785e9fd740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f78501ac3e0 con 0x563b4edcf1b0 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f785e9fd740 10 client.0 _ll_register_callbacks cb 0x7f784c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f7856225640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edd7390 0x563b4f1b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f7856225640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edd7390 0x563b4f1b3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58276/0 (socket says 172.21.15.49:58276) 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f7856225640 1 -- 172.21.15.49:0/3713478005 learned_addr learned my addr 172.21.15.49:0/3713478005 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.244+0000 7f7855a24640 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 0x563b4f1b7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7856225640 1 -- 172.21.15.49:0/3713478005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 msgr2=0x563b4f1b7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7856225640 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 0x563b4f1b7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7855a24640 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edf8070 0x563b4f1b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7856225640 1 -- 172.21.15.49:0/3713478005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edf8070 msgr2=0x563b4f1b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7856225640 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edf8070 0x563b4f1b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7856225640 1 -- 172.21.15.49:0/3713478005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b4f22aaf0 con 0x563b4edd7390 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7855a24640 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edf8070 0x563b4f1b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7856225640 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edd7390 0x563b4f1b3340 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f784c005ab0 tx=0x7f784c0041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1031eefe3bbb61af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7839ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7839ffb640 1 -- 172.21.15.49:0/3713478005 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c035040 con 0x563b4edd7390 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7839ffb640 1 -- 172.21.15.49:0/3713478005 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f784c005240 con 0x563b4edd7390 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f785e9fd740 1 -- 172.21.15.49:0/3713478005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7840034040 con 0x563b4edd7390 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7839ffb640 1 -- 172.21.15.49:0/3713478005 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f784c0044e0 con 0x563b4edd7390 2024-09-21T06:42:20.252 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f785e9fd740 10 client.16908 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f785e9fd740 1 -- 172.21.15.49:0/3713478005 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563b4f22bca0 con 0x563b4edd7390 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.245+0000 7f7839ffb640 1 -- 172.21.15.49:0/3713478005 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7840034040 con 0x563b4edd7390 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f7839ffb640 1 -- 172.21.15.49:0/3713478005 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f784c003680 con 0x563b4edd7390 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f785e9fd740 10 client.16908 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f785e9fd740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f785e9fd740 20 client.16908 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f785e9fd740 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563b4ed8bda0 0x563b4f22e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f785e9fd740 4 client.16908 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f785e9fd740 1 -- 172.21.15.49:0/3713478005 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b4f1138a0 con 0x563b4ed8bda0 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f7855a24640 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563b4ed8bda0 0x563b4f22e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f7855a24640 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563b4ed8bda0 0x563b4f22e490 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9daff6ba20212eb4 server_cookie=ba038d8a167753e2 in_seq=0 out_seq=0 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.246+0000 7f7839ffb640 10 client.16908 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f7839ffb640 1 -- 172.21.15.49:0/3713478005 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b4f1138a0 con 0x563b4ed8bda0 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f7839ffb640 10 client.16908 handle_command_reply: tid=0 2024-09-21T06:42:20.253 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 client.16908 shutdown 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 -- 172.21.15.49:0/3713478005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edd7390 msgr2=0x563b4f1b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edd7390 0x563b4f1b3340 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f784c005ab0 tx=0x7f784c0041a0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 -- 172.21.15.49:0/3713478005 shutdown_connections 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563b4ed8bda0 0x563b4f22e490 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563b4edf8070 0x563b4f1b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563b4edd7390 0x563b4f1b3340 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f7839ffb640 0 client.16908 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 --2- 172.21.15.49:0/3713478005 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563b4edcf1b0 0x563b4f1b7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 -- 172.21.15.49:0/3713478005 >> 172.21.15.49:0/3713478005 conn(0x563b4edec460 msgr2=0x563b4f1acbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 -- 172.21.15.49:0/3713478005 shutdown_connections 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 1 -- 172.21.15.49:0/3713478005 wait complete. 2024-09-21T06:42:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f785e9fd740 20 client.16908 trim_cache size 0 max 16384 2024-09-21T06:42:20.255 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f7858489640 1 -- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f783c0b6700 msgr2=0x7f783c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f7858489640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f783c0b6700 0x7f783c0b8c10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f78480e5500 tx=0x7f784801ef40 comp rx=0 tx=0).stop 2024-09-21T06:42:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f7858489640 1 -- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850108d20 msgr2=0x7f785019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.247+0000 7f7858489640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850108d20 0x7f785019fd20 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f784800eaa0 tx=0x7f784800ef60 comp rx=0 tx=0).stop 2024-09-21T06:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.248+0000 7f7858489640 1 -- 172.21.15.49:0/3474971783 shutdown_connections 2024-09-21T06:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.248+0000 7f7858489640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f783c0b6700 0x7f783c0b8c10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.248+0000 7f7858489640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7850108d20 0x7f785019fd20 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.248+0000 7f7858489640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f78501083d0 0x7f785019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.248+0000 7f7858489640 1 --2- 172.21.15.49:0/3474971783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7850102ae0 0x7f785019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.248+0000 7f7858489640 1 -- 172.21.15.49:0/3474971783 >> 172.21.15.49:0/3474971783 conn(0x7f7850079760 msgr2=0x7f7850101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.248+0000 7f7858489640 1 -- 172.21.15.49:0/3474971783 shutdown_connections 2024-09-21T06:42:20.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:20.248+0000 7f7858489640 1 -- 172.21.15.49:0/3474971783 wait complete. 2024-09-21T06:42:21.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:21 smithi049 ceph-mon[31177]: pgmap v490: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:42:21.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:21 smithi098 ceph-mon[34704]: pgmap v490: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:42:21.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:21 smithi079 ceph-mon[34346]: pgmap v490: 97 pgs: 97 active+clean; 5.1 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:42:21.951 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:42:21.951 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:42:22.223 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.428+0000 7fd19a04d640 1 -- 172.21.15.49:0/359999969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 msgr2=0x7fd194103f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.428+0000 7fd19a04d640 1 --2- 172.21.15.49:0/359999969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 0x7fd194103f00 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd184009900 tx=0x7fd18402a410 comp rx=0 tx=0).stop 2024-09-21T06:42:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.428+0000 7fd19a04d640 1 -- 172.21.15.49:0/359999969 shutdown_connections 2024-09-21T06:42:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.428+0000 7fd19a04d640 1 --2- 172.21.15.49:0/359999969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd194109d70 0x7fd1941105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.428+0000 7fd19a04d640 1 --2- 172.21.15.49:0/359999969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd194109420 0x7fd194109830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.428+0000 7fd19a04d640 1 --2- 172.21.15.49:0/359999969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 0x7fd194103f00 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.428+0000 7fd19a04d640 1 -- 172.21.15.49:0/359999969 >> 172.21.15.49:0/359999969 conn(0x7fd1940ff570 msgr2=0x7fd1941019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.428+0000 7fd19a04d640 1 -- 172.21.15.49:0/359999969 shutdown_connections 2024-09-21T06:42:22.431 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.428+0000 7fd19a04d640 1 -- 172.21.15.49:0/359999969 wait complete. 2024-09-21T06:42:22.433 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd19a04d640 1 Processor -- start 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd19a04d640 1 -- start start 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd19a04d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 0x7fd19419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd19a04d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd194109420 0x7fd19419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd19a04d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd194109d70 0x7fd19419fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd19a04d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd194113a30 con 0x7fd194103af0 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd19a04d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1941138b0 con 0x7fd194109d70 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd19a04d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd194113bb0 con 0x7fd194109420 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 0x7fd19419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 0x7fd19419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58294/0 (socket says 172.21.15.49:58294) 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.429+0000 7fd1937fe640 1 -- 172.21.15.49:0/1693119843 learned_addr learned my addr 172.21.15.49:0/1693119843 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd1937fe640 1 -- 172.21.15.49:0/1693119843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd194109420 msgr2=0x7fd19419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd1937fe640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd194109420 0x7fd19419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd193fff640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd194109d70 0x7fd19419fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd1937fe640 1 -- 172.21.15.49:0/1693119843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd194109d70 msgr2=0x7fd19419fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd1937fe640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd194109d70 0x7fd19419fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd1937fe640 1 -- 172.21.15.49:0/1693119843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1941a0380 con 0x7fd194103af0 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd193fff640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd194109d70 0x7fd19419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd1937fe640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 0x7fd19419a450 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd184005940 tx=0x7fd1840040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd190ff9640 1 -- 172.21.15.49:0/1693119843 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18403f030 con 0x7fd194103af0 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd19a04d640 1 -- 172.21.15.49:0/1693119843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1941a0610 con 0x7fd194103af0 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd190ff9640 1 -- 172.21.15.49:0/1693119843 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1840044c0 con 0x7fd194103af0 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd190ff9640 1 -- 172.21.15.49:0/1693119843 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184035070 con 0x7fd194103af0 2024-09-21T06:42:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.430+0000 7fd19a04d640 1 -- 172.21.15.49:0/1693119843 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1941a6e00 con 0x7fd194103af0 2024-09-21T06:42:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd190ff9640 1 -- 172.21.15.49:0/1693119843 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd184042030 con 0x7fd194103af0 2024-09-21T06:42:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1a0fc5740 1 Processor -- start 2024-09-21T06:42:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1a0fc5740 1 -- start start 2024-09-21T06:42:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca33d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca33def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.438 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 0x55ffca33e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ffca2b26f0 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ffca2a1b20 con 0x55ffc9f774d0 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ffca2a5930 con 0x55ffc9f981b0 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca33def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca33def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58310/0 (socket says 172.21.15.49:58310) 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd1937fe640 1 -- 172.21.15.49:0/669897379 learned_addr learned my addr 172.21.15.49:0/669897379 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd193fff640 1 --2- 172.21.15.49:0/669897379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca33d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.433+0000 7fd192ffd640 1 --2- 172.21.15.49:0/669897379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 0x55ffca33e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd1937fe640 1 -- 172.21.15.49:0/669897379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 msgr2=0x55ffca33d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd1937fe640 1 --2- 172.21.15.49:0/669897379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca33d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd1937fe640 1 -- 172.21.15.49:0/669897379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 msgr2=0x55ffca33e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd1937fe640 1 --2- 172.21.15.49:0/669897379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 0x55ffca33e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.439 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd1937fe640 1 -- 172.21.15.49:0/669897379 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffca267530 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd190ff9640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd17c0b6680 0x7fd17c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd1937fe640 1 --2- 172.21.15.49:0/669897379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca33def0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd184105310 tx=0x7fd18410bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4328a712b7400e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd193fff640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd17c0b6680 0x7fd17c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd190ff9640 1 -- 172.21.15.49:0/1693119843 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd184107c70 con 0x7fd194103af0 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd179ffb640 1 -- 172.21.15.49:0/669897379 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1840ca0f0 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd179ffb640 1 -- 172.21.15.49:0/669897379 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd184115070 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.434+0000 7fd179ffb640 1 -- 172.21.15.49:0/669897379 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1840cd210 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/669897379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 msgr2=0x55ffca33def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd193fff640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd17c0b6680 0x7fd17c0b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd18c005fd0 tx=0x7fd18c009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/669897379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca33def0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd184105310 tx=0x7fd18410bf40 comp rx=0 tx=0).stop 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/669897379 shutdown_connections 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/669897379 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 0x55ffca33e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/669897379 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca33def0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.440 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/669897379 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca33d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/669897379 >> 172.21.15.49:0/669897379 conn(0x55ffc9f8c300 msgr2=0x55ffca33b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/669897379 shutdown_connections 2024-09-21T06:42:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.435+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/669897379 wait complete. 2024-09-21T06:42:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1a0fc5740 1 -- start start 2024-09-21T06:42:22.441 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1a0fc5740 1 Processor -- start 2024-09-21T06:42:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 0x55ffca349000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f774d0 0x55ffca349540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca355150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ffca1d9ab0 con 0x55ffc9f774d0 2024-09-21T06:42:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ffca247730 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ffca34bef0 con 0x55ffc9f981b0 2024-09-21T06:42:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1a0fc5740 10 client.0 _ll_register_callbacks cb 0x55ffca29b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 0x55ffca349000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd192ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f774d0 0x55ffca349540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 0x55ffca349000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:34188/0 (socket says 172.21.15.49:34188) 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.436+0000 7fd1937fe640 1 -- 172.21.15.49:0/158987019 learned_addr learned my addr 172.21.15.49:0/158987019 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd193fff640 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca355150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd1937fe640 1 -- 172.21.15.49:0/158987019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 msgr2=0x55ffca355150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd1937fe640 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca355150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd1937fe640 1 -- 172.21.15.49:0/158987019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f774d0 msgr2=0x55ffca349540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd1937fe640 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f774d0 0x55ffca349540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd1937fe640 1 -- 172.21.15.49:0/158987019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffca003790 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd1937fe640 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 0x55ffca349000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd184105450 tx=0x7fd18410bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad786cf9c495ebbf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd172ffd640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd172ffd640 1 -- 172.21.15.49:0/158987019 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184049070 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd172ffd640 1 -- 172.21.15.49:0/158987019 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd1840d2230 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.437+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/158987019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd184115070 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd172ffd640 1 -- 172.21.15.49:0/158987019 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd1840cd3f0 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd1a0fc5740 10 client.26357 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/158987019 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ffca07c620 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd172ffd640 1 -- 172.21.15.49:0/158987019 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd184115070 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd172ffd640 1 -- 172.21.15.49:0/158987019 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd184105620 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd1a0fc5740 10 client.26357 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd1a0fc5740 10 client.26357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd1a0fc5740 20 client.26357 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ffc9f56d80 0x55ffca35aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd1a0fc5740 4 client.26357 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.438+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/158987019 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffca2b4640 con 0x55ffc9f56d80 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.439+0000 7fd192ffd640 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ffc9f56d80 0x55ffca35aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.439+0000 7fd172ffd640 10 client.26357 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.439+0000 7fd192ffd640 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ffc9f56d80 0x55ffca35aca0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9ce0c6f85ef6219 server_cookie=33468758e9a6629f in_seq=0 out_seq=0 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd172ffd640 1 -- 172.21.15.49:0/158987019 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ffca2b4640 con 0x55ffc9f56d80 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd172ffd640 10 client.26357 handle_command_reply: tid=0 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 client.26357 shutdown 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/158987019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 msgr2=0x55ffca349000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 0x55ffca349000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd184105450 tx=0x7fd18410bbb0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/158987019 shutdown_connections 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ffc9f56d80 0x55ffca35aca0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca355150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd172ffd640 0 client.26357 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f774d0 0x55ffca349540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/158987019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 0x55ffca349000 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/158987019 >> 172.21.15.49:0/158987019 conn(0x55ffc9f8c300 msgr2=0x55ffca33e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/158987019 shutdown_connections 2024-09-21T06:42:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/158987019 wait complete. 2024-09-21T06:42:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.440+0000 7fd1a0fc5740 20 client.26357 trim_cache size 0 max 16384 2024-09-21T06:42:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd1a0fc5740 1 Processor -- start 2024-09-21T06:42:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd1a0fc5740 1 -- start start 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 0x55ffca33f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f774d0 0x55ffca355050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f981b0 0x55ffca3461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd1941b2120 con 0x55ffc9f981b0 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1941af9f0 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd1941ad860 con 0x55ffc9f774d0 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd193fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f981b0 0x55ffca3461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd193fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f981b0 0x55ffca3461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58334/0 (socket says 172.21.15.49:58334) 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd193fff640 1 -- 172.21.15.49:0/392325812 learned_addr learned my addr 172.21.15.49:0/392325812 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.455+0000 7fd192ffd640 1 --2- 172.21.15.49:0/392325812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f774d0 0x55ffca355050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.456+0000 7fd193fff640 1 -- 172.21.15.49:0/392325812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f774d0 msgr2=0x55ffca355050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.456+0000 7fd193fff640 1 --2- 172.21.15.49:0/392325812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f774d0 0x55ffca355050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.456+0000 7fd193fff640 1 -- 172.21.15.49:0/392325812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 msgr2=0x55ffca33f0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.456+0000 7fd193fff640 1 --2- 172.21.15.49:0/392325812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 0x55ffca33f0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.456+0000 7fd193fff640 1 -- 172.21.15.49:0/392325812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffca3407c0 con 0x55ffc9f981b0 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.456+0000 7fd193fff640 1 --2- 172.21.15.49:0/392325812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f981b0 0x55ffca3461d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd18c010760 tx=0x7fd18c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8e6d2ba30c8572 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.456+0000 7fd1797fa640 1 -- 172.21.15.49:0/392325812 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c02c070 con 0x55ffc9f981b0 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.456+0000 7fd1797fa640 1 -- 172.21.15.49:0/392325812 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd18c010d50 con 0x55ffc9f981b0 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.456+0000 7fd1797fa640 1 -- 172.21.15.49:0/392325812 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c01e690 con 0x55ffc9f981b0 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/392325812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f981b0 msgr2=0x55ffca3461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/392325812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f981b0 0x55ffca3461d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fd18c010760 tx=0x7fd18c015000 comp rx=0 tx=0).stop 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/392325812 shutdown_connections 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/392325812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f981b0 0x55ffca3461d0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/392325812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f774d0 0x55ffca355050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/392325812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f6f2f0 0x55ffca33f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/392325812 >> 172.21.15.49:0/392325812 conn(0x55ffc9f8c300 msgr2=0x55ffca33e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/392325812 shutdown_connections 2024-09-21T06:42:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/392325812 wait complete. 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.457+0000 7fd1a0fc5740 1 -- start start 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1a0fc5740 1 Processor -- start 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca3515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 0x55ffca34eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1a0fc5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca34efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd1941adeb0 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd1941af320 con 0x55ffc9f774d0 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1a0fc5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd1941ae580 con 0x55ffc9f981b0 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1a0fc5740 10 client.0 _ll_register_callbacks cb 0x7fd188009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca3515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca3515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58342/0 (socket says 172.21.15.49:58342) 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1937fe640 1 -- 172.21.15.49:0/6901000 learned_addr learned my addr 172.21.15.49:0/6901000 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd192ffd640 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 0x55ffca34eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd193fff640 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca34efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1937fe640 1 -- 172.21.15.49:0/6901000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 msgr2=0x55ffca34efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1937fe640 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca34efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1937fe640 1 -- 172.21.15.49:0/6901000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 msgr2=0x55ffca34eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1937fe640 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 0x55ffca34eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.458+0000 7fd1937fe640 1 -- 172.21.15.49:0/6901000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffca34f520 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd192ffd640 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 0x55ffca34eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd1937fe640 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca3515e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd1840cd5b0 tx=0x7fd1840cd630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d7dd3c509ca48b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd172ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd172ffd640 1 -- 172.21.15.49:0/6901000 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd184049030 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd172ffd640 1 -- 172.21.15.49:0/6901000 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7fd1840d2230 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/6901000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd18c010d50 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd172ffd640 1 -- 172.21.15.49:0/6901000 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd1840cd870 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd1a0fc5740 10 client.16926 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/6901000 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ffca34f520 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd172ffd640 1 -- 172.21.15.49:0/6901000 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd18c010d50 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd172ffd640 1 -- 172.21.15.49:0/6901000 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd1840d7030 con 0x55ffc9f6f2f0 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd1a0fc5740 10 client.16926 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd1a0fc5740 10 client.16926 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd1a0fc5740 20 client.16926 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.459+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ffc9f2c1c0 0x55ffca3c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.460+0000 7fd1a0fc5740 4 client.16926 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.460+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/6901000 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ffca2b00f0 con 0x55ffc9f2c1c0 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.460+0000 7fd192ffd640 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ffc9f2c1c0 0x55ffca3c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.460+0000 7fd172ffd640 10 client.16926 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.460+0000 7fd192ffd640 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ffc9f2c1c0 0x55ffca3c7490 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1773fd2d22535d0 server_cookie=1cdace0c4eb1de5 in_seq=0 out_seq=0 2024-09-21T06:42:22.482 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd172ffd640 1 -- 172.21.15.49:0/6901000 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ffca2b00f0 con 0x55ffc9f2c1c0 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd172ffd640 10 client.16926 handle_command_reply: tid=0 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd1a0fc5740 1 client.16926 shutdown 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/6901000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 msgr2=0x55ffca3515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca3515e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fd1840cd5b0 tx=0x7fd1840cd630 comp rx=0 tx=0).stop 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/6901000 shutdown_connections 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ffc9f2c1c0 0x55ffca3c7490 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ffc9f981b0 0x55ffca34efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd172ffd640 0 client.16926 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ffc9f774d0 0x55ffca34eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd1a0fc5740 1 --2- 172.21.15.49:0/6901000 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ffc9f6f2f0 0x55ffca3515e0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.483 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.479+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/6901000 >> 172.21.15.49:0/6901000 conn(0x55ffc9f8c300 msgr2=0x55ffca34a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/6901000 shutdown_connections 2024-09-21T06:42:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd1a0fc5740 1 -- 172.21.15.49:0/6901000 wait complete. 2024-09-21T06:42:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd1a0fc5740 20 client.16926 trim_cache size 0 max 16384 2024-09-21T06:42:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:42:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:42:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:42:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:42:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 -- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd17c0b6680 msgr2=0x7fd17c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd17c0b6680 0x7fd17c0b8b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd18c005fd0 tx=0x7fd18c009500 comp rx=0 tx=0).stop 2024-09-21T06:42:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 -- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 msgr2=0x7fd19419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 0x7fd19419a450 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd184005940 tx=0x7fd1840040c0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 -- 172.21.15.49:0/1693119843 shutdown_connections 2024-09-21T06:42:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd17c0b6680 0x7fd17c0b8b90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd194109d70 0x7fd19419fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd194109420 0x7fd19419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 --2- 172.21.15.49:0/1693119843 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd194103af0 0x7fd19419a450 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 -- 172.21.15.49:0/1693119843 >> 172.21.15.49:0/1693119843 conn(0x7fd1940ff570 msgr2=0x7fd194101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.480+0000 7fd19a04d640 1 -- 172.21.15.49:0/1693119843 shutdown_connections 2024-09-21T06:42:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:22.481+0000 7fd19a04d640 1 -- 172.21.15.49:0/1693119843 wait complete. 2024-09-21T06:42:22.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.668+0000 7f057daee640 1 -- 172.21.15.49:0/1442701566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05781083c0 msgr2=0x7f05781087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.668+0000 7f057daee640 1 --2- 172.21.15.49:0/1442701566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05781083c0 0x7f05781087d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f0560009900 tx=0x7f056002a410 comp rx=0 tx=0).stop 2024-09-21T06:42:22.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.668+0000 7f057daee640 1 -- 172.21.15.49:0/1442701566 shutdown_connections 2024-09-21T06:42:22.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.668+0000 7f057daee640 1 --2- 172.21.15.49:0/1442701566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0578108d10 0x7f057810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.671 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.668+0000 7f057daee640 1 --2- 172.21.15.49:0/1442701566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05781083c0 0x7f05781087d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.668+0000 7f057daee640 1 --2- 172.21.15.49:0/1442701566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0578102a80 0x7f0578102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.668+0000 7f057daee640 1 -- 172.21.15.49:0/1442701566 >> 172.21.15.49:0/1442701566 conn(0x7f0578079740 msgr2=0x7f0578079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.668+0000 7f057daee640 1 -- 172.21.15.49:0/1442701566 shutdown_connections 2024-09-21T06:42:22.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.669+0000 7f057daee640 1 -- 172.21.15.49:0/1442701566 wait complete. 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.669+0000 7f057daee640 1 Processor -- start 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f057daee640 1 -- start start 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f057daee640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0578102a80 0x7f057819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f057daee640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05781083c0 0x7f057819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f057daee640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0578108d10 0x7f057819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f057daee640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05781129c0 con 0x7f0578108d10 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f057daee640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0578112840 con 0x7f05781083c0 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f057daee640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0578112b40 con 0x7f0578102a80 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f0577fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0578108d10 0x7f057819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f0577fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0578108d10 0x7f057819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58362/0 (socket says 172.21.15.49:58362) 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f0577fff640 1 -- 172.21.15.49:0/209376113 learned_addr learned my addr 172.21.15.49:0/209376113 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f0576ffd640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05781083c0 0x7f057819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.670+0000 7f05777fe640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0578102a80 0x7f057819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f0577fff640 1 -- 172.21.15.49:0/209376113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0578102a80 msgr2=0x7f057819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f0577fff640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0578102a80 0x7f057819b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f0577fff640 1 -- 172.21.15.49:0/209376113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05781083c0 msgr2=0x7f057819b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f0577fff640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05781083c0 0x7f057819b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f0577fff640 1 -- 172.21.15.49:0/209376113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05781a65a0 con 0x7f0578108d10 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f0577fff640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0578108d10 0x7f057819bd10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f057000cad0 tx=0x7f057000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f0574ff9640 1 -- 172.21.15.49:0/209376113 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057000ae20 con 0x7f0578108d10 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f0574ff9640 1 -- 172.21.15.49:0/209376113 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0570005020 con 0x7f0578108d10 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f057daee640 1 -- 172.21.15.49:0/209376113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05781a6890 con 0x7f0578108d10 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f0574ff9640 1 -- 172.21.15.49:0/209376113 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057000f6b0 con 0x7f0578108d10 2024-09-21T06:42:22.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.671+0000 7f057daee640 1 -- 172.21.15.49:0/209376113 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05781a6dd0 con 0x7f0578108d10 2024-09-21T06:42:22.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.673+0000 7f0584062740 1 Processor -- start 2024-09-21T06:42:22.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0574ff9640 1 -- 172.21.15.49:0/209376113 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f05700051d0 con 0x7f0578108d10 2024-09-21T06:42:22.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0584062740 1 -- start start 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0584062740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502f1350 0x55b750698430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0584062740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b750698970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0584062740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502d0670 0x55b750698eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0584062740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b75060ee60 con 0x55b7502f1350 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0584062740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b7505fe290 con 0x55b7502c8490 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0584062740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b7506020a0 con 0x55b7502d0670 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502f1350 0x55b750698430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502f1350 0x55b750698430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58378/0 (socket says 172.21.15.49:58378) 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0576ffd640 1 -- 172.21.15.49:0/3874899911 learned_addr learned my addr 172.21.15.49:0/3874899911 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f05777fe640 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b750698970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.674+0000 7f0576ffd640 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502d0670 0x55b750698eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f05777fe640 1 -- 172.21.15.49:0/3874899911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502d0670 msgr2=0x55b750698eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f05777fe640 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502d0670 0x55b750698eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f05777fe640 1 -- 172.21.15.49:0/3874899911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502f1350 msgr2=0x55b750698430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f05777fe640 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502f1350 0x55b750698430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f05777fe640 1 -- 172.21.15.49:0/3874899911 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b75035c930 con 0x55b7502c8490 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f0576ffd640 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502f1350 0x55b750698430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f0574ff9640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05640b6680 0x7f05640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f0576ffd640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05640b6680 0x7f05640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f05777fe640 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b750698970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f056800b730 tx=0x7f056800bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80c4880c4a6fc718 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f0574ff9640 1 -- 172.21.15.49:0/209376113 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f05700e77b0 con 0x7f0578108d10 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f056dffb640 1 -- 172.21.15.49:0/3874899911 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056800be40 con 0x55b7502c8490 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f056dffb640 1 -- 172.21.15.49:0/3874899911 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0568019070 con 0x55b7502c8490 2024-09-21T06:42:22.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.675+0000 7f056dffb640 1 -- 172.21.15.49:0/3874899911 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568014d60 con 0x55b7502c8490 2024-09-21T06:42:22.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0584062740 1 -- 172.21.15.49:0/3874899911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 msgr2=0x55b750698970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0576ffd640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05640b6680 0x7f05640b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0560032fd0 tx=0x7f0560040040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0584062740 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b750698970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f056800b730 tx=0x7f056800bbf0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0584062740 1 -- 172.21.15.49:0/3874899911 shutdown_connections 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0584062740 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502d0670 0x55b750698eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0584062740 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b750698970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0584062740 1 --2- 172.21.15.49:0/3874899911 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502f1350 0x55b750698430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0584062740 1 -- 172.21.15.49:0/3874899911 >> 172.21.15.49:0/3874899911 conn(0x55b7502e5740 msgr2=0x55b750696320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0584062740 1 -- 172.21.15.49:0/3874899911 shutdown_connections 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.676+0000 7f0584062740 1 -- 172.21.15.49:0/3874899911 wait complete. 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0584062740 1 -- start start 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0584062740 1 Processor -- start 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0584062740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b7506a8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0584062740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0584062740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502f1350 0x55b7506b4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0584062740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b75045f890 con 0x55b7502d0670 2024-09-21T06:42:22.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0584062740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b750598d40 con 0x55b7502c8490 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0584062740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b7506aaeb0 con 0x55b7502f1350 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0584062740 10 client.0 _ll_register_callbacks cb 0x55b7505fcc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0576ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506a88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58386/0 (socket says 172.21.15.49:58386) 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f0576ffd640 1 -- 172.21.15.49:0/3082548120 learned_addr learned my addr 172.21.15.49:0/3082548120 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.677+0000 7f05777fe640 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b7506a8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0577fff640 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502f1350 0x55b7506b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0576ffd640 1 -- 172.21.15.49:0/3082548120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502f1350 msgr2=0x55b7506b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0576ffd640 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502f1350 0x55b7506b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0576ffd640 1 -- 172.21.15.49:0/3082548120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 msgr2=0x55b7506a8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0576ffd640 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b7506a8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0576ffd640 1 -- 172.21.15.49:0/3082548120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7506b4750 con 0x55b7502d0670 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0576ffd640 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506a88b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0560006010 tx=0x7f0560031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906d419028240350 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0556ffd640 1 -- 172.21.15.49:0/3082548120 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056004e070 con 0x55b7502d0670 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0556ffd640 1 -- 172.21.15.49:0/3082548120 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f05600037f0 con 0x55b7502d0670 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0584062740 1 -- 172.21.15.49:0/3082548120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0568019070 con 0x55b7502d0670 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0556ffd640 1 -- 172.21.15.49:0/3082548120 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f056005a050 con 0x55b7502d0670 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0584062740 10 client.16938 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.678+0000 7f0584062740 1 -- 172.21.15.49:0/3082548120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b7506b7050 con 0x55b7502d0670 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.679+0000 7f0556ffd640 1 -- 172.21.15.49:0/3082548120 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0568019070 con 0x55b7502d0670 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.679+0000 7f0556ffd640 1 -- 172.21.15.49:0/3082548120 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f056004aa60 con 0x55b7502d0670 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.679+0000 7f0584062740 10 client.16938 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.679+0000 7f0584062740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.679+0000 7f0584062740 20 client.16938 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.679+0000 7f0584062740 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b7502afcd0 0x55b7506ba550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.679+0000 7f0584062740 4 client.16938 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.679+0000 7f0584062740 1 -- 172.21.15.49:0/3082548120 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b750610db0 con 0x55b7502afcd0 2024-09-21T06:42:22.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.679+0000 7f05777fe640 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b7502afcd0 0x55b7506ba550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.680+0000 7f0556ffd640 10 client.16938 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:22.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.680+0000 7f05777fe640 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b7502afcd0 0x55b7506ba550 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73f6622a9975defa server_cookie=adb28ed914b91516 in_seq=0 out_seq=0 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.680+0000 7f0556ffd640 1 -- 172.21.15.49:0/3082548120 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b750610db0 con 0x55b7502afcd0 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.680+0000 7f0556ffd640 10 client.16938 handle_command_reply: tid=0 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 client.16938 shutdown 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 -- 172.21.15.49:0/3082548120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 msgr2=0x55b7506a88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506a88b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0560006010 tx=0x7f0560031b10 comp rx=0 tx=0).stop 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 -- 172.21.15.49:0/3082548120 shutdown_connections 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b7502afcd0 0x55b7506ba550 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0556ffd640 0 client.16938 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502f1350 0x55b7506b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506a88b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 --2- 172.21.15.49:0/3082548120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b7506a8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 -- 172.21.15.49:0/3082548120 >> 172.21.15.49:0/3082548120 conn(0x55b7502e5740 msgr2=0x55b750699e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 -- 172.21.15.49:0/3082548120 shutdown_connections 2024-09-21T06:42:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 1 -- 172.21.15.49:0/3082548120 wait complete. 2024-09-21T06:42:22.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.681+0000 7f0584062740 20 client.16938 trim_cache size 0 max 16384 2024-09-21T06:42:22.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0584062740 1 Processor -- start 2024-09-21T06:42:22.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0584062740 1 -- start start 2024-09-21T06:42:22.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0584062740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502afcd0 0x55b7506a3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0584062740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b7506a7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0584062740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506aa050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0584062740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05781afea0 con 0x55b7502d0670 2024-09-21T06:42:22.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0584062740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05781ad770 con 0x55b7502c8490 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0584062740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05781ab5e0 con 0x55b7502afcd0 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0577fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506aa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0577fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506aa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58392/0 (socket says 172.21.15.49:58392) 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0577fff640 1 -- 172.21.15.49:0/177458179 learned_addr learned my addr 172.21.15.49:0/177458179 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f05777fe640 1 --2- 172.21.15.49:0/177458179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502afcd0 0x55b7506a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0576ffd640 1 --2- 172.21.15.49:0/177458179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b7506a7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0577fff640 1 -- 172.21.15.49:0/177458179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502afcd0 msgr2=0x55b7506a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0577fff640 1 --2- 172.21.15.49:0/177458179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502afcd0 0x55b7506a3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0577fff640 1 -- 172.21.15.49:0/177458179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 msgr2=0x55b7506a7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0577fff640 1 --2- 172.21.15.49:0/177458179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b7506a7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.699+0000 7f0577fff640 1 -- 172.21.15.49:0/177458179 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7506b4550 con 0x55b7502d0670 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f0577fff640 1 --2- 172.21.15.49:0/177458179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506aa050 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f05700ad2e0 tx=0x7f05700ad0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7124abe87b0ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f056d7fa640 1 -- 172.21.15.49:0/177458179 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057001d070 con 0x55b7502d0670 2024-09-21T06:42:22.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f056d7fa640 1 -- 172.21.15.49:0/177458179 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05700b20c0 con 0x55b7502d0670 2024-09-21T06:42:22.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f056d7fa640 1 -- 172.21.15.49:0/177458179 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05700ac2b0 con 0x55b7502d0670 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f0584062740 1 -- 172.21.15.49:0/177458179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 msgr2=0x55b7506aa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f0584062740 1 --2- 172.21.15.49:0/177458179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506aa050 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f05700ad2e0 tx=0x7f05700ad0f0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f0584062740 1 -- 172.21.15.49:0/177458179 shutdown_connections 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f0584062740 1 --2- 172.21.15.49:0/177458179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502d0670 0x55b7506aa050 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f0584062740 1 --2- 172.21.15.49:0/177458179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502c8490 0x55b7506a7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f0584062740 1 --2- 172.21.15.49:0/177458179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502afcd0 0x55b7506a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.700+0000 7f0584062740 1 -- 172.21.15.49:0/177458179 >> 172.21.15.49:0/177458179 conn(0x55b7502e5740 msgr2=0x55b750699460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.701+0000 7f0584062740 1 -- 172.21.15.49:0/177458179 shutdown_connections 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.701+0000 7f0584062740 1 -- 172.21.15.49:0/177458179 wait complete. 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.701+0000 7f0584062740 1 -- start start 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.701+0000 7f0584062740 1 Processor -- start 2024-09-21T06:42:22.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0584062740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502afcd0 0x55b7506acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0584062740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502c8490 0x55b7506ad220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0584062740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502d0670 0x55b75071e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0584062740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05781abc30 con 0x55b7502afcd0 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0584062740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05781ad0a0 con 0x55b7502d0670 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0584062740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05781ac300 con 0x55b7502c8490 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0584062740 10 client.0 _ll_register_callbacks cb 0x7f0560009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f05777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502afcd0 0x55b7506acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f05777fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502afcd0 0x55b7506acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58394/0 (socket says 172.21.15.49:58394) 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f05777fe640 1 -- 172.21.15.49:0/3787803735 learned_addr learned my addr 172.21.15.49:0/3787803735 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0577fff640 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502d0670 0x55b75071e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0576ffd640 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502c8490 0x55b7506ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f05777fe640 1 -- 172.21.15.49:0/3787803735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502c8490 msgr2=0x55b7506ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f05777fe640 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502c8490 0x55b7506ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f05777fe640 1 -- 172.21.15.49:0/3787803735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502d0670 msgr2=0x55b75071e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f05777fe640 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502d0670 0x55b75071e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f05777fe640 1 -- 172.21.15.49:0/3787803735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b75071e6c0 con 0x55b7502afcd0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0576ffd640 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502c8490 0x55b7506ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f05777fe640 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502afcd0 0x55b7506acc80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0568004810 tx=0x7f0568014940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5a35b5679222e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.702+0000 7f0556ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0556ffd640 1 -- 172.21.15.49:0/3787803735 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0568014d60 con 0x55b7502afcd0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0556ffd640 1 -- 172.21.15.49:0/3787803735 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f056800d950 con 0x55b7502afcd0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0584062740 1 -- 172.21.15.49:0/3787803735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05700b20c0 con 0x55b7502afcd0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0556ffd640 1 -- 172.21.15.49:0/3787803735 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f056800db50 con 0x55b7502afcd0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0584062740 10 client.16944 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0584062740 1 -- 172.21.15.49:0/3787803735 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b750725af0 con 0x55b7502afcd0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0556ffd640 1 -- 172.21.15.49:0/3787803735 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05700b20c0 con 0x55b7502afcd0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0556ffd640 1 -- 172.21.15.49:0/3787803735 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0568013070 con 0x55b7502afcd0 2024-09-21T06:42:22.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0584062740 10 client.16944 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:22.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0584062740 10 client.16944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:22.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0584062740 20 client.16944 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:22.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0584062740 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b7502f1350 0x55b7507280f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:22.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0584062740 4 client.16944 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:42:22.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.703+0000 7f0584062740 1 -- 172.21.15.49:0/3787803735 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b75060c860 con 0x55b7502f1350 2024-09-21T06:42:22.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.704+0000 7f0576ffd640 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b7502f1350 0x55b7507280f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:22.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.704+0000 7f0576ffd640 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b7502f1350 0x55b7507280f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fdfab2a6b3efe9a server_cookie=7791c04ea58bc6bb in_seq=0 out_seq=0 2024-09-21T06:42:22.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.704+0000 7f0556ffd640 10 client.16944 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:22.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0556ffd640 1 -- 172.21.15.49:0/3787803735 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b75060c860 con 0x55b7502f1350 2024-09-21T06:42:22.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0556ffd640 10 client.16944 handle_command_reply: tid=0 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 client.16944 shutdown 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 -- 172.21.15.49:0/3787803735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502afcd0 msgr2=0x55b7506acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502afcd0 0x55b7506acc80 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f0568004810 tx=0x7f0568014940 comp rx=0 tx=0).stop 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 -- 172.21.15.49:0/3787803735 shutdown_connections 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b7502f1350 0x55b7507280f0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0556ffd640 0 client.16944 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b7502d0670 0x55b75071e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b7502c8490 0x55b7506ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 --2- 172.21.15.49:0/3787803735 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b7502afcd0 0x55b7506acc80 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 -- 172.21.15.49:0/3787803735 >> 172.21.15.49:0/3787803735 conn(0x55b7502e5740 msgr2=0x55b7506a9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 -- 172.21.15.49:0/3787803735 shutdown_connections 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 1 -- 172.21.15.49:0/3787803735 wait complete. 2024-09-21T06:42:22.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.706+0000 7f0584062740 20 client.16944 trim_cache size 0 max 16384 2024-09-21T06:42:22.713 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:42:22.713 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:42:22.713 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "d4c33e7c-f05d-45e6-99c8-04167817884e", 2024-09-21T06:42:22.713 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:42:22.713 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:42:22.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 -- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05640b6680 msgr2=0x7f05640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05640b6680 0x7f05640b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0560032fd0 tx=0x7f0560040040 comp rx=0 tx=0).stop 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 -- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0578108d10 msgr2=0x7f057819bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0578108d10 0x7f057819bd10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f057000cad0 tx=0x7f057000cf90 comp rx=0 tx=0).stop 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 -- 172.21.15.49:0/209376113 shutdown_connections 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05640b6680 0x7f05640b8b90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0578108d10 0x7f057819bd10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05781083c0 0x7f057819b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 --2- 172.21.15.49:0/209376113 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0578102a80 0x7f057819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 -- 172.21.15.49:0/209376113 >> 172.21.15.49:0/209376113 conn(0x7f0578079740 msgr2=0x7f05781052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 -- 172.21.15.49:0/209376113 shutdown_connections 2024-09-21T06:42:22.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:22.707+0000 7f057daee640 1 -- 172.21.15.49:0/209376113 wait complete. 2024-09-21T06:42:23.469 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:42:23.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:23 smithi049 ceph-mon[31177]: pgmap v491: 97 pgs: 97 active+clean; 5.2 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-21T06:42:23.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:23 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:42:23.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:23 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:23.727 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:23.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:23 smithi098 ceph-mon[34704]: pgmap v491: 97 pgs: 97 active+clean; 5.2 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-21T06:42:23.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:23 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:42:23.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:23 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:23.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:23 smithi079 ceph-mon[34346]: pgmap v491: 97 pgs: 97 active+clean; 5.2 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-21T06:42:23.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:23 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:42:23.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:23 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.180+0000 7f10dd49d640 1 -- 172.21.15.49:0/720224935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d8108d30 msgr2=0x7f10d810f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:24.193 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.180+0000 7f10dd49d640 1 --2- 172.21.15.49:0/720224935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d8108d30 0x7f10d810f560 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009ca0 tx=0x7f10c802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.180+0000 7f10dd49d640 1 -- 172.21.15.49:0/720224935 shutdown_connections 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.180+0000 7f10dd49d640 1 --2- 172.21.15.49:0/720224935 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d8108d30 0x7f10d810f560 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.180+0000 7f10dd49d640 1 --2- 172.21.15.49:0/720224935 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d81083e0 0x7f10d81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.180+0000 7f10dd49d640 1 --2- 172.21.15.49:0/720224935 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10d8102aa0 0x7f10d8102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.180+0000 7f10dd49d640 1 -- 172.21.15.49:0/720224935 >> 172.21.15.49:0/720224935 conn(0x7f10d80797e0 msgr2=0x7f10d8079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.180+0000 7f10dd49d640 1 -- 172.21.15.49:0/720224935 shutdown_connections 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.180+0000 7f10dd49d640 1 -- 172.21.15.49:0/720224935 wait complete. 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10dd49d640 1 Processor -- start 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10dd49d640 1 -- start start 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10dd49d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d8102aa0 0x7f10d819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10dd49d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d81083e0 0x7f10d819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.194 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10dd49d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10d8108d30 0x7f10d819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10dd49d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f10d81129a0 con 0x7f10d81083e0 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10dd49d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10d8112820 con 0x7f10d8102aa0 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10dd49d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10d8112b20 con 0x7f10d8108d30 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10d67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d81083e0 0x7f10d819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10d67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d81083e0 0x7f10d819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58400/0 (socket says 172.21.15.49:58400) 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.181+0000 7f10d67fc640 1 -- 172.21.15.49:0/1711020261 learned_addr learned my addr 172.21.15.49:0/1711020261 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d8102aa0 0x7f10d819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d77fe640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10d8108d30 0x7f10d819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d67fc640 1 -- 172.21.15.49:0/1711020261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10d8108d30 msgr2=0x7f10d819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d67fc640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10d8108d30 0x7f10d819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d67fc640 1 -- 172.21.15.49:0/1711020261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d8102aa0 msgr2=0x7f10d819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d67fc640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d8102aa0 0x7f10d819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d67fc640 1 -- 172.21.15.49:0/1711020261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d81a0430 con 0x7f10d81083e0 2024-09-21T06:42:24.195 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d8102aa0 0x7f10d819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d77fe640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10d8108d30 0x7f10d819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10d67fc640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d81083e0 0x7f10d819aa70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f10c0005fd0 tx=0x7f10c000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10cffff640 1 -- 172.21.15.49:0/1711020261 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0017070 con 0x7f10d81083e0 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10dd49d640 1 -- 172.21.15.49:0/1711020261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d81a0720 con 0x7f10d81083e0 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10cffff640 1 -- 172.21.15.49:0/1711020261 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10c0009c30 con 0x7f10d81083e0 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10cffff640 1 -- 172.21.15.49:0/1711020261 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c0003d30 con 0x7f10d81083e0 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.182+0000 7f10dd49d640 1 -- 172.21.15.49:0/1711020261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d81a6e80 con 0x7f10d81083e0 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.185+0000 7f10e3a11740 1 Processor -- start 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.185+0000 7f10e3a11740 1 -- start start 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.185+0000 7f10cffff640 1 -- 172.21.15.49:0/1711020261 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f10c0003ed0 con 0x7f10d81083e0 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.185+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 0x55bbe589c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.185+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 0x55bbe589c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.196 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.185+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe589ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.185+0000 7f10e3a11740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bbe5812e50 con 0x55bbe54d4390 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.185+0000 7f10e3a11740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bbe5802280 con 0x55bbe54f5070 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.185+0000 7f10e3a11740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bbe5806090 con 0x55bbe54cc1b0 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe589ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe589ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58414/0 (socket says 172.21.15.49:58414) 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d67fc640 1 -- 172.21.15.49:0/3351505996 learned_addr learned my addr 172.21.15.49:0/3351505996 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d77fe640 1 --2- 172.21.15.49:0/3351505996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 0x55bbe589c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/3351505996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 0x55bbe589c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d67fc640 1 -- 172.21.15.49:0/3351505996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 msgr2=0x55bbe589c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10cffff640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10c40b6680 0x7f10c40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d67fc640 1 --2- 172.21.15.49:0/3351505996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 0x55bbe589c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d67fc640 1 -- 172.21.15.49:0/3351505996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 msgr2=0x55bbe589c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d67fc640 1 --2- 172.21.15.49:0/3351505996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 0x55bbe589c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.197 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d67fc640 1 -- 172.21.15.49:0/3351505996 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe5560650 con 0x55bbe54d4390 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d77fe640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10c40b6680 0x7f10c40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10cffff640 1 -- 172.21.15.49:0/1711020261 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f10c00e73e0 con 0x7f10d81083e0 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.186+0000 7f10d67fc640 1 --2- 172.21.15.49:0/3351505996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe589ccf0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f10c00e4a80 tx=0x7f10c00ad400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fc13d3a10320b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.187+0000 7f10cd7fa640 1 -- 172.21.15.49:0/3351505996 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c00acfe0 con 0x55bbe54d4390 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.187+0000 7f10cd7fa640 1 -- 172.21.15.49:0/3351505996 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10c00acd20 con 0x55bbe54d4390 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.187+0000 7f10cd7fa640 1 -- 172.21.15.49:0/3351505996 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c00ac980 con 0x55bbe54d4390 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.187+0000 7f10e3a11740 1 -- 172.21.15.49:0/3351505996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 msgr2=0x55bbe589ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.187+0000 7f10d77fe640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10c40b6680 0x7f10c40b8b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f10c802f500 tx=0x7f10c80095c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.187+0000 7f10e3a11740 1 --2- 172.21.15.49:0/3351505996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe589ccf0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f10c00e4a80 tx=0x7f10c00ad400 comp rx=0 tx=0).stop 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.188+0000 7f10e3a11740 1 -- 172.21.15.49:0/3351505996 shutdown_connections 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.188+0000 7f10e3a11740 1 --2- 172.21.15.49:0/3351505996 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe589ccf0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.188+0000 7f10e3a11740 1 --2- 172.21.15.49:0/3351505996 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 0x55bbe589c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.188+0000 7f10e3a11740 1 --2- 172.21.15.49:0/3351505996 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 0x55bbe589c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.198 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.188+0000 7f10e3a11740 1 -- 172.21.15.49:0/3351505996 >> 172.21.15.49:0/3351505996 conn(0x55bbe54e9460 msgr2=0x55bbe589a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.188+0000 7f10e3a11740 1 -- 172.21.15.49:0/3351505996 shutdown_connections 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.188+0000 7f10e3a11740 1 -- 172.21.15.49:0/3351505996 wait complete. 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.188+0000 7f10e3a11740 1 -- start start 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.188+0000 7f10e3a11740 1 Processor -- start 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 0x55bbe58a78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe58a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 0x55bbe58b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10e3a11740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bbe5663700 con 0x55bbe54d4390 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10e3a11740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bbe579d110 con 0x55bbe54f5070 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10e3a11740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bbe58aa9f0 con 0x55bbe54cc1b0 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10e3a11740 10 client.0 _ll_register_callbacks cb 0x55bbe57b6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe58a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe58a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58428/0 (socket says 172.21.15.49:58428) 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d67fc640 1 -- 172.21.15.49:0/993505913 learned_addr learned my addr 172.21.15.49:0/993505913 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 0x55bbe58a78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d77fe640 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 0x55bbe58b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d67fc640 1 -- 172.21.15.49:0/993505913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 msgr2=0x55bbe58a78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d67fc640 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 0x55bbe58a78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d67fc640 1 -- 172.21.15.49:0/993505913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 msgr2=0x55bbe58b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d67fc640 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 0x55bbe58b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d67fc640 1 -- 172.21.15.49:0/993505913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe57cac40 con 0x55bbe54d4390 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10d67fc640 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe58a7e30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f10c0022fc0 tx=0x7f10c000df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f7fc2613b66d91e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10be7fc640 1 -- 172.21.15.49:0/993505913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c00acb60 con 0x55bbe54d4390 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10be7fc640 1 -- 172.21.15.49:0/993505913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f10c00eaa40 con 0x55bbe54d4390 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.189+0000 7f10e3a11740 1 -- 172.21.15.49:0/993505913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10c00acd20 con 0x55bbe54d4390 2024-09-21T06:42:24.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10be7fc640 1 -- 172.21.15.49:0/993505913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f10c00ac980 con 0x55bbe54d4390 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10e3a11740 10 client.16956 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10e3a11740 1 -- 172.21.15.49:0/993505913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bbe58b66f0 con 0x55bbe54d4390 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10be7fc640 1 -- 172.21.15.49:0/993505913 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10c00ad910 con 0x55bbe54d4390 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10be7fc640 1 -- 172.21.15.49:0/993505913 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f10c00a9480 con 0x55bbe54d4390 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10e3a11740 10 client.16956 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10e3a11740 10 client.16956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10e3a11740 20 client.16956 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10e3a11740 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bbe54b39f0 0x55bbe58b9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10e3a11740 4 client.16956 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.190+0000 7f10e3a11740 1 -- 172.21.15.49:0/993505913 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f10c00acd20 con 0x55bbe54b39f0 2024-09-21T06:42:24.201 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.191+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bbe54b39f0 0x55bbe58b9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.191+0000 7f10be7fc640 10 client.16956 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.191+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bbe54b39f0 0x55bbe58b9a50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba26414de27c96ae server_cookie=2c5e2b29834f674e in_seq=0 out_seq=0 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10be7fc640 1 -- 172.21.15.49:0/993505913 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f10c00acd20 con 0x55bbe54b39f0 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10be7fc640 10 client.16956 handle_command_reply: tid=0 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 client.16956 shutdown 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 -- 172.21.15.49:0/993505913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 msgr2=0x55bbe58a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe58a7e30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f10c0022fc0 tx=0x7f10c000df70 comp rx=0 tx=0).stop 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 -- 172.21.15.49:0/993505913 shutdown_connections 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bbe54b39f0 0x55bbe58b9a50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10be7fc640 0 client.16956 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54f5070 0x55bbe58b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe58a7e30 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 --2- 172.21.15.49:0/993505913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54cc1b0 0x55bbe58a78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 -- 172.21.15.49:0/993505913 >> 172.21.15.49:0/993505913 conn(0x55bbe54e9460 msgr2=0x55bbe589f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:24.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 -- 172.21.15.49:0/993505913 shutdown_connections 2024-09-21T06:42:24.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 1 -- 172.21.15.49:0/993505913 wait complete. 2024-09-21T06:42:24.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.192+0000 7f10e3a11740 20 client.16956 trim_cache size 0 max 16384 2024-09-21T06:42:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.210+0000 7f10e3a11740 1 Processor -- start 2024-09-21T06:42:24.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.210+0000 7f10e3a11740 1 -- start start 2024-09-21T06:42:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.210+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54b39f0 0x55bbe58a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.210+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 0x55bbe58a9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.210+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54d4390 0x55bbe58b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.210+0000 7f10e3a11740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f10d81b2220 con 0x55bbe54b39f0 2024-09-21T06:42:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.210+0000 7f10e3a11740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10d81afaf0 con 0x55bbe54cc1b0 2024-09-21T06:42:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.210+0000 7f10e3a11740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10d81ad960 con 0x55bbe54d4390 2024-09-21T06:42:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54b39f0 0x55bbe58a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54b39f0 0x55bbe58a67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58436/0 (socket says 172.21.15.49:58436) 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d6ffd640 1 -- 172.21.15.49:0/4260231762 learned_addr learned my addr 172.21.15.49:0/4260231762 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d67fc640 1 --2- 172.21.15.49:0/4260231762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 0x55bbe58a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d77fe640 1 --2- 172.21.15.49:0/4260231762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54d4390 0x55bbe58b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d6ffd640 1 -- 172.21.15.49:0/4260231762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54d4390 msgr2=0x55bbe58b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/4260231762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54d4390 0x55bbe58b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d6ffd640 1 -- 172.21.15.49:0/4260231762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 msgr2=0x55bbe58a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/4260231762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 0x55bbe58a9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d6ffd640 1 -- 172.21.15.49:0/4260231762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe5894410 con 0x55bbe54b39f0 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/4260231762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54b39f0 0x55bbe58a67e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f10d000cc50 tx=0x7f10d000c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f97c3886af1689 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10ccff9640 1 -- 172.21.15.49:0/4260231762 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0005220 con 0x55bbe54b39f0 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10ccff9640 1 -- 172.21.15.49:0/4260231762 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10d0004c50 con 0x55bbe54b39f0 2024-09-21T06:42:24.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.211+0000 7f10ccff9640 1 -- 172.21.15.49:0/4260231762 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d001c810 con 0x55bbe54b39f0 2024-09-21T06:42:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.212+0000 7f10e3a11740 1 -- 172.21.15.49:0/4260231762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54b39f0 msgr2=0x55bbe58a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.212+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4260231762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54b39f0 0x55bbe58a67e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f10d000cc50 tx=0x7f10d000c4f0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.212+0000 7f10e3a11740 1 -- 172.21.15.49:0/4260231762 shutdown_connections 2024-09-21T06:42:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.212+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4260231762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54d4390 0x55bbe58b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.212+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4260231762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 0x55bbe58a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.212+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4260231762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54b39f0 0x55bbe58a67e0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.212+0000 7f10e3a11740 1 -- 172.21.15.49:0/4260231762 >> 172.21.15.49:0/4260231762 conn(0x55bbe54e9460 msgr2=0x55bbe58a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.212+0000 7f10e3a11740 1 -- 172.21.15.49:0/4260231762 shutdown_connections 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.212+0000 7f10e3a11740 1 -- 172.21.15.49:0/4260231762 wait complete. 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10e3a11740 1 -- start start 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10e3a11740 1 Processor -- start 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54b39f0 0x55bbe58bb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 0x55bbe58bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10e3a11740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe591d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10e3a11740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f10d81adfb0 con 0x55bbe54d4390 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10e3a11740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10d81af420 con 0x55bbe54cc1b0 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10e3a11740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10d81ae680 con 0x55bbe54b39f0 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10e3a11740 10 client.0 _ll_register_callbacks cb 0x7f10c8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10d77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe591d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10d77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe591d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58444/0 (socket says 172.21.15.49:58444) 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10d77fe640 1 -- 172.21.15.49:0/4047379940 learned_addr learned my addr 172.21.15.49:0/4047379940 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.213+0000 7f10d67fc640 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 0x55bbe58bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54b39f0 0x55bbe58bb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10d77fe640 1 -- 172.21.15.49:0/4047379940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54b39f0 msgr2=0x55bbe58bb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10d77fe640 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54b39f0 0x55bbe58bb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10d77fe640 1 -- 172.21.15.49:0/4047379940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 msgr2=0x55bbe58bbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10d77fe640 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 0x55bbe58bbc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10d77fe640 1 -- 172.21.15.49:0/4047379940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe591da40 con 0x55bbe54d4390 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10d77fe640 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe591d3d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009ca0 tx=0x7f10c802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c1f71aad8558a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10be7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10be7fc640 1 -- 172.21.15.49:0/4047379940 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10c8004490 con 0x55bbe54d4390 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10be7fc640 1 -- 172.21.15.49:0/4047379940 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f10c8004630 con 0x55bbe54d4390 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10e3a11740 1 -- 172.21.15.49:0/4047379940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10d0004c50 con 0x55bbe54d4390 2024-09-21T06:42:24.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10be7fc640 1 -- 172.21.15.49:0/4047379940 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f10c8004830 con 0x55bbe54d4390 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10e3a11740 10 client.16962 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.214+0000 7f10e3a11740 1 -- 172.21.15.49:0/4047379940 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bbe5924e00 con 0x55bbe54d4390 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.215+0000 7f10be7fc640 1 -- 172.21.15.49:0/4047379940 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10d0004c50 con 0x55bbe54d4390 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.215+0000 7f10be7fc640 1 -- 172.21.15.49:0/4047379940 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f10c8030830 con 0x55bbe54d4390 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.215+0000 7f10e3a11740 10 client.16962 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.215+0000 7f10e3a11740 10 client.16962 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.215+0000 7f10e3a11740 20 client.16962 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.215+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bbe54f5070 0x55bbe59275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.215+0000 7f10e3a11740 4 client.16962 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.215+0000 7f10e3a11740 1 -- 172.21.15.49:0/4047379940 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bbe5814da0 con 0x55bbe54f5070 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.215+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bbe54f5070 0x55bbe59275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10d6ffd640 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bbe54f5070 0x55bbe59275d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6fc85af3d6a8e2f server_cookie=8dbaefeda0d24013 in_seq=0 out_seq=0 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10be7fc640 10 client.16962 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:24.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10be7fc640 1 -- 172.21.15.49:0/4047379940 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x55bbe5814da0 con 0x55bbe54f5070 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10be7fc640 10 client.16962 handle_command_reply: tid=0 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 client.16962 shutdown 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 -- 172.21.15.49:0/4047379940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 msgr2=0x55bbe591d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe591d3d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f10c8009ca0 tx=0x7f10c802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 -- 172.21.15.49:0/4047379940 shutdown_connections 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bbe54f5070 0x55bbe59275d0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bbe54d4390 0x55bbe591d3d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bbe54cc1b0 0x55bbe58bbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10be7fc640 0 client.16962 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 --2- 172.21.15.49:0/4047379940 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bbe54b39f0 0x55bbe58bb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 -- 172.21.15.49:0/4047379940 >> 172.21.15.49:0/4047379940 conn(0x55bbe54e9460 msgr2=0x55bbe589d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 -- 172.21.15.49:0/4047379940 shutdown_connections 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.216+0000 7f10e3a11740 1 -- 172.21.15.49:0/4047379940 wait complete. 2024-09-21T06:42:24.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10e3a11740 20 client.16962 trim_cache size 0 max 16384 2024-09-21T06:42:24.224 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:42:24.224 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:42:24.224 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:42:24.224 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:42:24.224 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.224 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "d4c33e7c-f05d-45e6-99c8-04167817884e", 2024-09-21T06:42:24.224 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:42:24.225 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.227 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:42:24.228 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:42:24.229 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:24.230 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:42:24.231 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:42:24.231 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:42:24.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 -- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10c40b6680 msgr2=0x7f10c40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:24.231 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10c40b6680 0x7f10c40b8b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f10c802f500 tx=0x7f10c80095c0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 -- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d81083e0 msgr2=0x7f10d819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d81083e0 0x7f10d819aa70 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f10c0005fd0 tx=0x7f10c000dde0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 -- 172.21.15.49:0/1711020261 shutdown_connections 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10c40b6680 0x7f10c40b8b90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10d8108d30 0x7f10d819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10d81083e0 0x7f10d819aa70 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 --2- 172.21.15.49:0/1711020261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10d8102aa0 0x7f10d819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 -- 172.21.15.49:0/1711020261 >> 172.21.15.49:0/1711020261 conn(0x7f10d80797e0 msgr2=0x7f10d8101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 -- 172.21.15.49:0/1711020261 shutdown_connections 2024-09-21T06:42:24.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:24.217+0000 7f10dd49d640 1 -- 172.21.15.49:0/1711020261 wait complete. 2024-09-21T06:42:24.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:24 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:42:24.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:24 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:24.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:24 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:42:24.723 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:24 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:24.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:24 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:42:24.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:24 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:24.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:24 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:42:24.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:24 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:24.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:24 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:42:24.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:24 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:24.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:24 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:42:24.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:24 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:24.960 INFO:tasks.cephfs.filesystem:scrub status for tag:d4c33e7c-f05d-45e6-99c8-04167817884e - {'path': '/', 'tag': 'd4c33e7c-f05d-45e6-99c8-04167817884e', 'options': 'recursive,force'} 2024-09-21T06:42:25.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:25 smithi049 ceph-mon[31177]: pgmap v492: 97 pgs: 97 active+clean; 5.2 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-21T06:42:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:25 smithi098 ceph-mon[34704]: pgmap v492: 97 pgs: 97 active+clean; 5.2 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-21T06:42:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:25 smithi079 ceph-mon[34346]: pgmap v492: 97 pgs: 97 active+clean; 5.2 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-21T06:42:27.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:27 smithi049 ceph-mon[31177]: pgmap v493: 97 pgs: 97 active+clean; 5.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-21T06:42:28.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:27 smithi098 ceph-mon[34704]: pgmap v493: 97 pgs: 97 active+clean; 5.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-21T06:42:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:27 smithi079 ceph-mon[34346]: pgmap v493: 97 pgs: 97 active+clean; 5.3 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-21T06:42:28.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:28 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:42:29.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:28 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:42:29.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:28 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:42:29.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:29 smithi049 ceph-mon[31177]: pgmap v494: 97 pgs: 97 active+clean; 5.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-21T06:42:29.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:29 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:42:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:29 smithi098 ceph-mon[34704]: pgmap v494: 97 pgs: 97 active+clean; 5.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-21T06:42:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:29 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:42:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:29 smithi079 ceph-mon[34346]: pgmap v494: 97 pgs: 97 active+clean; 5.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 16 op/s 2024-09-21T06:42:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:29 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:42:31.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:31 smithi049 ceph-mon[31177]: pgmap v495: 97 pgs: 97 active+clean; 5.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:42:32.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:31 smithi098 ceph-mon[34704]: pgmap v495: 97 pgs: 97 active+clean; 5.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:42:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:31 smithi079 ceph-mon[34346]: pgmap v495: 97 pgs: 97 active+clean; 5.3 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:42:33.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:33 smithi049 ceph-mon[31177]: pgmap v496: 97 pgs: 97 active+clean; 5.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:42:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:33 smithi098 ceph-mon[34704]: pgmap v496: 97 pgs: 97 active+clean; 5.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:42:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:33 smithi079 ceph-mon[34346]: pgmap v496: 97 pgs: 97 active+clean; 5.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:42:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 -- 172.21.15.49:0/2266408315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 msgr2=0x7ff1bc10f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/2266408315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 0x7ff1bc10f470 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4009ca0 tx=0x7ff1b402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 -- 172.21.15.49:0/2266408315 shutdown_connections 2024-09-21T06:42:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/2266408315 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 0x7ff1bc10f470 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/2266408315 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc1082f0 0x7ff1bc108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/2266408315 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1bc1029c0 0x7ff1bc102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 -- 172.21.15.49:0/2266408315 >> 172.21.15.49:0/2266408315 conn(0x7ff1bc0fe3c0 msgr2=0x7ff1bc100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 -- 172.21.15.49:0/2266408315 shutdown_connections 2024-09-21T06:42:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 -- 172.21.15.49:0/2266408315 wait complete. 2024-09-21T06:42:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.595+0000 7ff1c1b41640 1 Processor -- start 2024-09-21T06:42:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1c1b41640 1 -- start start 2024-09-21T06:42:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1c1b41640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1bc1029c0 0x7ff1bc109560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1c1b41640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc1082f0 0x7ff1bc109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1c1b41640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 0x7ff1bc109fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1c1b41640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc112900 con 0x7ff1bc108c40 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1c1b41640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc112780 con 0x7ff1bc1082f0 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1c1b41640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc112a80 con 0x7ff1bc1029c0 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1bbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 0x7ff1bc109fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1bbfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 0x7ff1bc109fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48708/0 (socket says 172.21.15.49:48708) 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1bbfff640 1 -- 172.21.15.49:0/3896096680 learned_addr learned my addr 172.21.15.49:0/3896096680 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1baffd640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc1082f0 0x7ff1bc109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.596+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1bc1029c0 0x7ff1bc109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1bbfff640 1 -- 172.21.15.49:0/3896096680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1bc1029c0 msgr2=0x7ff1bc109560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1bbfff640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1bc1029c0 0x7ff1bc109560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1bbfff640 1 -- 172.21.15.49:0/3896096680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc1082f0 msgr2=0x7ff1bc109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1bbfff640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc1082f0 0x7ff1bc109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1bbfff640 1 -- 172.21.15.49:0/3896096680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1bc1a86e0 con 0x7ff1bc108c40 2024-09-21T06:42:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1bbfff640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 0x7ff1bc109fe0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4005cc0 tx=0x7ff1b4031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1b8ff9640 1 -- 172.21.15.49:0/3896096680 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4003b70 con 0x7ff1bc108c40 2024-09-21T06:42:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1b8ff9640 1 -- 172.21.15.49:0/3896096680 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1b40318f0 con 0x7ff1bc108c40 2024-09-21T06:42:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1b8ff9640 1 -- 172.21.15.49:0/3896096680 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b402f950 con 0x7ff1bc108c40 2024-09-21T06:42:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1c1b41640 1 -- 172.21.15.49:0/3896096680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1bc1a8970 con 0x7ff1bc108c40 2024-09-21T06:42:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.597+0000 7ff1c1b41640 1 -- 172.21.15.49:0/3896096680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1bc1a8e70 con 0x7ff1bc108c40 2024-09-21T06:42:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.600+0000 7ff1c8aaf740 1 Processor -- start 2024-09-21T06:42:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.600+0000 7ff1b8ff9640 1 -- 172.21.15.49:0/3896096680 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ff1b402fb10 con 0x7ff1bc108c40 2024-09-21T06:42:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.600+0000 7ff1c8aaf740 1 -- start start 2024-09-21T06:42:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.600+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7235f1b0 0x560b727049b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.600+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b723362f0 0x560b72704ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7233e4d0 0x560b72705430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560b726796f0 con 0x560b723362f0 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560b72668b20 con 0x560b7233e4d0 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560b7266c930 con 0x560b7235f1b0 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b723362f0 0x560b72704ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b723362f0 0x560b72704ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48720/0 (socket says 172.21.15.49:48720) 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/3126868927 learned_addr learned my addr 172.21.15.49:0/3126868927 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1baffd640 1 --2- 172.21.15.49:0/3126868927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7235f1b0 0x560b727049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1baffd640 1 --2- 172.21.15.49:0/3126868927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7233e4d0 0x560b72705430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1b8ff9640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff1a80b66b0 0x7ff1a80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/3126868927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7235f1b0 msgr2=0x560b727049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/3126868927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7235f1b0 0x560b727049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/3126868927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7233e4d0 msgr2=0x560b72705430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/3126868927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7233e4d0 0x560b72705430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/3126868927 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b7262e530 con 0x560b723362f0 2024-09-21T06:42:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bbfff640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff1a80b66b0 0x7ff1a80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1b8ff9640 1 -- 172.21.15.49:0/3896096680 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff1b41087f0 con 0x7ff1bc108c40 2024-09-21T06:42:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/3126868927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b723362f0 0x560b72704ef0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009ca0 tx=0x7ff1a4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670465c007585b6a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.601+0000 7ff1b1ffb640 1 -- 172.21.15.49:0/3126868927 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4005220 con 0x560b723362f0 2024-09-21T06:42:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.602+0000 7ff1b1ffb640 1 -- 172.21.15.49:0/3126868927 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1a4004c50 con 0x560b723362f0 2024-09-21T06:42:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.602+0000 7ff1b1ffb640 1 -- 172.21.15.49:0/3126868927 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4019720 con 0x560b723362f0 2024-09-21T06:42:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.602+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3126868927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b723362f0 msgr2=0x560b72704ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.602+0000 7ff1bbfff640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff1a80b66b0 0x7ff1a80b8bc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40cb890 tx=0x7ff1b409ba10 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.602+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3126868927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b723362f0 0x560b72704ef0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009ca0 tx=0x7ff1a4011810 comp rx=0 tx=0).stop 2024-09-21T06:42:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.602+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3126868927 shutdown_connections 2024-09-21T06:42:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.602+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3126868927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7233e4d0 0x560b72705430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.602+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3126868927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b723362f0 0x560b72704ef0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.603+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3126868927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7235f1b0 0x560b727049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.603+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3126868927 >> 172.21.15.49:0/3126868927 conn(0x560b72353300 msgr2=0x560b727028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.603+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3126868927 shutdown_connections 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.603+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3126868927 wait complete. 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.603+0000 7ff1c8aaf740 1 -- start start 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.603+0000 7ff1c8aaf740 1 Processor -- start 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 0x560b72710010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7233e4d0 0x560b72710550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7235f1b0 0x560b7271c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560b725a0ab0 con 0x560b7235f1b0 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560b7260e730 con 0x560b723362f0 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560b72713130 con 0x560b7233e4d0 2024-09-21T06:42:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1c8aaf740 10 client.0 _ll_register_callbacks cb 0x560b726626b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7235f1b0 0x560b7271c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7235f1b0 0x560b7271c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48722/0 (socket says 172.21.15.49:48722) 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 -- 172.21.15.49:0/3823931507 learned_addr learned my addr 172.21.15.49:0/3823931507 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7233e4d0 0x560b72710550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 0x560b72710010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 -- 172.21.15.49:0/3823931507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7233e4d0 msgr2=0x560b72710550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7233e4d0 0x560b72710550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 -- 172.21.15.49:0/3823931507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 msgr2=0x560b72710010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 0x560b72710010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 -- 172.21.15.49:0/3823931507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b723ca790 con 0x560b7235f1b0 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1baffd640 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7235f1b0 0x560b7271c450 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac011b00 tx=0x7ff1ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92702d8d3bbef528 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff19affd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff19affd640 1 -- 172.21.15.49:0/3823931507 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00fc50 con 0x560b7235f1b0 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3823931507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1a4004c50 con 0x560b7235f1b0 2024-09-21T06:42:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.604+0000 7ff19affd640 1 -- 172.21.15.49:0/3823931507 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff1ac009040 con 0x560b7235f1b0 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff19affd640 1 -- 172.21.15.49:0/3823931507 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff1ac00fdf0 con 0x560b7235f1b0 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff1c8aaf740 10 client.16974 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3823931507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b72443620 con 0x560b7235f1b0 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff19affd640 1 -- 172.21.15.49:0/3823931507 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1a4004c50 con 0x560b7235f1b0 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff19affd640 1 -- 172.21.15.49:0/3823931507 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff1ac01d030 con 0x560b7235f1b0 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff1c8aaf740 10 client.16974 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff1c8aaf740 10 client.16974 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff1c8aaf740 20 client.16974 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560b7231dd80 0x560b72722210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff1c8aaf740 4 client.16974 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.605+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3823931507 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b7267b640 con 0x560b7231dd80 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.606+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560b7231dd80 0x560b72722210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.606+0000 7ff19affd640 10 client.16974 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.606+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560b7231dd80 0x560b72722210 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79349b7c74c76c0f server_cookie=17167b9aadc06524 in_seq=0 out_seq=0 2024-09-21T06:42:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff19affd640 1 -- 172.21.15.49:0/3823931507 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b7267b640 con 0x560b7231dd80 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff19affd640 10 client.16974 handle_command_reply: tid=0 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 client.16974 shutdown 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3823931507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7235f1b0 msgr2=0x560b7271c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7235f1b0 0x560b7271c450 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac011b00 tx=0x7ff1ac0046c0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3823931507 shutdown_connections 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560b7231dd80 0x560b72722210 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7235f1b0 0x560b7271c450 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7233e4d0 0x560b72710550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/3823931507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 0x560b72710010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff19affd640 0 client.16974 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3823931507 >> 172.21.15.49:0/3823931507 conn(0x560b72353300 msgr2=0x560b727059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3823931507 shutdown_connections 2024-09-21T06:42:35.613 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/3823931507 wait complete. 2024-09-21T06:42:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.607+0000 7ff1c8aaf740 20 client.16974 trim_cache size 0 max 16384 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1c8aaf740 1 Processor -- start 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1c8aaf740 1 -- start start 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b723362f0 0x560b727063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b727104f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7235f1b0 0x560b72711c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b4240 con 0x560b7233e4d0 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b1b10 con 0x560b7235f1b0 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1af980 con 0x560b723362f0 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1bb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b727104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1bb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b727104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48732/0 (socket says 172.21.15.49:48732) 2024-09-21T06:42:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.622+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/2906901261 learned_addr learned my addr 172.21.15.49:0/2906901261 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1baffd640 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7235f1b0 0x560b72711c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1baffd640 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b723362f0 0x560b727063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/2906901261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b723362f0 msgr2=0x560b727063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b723362f0 0x560b727063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/2906901261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7235f1b0 msgr2=0x560b72711c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7235f1b0 0x560b72711c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/2906901261 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b727077c0 con 0x560b7233e4d0 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1baffd640 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b723362f0 0x560b727063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b727104f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x560b72703630 tx=0x7ff1a4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e107a0d773863c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1b17fa640 1 -- 172.21.15.49:0/2906901261 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4004250 con 0x560b7233e4d0 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1b17fa640 1 -- 172.21.15.49:0/2906901261 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1a40043f0 con 0x560b7233e4d0 2024-09-21T06:42:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.623+0000 7ff1b17fa640 1 -- 172.21.15.49:0/2906901261 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4003e30 con 0x560b7233e4d0 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/2906901261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 msgr2=0x560b727104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b727104f0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x560b72703630 tx=0x7ff1a4011810 comp rx=0 tx=0).stop 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/2906901261 shutdown_connections 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b7235f1b0 0x560b72711c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b727104f0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/2906901261 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b723362f0 0x560b727063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/2906901261 >> 172.21.15.49:0/2906901261 conn(0x560b72353300 msgr2=0x560b72711530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/2906901261 shutdown_connections 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/2906901261 wait complete. 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.624+0000 7ff1c8aaf740 1 -- start start 2024-09-21T06:42:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1c8aaf740 1 Processor -- start 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 0x560b72715de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b72716380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1c8aaf740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7235f1b0 0x560b72784c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1affd0 con 0x560b7233e4d0 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b1440 con 0x560b723362f0 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1c8aaf740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff1bc1b06a0 con 0x560b7235f1b0 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1c8aaf740 10 client.0 _ll_register_callbacks cb 0x7ff1ac009c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1bb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b72716380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1bb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b72716380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:48746/0 (socket says 172.21.15.49:48746) 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/1278600676 learned_addr learned my addr 172.21.15.49:0/1278600676 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1baffd640 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 0x560b72715de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/1278600676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7235f1b0 msgr2=0x560b72784c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7235f1b0 0x560b72784c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/1278600676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 msgr2=0x560b72715de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 0x560b72715de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1bb7fe640 1 -- 172.21.15.49:0/1278600676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b727852d0 con 0x560b7233e4d0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.625+0000 7ff1baffd640 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 0x560b72715de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff1bb7fe640 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b72716380 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009a30 tx=0x7ff1a4004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6162296de194ae49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff19affd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff19affd640 1 -- 172.21.15.49:0/1278600676 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a403b020 con 0x560b7233e4d0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff19affd640 1 -- 172.21.15.49:0/1278600676 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7ff1a402a040 con 0x560b7233e4d0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/1278600676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1a40043f0 con 0x560b7233e4d0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff19affd640 1 -- 172.21.15.49:0/1278600676 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff1a4004620 con 0x560b7233e4d0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff1c8aaf740 10 client.16980 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/1278600676 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560b7278c660 con 0x560b7233e4d0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff19affd640 1 -- 172.21.15.49:0/1278600676 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1a40043f0 con 0x560b7233e4d0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff19affd640 1 -- 172.21.15.49:0/1278600676 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff1a402d5a0 con 0x560b7233e4d0 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff1c8aaf740 10 client.16980 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff1c8aaf740 10 client.16980 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.626+0000 7ff1c8aaf740 20 client.16980 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.627+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560b722f31c0 0x560b7278ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.627+0000 7ff1c8aaf740 4 client.16980 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:42:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.627+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/1278600676 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560b726770f0 con 0x560b722f31c0 2024-09-21T06:42:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.627+0000 7ff1baffd640 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560b722f31c0 0x560b7278ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.627+0000 7ff1baffd640 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560b722f31c0 0x560b7278ec90 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21015035b66d351e server_cookie=aab5bed0d930d7b6 in_seq=0 out_seq=0 2024-09-21T06:42:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.627+0000 7ff19affd640 10 client.16980 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff19affd640 1 -- 172.21.15.49:0/1278600676 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560b726770f0 con 0x560b722f31c0 2024-09-21T06:42:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff19affd640 10 client.16980 handle_command_reply: tid=0 2024-09-21T06:42:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 client.16980 shutdown 2024-09-21T06:42:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/1278600676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 msgr2=0x560b72716380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b72716380 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009a30 tx=0x7ff1a4004250 comp rx=0 tx=0).stop 2024-09-21T06:42:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/1278600676 shutdown_connections 2024-09-21T06:42:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560b722f31c0 0x560b7278ec90 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560b7235f1b0 0x560b72784c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560b7233e4d0 0x560b72716380 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 --2- 172.21.15.49:0/1278600676 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b723362f0 0x560b72715de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff19affd640 0 client.16980 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/1278600676 >> 172.21.15.49:0/1278600676 conn(0x560b72353300 msgr2=0x560b72706170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/1278600676 shutdown_connections 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 1 -- 172.21.15.49:0/1278600676 wait complete. 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.635+0000 7ff1c8aaf740 20 client.16980 trim_cache size 0 max 16384 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:42:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:42:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 -- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff1a80b66b0 msgr2=0x7ff1a80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff1a80b66b0 0x7ff1a80b8bc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40cb890 tx=0x7ff1b409ba10 comp rx=0 tx=0).stop 2024-09-21T06:42:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 -- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 msgr2=0x7ff1bc109fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 0x7ff1bc109fe0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4005cc0 tx=0x7ff1b4031700 comp rx=0 tx=0).stop 2024-09-21T06:42:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 -- 172.21.15.49:0/3896096680 shutdown_connections 2024-09-21T06:42:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff1a80b66b0 0x7ff1a80b8bc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff1bc108c40 0x7ff1bc109fe0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff1bc1082f0 0x7ff1bc109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 --2- 172.21.15.49:0/3896096680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff1bc1029c0 0x7ff1bc109560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 -- 172.21.15.49:0/3896096680 >> 172.21.15.49:0/3896096680 conn(0x7ff1bc0fe3c0 msgr2=0x7ff1bc06ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 -- 172.21.15.49:0/3896096680 shutdown_connections 2024-09-21T06:42:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:35.636+0000 7ff1c1b41640 1 -- 172.21.15.49:0/3896096680 wait complete. 2024-09-21T06:42:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:35 smithi049 ceph-mon[31177]: pgmap v497: 97 pgs: 97 active+clean; 5.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 15 op/s 2024-09-21T06:42:36.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:35 smithi098 ceph-mon[34704]: pgmap v497: 97 pgs: 97 active+clean; 5.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 15 op/s 2024-09-21T06:42:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:35 smithi079 ceph-mon[34346]: pgmap v497: 97 pgs: 97 active+clean; 5.4 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 15 op/s 2024-09-21T06:42:37.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:37 smithi049 ceph-mon[31177]: pgmap v498: 97 pgs: 97 active+clean; 5.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:42:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:37 smithi098 ceph-mon[34704]: pgmap v498: 97 pgs: 97 active+clean; 5.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:42:38.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:37 smithi079 ceph-mon[34346]: pgmap v498: 97 pgs: 97 active+clean; 5.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:42:39.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:39 smithi049 ceph-mon[31177]: pgmap v499: 97 pgs: 97 active+clean; 5.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-09-21T06:42:40.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:39 smithi098 ceph-mon[34704]: pgmap v499: 97 pgs: 97 active+clean; 5.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-09-21T06:42:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:39 smithi079 ceph-mon[34346]: pgmap v499: 97 pgs: 97 active+clean; 5.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 27 KiB/s wr, 16 op/s 2024-09-21T06:42:41.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:41 smithi049 ceph-mon[31177]: pgmap v500: 97 pgs: 97 active+clean; 5.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:42:42.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:41 smithi098 ceph-mon[34704]: pgmap v500: 97 pgs: 97 active+clean; 5.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:42:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:41 smithi079 ceph-mon[34346]: pgmap v500: 97 pgs: 97 active+clean; 5.5 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:42:43.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:43 smithi049 ceph-mon[31177]: pgmap v501: 97 pgs: 97 active+clean; 5.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-21T06:42:44.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:43 smithi098 ceph-mon[34704]: pgmap v501: 97 pgs: 97 active+clean; 5.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-21T06:42:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:43 smithi079 ceph-mon[34346]: pgmap v501: 97 pgs: 97 active+clean; 5.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-09-21T06:42:45.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:45 smithi049 ceph-mon[31177]: pgmap v502: 97 pgs: 97 active+clean; 5.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T06:42:46.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:45 smithi098 ceph-mon[34704]: pgmap v502: 97 pgs: 97 active+clean; 5.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T06:42:46.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:45 smithi079 ceph-mon[34346]: pgmap v502: 97 pgs: 97 active+clean; 5.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T06:42:47.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:47 smithi049 ceph-mon[31177]: pgmap v503: 97 pgs: 97 active+clean; 5.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-21T06:42:48.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:47 smithi098 ceph-mon[34704]: pgmap v503: 97 pgs: 97 active+clean; 5.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-21T06:42:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:47 smithi079 ceph-mon[34346]: pgmap v503: 97 pgs: 97 active+clean; 5.6 MiB data, 388 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-21T06:42:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.752+0000 7f54b132b640 1 -- 172.21.15.49:0/47994257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 msgr2=0x7f54ac102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:48.754 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.752+0000 7f54b132b640 1 --2- 172.21.15.49:0/47994257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 0x7f54ac102de0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f549c009900 tx=0x7f549c02a410 comp rx=0 tx=0).stop 2024-09-21T06:42:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.752+0000 7f54b132b640 1 -- 172.21.15.49:0/47994257 shutdown_connections 2024-09-21T06:42:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.752+0000 7f54b132b640 1 --2- 172.21.15.49:0/47994257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54ac108c50 0x7f54ac10f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.752+0000 7f54b132b640 1 --2- 172.21.15.49:0/47994257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac108300 0x7f54ac108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.752+0000 7f54b132b640 1 --2- 172.21.15.49:0/47994257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 0x7f54ac102de0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.752+0000 7f54b132b640 1 -- 172.21.15.49:0/47994257 >> 172.21.15.49:0/47994257 conn(0x7f54ac07a710 msgr2=0x7f54ac07ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.752+0000 7f54b132b640 1 -- 172.21.15.49:0/47994257 shutdown_connections 2024-09-21T06:42:48.755 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.753+0000 7f54b132b640 1 -- 172.21.15.49:0/47994257 wait complete. 2024-09-21T06:42:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.753+0000 7f54b132b640 1 Processor -- start 2024-09-21T06:42:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.753+0000 7f54b132b640 1 -- start start 2024-09-21T06:42:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54b132b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 0x7f54ac19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54b132b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54ac108300 0x7f54ac19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54b132b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac108c50 0x7f54ac19bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54b132b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac112910 con 0x7f54ac1029d0 2024-09-21T06:42:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54b132b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac112790 con 0x7f54ac108c50 2024-09-21T06:42:48.757 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54b132b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac112a90 con 0x7f54ac108300 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 0x7f54ac19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 0x7f54ac19b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40150/0 (socket says 172.21.15.49:40150) 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aaffd640 1 -- 172.21.15.49:0/3842888507 learned_addr learned my addr 172.21.15.49:0/3842888507 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac108c50 0x7f54ac19bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54ac108300 0x7f54ac19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aaffd640 1 -- 172.21.15.49:0/3842888507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54ac108300 msgr2=0x7f54ac19b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aaffd640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54ac108300 0x7f54ac19b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aaffd640 1 -- 172.21.15.49:0/3842888507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac108c50 msgr2=0x7f54ac19bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aaffd640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac108c50 0x7f54ac19bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aaffd640 1 -- 172.21.15.49:0/3842888507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac1a6480 con 0x7f54ac1029d0 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.754+0000 7f54aaffd640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 0x7f54ac19b1c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f549c005940 tx=0x7f549c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.755+0000 7f54a3fff640 1 -- 172.21.15.49:0/3842888507 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c03f030 con 0x7f54ac1029d0 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.755+0000 7f54b132b640 1 -- 172.21.15.49:0/3842888507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac1a6710 con 0x7f54ac1029d0 2024-09-21T06:42:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.755+0000 7f54a3fff640 1 -- 172.21.15.49:0/3842888507 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f549c003aa0 con 0x7f54ac1029d0 2024-09-21T06:42:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.755+0000 7f54a3fff640 1 -- 172.21.15.49:0/3842888507 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c035070 con 0x7f54ac1029d0 2024-09-21T06:42:48.759 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.755+0000 7f54b132b640 1 -- 172.21.15.49:0/3842888507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac1a6c00 con 0x7f54ac1029d0 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54b8297740 1 Processor -- start 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54b8297740 1 -- start start 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54a3fff640 1 -- 172.21.15.49:0/3842888507 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f549c042030 con 0x7f54ac1029d0 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54b8297740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 0x55f8b16129b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54b8297740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b12442f0 0x55f8b1612ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54b8297740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b1613430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54b8297740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f8b15876f0 con 0x55f8b124c4d0 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54b8297740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f8b1576b20 con 0x55f8b126d1b0 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54b8297740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f8b157a930 con 0x55f8b12442f0 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54aa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b1613430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54aa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b1613430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40164/0 (socket says 172.21.15.49:40164) 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.758+0000 7f54aa7fc640 1 -- 172.21.15.49:0/2796100400 learned_addr learned my addr 172.21.15.49:0/2796100400 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54aaffd640 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b12442f0 0x55f8b1612ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 0x55f8b16129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54aa7fc640 1 -- 172.21.15.49:0/2796100400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b12442f0 msgr2=0x55f8b1612ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b12442f0 0x55f8b1612ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54aa7fc640 1 -- 172.21.15.49:0/2796100400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 msgr2=0x55f8b16129b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 0x55f8b16129b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54aa7fc640 1 -- 172.21.15.49:0/2796100400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b153c530 con 0x55f8b124c4d0 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 0x55f8b16129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54a3fff640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54980b6680 0x7f54980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b1613430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f549400bcd0 tx=0x7f54940107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50acb4163214a9b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54980b6680 0x7f54980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54a3fff640 1 -- 172.21.15.49:0/3842888507 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f549c107da0 con 0x7f54ac1029d0 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54a17fa640 1 -- 172.21.15.49:0/2796100400 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549401c680 con 0x55f8b124c4d0 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54a17fa640 1 -- 172.21.15.49:0/2796100400 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f549401ccd0 con 0x55f8b124c4d0 2024-09-21T06:42:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.759+0000 7f54a17fa640 1 -- 172.21.15.49:0/2796100400 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5494011bf0 con 0x55f8b124c4d0 2024-09-21T06:42:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54b8297740 1 -- 172.21.15.49:0/2796100400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 msgr2=0x55f8b1613430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54980b6680 0x7f54980b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f54a4005fd0 tx=0x7f54a4009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54b8297740 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b1613430 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f549400bcd0 tx=0x7f54940107a0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54b8297740 1 -- 172.21.15.49:0/2796100400 shutdown_connections 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54b8297740 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b1613430 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54b8297740 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b12442f0 0x55f8b1612ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54b8297740 1 --2- 172.21.15.49:0/2796100400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 0x55f8b16129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54b8297740 1 -- 172.21.15.49:0/2796100400 >> 172.21.15.49:0/2796100400 conn(0x55f8b1261300 msgr2=0x55f8b16108a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54b8297740 1 -- 172.21.15.49:0/2796100400 shutdown_connections 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.760+0000 7f54b8297740 1 -- 172.21.15.49:0/2796100400 wait complete. 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.761+0000 7f54b8297740 1 -- start start 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.761+0000 7f54b8297740 1 Processor -- start 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.761+0000 7f54b8297740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 0x55f8b161e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.761+0000 7f54b8297740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 0x55f8b161e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.761+0000 7f54b8297740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b126d1b0 0x55f8b162a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.761+0000 7f54b8297740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f8b14aeab0 con 0x55f8b126d1b0 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.761+0000 7f54b8297740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f8b151c730 con 0x55f8b12442f0 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.761+0000 7f54b8297740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f8b1621130 con 0x55f8b124c4d0 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.761+0000 7f54b8297740 10 client.0 _ll_register_callbacks cb 0x55f8b15706b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54ab7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b126d1b0 0x55f8b162a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54ab7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b126d1b0 0x55f8b162a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40178/0 (socket says 172.21.15.49:40178) 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 0x55f8b161e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54ab7fe640 1 -- 172.21.15.49:0/783499356 learned_addr learned my addr 172.21.15.49:0/783499356 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 0x55f8b161e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54ab7fe640 1 -- 172.21.15.49:0/783499356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 msgr2=0x55f8b161e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 0x55f8b161e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54ab7fe640 1 -- 172.21.15.49:0/783499356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 msgr2=0x55f8b161e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 0x55f8b161e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54ab7fe640 1 -- 172.21.15.49:0/783499356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b12d8790 con 0x55f8b126d1b0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b126d1b0 0x55f8b162a420 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009fd0 tx=0x7f54a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e4e34d007ac360 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54927fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54927fc640 1 -- 172.21.15.49:0/783499356 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4004b20 con 0x55f8b126d1b0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54927fc640 1 -- 172.21.15.49:0/783499356 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f54a4004cc0 con 0x55f8b126d1b0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.762+0000 7f54b8297740 1 -- 172.21.15.49:0/783499356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f549401ccd0 con 0x55f8b126d1b0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54927fc640 1 -- 172.21.15.49:0/783499356 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f54a400f870 con 0x55f8b126d1b0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54b8297740 10 client.16992 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54b8297740 1 -- 172.21.15.49:0/783499356 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f8b1351620 con 0x55f8b126d1b0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54927fc640 1 -- 172.21.15.49:0/783499356 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f549401ccd0 con 0x55f8b126d1b0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54927fc640 1 -- 172.21.15.49:0/783499356 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f54a4027070 con 0x55f8b126d1b0 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54b8297740 10 client.16992 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54b8297740 10 client.16992 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54b8297740 20 client.16992 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54b8297740 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8b122bd80 0x55f8b16302c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54b8297740 4 client.16992 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54b8297740 1 -- 172.21.15.49:0/783499356 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8b1589640 con 0x55f8b122bd80 2024-09-21T06:42:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.763+0000 7f54aaffd640 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8b122bd80 0x55f8b16302c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.764+0000 7f54927fc640 10 client.16992 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.764+0000 7f54aaffd640 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8b122bd80 0x55f8b16302c0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de3515136524868e server_cookie=5b8624071937a526 in_seq=0 out_seq=0 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.764+0000 7f54927fc640 1 -- 172.21.15.49:0/783499356 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8b1589640 con 0x55f8b122bd80 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.764+0000 7f54927fc640 10 client.16992 handle_command_reply: tid=0 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 client.16992 shutdown 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 -- 172.21.15.49:0/783499356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b126d1b0 msgr2=0x55f8b162a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b126d1b0 0x55f8b162a420 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009fd0 tx=0x7f54a4004a40 comp rx=0 tx=0).stop 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 -- 172.21.15.49:0/783499356 shutdown_connections 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8b122bd80 0x55f8b16302c0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b126d1b0 0x55f8b162a420 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 0x55f8b161e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54927fc640 0 client.16992 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 --2- 172.21.15.49:0/783499356 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 0x55f8b161e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 -- 172.21.15.49:0/783499356 >> 172.21.15.49:0/783499356 conn(0x55f8b1261300 msgr2=0x55f8b16139e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 -- 172.21.15.49:0/783499356 shutdown_connections 2024-09-21T06:42:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 1 -- 172.21.15.49:0/783499356 wait complete. 2024-09-21T06:42:48.771 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.765+0000 7f54b8297740 20 client.16992 trim_cache size 0 max 16384 2024-09-21T06:42:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.780+0000 7f54b8297740 1 Processor -- start 2024-09-21T06:42:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.780+0000 7f54b8297740 1 -- start start 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.780+0000 7f54b8297740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 0x55f8b161e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.780+0000 7f54b8297740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b16142a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.780+0000 7f54b8297740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b126d1b0 0x55f8b161fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.780+0000 7f54b8297740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1b2000 con 0x55f8b124c4d0 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.780+0000 7f54b8297740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1af8d0 con 0x55f8b12442f0 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.780+0000 7f54b8297740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1ad740 con 0x55f8b126d1b0 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.780+0000 7f54aa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b16142a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aa7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b16142a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40182/0 (socket says 172.21.15.49:40182) 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aaffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 0x55f8b161e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aa7fc640 1 -- 172.21.15.49:0/3905779694 learned_addr learned my addr 172.21.15.49:0/3905779694 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/3905779694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b126d1b0 0x55f8b161fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aa7fc640 1 -- 172.21.15.49:0/3905779694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b126d1b0 msgr2=0x55f8b161fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/3905779694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b126d1b0 0x55f8b161fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aa7fc640 1 -- 172.21.15.49:0/3905779694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 msgr2=0x55f8b161e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/3905779694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 0x55f8b161e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aa7fc640 1 -- 172.21.15.49:0/3905779694 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b161c5d0 con 0x55f8b124c4d0 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aaffd640 1 --2- 172.21.15.49:0/3905779694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 0x55f8b161e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/3905779694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b16142a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f54940117a0 tx=0x7f54940117d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2279890c28436821 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54a0ff9640 1 -- 172.21.15.49:0/3905779694 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5494004020 con 0x55f8b124c4d0 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54a0ff9640 1 -- 172.21.15.49:0/3905779694 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5494011d60 con 0x55f8b124c4d0 2024-09-21T06:42:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.781+0000 7f54a0ff9640 1 -- 172.21.15.49:0/3905779694 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5494005310 con 0x55f8b124c4d0 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.782+0000 7f54b8297740 1 -- 172.21.15.49:0/3905779694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 msgr2=0x55f8b16142a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.782+0000 7f54b8297740 1 --2- 172.21.15.49:0/3905779694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b16142a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f54940117a0 tx=0x7f54940117d0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.782+0000 7f54b8297740 1 -- 172.21.15.49:0/3905779694 shutdown_connections 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.782+0000 7f54b8297740 1 --2- 172.21.15.49:0/3905779694 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b126d1b0 0x55f8b161fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.782+0000 7f54b8297740 1 --2- 172.21.15.49:0/3905779694 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b124c4d0 0x55f8b16142a0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.782+0000 7f54b8297740 1 --2- 172.21.15.49:0/3905779694 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b12442f0 0x55f8b161e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.782+0000 7f54b8297740 1 -- 172.21.15.49:0/3905779694 >> 172.21.15.49:0/3905779694 conn(0x55f8b1261300 msgr2=0x55f8b161f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.782+0000 7f54b8297740 1 -- 172.21.15.49:0/3905779694 shutdown_connections 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.782+0000 7f54b8297740 1 -- 172.21.15.49:0/3905779694 wait complete. 2024-09-21T06:42:48.788 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54b8297740 1 -- start start 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54b8297740 1 Processor -- start 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54b8297740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b12442f0 0x55f8b1626ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54b8297740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 0x55f8b1623fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54b8297740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 0x55f8b16244e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54b8297740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1add90 con 0x55f8b12442f0 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54b8297740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1af200 con 0x55f8b126d1b0 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54b8297740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac1ae460 con 0x55f8b124c4d0 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54b8297740 10 client.0 _ll_register_callbacks cb 0x7f54a4009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54aaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b12442f0 0x55f8b1626ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54aaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b12442f0 0x55f8b1626ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40198/0 (socket says 172.21.15.49:40198) 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54aaffd640 1 -- 172.21.15.49:0/86810787 learned_addr learned my addr 172.21.15.49:0/86810787 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 0x55f8b1623fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.789 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.783+0000 7f54ab7fe640 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 0x55f8b16244e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54aaffd640 1 -- 172.21.15.49:0/86810787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 msgr2=0x55f8b1623fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54aaffd640 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 0x55f8b1623fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54aaffd640 1 -- 172.21.15.49:0/86810787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 msgr2=0x55f8b16244e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54aaffd640 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 0x55f8b16244e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54aaffd640 1 -- 172.21.15.49:0/86810787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b1624c20 con 0x55f8b12442f0 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54aaffd640 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b12442f0 0x55f8b1626ae0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f549c0cdc10 tx=0x7f549c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0ab5816bfc7892 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54927fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54927fc640 1 -- 172.21.15.49:0/86810787 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c049040 con 0x55f8b12442f0 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54927fc640 1 -- 172.21.15.49:0/86810787 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f549c03bcc0 con 0x55f8b12442f0 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54b8297740 1 -- 172.21.15.49:0/86810787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5494011d60 con 0x55f8b12442f0 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54927fc640 1 -- 172.21.15.49:0/86810787 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f549c0c93f0 con 0x55f8b12442f0 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54b8297740 10 client.16998 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:48.790 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54b8297740 1 -- 172.21.15.49:0/86810787 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f8b169abb0 con 0x55f8b12442f0 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54927fc640 1 -- 172.21.15.49:0/86810787 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5494011d60 con 0x55f8b12442f0 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.784+0000 7f54927fc640 1 -- 172.21.15.49:0/86810787 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f549c0f10b0 con 0x55f8b12442f0 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.785+0000 7f54b8297740 10 client.16998 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.785+0000 7f54b8297740 10 client.16998 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.785+0000 7f54b8297740 20 client.16998 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.785+0000 7f54b8297740 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8b12011c0 0x55f8b169d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.785+0000 7f54b8297740 4 client.16998 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.785+0000 7f54b8297740 1 -- 172.21.15.49:0/86810787 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f8b15850f0 con 0x55f8b12011c0 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.785+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8b12011c0 0x55f8b169d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.785+0000 7f54927fc640 10 client.16998 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.785+0000 7f54aa7fc640 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8b12011c0 0x55f8b169d370 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=978292bd9cd7ca3b server_cookie=4cdd5e717f52b6c0 in_seq=0 out_seq=0 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54927fc640 1 -- 172.21.15.49:0/86810787 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f8b15850f0 con 0x55f8b12011c0 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54927fc640 10 client.16998 handle_command_reply: tid=0 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 client.16998 shutdown 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 -- 172.21.15.49:0/86810787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b12442f0 msgr2=0x55f8b1626ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b12442f0 0x55f8b1626ae0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f549c0cdc10 tx=0x7f549c003f10 comp rx=0 tx=0).stop 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 -- 172.21.15.49:0/86810787 shutdown_connections 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8b12011c0 0x55f8b169d370 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8b126d1b0 0x55f8b16244e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8b124c4d0 0x55f8b1623fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54927fc640 0 client.16998 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 --2- 172.21.15.49:0/86810787 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8b12442f0 0x55f8b1626ae0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 -- 172.21.15.49:0/86810787 >> 172.21.15.49:0/86810787 conn(0x55f8b1261300 msgr2=0x55f8b1614070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 -- 172.21.15.49:0/86810787 shutdown_connections 2024-09-21T06:42:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 1 -- 172.21.15.49:0/86810787 wait complete. 2024-09-21T06:42:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.793+0000 7f54b8297740 20 client.16998 trim_cache size 0 max 16384 2024-09-21T06:42:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:42:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:42:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:42:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:42:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 -- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54980b6680 msgr2=0x7f54980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54980b6680 0x7f54980b8b90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f54a4005fd0 tx=0x7f54a4009500 comp rx=0 tx=0).stop 2024-09-21T06:42:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 -- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 msgr2=0x7f54ac19b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 0x7f54ac19b1c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f549c005940 tx=0x7f549c004270 comp rx=0 tx=0).stop 2024-09-21T06:42:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 -- 172.21.15.49:0/3842888507 shutdown_connections 2024-09-21T06:42:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f54980b6680 0x7f54980b8b90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f54ac108c50 0x7f54ac19bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f54ac108300 0x7f54ac19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 --2- 172.21.15.49:0/3842888507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f54ac1029d0 0x7f54ac19b1c0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 -- 172.21.15.49:0/3842888507 >> 172.21.15.49:0/3842888507 conn(0x7f54ac07a710 msgr2=0x7f54ac1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 -- 172.21.15.49:0/3842888507 shutdown_connections 2024-09-21T06:42:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:42:48.794+0000 7f54b132b640 1 -- 172.21.15.49:0/3842888507 wait complete. 2024-09-21T06:42:49.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:49 smithi049 ceph-mon[31177]: pgmap v504: 97 pgs: 97 active+clean; 5.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 14 op/s 2024-09-21T06:42:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:49 smithi098 ceph-mon[34704]: pgmap v504: 97 pgs: 97 active+clean; 5.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 14 op/s 2024-09-21T06:42:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:49 smithi079 ceph-mon[34346]: pgmap v504: 97 pgs: 97 active+clean; 5.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 KiB/s wr, 14 op/s 2024-09-21T06:42:51.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:51 smithi049 ceph-mon[31177]: pgmap v505: 97 pgs: 97 active+clean; 5.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-09-21T06:42:52.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:51 smithi098 ceph-mon[34704]: pgmap v505: 97 pgs: 97 active+clean; 5.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-09-21T06:42:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:51 smithi079 ceph-mon[34346]: pgmap v505: 97 pgs: 97 active+clean; 5.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 15 KiB/s wr, 9 op/s 2024-09-21T06:42:53.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:53 smithi049 ceph-mon[31177]: pgmap v506: 97 pgs: 97 active+clean; 5.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-21T06:42:53.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:42:54.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:53 smithi098 ceph-mon[34704]: pgmap v506: 97 pgs: 97 active+clean; 5.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-21T06:42:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:42:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:53 smithi079 ceph-mon[34346]: pgmap v506: 97 pgs: 97 active+clean; 5.7 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-09-21T06:42:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:42:54.961 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:42:54.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:42:54.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:42:54.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:42:55.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:42:55.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:42:55.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:42:55.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:42:55.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:42:55.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:42:55.235 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.746+0000 7f0b42acf640 1 -- 172.21.15.49:0/2331928744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c10de10 msgr2=0x7f0b3c110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.746+0000 7f0b42acf640 1 --2- 172.21.15.49:0/2331928744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c10de10 0x7f0b3c110300 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f0b34009ca0 tx=0x7f0b3402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.746+0000 7f0b42acf640 1 -- 172.21.15.49:0/2331928744 shutdown_connections 2024-09-21T06:42:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.746+0000 7f0b42acf640 1 --2- 172.21.15.49:0/2331928744 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c10de10 0x7f0b3c110300 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.746+0000 7f0b42acf640 1 --2- 172.21.15.49:0/2331928744 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3c105300 0x7f0b3c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.746+0000 7f0b42acf640 1 --2- 172.21.15.49:0/2331928744 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3c1049b0 0x7f0b3c104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.747+0000 7f0b42acf640 1 -- 172.21.15.49:0/2331928744 >> 172.21.15.49:0/2331928744 conn(0x7f0b3c079700 msgr2=0x7f0b3c079b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.747+0000 7f0b42acf640 1 -- 172.21.15.49:0/2331928744 shutdown_connections 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.747+0000 7f0b42acf640 1 -- 172.21.15.49:0/2331928744 wait complete. 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.747+0000 7f0b42acf640 1 Processor -- start 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.747+0000 7f0b42acf640 1 -- start start 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b42acf640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3c1049b0 0x7f0b3c19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b42acf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c105300 0x7f0b3c19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b42acf640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3c10de10 0x7f0b3c19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b42acf640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c113af0 con 0x7f0b3c105300 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b42acf640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c113970 con 0x7f0b3c1049b0 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b42acf640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c113c70 con 0x7f0b3c10de10 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c105300 0x7f0b3c19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c105300 0x7f0b3c19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40218/0 (socket says 172.21.15.49:40218) 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b3bfff640 1 -- 172.21.15.49:0/1458491857 learned_addr learned my addr 172.21.15.49:0/1458491857 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b4086b640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3c1049b0 0x7f0b3c19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b4106c640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3c10de10 0x7f0b3c19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b3bfff640 1 -- 172.21.15.49:0/1458491857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3c10de10 msgr2=0x7f0b3c19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3c10de10 0x7f0b3c19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b3bfff640 1 -- 172.21.15.49:0/1458491857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3c1049b0 msgr2=0x7f0b3c19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3c1049b0 0x7f0b3c19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.748+0000 7f0b3bfff640 1 -- 172.21.15.49:0/1458491857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b3c1a0410 con 0x7f0b3c105300 2024-09-21T06:42:55.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.749+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c105300 0x7f0b3c19aa40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800d950 tx=0x7f0b2800dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.749+0000 7f0b39ffb640 1 -- 172.21.15.49:0/1458491857 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28017070 con 0x7f0b3c105300 2024-09-21T06:42:55.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.749+0000 7f0b42acf640 1 -- 172.21.15.49:0/1458491857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b3c1a0700 con 0x7f0b3c105300 2024-09-21T06:42:55.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.749+0000 7f0b39ffb640 1 -- 172.21.15.49:0/1458491857 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b28009c30 con 0x7f0b3c105300 2024-09-21T06:42:55.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.749+0000 7f0b39ffb640 1 -- 172.21.15.49:0/1458491857 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b280047a0 con 0x7f0b3c105300 2024-09-21T06:42:55.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.749+0000 7f0b42acf640 1 -- 172.21.15.49:0/1458491857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b3c1a6e60 con 0x7f0b3c105300 2024-09-21T06:42:55.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b39ffb640 1 -- 172.21.15.49:0/1458491857 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0b28004020 con 0x7f0b3c105300 2024-09-21T06:42:55.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b49043740 1 Processor -- start 2024-09-21T06:42:55.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b49043740 1 -- start start 2024-09-21T06:42:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b49043740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836e5070 0x55d483a8c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b49043740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 0x55d483a8c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b49043740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a8ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b49043740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d483a02e50 con 0x55d4836c4390 2024-09-21T06:42:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b49043740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d4839f2280 con 0x55d4836bc1b0 2024-09-21T06:42:55.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b49043740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d4839f6090 con 0x55d4836e5070 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a8ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a8ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40228/0 (socket says 172.21.15.49:40228) 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.752+0000 7f0b3bfff640 1 -- 172.21.15.49:0/2657859086 learned_addr learned my addr 172.21.15.49:0/2657859086 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2657859086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836e5070 0x55d483a8c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b4086b640 1 --2- 172.21.15.49:0/2657859086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 0x55d483a8c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b39ffb640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b2c0b6680 0x7f0b2c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b4106c640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b2c0b6680 0x7f0b2c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b39ffb640 1 -- 172.21.15.49:0/1458491857 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0b280e7360 con 0x7f0b3c105300 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b4106c640 1 -- 172.21.15.49:0/2657859086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 msgr2=0x55d483a8c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2657859086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 0x55d483a8c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b4106c640 1 -- 172.21.15.49:0/2657859086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 msgr2=0x55d483a8ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2657859086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a8ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b4106c640 1 -- 172.21.15.49:0/2657859086 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d483750650 con 0x55d4836e5070 2024-09-21T06:42:55.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.753+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2657859086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836e5070 0x55d483a8c270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b3402ade0 tx=0x7f0b34031ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c1283471687e79e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.754+0000 7f0b4106c640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b2c0b6680 0x7f0b2c0b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0b34048000 tx=0x7f0b3404a000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.754+0000 7f0b26ffd640 1 -- 172.21.15.49:0/2657859086 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34031730 con 0x55d4836e5070 2024-09-21T06:42:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.754+0000 7f0b26ffd640 1 -- 172.21.15.49:0/2657859086 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b34036070 con 0x55d4836e5070 2024-09-21T06:42:55.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.754+0000 7f0b26ffd640 1 -- 172.21.15.49:0/2657859086 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3402f660 con 0x55d4836e5070 2024-09-21T06:42:55.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.754+0000 7f0b49043740 1 -- 172.21.15.49:0/2657859086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836e5070 msgr2=0x55d483a8c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.754+0000 7f0b49043740 1 --2- 172.21.15.49:0/2657859086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836e5070 0x55d483a8c270 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0b3402ade0 tx=0x7f0b34031ec0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.755+0000 7f0b49043740 1 -- 172.21.15.49:0/2657859086 shutdown_connections 2024-09-21T06:42:55.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.755+0000 7f0b49043740 1 --2- 172.21.15.49:0/2657859086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a8ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.755+0000 7f0b49043740 1 --2- 172.21.15.49:0/2657859086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 0x55d483a8c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.755+0000 7f0b49043740 1 --2- 172.21.15.49:0/2657859086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836e5070 0x55d483a8c270 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.755+0000 7f0b49043740 1 -- 172.21.15.49:0/2657859086 >> 172.21.15.49:0/2657859086 conn(0x55d4836d9460 msgr2=0x55d483a8a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.755+0000 7f0b49043740 1 -- 172.21.15.49:0/2657859086 shutdown_connections 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.755+0000 7f0b49043740 1 -- 172.21.15.49:0/2657859086 wait complete. 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.755+0000 7f0b49043740 1 -- start start 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.755+0000 7f0b49043740 1 Processor -- start 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b49043740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 0x55d483a9bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b49043740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836c4390 0x55d483a9c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b49043740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836e5070 0x55d483aa7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b49043740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d483853700 con 0x55d4836e5070 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b49043740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d48398d110 con 0x55d4836bc1b0 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b49043740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d483a9eb40 con 0x55d4836c4390 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b49043740 10 client.0 _ll_register_callbacks cb 0x55d4839a6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b4106c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836e5070 0x55d483aa7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b4106c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836e5070 0x55d483aa7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40240/0 (socket says 172.21.15.49:40240) 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b4106c640 1 -- 172.21.15.49:0/2155225848 learned_addr learned my addr 172.21.15.49:0/2155225848 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836c4390 0x55d483a9c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b4086b640 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 0x55d483a9bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b4106c640 1 -- 172.21.15.49:0/2155225848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836c4390 msgr2=0x55d483a9c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836c4390 0x55d483a9c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b4106c640 1 -- 172.21.15.49:0/2155225848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 msgr2=0x55d483a9bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 0x55d483a9bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b4106c640 1 -- 172.21.15.49:0/2155225848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4839bac40 con 0x55d4836e5070 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.756+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836c4390 0x55d483a9c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836e5070 0x55d483aa7ea0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0b34040040 tx=0x7f0b34004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c176dce3bf7deaa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2155225848 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34004240 con 0x55d4836e5070 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2155225848 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0b340043e0 con 0x55d4836e5070 2024-09-21T06:42:55.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b49043740 1 -- 172.21.15.49:0/2155225848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b34036070 con 0x55d4836e5070 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2155225848 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b3402f310 con 0x55d4836e5070 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b49043740 10 client.17010 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b49043740 1 -- 172.21.15.49:0/2155225848 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d483aaa880 con 0x55d4836e5070 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2155225848 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b34036070 con 0x55d4836e5070 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2155225848 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0b34030c00 con 0x55d4836e5070 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b49043740 10 client.17010 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.757+0000 7f0b49043740 10 client.17010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.758+0000 7f0b49043740 20 client.17010 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.758+0000 7f0b49043740 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4836a39f0 0x55d483aadbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.758+0000 7f0b49043740 4 client.17010 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.758+0000 7f0b49043740 1 -- 172.21.15.49:0/2155225848 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d483a04da0 con 0x55d4836a39f0 2024-09-21T06:42:55.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.758+0000 7f0b4086b640 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4836a39f0 0x55d483aadbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.758+0000 7f0b4086b640 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4836a39f0 0x55d483aadbe0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e6fd17f0488f9c5 server_cookie=71fd7c4229dd6e3f in_seq=0 out_seq=0 2024-09-21T06:42:55.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.758+0000 7f0b1bfff640 10 client.17010 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2155225848 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d483a04da0 con 0x55d4836a39f0 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b1bfff640 10 client.17010 handle_command_reply: tid=0 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 client.17010 shutdown 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 -- 172.21.15.49:0/2155225848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836e5070 msgr2=0x55d483aa7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836e5070 0x55d483aa7ea0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0b34040040 tx=0x7f0b34004670 comp rx=0 tx=0).stop 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 -- 172.21.15.49:0/2155225848 shutdown_connections 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4836a39f0 0x55d483aadbe0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b1bfff640 0 client.17010 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836e5070 0x55d483aa7ea0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836c4390 0x55d483a9c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 --2- 172.21.15.49:0/2155225848 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836bc1b0 0x55d483a9bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 -- 172.21.15.49:0/2155225848 >> 172.21.15.49:0/2155225848 conn(0x55d4836d9460 msgr2=0x55d483a8f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 -- 172.21.15.49:0/2155225848 shutdown_connections 2024-09-21T06:42:55.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.759+0000 7f0b49043740 1 -- 172.21.15.49:0/2155225848 wait complete. 2024-09-21T06:42:55.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.760+0000 7f0b49043740 20 client.17010 trim_cache size 0 max 16384 2024-09-21T06:42:55.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.777+0000 7f0b49043740 1 Processor -- start 2024-09-21T06:42:55.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.777+0000 7f0b49043740 1 -- start start 2024-09-21T06:42:55.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.777+0000 7f0b49043740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836a39f0 0x55d483a8a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.777+0000 7f0b49043740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836bc1b0 0x55d483aa7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.777+0000 7f0b49043740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836c4390 0x55d483a98ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.777+0000 7f0b49043740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1afe20 con 0x55d4836bc1b0 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.777+0000 7f0b49043740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1ad6f0 con 0x55d4836c4390 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.777+0000 7f0b49043740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1ab560 con 0x55d4836a39f0 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836bc1b0 0x55d483aa7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b3bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836bc1b0 0x55d483aa7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40248/0 (socket says 172.21.15.49:40248) 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b3bfff640 1 -- 172.21.15.49:0/4229351288 learned_addr learned my addr 172.21.15.49:0/4229351288 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b4086b640 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836a39f0 0x55d483a8a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b4106c640 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836c4390 0x55d483a98ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b3bfff640 1 -- 172.21.15.49:0/4229351288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836a39f0 msgr2=0x55d483a8a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836a39f0 0x55d483a8a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b3bfff640 1 -- 172.21.15.49:0/4229351288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836c4390 msgr2=0x55d483a98ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836c4390 0x55d483a98ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b3bfff640 1 -- 172.21.15.49:0/4229351288 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d483a84360 con 0x55d4836bc1b0 2024-09-21T06:42:55.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b4086b640 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836a39f0 0x55d483a8a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:55.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b4106c640 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836c4390 0x55d483a98ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:55.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.778+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836bc1b0 0x55d483aa7da0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009610 tx=0x7f0b28094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481d2ac545527c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.779+0000 7f0b267fc640 1 -- 172.21.15.49:0/4229351288 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b280acae0 con 0x55d4836bc1b0 2024-09-21T06:42:55.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.779+0000 7f0b267fc640 1 -- 172.21.15.49:0/4229351288 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b280acca0 con 0x55d4836bc1b0 2024-09-21T06:42:55.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.779+0000 7f0b267fc640 1 -- 172.21.15.49:0/4229351288 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800be60 con 0x55d4836bc1b0 2024-09-21T06:42:55.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.779+0000 7f0b49043740 1 -- 172.21.15.49:0/4229351288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836bc1b0 msgr2=0x55d483aa7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.779+0000 7f0b49043740 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836bc1b0 0x55d483aa7da0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009610 tx=0x7f0b28094040 comp rx=0 tx=0).stop 2024-09-21T06:42:55.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.780+0000 7f0b49043740 1 -- 172.21.15.49:0/4229351288 shutdown_connections 2024-09-21T06:42:55.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.780+0000 7f0b49043740 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836c4390 0x55d483a98ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.780+0000 7f0b49043740 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836bc1b0 0x55d483aa7da0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.780+0000 7f0b49043740 1 --2- 172.21.15.49:0/4229351288 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836a39f0 0x55d483a8a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.780+0000 7f0b49043740 1 -- 172.21.15.49:0/4229351288 >> 172.21.15.49:0/4229351288 conn(0x55d4836d9460 msgr2=0x55d483a89a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.780+0000 7f0b49043740 1 -- 172.21.15.49:0/4229351288 shutdown_connections 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.780+0000 7f0b49043740 1 -- 172.21.15.49:0/4229351288 wait complete. 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.780+0000 7f0b49043740 1 -- start start 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.780+0000 7f0b49043740 1 Processor -- start 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b49043740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836a39f0 0x55d483aa4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b49043740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836bc1b0 0x55d483a9f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b49043740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a9fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b49043740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1abbb0 con 0x55d4836c4390 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b49043740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1ad020 con 0x55d4836a39f0 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b49043740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b3c1ac280 con 0x55d4836bc1b0 2024-09-21T06:42:55.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b49043740 10 client.0 _ll_register_callbacks cb 0x7f0b280a9860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4106c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a9fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4106c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a9fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:40264/0 (socket says 172.21.15.49:40264) 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4106c640 1 -- 172.21.15.49:0/2666446269 learned_addr learned my addr 172.21.15.49:0/2666446269 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4086b640 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836a39f0 0x55d483aa4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836bc1b0 0x55d483a9f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4106c640 1 -- 172.21.15.49:0/2666446269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836bc1b0 msgr2=0x55d483a9f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836bc1b0 0x55d483a9f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4106c640 1 -- 172.21.15.49:0/2666446269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836a39f0 msgr2=0x55d483aa4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836a39f0 0x55d483aa4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4106c640 1 -- 172.21.15.49:0/2666446269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d483aa03b0 con 0x55d4836c4390 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4086b640 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836a39f0 0x55d483aa4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:55.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b4106c640 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a9fdf0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0b3402f8a0 tx=0x7f0b3402fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadd936f0681cbaa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.781+0000 7f0b1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2666446269 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b34069030 con 0x55d4836c4390 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2666446269 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0b3404aa00 con 0x55d4836c4390 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b49043740 1 -- 172.21.15.49:0/2666446269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b280acca0 con 0x55d4836c4390 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2666446269 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b34073050 con 0x55d4836c4390 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b49043740 10 client.17016 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b49043740 1 -- 172.21.15.49:0/2666446269 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d483b181a0 con 0x55d4836c4390 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2666446269 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b280acca0 con 0x55d4836c4390 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2666446269 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0b3404ac40 con 0x55d4836c4390 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b49043740 10 client.17016 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b49043740 10 client.17016 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b49043740 20 client.17016 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:55.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b49043740 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4836e5070 0x55d483b1a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b49043740 4 client.17016 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.782+0000 7f0b49043740 1 -- 172.21.15.49:0/2666446269 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d483a00850 con 0x55d4836e5070 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.783+0000 7f0b4086b640 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4836e5070 0x55d483b1a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.783+0000 7f0b4086b640 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4836e5070 0x55d483b1a950 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=998cfc8d07ff90ce server_cookie=ce6582bd1b41e5d5 in_seq=0 out_seq=0 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.783+0000 7f0b1bfff640 10 client.17016 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.783+0000 7f0b1bfff640 1 -- 172.21.15.49:0/2666446269 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x55d483a00850 con 0x55d4836e5070 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.783+0000 7f0b1bfff640 10 client.17016 handle_command_reply: tid=0 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.783+0000 7f0b49043740 1 client.17016 shutdown 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.783+0000 7f0b49043740 1 -- 172.21.15.49:0/2666446269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 msgr2=0x55d483a9fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a9fdf0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f0b3402f8a0 tx=0x7f0b3402fd10 comp rx=0 tx=0).stop 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 1 -- 172.21.15.49:0/2666446269 shutdown_connections 2024-09-21T06:42:55.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4836e5070 0x55d483b1a950 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4836c4390 0x55d483a9fdf0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b1bfff640 0 client.17016 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:42:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4836bc1b0 0x55d483a9f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 1 --2- 172.21.15.49:0/2666446269 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4836a39f0 0x55d483aa4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 1 -- 172.21.15.49:0/2666446269 >> 172.21.15.49:0/2666446269 conn(0x55d4836d9460 msgr2=0x55d483a899b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 1 -- 172.21.15.49:0/2666446269 shutdown_connections 2024-09-21T06:42:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 1 -- 172.21.15.49:0/2666446269 wait complete. 2024-09-21T06:42:55.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.784+0000 7f0b49043740 20 client.17016 trim_cache size 0 max 16384 2024-09-21T06:42:55.791 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:55.792 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.793 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.794 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:42:55.795 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.796 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:42:55.797 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:42:55.798 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:42:55.799 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:42:55.799 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:42:55.799 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:42:55.799 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 -- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b2c0b6680 msgr2=0x7f0b2c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b2c0b6680 0x7f0b2c0b8b90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f0b34048000 tx=0x7f0b3404a000 comp rx=0 tx=0).stop 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 -- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c105300 msgr2=0x7f0b3c19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c105300 0x7f0b3c19aa40 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800d950 tx=0x7f0b2800dd50 comp rx=0 tx=0).stop 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 -- 172.21.15.49:0/1458491857 shutdown_connections 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b2c0b6680 0x7f0b2c0b8b90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b3c10de10 0x7f0b3c19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b3c105300 0x7f0b3c19aa40 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 --2- 172.21.15.49:0/1458491857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b3c1049b0 0x7f0b3c19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 -- 172.21.15.49:0/1458491857 >> 172.21.15.49:0/1458491857 conn(0x7f0b3c079700 msgr2=0x7f0b3c0ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 -- 172.21.15.49:0/1458491857 shutdown_connections 2024-09-21T06:42:55.801 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:55.785+0000 7f0b42acf640 1 -- 172.21.15.49:0/1458491857 wait complete. 2024-09-21T06:42:55.935 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:55 smithi049 ceph-mon[31177]: pgmap v507: 97 pgs: 97 active+clean; 5.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T06:42:56.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:55 smithi098 ceph-mon[34704]: pgmap v507: 97 pgs: 97 active+clean; 5.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T06:42:56.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:55 smithi079 ceph-mon[34346]: pgmap v507: 97 pgs: 97 active+clean; 5.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T06:42:56.584 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:42:56.584 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:42:56.901 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:57.225 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.225 INFO:tasks.workunit.client.0.smithi049.stdout:251/600: open fd = 3 2024-09-21T06:42:57.225 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.225 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:252/600: open fd = 3 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:253/600: open fd = 3 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:254/600: open fd = 3 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.226 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:255/600: open fd = 3 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:256/600: open fd = 3 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:257/600: open fd = 3 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:258/600: open fd = 3 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.227 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:259/600: open fd = 3 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:260/600: open fd = 3 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:261/600: open fd = 3 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:262/600: open fd = 3 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.228 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:263/600: open fd = 3 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:264/600: open fd = 3 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:265/600: open fd = 3 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.229 INFO:tasks.workunit.client.0.smithi049.stdout:266/600: open fd = 3 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:267/600: open fd = 3 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:268/600: open fd = 3 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:269/600: open fd = 3 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.230 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:270/600: open fd = 3 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:271/600: open fd = 3 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:272/600: open fd = 3 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:273/600: open fd = 3 2024-09-21T06:42:57.231 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:274/600: open fd = 3 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:275/600: open fd = 3 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:276/600: open fd = 3 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:277/600: open fd = 3 2024-09-21T06:42:57.232 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:278/600: open fd = 3 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:279/600: open fd = 3 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:280/600: open fd = 3 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.233 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:281/600: open fd = 3 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:282/600: open fd = 3 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:283/600: open fd = 3 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:284/600: open fd = 3 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.234 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:285/600: open fd = 3 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:286/600: open fd = 3 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:287/600: open fd = 3 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:288/600: open fd = 3 2024-09-21T06:42:57.235 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:289/600: open fd = 3 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:290/600: open fd = 3 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:291/600: open fd = 3 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.236 INFO:tasks.workunit.client.0.smithi049.stdout:292/600: open fd = 3 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:293/600: open fd = 3 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:294/600: open fd = 3 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:295/600: open fd = 3 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.237 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:296/600: open fd = 3 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:297/600: open fd = 3 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:298/600: open fd = 3 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:299/600: open fd = 3 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.238 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:300/600: open fd = 3 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:301/600: open fd = 3 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:302/600: open fd = 3 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:303/600: open fd = 3 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.239 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:304/600: open fd = 3 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:305/600: open fd = 3 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:306/600: open fd = 3 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:307/600: open fd = 3 2024-09-21T06:42:57.240 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:308/600: open fd = 3 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:309/600: open fd = 3 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:310/600: open fd = 3 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.241 INFO:tasks.workunit.client.0.smithi049.stdout:311/600: open fd = 3 2024-09-21T06:42:57.242 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.242 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.242 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:42:57.242 INFO:tasks.workunit.client.0.smithi049.stdout:312/600: open fd = 3 2024-09-21T06:42:57.242 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.242 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:42:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.523+0000 7f9e355a3640 1 -- 172.21.15.49:0/835930386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 msgr2=0x7f9e30104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.523+0000 7f9e355a3640 1 --2- 172.21.15.49:0/835930386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 0x7f9e30104dd0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009900 tx=0x7f9e2002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.523+0000 7f9e355a3640 1 -- 172.21.15.49:0/835930386 shutdown_connections 2024-09-21T06:42:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.523+0000 7f9e355a3640 1 --2- 172.21.15.49:0/835930386 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e3010de20 0x7f9e30110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.523+0000 7f9e355a3640 1 --2- 172.21.15.49:0/835930386 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e30105310 0x7f9e3010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.523+0000 7f9e355a3640 1 --2- 172.21.15.49:0/835930386 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 0x7f9e30104dd0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.526 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.523+0000 7f9e355a3640 1 -- 172.21.15.49:0/835930386 >> 172.21.15.49:0/835930386 conn(0x7f9e30079710 msgr2=0x7f9e30079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.523+0000 7f9e355a3640 1 -- 172.21.15.49:0/835930386 shutdown_connections 2024-09-21T06:42:57.527 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.523+0000 7f9e355a3640 1 -- 172.21.15.49:0/835930386 wait complete. 2024-09-21T06:42:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.524+0000 7f9e355a3640 1 Processor -- start 2024-09-21T06:42:57.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.524+0000 7f9e355a3640 1 -- start start 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.524+0000 7f9e355a3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 0x7f9e3019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.524+0000 7f9e355a3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e30105310 0x7f9e3019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.524+0000 7f9e355a3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e3010de20 0x7f9e3019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.524+0000 7f9e355a3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30113aa0 con 0x7f9e301049c0 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.524+0000 7f9e355a3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30113920 con 0x7f9e3010de20 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.524+0000 7f9e355a3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9e30113c20 con 0x7f9e30105310 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 0x7f9e3019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 0x7f9e3019a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59910/0 (socket says 172.21.15.49:59910) 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2effd640 1 -- 172.21.15.49:0/1952340841 learned_addr learned my addr 172.21.15.49:0/1952340841 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2e7fc640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e30105310 0x7f9e3019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2f7fe640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e3010de20 0x7f9e3019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2effd640 1 -- 172.21.15.49:0/1952340841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e30105310 msgr2=0x7f9e3019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2effd640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e30105310 0x7f9e3019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2effd640 1 -- 172.21.15.49:0/1952340841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e3010de20 msgr2=0x7f9e3019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2effd640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e3010de20 0x7f9e3019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2effd640 1 -- 172.21.15.49:0/1952340841 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e301a0440 con 0x7f9e301049c0 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2f7fe640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e3010de20 0x7f9e3019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e2effd640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 0x7f9e3019a4d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005940 tx=0x7f9e200040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.525+0000 7f9e17fff640 1 -- 172.21.15.49:0/1952340841 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2003f030 con 0x7f9e301049c0 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.526+0000 7f9e17fff640 1 -- 172.21.15.49:0/1952340841 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e200044c0 con 0x7f9e301049c0 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.526+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e301a06d0 con 0x7f9e301049c0 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.526+0000 7f9e17fff640 1 -- 172.21.15.49:0/1952340841 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e20035070 con 0x7f9e301049c0 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.526+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e301a6e90 con 0x7f9e301049c0 2024-09-21T06:42:57.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.527+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3006c280 con 0x7f9e301049c0 2024-09-21T06:42:57.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.529+0000 7f9e17fff640 1 -- 172.21.15.49:0/1952340841 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9e20042030 con 0x7f9e301049c0 2024-09-21T06:42:57.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.529+0000 7f9e17fff640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9e180b6680 0x7f9e180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.529+0000 7f9e2e7fc640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9e180b6680 0x7f9e180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.529+0000 7f9e17fff640 1 -- 172.21.15.49:0/1952340841 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f9e20107e10 con 0x7f9e301049c0 2024-09-21T06:42:57.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.530+0000 7f9e2e7fc640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9e180b6680 0x7f9e180b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9e3010fba0 tx=0x7f9e24005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:57.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.533+0000 7f9e17fff640 1 -- 172.21.15.49:0/1952340841 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e200ce2e0 con 0x7f9e301049c0 2024-09-21T06:42:57.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.757+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e301a7060 con 0x7f9e301049c0 2024-09-21T06:42:57.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.758+0000 7f9e17fff640 1 -- 172.21.15.49:0/1952340841 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f9e200d26c0 con 0x7f9e301049c0 2024-09-21T06:42:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:42:57.761 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:42:57.761 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:42:57.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9e180b6680 msgr2=0x7f9e180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9e180b6680 0x7f9e180b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9e3010fba0 tx=0x7f9e24005f90 comp rx=0 tx=0).stop 2024-09-21T06:42:57.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 msgr2=0x7f9e3019a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 0x7f9e3019a4d0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005940 tx=0x7f9e200040c0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 shutdown_connections 2024-09-21T06:42:57.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9e180b6680 0x7f9e180b8b90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9e3010de20 0x7f9e3019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9e30105310 0x7f9e3019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 --2- 172.21.15.49:0/1952340841 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9e301049c0 0x7f9e3019a4d0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.760+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 >> 172.21.15.49:0/1952340841 conn(0x7f9e30079710 msgr2=0x7f9e30107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:57.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.761+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 shutdown_connections 2024-09-21T06:42:57.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:57.761+0000 7f9e355a3640 1 -- 172.21.15.49:0/1952340841 wait complete. 2024-09-21T06:42:57.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:57 smithi049 ceph-mon[31177]: pgmap v508: 97 pgs: 97 active+clean; 5.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-21T06:42:58.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:57 smithi098 ceph-mon[34704]: pgmap v508: 97 pgs: 97 active+clean; 5.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-21T06:42:58.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:57 smithi079 ceph-mon[34346]: pgmap v508: 97 pgs: 97 active+clean; 5.8 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 12 op/s 2024-09-21T06:42:58.400 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:42:58.660 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:59.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:58 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1952340841' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:59.053 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:58 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1952340841' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:59.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:58 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1952340841' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.257+0000 7f9529666640 1 -- 172.21.15.49:0/3903255443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9524109df0 msgr2=0x7f9524110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.257+0000 7f9529666640 1 --2- 172.21.15.49:0/3903255443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9524109df0 0x7f9524110620 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f951c009ca0 tx=0x7f951c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.257+0000 7f9529666640 1 -- 172.21.15.49:0/3903255443 shutdown_connections 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.257+0000 7f9529666640 1 --2- 172.21.15.49:0/3903255443 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9524109df0 0x7f9524110620 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.257+0000 7f9529666640 1 --2- 172.21.15.49:0/3903255443 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f95241094a0 0x7f95241098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.257+0000 7f9529666640 1 --2- 172.21.15.49:0/3903255443 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9524103b60 0x7f9524103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.257+0000 7f9529666640 1 -- 172.21.15.49:0/3903255443 >> 172.21.15.49:0/3903255443 conn(0x7f952407b850 msgr2=0x7f952407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.257+0000 7f9529666640 1 -- 172.21.15.49:0/3903255443 shutdown_connections 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.257+0000 7f9529666640 1 -- 172.21.15.49:0/3903255443 wait complete. 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.258+0000 7f9529666640 1 Processor -- start 2024-09-21T06:42:59.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.258+0000 7f9529666640 1 -- start start 2024-09-21T06:42:59.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.258+0000 7f9529666640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9524103b60 0x7f9524075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.258+0000 7f9529666640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95241094a0 0x7f9524075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.258+0000 7f9529666640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9524109df0 0x7f9524076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.258+0000 7f9529666640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9524113ab0 con 0x7f95241094a0 2024-09-21T06:42:59.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.258+0000 7f9529666640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9524113930 con 0x7f9524103b60 2024-09-21T06:42:59.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.258+0000 7f9529666640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9524113c30 con 0x7f9524109df0 2024-09-21T06:42:59.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95241094a0 0x7f9524075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95241094a0 0x7f9524075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59920/0 (socket says 172.21.15.49:59920) 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95227fc640 1 -- 172.21.15.49:0/2756192869 learned_addr learned my addr 172.21.15.49:0/2756192869 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f9522ffd640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9524103b60 0x7f9524075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95237fe640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9524109df0 0x7f9524076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95227fc640 1 -- 172.21.15.49:0/2756192869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9524109df0 msgr2=0x7f9524076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95227fc640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9524109df0 0x7f9524076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95227fc640 1 -- 172.21.15.49:0/2756192869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9524103b60 msgr2=0x7f9524075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95227fc640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9524103b60 0x7f9524075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95227fc640 1 -- 172.21.15.49:0/2756192869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95241a86c0 con 0x7f95241094a0 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f95227fc640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95241094a0 0x7f9524075c50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f951400e9f0 tx=0x7f951400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f951bfff640 1 -- 172.21.15.49:0/2756192869 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951400ccc0 con 0x7f95241094a0 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f951bfff640 1 -- 172.21.15.49:0/2756192869 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95140108e0 con 0x7f95241094a0 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.259+0000 7f9529666640 1 -- 172.21.15.49:0/2756192869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95241a89b0 con 0x7f95241094a0 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.260+0000 7f951bfff640 1 -- 172.21.15.49:0/2756192869 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514018860 con 0x7f95241094a0 2024-09-21T06:42:59.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.260+0000 7f9529666640 1 -- 172.21.15.49:0/2756192869 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95241a8ef0 con 0x7f95241094a0 2024-09-21T06:42:59.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.262+0000 7f952fbda740 1 Processor -- start 2024-09-21T06:42:59.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.262+0000 7f952fbda740 1 -- start start 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.262+0000 7f951bfff640 1 -- 172.21.15.49:0/2756192869 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9514010430 con 0x7f95241094a0 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f952fbda740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565fb070 0x5569569a26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f952fbda740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 0x5569569a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f952fbda740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565da390 0x5569569a3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f952fbda740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556956918ea0 con 0x5569565da390 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f952fbda740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5569569082d0 con 0x5569565d21b0 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f952fbda740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55695690c0e0 con 0x5569565fb070 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f95227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565da390 0x5569569a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f95227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565da390 0x5569569a3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59924/0 (socket says 172.21.15.49:59924) 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f95227fc640 1 -- 172.21.15.49:0/290148104 learned_addr learned my addr 172.21.15.49:0/290148104 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f95237fe640 1 --2- 172.21.15.49:0/290148104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565fb070 0x5569569a26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f9522ffd640 1 --2- 172.21.15.49:0/290148104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 0x5569569a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f95227fc640 1 -- 172.21.15.49:0/290148104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565fb070 msgr2=0x5569569a26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f95227fc640 1 --2- 172.21.15.49:0/290148104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565fb070 0x5569569a26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f95227fc640 1 -- 172.21.15.49:0/290148104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 msgr2=0x5569569a2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f95227fc640 1 --2- 172.21.15.49:0/290148104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 0x5569569a2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f95227fc640 1 -- 172.21.15.49:0/290148104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556956666650 con 0x5569565da390 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.263+0000 7f951bfff640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f95100b6680 0x7f95100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.264+0000 7f95237fe640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f95100b6680 0x7f95100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.264+0000 7f95227fc640 1 --2- 172.21.15.49:0/290148104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565da390 0x5569569a3120 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f95140e50f0 tx=0x7f95140f0590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33af7f0cbebf1913 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.264+0000 7f951bfff640 1 -- 172.21.15.49:0/2756192869 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f95140e7a50 con 0x7f95241094a0 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.264+0000 7f95197fa640 1 -- 172.21.15.49:0/290148104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95140a9720 con 0x5569565da390 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.264+0000 7f95197fa640 1 -- 172.21.15.49:0/290148104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9514010720 con 0x5569565da390 2024-09-21T06:42:59.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.264+0000 7f95197fa640 1 -- 172.21.15.49:0/290148104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95140acff0 con 0x5569565da390 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 -- 172.21.15.49:0/290148104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565da390 msgr2=0x5569569a3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f95237fe640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f95100b6680 0x7f95100b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f951c005cc0 tx=0x7f951c005c30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 --2- 172.21.15.49:0/290148104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565da390 0x5569569a3120 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f95140e50f0 tx=0x7f95140f0590 comp rx=0 tx=0).stop 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 -- 172.21.15.49:0/290148104 shutdown_connections 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 --2- 172.21.15.49:0/290148104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565da390 0x5569569a3120 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 --2- 172.21.15.49:0/290148104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 0x5569569a2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 --2- 172.21.15.49:0/290148104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565fb070 0x5569569a26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 -- 172.21.15.49:0/290148104 >> 172.21.15.49:0/290148104 conn(0x5569565ef460 msgr2=0x5569569a0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 -- 172.21.15.49:0/290148104 shutdown_connections 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 -- 172.21.15.49:0/290148104 wait complete. 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.265+0000 7f952fbda740 1 -- start start 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f952fbda740 1 Processor -- start 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f952fbda740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 0x5569569add80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f952fbda740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 0x5569569ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f952fbda740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565fb070 0x5569569ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f952fbda740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556956769700 con 0x5569565fb070 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f952fbda740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5569568a3160 con 0x5569565d21b0 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f952fbda740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5569569b0e80 con 0x5569565da390 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f952fbda740 10 client.0 _ll_register_callbacks cb 0x5569568bc9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f95237fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565fb070 0x5569569ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f95237fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565fb070 0x5569569ba1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59940/0 (socket says 172.21.15.49:59940) 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f95237fe640 1 -- 172.21.15.49:0/61683249 learned_addr learned my addr 172.21.15.49:0/61683249 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f9522ffd640 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 0x5569569add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f95227fc640 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 0x5569569ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f95237fe640 1 -- 172.21.15.49:0/61683249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 msgr2=0x5569569ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f95237fe640 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 0x5569569ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f95237fe640 1 -- 172.21.15.49:0/61683249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 msgr2=0x5569569add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f95237fe640 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 0x5569569add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f95237fe640 1 -- 172.21.15.49:0/61683249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569568d0c90 con 0x5569565fb070 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.266+0000 7f9522ffd640 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 0x5569569add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.267+0000 7f95237fe640 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565fb070 0x5569569ba1a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f951c02f4f0 tx=0x7f951c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ee6df05b2ee2a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.267+0000 7f950a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.267+0000 7f950a7fc640 1 -- 172.21.15.49:0/61683249 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951c003c40 con 0x5569565fb070 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.267+0000 7f950a7fc640 1 -- 172.21.15.49:0/61683249 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f951c003de0 con 0x5569565fb070 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.267+0000 7f952fbda740 1 -- 172.21.15.49:0/61683249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55695691adf0 con 0x5569565fb070 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.267+0000 7f950a7fc640 1 -- 172.21.15.49:0/61683249 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f951c004040 con 0x5569565fb070 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.267+0000 7f952fbda740 10 client.17034 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.267+0000 7f952fbda740 1 -- 172.21.15.49:0/61683249 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5569569bcbf0 con 0x5569565fb070 2024-09-21T06:42:59.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.267+0000 7f950a7fc640 1 -- 172.21.15.49:0/61683249 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55695691adf0 con 0x5569565fb070 2024-09-21T06:42:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.268+0000 7f950a7fc640 1 -- 172.21.15.49:0/61683249 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f951c051070 con 0x5569565fb070 2024-09-21T06:42:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.268+0000 7f952fbda740 10 client.17034 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.268+0000 7f952fbda740 10 client.17034 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:42:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.268+0000 7f952fbda740 20 client.17034 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:59.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.268+0000 7f952fbda740 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5569565b99f0 0x5569569c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.268+0000 7f952fbda740 4 client.17034 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.268+0000 7f952fbda740 1 -- 172.21.15.49:0/61683249 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569569168a0 con 0x5569565b99f0 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.268+0000 7f9522ffd640 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5569565b99f0 0x5569569c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.269+0000 7f950a7fc640 10 client.17034 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.269+0000 7f9522ffd640 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5569565b99f0 0x5569569c00c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=436eda4037bb2244 server_cookie=ce0c2f5ccbc5abba in_seq=0 out_seq=0 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.269+0000 7f950a7fc640 1 -- 172.21.15.49:0/61683249 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569569168a0 con 0x5569565b99f0 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.269+0000 7f950a7fc640 10 client.17034 handle_command_reply: tid=0 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.269+0000 7f952fbda740 1 client.17034 shutdown 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.269+0000 7f952fbda740 1 -- 172.21.15.49:0/61683249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565fb070 msgr2=0x5569569ba1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.269+0000 7f952fbda740 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565fb070 0x5569569ba1a0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f951c02f4f0 tx=0x7f951c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f952fbda740 1 -- 172.21.15.49:0/61683249 shutdown_connections 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f952fbda740 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5569565b99f0 0x5569569c00c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f952fbda740 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565fb070 0x5569569ba1a0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f952fbda740 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 0x5569569ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f952fbda740 1 --2- 172.21.15.49:0/61683249 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565d21b0 0x5569569add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f950a7fc640 0 client.17034 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:42:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f952fbda740 1 -- 172.21.15.49:0/61683249 >> 172.21.15.49:0/61683249 conn(0x5569565ef460 msgr2=0x5569569a5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f952fbda740 1 -- 172.21.15.49:0/61683249 shutdown_connections 2024-09-21T06:42:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f952fbda740 1 -- 172.21.15.49:0/61683249 wait complete. 2024-09-21T06:42:59.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.270+0000 7f952fbda740 20 client.17034 trim_cache size 0 max 16384 2024-09-21T06:42:59.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.283+0000 7f952fbda740 1 Processor -- start 2024-09-21T06:42:59.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.283+0000 7f952fbda740 1 -- start start 2024-09-21T06:42:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.283+0000 7f952fbda740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565b99f0 0x5569569a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.283+0000 7f952fbda740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x55695699fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.283+0000 7f952fbda740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 0x5569569a0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.283+0000 7f952fbda740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f95241b4300 con 0x5569565d21b0 2024-09-21T06:42:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.283+0000 7f952fbda740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95241b1bd0 con 0x5569565b99f0 2024-09-21T06:42:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.283+0000 7f952fbda740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f95241afa40 con 0x5569565da390 2024-09-21T06:42:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.283+0000 7f95227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x55695699fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x55695699fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59954/0 (socket says 172.21.15.49:59954) 2024-09-21T06:42:59.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95227fc640 1 -- 172.21.15.49:0/3652976055 learned_addr learned my addr 172.21.15.49:0/3652976055 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f9522ffd640 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565b99f0 0x5569569a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95237fe640 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 0x5569569a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95227fc640 1 -- 172.21.15.49:0/3652976055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 msgr2=0x5569569a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95227fc640 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 0x5569569a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95227fc640 1 -- 172.21.15.49:0/3652976055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565b99f0 msgr2=0x5569569a3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95227fc640 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565b99f0 0x5569569a3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95227fc640 1 -- 172.21.15.49:0/3652976055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569569a4990 con 0x5569565d21b0 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95237fe640 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 0x5569569a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f95227fc640 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x55695699fbc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f95140aaaf0 tx=0x7f95140096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f2574988b9836f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f9518ff9640 1 -- 172.21.15.49:0/3652976055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95140ad1d0 con 0x5569565d21b0 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f9518ff9640 1 -- 172.21.15.49:0/3652976055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95140ad390 con 0x5569565d21b0 2024-09-21T06:42:59.288 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.284+0000 7f9518ff9640 1 -- 172.21.15.49:0/3652976055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95140ad650 con 0x5569565d21b0 2024-09-21T06:42:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.285+0000 7f952fbda740 1 -- 172.21.15.49:0/3652976055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 msgr2=0x55695699fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.285+0000 7f952fbda740 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x55695699fbc0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f95140aaaf0 tx=0x7f95140096a0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.285+0000 7f952fbda740 1 -- 172.21.15.49:0/3652976055 shutdown_connections 2024-09-21T06:42:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.285+0000 7f952fbda740 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565da390 0x5569569a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.285+0000 7f952fbda740 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x55695699fbc0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.285+0000 7f952fbda740 1 --2- 172.21.15.49:0/3652976055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565b99f0 0x5569569a3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.285+0000 7f952fbda740 1 -- 172.21.15.49:0/3652976055 >> 172.21.15.49:0/3652976055 conn(0x5569565ef460 msgr2=0x5569569a36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:59.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.285+0000 7f952fbda740 1 -- 172.21.15.49:0/3652976055 shutdown_connections 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.285+0000 7f952fbda740 1 -- 172.21.15.49:0/3652976055 wait complete. 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f952fbda740 1 -- start start 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f952fbda740 1 Processor -- start 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f952fbda740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565b99f0 0x5569569b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f952fbda740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x5569569b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f952fbda740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565da390 0x5569569b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f952fbda740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f95241b0090 con 0x5569565d21b0 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f952fbda740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f95241b1500 con 0x5569565da390 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f952fbda740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f95241b0760 con 0x5569565b99f0 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f952fbda740 10 client.0 _ll_register_callbacks cb 0x7f951c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f95227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x5569569b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f95227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x5569569b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59956/0 (socket says 172.21.15.49:59956) 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f95227fc640 1 -- 172.21.15.49:0/1497564646 learned_addr learned my addr 172.21.15.49:0/1497564646 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:42:59.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f95237fe640 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565da390 0x5569569b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.286+0000 7f9522ffd640 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565b99f0 0x5569569b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f95227fc640 1 -- 172.21.15.49:0/1497564646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565b99f0 msgr2=0x5569569b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f95227fc640 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565b99f0 0x5569569b2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f95227fc640 1 -- 172.21.15.49:0/1497564646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565da390 msgr2=0x5569569b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f95227fc640 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565da390 0x5569569b2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f95227fc640 1 -- 172.21.15.49:0/1497564646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556956a29c30 con 0x5569565d21b0 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f95227fc640 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x5569569b27c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f951400e9c0 tx=0x7f951400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cad1f86c12e45a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f950a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f950a7fc640 1 -- 172.21.15.49:0/1497564646 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95140b2020 con 0x5569565d21b0 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f950a7fc640 1 -- 172.21.15.49:0/1497564646 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f95140a9af0 con 0x5569565d21b0 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f952fbda740 1 -- 172.21.15.49:0/1497564646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95140ad390 con 0x5569565d21b0 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f950a7fc640 1 -- 172.21.15.49:0/1497564646 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f95140ad650 con 0x5569565d21b0 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f952fbda740 10 client.17040 fetch_fsmap learned FSMap version 27 2024-09-21T06:42:59.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f952fbda740 1 -- 172.21.15.49:0/1497564646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556956a2aeb0 con 0x5569565d21b0 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.287+0000 7f950a7fc640 1 -- 172.21.15.49:0/1497564646 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95140ad390 con 0x5569565d21b0 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f950a7fc640 1 -- 172.21.15.49:0/1497564646 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f95140f0c70 con 0x5569565d21b0 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f952fbda740 10 client.17040 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f952fbda740 10 client.17040 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f952fbda740 20 client.17040 populate_metadata read hostname 'smithi049' 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f952fbda740 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5569565fb070 0x556956a2d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f952fbda740 4 client.17040 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f952fbda740 1 -- 172.21.15.49:0/1497564646 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556956913cd0 con 0x5569565fb070 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f9522ffd640 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5569565fb070 0x556956a2d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f9522ffd640 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5569565fb070 0x556956a2d090 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=310250f25a1a821 server_cookie=52e8d1439a6363a7 in_seq=0 out_seq=0 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.288+0000 7f950a7fc640 10 client.17040 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f950a7fc640 1 -- 172.21.15.49:0/1497564646 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556956913cd0 con 0x5569565fb070 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f950a7fc640 10 client.17040 handle_command_reply: tid=0 2024-09-21T06:42:59.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 client.17040 shutdown 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 -- 172.21.15.49:0/1497564646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 msgr2=0x5569569b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x5569569b27c0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f951400e9c0 tx=0x7f951400ce60 comp rx=0 tx=0).stop 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 -- 172.21.15.49:0/1497564646 shutdown_connections 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x5569565fb070 0x556956a2d090 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5569565da390 0x5569569b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5569565d21b0 0x5569569b27c0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 --2- 172.21.15.49:0/1497564646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5569565b99f0 0x5569569b2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 -- 172.21.15.49:0/1497564646 >> 172.21.15.49:0/1497564646 conn(0x5569565ef460 msgr2=0x5569569af230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f950a7fc640 0 client.17040 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 -- 172.21.15.49:0/1497564646 shutdown_connections 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 1 -- 172.21.15.49:0/1497564646 wait complete. 2024-09-21T06:42:59.296 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.289+0000 7f952fbda740 20 client.17040 trim_cache size 0 max 16384 2024-09-21T06:42:59.297 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:42:59.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 -- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f95100b6680 msgr2=0x7f95100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:59.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f95100b6680 0x7f95100b8b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f951c005cc0 tx=0x7f951c005c30 comp rx=0 tx=0).stop 2024-09-21T06:42:59.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 -- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95241094a0 msgr2=0x7f9524075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:59.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95241094a0 0x7f9524075c50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f951400e9f0 tx=0x7f951400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 -- 172.21.15.49:0/2756192869 shutdown_connections 2024-09-21T06:42:59.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f95100b6680 0x7f95100b8b90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9524109df0 0x7f9524076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f95241094a0 0x7f9524075c50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 --2- 172.21.15.49:0/2756192869 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9524103b60 0x7f9524075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:59.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 -- 172.21.15.49:0/2756192869 >> 172.21.15.49:0/2756192869 conn(0x7f952407b850 msgr2=0x7f9524105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:59.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 -- 172.21.15.49:0/2756192869 shutdown_connections 2024-09-21T06:42:59.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:42:59.290+0000 7f9529666640 1 -- 172.21.15.49:0/2756192869 wait complete. 2024-09-21T06:42:59.939 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:43:00.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:42:59 smithi098 ceph-mon[34704]: pgmap v509: 97 pgs: 97 active+clean; 5.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T06:43:00.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:42:59 smithi079 ceph-mon[34346]: pgmap v509: 97 pgs: 97 active+clean; 5.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T06:43:00.195 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:00.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:42:59 smithi049 ceph-mon[31177]: pgmap v509: 97 pgs: 97 active+clean; 5.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 14 op/s 2024-09-21T06:43:00.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 -- 172.21.15.49:0/468526260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 msgr2=0x7f6ab410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:00.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 --2- 172.21.15.49:0/468526260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 0x7f6ab410f550 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f6aac009ca0 tx=0x7f6aac02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 -- 172.21.15.49:0/468526260 shutdown_connections 2024-09-21T06:43:00.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 --2- 172.21.15.49:0/468526260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 0x7f6ab410f550 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 --2- 172.21.15.49:0/468526260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab41083d0 0x7f6ab41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 --2- 172.21.15.49:0/468526260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab4102ae0 0x7f6ab4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 -- 172.21.15.49:0/468526260 >> 172.21.15.49:0/468526260 conn(0x7f6ab40797b0 msgr2=0x7f6ab4079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:00.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 -- 172.21.15.49:0/468526260 shutdown_connections 2024-09-21T06:43:00.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 -- 172.21.15.49:0/468526260 wait complete. 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 Processor -- start 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.674+0000 7f6abaab5640 1 -- start start 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6abaab5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab4102ae0 0x7f6ab419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6abaab5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab41083d0 0x7f6ab419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6abaab5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 0x7f6ab419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6abaab5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41129e0 con 0x7f6ab4108d20 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6abaab5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4112860 con 0x7f6ab4102ae0 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6abaab5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab4112b60 con 0x7f6ab41083d0 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab9052640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 0x7f6ab419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab8851640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab4102ae0 0x7f6ab419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab9052640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 0x7f6ab419fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59980/0 (socket says 172.21.15.49:59980) 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab9052640 1 -- 172.21.15.49:0/3959285566 learned_addr learned my addr 172.21.15.49:0/3959285566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab41083d0 0x7f6ab419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab9052640 1 -- 172.21.15.49:0/3959285566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab41083d0 msgr2=0x7f6ab419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab9052640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab41083d0 0x7f6ab419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab9052640 1 -- 172.21.15.49:0/3959285566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab4102ae0 msgr2=0x7f6ab419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab9052640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab4102ae0 0x7f6ab419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab9052640 1 -- 172.21.15.49:0/3959285566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab41a0310 con 0x7f6ab4108d20 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.675+0000 7f6ab8851640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab4102ae0 0x7f6ab419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.676+0000 7f6ab9052640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 0x7f6ab419fca0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f6aac005cc0 tx=0x7f6aac02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.676+0000 7f6ab1ffb640 1 -- 172.21.15.49:0/3959285566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac003bf0 con 0x7f6ab4108d20 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.676+0000 7f6abaab5640 1 -- 172.21.15.49:0/3959285566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab41a05a0 con 0x7f6ab4108d20 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.676+0000 7f6ab1ffb640 1 -- 172.21.15.49:0/3959285566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aac003d90 con 0x7f6ab4108d20 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.676+0000 7f6ab1ffb640 1 -- 172.21.15.49:0/3959285566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aac02fb20 con 0x7f6ab4108d20 2024-09-21T06:43:00.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.676+0000 7f6abaab5640 1 -- 172.21.15.49:0/3959285566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab41a6e20 con 0x7f6ab4108d20 2024-09-21T06:43:00.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.679+0000 7f6ac1029740 1 Processor -- start 2024-09-21T06:43:00.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.679+0000 7f6ab1ffb640 1 -- 172.21.15.49:0/3959285566 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6aac004580 con 0x7f6ab4108d20 2024-09-21T06:43:00.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.679+0000 7f6ac1029740 1 -- start start 2024-09-21T06:43:00.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.679+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762a4c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.679+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a4cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.679+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 0x561762a4d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.679+0000 7f6ac1029740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5617629c2ea0 con 0x5617626a5070 2024-09-21T06:43:00.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.679+0000 7f6ac1029740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5617629b22d0 con 0x561762684390 2024-09-21T06:43:00.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.679+0000 7f6ac1029740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5617629b60e0 con 0x56176267c1b0 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762a4c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762a4c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59994/0 (socket says 172.21.15.49:59994) 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 -- 172.21.15.49:0/667035511 learned_addr learned my addr 172.21.15.49:0/667035511 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab8851640 1 --2- 172.21.15.49:0/667035511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a4cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/667035511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 0x561762a4d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab1ffb640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6aa40b6730 0x7f6aa40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 -- 172.21.15.49:0/667035511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 msgr2=0x561762a4cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/667035511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a4cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 -- 172.21.15.49:0/667035511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 msgr2=0x561762a4d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/667035511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 0x561762a4d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 -- 172.21.15.49:0/667035511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561762710650 con 0x5617626a5070 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab9052640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6aa40b6730 0x7f6aa40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/667035511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762a4c6a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000a5c0 tx=0x7f6aa000a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f1a616a1dd3dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:00.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.680+0000 7f6ab1ffb640 1 -- 172.21.15.49:0/3959285566 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6aac108950 con 0x7f6ab4108d20 2024-09-21T06:43:00.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.681+0000 7f6a9effd640 1 -- 172.21.15.49:0/667035511 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0019030 con 0x5617626a5070 2024-09-21T06:43:00.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.681+0000 7f6a9effd640 1 -- 172.21.15.49:0/667035511 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa00110d0 con 0x5617626a5070 2024-09-21T06:43:00.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.681+0000 7f6a9effd640 1 -- 172.21.15.49:0/667035511 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0004d00 con 0x5617626a5070 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.681+0000 7f6ac1029740 1 -- 172.21.15.49:0/667035511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 msgr2=0x561762a4c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.681+0000 7f6ab9052640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6aa40b6730 0x7f6aa40b8c40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6aac106680 tx=0x7f6aac09bb70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.681+0000 7f6ac1029740 1 --2- 172.21.15.49:0/667035511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762a4c6a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f6aa000a5c0 tx=0x7f6aa000a740 comp rx=0 tx=0).stop 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.682+0000 7f6ac1029740 1 -- 172.21.15.49:0/667035511 shutdown_connections 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.682+0000 7f6ac1029740 1 --2- 172.21.15.49:0/667035511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 0x561762a4d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.682+0000 7f6ac1029740 1 --2- 172.21.15.49:0/667035511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a4cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.682+0000 7f6ac1029740 1 --2- 172.21.15.49:0/667035511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762a4c6a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.682+0000 7f6ac1029740 1 -- 172.21.15.49:0/667035511 >> 172.21.15.49:0/667035511 conn(0x561762699460 msgr2=0x561762a4a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.682+0000 7f6ac1029740 1 -- 172.21.15.49:0/667035511 shutdown_connections 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.682+0000 7f6ac1029740 1 -- 172.21.15.49:0/667035511 wait complete. 2024-09-21T06:43:00.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.682+0000 7f6ac1029740 1 -- start start 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.682+0000 7f6ac1029740 1 Processor -- start 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a57d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a58280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5617626a5070 0x561762a64170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ac1029740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x561762813700 con 0x561762684390 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ac1029740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56176294d160 con 0x5617626a5070 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ac1029740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561762a5ae80 con 0x56176267c1b0 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ac1029740 10 client.0 _ll_register_callbacks cb 0x5617629669e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab8851640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a58280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab8851640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a58280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60000/0 (socket says 172.21.15.49:60000) 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab8851640 1 -- 172.21.15.49:0/4161539134 learned_addr learned my addr 172.21.15.49:0/4161539134 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a57d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5617626a5070 0x561762a64170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab8851640 1 -- 172.21.15.49:0/4161539134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 msgr2=0x561762a57d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab8851640 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a57d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab8851640 1 -- 172.21.15.49:0/4161539134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5617626a5070 msgr2=0x561762a64170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab8851640 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5617626a5070 0x561762a64170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab8851640 1 -- 172.21.15.49:0/4161539134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56176297ac90 con 0x561762684390 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6a93fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.683+0000 7f6ab8851640 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a58280 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80118c0 tx=0x7f6aa8011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d346e5b65a16a9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6a93fff640 1 -- 172.21.15.49:0/4161539134 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8010b40 con 0x561762684390 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6a93fff640 1 -- 172.21.15.49:0/4161539134 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6aa8010ce0 con 0x561762684390 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6ac1029740 1 -- 172.21.15.49:0/4161539134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aa00110d0 con 0x561762684390 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6a93fff640 1 -- 172.21.15.49:0/4161539134 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6aa8005020 con 0x561762684390 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6ac1029740 10 client.17052 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6ac1029740 1 -- 172.21.15.49:0/4161539134 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561762a6af80 con 0x561762684390 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6a93fff640 1 -- 172.21.15.49:0/4161539134 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa00110d0 con 0x561762684390 2024-09-21T06:43:00.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6a93fff640 1 -- 172.21.15.49:0/4161539134 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6aa801a410 con 0x561762684390 2024-09-21T06:43:00.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6ac1029740 10 client.17052 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:00.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6ac1029740 10 client.17052 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:00.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6ac1029740 20 client.17052 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:00.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6ac1029740 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5617626639f0 0x561762a6e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6ac1029740 4 client.17052 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:00.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.684+0000 7f6ac1029740 1 -- 172.21.15.49:0/4161539134 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617629c4df0 con 0x5617626639f0 2024-09-21T06:43:00.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.685+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5617626639f0 0x561762a6e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.685+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5617626639f0 0x561762a6e540 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4b46dc400531be50 server_cookie=f8b5d414f01cb08 in_seq=0 out_seq=0 2024-09-21T06:43:00.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.685+0000 7f6a93fff640 10 client.17052 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:43:00.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6a93fff640 1 -- 172.21.15.49:0/4161539134 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5617629c4df0 con 0x5617626639f0 2024-09-21T06:43:00.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6a93fff640 10 client.17052 handle_command_reply: tid=0 2024-09-21T06:43:00.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6ac1029740 1 client.17052 shutdown 2024-09-21T06:43:00.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6ac1029740 1 -- 172.21.15.49:0/4161539134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 msgr2=0x561762a58280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:00.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6ac1029740 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a58280 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80118c0 tx=0x7f6aa8011d80 comp rx=0 tx=0).stop 2024-09-21T06:43:00.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6ac1029740 1 -- 172.21.15.49:0/4161539134 shutdown_connections 2024-09-21T06:43:00.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6ac1029740 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5617626639f0 0x561762a6e540 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6ac1029740 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5617626a5070 0x561762a64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6ac1029740 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a58280 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6a93fff640 0 client.17052 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:43:00.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6ac1029740 1 --2- 172.21.15.49:0/4161539134 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a57d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.686+0000 7f6ac1029740 1 -- 172.21.15.49:0/4161539134 >> 172.21.15.49:0/4161539134 conn(0x561762699460 msgr2=0x561762a4f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:00.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.687+0000 7f6ac1029740 1 -- 172.21.15.49:0/4161539134 shutdown_connections 2024-09-21T06:43:00.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.687+0000 7f6ac1029740 1 -- 172.21.15.49:0/4161539134 wait complete. 2024-09-21T06:43:00.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.687+0000 7f6ac1029740 20 client.17052 trim_cache size 0 max 16384 2024-09-21T06:43:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ac1029740 1 Processor -- start 2024-09-21T06:43:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ac1029740 1 -- start start 2024-09-21T06:43:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56176267c1b0 0x561762a64070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a59c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5617626a5070 0x561762a4dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ac1029740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41afde0 con 0x561762684390 2024-09-21T06:43:00.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ac1029740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41ad6b0 con 0x56176267c1b0 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ac1029740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41ab520 con 0x5617626a5070 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ab8851640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a59c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ab8851640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a59c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60004/0 (socket says 172.21.15.49:60004) 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.700+0000 7f6ab8851640 1 -- 172.21.15.49:0/600297501 learned_addr learned my addr 172.21.15.49:0/600297501 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/600297501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56176267c1b0 0x561762a64070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6ab8851640 1 -- 172.21.15.49:0/600297501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5617626a5070 msgr2=0x561762a4dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6ab8851640 1 --2- 172.21.15.49:0/600297501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5617626a5070 0x561762a4dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6ab8851640 1 -- 172.21.15.49:0/600297501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56176267c1b0 msgr2=0x561762a64070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6ab8851640 1 --2- 172.21.15.49:0/600297501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56176267c1b0 0x561762a64070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6ab8851640 1 -- 172.21.15.49:0/600297501 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561762a4f500 con 0x561762684390 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/600297501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56176267c1b0 0x561762a64070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:00.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6ab8851640 1 --2- 172.21.15.49:0/600297501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a59c20 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6aa801a830 tx=0x7f6aa80114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c555dbf5fa77d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:00.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6a9e7fc640 1 -- 172.21.15.49:0/600297501 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa8031070 con 0x561762684390 2024-09-21T06:43:00.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6a9e7fc640 1 -- 172.21.15.49:0/600297501 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa801a410 con 0x561762684390 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.701+0000 7f6a9e7fc640 1 -- 172.21.15.49:0/600297501 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa80055e0 con 0x561762684390 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 -- 172.21.15.49:0/600297501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 msgr2=0x561762a59c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 --2- 172.21.15.49:0/600297501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a59c20 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f6aa801a830 tx=0x7f6aa80114b0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 -- 172.21.15.49:0/600297501 shutdown_connections 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 --2- 172.21.15.49:0/600297501 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5617626a5070 0x561762a4dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 --2- 172.21.15.49:0/600297501 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561762684390 0x561762a59c20 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 --2- 172.21.15.49:0/600297501 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56176267c1b0 0x561762a64070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 -- 172.21.15.49:0/600297501 >> 172.21.15.49:0/600297501 conn(0x561762699460 msgr2=0x561762a4d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 -- 172.21.15.49:0/600297501 shutdown_connections 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 -- 172.21.15.49:0/600297501 wait complete. 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 -- start start 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.702+0000 7f6ac1029740 1 Processor -- start 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a5c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 0x561762a5cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ac1029740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762ad7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ac1029740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41abb70 con 0x5617626a5070 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ac1029740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41acfe0 con 0x561762684390 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ac1029740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab41ac240 con 0x56176267c1b0 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ac1029740 10 client.0 _ll_register_callbacks cb 0x7f6aa800bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762ad7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762ad7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60016/0 (socket says 172.21.15.49:60016) 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab3fff640 1 -- 172.21.15.49:0/3810618621 learned_addr learned my addr 172.21.15.49:0/3810618621 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a5c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab8851640 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 0x561762a5cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab3fff640 1 -- 172.21.15.49:0/3810618621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 msgr2=0x561762a5c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a5c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab3fff640 1 -- 172.21.15.49:0/3810618621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 msgr2=0x561762a5cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 0x561762a5cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.703+0000 7f6ab3fff640 1 -- 172.21.15.49:0/3810618621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561762ad8490 con 0x5617626a5070 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6ab3fff640 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762ad7f00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0015010 tx=0x7f6aa000a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce659deb29324b21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6a93fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6a93fff640 1 -- 172.21.15.49:0/3810618621 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0019040 con 0x5617626a5070 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6a93fff640 1 -- 172.21.15.49:0/3810618621 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6aa002df90 con 0x5617626a5070 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6ac1029740 1 -- 172.21.15.49:0/3810618621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6aa801a410 con 0x5617626a5070 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6a93fff640 1 -- 172.21.15.49:0/3810618621 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6aa003a050 con 0x5617626a5070 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6ac1029740 10 client.17058 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6ac1029740 1 -- 172.21.15.49:0/3810618621 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561762ad9680 con 0x5617626a5070 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6a93fff640 1 -- 172.21.15.49:0/3810618621 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6aa801a410 con 0x5617626a5070 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6a93fff640 1 -- 172.21.15.49:0/3810618621 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6aa0011af0 con 0x5617626a5070 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6ac1029740 10 client.17058 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6ac1029740 10 client.17058 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6ac1029740 20 client.17058 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.704+0000 7f6ac1029740 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561762638da0 0x561762adbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:00.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.705+0000 7f6ac1029740 4 client.17058 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.705+0000 7f6ac1029740 1 -- 172.21.15.49:0/3810618621 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5617629c08a0 con 0x561762638da0 2024-09-21T06:43:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.705+0000 7f6ab8851640 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561762638da0 0x561762adbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.705+0000 7f6ab8851640 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561762638da0 0x561762adbbf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a718010f9587729 server_cookie=5b7391fe9322ac4 in_seq=0 out_seq=0 2024-09-21T06:43:00.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.705+0000 7f6a93fff640 10 client.17058 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.705+0000 7f6a93fff640 1 -- 172.21.15.49:0/3810618621 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5617629c08a0 con 0x561762638da0 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.705+0000 7f6a93fff640 10 client.17058 handle_command_reply: tid=0 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.705+0000 7f6ac1029740 1 client.17058 shutdown 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 -- 172.21.15.49:0/3810618621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 msgr2=0x561762ad7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762ad7f00 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0015010 tx=0x7f6aa000a740 comp rx=0 tx=0).stop 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 -- 172.21.15.49:0/3810618621 shutdown_connections 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x561762638da0 0x561762adbbf0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5617626a5070 0x561762ad7f00 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561762684390 0x561762a5cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 --2- 172.21.15.49:0/3810618621 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56176267c1b0 0x561762a5c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 -- 172.21.15.49:0/3810618621 >> 172.21.15.49:0/3810618621 conn(0x561762699460 msgr2=0x561762a59910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:00.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6a93fff640 0 client.17058 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:43:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 -- 172.21.15.49:0/3810618621 shutdown_connections 2024-09-21T06:43:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 1 -- 172.21.15.49:0/3810618621 wait complete. 2024-09-21T06:43:00.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6ac1029740 20 client.17058 trim_cache size 0 max 16384 2024-09-21T06:43:00.713 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6abaab5640 1 -- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6aa40b6730 msgr2=0x7f6aa40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6abaab5640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6aa40b6730 0x7f6aa40b8c40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6aac106680 tx=0x7f6aac09bb70 comp rx=0 tx=0).stop 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6abaab5640 1 -- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 msgr2=0x7f6ab419fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.706+0000 7f6abaab5640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 0x7f6ab419fca0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f6aac005cc0 tx=0x7f6aac02f380 comp rx=0 tx=0).stop 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.707+0000 7f6abaab5640 1 -- 172.21.15.49:0/3959285566 shutdown_connections 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.707+0000 7f6abaab5640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6aa40b6730 0x7f6aa40b8c40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.707+0000 7f6abaab5640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ab4108d20 0x7f6ab419fca0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.707+0000 7f6abaab5640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ab41083d0 0x7f6ab419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.707+0000 7f6abaab5640 1 --2- 172.21.15.49:0/3959285566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ab4102ae0 0x7f6ab419a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.707+0000 7f6abaab5640 1 -- 172.21.15.49:0/3959285566 >> 172.21.15.49:0/3959285566 conn(0x7f6ab40797b0 msgr2=0x7f6ab4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:00.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.707+0000 7f6abaab5640 1 -- 172.21.15.49:0/3959285566 shutdown_connections 2024-09-21T06:43:00.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:00.707+0000 7f6abaab5640 1 -- 172.21.15.49:0/3959285566 wait complete. 2024-09-21T06:43:01.439 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:43:01.701 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.894+0000 7f6aee64d640 1 -- 172.21.15.49:0/7500135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8102030 msgr2=0x7f6ae8102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.894+0000 7f6aee64d640 1 --2- 172.21.15.49:0/7500135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8102030 0x7f6ae8102440 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009900 tx=0x7f6ad802a410 comp rx=0 tx=0).stop 2024-09-21T06:43:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.894+0000 7f6aee64d640 1 -- 172.21.15.49:0/7500135 shutdown_connections 2024-09-21T06:43:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.894+0000 7f6aee64d640 1 --2- 172.21.15.49:0/7500135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae8106b60 0x7f6ae81105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.894+0000 7f6aee64d640 1 --2- 172.21.15.49:0/7500135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ae8106210 0x7f6ae8106620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.894+0000 7f6aee64d640 1 --2- 172.21.15.49:0/7500135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8102030 0x7f6ae8102440 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.894+0000 7f6aee64d640 1 -- 172.21.15.49:0/7500135 >> 172.21.15.49:0/7500135 conn(0x7f6ae8079e60 msgr2=0x7f6ae807a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.894+0000 7f6aee64d640 1 -- 172.21.15.49:0/7500135 shutdown_connections 2024-09-21T06:43:01.897 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.894+0000 7f6aee64d640 1 -- 172.21.15.49:0/7500135 wait complete. 2024-09-21T06:43:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aee64d640 1 Processor -- start 2024-09-21T06:43:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aee64d640 1 -- start start 2024-09-21T06:43:01.899 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aee64d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ae8102030 0x7f6ae819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aee64d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae8106210 0x7f6ae819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aee64d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8106b60 0x7f6ae819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aee64d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8113a30 con 0x7f6ae8106b60 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aee64d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81138b0 con 0x7f6ae8106210 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aee64d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae8113bb0 con 0x7f6ae8102030 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aecbea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8106b60 0x7f6ae819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aecbea640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8106b60 0x7f6ae819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60024/0 (socket says 172.21.15.49:60024) 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6aecbea640 1 -- 172.21.15.49:0/2507350209 learned_addr learned my addr 172.21.15.49:0/2507350209 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ae8102030 0x7f6ae819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.895+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae8106210 0x7f6ae819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6aecbea640 1 -- 172.21.15.49:0/2507350209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ae8102030 msgr2=0x7f6ae819a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.900 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6aecbea640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ae8102030 0x7f6ae819a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6aecbea640 1 -- 172.21.15.49:0/2507350209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae8106210 msgr2=0x7f6ae819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6aecbea640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae8106210 0x7f6ae819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6aecbea640 1 -- 172.21.15.49:0/2507350209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae81a0470 con 0x7f6ae8106b60 2024-09-21T06:43:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6aecbea640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8106b60 0x7f6ae819fe00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cce0 tx=0x7f6ae000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6ae57fa640 1 -- 172.21.15.49:0/2507350209 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000f450 con 0x7f6ae8106b60 2024-09-21T06:43:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6ae57fa640 1 -- 172.21.15.49:0/2507350209 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ae000faa0 con 0x7f6ae8106b60 2024-09-21T06:43:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6ae57fa640 1 -- 172.21.15.49:0/2507350209 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0018b70 con 0x7f6ae8106b60 2024-09-21T06:43:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6aee64d640 1 -- 172.21.15.49:0/2507350209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae81a0760 con 0x7f6ae8106b60 2024-09-21T06:43:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.896+0000 7f6aee64d640 1 -- 172.21.15.49:0/2507350209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae81a0c60 con 0x7f6ae8106b60 2024-09-21T06:43:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.899+0000 7f6af55c3740 1 Processor -- start 2024-09-21T06:43:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.899+0000 7f6ae57fa640 1 -- 172.21.15.49:0/2507350209 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6ae0018d10 con 0x7f6ae8106b60 2024-09-21T06:43:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.899+0000 7f6af55c3740 1 -- start start 2024-09-21T06:43:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 0x55891a4039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a403ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a404430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6af55c3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55891a3786f0 con 0x55891a0352f0 2024-09-21T06:43:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6af55c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55891a367b20 con 0x55891a05e1b0 2024-09-21T06:43:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6af55c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55891a36b930 con 0x55891a03d4d0 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a403ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a403ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60032/0 (socket says 172.21.15.49:60032) 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae7fff640 1 -- 172.21.15.49:0/2205213594 learned_addr learned my addr 172.21.15.49:0/2205213594 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 0x55891a4039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a404430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae7fff640 1 -- 172.21.15.49:0/2205213594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 msgr2=0x55891a404430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a404430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae7fff640 1 -- 172.21.15.49:0/2205213594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 msgr2=0x55891a4039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 0x55891a4039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae7fff640 1 -- 172.21.15.49:0/2205213594 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55891a32d530 con 0x55891a0352f0 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a404430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae57fa640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ad00b6680 0x7f6ad00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ad00b6680 0x7f6ad00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a403ef0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6ae806b9c0 tx=0x7f6ad8032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea5a3c71eb5aea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.900+0000 7f6ae57fa640 1 -- 172.21.15.49:0/2507350209 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6ae00e7aa0 con 0x7f6ae8106b60 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.901+0000 7f6ace7fc640 1 -- 172.21.15.49:0/2205213594 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8040070 con 0x55891a0352f0 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.901+0000 7f6ace7fc640 1 -- 172.21.15.49:0/2205213594 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad8005db0 con 0x55891a0352f0 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.901+0000 7f6ace7fc640 1 -- 172.21.15.49:0/2205213594 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8035040 con 0x55891a0352f0 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 -- 172.21.15.49:0/2205213594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 msgr2=0x55891a403ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a403ef0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f6ae806b9c0 tx=0x7f6ad8032df0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ad00b6680 0x7f6ad00b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6adc005d00 tx=0x7f6adc014040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 -- 172.21.15.49:0/2205213594 shutdown_connections 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a404430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a403ef0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 --2- 172.21.15.49:0/2205213594 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 0x55891a4039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 -- 172.21.15.49:0/2205213594 >> 172.21.15.49:0/2205213594 conn(0x55891a052300 msgr2=0x55891a4018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 -- 172.21.15.49:0/2205213594 shutdown_connections 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 -- 172.21.15.49:0/2205213594 wait complete. 2024-09-21T06:43:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 -- start start 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.902+0000 7f6af55c3740 1 Processor -- start 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a40f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a40f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 0x55891a41b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6af55c3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55891a29fab0 con 0x55891a0352f0 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6af55c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55891a30d730 con 0x55891a05e1b0 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6af55c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55891a4120d0 con 0x55891a03d4d0 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6af55c3740 10 client.0 _ll_register_callbacks cb 0x55891a3616b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a40f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a40f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60042/0 (socket says 172.21.15.49:60042) 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae7fff640 1 -- 172.21.15.49:0/3537300642 learned_addr learned my addr 172.21.15.49:0/3537300642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6aecbea640 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 0x55891a41b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a40f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae7fff640 1 -- 172.21.15.49:0/3537300642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 msgr2=0x55891a40f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a40f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae7fff640 1 -- 172.21.15.49:0/3537300642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 msgr2=0x55891a41b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 0x55891a41b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae7fff640 1 -- 172.21.15.49:0/3537300642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55891a0c9790 con 0x55891a0352f0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a40f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a40f020 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8005610 tx=0x7f6ad80051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c687426e9a35021 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.903+0000 7f6ac77fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6ac77fe640 1 -- 172.21.15.49:0/3537300642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8035040 con 0x55891a0352f0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6ac77fe640 1 -- 172.21.15.49:0/3537300642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6ad80314a0 con 0x55891a0352f0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6af55c3740 1 -- 172.21.15.49:0/3537300642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad8005db0 con 0x55891a0352f0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6ac77fe640 1 -- 172.21.15.49:0/3537300642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ad8054050 con 0x55891a0352f0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6af55c3740 10 client.17070 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6af55c3740 1 -- 172.21.15.49:0/3537300642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55891a142620 con 0x55891a0352f0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6ac77fe640 1 -- 172.21.15.49:0/3537300642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad8005db0 con 0x55891a0352f0 2024-09-21T06:43:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6ac77fe640 1 -- 172.21.15.49:0/3537300642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6ad8003aa0 con 0x55891a0352f0 2024-09-21T06:43:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6af55c3740 10 client.17070 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6af55c3740 10 client.17070 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6af55c3740 20 client.17070 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6af55c3740 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55891a01cd80 0x55891a420fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6af55c3740 4 client.17070 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.904+0000 7f6af55c3740 1 -- 172.21.15.49:0/3537300642 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55891a37a640 con 0x55891a01cd80 2024-09-21T06:43:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.905+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55891a01cd80 0x55891a420fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.905+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55891a01cd80 0x55891a420fc0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f1234c58c465dd3 server_cookie=7c887c5857170311 in_seq=0 out_seq=0 2024-09-21T06:43:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.905+0000 7f6ac77fe640 10 client.17070 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6ac77fe640 1 -- 172.21.15.49:0/3537300642 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55891a37a640 con 0x55891a01cd80 2024-09-21T06:43:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6ac77fe640 10 client.17070 handle_command_reply: tid=0 2024-09-21T06:43:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 client.17070 shutdown 2024-09-21T06:43:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 -- 172.21.15.49:0/3537300642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 msgr2=0x55891a40f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a40f020 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8005610 tx=0x7f6ad80051c0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 -- 172.21.15.49:0/3537300642 shutdown_connections 2024-09-21T06:43:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55891a01cd80 0x55891a420fc0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a05e1b0 0x55891a41b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6ac77fe640 0 client.17070 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a03d4d0 0x55891a40f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 --2- 172.21.15.49:0/3537300642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a40f020 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 -- 172.21.15.49:0/3537300642 >> 172.21.15.49:0/3537300642 conn(0x55891a052300 msgr2=0x55891a4049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 -- 172.21.15.49:0/3537300642 shutdown_connections 2024-09-21T06:43:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 1 -- 172.21.15.49:0/3537300642 wait complete. 2024-09-21T06:43:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.906+0000 7f6af55c3740 20 client.17070 trim_cache size 0 max 16384 2024-09-21T06:43:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6af55c3740 1 Processor -- start 2024-09-21T06:43:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6af55c3740 1 -- start start 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a4050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a03d4d0 0x55891a41b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 0x55891a40c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6af55c3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81b2070 con 0x55891a0352f0 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6af55c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81af940 con 0x55891a03d4d0 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6af55c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81ad7b0 con 0x55891a05e1b0 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a4050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a4050f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60052/0 (socket says 172.21.15.49:60052) 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae7fff640 1 -- 172.21.15.49:0/2216830018 learned_addr learned my addr 172.21.15.49:0/2216830018 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6aecbea640 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 0x55891a40c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a03d4d0 0x55891a41b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae7fff640 1 -- 172.21.15.49:0/2216830018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 msgr2=0x55891a40c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 0x55891a40c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae7fff640 1 -- 172.21.15.49:0/2216830018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a03d4d0 msgr2=0x55891a41b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a03d4d0 0x55891a41b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae7fff640 1 -- 172.21.15.49:0/2216830018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55891a4021a0 con 0x55891a0352f0 2024-09-21T06:43:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6aecbea640 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 0x55891a40c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.921+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a03d4d0 0x55891a41b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.922+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a4050f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6ad802a930 tx=0x7f6ad8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bc9a5acd833f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.922+0000 7f6acdffb640 1 -- 172.21.15.49:0/2216830018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8040040 con 0x55891a0352f0 2024-09-21T06:43:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.922+0000 7f6acdffb640 1 -- 172.21.15.49:0/2216830018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad8005230 con 0x55891a0352f0 2024-09-21T06:43:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.922+0000 7f6acdffb640 1 -- 172.21.15.49:0/2216830018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8004220 con 0x55891a0352f0 2024-09-21T06:43:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 -- 172.21.15.49:0/2216830018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 msgr2=0x55891a4050f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a4050f0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f6ad802a930 tx=0x7f6ad8000bc0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 -- 172.21.15.49:0/2216830018 shutdown_connections 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 0x55891a40c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a03d4d0 0x55891a41b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 --2- 172.21.15.49:0/2216830018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a0352f0 0x55891a4050f0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 -- 172.21.15.49:0/2216830018 >> 172.21.15.49:0/2216830018 conn(0x55891a052300 msgr2=0x55891a4049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 -- 172.21.15.49:0/2216830018 shutdown_connections 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 -- 172.21.15.49:0/2216830018 wait complete. 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 -- start start 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.923+0000 7f6af55c3740 1 Processor -- start 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a0352f0 0x55891a4238d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a03d4d0 0x55891a423e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6af55c3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 0x55891a483710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6af55c3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81ade00 con 0x55891a03d4d0 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6af55c3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81af270 con 0x55891a0352f0 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6af55c3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae81ae4d0 con 0x55891a05e1b0 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6af55c3740 10 client.0 _ll_register_callbacks cb 0x7f6adc00b7c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a03d4d0 0x55891a423e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a03d4d0 0x55891a423e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60068/0 (socket says 172.21.15.49:60068) 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae77fe640 1 -- 172.21.15.49:0/1531744375 learned_addr learned my addr 172.21.15.49:0/1531744375 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6aecbea640 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 0x55891a483710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a0352f0 0x55891a4238d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae77fe640 1 -- 172.21.15.49:0/1531744375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 msgr2=0x55891a483710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 0x55891a483710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae77fe640 1 -- 172.21.15.49:0/1531744375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a0352f0 msgr2=0x55891a4238d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a0352f0 0x55891a4238d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae77fe640 1 -- 172.21.15.49:0/1531744375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55891a483d80 con 0x55891a03d4d0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a0352f0 0x55891a4238d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ae77fe640 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a03d4d0 0x55891a423e90 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00b9d0 tx=0x7f6adc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608987614809704e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ac77fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ac77fe640 1 -- 172.21.15.49:0/1531744375 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6adc02f070 con 0x55891a03d4d0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6ac77fe640 1 -- 172.21.15.49:0/1531744375 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f6adc0228f0 con 0x55891a03d4d0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.924+0000 7f6af55c3740 1 -- 172.21.15.49:0/1531744375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ad8005230 con 0x55891a03d4d0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6ac77fe640 1 -- 172.21.15.49:0/1531744375 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6adc03b050 con 0x55891a03d4d0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6af55c3740 10 client.17076 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6af55c3740 1 -- 172.21.15.49:0/1531744375 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55891a48b020 con 0x55891a03d4d0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6ac77fe640 1 -- 172.21.15.49:0/1531744375 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ad8005230 con 0x55891a03d4d0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6ac77fe640 1 -- 172.21.15.49:0/1531744375 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6adc021ae0 con 0x55891a03d4d0 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6af55c3740 10 client.17076 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6af55c3740 10 client.17076 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6af55c3740 20 client.17076 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6af55c3740 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558919ff21c0 0x55891a48d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6af55c3740 4 client.17076 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:43:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6af55c3740 1 -- 172.21.15.49:0/1531744375 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55891a3760f0 con 0x558919ff21c0 2024-09-21T06:43:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.925+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558919ff21c0 0x55891a48d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.926+0000 7f6ac77fe640 10 client.17076 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:01.933 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:01.926+0000 7f6ae7fff640 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558919ff21c0 0x55891a48d7c0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5910fa4d6effa69 server_cookie=a6649daf15c8d974 in_seq=0 out_seq=0 2024-09-21T06:43:01.999 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:01 smithi049 ceph-mon[31177]: pgmap v510: 97 pgs: 97 active+clean; 5.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:43:02.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:01 smithi098 ceph-mon[34704]: pgmap v510: 97 pgs: 97 active+clean; 5.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:43:02.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:01 smithi079 ceph-mon[34346]: pgmap v510: 97 pgs: 97 active+clean; 5.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-09-21T06:43:02.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.239+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1664751257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa8102ae0 msgr2=0x7f0aa8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.239+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1664751257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa8102ae0 0x7f0aa8102ef0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009900 tx=0x7f0aa002a410 comp rx=0 tx=0).stop 2024-09-21T06:43:02.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.239+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1664751257 shutdown_connections 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.239+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1664751257 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa8108d20 0x7f0aa810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.239+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1664751257 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa81083d0 0x7f0aa81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.239+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1664751257 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa8102ae0 0x7f0aa8102ef0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.239+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1664751257 >> 172.21.15.49:0/1664751257 conn(0x7f0aa80797b0 msgr2=0x7f0aa8079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.239+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1664751257 shutdown_connections 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.239+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1664751257 wait complete. 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aaf0f3640 1 Processor -- start 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aaf0f3640 1 -- start start 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aaf0f3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa8102ae0 0x7f0aa819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aaf0f3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa81083d0 0x7f0aa819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aaf0f3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa8108d20 0x7f0aa81a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aaf0f3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81129e0 con 0x7f0aa81083d0 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aaf0f3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8112860 con 0x7f0aa8108d20 2024-09-21T06:43:02.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aaf0f3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8112b60 con 0x7f0aa8102ae0 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa81083d0 0x7f0aa819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa81083d0 0x7f0aa819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60080/0 (socket says 172.21.15.49:60080) 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aa7fff640 1 -- 172.21.15.49:0/1258407669 learned_addr learned my addr 172.21.15.49:0/1258407669 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aace8f640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa8102ae0 0x7f0aa819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.240+0000 7f0aad690640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa8108d20 0x7f0aa81a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aa7fff640 1 -- 172.21.15.49:0/1258407669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa8102ae0 msgr2=0x7f0aa819c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa8102ae0 0x7f0aa819c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aa7fff640 1 -- 172.21.15.49:0/1258407669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa8108d20 msgr2=0x7f0aa81a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa8108d20 0x7f0aa81a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aa7fff640 1 -- 172.21.15.49:0/1258407669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa81a2600 con 0x7f0aa81083d0 2024-09-21T06:43:02.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa81083d0 0x7f0aa819ccf0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800cce0 tx=0x7f0a9800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aa5ffb640 1 -- 172.21.15.49:0/1258407669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800f450 con 0x7f0aa81083d0 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aa5ffb640 1 -- 172.21.15.49:0/1258407669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a9800faa0 con 0x7f0aa81083d0 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aa5ffb640 1 -- 172.21.15.49:0/1258407669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98018c50 con 0x7f0aa81083d0 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1258407669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa81a28f0 con 0x7f0aa81083d0 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.241+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1258407669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa81a9110 con 0x7f0aa81083d0 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0ab5667740 1 Processor -- start 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0ab5667740 1 -- start start 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aa5ffb640 1 -- 172.21.15.49:0/1258407669 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0a9800fc50 con 0x7f0aa81083d0 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a249070 0x55ad3a5f02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 0x55ad3a5f0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a228390 0x55ad3a5f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0ab5667740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a566ea0 con 0x55ad3a249070 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0ab5667740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a5562d0 con 0x55ad3a2201b0 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0ab5667740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a55a0e0 con 0x55ad3a228390 2024-09-21T06:43:02.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aad690640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a249070 0x55ad3a5f02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aad690640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a249070 0x55ad3a5f02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60094/0 (socket says 172.21.15.49:60094) 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aad690640 1 -- 172.21.15.49:0/3460714798 learned_addr learned my addr 172.21.15.49:0/3460714798 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aace8f640 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 0x55ad3a5f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a228390 0x55ad3a5f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aad690640 1 -- 172.21.15.49:0/3460714798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a228390 msgr2=0x55ad3a5f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aad690640 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a228390 0x55ad3a5f0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aad690640 1 -- 172.21.15.49:0/3460714798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 msgr2=0x55ad3a5f0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.244+0000 7f0aad690640 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 0x55ad3a5f0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.245+0000 7f0aad690640 1 -- 172.21.15.49:0/3460714798 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3a2b4650 con 0x55ad3a249070 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.245+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a228390 0x55ad3a5f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.245+0000 7f0aad690640 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a249070 0x55ad3a5f02c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000caa0 tx=0x7f0a9000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d8c96709bc530c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.245+0000 7f0aa5ffb640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a940b66b0 0x7f0a940b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.245+0000 7f0a9effd640 1 -- 172.21.15.49:0/3460714798 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90004020 con 0x55ad3a249070 2024-09-21T06:43:02.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.245+0000 7f0a9effd640 1 -- 172.21.15.49:0/3460714798 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a900041c0 con 0x55ad3a249070 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.245+0000 7f0a9effd640 1 -- 172.21.15.49:0/3460714798 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a90010690 con 0x55ad3a249070 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.245+0000 7f0aace8f640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a940b66b0 0x7f0a940b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.245+0000 7f0aa5ffb640 1 -- 172.21.15.49:0/1258407669 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0a980e7bf0 con 0x7f0aa81083d0 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 -- 172.21.15.49:0/3460714798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a249070 msgr2=0x55ad3a5f02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0aace8f640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a940b66b0 0x7f0a940b8bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0031440 tx=0x7f0aa0009650 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a249070 0x55ad3a5f02c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f0a9000caa0 tx=0x7f0a9000cf60 comp rx=0 tx=0).stop 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 -- 172.21.15.49:0/3460714798 shutdown_connections 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a228390 0x55ad3a5f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 0x55ad3a5f0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 --2- 172.21.15.49:0/3460714798 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a249070 0x55ad3a5f02c0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 -- 172.21.15.49:0/3460714798 >> 172.21.15.49:0/3460714798 conn(0x55ad3a23d460 msgr2=0x55ad3a5ee1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 -- 172.21.15.49:0/3460714798 shutdown_connections 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 -- 172.21.15.49:0/3460714798 wait complete. 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 -- start start 2024-09-21T06:43:02.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.246+0000 7f0ab5667740 1 Processor -- start 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 0x55ad3a5fb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a228390 0x55ad3a5fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a249070 0x55ad3a5fc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0ab5667740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a3b7700 con 0x55ad3a228390 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0ab5667740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a4f1160 con 0x55ad3a2201b0 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0ab5667740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ad3a5feaa0 con 0x55ad3a249070 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0ab5667740 10 client.0 _ll_register_callbacks cb 0x55ad3a50a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a228390 0x55ad3a5fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0aa7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a228390 0x55ad3a5fbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60098/0 (socket says 172.21.15.49:60098) 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0aa7fff640 1 -- 172.21.15.49:0/4033455716 learned_addr learned my addr 172.21.15.49:0/4033455716 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0aace8f640 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 0x55ad3a5fb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.247+0000 7f0aad690640 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a249070 0x55ad3a5fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0aa7fff640 1 -- 172.21.15.49:0/4033455716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a249070 msgr2=0x55ad3a5fc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a249070 0x55ad3a5fc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0aa7fff640 1 -- 172.21.15.49:0/4033455716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 msgr2=0x55ad3a5fb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 0x55ad3a5fb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0aa7fff640 1 -- 172.21.15.49:0/4033455716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3a51ec90 con 0x55ad3a228390 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a228390 0x55ad3a5fbe90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0a980aac90 tx=0x7f0a980ad430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9353019c8fd3ef66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0a87fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0a87fff640 1 -- 172.21.15.49:0/4033455716 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a980ad530 con 0x55ad3a228390 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0a87fff640 1 -- 172.21.15.49:0/4033455716 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0a980b21d0 con 0x55ad3a228390 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0ab5667740 1 -- 172.21.15.49:0/4033455716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a900041c0 con 0x55ad3a228390 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0a87fff640 1 -- 172.21.15.49:0/4033455716 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a980d10b0 con 0x55ad3a228390 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0ab5667740 10 client.17088 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0ab5667740 1 -- 172.21.15.49:0/4033455716 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ad3a60a6e0 con 0x55ad3a228390 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.248+0000 7f0a87fff640 1 -- 172.21.15.49:0/4033455716 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a900041c0 con 0x55ad3a228390 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.249+0000 7f0a87fff640 1 -- 172.21.15.49:0/4033455716 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0a98020030 con 0x55ad3a228390 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.249+0000 7f0ab5667740 10 client.17088 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:02.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.249+0000 7f0ab5667740 10 client.17088 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.249+0000 7f0ab5667740 20 client.17088 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.249+0000 7f0ab5667740 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ad3a2079f0 0x55ad3a60dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.249+0000 7f0ab5667740 4 client.17088 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.249+0000 7f0ab5667740 1 -- 172.21.15.49:0/4033455716 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad3a568df0 con 0x55ad3a2079f0 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.249+0000 7f0aace8f640 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ad3a2079f0 0x55ad3a60dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.250+0000 7f0aace8f640 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ad3a2079f0 0x55ad3a60dbd0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c956c9499c2b594 server_cookie=3dd7c57dca6f5328 in_seq=0 out_seq=0 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.250+0000 7f0a87fff640 10 client.17088 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.250+0000 7f0a87fff640 1 -- 172.21.15.49:0/4033455716 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ad3a568df0 con 0x55ad3a2079f0 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.250+0000 7f0a87fff640 10 client.17088 handle_command_reply: tid=0 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.250+0000 7f0ab5667740 1 client.17088 shutdown 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 -- 172.21.15.49:0/4033455716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a228390 msgr2=0x55ad3a5fbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a228390 0x55ad3a5fbe90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0a980aac90 tx=0x7f0a980ad430 comp rx=0 tx=0).stop 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 -- 172.21.15.49:0/4033455716 shutdown_connections 2024-09-21T06:43:02.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ad3a2079f0 0x55ad3a60dbd0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0a87fff640 0 client.17088 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a249070 0x55ad3a5fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a228390 0x55ad3a5fbe90 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 --2- 172.21.15.49:0/4033455716 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a2201b0 0x55ad3a5fb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 -- 172.21.15.49:0/4033455716 >> 172.21.15.49:0/4033455716 conn(0x55ad3a23d460 msgr2=0x55ad3a5f3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 -- 172.21.15.49:0/4033455716 shutdown_connections 2024-09-21T06:43:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 1 -- 172.21.15.49:0/4033455716 wait complete. 2024-09-21T06:43:02.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.251+0000 7f0ab5667740 20 client.17088 trim_cache size 0 max 16384 2024-09-21T06:43:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.264+0000 7f0ab5667740 1 Processor -- start 2024-09-21T06:43:02.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.264+0000 7f0ab5667740 1 -- start start 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.264+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.264+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 0x55ad3a6073c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.264+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 0x55ad3a607900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.264+0000 7f0ab5667740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81b41e0 con 0x55ad3a2079f0 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.264+0000 7f0ab5667740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81b1ab0 con 0x55ad3a228390 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.264+0000 7f0ab5667740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81af920 con 0x55ad3a2201b0 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aace8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aace8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5f1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60108/0 (socket says 172.21.15.49:60108) 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aace8f640 1 -- 172.21.15.49:0/1675712783 learned_addr learned my addr 172.21.15.49:0/1675712783 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 0x55ad3a6073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aad690640 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 0x55ad3a607900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aace8f640 1 -- 172.21.15.49:0/1675712783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 msgr2=0x55ad3a6073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aace8f640 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 0x55ad3a6073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aace8f640 1 -- 172.21.15.49:0/1675712783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 msgr2=0x55ad3a607900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aace8f640 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 0x55ad3a607900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aace8f640 1 -- 172.21.15.49:0/1675712783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad3a5e95d0 con 0x55ad3a2079f0 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aad690640 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 0x55ad3a607900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 0x55ad3a6073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0aace8f640 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5f1c60 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00096c0 tx=0x7f0aa003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a580c8373db0bbda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0a9e7fc640 1 -- 172.21.15.49:0/1675712783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0035040 con 0x55ad3a2079f0 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0a9e7fc640 1 -- 172.21.15.49:0/1675712783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa0056070 con 0x55ad3a2079f0 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.265+0000 7f0a9e7fc640 1 -- 172.21.15.49:0/1675712783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa005b970 con 0x55ad3a2079f0 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.266+0000 7f0ab5667740 1 -- 172.21.15.49:0/1675712783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 msgr2=0x55ad3a5f1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.266+0000 7f0ab5667740 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5f1c60 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0aa00096c0 tx=0x7f0aa003f000 comp rx=0 tx=0).stop 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.266+0000 7f0ab5667740 1 -- 172.21.15.49:0/1675712783 shutdown_connections 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.266+0000 7f0ab5667740 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 0x55ad3a607900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.266+0000 7f0ab5667740 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 0x55ad3a6073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.266+0000 7f0ab5667740 1 --2- 172.21.15.49:0/1675712783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5f1c60 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.266+0000 7f0ab5667740 1 -- 172.21.15.49:0/1675712783 >> 172.21.15.49:0/1675712783 conn(0x55ad3a23d460 msgr2=0x55ad3a606cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.266+0000 7f0ab5667740 1 -- 172.21.15.49:0/1675712783 shutdown_connections 2024-09-21T06:43:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.266+0000 7f0ab5667740 1 -- 172.21.15.49:0/1675712783 wait complete. 2024-09-21T06:43:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.267+0000 7f0ab5667740 1 -- start start 2024-09-21T06:43:02.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.267+0000 7f0ab5667740 1 Processor -- start 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.267+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5fff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.267+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 0x55ad3a600470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.267+0000 7f0ab5667740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 0x55ad3a6009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.267+0000 7f0ab5667740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81aff70 con 0x55ad3a2079f0 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.267+0000 7f0ab5667740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81b13e0 con 0x55ad3a228390 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.267+0000 7f0ab5667740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81b0640 con 0x55ad3a2201b0 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0ab5667740 10 client.0 _ll_register_callbacks cb 0x7f0a9800cc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aace8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aace8f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60120/0 (socket says 172.21.15.49:60120) 2024-09-21T06:43:02.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aace8f640 1 -- 172.21.15.49:0/82108677 learned_addr learned my addr 172.21.15.49:0/82108677 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 0x55ad3a600470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aad690640 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 0x55ad3a6009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aace8f640 1 -- 172.21.15.49:0/82108677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 msgr2=0x55ad3a600470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aace8f640 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 0x55ad3a600470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aace8f640 1 -- 172.21.15.49:0/82108677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 msgr2=0x55ad3a6009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aace8f640 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 0x55ad3a6009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aace8f640 1 -- 172.21.15.49:0/82108677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad3a6777e0 con 0x55ad3a2079f0 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0aace8f640 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5fff30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0031670 tx=0x7f0aa002ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bdb4ca4a5cf695 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0a87fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0a87fff640 1 -- 172.21.15.49:0/82108677 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa006a060 con 0x55ad3a2079f0 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0ab5667740 1 -- 172.21.15.49:0/82108677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aa0056070 con 0x55ad3a2079f0 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.268+0000 7f0a87fff640 1 -- 172.21.15.49:0/82108677 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(78..78 src has 1..78) ==== 8550+0+0 (secure 0 0 0) 0x7f0aa005b900 con 0x55ad3a2079f0 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0a87fff640 1 -- 172.21.15.49:0/82108677 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0aa005bb00 con 0x55ad3a2079f0 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0ab5667740 10 client.17094 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:02.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0ab5667740 1 -- 172.21.15.49:0/82108677 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ad3a6789d0 con 0x55ad3a2079f0 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0a87fff640 1 -- 172.21.15.49:0/82108677 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa0056070 con 0x55ad3a2079f0 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0a87fff640 1 -- 172.21.15.49:0/82108677 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0aa003d450 con 0x55ad3a2079f0 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0ab5667740 10 client.17094 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0ab5667740 10 client.17094 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0ab5667740 20 client.17094 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0ab5667740 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ad3a249070 0x55ad3a67b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0ab5667740 4 client.17094 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0ab5667740 1 -- 172.21.15.49:0/82108677 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad3a5648a0 con 0x55ad3a249070 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.269+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ad3a249070 0x55ad3a67b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0aa7fff640 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ad3a249070 0x55ad3a67b150 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=323d910d87068d3c server_cookie=e11b4ebe8b33f79b in_seq=0 out_seq=0 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0a87fff640 10 client.17094 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0a87fff640 1 -- 172.21.15.49:0/82108677 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad3a5648a0 con 0x55ad3a249070 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0a87fff640 10 client.17094 handle_command_reply: tid=0 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 client.17094 shutdown 2024-09-21T06:43:02.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 -- 172.21.15.49:0/82108677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 msgr2=0x55ad3a5fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5fff30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0031670 tx=0x7f0aa002ab10 comp rx=0 tx=0).stop 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 -- 172.21.15.49:0/82108677 shutdown_connections 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ad3a249070 0x55ad3a67b150 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ad3a228390 0x55ad3a6009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ad3a2201b0 0x55ad3a600470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0a87fff640 0 client.17094 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 --2- 172.21.15.49:0/82108677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ad3a2079f0 0x55ad3a5fff30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 -- 172.21.15.49:0/82108677 >> 172.21.15.49:0/82108677 conn(0x55ad3a23d460 msgr2=0x55ad3a607670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 -- 172.21.15.49:0/82108677 shutdown_connections 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 1 -- 172.21.15.49:0/82108677 wait complete. 2024-09-21T06:43:02.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.270+0000 7f0ab5667740 20 client.17094 trim_cache size 0 max 16384 2024-09-21T06:43:02.279 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:43:02.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a940b66b0 msgr2=0x7f0a940b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a940b66b0 0x7f0a940b8bc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0031440 tx=0x7f0aa0009650 comp rx=0 tx=0).stop 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa81083d0 msgr2=0x7f0aa819ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa81083d0 0x7f0aa819ccf0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800cce0 tx=0x7f0a9800a620 comp rx=0 tx=0).stop 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1258407669 shutdown_connections 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a940b66b0 0x7f0a940b8bc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0aa8108d20 0x7f0aa81a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0aa81083d0 0x7f0aa819ccf0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 --2- 172.21.15.49:0/1258407669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0aa8102ae0 0x7f0aa819c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1258407669 >> 172.21.15.49:0/1258407669 conn(0x7f0aa80797b0 msgr2=0x7f0aa8106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1258407669 shutdown_connections 2024-09-21T06:43:02.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:02.271+0000 7f0aaf0f3640 1 -- 172.21.15.49:0/1258407669 wait complete. 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6ac77fe640 1 -- 172.21.15.49:0/1531744375 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55891a3760f0 con 0x558919ff21c0 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6ac77fe640 10 client.17076 handle_command_reply: tid=0 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 client.17076 shutdown 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 -- 172.21.15.49:0/1531744375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a03d4d0 msgr2=0x55891a423e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a03d4d0 0x55891a423e90 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f6adc00b9d0 tx=0x7f6adc004730 comp rx=0 tx=0).stop 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 -- 172.21.15.49:0/1531744375 shutdown_connections 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558919ff21c0 0x55891a48d7c0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55891a05e1b0 0x55891a483710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55891a03d4d0 0x55891a423e90 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 --2- 172.21.15.49:0/1531744375 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55891a0352f0 0x55891a4238d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6ac77fe640 0 client.17076 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 -- 172.21.15.49:0/1531744375 >> 172.21.15.49:0/1531744375 conn(0x55891a052300 msgr2=0x55891a401880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 -- 172.21.15.49:0/1531744375 shutdown_connections 2024-09-21T06:43:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 1 -- 172.21.15.49:0/1531744375 wait complete. 2024-09-21T06:43:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.562+0000 7f6af55c3740 20 client.17076 trim_cache size 0 max 16384 2024-09-21T06:43:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:43:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:43:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:43:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:43:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 -- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ad00b6680 msgr2=0x7f6ad00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ad00b6680 0x7f6ad00b8b90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6adc005d00 tx=0x7f6adc014040 comp rx=0 tx=0).stop 2024-09-21T06:43:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 -- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8106b60 msgr2=0x7f6ae819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8106b60 0x7f6ae819fe00 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cce0 tx=0x7f6ae000a620 comp rx=0 tx=0).stop 2024-09-21T06:43:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 -- 172.21.15.49:0/2507350209 shutdown_connections 2024-09-21T06:43:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6ad00b6680 0x7f6ad00b8b90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6ae8106b60 0x7f6ae819fe00 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6ae8106210 0x7f6ae819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 --2- 172.21.15.49:0/2507350209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6ae8102030 0x7f6ae819a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 -- 172.21.15.49:0/2507350209 >> 172.21.15.49:0/2507350209 conn(0x7f6ae8079e60 msgr2=0x7f6ae8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.563+0000 7f6aee64d640 1 -- 172.21.15.49:0/2507350209 shutdown_connections 2024-09-21T06:43:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:03.564+0000 7f6aee64d640 1 -- 172.21.15.49:0/2507350209 wait complete. 2024-09-21T06:43:03.947 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:43:03.948 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:43:04.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:03 smithi098 ceph-mon[34704]: pgmap v511: 97 pgs: 97 active+clean; 5.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:43:04.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:03 smithi079 ceph-mon[34346]: pgmap v511: 97 pgs: 97 active+clean; 5.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:43:04.218 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:03 smithi049 ceph-mon[31177]: pgmap v511: 97 pgs: 97 active+clean; 5.9 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:43:04.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/222643029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb8104840 msgr2=0x7f8eb8104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:04.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/222643029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb8104840 0x7f8eb8104c50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009900 tx=0x7f8ea802a410 comp rx=0 tx=0).stop 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/222643029 shutdown_connections 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/222643029 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb810ddf0 0x7f8eb8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/222643029 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eb8105270 0x7f8eb810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/222643029 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb8104840 0x7f8eb8104c50 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/222643029 >> 172.21.15.49:0/222643029 conn(0x7f8eb8079730 msgr2=0x7f8eb8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/222643029 shutdown_connections 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/222643029 wait complete. 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.742+0000 7f8ebd6b1640 1 Processor -- start 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8ebd6b1640 1 -- start start 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8ebd6b1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eb8104840 0x7f8eb819c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8ebd6b1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8105270 0x7f8eb819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8ebd6b1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb810ddf0 0x7f8eb81a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8ebd6b1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb8113a90 con 0x7f8eb810ddf0 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8ebd6b1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb8113910 con 0x7f8eb8105270 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8ebd6b1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb8113c10 con 0x7f8eb8104840 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eb77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb810ddf0 0x7f8eb81a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eb77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb810ddf0 0x7f8eb81a1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60124/0 (socket says 172.21.15.49:60124) 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eb77fe640 1 -- 172.21.15.49:0/3920384499 learned_addr learned my addr 172.21.15.49:0/3920384499 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eaffff640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8105270 0x7f8eb819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eb8104840 0x7f8eb819c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eb77fe640 1 -- 172.21.15.49:0/3920384499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eb8104840 msgr2=0x7f8eb819c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eb77fe640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eb8104840 0x7f8eb819c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eb77fe640 1 -- 172.21.15.49:0/3920384499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8105270 msgr2=0x7f8eb819ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eb77fe640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8105270 0x7f8eb819ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.743+0000 7f8eb77fe640 1 -- 172.21.15.49:0/3920384499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb81a2690 con 0x7f8eb810ddf0 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.744+0000 7f8eb77fe640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb810ddf0 0x7f8eb81a1f60 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000eb10 tx=0x7f8eb000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:04.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.745+0000 7f8eb4ff9640 1 -- 172.21.15.49:0/3920384499 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0004b20 con 0x7f8eb810ddf0 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.745+0000 7f8eb4ff9640 1 -- 172.21.15.49:0/3920384499 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8eb0004cc0 con 0x7f8eb810ddf0 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.745+0000 7f8eb4ff9640 1 -- 172.21.15.49:0/3920384499 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0010670 con 0x7f8eb810ddf0 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.745+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/3920384499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb81a2980 con 0x7f8eb810ddf0 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.745+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/3920384499 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb81a90e0 con 0x7f8eb810ddf0 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.748+0000 7f8ec3c25740 1 Processor -- start 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.748+0000 7f8eb4ff9640 1 -- 172.21.15.49:0/3920384499 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8eb0005020 con 0x7f8eb810ddf0 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.748+0000 7f8ec3c25740 1 -- start start 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.748+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 0x56204a94d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.748+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 0x56204a94d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.748+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a585670 0x56204a94deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.748+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56204a8c3e60 con 0x56204a585670 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.748+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56204a8b3290 con 0x56204a5a6350 2024-09-21T06:43:04.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.748+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56204a8b70a0 con 0x56204a57d490 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a585670 0x56204a94deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a585670 0x56204a94deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60136/0 (socket says 172.21.15.49:60136) 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 -- 172.21.15.49:0/3125729389 learned_addr learned my addr 172.21.15.49:0/3125729389 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/3125729389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 0x56204a94d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 --2- 172.21.15.49:0/3125729389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 0x56204a94d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 -- 172.21.15.49:0/3125729389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 msgr2=0x56204a94d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 --2- 172.21.15.49:0/3125729389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 0x56204a94d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 -- 172.21.15.49:0/3125729389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 msgr2=0x56204a94d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 --2- 172.21.15.49:0/3125729389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 0x56204a94d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eb4ff9640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ea40b6700 0x7f8ea40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 -- 172.21.15.49:0/3125729389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56204a611930 con 0x56204a585670 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ea40b6700 0x7f8ea40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eaffff640 1 --2- 172.21.15.49:0/3125729389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a585670 0x56204a94deb0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00058c0 tx=0x7f8ea0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e06299515114f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8eb4ff9640 1 -- 172.21.15.49:0/3920384499 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8638+0+0 (secure 0 0 0) 0x7f8eb00e7d40 con 0x7f8eb810ddf0 2024-09-21T06:43:04.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8ead7fa640 1 -- 172.21.15.49:0/3125729389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0005020 con 0x56204a585670 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8ead7fa640 1 -- 172.21.15.49:0/3125729389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea00047a0 con 0x56204a585670 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.749+0000 7f8ead7fa640 1 -- 172.21.15.49:0/3125729389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000fa20 con 0x56204a585670 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3125729389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a585670 msgr2=0x56204a94deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ea40b6700 0x7f8ea40b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8000c00 tx=0x7f8ea8005a20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3125729389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a585670 0x56204a94deb0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00058c0 tx=0x7f8ea0005850 comp rx=0 tx=0).stop 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3125729389 shutdown_connections 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3125729389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a585670 0x56204a94deb0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3125729389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 0x56204a94d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3125729389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 0x56204a94d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3125729389 >> 172.21.15.49:0/3125729389 conn(0x56204a59a740 msgr2=0x56204a94b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3125729389 shutdown_connections 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.750+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3125729389 wait complete. 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8ec3c25740 1 -- start start 2024-09-21T06:43:04.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8ec3c25740 1 Processor -- start 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a57d490 0x56204a959030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 0x56204a9595b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 0x56204a964f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56204a714890 con 0x56204a57d490 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56204a84dd40 con 0x56204a5a6350 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56204a95bc10 con 0x56204a585670 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a57d490 0x56204a959030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8ec3c25740 10 client.0 _ll_register_callbacks cb 0x56204a8b1c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.751+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a57d490 0x56204a959030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60144/0 (socket says 172.21.15.49:60144) 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/1724458111 learned_addr learned my addr 172.21.15.49:0/1724458111 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8eaffff640 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 0x56204a9595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8eb77fe640 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 0x56204a964f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/1724458111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 msgr2=0x56204a9595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 0x56204a9595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/1724458111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 msgr2=0x56204a964f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 0x56204a964f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/1724458111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56204a965510 con 0x56204a57d490 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a57d490 0x56204a959030 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8032fd0 tx=0x7f8ea8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f0289404302519 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8e9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/1724458111 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea804c030 con 0x56204a57d490 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8ec3c25740 1 -- 172.21.15.49:0/1724458111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea00047a0 con 0x56204a57d490 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.752+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/1724458111 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8638+0+0 (secure 0 0 0) 0x7f8ea80035f0 con 0x56204a57d490 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/1724458111 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8ea8035040 con 0x56204a57d490 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8ec3c25740 10 client.17106 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8ec3c25740 1 -- 172.21.15.49:0/1724458111 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56204a967e40 con 0x56204a57d490 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/1724458111 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea00047a0 con 0x56204a57d490 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/1724458111 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8ea80486a0 con 0x56204a57d490 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8ec3c25740 10 client.17106 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:04.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8ec3c25740 10 client.17106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:04.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8ec3c25740 20 client.17106 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:04.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56204a564cd0 0x56204a96b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8ec3c25740 4 client.17106 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:04.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8ec3c25740 1 -- 172.21.15.49:0/1724458111 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56204a8c5db0 con 0x56204a564cd0 2024-09-21T06:43:04.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.753+0000 7f8eaffff640 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56204a564cd0 0x56204a96b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.754+0000 7f8eaffff640 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56204a564cd0 0x56204a96b440 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29640789a6c63800 server_cookie=3ded2b8b43d7bba5 in_seq=0 out_seq=0 2024-09-21T06:43:04.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.754+0000 7f8e9e7fc640 10 client.17106 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:04.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/1724458111 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56204a8c5db0 con 0x56204a564cd0 2024-09-21T06:43:04.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8e9e7fc640 10 client.17106 handle_command_reply: tid=0 2024-09-21T06:43:04.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 client.17106 shutdown 2024-09-21T06:43:04.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 -- 172.21.15.49:0/1724458111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a57d490 msgr2=0x56204a959030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:04.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a57d490 0x56204a959030 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8032fd0 tx=0x7f8ea8009260 comp rx=0 tx=0).stop 2024-09-21T06:43:04.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 -- 172.21.15.49:0/1724458111 shutdown_connections 2024-09-21T06:43:04.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56204a564cd0 0x56204a96b440 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a5a6350 0x56204a964f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8e9e7fc640 0 client.17106 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:04.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 0x56204a9595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/1724458111 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a57d490 0x56204a959030 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 -- 172.21.15.49:0/1724458111 >> 172.21.15.49:0/1724458111 conn(0x56204a59a740 msgr2=0x56204a950610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:04.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 -- 172.21.15.49:0/1724458111 shutdown_connections 2024-09-21T06:43:04.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 1 -- 172.21.15.49:0/1724458111 wait complete. 2024-09-21T06:43:04.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.755+0000 7f8ec3c25740 20 client.17106 trim_cache size 0 max 16384 2024-09-21T06:43:04.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8ec3c25740 1 Processor -- start 2024-09-21T06:43:04.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8ec3c25740 1 -- start start 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a959680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a57d490 0x56204a94eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 0x56204a952510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b4430 con 0x56204a564cd0 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b1d00 con 0x56204a57d490 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81afb70 con 0x56204a585670 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a959680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a959680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60152/0 (socket says 172.21.15.49:60152) 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.773+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/2234159184 learned_addr learned my addr 172.21.15.49:0/2234159184 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:04.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eb77fe640 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 0x56204a952510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eaffff640 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a57d490 0x56204a94eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/2234159184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 msgr2=0x56204a952510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 0x56204a952510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/2234159184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a57d490 msgr2=0x56204a94eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a57d490 0x56204a94eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/2234159184 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56204a94e240 con 0x56204a564cd0 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eaffff640 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a57d490 0x56204a94eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a959680 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009230 tx=0x7f8ea8031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedb5e328ca076c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eacff9640 1 -- 172.21.15.49:0/2234159184 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea805d070 con 0x56204a564cd0 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eacff9640 1 -- 172.21.15.49:0/2234159184 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea8048640 con 0x56204a564cd0 2024-09-21T06:43:04.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.774+0000 7f8eacff9640 1 -- 172.21.15.49:0/2234159184 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea804c070 con 0x56204a564cd0 2024-09-21T06:43:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 -- 172.21.15.49:0/2234159184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 msgr2=0x56204a959680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a959680 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009230 tx=0x7f8ea8031a10 comp rx=0 tx=0).stop 2024-09-21T06:43:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 -- 172.21.15.49:0/2234159184 shutdown_connections 2024-09-21T06:43:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a585670 0x56204a952510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a57d490 0x56204a94eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/2234159184 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a959680 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 -- 172.21.15.49:0/2234159184 >> 172.21.15.49:0/2234159184 conn(0x56204a59a740 msgr2=0x56204a94e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:04.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 -- 172.21.15.49:0/2234159184 shutdown_connections 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 -- 172.21.15.49:0/2234159184 wait complete. 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.775+0000 7f8ec3c25740 1 -- start start 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8ec3c25740 1 Processor -- start 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a95d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 0x56204a95dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8ec3c25740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a585670 0x56204a9d4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b01c0 con 0x56204a564cd0 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b1630 con 0x56204a585670 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8ec3c25740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b0890 con 0x56204a57d490 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8ec3c25740 10 client.0 _ll_register_callbacks cb 0x7f8ea0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a95d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a95d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:60166/0 (socket says 172.21.15.49:60166) 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/3280669093 learned_addr learned my addr 172.21.15.49:0/3280669093 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:04.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eaffff640 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 0x56204a95dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb77fe640 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a585670 0x56204a9d4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/3280669093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 msgr2=0x56204a95dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 0x56204a95dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/3280669093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a585670 msgr2=0x56204a9d4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a585670 0x56204a9d4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb6ffd640 1 -- 172.21.15.49:0/3280669093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56204a9d5410 con 0x56204a564cd0 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.776+0000 7f8eb77fe640 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a585670 0x56204a9d4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8eb6ffd640 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a95d630 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8048b90 tx=0x7f8ea8048a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e34eeced1825c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8e9e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/3280669093 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea804c070 con 0x56204a564cd0 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/3280669093 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8638+0+0 (secure 0 0 0) 0x7f8ea8003a00 con 0x56204a564cd0 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3280669093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ea8048640 con 0x56204a564cd0 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/3280669093 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8ea8071050 con 0x56204a564cd0 2024-09-21T06:43:04.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8ec3c25740 10 client.17112 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3280669093 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56204a9d6640 con 0x56204a564cd0 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/3280669093 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea8048640 con 0x56204a564cd0 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/3280669093 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8ea8059450 con 0x56204a564cd0 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8ec3c25740 10 client.17112 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8ec3c25740 10 client.17112 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8ec3c25740 20 client.17112 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56204a5a6350 0x56204a9d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8ec3c25740 4 client.17112 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.777+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3280669093 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56204a8c1860 con 0x56204a5a6350 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.778+0000 7f8eaffff640 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56204a5a6350 0x56204a9d8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.778+0000 7f8e9e7fc640 10 client.17112 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:04.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.778+0000 7f8eaffff640 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56204a5a6350 0x56204a9d8d60 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be235cf00ecabf3f server_cookie=574198dfca3544b in_seq=0 out_seq=0 2024-09-21T06:43:04.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8e9e7fc640 1 -- 172.21.15.49:0/3280669093 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56204a8c1860 con 0x56204a5a6350 2024-09-21T06:43:04.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8e9e7fc640 10 client.17112 handle_command_reply: tid=0 2024-09-21T06:43:04.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8ec3c25740 1 client.17112 shutdown 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3280669093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 msgr2=0x56204a95d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a95d630 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8048b90 tx=0x7f8ea8048a20 comp rx=0 tx=0).stop 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3280669093 shutdown_connections 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56204a5a6350 0x56204a9d8d60 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56204a585670 0x56204a9d4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56204a57d490 0x56204a95dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8e9e7fc640 0 client.17112 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8ec3c25740 1 --2- 172.21.15.49:0/3280669093 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56204a564cd0 0x56204a95d630 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.780+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3280669093 >> 172.21.15.49:0/3280669093 conn(0x56204a59a740 msgr2=0x56204a95a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3280669093 shutdown_connections 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ec3c25740 1 -- 172.21.15.49:0/3280669093 wait complete. 2024-09-21T06:43:04.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ec3c25740 20 client.17112 trim_cache size 0 max 16384 2024-09-21T06:43:04.787 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:43:04.787 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:43:04.787 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2", 2024-09-21T06:43:04.787 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:43:04.787 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ea40b6700 msgr2=0x7f8ea40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ea40b6700 0x7f8ea40b8c10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8000c00 tx=0x7f8ea8005a20 comp rx=0 tx=0).stop 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb810ddf0 msgr2=0x7f8eb81a1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb810ddf0 0x7f8eb81a1f60 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000eb10 tx=0x7f8eb000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/3920384499 shutdown_connections 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8ea40b6700 0x7f8ea40b8c10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8eb810ddf0 0x7f8eb81a1f60 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8eb8105270 0x7f8eb819ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 --2- 172.21.15.49:0/3920384499 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8eb8104840 0x7f8eb819c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/3920384499 >> 172.21.15.49:0/3920384499 conn(0x7f8eb8079730 msgr2=0x7f8eb80ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/3920384499 shutdown_connections 2024-09-21T06:43:04.788 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:04.781+0000 7f8ebd6b1640 1 -- 172.21.15.49:0/3920384499 wait complete. 2024-09-21T06:43:04.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:04 smithi049 ceph-mon[31177]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:43:05.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:04 smithi098 ceph-mon[34704]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:43:05.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:04 smithi079 ceph-mon[34346]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:43:05.493 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:43:05.757 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:06.027 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:05 smithi049 ceph-mon[31177]: pgmap v513: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 75 KiB/s wr, 33 op/s 2024-09-21T06:43:06.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:05 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:43:06.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:05 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:06.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:05 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:43:06.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:05 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:43:06.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:05 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:06.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:05 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:06.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:05 smithi098 ceph-mon[34704]: pgmap v513: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 75 KiB/s wr, 33 op/s 2024-09-21T06:43:06.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:05 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:43:06.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:05 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:06.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:05 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:43:06.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:05 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:43:06.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:05 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:06.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:05 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:06.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:05 smithi079 ceph-mon[34346]: pgmap v513: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 75 KiB/s wr, 33 op/s 2024-09-21T06:43:06.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:05 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:43:06.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:05 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:06.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:05 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:43:06.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:05 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:43:06.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:05 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:06.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:05 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:06.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.257+0000 7f3313fdd640 1 -- 172.21.15.49:0/762183989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 msgr2=0x7f330c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.257+0000 7f3313fdd640 1 --2- 172.21.15.49:0/762183989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 0x7f330c1098c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f32fc009900 tx=0x7f32fc02a410 comp rx=0 tx=0).stop 2024-09-21T06:43:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.258+0000 7f3313fdd640 1 -- 172.21.15.49:0/762183989 shutdown_connections 2024-09-21T06:43:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.258+0000 7f3313fdd640 1 --2- 172.21.15.49:0/762183989 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c109e00 0x7f330c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.258+0000 7f3313fdd640 1 --2- 172.21.15.49:0/762183989 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 0x7f330c1098c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.258+0000 7f3313fdd640 1 --2- 172.21.15.49:0/762183989 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330c103bc0 0x7f330c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.258+0000 7f3313fdd640 1 -- 172.21.15.49:0/762183989 >> 172.21.15.49:0/762183989 conn(0x7f330c07b910 msgr2=0x7f330c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.258+0000 7f3313fdd640 1 -- 172.21.15.49:0/762183989 shutdown_connections 2024-09-21T06:43:06.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.258+0000 7f3313fdd640 1 -- 172.21.15.49:0/762183989 wait complete. 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.258+0000 7f3313fdd640 1 Processor -- start 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.258+0000 7f3313fdd640 1 -- start start 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3313fdd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330c103bc0 0x7f330c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3313fdd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 0x7f330c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3313fdd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c109e00 0x7f330c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3313fdd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f330c113ac0 con 0x7f330c1094b0 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3313fdd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f330c113940 con 0x7f330c109e00 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3313fdd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f330c113c40 con 0x7f330c103bc0 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311578640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 0x7f330c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311578640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 0x7f330c19aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35560/0 (socket says 172.21.15.49:35560) 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311578640 1 -- 172.21.15.49:0/1365265107 learned_addr learned my addr 172.21.15.49:0/1365265107 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:06.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f331257a640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c109e00 0x7f330c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311d79640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330c103bc0 0x7f330c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311578640 1 -- 172.21.15.49:0/1365265107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330c103bc0 msgr2=0x7f330c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311578640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330c103bc0 0x7f330c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311578640 1 -- 172.21.15.49:0/1365265107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c109e00 msgr2=0x7f330c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311578640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c109e00 0x7f330c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311578640 1 -- 172.21.15.49:0/1365265107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f330c1a0440 con 0x7f330c1094b0 2024-09-21T06:43:06.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f331257a640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c109e00 0x7f330c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.259+0000 7f3311578640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 0x7f330c19aa70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f32fc02a930 tx=0x7f32fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.260+0000 7f3302ffd640 1 -- 172.21.15.49:0/1365265107 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc03f030 con 0x7f330c1094b0 2024-09-21T06:43:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.260+0000 7f3302ffd640 1 -- 172.21.15.49:0/1365265107 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32fc003aa0 con 0x7f330c1094b0 2024-09-21T06:43:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.260+0000 7f3313fdd640 1 -- 172.21.15.49:0/1365265107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f330c1a06d0 con 0x7f330c1094b0 2024-09-21T06:43:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.260+0000 7f3302ffd640 1 -- 172.21.15.49:0/1365265107 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc035070 con 0x7f330c1094b0 2024-09-21T06:43:06.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.260+0000 7f3313fdd640 1 -- 172.21.15.49:0/1365265107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f330c1a6e90 con 0x7f330c1094b0 2024-09-21T06:43:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.262+0000 7f331a551740 1 Processor -- start 2024-09-21T06:43:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.262+0000 7f331a551740 1 -- start start 2024-09-21T06:43:06.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3302ffd640 1 -- 172.21.15.49:0/1365265107 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f32fc042030 con 0x7f330c1094b0 2024-09-21T06:43:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f331a551740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 0x562a7781c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f331a551740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7781c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f331a551740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 0x562a7781ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f331a551740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562a77792e50 con 0x562a7744c1b0 2024-09-21T06:43:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f331a551740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562a77782280 con 0x562a77475070 2024-09-21T06:43:06.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f331a551740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a77786090 con 0x562a77454390 2024-09-21T06:43:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3311d79640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7781c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3311d79640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7781c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35564/0 (socket says 172.21.15.49:35564) 2024-09-21T06:43:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3311d79640 1 -- 172.21.15.49:0/4112461342 learned_addr learned my addr 172.21.15.49:0/4112461342 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f331257a640 1 --2- 172.21.15.49:0/4112461342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 0x562a7781c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3311578640 1 --2- 172.21.15.49:0/4112461342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 0x562a7781ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3311d79640 1 -- 172.21.15.49:0/4112461342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 msgr2=0x562a7781ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:06.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3311d79640 1 --2- 172.21.15.49:0/4112461342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 0x562a7781ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3311d79640 1 -- 172.21.15.49:0/4112461342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 msgr2=0x562a7781c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3311d79640 1 --2- 172.21.15.49:0/4112461342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 0x562a7781c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.263+0000 7f3311d79640 1 -- 172.21.15.49:0/4112461342 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a774e0650 con 0x562a7744c1b0 2024-09-21T06:43:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.264+0000 7f3311d79640 1 --2- 172.21.15.49:0/4112461342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7781c7b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f330800bcf0 tx=0x7f330800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32de1d9cdd5c9ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.264+0000 7f3302ffd640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f32f80b6700 0x7f32f80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.264+0000 7f32f7fff640 1 -- 172.21.15.49:0/4112461342 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308015070 con 0x562a7744c1b0 2024-09-21T06:43:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.264+0000 7f32f7fff640 1 -- 172.21.15.49:0/4112461342 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f330801a910 con 0x562a7744c1b0 2024-09-21T06:43:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.264+0000 7f32f7fff640 1 -- 172.21.15.49:0/4112461342 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33080119a0 con 0x562a7744c1b0 2024-09-21T06:43:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.264+0000 7f331257a640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f32f80b6700 0x7f32f80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.264+0000 7f3302ffd640 1 -- 172.21.15.49:0/1365265107 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8638+0+0 (secure 0 0 0) 0x7f32fc107ed0 con 0x7f330c1094b0 2024-09-21T06:43:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 -- 172.21.15.49:0/4112461342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 msgr2=0x562a7781c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331257a640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f32f80b6700 0x7f32f80b8c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f330400af80 tx=0x7f330400a730 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:06.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 --2- 172.21.15.49:0/4112461342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7781c7b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f330800bcf0 tx=0x7f330800f730 comp rx=0 tx=0).stop 2024-09-21T06:43:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 -- 172.21.15.49:0/4112461342 shutdown_connections 2024-09-21T06:43:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 --2- 172.21.15.49:0/4112461342 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 0x562a7781ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 --2- 172.21.15.49:0/4112461342 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7781c7b0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 --2- 172.21.15.49:0/4112461342 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 0x562a7781c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 -- 172.21.15.49:0/4112461342 >> 172.21.15.49:0/4112461342 conn(0x562a77469460 msgr2=0x562a7781a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 -- 172.21.15.49:0/4112461342 shutdown_connections 2024-09-21T06:43:06.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 -- 172.21.15.49:0/4112461342 wait complete. 2024-09-21T06:43:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 -- start start 2024-09-21T06:43:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.265+0000 7f331a551740 1 Processor -- start 2024-09-21T06:43:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f331a551740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 0x562a77827930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f331a551740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a77454390 0x562a77827e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f331a551740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 0x562a77833d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f331a551740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562a775e3700 con 0x562a77454390 2024-09-21T06:43:06.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f331a551740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562a7771d110 con 0x562a77475070 2024-09-21T06:43:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f331a551740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a7782aa50 con 0x562a7744c1b0 2024-09-21T06:43:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f331a551740 10 client.0 _ll_register_callbacks cb 0x562a77736990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f3311578640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a77454390 0x562a77827e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f3311578640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a77454390 0x562a77827e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35568/0 (socket says 172.21.15.49:35568) 2024-09-21T06:43:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f3311578640 1 -- 172.21.15.49:0/1888806669 learned_addr learned my addr 172.21.15.49:0/1888806669 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f3311d79640 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 0x562a77827930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.266+0000 7f331257a640 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 0x562a77833d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f3311578640 1 -- 172.21.15.49:0/1888806669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 msgr2=0x562a77827930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:06.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f3311578640 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 0x562a77827930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f3311578640 1 -- 172.21.15.49:0/1888806669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 msgr2=0x562a77833d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:06.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f3311578640 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 0x562a77833d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f3311578640 1 -- 172.21.15.49:0/1888806669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a7774ac40 con 0x562a77454390 2024-09-21T06:43:06.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f331257a640 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 0x562a77833d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:06.282 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f3311578640 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a77454390 0x562a77827e70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f32fc105610 tx=0x7f32fc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6630901a63fcb54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:06.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f32f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:06.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f32f57fa640 1 -- 172.21.15.49:0/1888806669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc049070 con 0x562a77454390 2024-09-21T06:43:06.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f32f57fa640 1 -- 172.21.15.49:0/1888806669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8638+0+0 (secure 0 0 0) 0x7f32fc105830 con 0x562a77454390 2024-09-21T06:43:06.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f331a551740 1 -- 172.21.15.49:0/1888806669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f330801a910 con 0x562a77454390 2024-09-21T06:43:06.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f32f57fa640 1 -- 172.21.15.49:0/1888806669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32fc0c9b50 con 0x562a77454390 2024-09-21T06:43:06.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f331a551740 10 client.17124 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:06.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f331a551740 1 -- 172.21.15.49:0/1888806669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562a77836730 con 0x562a77454390 2024-09-21T06:43:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.267+0000 7f32f57fa640 1 -- 172.21.15.49:0/1888806669 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f330801a910 con 0x562a77454390 2024-09-21T06:43:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.268+0000 7f32f57fa640 1 -- 172.21.15.49:0/1888806669 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f32fc0f1110 con 0x562a77454390 2024-09-21T06:43:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.268+0000 7f331a551740 10 client.17124 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.268+0000 7f331a551740 10 client.17124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.268+0000 7f331a551740 20 client.17124 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.268+0000 7f331a551740 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a774339f0 0x562a77839cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.268+0000 7f331a551740 4 client.17124 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.268+0000 7f331a551740 1 -- 172.21.15.49:0/1888806669 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a77794da0 con 0x562a774339f0 2024-09-21T06:43:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.268+0000 7f3311d79640 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a774339f0 0x562a77839cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.269+0000 7f3311d79640 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a774339f0 0x562a77839cd0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a796ff40b646833d server_cookie=572cc90b1dd41e32 in_seq=0 out_seq=0 2024-09-21T06:43:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.269+0000 7f32f57fa640 10 client.17124 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.269+0000 7f32f57fa640 1 -- 172.21.15.49:0/1888806669 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a77794da0 con 0x562a774339f0 2024-09-21T06:43:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.269+0000 7f32f57fa640 10 client.17124 handle_command_reply: tid=0 2024-09-21T06:43:06.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.269+0000 7f331a551740 1 client.17124 shutdown 2024-09-21T06:43:06.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.269+0000 7f331a551740 1 -- 172.21.15.49:0/1888806669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a77454390 msgr2=0x562a77827e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:06.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.269+0000 7f331a551740 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a77454390 0x562a77827e70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f32fc105610 tx=0x7f32fc02a410 comp rx=0 tx=0).stop 2024-09-21T06:43:06.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f331a551740 1 -- 172.21.15.49:0/1888806669 shutdown_connections 2024-09-21T06:43:06.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f331a551740 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a774339f0 0x562a77839cd0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f331a551740 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77475070 0x562a77833d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f331a551740 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a77454390 0x562a77827e70 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f32f57fa640 0 client.17124 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:06.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f331a551740 1 --2- 172.21.15.49:0/1888806669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 0x562a77827930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f331a551740 1 -- 172.21.15.49:0/1888806669 >> 172.21.15.49:0/1888806669 conn(0x562a77469460 msgr2=0x562a7781f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:06.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f331a551740 1 -- 172.21.15.49:0/1888806669 shutdown_connections 2024-09-21T06:43:06.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f331a551740 1 -- 172.21.15.49:0/1888806669 wait complete. 2024-09-21T06:43:06.287 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.270+0000 7f331a551740 20 client.17124 trim_cache size 0 max 16384 2024-09-21T06:43:06.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.287+0000 7f331a551740 1 Processor -- start 2024-09-21T06:43:06.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.287+0000 7f331a551740 1 -- start start 2024-09-21T06:43:06.297 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.287+0000 7f331a551740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a774339f0 0x562a7781dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.287+0000 7f331a551740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 0x562a77829560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f331a551740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77454390 0x562a77833c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f331a551740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1b43a0 con 0x562a774339f0 2024-09-21T06:43:06.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f331a551740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1b1c70 con 0x562a77454390 2024-09-21T06:43:06.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f331a551740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1afae0 con 0x562a7744c1b0 2024-09-21T06:43:06.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311d79640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a774339f0 0x562a7781dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311d79640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a774339f0 0x562a7781dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35576/0 (socket says 172.21.15.49:35576) 2024-09-21T06:43:06.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311d79640 1 -- 172.21.15.49:0/3696118185 learned_addr learned my addr 172.21.15.49:0/3696118185 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:06.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f331257a640 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77454390 0x562a77833c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311578640 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 0x562a77829560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311d79640 1 -- 172.21.15.49:0/3696118185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 msgr2=0x562a77829560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:06.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311d79640 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 0x562a77829560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311d79640 1 -- 172.21.15.49:0/3696118185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77454390 msgr2=0x562a77833c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:06.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311d79640 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77454390 0x562a77833c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311d79640 1 -- 172.21.15.49:0/3696118185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a7781af20 con 0x562a774339f0 2024-09-21T06:43:06.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311578640 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 0x562a77829560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:06.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f3311d79640 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a774339f0 0x562a7781dc60 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3308011590 tx=0x7f330800b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d68332a1256c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:06.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f32f77fe640 1 -- 172.21.15.49:0/3696118185 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3308015070 con 0x562a774339f0 2024-09-21T06:43:06.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f32f77fe640 1 -- 172.21.15.49:0/3696118185 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33080116b0 con 0x562a774339f0 2024-09-21T06:43:06.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.288+0000 7f32f77fe640 1 -- 172.21.15.49:0/3696118185 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33080048e0 con 0x562a774339f0 2024-09-21T06:43:06.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.289+0000 7f331a551740 1 -- 172.21.15.49:0/3696118185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a774339f0 msgr2=0x562a7781dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:06.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.289+0000 7f331a551740 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a774339f0 0x562a7781dc60 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3308011590 tx=0x7f330800b5e0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.289+0000 7f331a551740 1 -- 172.21.15.49:0/3696118185 shutdown_connections 2024-09-21T06:43:06.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.289+0000 7f331a551740 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a77454390 0x562a77833c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.289+0000 7f331a551740 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a7744c1b0 0x562a77829560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.289+0000 7f331a551740 1 --2- 172.21.15.49:0/3696118185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a774339f0 0x562a7781dc60 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.289+0000 7f331a551740 1 -- 172.21.15.49:0/3696118185 >> 172.21.15.49:0/3696118185 conn(0x562a77469460 msgr2=0x562a77828e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:06.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.289+0000 7f331a551740 1 -- 172.21.15.49:0/3696118185 shutdown_connections 2024-09-21T06:43:06.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.289+0000 7f331a551740 1 -- 172.21.15.49:0/3696118185 wait complete. 2024-09-21T06:43:06.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.290+0000 7f331a551740 1 -- start start 2024-09-21T06:43:06.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.290+0000 7f331a551740 1 Processor -- start 2024-09-21T06:43:06.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.290+0000 7f331a551740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a774339f0 0x562a7782bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.290+0000 7f331a551740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7782c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.290+0000 7f331a551740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 0x562a7782c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.290+0000 7f331a551740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1b0130 con 0x562a7744c1b0 2024-09-21T06:43:06.302 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.290+0000 7f331a551740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1b15a0 con 0x562a774339f0 2024-09-21T06:43:06.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.290+0000 7f331a551740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f330c1b0800 con 0x562a77454390 2024-09-21T06:43:06.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f331a551740 10 client.0 _ll_register_callbacks cb 0x7f32fc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:06.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311578640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7782c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311578640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7782c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:35584/0 (socket says 172.21.15.49:35584) 2024-09-21T06:43:06.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311578640 1 -- 172.21.15.49:0/3824733801 learned_addr learned my addr 172.21.15.49:0/3824733801 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:06.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311d79640 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a774339f0 0x562a7782bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f331257a640 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 0x562a7782c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311578640 1 -- 172.21.15.49:0/3824733801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 msgr2=0x562a7782c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:06.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311578640 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 0x562a7782c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311578640 1 -- 172.21.15.49:0/3824733801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a774339f0 msgr2=0x562a7782bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:06.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311578640 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a774339f0 0x562a7782bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311578640 1 -- 172.21.15.49:0/3824733801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a778a36e0 con 0x562a7744c1b0 2024-09-21T06:43:06.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f3311578640 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7782c240 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0f14e0 tx=0x7f32fc009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e26bb1ea8f46b8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:06.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f32f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:06.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f32f57fa640 1 -- 172.21.15.49:0/3824733801 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32fc049070 con 0x562a7744c1b0 2024-09-21T06:43:06.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f32f57fa640 1 -- 172.21.15.49:0/3824733801 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8638+0+0 (secure 0 0 0) 0x7f32fc0d7440 con 0x562a7744c1b0 2024-09-21T06:43:06.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.291+0000 7f331a551740 1 -- 172.21.15.49:0/3824733801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33080116b0 con 0x562a7744c1b0 2024-09-21T06:43:06.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f32f57fa640 1 -- 172.21.15.49:0/3824733801 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f32fc0c9420 con 0x562a7744c1b0 2024-09-21T06:43:06.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f331a551740 10 client.17130 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:06.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f331a551740 1 -- 172.21.15.49:0/3824733801 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562a778a48e0 con 0x562a7744c1b0 2024-09-21T06:43:06.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f32f57fa640 1 -- 172.21.15.49:0/3824733801 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33080116b0 con 0x562a7744c1b0 2024-09-21T06:43:06.305 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f32f57fa640 1 -- 172.21.15.49:0/3824733801 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f32fc10bce0 con 0x562a7744c1b0 2024-09-21T06:43:06.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f331a551740 10 client.17130 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:06.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f331a551740 10 client.17130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:06.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f331a551740 20 client.17130 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:06.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f331a551740 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a77475070 0x562a778a6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:06.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f331a551740 4 client.17130 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:43:06.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f331a551740 1 -- 172.21.15.49:0/3824733801 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562a77790850 con 0x562a77475070 2024-09-21T06:43:06.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.292+0000 7f3311d79640 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a77475070 0x562a778a6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:06.306 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f3311d79640 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a77475070 0x562a778a6e70 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35e0a02184e028bf server_cookie=9634d689f5110782 in_seq=0 out_seq=0 2024-09-21T06:43:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f32f57fa640 10 client.17130 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f32f57fa640 1 -- 172.21.15.49:0/3824733801 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x562a77790850 con 0x562a77475070 2024-09-21T06:43:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f32f57fa640 10 client.17130 handle_command_reply: tid=0 2024-09-21T06:43:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f331a551740 1 client.17130 shutdown 2024-09-21T06:43:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f331a551740 1 -- 172.21.15.49:0/3824733801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 msgr2=0x562a7782c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f331a551740 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7782c240 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f32fc0f14e0 tx=0x7f32fc009680 comp rx=0 tx=0).stop 2024-09-21T06:43:06.307 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f331a551740 1 -- 172.21.15.49:0/3824733801 shutdown_connections 2024-09-21T06:43:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f331a551740 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a77475070 0x562a778a6e70 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f331a551740 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a77454390 0x562a7782c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f331a551740 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a7744c1b0 0x562a7782c240 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f32f57fa640 0 client.17130 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f331a551740 1 --2- 172.21.15.49:0/3824733801 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a774339f0 0x562a7782bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.293+0000 7f331a551740 1 -- 172.21.15.49:0/3824733801 >> 172.21.15.49:0/3824733801 conn(0x562a77469460 msgr2=0x562a7781da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:06.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.294+0000 7f331a551740 1 -- 172.21.15.49:0/3824733801 shutdown_connections 2024-09-21T06:43:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.294+0000 7f331a551740 1 -- 172.21.15.49:0/3824733801 wait complete. 2024-09-21T06:43:06.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.294+0000 7f331a551740 20 client.17130 trim_cache size 0 max 16384 2024-09-21T06:43:06.309 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:43:06.309 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:43:06.309 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:43:06.310 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:43:06.310 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.310 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2", 2024-09-21T06:43:06.310 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:43:06.310 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:43:06.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.310 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:43:06.310 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:43:06.311 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:43:06.311 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.312 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:43:06.312 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:43:06.312 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.313 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:43:06.313 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:43:06.313 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.314 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.314 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.314 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:43:06.314 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:43:06.314 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.314 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.314 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.315 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.315 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.315 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.315 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:43:06.315 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:43:06.315 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.315 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.315 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.316 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.316 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.316 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.316 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:43:06.316 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:43:06.316 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.316 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.317 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.317 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.317 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.317 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.317 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:43:06.317 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:43:06.317 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.318 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.318 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.318 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.318 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.318 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.318 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:43:06.318 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:43:06.319 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.319 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.319 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.319 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.319 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.319 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.320 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:43:06.320 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:43:06.320 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.321 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:43:06.321 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:43:06.321 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.322 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:06.322 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:43:06.322 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:43:06.322 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:06.322 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:06.322 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:06.323 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:06.323 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:06.323 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:43:06.323 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:43:06.323 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:43:06.324 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.294+0000 7f3313fdd640 1 -- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f32f80b6700 msgr2=0x7f32f80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.294+0000 7f3313fdd640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f32f80b6700 0x7f32f80b8c10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f330400af80 tx=0x7f330400a730 comp rx=0 tx=0).stop 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.294+0000 7f3313fdd640 1 -- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 msgr2=0x7f330c19aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.294+0000 7f3313fdd640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 0x7f330c19aa70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f32fc02a930 tx=0x7f32fc004270 comp rx=0 tx=0).stop 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.295+0000 7f3313fdd640 1 -- 172.21.15.49:0/1365265107 shutdown_connections 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.295+0000 7f3313fdd640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f32f80b6700 0x7f32f80b8c10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.295+0000 7f3313fdd640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f330c109e00 0x7f330c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.295+0000 7f3313fdd640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f330c1094b0 0x7f330c19aa70 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.295+0000 7f3313fdd640 1 --2- 172.21.15.49:0/1365265107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f330c103bc0 0x7f330c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.295+0000 7f3313fdd640 1 -- 172.21.15.49:0/1365265107 >> 172.21.15.49:0/1365265107 conn(0x7f330c07b910 msgr2=0x7f330c105580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.295+0000 7f3313fdd640 1 -- 172.21.15.49:0/1365265107 shutdown_connections 2024-09-21T06:43:06.325 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:06.295+0000 7f3313fdd640 1 -- 172.21.15.49:0/1365265107 wait complete. 2024-09-21T06:43:06.928 INFO:tasks.cephfs.filesystem:scrub status for tag:57389ff9-c679-4ffc-8f1d-b3dd121a6ba2 - {'path': '/', 'tag': '57389ff9-c679-4ffc-8f1d-b3dd121a6ba2', 'options': 'recursive,force'} 2024-09-21T06:43:08.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:07 smithi098 ceph-mon[34704]: pgmap v514: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 80 KiB/s wr, 34 op/s 2024-09-21T06:43:08.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:07 smithi079 ceph-mon[34346]: pgmap v514: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 80 KiB/s wr, 34 op/s 2024-09-21T06:43:08.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:07 smithi049 ceph-mon[31177]: pgmap v514: 97 pgs: 97 active+clean; 6.0 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 80 KiB/s wr, 34 op/s 2024-09-21T06:43:10.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:09 smithi049 ceph-mon[31177]: pgmap v515: 97 pgs: 97 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 36 op/s 2024-09-21T06:43:10.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:09 smithi098 ceph-mon[34704]: pgmap v515: 97 pgs: 97 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 36 op/s 2024-09-21T06:43:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:09 smithi079 ceph-mon[34346]: pgmap v515: 97 pgs: 97 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 36 op/s 2024-09-21T06:43:12.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:11 smithi098 ceph-mon[34704]: pgmap v516: 97 pgs: 97 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 36 op/s 2024-09-21T06:43:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:11 smithi079 ceph-mon[34346]: pgmap v516: 97 pgs: 97 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 36 op/s 2024-09-21T06:43:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:11 smithi049 ceph-mon[31177]: pgmap v516: 97 pgs: 97 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 36 op/s 2024-09-21T06:43:14.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:13 smithi098 ceph-mon[34704]: pgmap v517: 97 pgs: 97 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 80 KiB/s wr, 35 op/s 2024-09-21T06:43:14.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:13 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:43:14.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:13 smithi098 ceph-mon[34704]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:43:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:13 smithi079 ceph-mon[34346]: pgmap v517: 97 pgs: 97 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 80 KiB/s wr, 35 op/s 2024-09-21T06:43:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:13 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:43:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:13 smithi079 ceph-mon[34346]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:43:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:13 smithi049 ceph-mon[31177]: pgmap v517: 97 pgs: 97 active+clean; 6.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 80 KiB/s wr, 35 op/s 2024-09-21T06:43:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:13 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:43:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:13 smithi049 ceph-mon[31177]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:43:15.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:14 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:43:15.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:14 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:43:15.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:14 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:43:16.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:15 smithi098 ceph-mon[34704]: pgmap v519: 97 pgs: 97 active+clean; 6.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:43:16.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:15 smithi079 ceph-mon[34346]: pgmap v519: 97 pgs: 97 active+clean; 6.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:43:16.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:15 smithi049 ceph-mon[31177]: pgmap v519: 97 pgs: 97 active+clean; 6.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 14 op/s 2024-09-21T06:43:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.683+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2064567264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e141052a0 msgr2=0x7f2e1410d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.683+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2064567264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e141052a0 0x7f2e1410d7e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009900 tx=0x7f2e0802a410 comp rx=0 tx=0).stop 2024-09-21T06:43:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.683+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2064567264 shutdown_connections 2024-09-21T06:43:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.683+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2064567264 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e1410ddb0 0x7f2e141102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.683+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2064567264 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e141052a0 0x7f2e1410d7e0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.683+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2064567264 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e14104950 0x7f2e14104d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.683+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2064567264 >> 172.21.15.49:0/2064567264 conn(0x7f2e1407a710 msgr2=0x7f2e1407ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.683+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2064567264 shutdown_connections 2024-09-21T06:43:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.683+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2064567264 wait complete. 2024-09-21T06:43:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.684+0000 7f2e19a8b640 1 Processor -- start 2024-09-21T06:43:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.684+0000 7f2e19a8b640 1 -- start start 2024-09-21T06:43:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e19a8b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e14104950 0x7f2e1419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e19a8b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e141052a0 0x7f2e1419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e19a8b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1410ddb0 0x7f2e1419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e19a8b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14113a10 con 0x7f2e14104950 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e19a8b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14113890 con 0x7f2e141052a0 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e19a8b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2e14113b90 con 0x7f2e1410ddb0 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e14104950 0x7f2e1419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e14104950 0x7f2e1419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58246/0 (socket says 172.21.15.49:58246) 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e137fe640 1 -- 172.21.15.49:0/2950553185 learned_addr learned my addr 172.21.15.49:0/2950553185 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e141052a0 0x7f2e1419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e13fff640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1410ddb0 0x7f2e1419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e137fe640 1 -- 172.21.15.49:0/2950553185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1410ddb0 msgr2=0x7f2e1419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e137fe640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1410ddb0 0x7f2e1419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e137fe640 1 -- 172.21.15.49:0/2950553185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e141052a0 msgr2=0x7f2e1419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e137fe640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e141052a0 0x7f2e1419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e137fe640 1 -- 172.21.15.49:0/2950553185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e141a0340 con 0x7f2e14104950 2024-09-21T06:43:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.685+0000 7f2e137fe640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e14104950 0x7f2e1419a410 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400e9f0 tx=0x7f2e0400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.686+0000 7f2e10ff9640 1 -- 172.21.15.49:0/2950553185 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400cd80 con 0x7f2e14104950 2024-09-21T06:43:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.686+0000 7f2e10ff9640 1 -- 172.21.15.49:0/2950553185 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e040054d0 con 0x7f2e14104950 2024-09-21T06:43:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.686+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2950553185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e141a0630 con 0x7f2e14104950 2024-09-21T06:43:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.686+0000 7f2e10ff9640 1 -- 172.21.15.49:0/2950553185 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e04010690 con 0x7f2e14104950 2024-09-21T06:43:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.686+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2950553185 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e141a6dc0 con 0x7f2e14104950 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.688+0000 7f2e209fe740 1 Processor -- start 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.688+0000 7f2e209fe740 1 -- start start 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.688+0000 7f2e10ff9640 1 -- 172.21.15.49:0/2950553185 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2e04004e90 con 0x7f2e14104950 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99e91b0 0x5578e9d8e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9d8eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9d8f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e209fe740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5578e9d036f0 con 0x5578e99c02f0 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e209fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5578e9cf2b20 con 0x5578e99c84d0 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e209fe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5578e9cf6930 con 0x5578e99e91b0 2024-09-21T06:43:16.693 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9d8eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9d8eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58250/0 (socket says 172.21.15.49:58250) 2024-09-21T06:43:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e137fe640 1 -- 172.21.15.49:0/4132168080 learned_addr learned my addr 172.21.15.49:0/4132168080 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e13fff640 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99e91b0 0x5578e9d8e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9d8f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e137fe640 1 -- 172.21.15.49:0/4132168080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99e91b0 msgr2=0x5578e9d8e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:16.694 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e137fe640 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99e91b0 0x5578e9d8e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e137fe640 1 -- 172.21.15.49:0/4132168080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 msgr2=0x5578e9d8f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e137fe640 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9d8f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e137fe640 1 -- 172.21.15.49:0/4132168080 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e9cb8530 con 0x5578e99c02f0 2024-09-21T06:43:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e13fff640 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99e91b0 0x5578e9d8e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e10ff9640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2dfc0b6680 0x7f2dfc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.689+0000 7f2e137fe640 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9d8eef0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f2e040e5260 tx=0x7f2e040ebd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ceef7d3061f212 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.690+0000 7f2e13fff640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2dfc0b6680 0x7f2dfc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.690+0000 7f2df9ffb640 1 -- 172.21.15.49:0/4132168080 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e040aa040 con 0x5578e99c02f0 2024-09-21T06:43:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.690+0000 7f2e10ff9640 1 -- 172.21.15.49:0/2950553185 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f2e040e7bf0 con 0x7f2e14104950 2024-09-21T06:43:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.690+0000 7f2df9ffb640 1 -- 172.21.15.49:0/4132168080 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e040ad500 con 0x5578e99c02f0 2024-09-21T06:43:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.690+0000 7f2df9ffb640 1 -- 172.21.15.49:0/4132168080 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e040d0c90 con 0x5578e99c02f0 2024-09-21T06:43:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e13fff640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2dfc0b6680 0x7f2dfc0b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c005fd0 tx=0x7f2e0c009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 -- 172.21.15.49:0/4132168080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 msgr2=0x5578e9d8eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9d8eef0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f2e040e5260 tx=0x7f2e040ebd30 comp rx=0 tx=0).stop 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 -- 172.21.15.49:0/4132168080 shutdown_connections 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9d8f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9d8eef0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 --2- 172.21.15.49:0/4132168080 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99e91b0 0x5578e9d8e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 -- 172.21.15.49:0/4132168080 >> 172.21.15.49:0/4132168080 conn(0x5578e99dd300 msgr2=0x5578e9d8c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 -- 172.21.15.49:0/4132168080 shutdown_connections 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 -- 172.21.15.49:0/4132168080 wait complete. 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.691+0000 7f2e209fe740 1 -- start start 2024-09-21T06:43:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e209fe740 1 Processor -- start 2024-09-21T06:43:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 0x5578e9d9a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9d9a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99e91b0 0x5578e9da6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e209fe740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5578e9c2aab0 con 0x5578e99e91b0 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e209fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5578e9c98730 con 0x5578e99c84d0 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e209fe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5578e9d9d130 con 0x5578e99c02f0 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e209fe740 10 client.0 _ll_register_callbacks cb 0x5578e9cec6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e13fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99e91b0 0x5578e9da6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e13fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99e91b0 0x5578e9da6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58254/0 (socket says 172.21.15.49:58254) 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e13fff640 1 -- 172.21.15.49:0/2401642653 learned_addr learned my addr 172.21.15.49:0/2401642653 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9d9a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e137fe640 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 0x5578e9d9a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e13fff640 1 -- 172.21.15.49:0/2401642653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 msgr2=0x5578e9d9a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e13fff640 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 0x5578e9d9a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.701 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e13fff640 1 -- 172.21.15.49:0/2401642653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 msgr2=0x5578e9d9a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e13fff640 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9d9a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.692+0000 7f2e13fff640 1 -- 172.21.15.49:0/2401642653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e9a54790 con 0x5578e99e91b0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2e13fff640 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99e91b0 0x5578e9da6450 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c010bf0 tx=0x7f2e0c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7446711da8408a8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2df2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2df2ffd640 1 -- 172.21.15.49:0/2401642653 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c02c060 con 0x5578e99e91b0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2df2ffd640 1 -- 172.21.15.49:0/2401642653 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f2e0c017030 con 0x5578e99e91b0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2e209fe740 1 -- 172.21.15.49:0/2401642653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e040ad500 con 0x5578e99e91b0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2df2ffd640 1 -- 172.21.15.49:0/2401642653 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2e0c01fd40 con 0x5578e99e91b0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2e209fe740 10 client.17142 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2e209fe740 1 -- 172.21.15.49:0/2401642653 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5578e9acd620 con 0x5578e99e91b0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2df2ffd640 1 -- 172.21.15.49:0/2401642653 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e040ad500 con 0x5578e99e91b0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.693+0000 7f2df2ffd640 1 -- 172.21.15.49:0/2401642653 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2e0c01c3f0 con 0x5578e99e91b0 2024-09-21T06:43:16.702 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.694+0000 7f2e209fe740 10 client.17142 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.694+0000 7f2e209fe740 10 client.17142 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.694+0000 7f2e209fe740 20 client.17142 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.694+0000 7f2e209fe740 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5578e99a7d80 0x5578e9dac220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.694+0000 7f2e209fe740 4 client.17142 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.694+0000 7f2e209fe740 1 -- 172.21.15.49:0/2401642653 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578e9d05640 con 0x5578e99a7d80 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.694+0000 7f2e137fe640 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5578e99a7d80 0x5578e9dac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.694+0000 7f2df2ffd640 10 client.17142 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.694+0000 7f2e137fe640 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5578e99a7d80 0x5578e9dac220 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3687797b96540b6e server_cookie=b3969b377af909f2 in_seq=0 out_seq=0 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2df2ffd640 1 -- 172.21.15.49:0/2401642653 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578e9d05640 con 0x5578e99a7d80 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2df2ffd640 10 client.17142 handle_command_reply: tid=0 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 client.17142 shutdown 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 -- 172.21.15.49:0/2401642653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99e91b0 msgr2=0x5578e9da6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99e91b0 0x5578e9da6450 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c010bf0 tx=0x7f2e0c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.703 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 -- 172.21.15.49:0/2401642653 shutdown_connections 2024-09-21T06:43:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5578e99a7d80 0x5578e9dac220 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99e91b0 0x5578e9da6450 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9d9a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2df2ffd640 0 client.17142 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 --2- 172.21.15.49:0/2401642653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 0x5578e9d9a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 -- 172.21.15.49:0/2401642653 >> 172.21.15.49:0/2401642653 conn(0x5578e99dd300 msgr2=0x5578e9d8f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 -- 172.21.15.49:0/2401642653 shutdown_connections 2024-09-21T06:43:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.695+0000 7f2e209fe740 1 -- 172.21.15.49:0/2401642653 wait complete. 2024-09-21T06:43:16.704 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.696+0000 7f2e209fe740 20 client.17142 trim_cache size 0 max 16384 2024-09-21T06:43:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e209fe740 1 Processor -- start 2024-09-21T06:43:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e209fe740 1 -- start start 2024-09-21T06:43:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99a7d80 0x5578e9d900f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9da6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9da6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e209fe740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2e141b20f0 con 0x5578e99c02f0 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e209fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e141af9c0 con 0x5578e99c84d0 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e209fe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2e141ad830 con 0x5578e99a7d80 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e12ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9da6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e12ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9da6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58256/0 (socket says 172.21.15.49:58256) 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e12ffd640 1 -- 172.21.15.49:0/608424103 learned_addr learned my addr 172.21.15.49:0/608424103 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e137fe640 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99a7d80 0x5578e9d900f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e12ffd640 1 -- 172.21.15.49:0/608424103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99a7d80 msgr2=0x5578e9d900f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e13fff640 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9da6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99a7d80 0x5578e9d900f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e12ffd640 1 -- 172.21.15.49:0/608424103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 msgr2=0x5578e9da6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9da6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e12ffd640 1 -- 172.21.15.49:0/608424103 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e9d98520 con 0x5578e99c02f0 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.711+0000 7f2e137fe640 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99a7d80 0x5578e9d900f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9da6350 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009900 tx=0x7f2e08000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96815fa4355938fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2df97fa640 1 -- 172.21.15.49:0/608424103 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08035040 con 0x5578e99c02f0 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2df97fa640 1 -- 172.21.15.49:0/608424103 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e080316a0 con 0x5578e99c02f0 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2df97fa640 1 -- 172.21.15.49:0/608424103 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e08004750 con 0x5578e99c02f0 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2e209fe740 1 -- 172.21.15.49:0/608424103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 msgr2=0x5578e9da6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2e209fe740 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9da6350 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009900 tx=0x7f2e08000bc0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2e209fe740 1 -- 172.21.15.49:0/608424103 shutdown_connections 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2e209fe740 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9da6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2e209fe740 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99c02f0 0x5578e9da6350 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2e209fe740 1 --2- 172.21.15.49:0/608424103 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99a7d80 0x5578e9d900f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.712+0000 7f2e209fe740 1 -- 172.21.15.49:0/608424103 >> 172.21.15.49:0/608424103 conn(0x5578e99dd300 msgr2=0x5578e9d8f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 -- 172.21.15.49:0/608424103 shutdown_connections 2024-09-21T06:43:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 -- 172.21.15.49:0/608424103 wait complete. 2024-09-21T06:43:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 -- start start 2024-09-21T06:43:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 Processor -- start 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99a7d80 0x5578e9d9fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 0x5578e9da0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9e0dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2e141ade80 con 0x5578e99a7d80 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2e141af2f0 con 0x5578e99c84d0 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.713+0000 7f2e209fe740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2e141ae550 con 0x5578e99c02f0 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e209fe740 10 client.0 _ll_register_callbacks cb 0x7f2e0c011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99a7d80 0x5578e9d9fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e137fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99a7d80 0x5578e9d9fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58264/0 (socket says 172.21.15.49:58264) 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e137fe640 1 -- 172.21.15.49:0/702632484 learned_addr learned my addr 172.21.15.49:0/702632484 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 0x5578e9da0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e13fff640 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9e0dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e137fe640 1 -- 172.21.15.49:0/702632484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 msgr2=0x5578e9da0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e137fe640 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 0x5578e9da0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e137fe640 1 -- 172.21.15.49:0/702632484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 msgr2=0x5578e9e0dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e137fe640 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9e0dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e137fe640 1 -- 172.21.15.49:0/702632484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e9e0e280 con 0x5578e99a7d80 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e13fff640 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9e0dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 0x5578e9da0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e137fe640 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99a7d80 0x5578e9d9fe50 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f2e040ad6f0 tx=0x7f2e040a9a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadf4ec629dfda4a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2df2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2df2ffd640 1 -- 172.21.15.49:0/702632484 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e040ce9c0 con 0x5578e99a7d80 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2df2ffd640 1 -- 172.21.15.49:0/702632484 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f2e0406a000 con 0x5578e99a7d80 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e209fe740 1 -- 172.21.15.49:0/702632484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e080316a0 con 0x5578e99a7d80 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2df2ffd640 1 -- 172.21.15.49:0/702632484 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2e040cf7e0 con 0x5578e99a7d80 2024-09-21T06:43:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e209fe740 10 client.17148 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.714+0000 7f2e209fe740 1 -- 172.21.15.49:0/702632484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5578e9e16720 con 0x5578e99a7d80 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.715+0000 7f2df2ffd640 1 -- 172.21.15.49:0/702632484 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e080316a0 con 0x5578e99a7d80 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.715+0000 7f2df2ffd640 1 -- 172.21.15.49:0/702632484 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2e040b6f80 con 0x5578e99a7d80 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.715+0000 7f2e209fe740 10 client.17148 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.715+0000 7f2e209fe740 10 client.17148 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.715+0000 7f2e209fe740 20 client.17148 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.715+0000 7f2e209fe740 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5578e99e91b0 0x5578e9e18ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.715+0000 7f2e209fe740 4 client.17148 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.715+0000 7f2e209fe740 1 -- 172.21.15.49:0/702632484 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5578e9d010f0 con 0x5578e99e91b0 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.715+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5578e99e91b0 0x5578e9e18ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.716+0000 7f2e12ffd640 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5578e99e91b0 0x5578e9e18ac0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12bff55a260a4ee6 server_cookie=3a30b7b040152982 in_seq=0 out_seq=0 2024-09-21T06:43:16.722 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.716+0000 7f2df2ffd640 10 client.17148 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.723+0000 7f2df2ffd640 1 -- 172.21.15.49:0/702632484 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578e9d010f0 con 0x5578e99e91b0 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.723+0000 7f2df2ffd640 10 client.17148 handle_command_reply: tid=0 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.723+0000 7f2e209fe740 1 client.17148 shutdown 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 -- 172.21.15.49:0/702632484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99a7d80 msgr2=0x5578e9d9fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99a7d80 0x5578e9d9fe50 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f2e040ad6f0 tx=0x7f2e040a9a50 comp rx=0 tx=0).stop 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 -- 172.21.15.49:0/702632484 shutdown_connections 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5578e99e91b0 0x5578e9e18ac0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5578e99c84d0 0x5578e9e0dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5578e99c02f0 0x5578e9da0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2df2ffd640 0 client.17148 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 --2- 172.21.15.49:0/702632484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5578e99a7d80 0x5578e9d9fe50 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 -- 172.21.15.49:0/702632484 >> 172.21.15.49:0/702632484 conn(0x5578e99dd300 msgr2=0x5578e9d8aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 -- 172.21.15.49:0/702632484 shutdown_connections 2024-09-21T06:43:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 1 -- 172.21.15.49:0/702632484 wait complete. 2024-09-21T06:43:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e209fe740 20 client.17148 trim_cache size 0 max 16384 2024-09-21T06:43:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:43:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:43:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:43:16.727 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:43:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2dfc0b6680 msgr2=0x7f2dfc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2dfc0b6680 0x7f2dfc0b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c005fd0 tx=0x7f2e0c009500 comp rx=0 tx=0).stop 2024-09-21T06:43:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e14104950 msgr2=0x7f2e1419a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e14104950 0x7f2e1419a410 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400e9f0 tx=0x7f2e0400edf0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2950553185 shutdown_connections 2024-09-21T06:43:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f2dfc0b6680 0x7f2dfc0b8b90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2e1410ddb0 0x7f2e1419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.728 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2e141052a0 0x7f2e1419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.724+0000 7f2e19a8b640 1 --2- 172.21.15.49:0/2950553185 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2e14104950 0x7f2e1419a410 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.725+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2950553185 >> 172.21.15.49:0/2950553185 conn(0x7f2e1407a710 msgr2=0x7f2e14100580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.725+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2950553185 shutdown_connections 2024-09-21T06:43:16.729 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:16.725+0000 7f2e19a8b640 1 -- 172.21.15.49:0/2950553185 wait complete. 2024-09-21T06:43:18.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:17 smithi098 ceph-mon[34704]: pgmap v520: 97 pgs: 97 active+clean; 6.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:43:18.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:17 smithi079 ceph-mon[34346]: pgmap v520: 97 pgs: 97 active+clean; 6.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:43:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:17 smithi049 ceph-mon[31177]: pgmap v520: 97 pgs: 97 active+clean; 6.2 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:43:20.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:19 smithi098 ceph-mon[34704]: pgmap v521: 97 pgs: 97 active+clean; 6.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-21T06:43:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:19 smithi079 ceph-mon[34346]: pgmap v521: 97 pgs: 97 active+clean; 6.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-21T06:43:20.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:19 smithi049 ceph-mon[31177]: pgmap v521: 97 pgs: 97 active+clean; 6.3 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-21T06:43:22.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:21 smithi098 ceph-mon[34704]: pgmap v522: 97 pgs: 97 active+clean; 6.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-21T06:43:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:21 smithi079 ceph-mon[34346]: pgmap v522: 97 pgs: 97 active+clean; 6.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-21T06:43:22.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:21 smithi049 ceph-mon[31177]: pgmap v522: 97 pgs: 97 active+clean; 6.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-21T06:43:24.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:23 smithi098 ceph-mon[34704]: pgmap v523: 97 pgs: 97 active+clean; 6.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:43:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:23 smithi079 ceph-mon[34346]: pgmap v523: 97 pgs: 97 active+clean; 6.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:43:24.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:23 smithi049 ceph-mon[31177]: pgmap v523: 97 pgs: 97 active+clean; 6.3 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:43:26.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:25 smithi098 ceph-mon[34704]: pgmap v524: 97 pgs: 97 active+clean; 6.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:43:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:25 smithi079 ceph-mon[34346]: pgmap v524: 97 pgs: 97 active+clean; 6.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:43:26.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:25 smithi049 ceph-mon[31177]: pgmap v524: 97 pgs: 97 active+clean; 6.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:43:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:27 smithi098 ceph-mon[34704]: pgmap v525: 97 pgs: 97 active+clean; 6.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:43:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:27 smithi079 ceph-mon[34346]: pgmap v525: 97 pgs: 97 active+clean; 6.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:43:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:27 smithi049 ceph-mon[31177]: pgmap v525: 97 pgs: 97 active+clean; 6.4 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:43:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.837+0000 7f96a3c30640 1 -- 172.21.15.49:0/3073978011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c108300 msgr2=0x7f969c108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.837+0000 7f96a3c30640 1 --2- 172.21.15.49:0/3073978011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c108300 0x7f969c108710 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f968c009900 tx=0x7f968c02a410 comp rx=0 tx=0).stop 2024-09-21T06:43:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.837+0000 7f96a3c30640 1 -- 172.21.15.49:0/3073978011 shutdown_connections 2024-09-21T06:43:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.837+0000 7f96a3c30640 1 --2- 172.21.15.49:0/3073978011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f969c108c50 0x7f969c10f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.837+0000 7f96a3c30640 1 --2- 172.21.15.49:0/3073978011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c108300 0x7f969c108710 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.837+0000 7f96a3c30640 1 --2- 172.21.15.49:0/3073978011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f969c1029d0 0x7f969c102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.837+0000 7f96a3c30640 1 -- 172.21.15.49:0/3073978011 >> 172.21.15.49:0/3073978011 conn(0x7f969c07a710 msgr2=0x7f969c07ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.837+0000 7f96a3c30640 1 -- 172.21.15.49:0/3073978011 shutdown_connections 2024-09-21T06:43:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.837+0000 7f96a3c30640 1 -- 172.21.15.49:0/3073978011 wait complete. 2024-09-21T06:43:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a3c30640 1 Processor -- start 2024-09-21T06:43:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a3c30640 1 -- start start 2024-09-21T06:43:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a3c30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c1029d0 0x7f969c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a3c30640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f969c108300 0x7f969c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a3c30640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f969c108c50 0x7f969c19eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a3c30640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f969c112910 con 0x7f969c1029d0 2024-09-21T06:43:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a3c30640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f969c112790 con 0x7f969c108300 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a3c30640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f969c112a90 con 0x7f969c108c50 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a19cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c1029d0 0x7f969c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a19cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c1029d0 0x7f969c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53222/0 (socket says 172.21.15.49:53222) 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.838+0000 7f96a19cc640 1 -- 172.21.15.49:0/2432809369 learned_addr learned my addr 172.21.15.49:0/2432809369 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a21cd640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f969c108c50 0x7f969c19eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a11cb640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f969c108300 0x7f969c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a19cc640 1 -- 172.21.15.49:0/2432809369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f969c108c50 msgr2=0x7f969c19eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a19cc640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f969c108c50 0x7f969c19eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a19cc640 1 -- 172.21.15.49:0/2432809369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f969c108300 msgr2=0x7f969c199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a19cc640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f969c108300 0x7f969c199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a19cc640 1 -- 172.21.15.49:0/2432809369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c19f220 con 0x7f969c1029d0 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a21cd640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f969c108c50 0x7f969c19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a11cb640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f969c108300 0x7f969c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a19cc640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c1029d0 0x7f969c1992f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f969800d950 tx=0x7f969800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f9692ffd640 1 -- 172.21.15.49:0/2432809369 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9698017030 con 0x7f969c1029d0 2024-09-21T06:43:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a3c30640 1 -- 172.21.15.49:0/2432809369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969c19f510 con 0x7f969c1029d0 2024-09-21T06:43:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f9692ffd640 1 -- 172.21.15.49:0/2432809369 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9698004020 con 0x7f969c1029d0 2024-09-21T06:43:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f9692ffd640 1 -- 172.21.15.49:0/2432809369 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96980047a0 con 0x7f969c1029d0 2024-09-21T06:43:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.839+0000 7f96a3c30640 1 -- 172.21.15.49:0/2432809369 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969c1a5ca0 con 0x7f969c1029d0 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.842+0000 7f96aac80740 1 Processor -- start 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.842+0000 7f96aac80740 1 -- start start 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.842+0000 7f96aac80740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 0x55f71be609b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.842+0000 7f96aac80740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be60ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.842+0000 7f96aac80740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be61430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.842+0000 7f96aac80740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f71bdd56f0 con 0x55f71ba922f0 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.842+0000 7f96aac80740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f71bdc4b20 con 0x55f71babb1b0 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.842+0000 7f96aac80740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f71bdc8930 con 0x55f71ba9a4d0 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f9692ffd640 1 -- 172.21.15.49:0/2432809369 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9698009a30 con 0x7f969c1029d0 2024-09-21T06:43:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a11cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be61430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a21cd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 0x55f71be609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a11cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be61430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:47616/0 (socket says 172.21.15.49:47616) 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a11cb640 1 -- 172.21.15.49:0/2781511927 learned_addr learned my addr 172.21.15.49:0/2781511927 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a19cc640 1 --2- 172.21.15.49:0/2781511927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be60ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a11cb640 1 -- 172.21.15.49:0/2781511927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 msgr2=0x55f71be609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a11cb640 1 --2- 172.21.15.49:0/2781511927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 0x55f71be609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a11cb640 1 -- 172.21.15.49:0/2781511927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 msgr2=0x55f71be60ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a11cb640 1 --2- 172.21.15.49:0/2781511927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be60ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a11cb640 1 -- 172.21.15.49:0/2781511927 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71bd8a530 con 0x55f71ba9a4d0 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a19cc640 1 --2- 172.21.15.49:0/2781511927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be60ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.843+0000 7f96a11cb640 1 --2- 172.21.15.49:0/2781511927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be61430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f968c000c00 tx=0x7f968c032ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fd734bf7434f8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.844+0000 7f9692ffd640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96880b6680 0x7f96880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.844+0000 7f9687fff640 1 -- 172.21.15.49:0/2781511927 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c03f070 con 0x55f71ba9a4d0 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.844+0000 7f9687fff640 1 -- 172.21.15.49:0/2781511927 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f968c0316a0 con 0x55f71ba9a4d0 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.844+0000 7f96a21cd640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96880b6680 0x7f96880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.844+0000 7f9687fff640 1 -- 172.21.15.49:0/2781511927 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c035070 con 0x55f71ba9a4d0 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.844+0000 7f9692ffd640 1 -- 172.21.15.49:0/2432809369 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f96980e7330 con 0x7f969c1029d0 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 -- 172.21.15.49:0/2781511927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 msgr2=0x55f71be61430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96a21cd640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96880b6680 0x7f96880b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9694005fd0 tx=0x7f9694009680 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 --2- 172.21.15.49:0/2781511927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be61430 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f968c000c00 tx=0x7f968c032ce0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 -- 172.21.15.49:0/2781511927 shutdown_connections 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 --2- 172.21.15.49:0/2781511927 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be61430 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 --2- 172.21.15.49:0/2781511927 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be60ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 --2- 172.21.15.49:0/2781511927 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 0x55f71be609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 -- 172.21.15.49:0/2781511927 >> 172.21.15.49:0/2781511927 conn(0x55f71baaf300 msgr2=0x55f71be5e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 -- 172.21.15.49:0/2781511927 shutdown_connections 2024-09-21T06:43:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 -- 172.21.15.49:0/2781511927 wait complete. 2024-09-21T06:43:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 -- start start 2024-09-21T06:43:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.845+0000 7f96aac80740 1 Processor -- start 2024-09-21T06:43:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96aac80740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba922f0 0x55f71be6e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96aac80740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 0x55f71be6e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96aac80740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71babb1b0 0x55f71be6ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96aac80740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f71bcfcab0 con 0x55f71babb1b0 2024-09-21T06:43:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96aac80740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f71bd6a730 con 0x55f71ba9a4d0 2024-09-21T06:43:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96aac80740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f71be712b0 con 0x55f71ba922f0 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96aac80740 10 client.0 _ll_register_callbacks cb 0x55f71bdbe6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a21cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71babb1b0 0x55f71be6ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a21cd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71babb1b0 0x55f71be6ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53236/0 (socket says 172.21.15.49:53236) 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a21cd640 1 -- 172.21.15.49:0/1123878647 learned_addr learned my addr 172.21.15.49:0/1123878647 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a19cc640 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba922f0 0x55f71be6e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a11cb640 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 0x55f71be6e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a21cd640 1 -- 172.21.15.49:0/1123878647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba922f0 msgr2=0x55f71be6e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a21cd640 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba922f0 0x55f71be6e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a21cd640 1 -- 172.21.15.49:0/1123878647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 msgr2=0x55f71be6e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a21cd640 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 0x55f71be6e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.846+0000 7f96a21cd640 1 -- 172.21.15.49:0/1123878647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f71bb26790 con 0x55f71babb1b0 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96a21cd640 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71babb1b0 0x55f71be6ebb0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f96940129a0 tx=0x7f9694004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a802f3ee13b941b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96857fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96857fa640 1 -- 172.21.15.49:0/1123878647 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969400fcf0 con 0x55f71babb1b0 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96857fa640 1 -- 172.21.15.49:0/1123878647 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f969401f420 con 0x55f71babb1b0 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96aac80740 1 -- 172.21.15.49:0/1123878647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f968c0316a0 con 0x55f71babb1b0 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96857fa640 1 -- 172.21.15.49:0/1123878647 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f969401f620 con 0x55f71babb1b0 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96aac80740 10 client.17160 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96aac80740 1 -- 172.21.15.49:0/1123878647 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f71bb9f620 con 0x55f71babb1b0 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96857fa640 1 -- 172.21.15.49:0/1123878647 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f968c0316a0 con 0x55f71babb1b0 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96857fa640 1 -- 172.21.15.49:0/1123878647 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f969402f7f0 con 0x55f71babb1b0 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96aac80740 10 client.17160 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96aac80740 10 client.17160 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96aac80740 20 client.17160 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.847+0000 7f96aac80740 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f71ba79d80 0x55f71be802a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.848+0000 7f96aac80740 4 client.17160 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.848+0000 7f96aac80740 1 -- 172.21.15.49:0/1123878647 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f71bdd7640 con 0x55f71ba79d80 2024-09-21T06:43:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.848+0000 7f96a19cc640 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f71ba79d80 0x55f71be802a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.848+0000 7f96a19cc640 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f71ba79d80 0x55f71be802a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=610f3f12dbb05ea6 server_cookie=e07264c36aa4602 in_seq=0 out_seq=0 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.848+0000 7f96857fa640 10 client.17160 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96857fa640 1 -- 172.21.15.49:0/1123878647 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f71bdd7640 con 0x55f71ba79d80 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96857fa640 10 client.17160 handle_command_reply: tid=0 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 client.17160 shutdown 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 -- 172.21.15.49:0/1123878647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71babb1b0 msgr2=0x55f71be6ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71babb1b0 0x55f71be6ebb0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f96940129a0 tx=0x7f9694004a40 comp rx=0 tx=0).stop 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 -- 172.21.15.49:0/1123878647 shutdown_connections 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f71ba79d80 0x55f71be802a0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71babb1b0 0x55f71be6ebb0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 0x55f71be6e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 --2- 172.21.15.49:0/1123878647 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba922f0 0x55f71be6e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96857fa640 0 client.17160 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 -- 172.21.15.49:0/1123878647 >> 172.21.15.49:0/1123878647 conn(0x55f71baaf300 msgr2=0x55f71be5cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 -- 172.21.15.49:0/1123878647 shutdown_connections 2024-09-21T06:43:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 1 -- 172.21.15.49:0/1123878647 wait complete. 2024-09-21T06:43:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.849+0000 7f96aac80740 20 client.17160 trim_cache size 0 max 16384 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96aac80740 1 Processor -- start 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96aac80740 1 -- start start 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96aac80740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be69600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96aac80740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 0x55f71be7a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96aac80740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71babb1b0 0x55f71be6e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96aac80740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f969c1aff20 con 0x55f71ba922f0 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96aac80740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f969c1ad7f0 con 0x55f71ba9a4d0 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96aac80740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f969c1ab660 con 0x55f71babb1b0 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96a19cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be69600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96a19cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be69600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53242/0 (socket says 172.21.15.49:53242) 2024-09-21T06:43:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.864+0000 7f96a19cc640 1 -- 172.21.15.49:0/1376367549 learned_addr learned my addr 172.21.15.49:0/1376367549 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a11cb640 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 0x55f71be7a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a21cd640 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71babb1b0 0x55f71be6e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a19cc640 1 -- 172.21.15.49:0/1376367549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71babb1b0 msgr2=0x55f71be6e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a19cc640 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71babb1b0 0x55f71be6e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a19cc640 1 -- 172.21.15.49:0/1376367549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 msgr2=0x55f71be7a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a19cc640 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 0x55f71be7a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a19cc640 1 -- 172.21.15.49:0/1376367549 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f71be5e850 con 0x55f71ba922f0 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a11cb640 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 0x55f71be7a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a21cd640 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71babb1b0 0x55f71be6e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96a19cc640 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be69600 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f96980ad0c0 tx=0x7f9698094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5fb2d0022acfea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96877fe640 1 -- 172.21.15.49:0/1376367549 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96980aca80 con 0x55f71ba922f0 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96877fe640 1 -- 172.21.15.49:0/1376367549 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96980e6070 con 0x55f71ba922f0 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.865+0000 7f96877fe640 1 -- 172.21.15.49:0/1376367549 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96980ac8a0 con 0x55f71ba922f0 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 -- 172.21.15.49:0/1376367549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 msgr2=0x55f71be69600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be69600 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f96980ad0c0 tx=0x7f9698094040 comp rx=0 tx=0).stop 2024-09-21T06:43:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 -- 172.21.15.49:0/1376367549 shutdown_connections 2024-09-21T06:43:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71babb1b0 0x55f71be6e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71ba9a4d0 0x55f71be7a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 --2- 172.21.15.49:0/1376367549 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be69600 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 -- 172.21.15.49:0/1376367549 >> 172.21.15.49:0/1376367549 conn(0x55f71baaf300 msgr2=0x55f71be68ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 -- 172.21.15.49:0/1376367549 shutdown_connections 2024-09-21T06:43:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 -- 172.21.15.49:0/1376367549 wait complete. 2024-09-21T06:43:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 -- start start 2024-09-21T06:43:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.866+0000 7f96aac80740 1 Processor -- start 2024-09-21T06:43:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96aac80740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be72760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.872 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96aac80740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be72ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96aac80740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 0x55f71be73200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96aac80740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f969c1abcb0 con 0x55f71ba922f0 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96aac80740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f969c1ad120 con 0x55f71babb1b0 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96aac80740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f969c1ac380 con 0x55f71ba9a4d0 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96aac80740 10 client.0 _ll_register_callbacks cb 0x7f96940098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a19cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be72760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a19cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be72760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53248/0 (socket says 172.21.15.49:53248) 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a19cc640 1 -- 172.21.15.49:0/3790050862 learned_addr learned my addr 172.21.15.49:0/3790050862 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a21cd640 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 0x55f71be73200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a11cb640 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be72ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a19cc640 1 -- 172.21.15.49:0/3790050862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 msgr2=0x55f71be72ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a19cc640 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be72ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.873 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a19cc640 1 -- 172.21.15.49:0/3790050862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 msgr2=0x55f71be73200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a19cc640 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 0x55f71be73200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.867+0000 7f96a19cc640 1 -- 172.21.15.49:0/3790050862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f71bee9eb0 con 0x55f71ba922f0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96a19cc640 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be72760 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9698005fd0 tx=0x7f96980acc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376eef034a609dac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96857fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96857fa640 1 -- 172.21.15.49:0/3790050862 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96980aca80 con 0x55f71ba922f0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96857fa640 1 -- 172.21.15.49:0/3790050862 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f96980a93a0 con 0x55f71ba922f0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96aac80740 1 -- 172.21.15.49:0/3790050862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96980e6070 con 0x55f71ba922f0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96857fa640 1 -- 172.21.15.49:0/3790050862 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f96980ad830 con 0x55f71ba922f0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96aac80740 10 client.17166 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96aac80740 1 -- 172.21.15.49:0/3790050862 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f71beeb020 con 0x55f71ba922f0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96857fa640 1 -- 172.21.15.49:0/3790050862 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96980e6070 con 0x55f71ba922f0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96857fa640 1 -- 172.21.15.49:0/3790050862 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f96980981d0 con 0x55f71ba922f0 2024-09-21T06:43:29.874 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96aac80740 10 client.17166 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96aac80740 10 client.17166 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96aac80740 20 client.17166 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96aac80740 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f71ba4f1c0 0x55f71beed780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96aac80740 4 client.17166 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:43:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.868+0000 7f96aac80740 1 -- 172.21.15.49:0/3790050862 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f71be70aa0 con 0x55f71ba4f1c0 2024-09-21T06:43:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.869+0000 7f96a11cb640 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f71ba4f1c0 0x55f71beed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.869+0000 7f96857fa640 10 client.17166 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.869+0000 7f96a11cb640 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f71ba4f1c0 0x55f71beed780 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71d7e1aae0e37973 server_cookie=8d13dab770ab7bcc in_seq=0 out_seq=0 2024-09-21T06:43:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96857fa640 1 -- 172.21.15.49:0/3790050862 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f71be70aa0 con 0x55f71ba4f1c0 2024-09-21T06:43:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96857fa640 10 client.17166 handle_command_reply: tid=0 2024-09-21T06:43:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 client.17166 shutdown 2024-09-21T06:43:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 -- 172.21.15.49:0/3790050862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 msgr2=0x55f71be72760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be72760 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f9698005fd0 tx=0x7f96980acc40 comp rx=0 tx=0).stop 2024-09-21T06:43:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 -- 172.21.15.49:0/3790050862 shutdown_connections 2024-09-21T06:43:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f71ba4f1c0 0x55f71beed780 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f71babb1b0 0x55f71be73200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f71ba9a4d0 0x55f71be72ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 --2- 172.21.15.49:0/3790050862 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f71ba922f0 0x55f71be72760 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96857fa640 0 client.17166 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 -- 172.21.15.49:0/3790050862 >> 172.21.15.49:0/3790050862 conn(0x55f71baaf300 msgr2=0x55f71be6f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 -- 172.21.15.49:0/3790050862 shutdown_connections 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 1 -- 172.21.15.49:0/3790050862 wait complete. 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.877+0000 7f96aac80740 20 client.17166 trim_cache size 0 max 16384 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:43:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:43:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 -- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96880b6680 msgr2=0x7f96880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96880b6680 0x7f96880b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9694005fd0 tx=0x7f9694009680 comp rx=0 tx=0).stop 2024-09-21T06:43:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 -- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c1029d0 msgr2=0x7f969c1992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c1029d0 0x7f969c1992f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f969800d950 tx=0x7f969800de10 comp rx=0 tx=0).stop 2024-09-21T06:43:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 -- 172.21.15.49:0/2432809369 shutdown_connections 2024-09-21T06:43:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f96880b6680 0x7f96880b8b90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f969c108c50 0x7f969c19eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f969c108300 0x7f969c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 --2- 172.21.15.49:0/2432809369 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f969c1029d0 0x7f969c1992f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 -- 172.21.15.49:0/2432809369 >> 172.21.15.49:0/2432809369 conn(0x7f969c07a710 msgr2=0x7f969c105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 -- 172.21.15.49:0/2432809369 shutdown_connections 2024-09-21T06:43:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:29.878+0000 7f96a3c30640 1 -- 172.21.15.49:0/2432809369 wait complete. 2024-09-21T06:43:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:29 smithi098 ceph-mon[34704]: pgmap v526: 97 pgs: 97 active+clean; 6.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:43:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:29 smithi079 ceph-mon[34346]: pgmap v526: 97 pgs: 97 active+clean; 6.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:43:30.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:29 smithi049 ceph-mon[31177]: pgmap v526: 97 pgs: 97 active+clean; 6.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:43:32.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:31 smithi098 ceph-mon[34704]: pgmap v527: 97 pgs: 97 active+clean; 6.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-09-21T06:43:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:31 smithi079 ceph-mon[34346]: pgmap v527: 97 pgs: 97 active+clean; 6.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-09-21T06:43:32.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:31 smithi049 ceph-mon[31177]: pgmap v527: 97 pgs: 97 active+clean; 6.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-09-21T06:43:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:33 smithi098 ceph-mon[34704]: pgmap v528: 97 pgs: 97 active+clean; 6.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-21T06:43:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:33 smithi079 ceph-mon[34346]: pgmap v528: 97 pgs: 97 active+clean; 6.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-21T06:43:34.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:33 smithi049 ceph-mon[31177]: pgmap v528: 97 pgs: 97 active+clean; 6.5 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-21T06:43:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:35 smithi098 ceph-mon[34704]: pgmap v529: 97 pgs: 97 active+clean; 6.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:43:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:35 smithi079 ceph-mon[34346]: pgmap v529: 97 pgs: 97 active+clean; 6.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:43:36.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:35 smithi049 ceph-mon[31177]: pgmap v529: 97 pgs: 97 active+clean; 6.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:43:36.929 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:43:37.204 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.680+0000 7f00b0223640 1 -- 172.21.15.49:0/472408310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 msgr2=0x7f00a810fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.680+0000 7f00b0223640 1 --2- 172.21.15.49:0/472408310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 0x7f00a810fc70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f0098009900 tx=0x7f009802a480 comp rx=0 tx=0).stop 2024-09-21T06:43:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.680+0000 7f00b0223640 1 -- 172.21.15.49:0/472408310 shutdown_connections 2024-09-21T06:43:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.680+0000 7f00b0223640 1 --2- 172.21.15.49:0/472408310 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00a81101b0 0x7f00a81125d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.680+0000 7f00b0223640 1 --2- 172.21.15.49:0/472408310 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 0x7f00a810fc70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.680+0000 7f00b0223640 1 --2- 172.21.15.49:0/472408310 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00a8102600 0x7f00a8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.680+0000 7f00b0223640 1 -- 172.21.15.49:0/472408310 >> 172.21.15.49:0/472408310 conn(0x7f00a8079750 msgr2=0x7f00a8079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.680+0000 7f00b0223640 1 -- 172.21.15.49:0/472408310 shutdown_connections 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.680+0000 7f00b0223640 1 -- 172.21.15.49:0/472408310 wait complete. 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.681+0000 7f00b0223640 1 Processor -- start 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.681+0000 7f00b0223640 1 -- start start 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.681+0000 7f00b0223640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00a8102600 0x7f00a819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.681+0000 7f00b0223640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 0x7f00a819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.681+0000 7f00b0223640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00a81101b0 0x7f00a81a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.681+0000 7f00b0223640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8115ca0 con 0x7f00a8102f50 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.681+0000 7f00b0223640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8115b20 con 0x7f00a81101b0 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.681+0000 7f00b0223640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f00a8115e20 con 0x7f00a8102600 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ad7be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 0x7f00a819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ad7be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 0x7f00a819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34354/0 (socket says 172.21.15.49:34354) 2024-09-21T06:43:37.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ad7be640 1 -- 172.21.15.49:0/1203016938 learned_addr learned my addr 172.21.15.49:0/1203016938 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00adfbf640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00a8102600 0x7f00a819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00a81101b0 0x7f00a81a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ad7be640 1 -- 172.21.15.49:0/1203016938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00a8102600 msgr2=0x7f00a819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ad7be640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00a8102600 0x7f00a819c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ad7be640 1 -- 172.21.15.49:0/1203016938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00a81101b0 msgr2=0x7f00a81a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ad7be640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00a81101b0 0x7f00a81a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ad7be640 1 -- 172.21.15.49:0/1203016938 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a81a2620 con 0x7f00a8102f50 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00a81101b0 0x7f00a81a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f00ad7be640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 0x7f00a819cc50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f0098005940 tx=0x7f00980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.682+0000 7f009effd640 1 -- 172.21.15.49:0/1203016938 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009803f030 con 0x7f00a8102f50 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.683+0000 7f00b0223640 1 -- 172.21.15.49:0/1203016938 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a81a28b0 con 0x7f00a8102f50 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.683+0000 7f009effd640 1 -- 172.21.15.49:0/1203016938 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0098003cb0 con 0x7f00a8102f50 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.683+0000 7f009effd640 1 -- 172.21.15.49:0/1203016938 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098035070 con 0x7f00a8102f50 2024-09-21T06:43:37.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.683+0000 7f00b0223640 1 -- 172.21.15.49:0/1203016938 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a81a9070 con 0x7f00a8102f50 2024-09-21T06:43:37.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.685+0000 7f00b6797740 1 Processor -- start 2024-09-21T06:43:37.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.685+0000 7f00b6797740 1 -- start start 2024-09-21T06:43:37.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.685+0000 7f009effd640 1 -- 172.21.15.49:0/1203016938 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0098042030 con 0x7f00a8102f50 2024-09-21T06:43:37.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00b6797740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 0x562191698650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00b6797740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912c81b0 0x562191698b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00b6797740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 0x5621916990d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00b6797740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56219160ee50 con 0x5621912c81b0 2024-09-21T06:43:37.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00b6797740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5621915fe280 con 0x5621912d0390 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00b6797740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562191602090 con 0x5621912f1070 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00adfbf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912c81b0 0x562191698b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00adfbf640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912c81b0 0x562191698b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34360/0 (socket says 172.21.15.49:34360) 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00adfbf640 1 -- 172.21.15.49:0/702485534 learned_addr learned my addr 172.21.15.49:0/702485534 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/702485534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 0x562191698650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00ad7be640 1 --2- 172.21.15.49:0/702485534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 0x5621916990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00adfbf640 1 -- 172.21.15.49:0/702485534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 msgr2=0x562191698650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00adfbf640 1 --2- 172.21.15.49:0/702485534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 0x562191698650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00adfbf640 1 -- 172.21.15.49:0/702485534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 msgr2=0x5621916990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00adfbf640 1 --2- 172.21.15.49:0/702485534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 0x5621916990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00adfbf640 1 -- 172.21.15.49:0/702485534 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56219135c650 con 0x5621912c81b0 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.686+0000 7f00adfbf640 1 --2- 172.21.15.49:0/702485534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912c81b0 0x562191698b90 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f00a400bd10 tx=0x7f00a40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1d853aa7b5b21fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.687+0000 7f009effd640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f00940b6680 0x7f00940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.687+0000 7f0093fff640 1 -- 172.21.15.49:0/702485534 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4004030 con 0x5621912c81b0 2024-09-21T06:43:37.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.687+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f00940b6680 0x7f00940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.687+0000 7f0093fff640 1 -- 172.21.15.49:0/702485534 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00a40035f0 con 0x5621912c81b0 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.687+0000 7f0093fff640 1 -- 172.21.15.49:0/702485534 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a40117b0 con 0x5621912c81b0 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.687+0000 7f009effd640 1 -- 172.21.15.49:0/1203016938 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f0098108050 con 0x7f00a8102f50 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 -- 172.21.15.49:0/702485534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912c81b0 msgr2=0x562191698b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f00940b6680 0x7f00940b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005fd0 tx=0x7f00a0009800 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 --2- 172.21.15.49:0/702485534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912c81b0 0x562191698b90 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f00a400bd10 tx=0x7f00a40107a0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 -- 172.21.15.49:0/702485534 shutdown_connections 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 --2- 172.21.15.49:0/702485534 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 0x5621916990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 --2- 172.21.15.49:0/702485534 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912c81b0 0x562191698b90 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 --2- 172.21.15.49:0/702485534 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 0x562191698650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 -- 172.21.15.49:0/702485534 >> 172.21.15.49:0/702485534 conn(0x5621912e5460 msgr2=0x562191696540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 -- 172.21.15.49:0/702485534 shutdown_connections 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 -- 172.21.15.49:0/702485534 wait complete. 2024-09-21T06:43:37.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.688+0000 7f00b6797740 1 -- start start 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00b6797740 1 Processor -- start 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00b6797740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 0x5621916a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00b6797740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x5621916a4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00b6797740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912f1070 0x5621916b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00b6797740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56219145f700 con 0x5621912d0390 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00b6797740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562191599110 con 0x5621912f1070 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00b6797740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5621916a6e30 con 0x5621912c81b0 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00b6797740 10 client.0 _ll_register_callbacks cb 0x5621915b2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00ad7be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x5621916a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00ad7be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x5621916a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34370/0 (socket says 172.21.15.49:34370) 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00ad7be640 1 -- 172.21.15.49:0/1453729304 learned_addr learned my addr 172.21.15.49:0/1453729304 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00adfbf640 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 0x5621916a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.689+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912f1070 0x5621916b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00ad7be640 1 -- 172.21.15.49:0/1453729304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 msgr2=0x5621916a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00ad7be640 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 0x5621916a3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00ad7be640 1 -- 172.21.15.49:0/1453729304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912f1070 msgr2=0x5621916b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00ad7be640 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912f1070 0x5621916b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00ad7be640 1 -- 172.21.15.49:0/1453729304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621915c6c40 con 0x5621912d0390 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912f1070 0x5621916b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00ad7be640 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x5621916a4230 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0098006010 tx=0x7f0098032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9a37eee33531c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00917fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00917fa640 1 -- 172.21.15.49:0/1453729304 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098049030 con 0x5621912d0390 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00917fa640 1 -- 172.21.15.49:0/1453729304 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f00980b5110 con 0x5621912d0390 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00b6797740 1 -- 172.21.15.49:0/1453729304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a40035f0 con 0x5621912d0390 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00917fa640 1 -- 172.21.15.49:0/1453729304 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f00980efe60 con 0x5621912d0390 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00b6797740 10 client.17178 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00b6797740 1 -- 172.21.15.49:0/1453729304 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5621916b2b20 con 0x5621912d0390 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.690+0000 7f00917fa640 1 -- 172.21.15.49:0/1453729304 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00980d0030 con 0x5621912d0390 2024-09-21T06:43:37.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00917fa640 1 -- 172.21.15.49:0/1453729304 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f009810a110 con 0x5621912d0390 2024-09-21T06:43:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00b6797740 10 client.17178 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00b6797740 10 client.17178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00b6797740 20 client.17178 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00b6797740 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5621912af9f0 0x5621916b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00b6797740 4 client.17178 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00b6797740 1 -- 172.21.15.49:0/1453729304 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562191610da0 con 0x5621912af9f0 2024-09-21T06:43:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00adfbf640 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5621912af9f0 0x5621916b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00adfbf640 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5621912af9f0 0x5621916b6080 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17caf666bcc248d5 server_cookie=d310616de49adcc9 in_seq=0 out_seq=0 2024-09-21T06:43:37.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.691+0000 7f00917fa640 10 client.17178 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.692+0000 7f00917fa640 1 -- 172.21.15.49:0/1453729304 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562191610da0 con 0x5621912af9f0 2024-09-21T06:43:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.692+0000 7f00917fa640 10 client.17178 handle_command_reply: tid=0 2024-09-21T06:43:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.692+0000 7f00b6797740 1 client.17178 shutdown 2024-09-21T06:43:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.692+0000 7f00b6797740 1 -- 172.21.15.49:0/1453729304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 msgr2=0x5621916a4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.692+0000 7f00b6797740 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x5621916a4230 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0098006010 tx=0x7f0098032f60 comp rx=0 tx=0).stop 2024-09-21T06:43:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00b6797740 1 -- 172.21.15.49:0/1453729304 shutdown_connections 2024-09-21T06:43:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00b6797740 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5621912af9f0 0x5621916b6080 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.700 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00b6797740 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912f1070 0x5621916b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00b6797740 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x5621916a4230 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00b6797740 1 --2- 172.21.15.49:0/1453729304 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 0x5621916a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00917fa640 0 client.17178 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:37.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00b6797740 1 -- 172.21.15.49:0/1453729304 >> 172.21.15.49:0/1453729304 conn(0x5621912e5460 msgr2=0x56219169b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00b6797740 1 -- 172.21.15.49:0/1453729304 shutdown_connections 2024-09-21T06:43:37.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00b6797740 1 -- 172.21.15.49:0/1453729304 wait complete. 2024-09-21T06:43:37.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.693+0000 7f00b6797740 20 client.17178 trim_cache size 0 max 16384 2024-09-21T06:43:37.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.710+0000 7f00b6797740 1 Processor -- start 2024-09-21T06:43:37.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.710+0000 7f00b6797740 1 -- start start 2024-09-21T06:43:37.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.710+0000 7f00b6797740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912c81b0 0x5621916a2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.710+0000 7f00b6797740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x562191699d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00b6797740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 0x5621916b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00b6797740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81b4300 con 0x5621912d0390 2024-09-21T06:43:37.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00b6797740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81b1bd0 con 0x5621912c81b0 2024-09-21T06:43:37.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00b6797740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81afa40 con 0x5621912f1070 2024-09-21T06:43:37.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ad7be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x562191699d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ad7be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x562191699d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34378/0 (socket says 172.21.15.49:34378) 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ad7be640 1 -- 172.21.15.49:0/1860720367 learned_addr learned my addr 172.21.15.49:0/1860720367 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 0x5621916b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00adfbf640 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912c81b0 0x5621916a2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ad7be640 1 -- 172.21.15.49:0/1860720367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 msgr2=0x5621916b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ad7be640 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 0x5621916b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ad7be640 1 -- 172.21.15.49:0/1860720367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912c81b0 msgr2=0x5621916a2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ad7be640 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912c81b0 0x5621916a2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ad7be640 1 -- 172.21.15.49:0/1860720367 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562191697300 con 0x5621912d0390 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 0x5621916b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00adfbf640 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912c81b0 0x5621916a2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00ad7be640 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x562191699d90 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f00980d2af0 tx=0x7f009802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a018053911a05ee2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00937fe640 1 -- 172.21.15.49:0/1860720367 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098049070 con 0x5621912d0390 2024-09-21T06:43:37.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00937fe640 1 -- 172.21.15.49:0/1860720367 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00980d0030 con 0x5621912d0390 2024-09-21T06:43:37.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.711+0000 7f00937fe640 1 -- 172.21.15.49:0/1860720367 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980ce550 con 0x5621912d0390 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.712+0000 7f00b6797740 1 -- 172.21.15.49:0/1860720367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 msgr2=0x562191699d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.712+0000 7f00b6797740 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x562191699d90 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f00980d2af0 tx=0x7f009802a480 comp rx=0 tx=0).stop 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.712+0000 7f00b6797740 1 -- 172.21.15.49:0/1860720367 shutdown_connections 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.712+0000 7f00b6797740 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912f1070 0x5621916b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.712+0000 7f00b6797740 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912d0390 0x562191699d90 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.712+0000 7f00b6797740 1 --2- 172.21.15.49:0/1860720367 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912c81b0 0x5621916a2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.712+0000 7f00b6797740 1 -- 172.21.15.49:0/1860720367 >> 172.21.15.49:0/1860720367 conn(0x5621912e5460 msgr2=0x562191699680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.712+0000 7f00b6797740 1 -- 172.21.15.49:0/1860720367 shutdown_connections 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.712+0000 7f00b6797740 1 -- 172.21.15.49:0/1860720367 wait complete. 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00b6797740 1 -- start start 2024-09-21T06:43:37.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00b6797740 1 Processor -- start 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00b6797740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 0x5621916a8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00b6797740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 0x5621916a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00b6797740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912f1070 0x56219171fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00b6797740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81b0090 con 0x5621912f1070 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00b6797740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81b1500 con 0x5621912d0390 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00b6797740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81b0760 con 0x5621912c81b0 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00b6797740 10 client.0 _ll_register_callbacks cb 0x7f009810b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00ae7c0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912f1070 0x56219171fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00ae7c0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912f1070 0x56219171fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34388/0 (socket says 172.21.15.49:34388) 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00ae7c0640 1 -- 172.21.15.49:0/2718123921 learned_addr learned my addr 172.21.15.49:0/2718123921 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00adfbf640 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 0x5621916a8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.713+0000 7f00ad7be640 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 0x5621916a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00ae7c0640 1 -- 172.21.15.49:0/2718123921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 msgr2=0x5621916a8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 0x5621916a8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00ae7c0640 1 -- 172.21.15.49:0/2718123921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 msgr2=0x5621916a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 0x5621916a89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00ae7c0640 1 -- 172.21.15.49:0/2718123921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56219171ff80 con 0x5621912f1070 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00ad7be640 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 0x5621916a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00ae7c0640 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912f1070 0x56219171fa40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f00a0011f10 tx=0x7f00a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c10f5b98aa5b508 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00917fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00917fa640 1 -- 172.21.15.49:0/2718123921 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a002c060 con 0x5621912f1070 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00917fa640 1 -- 172.21.15.49:0/2718123921 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f00a00105e0 con 0x5621912f1070 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00b6797740 1 -- 172.21.15.49:0/2718123921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00980d0030 con 0x5621912f1070 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00917fa640 1 -- 172.21.15.49:0/2718123921 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f00a00107e0 con 0x5621912f1070 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00b6797740 10 client.17184 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.714+0000 7f00b6797740 1 -- 172.21.15.49:0/2718123921 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562191721020 con 0x5621912f1070 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.715+0000 7f00917fa640 1 -- 172.21.15.49:0/2718123921 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00980d0030 con 0x5621912f1070 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.715+0000 7f00917fa640 1 -- 172.21.15.49:0/2718123921 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f00a0026070 con 0x5621912f1070 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.715+0000 7f00b6797740 10 client.17184 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.715+0000 7f00b6797740 10 client.17184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.715+0000 7f00b6797740 20 client.17184 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.715+0000 7f00b6797740 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562191284da0 0x562191723810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.715+0000 7f00b6797740 4 client.17184 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.715+0000 7f00b6797740 1 -- 172.21.15.49:0/2718123921 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56219169f8a0 con 0x562191284da0 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.715+0000 7f00adfbf640 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562191284da0 0x562191723810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00adfbf640 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562191284da0 0x562191723810 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a074feca40578fd server_cookie=d30c05fb288c9486 in_seq=0 out_seq=0 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00917fa640 10 client.17184 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00917fa640 1 -- 172.21.15.49:0/2718123921 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x56219169f8a0 con 0x562191284da0 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00917fa640 10 client.17184 handle_command_reply: tid=0 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 client.17184 shutdown 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 -- 172.21.15.49:0/2718123921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912f1070 msgr2=0x56219171fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912f1070 0x56219171fa40 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f00a0011f10 tx=0x7f00a0004a40 comp rx=0 tx=0).stop 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 -- 172.21.15.49:0/2718123921 shutdown_connections 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562191284da0 0x562191723810 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5621912f1070 0x56219171fa40 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5621912d0390 0x5621916a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 --2- 172.21.15.49:0/2718123921 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5621912c81b0 0x5621916a8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00917fa640 0 client.17184 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 -- 172.21.15.49:0/2718123921 >> 172.21.15.49:0/2718123921 conn(0x5621912e5460 msgr2=0x56219169d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 -- 172.21.15.49:0/2718123921 shutdown_connections 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 1 -- 172.21.15.49:0/2718123921 wait complete. 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.716+0000 7f00b6797740 20 client.17184 trim_cache size 0 max 16384 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:43:37.723 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.724 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.725 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.726 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.727 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.728 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:43:37.729 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 -- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f00940b6680 msgr2=0x7f00940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f00940b6680 0x7f00940b8b90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005fd0 tx=0x7f00a0009800 comp rx=0 tx=0).stop 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 -- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 msgr2=0x7f00a819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 0x7f00a819cc50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f0098005940 tx=0x7f00980042f0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 -- 172.21.15.49:0/1203016938 shutdown_connections 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f00940b6680 0x7f00940b8b90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f00a81101b0 0x7f00a81a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f00a8102f50 0x7f00a819cc50 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 --2- 172.21.15.49:0/1203016938 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f00a8102600 0x7f00a819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 -- 172.21.15.49:0/1203016938 >> 172.21.15.49:0/1203016938 conn(0x7f00a8079750 msgr2=0x7f00a8108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 -- 172.21.15.49:0/1203016938 shutdown_connections 2024-09-21T06:43:37.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:37.717+0000 7f00b0223640 1 -- 172.21.15.49:0/1203016938 wait complete. 2024-09-21T06:43:37.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:37 smithi049 ceph-mon[31177]: pgmap v530: 97 pgs: 97 active+clean; 6.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:43:38.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:37 smithi079 ceph-mon[34346]: pgmap v530: 97 pgs: 97 active+clean; 6.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:43:38.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:37 smithi098 ceph-mon[34704]: pgmap v530: 97 pgs: 97 active+clean; 6.6 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:43:38.523 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:43:38.523 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:43:38.785 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:39.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.260+0000 7ffb2620a640 1 -- 172.21.15.49:0/1378008434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 msgr2=0x7ffb2010d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.260+0000 7ffb2620a640 1 --2- 172.21.15.49:0/1378008434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 0x7ffb2010d920 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ffb08009900 tx=0x7ffb0802a410 comp rx=0 tx=0).stop 2024-09-21T06:43:39.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.261+0000 7ffb2620a640 1 -- 172.21.15.49:0/1378008434 shutdown_connections 2024-09-21T06:43:39.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.261+0000 7ffb2620a640 1 --2- 172.21.15.49:0/1378008434 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb2010de60 0x7ffb20110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.261+0000 7ffb2620a640 1 --2- 172.21.15.49:0/1378008434 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 0x7ffb2010d920 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.261+0000 7ffb2620a640 1 --2- 172.21.15.49:0/1378008434 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb201048b0 0x7ffb20104cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.261+0000 7ffb2620a640 1 -- 172.21.15.49:0/1378008434 >> 172.21.15.49:0/1378008434 conn(0x7ffb20079750 msgr2=0x7ffb20079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:39.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.261+0000 7ffb2620a640 1 -- 172.21.15.49:0/1378008434 shutdown_connections 2024-09-21T06:43:39.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.261+0000 7ffb2620a640 1 -- 172.21.15.49:0/1378008434 wait complete. 2024-09-21T06:43:39.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.261+0000 7ffb2620a640 1 Processor -- start 2024-09-21T06:43:39.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.261+0000 7ffb2620a640 1 -- start start 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb2620a640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb201048b0 0x7ffb201027c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb2620a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 0x7ffb20102d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb2620a640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb2010de60 0x7ffb20103240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb2620a640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20113aa0 con 0x7ffb201052e0 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb2620a640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20113920 con 0x7ffb201048b0 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb2620a640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb20113c20 con 0x7ffb2010de60 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb17fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 0x7ffb20102d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb17fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 0x7ffb20102d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34400/0 (socket says 172.21.15.49:34400) 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb17fff640 1 -- 172.21.15.49:0/534363815 learned_addr learned my addr 172.21.15.49:0/534363815 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb1ffff640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb2010de60 0x7ffb20103240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb1f7fe640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb201048b0 0x7ffb201027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb17fff640 1 -- 172.21.15.49:0/534363815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb2010de60 msgr2=0x7ffb20103240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb17fff640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb2010de60 0x7ffb20103240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb17fff640 1 -- 172.21.15.49:0/534363815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb201048b0 msgr2=0x7ffb201027c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb17fff640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb201048b0 0x7ffb201027c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb17fff640 1 -- 172.21.15.49:0/534363815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb201a8660 con 0x7ffb201052e0 2024-09-21T06:43:39.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb1f7fe640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb201048b0 0x7ffb201027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:39.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb17fff640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 0x7ffb20102d00 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ffb08032fd0 tx=0x7ffb08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:39.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.262+0000 7ffb1d7fa640 1 -- 172.21.15.49:0/534363815 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0803f030 con 0x7ffb201052e0 2024-09-21T06:43:39.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.263+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb201a88f0 con 0x7ffb201052e0 2024-09-21T06:43:39.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.263+0000 7ffb1d7fa640 1 -- 172.21.15.49:0/534363815 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb08004490 con 0x7ffb201052e0 2024-09-21T06:43:39.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.263+0000 7ffb1d7fa640 1 -- 172.21.15.49:0/534363815 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb08035070 con 0x7ffb201052e0 2024-09-21T06:43:39.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.263+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb201a8dd0 con 0x7ffb201052e0 2024-09-21T06:43:39.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.264+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb2006c1e0 con 0x7ffb201052e0 2024-09-21T06:43:39.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.265+0000 7ffb1d7fa640 1 -- 172.21.15.49:0/534363815 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ffb08042030 con 0x7ffb201052e0 2024-09-21T06:43:39.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.266+0000 7ffb1d7fa640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb0c0b6680 0x7ffb0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.266+0000 7ffb1f7fe640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb0c0b6680 0x7ffb0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.266+0000 7ffb1d7fa640 1 -- 172.21.15.49:0/534363815 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7ffb08107cf0 con 0x7ffb201052e0 2024-09-21T06:43:39.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.267+0000 7ffb1f7fe640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb0c0b6680 0x7ffb0c0b8b90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffb100058c0 tx=0x7ffb10005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:39.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.271+0000 7ffb1d7fa640 1 -- 172.21.15.49:0/534363815 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb0810c070 con 0x7ffb201052e0 2024-09-21T06:43:39.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.495+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb20108a00 con 0x7ffb201052e0 2024-09-21T06:43:39.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.496+0000 7ffb1d7fa640 1 -- 172.21.15.49:0/534363815 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7ffb080ce1f0 con 0x7ffb201052e0 2024-09-21T06:43:39.499 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:43:39.499 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:43:39.499 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:43:39.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb0c0b6680 msgr2=0x7ffb0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb0c0b6680 0x7ffb0c0b8b90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ffb100058c0 tx=0x7ffb10005850 comp rx=0 tx=0).stop 2024-09-21T06:43:39.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 msgr2=0x7ffb20102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 0x7ffb20102d00 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ffb08032fd0 tx=0x7ffb08004270 comp rx=0 tx=0).stop 2024-09-21T06:43:39.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 shutdown_connections 2024-09-21T06:43:39.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb0c0b6680 0x7ffb0c0b8b90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb2010de60 0x7ffb20103240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb201052e0 0x7ffb20102d00 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 --2- 172.21.15.49:0/534363815 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb201048b0 0x7ffb201027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 >> 172.21.15.49:0/534363815 conn(0x7ffb20079750 msgr2=0x7ffb200ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:39.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 shutdown_connections 2024-09-21T06:43:39.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:39.498+0000 7ffb2620a640 1 -- 172.21.15.49:0/534363815 wait complete. 2024-09-21T06:43:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:39 smithi079 ceph-mon[34346]: pgmap v531: 97 pgs: 97 active+clean; 6.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-09-21T06:43:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:39 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/534363815' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:40.158 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:39 smithi049 ceph-mon[31177]: pgmap v531: 97 pgs: 97 active+clean; 6.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-09-21T06:43:40.158 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:39 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/534363815' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:40.189 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:43:40.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:39 smithi098 ceph-mon[34704]: pgmap v531: 97 pgs: 97 active+clean; 6.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-09-21T06:43:40.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:39 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/534363815' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:40.449 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.913+0000 7f773993e640 1 -- 172.21.15.49:0/4011268352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7734109df0 msgr2=0x7f7734110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.913+0000 7f773993e640 1 --2- 172.21.15.49:0/4011268352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7734109df0 0x7f7734110620 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f772c009ca0 tx=0x7f772c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.916 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.913+0000 7f773993e640 1 -- 172.21.15.49:0/4011268352 shutdown_connections 2024-09-21T06:43:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.913+0000 7f773993e640 1 --2- 172.21.15.49:0/4011268352 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7734109df0 0x7f7734110620 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.913+0000 7f773993e640 1 --2- 172.21.15.49:0/4011268352 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f77341094a0 0x7f77341098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.913+0000 7f773993e640 1 --2- 172.21.15.49:0/4011268352 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7734103b60 0x7f7734103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.913+0000 7f773993e640 1 -- 172.21.15.49:0/4011268352 >> 172.21.15.49:0/4011268352 conn(0x7f773407b850 msgr2=0x7f773407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.913+0000 7f773993e640 1 -- 172.21.15.49:0/4011268352 shutdown_connections 2024-09-21T06:43:40.917 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.913+0000 7f773993e640 1 -- 172.21.15.49:0/4011268352 wait complete. 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.914+0000 7f773993e640 1 Processor -- start 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.914+0000 7f773993e640 1 -- start start 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f773993e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734103b60 0x7f773419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f773993e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77341094a0 0x7f773419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f773993e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7734109df0 0x7f773419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f773993e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7734113ab0 con 0x7f77341094a0 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f773993e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7734113930 con 0x7f7734109df0 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f773993e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7734113c30 con 0x7f7734103b60 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f77327fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77341094a0 0x7f773419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f77327fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77341094a0 0x7f773419aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34410/0 (socket says 172.21.15.49:34410) 2024-09-21T06:43:40.919 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f77327fc640 1 -- 172.21.15.49:0/3223971398 learned_addr learned my addr 172.21.15.49:0/3223971398 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f7732ffd640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734103b60 0x7f773419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f77337fe640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7734109df0 0x7f773419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f77327fc640 1 -- 172.21.15.49:0/3223971398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734103b60 msgr2=0x7f773419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f77327fc640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734103b60 0x7f773419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f77327fc640 1 -- 172.21.15.49:0/3223971398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7734109df0 msgr2=0x7f773419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f77327fc640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7734109df0 0x7f773419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.915+0000 7f77327fc640 1 -- 172.21.15.49:0/3223971398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77341a03f0 con 0x7f77341094a0 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.916+0000 7f77327fc640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77341094a0 0x7f773419aa20 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f772800d750 tx=0x7f772800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.916+0000 7f773893c640 1 -- 172.21.15.49:0/3223971398 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728017070 con 0x7f77341094a0 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.916+0000 7f773893c640 1 -- 172.21.15.49:0/3223971398 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77280054d0 con 0x7f77341094a0 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.916+0000 7f773993e640 1 -- 172.21.15.49:0/3223971398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77341a06e0 con 0x7f77341094a0 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.916+0000 7f773893c640 1 -- 172.21.15.49:0/3223971398 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728004c30 con 0x7f77341094a0 2024-09-21T06:43:40.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.916+0000 7f773993e640 1 -- 172.21.15.49:0/3223971398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77341a6e40 con 0x7f77341094a0 2024-09-21T06:43:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f773feb2740 1 Processor -- start 2024-09-21T06:43:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f773feb2740 1 -- start start 2024-09-21T06:43:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f773893c640 1 -- 172.21.15.49:0/3223971398 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f7728004dd0 con 0x7f77341094a0 2024-09-21T06:43:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f773feb2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af9e070 0x56247b3456a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f773feb2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af751b0 0x56247b345be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f773feb2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b346120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f773feb2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56247b2bbea0 con 0x56247af751b0 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f773feb2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56247b2ab2d0 con 0x56247af7d390 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f773feb2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56247b2af0e0 con 0x56247af9e070 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f7732ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af751b0 0x56247b345be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f7732ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af751b0 0x56247b345be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34414/0 (socket says 172.21.15.49:34414) 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f7732ffd640 1 -- 172.21.15.49:0/4164672121 learned_addr learned my addr 172.21.15.49:0/4164672121 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f77337fe640 1 --2- 172.21.15.49:0/4164672121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af9e070 0x56247b3456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.919+0000 7f77327fc640 1 --2- 172.21.15.49:0/4164672121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b346120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f7732ffd640 1 -- 172.21.15.49:0/4164672121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af9e070 msgr2=0x56247b3456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f7732ffd640 1 --2- 172.21.15.49:0/4164672121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af9e070 0x56247b3456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f7732ffd640 1 -- 172.21.15.49:0/4164672121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 msgr2=0x56247b346120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f7732ffd640 1 --2- 172.21.15.49:0/4164672121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b346120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f7732ffd640 1 -- 172.21.15.49:0/4164672121 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56247b009650 con 0x56247af751b0 2024-09-21T06:43:40.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f773893c640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f771c0b6680 0x7f771c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.924 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f7732ffd640 1 --2- 172.21.15.49:0/4164672121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af751b0 0x56247b345be0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f772400bd10 tx=0x7f77240107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3023baccb2eb594a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f77337fe640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f771c0b6680 0x7f771c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f7719ffb640 1 -- 172.21.15.49:0/4164672121 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7724004030 con 0x56247af751b0 2024-09-21T06:43:40.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f7719ffb640 1 -- 172.21.15.49:0/4164672121 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77240035f0 con 0x56247af751b0 2024-09-21T06:43:40.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f773893c640 1 -- 172.21.15.49:0/3223971398 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f77280e70e0 con 0x7f77341094a0 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.920+0000 7f7719ffb640 1 -- 172.21.15.49:0/4164672121 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77240117b0 con 0x56247af751b0 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f773feb2740 1 -- 172.21.15.49:0/4164672121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af751b0 msgr2=0x56247b345be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f77337fe640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f771c0b6680 0x7f771c0b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f772c02f500 tx=0x7f772c02f370 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f773feb2740 1 --2- 172.21.15.49:0/4164672121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af751b0 0x56247b345be0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f772400bd10 tx=0x7f77240107a0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f773feb2740 1 -- 172.21.15.49:0/4164672121 shutdown_connections 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f773feb2740 1 --2- 172.21.15.49:0/4164672121 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b346120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f773feb2740 1 --2- 172.21.15.49:0/4164672121 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af751b0 0x56247b345be0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f773feb2740 1 --2- 172.21.15.49:0/4164672121 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af9e070 0x56247b3456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f773feb2740 1 -- 172.21.15.49:0/4164672121 >> 172.21.15.49:0/4164672121 conn(0x56247af92460 msgr2=0x56247b343590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f773feb2740 1 -- 172.21.15.49:0/4164672121 shutdown_connections 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.921+0000 7f773feb2740 1 -- 172.21.15.49:0/4164672121 wait complete. 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f773feb2740 1 -- start start 2024-09-21T06:43:40.928 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f773feb2740 1 Processor -- start 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f773feb2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b350d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f773feb2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af7d390 0x56247b351270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f773feb2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af9e070 0x56247b3517f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f773feb2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56247b10c700 con 0x56247af7d390 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f773feb2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56247b246160 con 0x56247af9e070 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f773feb2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56247b353f20 con 0x56247af751b0 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f773feb2740 10 client.0 _ll_register_callbacks cb 0x56247b25f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f77327fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af7d390 0x56247b351270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f77327fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af7d390 0x56247b351270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34430/0 (socket says 172.21.15.49:34430) 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.922+0000 7f77327fc640 1 -- 172.21.15.49:0/3345911469 learned_addr learned my addr 172.21.15.49:0/3345911469 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f7732ffd640 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b350d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f77337fe640 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af9e070 0x56247b3517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f77327fc640 1 -- 172.21.15.49:0/3345911469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 msgr2=0x56247b350d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f77327fc640 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b350d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f77327fc640 1 -- 172.21.15.49:0/3345911469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af9e070 msgr2=0x56247b3517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f77327fc640 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af9e070 0x56247b3517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f77327fc640 1 -- 172.21.15.49:0/3345911469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56247b273c90 con 0x56247af7d390 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f77327fc640 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af7d390 0x56247b351270 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f772800d720 tx=0x7f77280acd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dd8bc53e90ca8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f7712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f7712ffd640 1 -- 172.21.15.49:0/3345911469 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7728020070 con 0x56247af7d390 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f7712ffd640 1 -- 172.21.15.49:0/3345911469 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f77280940f0 con 0x56247af7d390 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f773feb2740 1 -- 172.21.15.49:0/3345911469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77240035f0 con 0x56247af7d390 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f7712ffd640 1 -- 172.21.15.49:0/3345911469 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f77280acaa0 con 0x56247af7d390 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.923+0000 7f773feb2740 10 client.17202 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f773feb2740 1 -- 172.21.15.49:0/3345911469 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56247b35fc50 con 0x56247af7d390 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f7712ffd640 1 -- 172.21.15.49:0/3345911469 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77240035f0 con 0x56247af7d390 2024-09-21T06:43:40.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f7712ffd640 1 -- 172.21.15.49:0/3345911469 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f77280e90d0 con 0x56247af7d390 2024-09-21T06:43:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f773feb2740 10 client.17202 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f773feb2740 10 client.17202 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:43:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f773feb2740 20 client.17202 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f773feb2740 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x56247af5c9f0 0x56247b363130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f773feb2740 4 client.17202 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f773feb2740 1 -- 172.21.15.49:0/3345911469 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56247b2bddf0 con 0x56247af5c9f0 2024-09-21T06:43:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.924+0000 7f7732ffd640 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x56247af5c9f0 0x56247b363130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.925+0000 7f7712ffd640 10 client.17202 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:43:40.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.925+0000 7f7732ffd640 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x56247af5c9f0 0x56247b363130 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ee58545698b46b1f server_cookie=9b482ba9d13707f7 in_seq=0 out_seq=0 2024-09-21T06:43:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.925+0000 7f7712ffd640 1 -- 172.21.15.49:0/3345911469 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56247b2bddf0 con 0x56247af5c9f0 2024-09-21T06:43:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.925+0000 7f7712ffd640 10 client.17202 handle_command_reply: tid=0 2024-09-21T06:43:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 client.17202 shutdown 2024-09-21T06:43:40.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 -- 172.21.15.49:0/3345911469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af7d390 msgr2=0x56247b351270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af7d390 0x56247b351270 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f772800d720 tx=0x7f77280acd60 comp rx=0 tx=0).stop 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 -- 172.21.15.49:0/3345911469 shutdown_connections 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x56247af5c9f0 0x56247b363130 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af9e070 0x56247b3517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af7d390 0x56247b351270 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f7712ffd640 0 client.17202 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 --2- 172.21.15.49:0/3345911469 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b350d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 -- 172.21.15.49:0/3345911469 >> 172.21.15.49:0/3345911469 conn(0x56247af92460 msgr2=0x56247b347090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 -- 172.21.15.49:0/3345911469 shutdown_connections 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 1 -- 172.21.15.49:0/3345911469 wait complete. 2024-09-21T06:43:40.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.926+0000 7f773feb2740 20 client.17202 trim_cache size 0 max 16384 2024-09-21T06:43:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.939+0000 7f773feb2740 1 Processor -- start 2024-09-21T06:43:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.939+0000 7f773feb2740 1 -- start start 2024-09-21T06:43:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f773feb2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b34c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f773feb2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b3435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f773feb2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b34df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f773feb2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f77341b2130 con 0x56247af9e070 2024-09-21T06:43:40.943 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f773feb2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f77341afa00 con 0x56247af7d390 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f773feb2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f77341ad870 con 0x56247af751b0 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77337fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b34df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77337fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b34df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34434/0 (socket says 172.21.15.49:34434) 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77337fe640 1 -- 172.21.15.49:0/602508051 learned_addr learned my addr 172.21.15.49:0/602508051 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77327fc640 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b3435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f7732ffd640 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b34c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77337fe640 1 -- 172.21.15.49:0/602508051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 msgr2=0x56247b34c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77337fe640 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b34c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77337fe640 1 -- 172.21.15.49:0/602508051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 msgr2=0x56247b3435c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77337fe640 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b3435c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77337fe640 1 -- 172.21.15.49:0/602508051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56247b34f230 con 0x56247af9e070 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77327fc640 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b3435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.940+0000 7f77337fe640 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b34df20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f772c035000 tx=0x7f772c041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b52416d7d445d04 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f77197fa640 1 -- 172.21.15.49:0/602508051 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c02f660 con 0x56247af9e070 2024-09-21T06:43:40.944 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f77197fa640 1 -- 172.21.15.49:0/602508051 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f772c036050 con 0x56247af9e070 2024-09-21T06:43:40.945 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f77197fa640 1 -- 172.21.15.49:0/602508051 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c030b30 con 0x56247af9e070 2024-09-21T06:43:40.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f773feb2740 1 -- 172.21.15.49:0/602508051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 msgr2=0x56247b34df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f773feb2740 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b34df20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f772c035000 tx=0x7f772c041000 comp rx=0 tx=0).stop 2024-09-21T06:43:40.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f773feb2740 1 -- 172.21.15.49:0/602508051 shutdown_connections 2024-09-21T06:43:40.947 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f773feb2740 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b34df20 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f773feb2740 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b3435c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f773feb2740 1 --2- 172.21.15.49:0/602508051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b34c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.941+0000 7f773feb2740 1 -- 172.21.15.49:0/602508051 >> 172.21.15.49:0/602508051 conn(0x56247af92460 msgr2=0x56247b342eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.942+0000 7f773feb2740 1 -- 172.21.15.49:0/602508051 shutdown_connections 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.942+0000 7f773feb2740 1 -- 172.21.15.49:0/602508051 wait complete. 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.942+0000 7f773feb2740 1 -- start start 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.942+0000 7f773feb2740 1 Processor -- start 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.942+0000 7f773feb2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b3553b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f773feb2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b3558f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f773feb2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b355e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f773feb2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f77341adec0 con 0x56247af9e070 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f773feb2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f77341af330 con 0x56247af7d390 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f773feb2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f77341ae590 con 0x56247af751b0 2024-09-21T06:43:40.948 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f773feb2740 10 client.0 _ll_register_callbacks cb 0x7f77280046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77337fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b355e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77337fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b355e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34442/0 (socket says 172.21.15.49:34442) 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77337fe640 1 -- 172.21.15.49:0/526887669 learned_addr learned my addr 172.21.15.49:0/526887669 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77327fc640 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b3558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f7732ffd640 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b3553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77337fe640 1 -- 172.21.15.49:0/526887669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 msgr2=0x56247b3553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77337fe640 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b3553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77337fe640 1 -- 172.21.15.49:0/526887669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 msgr2=0x56247b3558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77337fe640 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b3558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77337fe640 1 -- 172.21.15.49:0/526887669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56247b3d1100 con 0x56247af9e070 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f77337fe640 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b355e30 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f772c043040 tx=0x7f772c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f0f6127192a0fe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f7712ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.943+0000 7f7712ffd640 1 -- 172.21.15.49:0/526887669 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c061060 con 0x56247af9e070 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f7712ffd640 1 -- 172.21.15.49:0/526887669 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f772c02f870 con 0x56247af9e070 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f773feb2740 1 -- 172.21.15.49:0/526887669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f772c036050 con 0x56247af9e070 2024-09-21T06:43:40.949 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f7712ffd640 1 -- 172.21.15.49:0/526887669 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f772c031cd0 con 0x56247af9e070 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f773feb2740 10 client.17208 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f773feb2740 1 -- 172.21.15.49:0/526887669 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56247b3d2360 con 0x56247af9e070 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f7712ffd640 1 -- 172.21.15.49:0/526887669 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f772c036050 con 0x56247af9e070 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f7712ffd640 1 -- 172.21.15.49:0/526887669 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f772c049b00 con 0x56247af9e070 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f773feb2740 10 client.17208 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f773feb2740 10 client.17208 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f773feb2740 20 client.17208 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f773feb2740 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x56247af31da0 0x56247b3d4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f773feb2740 4 client.17208 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f773feb2740 1 -- 172.21.15.49:0/526887669 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56247b2b98a0 con 0x56247af31da0 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.944+0000 7f7732ffd640 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x56247af31da0 0x56247b3d4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f7732ffd640 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x56247af31da0 0x56247b3d4ac0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b3055da37e80e9d server_cookie=76cf5c0bf40c8195 in_seq=0 out_seq=0 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f7712ffd640 10 client.17208 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f7712ffd640 1 -- 172.21.15.49:0/526887669 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56247b2b98a0 con 0x56247af31da0 2024-09-21T06:43:40.950 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f7712ffd640 10 client.17208 handle_command_reply: tid=0 2024-09-21T06:43:40.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f773feb2740 1 client.17208 shutdown 2024-09-21T06:43:40.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f773feb2740 1 -- 172.21.15.49:0/526887669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 msgr2=0x56247b355e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.951 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f773feb2740 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b355e30 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f772c043040 tx=0x7f772c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f773feb2740 1 -- 172.21.15.49:0/526887669 shutdown_connections 2024-09-21T06:43:40.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f773feb2740 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x56247af31da0 0x56247b3d4ac0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f773feb2740 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56247af9e070 0x56247b355e30 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f773feb2740 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56247af7d390 0x56247b3558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f773feb2740 1 --2- 172.21.15.49:0/526887669 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56247af751b0 0x56247b3553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f773feb2740 1 -- 172.21.15.49:0/526887669 >> 172.21.15.49:0/526887669 conn(0x56247af92460 msgr2=0x56247b35c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.952 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.945+0000 7f7712ffd640 0 client.17208 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:43:40.952 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773feb2740 1 -- 172.21.15.49:0/526887669 shutdown_connections 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773feb2740 1 -- 172.21.15.49:0/526887669 wait complete. 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773feb2740 20 client.17208 trim_cache size 0 max 16384 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 -- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f771c0b6680 msgr2=0x7f771c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f771c0b6680 0x7f771c0b8b90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f772c02f500 tx=0x7f772c02f370 comp rx=0 tx=0).stop 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 -- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77341094a0 msgr2=0x7f773419aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77341094a0 0x7f773419aa20 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f772800d750 tx=0x7f772800dc10 comp rx=0 tx=0).stop 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 -- 172.21.15.49:0/3223971398 shutdown_connections 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f771c0b6680 0x7f771c0b8b90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7734109df0 0x7f773419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f77341094a0 0x7f773419aa20 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.953 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 --2- 172.21.15.49:0/3223971398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7734103b60 0x7f773419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 -- 172.21.15.49:0/3223971398 >> 172.21.15.49:0/3223971398 conn(0x7f773407b850 msgr2=0x7f7734107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.946+0000 7f773993e640 1 -- 172.21.15.49:0/3223971398 shutdown_connections 2024-09-21T06:43:40.954 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:40.947+0000 7f773993e640 1 -- 172.21.15.49:0/3223971398 wait complete. 2024-09-21T06:43:41.682 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:43:41.952 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:41.967 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:41 smithi049 ceph-mon[31177]: pgmap v532: 97 pgs: 97 active+clean; 6.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T06:43:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:41 smithi079 ceph-mon[34346]: pgmap v532: 97 pgs: 97 active+clean; 6.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T06:43:42.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:41 smithi098 ceph-mon[34704]: pgmap v532: 97 pgs: 97 active+clean; 6.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T06:43:42.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.426+0000 7ff7b9412640 1 -- 172.21.15.49:0/3697237117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 msgr2=0x7ff7b4104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.426+0000 7ff7b9412640 1 --2- 172.21.15.49:0/3697237117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 0x7ff7b4104e40 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4009900 tx=0x7ff7a402a410 comp rx=0 tx=0).stop 2024-09-21T06:43:42.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.426+0000 7ff7b9412640 1 -- 172.21.15.49:0/3697237117 shutdown_connections 2024-09-21T06:43:42.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.426+0000 7ff7b9412640 1 --2- 172.21.15.49:0/3697237117 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b410de60 0x7ff7b4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.431 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.426+0000 7ff7b9412640 1 --2- 172.21.15.49:0/3697237117 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4105380 0x7ff7b410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.426+0000 7ff7b9412640 1 --2- 172.21.15.49:0/3697237117 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 0x7ff7b4104e40 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.426+0000 7ff7b9412640 1 -- 172.21.15.49:0/3697237117 >> 172.21.15.49:0/3697237117 conn(0x7ff7b40797b0 msgr2=0x7ff7b4079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.426+0000 7ff7b9412640 1 -- 172.21.15.49:0/3697237117 shutdown_connections 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.426+0000 7ff7b9412640 1 -- 172.21.15.49:0/3697237117 wait complete. 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.427+0000 7ff7b9412640 1 Processor -- start 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b9412640 1 -- start start 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b9412640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 0x7ff7b419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b9412640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4105380 0x7ff7b419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b9412640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b410de60 0x7ff7b419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b9412640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b4113aa0 con 0x7ff7b4104a30 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b9412640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b4113920 con 0x7ff7b410de60 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b9412640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b4113c20 con 0x7ff7b4105380 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 0x7ff7b419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 0x7ff7b419a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34448/0 (socket says 172.21.15.49:34448) 2024-09-21T06:43:42.432 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b2ffd640 1 -- 172.21.15.49:0/2002604969 learned_addr learned my addr 172.21.15.49:0/2002604969 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4105380 0x7ff7b419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.428+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b410de60 0x7ff7b419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff7b2ffd640 1 -- 172.21.15.49:0/2002604969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4105380 msgr2=0x7ff7b419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff7b2ffd640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4105380 0x7ff7b419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff7b2ffd640 1 -- 172.21.15.49:0/2002604969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b410de60 msgr2=0x7ff7b419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff7b2ffd640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b410de60 0x7ff7b419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff7b2ffd640 1 -- 172.21.15.49:0/2002604969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b41a0480 con 0x7ff7b4104a30 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b410de60 0x7ff7b419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff7b2ffd640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 0x7ff7b419a510 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4005940 tx=0x7ff7a4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff79bfff640 1 -- 172.21.15.49:0/2002604969 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a403f030 con 0x7ff7b4104a30 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff7b9412640 1 -- 172.21.15.49:0/2002604969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b41a0710 con 0x7ff7b4104a30 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff79bfff640 1 -- 172.21.15.49:0/2002604969 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7a4003aa0 con 0x7ff7b4104a30 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff79bfff640 1 -- 172.21.15.49:0/2002604969 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a4035070 con 0x7ff7b4104a30 2024-09-21T06:43:42.433 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.429+0000 7ff7b9412640 1 -- 172.21.15.49:0/2002604969 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7b41a6ed0 con 0x7ff7b4104a30 2024-09-21T06:43:42.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.432+0000 7ff7bf986740 1 Processor -- start 2024-09-21T06:43:42.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.432+0000 7ff7bf986740 1 -- start start 2024-09-21T06:43:42.434 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.432+0000 7ff79bfff640 1 -- 172.21.15.49:0/2002604969 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ff7a4042030 con 0x7ff7b4104a30 2024-09-21T06:43:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.432+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0995070 0x562ed0d3c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.432+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed096c1b0 0x562ed0d3c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.435 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.432+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d3cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.432+0000 7ff7bf986740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562ed0cb2ea0 con 0x562ed0995070 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.432+0000 7ff7bf986740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ed0ca22d0 con 0x562ed096c1b0 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.432+0000 7ff7bf986740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ed0ca60e0 con 0x562ed0974390 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0995070 0x562ed0d3c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0995070 0x562ed0d3c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34450/0 (socket says 172.21.15.49:34450) 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b37fe640 1 -- 172.21.15.49:0/3503336135 learned_addr learned my addr 172.21.15.49:0/3503336135 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b2ffd640 1 --2- 172.21.15.49:0/3503336135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed096c1b0 0x562ed0d3c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/3503336135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d3cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b37fe640 1 -- 172.21.15.49:0/3503336135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 msgr2=0x562ed0d3cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/3503336135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d3cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b37fe640 1 -- 172.21.15.49:0/3503336135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed096c1b0 msgr2=0x562ed0d3c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/3503336135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed096c1b0 0x562ed0d3c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b37fe640 1 -- 172.21.15.49:0/3503336135 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ed0a00650 con 0x562ed0995070 2024-09-21T06:43:42.436 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/3503336135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0995070 0x562ed0d3c2c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009fd0 tx=0x7ff7ac010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a687199545275c13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.433+0000 7ff79bfff640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff79c0b6680 0x7ff79c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.434+0000 7ff7997fa640 1 -- 172.21.15.49:0/3503336135 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac011700 con 0x562ed0995070 2024-09-21T06:43:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.434+0000 7ff7997fa640 1 -- 172.21.15.49:0/3503336135 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7ac011d50 con 0x562ed0995070 2024-09-21T06:43:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.434+0000 7ff7997fa640 1 -- 172.21.15.49:0/3503336135 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00e3c0 con 0x562ed0995070 2024-09-21T06:43:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.434+0000 7ff79bfff640 1 -- 172.21.15.49:0/2002604969 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7ff7a4107600 con 0x7ff7b4104a30 2024-09-21T06:43:42.437 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.434+0000 7ff7b2ffd640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff79c0b6680 0x7ff79c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 -- 172.21.15.49:0/3503336135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0995070 msgr2=0x562ed0d3c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 --2- 172.21.15.49:0/3503336135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0995070 0x562ed0d3c2c0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009fd0 tx=0x7ff7ac010860 comp rx=0 tx=0).stop 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7b2ffd640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff79c0b6680 0x7ff79c0b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4104db0 tx=0x7ff7a402a410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 -- 172.21.15.49:0/3503336135 shutdown_connections 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 --2- 172.21.15.49:0/3503336135 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d3cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 --2- 172.21.15.49:0/3503336135 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed096c1b0 0x562ed0d3c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 --2- 172.21.15.49:0/3503336135 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0995070 0x562ed0d3c2c0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 -- 172.21.15.49:0/3503336135 >> 172.21.15.49:0/3503336135 conn(0x562ed0989460 msgr2=0x562ed0d3a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 -- 172.21.15.49:0/3503336135 shutdown_connections 2024-09-21T06:43:42.440 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 -- 172.21.15.49:0/3503336135 wait complete. 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 -- start start 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.435+0000 7ff7bf986740 1 Processor -- start 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed096c1b0 0x562ed0d4c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0974390 0x562ed0d4cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d51c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7bf986740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562ed0b03700 con 0x562ed0974390 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7bf986740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ed0c3d160 con 0x562ed0995070 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7bf986740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ed0d4aaa0 con 0x562ed096c1b0 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7bf986740 10 client.0 _ll_register_callbacks cb 0x562ed0c569e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b27fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0974390 0x562ed0d4cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b27fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0974390 0x562ed0d4cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34466/0 (socket says 172.21.15.49:34466) 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b27fc640 1 -- 172.21.15.49:0/4245389545 learned_addr learned my addr 172.21.15.49:0/4245389545 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed096c1b0 0x562ed0d4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d51c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b27fc640 1 -- 172.21.15.49:0/4245389545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed096c1b0 msgr2=0x562ed0d4c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed096c1b0 0x562ed0d4c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b27fc640 1 -- 172.21.15.49:0/4245389545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 msgr2=0x562ed0d51c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d51c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b27fc640 1 -- 172.21.15.49:0/4245389545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ed0c6ac90 con 0x562ed0974390 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d51c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0974390 0x562ed0d4cc60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8012700 tx=0x7ff7a800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246d44ea71da93f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.436+0000 7ff796ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff796ff5640 1 -- 172.21.15.49:0/4245389545 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a801f060 con 0x562ed0974390 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff796ff5640 1 -- 172.21.15.49:0/4245389545 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7ff7a8010dc0 con 0x562ed0974390 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff7bf986740 1 -- 172.21.15.49:0/4245389545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7ac011d50 con 0x562ed0974390 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff796ff5640 1 -- 172.21.15.49:0/4245389545 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7a801a430 con 0x562ed0974390 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff7bf986740 10 client.17220 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff7bf986740 1 -- 172.21.15.49:0/4245389545 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562ed0d5ac30 con 0x562ed0974390 2024-09-21T06:43:42.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff796ff5640 1 -- 172.21.15.49:0/4245389545 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7ac011d50 con 0x562ed0974390 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff796ff5640 1 -- 172.21.15.49:0/4245389545 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff7a800e5e0 con 0x562ed0974390 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff7bf986740 10 client.17220 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff7bf986740 10 client.17220 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.437+0000 7ff7bf986740 20 client.17220 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.438+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x562ed09539f0 0x562ed0d5e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.438+0000 7ff7bf986740 4 client.17220 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.438+0000 7ff7bf986740 1 -- 172.21.15.49:0/4245389545 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ed0cb4df0 con 0x562ed09539f0 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.438+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x562ed09539f0 0x562ed0d5e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.438+0000 7ff796ff5640 10 client.17220 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:43:42.443 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.438+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x562ed09539f0 0x562ed0d5e150 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f64c21822730670 server_cookie=fd3e61089fb37d81 in_seq=0 out_seq=0 2024-09-21T06:43:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff796ff5640 1 -- 172.21.15.49:0/4245389545 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ed0cb4df0 con 0x562ed09539f0 2024-09-21T06:43:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff796ff5640 10 client.17220 handle_command_reply: tid=0 2024-09-21T06:43:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 client.17220 shutdown 2024-09-21T06:43:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 -- 172.21.15.49:0/4245389545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0974390 msgr2=0x562ed0d4cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.444 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0974390 0x562ed0d4cc60 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7ff7a8012700 tx=0x7ff7a800af90 comp rx=0 tx=0).stop 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 -- 172.21.15.49:0/4245389545 shutdown_connections 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x562ed09539f0 0x562ed0d5e150 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d51c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed0974390 0x562ed0d4cc60 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4245389545 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed096c1b0 0x562ed0d4c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 -- 172.21.15.49:0/4245389545 >> 172.21.15.49:0/4245389545 conn(0x562ed0989460 msgr2=0x562ed0d3f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff796ff5640 0 client.17220 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.439+0000 7ff7bf986740 1 -- 172.21.15.49:0/4245389545 shutdown_connections 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.440+0000 7ff7bf986740 1 -- 172.21.15.49:0/4245389545 wait complete. 2024-09-21T06:43:42.445 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.440+0000 7ff7bf986740 20 client.17220 trim_cache size 0 max 16384 2024-09-21T06:43:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7bf986740 1 Processor -- start 2024-09-21T06:43:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7bf986740 1 -- start start 2024-09-21T06:43:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d4ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d52300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d3f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7bf986740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41b0000 con 0x562ed096c1b0 2024-09-21T06:43:42.455 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7bf986740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41ad8d0 con 0x562ed0995070 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7bf986740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41ab740 con 0x562ed0974390 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d4ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d4ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34480/0 (socket says 172.21.15.49:34480) 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7b37fe640 1 -- 172.21.15.49:0/4135810096 learned_addr learned my addr 172.21.15.49:0/4135810096 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.453+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/4135810096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d52300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.454+0000 7ff7b37fe640 1 -- 172.21.15.49:0/4135810096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 msgr2=0x562ed0d52300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.454+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/4135810096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d52300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.454+0000 7ff7b37fe640 1 -- 172.21.15.49:0/4135810096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 msgr2=0x562ed0d3f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.454+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/4135810096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d3f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.454+0000 7ff7b37fe640 1 -- 172.21.15.49:0/4135810096 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ed0d5e6b0 con 0x562ed096c1b0 2024-09-21T06:43:42.456 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.454+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/4135810096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d4ccf0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac01b9e0 tx=0x7ff7ac010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7854ed2e3e21f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.454+0000 7ff798ff9640 1 -- 172.21.15.49:0/4135810096 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac024040 con 0x562ed096c1b0 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.454+0000 7ff798ff9640 1 -- 172.21.15.49:0/4135810096 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7ac011bb0 con 0x562ed096c1b0 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.454+0000 7ff798ff9640 1 -- 172.21.15.49:0/4135810096 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac02c9d0 con 0x562ed096c1b0 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 -- 172.21.15.49:0/4135810096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 msgr2=0x562ed0d4ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4135810096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d4ccf0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac01b9e0 tx=0x7ff7ac010fd0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 -- 172.21.15.49:0/4135810096 shutdown_connections 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4135810096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d3f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4135810096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d52300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 --2- 172.21.15.49:0/4135810096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d4ccf0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 -- 172.21.15.49:0/4135810096 >> 172.21.15.49:0/4135810096 conn(0x562ed0989460 msgr2=0x562ed0d51bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 -- 172.21.15.49:0/4135810096 shutdown_connections 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 -- 172.21.15.49:0/4135810096 wait complete. 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.455+0000 7ff7bf986740 1 -- start start 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7bf986740 1 Processor -- start 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d585d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d58b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7bf986740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d53c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7bf986740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41abd90 con 0x562ed096c1b0 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7bf986740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41ad200 con 0x562ed0995070 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7bf986740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b41ac460 con 0x562ed0974390 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7bf986740 10 client.0 _ll_register_callbacks cb 0x7ff7a800a590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d585d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34488/0 (socket says 172.21.15.49:34488) 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b37fe640 1 -- 172.21.15.49:0/1699672051 learned_addr learned my addr 172.21.15.49:0/1699672051 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d53c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d58b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b37fe640 1 -- 172.21.15.49:0/1699672051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 msgr2=0x562ed0d58b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d58b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b37fe640 1 -- 172.21.15.49:0/1699672051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 msgr2=0x562ed0d53c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d53c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b37fe640 1 -- 172.21.15.49:0/1699672051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ed0d543c0 con 0x562ed096c1b0 2024-09-21T06:43:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.456+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d58b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.457+0000 7ff7b37fe640 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d585d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009f20 tx=0x7ff7ac0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd31afad1d4fe38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.457+0000 7ff796ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.457+0000 7ff796ff5640 1 -- 172.21.15.49:0/1699672051 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac037040 con 0x562ed096c1b0 2024-09-21T06:43:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.457+0000 7ff796ff5640 1 -- 172.21.15.49:0/1699672051 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7ff7ac011500 con 0x562ed096c1b0 2024-09-21T06:43:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.457+0000 7ff7bf986740 1 -- 172.21.15.49:0/1699672051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7ac011bb0 con 0x562ed096c1b0 2024-09-21T06:43:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.457+0000 7ff796ff5640 1 -- 172.21.15.49:0/1699672051 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff7ac011700 con 0x562ed096c1b0 2024-09-21T06:43:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.457+0000 7ff7bf986740 10 client.17226 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:42.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.457+0000 7ff7bf986740 1 -- 172.21.15.49:0/1699672051 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562ed0dc86d0 con 0x562ed096c1b0 2024-09-21T06:43:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.457+0000 7ff796ff5640 1 -- 172.21.15.49:0/1699672051 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7ac011bb0 con 0x562ed096c1b0 2024-09-21T06:43:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff796ff5640 1 -- 172.21.15.49:0/1699672051 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff7ac03d070 con 0x562ed096c1b0 2024-09-21T06:43:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff7bf986740 10 client.17226 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff7bf986740 10 client.17226 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff7bf986740 20 client.17226 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff7bf986740 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x562ed0928da0 0x562ed0dcabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff7bf986740 4 client.17226 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:42.463 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff7bf986740 1 -- 172.21.15.49:0/1699672051 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562ed0cb08a0 con 0x562ed0928da0 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x562ed0928da0 0x562ed0dcabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff796ff5640 10 client.17226 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.458+0000 7ff7b27fc640 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x562ed0928da0 0x562ed0dcabe0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bacc5eb4138c48d4 server_cookie=65c0a75bff562536 in_seq=0 out_seq=0 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff796ff5640 1 -- 172.21.15.49:0/1699672051 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562ed0cb08a0 con 0x562ed0928da0 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff796ff5640 10 client.17226 handle_command_reply: tid=0 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 client.17226 shutdown 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 -- 172.21.15.49:0/1699672051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 msgr2=0x562ed0d585d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d585d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009f20 tx=0x7ff7ac0096c0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 -- 172.21.15.49:0/1699672051 shutdown_connections 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x562ed0928da0 0x562ed0dcabe0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ed0995070 0x562ed0d53c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ed0974390 0x562ed0d58b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 --2- 172.21.15.49:0/1699672051 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ed096c1b0 0x562ed0d585d0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 -- 172.21.15.49:0/1699672051 >> 172.21.15.49:0/1699672051 conn(0x562ed0989460 msgr2=0x562ed0d3f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff796ff5640 0 client.17226 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:43:42.464 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 -- 172.21.15.49:0/1699672051 shutdown_connections 2024-09-21T06:43:42.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 1 -- 172.21.15.49:0/1699672051 wait complete. 2024-09-21T06:43:42.465 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.459+0000 7ff7bf986740 20 client.17226 trim_cache size 0 max 16384 2024-09-21T06:43:42.465 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 -- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff79c0b6680 msgr2=0x7ff79c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff79c0b6680 0x7ff79c0b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4104db0 tx=0x7ff7a402a410 comp rx=0 tx=0).stop 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 -- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 msgr2=0x7ff7b419a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 0x7ff7b419a510 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4005940 tx=0x7ff7a4004270 comp rx=0 tx=0).stop 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 -- 172.21.15.49:0/2002604969 shutdown_connections 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff79c0b6680 0x7ff79c0b8b90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff7b410de60 0x7ff7b419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff7b4105380 0x7ff7b419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 --2- 172.21.15.49:0/2002604969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff7b4104a30 0x7ff7b419a510 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 -- 172.21.15.49:0/2002604969 >> 172.21.15.49:0/2002604969 conn(0x7ff7b40797b0 msgr2=0x7ff7b41008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 -- 172.21.15.49:0/2002604969 shutdown_connections 2024-09-21T06:43:42.466 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:42.460+0000 7ff7b9412640 1 -- 172.21.15.49:0/2002604969 wait complete. 2024-09-21T06:43:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.980+0000 7efd62870640 1 -- 172.21.15.49:0/698143896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c10dd90 msgr2=0x7efd5c110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.980+0000 7efd62870640 1 --2- 172.21.15.49:0/698143896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c10dd90 0x7efd5c110270 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7efd54009ca0 tx=0x7efd5402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.980+0000 7efd62870640 1 -- 172.21.15.49:0/698143896 shutdown_connections 2024-09-21T06:43:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.980+0000 7efd62870640 1 --2- 172.21.15.49:0/698143896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c10dd90 0x7efd5c110270 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.980+0000 7efd62870640 1 --2- 172.21.15.49:0/698143896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c1052c0 0x7efd5c10d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.980+0000 7efd62870640 1 --2- 172.21.15.49:0/698143896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c104970 0x7efd5c104d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.980+0000 7efd62870640 1 -- 172.21.15.49:0/698143896 >> 172.21.15.49:0/698143896 conn(0x7efd5c0fe3c0 msgr2=0x7efd5c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.980+0000 7efd62870640 1 -- 172.21.15.49:0/698143896 shutdown_connections 2024-09-21T06:43:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.980+0000 7efd62870640 1 -- 172.21.15.49:0/698143896 wait complete. 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.981+0000 7efd62870640 1 Processor -- start 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.981+0000 7efd62870640 1 -- start start 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd62870640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c104970 0x7efd5c19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd62870640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c1052c0 0x7efd5c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd62870640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c10dd90 0x7efd5c19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd62870640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1139e0 con 0x7efd5c104970 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd62870640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c113860 con 0x7efd5c10dd90 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd62870640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c113b60 con 0x7efd5c1052c0 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c104970 0x7efd5c19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c104970 0x7efd5c19a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34502/0 (socket says 172.21.15.49:34502) 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5bfff640 1 -- 172.21.15.49:0/4218441998 learned_addr learned my addr 172.21.15.49:0/4218441998 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:42.985 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c1052c0 0x7efd5c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd60e0d640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c10dd90 0x7efd5c19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5bfff640 1 -- 172.21.15.49:0/4218441998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c1052c0 msgr2=0x7efd5c19a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5bfff640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c1052c0 0x7efd5c19a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5bfff640 1 -- 172.21.15.49:0/4218441998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c10dd90 msgr2=0x7efd5c19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5bfff640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c10dd90 0x7efd5c19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5bfff640 1 -- 172.21.15.49:0/4218441998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5c1a02b0 con 0x7efd5c104970 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd60e0d640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c10dd90 0x7efd5c19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.982+0000 7efd5bfff640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c104970 0x7efd5c19a380 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00e9f0 tx=0x7efd4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.983+0000 7efd597fa640 1 -- 172.21.15.49:0/4218441998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c00cd80 con 0x7efd5c104970 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.983+0000 7efd62870640 1 -- 172.21.15.49:0/4218441998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5c1a05a0 con 0x7efd5c104970 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.983+0000 7efd597fa640 1 -- 172.21.15.49:0/4218441998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd4c0108e0 con 0x7efd5c104970 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.983+0000 7efd597fa640 1 -- 172.21.15.49:0/4218441998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c018980 con 0x7efd5c104970 2024-09-21T06:43:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.983+0000 7efd62870640 1 -- 172.21.15.49:0/4218441998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5c1a6d30 con 0x7efd5c104970 2024-09-21T06:43:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.986+0000 7efd597fa640 1 -- 172.21.15.49:0/4218441998 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7efd4c010430 con 0x7efd5c104970 2024-09-21T06:43:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.986+0000 7efd697db740 1 Processor -- start 2024-09-21T06:43:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.986+0000 7efd697db740 1 -- start start 2024-09-21T06:43:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.986+0000 7efd597fa640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efd440b6680 0x7efd440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd697db740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423919b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd697db740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 0x561442391ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd697db740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fcb4d0 0x561442392430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd697db740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5614423066f0 con 0x561441fec1b0 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd697db740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5614422f5b20 con 0x561441fcb4d0 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd697db740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5614422f9930 con 0x561441fc32f0 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd597fa640 1 -- 172.21.15.49:0/4218441998 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7efd4c0e7b50 con 0x7efd5c104970 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd60e0d640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efd440b6680 0x7efd440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423919b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34506/0 (socket says 172.21.15.49:34506) 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5bfff640 1 -- 172.21.15.49:0/4153311198 learned_addr learned my addr 172.21.15.49:0/4153311198 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/4153311198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 0x561442391ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5bfff640 1 -- 172.21.15.49:0/4153311198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 msgr2=0x561442391ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5bfff640 1 --2- 172.21.15.49:0/4153311198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 0x561442391ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5bfff640 1 -- 172.21.15.49:0/4153311198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fcb4d0 msgr2=0x561442392430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5bfff640 1 --2- 172.21.15.49:0/4153311198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fcb4d0 0x561442392430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5bfff640 1 -- 172.21.15.49:0/4153311198 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614422bb530 con 0x561441fec1b0 2024-09-21T06:43:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/4153311198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 0x561442391ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd60e0d640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efd440b6680 0x7efd440b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efd54006010 tx=0x7efd540094a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.987+0000 7efd5bfff640 1 --2- 172.21.15.49:0/4153311198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423919b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0a9f20 tx=0x7efd4c0aa0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f6a046834e7d61e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.988+0000 7efd427fc640 1 -- 172.21.15.49:0/4153311198 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c0615e0 con 0x561441fec1b0 2024-09-21T06:43:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.988+0000 7efd427fc640 1 -- 172.21.15.49:0/4153311198 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd4c010720 con 0x561441fec1b0 2024-09-21T06:43:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.988+0000 7efd427fc640 1 -- 172.21.15.49:0/4153311198 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd4c0a9070 con 0x561441fec1b0 2024-09-21T06:43:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.988+0000 7efd697db740 1 -- 172.21.15.49:0/4153311198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 msgr2=0x5614423919b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.988+0000 7efd697db740 1 --2- 172.21.15.49:0/4153311198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423919b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0a9f20 tx=0x7efd4c0aa0c0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.989+0000 7efd697db740 1 -- 172.21.15.49:0/4153311198 shutdown_connections 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.989+0000 7efd697db740 1 --2- 172.21.15.49:0/4153311198 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fcb4d0 0x561442392430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.989+0000 7efd697db740 1 --2- 172.21.15.49:0/4153311198 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 0x561442391ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.989+0000 7efd697db740 1 --2- 172.21.15.49:0/4153311198 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423919b0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.989+0000 7efd697db740 1 -- 172.21.15.49:0/4153311198 >> 172.21.15.49:0/4153311198 conn(0x561441fe0300 msgr2=0x56144238f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.989+0000 7efd697db740 1 -- 172.21.15.49:0/4153311198 shutdown_connections 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.989+0000 7efd697db740 1 -- 172.21.15.49:0/4153311198 wait complete. 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.989+0000 7efd697db740 1 -- start start 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.989+0000 7efd697db740 1 Processor -- start 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd697db740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 0x56144239cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd697db740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd697db740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fec1b0 0x56144239da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd697db740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56144222dab0 con 0x561441fcb4d0 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd697db740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56144229b730 con 0x561441fec1b0 2024-09-21T06:43:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd697db740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5614423a0130 con 0x561441fc32f0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd697db740 10 client.0 _ll_register_callbacks cb 0x5614422ef6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd5b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd5b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34522/0 (socket says 172.21.15.49:34522) 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd5b7fe640 1 -- 172.21.15.49:0/1828247937 learned_addr learned my addr 172.21.15.49:0/1828247937 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd5bfff640 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 0x56144239cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd60e0d640 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fec1b0 0x56144239da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd5b7fe640 1 -- 172.21.15.49:0/1828247937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 msgr2=0x56144239cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 0x56144239cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd5b7fe640 1 -- 172.21.15.49:0/1828247937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fec1b0 msgr2=0x56144239da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fec1b0 0x56144239da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.990+0000 7efd5b7fe640 1 -- 172.21.15.49:0/1828247937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561442057790 con 0x561441fcb4d0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239d4d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7efd5c06c960 tx=0x7efd500118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dba73f9413ffbd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1828247937 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50004020 con 0x561441fcb4d0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1828247937 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7efd500041c0 con 0x561441fcb4d0 2024-09-21T06:43:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd697db740 1 -- 172.21.15.49:0/1828247937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561442308640 con 0x561441fcb4d0 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1828247937 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd500043c0 con 0x561441fcb4d0 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd697db740 10 client.17238 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd697db740 1 -- 172.21.15.49:0/1828247937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5614420d0620 con 0x561441fcb4d0 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1828247937 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561442308640 con 0x561441fcb4d0 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.991+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1828247937 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7efd50004bb0 con 0x561441fcb4d0 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.992+0000 7efd697db740 10 client.17238 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.992+0000 7efd697db740 10 client.17238 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.992+0000 7efd697db740 20 client.17238 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.992+0000 7efd697db740 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561441faad80 0x5614423af290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.992+0000 7efd697db740 4 client.17238 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.992+0000 7efd697db740 1 -- 172.21.15.49:0/1828247937 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614423040f0 con 0x561441faad80 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.992+0000 7efd5bfff640 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561441faad80 0x5614423af290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.992+0000 7efd3b7fe640 10 client.17238 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.992+0000 7efd5bfff640 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561441faad80 0x5614423af290 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1675287b71953ee3 server_cookie=22b0f2ae935618d3 in_seq=0 out_seq=0 2024-09-21T06:43:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1828247937 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5614423040f0 con 0x561441faad80 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd3b7fe640 10 client.17238 handle_command_reply: tid=0 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd697db740 1 client.17238 shutdown 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd697db740 1 -- 172.21.15.49:0/1828247937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 msgr2=0x56144239d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd697db740 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239d4d0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7efd5c06c960 tx=0x7efd500118d0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd697db740 1 -- 172.21.15.49:0/1828247937 shutdown_connections 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd697db740 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561441faad80 0x5614423af290 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd697db740 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fec1b0 0x56144239da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd697db740 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239d4d0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd3b7fe640 0 client.17238 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd697db740 1 --2- 172.21.15.49:0/1828247937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fc32f0 0x56144239cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.993+0000 7efd697db740 1 -- 172.21.15.49:0/1828247937 >> 172.21.15.49:0/1828247937 conn(0x561441fe0300 msgr2=0x5614423929e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.994+0000 7efd697db740 1 -- 172.21.15.49:0/1828247937 shutdown_connections 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.994+0000 7efd697db740 1 -- 172.21.15.49:0/1828247937 wait complete. 2024-09-21T06:43:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:42.994+0000 7efd697db740 20 client.17238 trim_cache size 0 max 16384 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd697db740 1 Processor -- start 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd697db740 1 -- start start 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd697db740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 0x56144238f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd697db740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd697db740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fec1b0 0x56144239a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd697db740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1b2040 con 0x561441fcb4d0 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd697db740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1af910 con 0x561441fc32f0 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd697db740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1ad780 con 0x561441fec1b0 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd5b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd5b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34526/0 (socket says 172.21.15.49:34526) 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd5b7fe640 1 -- 172.21.15.49:0/959929021 learned_addr learned my addr 172.21.15.49:0/959929021 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.021+0000 7efd5bfff640 1 --2- 172.21.15.49:0/959929021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 0x56144238f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd5b7fe640 1 -- 172.21.15.49:0/959929021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fec1b0 msgr2=0x56144239a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd60e0d640 1 --2- 172.21.15.49:0/959929021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fec1b0 0x56144239a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/959929021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fec1b0 0x56144239a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd5b7fe640 1 -- 172.21.15.49:0/959929021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 msgr2=0x56144238f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/959929021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 0x56144238f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd5b7fe640 1 -- 172.21.15.49:0/959929021 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614423aa0d0 con 0x561441fcb4d0 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/959929021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239a160 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7efd50000c00 tx=0x7efd5000bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23deb9e1d780c7c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd41ffb640 1 -- 172.21.15.49:0/959929021 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50000e60 con 0x561441fcb4d0 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd41ffb640 1 -- 172.21.15.49:0/959929021 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd50010e60 con 0x561441fcb4d0 2024-09-21T06:43:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.022+0000 7efd41ffb640 1 -- 172.21.15.49:0/959929021 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500048c0 con 0x561441fcb4d0 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 -- 172.21.15.49:0/959929021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 msgr2=0x56144239a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 --2- 172.21.15.49:0/959929021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239a160 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7efd50000c00 tx=0x7efd5000bf50 comp rx=0 tx=0).stop 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 -- 172.21.15.49:0/959929021 shutdown_connections 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 --2- 172.21.15.49:0/959929021 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fec1b0 0x56144239a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 --2- 172.21.15.49:0/959929021 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fcb4d0 0x56144239a160 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 --2- 172.21.15.49:0/959929021 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 0x56144238f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 -- 172.21.15.49:0/959929021 >> 172.21.15.49:0/959929021 conn(0x561441fe0300 msgr2=0x56144238f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 -- 172.21.15.49:0/959929021 shutdown_connections 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 -- 172.21.15.49:0/959929021 wait complete. 2024-09-21T06:43:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.023+0000 7efd697db740 1 -- start start 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd697db740 1 Processor -- start 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd697db740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 0x5614423a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd697db740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fcb4d0 0x5614423a2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd697db740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd697db740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1addd0 con 0x561441fec1b0 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd697db740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1af240 con 0x561441fc32f0 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd697db740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7efd5c1ae4a0 con 0x561441fcb4d0 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd697db740 10 client.0 _ll_register_callbacks cb 0x7efd5000ba50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd60e0d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd60e0d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423a2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34540/0 (socket says 172.21.15.49:34540) 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd60e0d640 1 -- 172.21.15.49:0/1853252598 learned_addr learned my addr 172.21.15.49:0/1853252598 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd5bfff640 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 0x5614423a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.024+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fcb4d0 0x5614423a2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd60e0d640 1 -- 172.21.15.49:0/1853252598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fcb4d0 msgr2=0x5614423a2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd60e0d640 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fcb4d0 0x5614423a2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd60e0d640 1 -- 172.21.15.49:0/1853252598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 msgr2=0x5614423a24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd60e0d640 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 0x5614423a24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd60e0d640 1 -- 172.21.15.49:0/1853252598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561442417dc0 con 0x561441fec1b0 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd5b7fe640 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fcb4d0 0x5614423a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd60e0d640 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423a2f40 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7efd540317a0 tx=0x7efd5402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1382b081844deff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1853252598 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54004440 con 0x561441fec1b0 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1853252598 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7efd540045e0 con 0x561441fec1b0 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd697db740 1 -- 172.21.15.49:0/1853252598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd50010e60 con 0x561441fec1b0 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1853252598 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efd540047e0 con 0x561441fec1b0 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd697db740 10 client.17244 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.025+0000 7efd697db740 1 -- 172.21.15.49:0/1853252598 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561442419050 con 0x561441fec1b0 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.026+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1853252598 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd50010e60 con 0x561441fec1b0 2024-09-21T06:43:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.026+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1853252598 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7efd54030750 con 0x561441fec1b0 2024-09-21T06:43:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.026+0000 7efd697db740 10 client.17244 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.026+0000 7efd697db740 10 client.17244 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.026+0000 7efd697db740 20 client.17244 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.026+0000 7efd697db740 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561441f801c0 0x56144241b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.026+0000 7efd697db740 4 client.17244 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:43:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.026+0000 7efd697db740 1 -- 172.21.15.49:0/1853252598 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561442301520 con 0x561441f801c0 2024-09-21T06:43:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.026+0000 7efd5bfff640 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561441f801c0 0x56144241b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.027+0000 7efd5bfff640 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561441f801c0 0x56144241b7e0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=480dbe5adc62a62a server_cookie=b0b69e9587f31a2b in_seq=0 out_seq=0 2024-09-21T06:43:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.027+0000 7efd3b7fe640 10 client.17244 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd3b7fe640 1 -- 172.21.15.49:0/1853252598 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561442301520 con 0x561441f801c0 2024-09-21T06:43:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd3b7fe640 10 client.17244 handle_command_reply: tid=0 2024-09-21T06:43:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 client.17244 shutdown 2024-09-21T06:43:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 -- 172.21.15.49:0/1853252598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 msgr2=0x5614423a2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423a2f40 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7efd540317a0 tx=0x7efd5402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 -- 172.21.15.49:0/1853252598 shutdown_connections 2024-09-21T06:43:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561441f801c0 0x56144241b7e0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561441fec1b0 0x5614423a2f40 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561441fcb4d0 0x5614423a2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 --2- 172.21.15.49:0/1853252598 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561441fc32f0 0x5614423a24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd3b7fe640 0 client.17244 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 -- 172.21.15.49:0/1853252598 >> 172.21.15.49:0/1853252598 conn(0x561441fe0300 msgr2=0x5614423929e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 -- 172.21.15.49:0/1853252598 shutdown_connections 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 1 -- 172.21.15.49:0/1853252598 wait complete. 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.034+0000 7efd697db740 20 client.17244 trim_cache size 0 max 16384 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:43:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:43:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 -- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efd440b6680 msgr2=0x7efd440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efd440b6680 0x7efd440b8b90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7efd54006010 tx=0x7efd540094a0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 -- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c104970 msgr2=0x7efd5c19a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c104970 0x7efd5c19a380 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7efd4c00e9f0 tx=0x7efd4c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 -- 172.21.15.49:0/4218441998 shutdown_connections 2024-09-21T06:43:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7efd440b6680 0x7efd440b8b90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7efd5c10dd90 0x7efd5c19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7efd5c1052c0 0x7efd5c19a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 --2- 172.21.15.49:0/4218441998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7efd5c104970 0x7efd5c19a380 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 -- 172.21.15.49:0/4218441998 >> 172.21.15.49:0/4218441998 conn(0x7efd5c0fe3c0 msgr2=0x7efd5c107850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 -- 172.21.15.49:0/4218441998 shutdown_connections 2024-09-21T06:43:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:43.035+0000 7efd62870640 1 -- 172.21.15.49:0/4218441998 wait complete. 2024-09-21T06:43:43.230 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:43:43.490 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:43.950 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:43 smithi049 ceph-mon[31177]: pgmap v533: 97 pgs: 97 active+clean; 6.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.948+0000 7feb7fae9640 1 -- 172.21.15.49:0/3744332207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 msgr2=0x7feb781087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.948+0000 7feb7fae9640 1 --2- 172.21.15.49:0/3744332207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 0x7feb781087b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7feb68009900 tx=0x7feb6802a410 comp rx=0 tx=0).stop 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.948+0000 7feb7fae9640 1 -- 172.21.15.49:0/3744332207 shutdown_connections 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.948+0000 7feb7fae9640 1 --2- 172.21.15.49:0/3744332207 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb78108cf0 0x7feb7810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.948+0000 7feb7fae9640 1 --2- 172.21.15.49:0/3744332207 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 0x7feb781087b0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.948+0000 7feb7fae9640 1 --2- 172.21.15.49:0/3744332207 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb78102a60 0x7feb78102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.948+0000 7feb7fae9640 1 -- 172.21.15.49:0/3744332207 >> 172.21.15.49:0/3744332207 conn(0x7feb78079730 msgr2=0x7feb78079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.949+0000 7feb7fae9640 1 -- 172.21.15.49:0/3744332207 shutdown_connections 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.949+0000 7feb7fae9640 1 -- 172.21.15.49:0/3744332207 wait complete. 2024-09-21T06:43:43.956 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7fae9640 1 Processor -- start 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7fae9640 1 -- start start 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7fae9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb78102a60 0x7feb78199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7fae9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 0x7feb78199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7fae9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb78108cf0 0x7feb7819ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7fae9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feb78112a20 con 0x7feb781083a0 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7fae9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb781128a0 con 0x7feb78102a60 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7fae9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feb78112ba0 con 0x7feb78108cf0 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7d084640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 0x7feb78199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7d084640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 0x7feb78199ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34556/0 (socket says 172.21.15.49:34556) 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7d084640 1 -- 172.21.15.49:0/256455998 learned_addr learned my addr 172.21.15.49:0/256455998 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.950+0000 7feb7d885640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb78102a60 0x7feb78199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7e086640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb78108cf0 0x7feb7819ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.957 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7d084640 1 -- 172.21.15.49:0/256455998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb78108cf0 msgr2=0x7feb7819ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7d084640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb78108cf0 0x7feb7819ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7d084640 1 -- 172.21.15.49:0/256455998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb78102a60 msgr2=0x7feb78199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7d084640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb78102a60 0x7feb78199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7d084640 1 -- 172.21.15.49:0/256455998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7819f4a0 con 0x7feb781083a0 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7e086640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb78108cf0 0x7feb7819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7d084640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 0x7feb78199ad0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7feb68031a90 tx=0x7feb68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb6effd640 1 -- 172.21.15.49:0/256455998 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6803f030 con 0x7feb781083a0 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7fae9640 1 -- 172.21.15.49:0/256455998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb7819f730 con 0x7feb781083a0 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb6effd640 1 -- 172.21.15.49:0/256455998 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb68004490 con 0x7feb781083a0 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb6effd640 1 -- 172.21.15.49:0/256455998 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68035070 con 0x7feb781083a0 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.951+0000 7feb7fae9640 1 -- 172.21.15.49:0/256455998 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb7806ae60 con 0x7feb781083a0 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.954+0000 7feb8605d740 1 Processor -- start 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.954+0000 7feb8605d740 1 -- start start 2024-09-21T06:43:43.958 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.954+0000 7feb6effd640 1 -- 172.21.15.49:0/256455998 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7feb68042030 con 0x7feb781083a0 2024-09-21T06:43:43.959 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.954+0000 7feb8605d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 0x5613673766a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.954+0000 7feb8605d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x561367376be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb8605d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x561367377120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.962 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb8605d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5613672ecea0 con 0x561366fa61b0 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb8605d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5613672dc2d0 con 0x561366fae390 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb8605d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5613672e00e0 con 0x561366fcf070 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7d885640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x561367376be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7d885640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x561367376be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34570/0 (socket says 172.21.15.49:34570) 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7d885640 1 -- 172.21.15.49:0/3282658566 learned_addr learned my addr 172.21.15.49:0/3282658566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7e086640 1 --2- 172.21.15.49:0/3282658566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 0x5613673766a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7d084640 1 --2- 172.21.15.49:0/3282658566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x561367377120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7d885640 1 -- 172.21.15.49:0/3282658566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 msgr2=0x5613673766a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7d885640 1 --2- 172.21.15.49:0/3282658566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 0x5613673766a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7d885640 1 -- 172.21.15.49:0/3282658566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 msgr2=0x561367377120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7d885640 1 --2- 172.21.15.49:0/3282658566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x561367377120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.955+0000 7feb7d885640 1 -- 172.21.15.49:0/3282658566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56136703a650 con 0x561366fa61b0 2024-09-21T06:43:43.963 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.956+0000 7feb6effd640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7feb640b6700 0x7feb640b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.956+0000 7feb7d885640 1 --2- 172.21.15.49:0/3282658566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x561367376be0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7feb74009a70 tx=0x7feb74009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd65ff45f120724b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.956+0000 7feb7e086640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7feb640b6700 0x7feb640b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.956+0000 7feb6effd640 1 -- 172.21.15.49:0/256455998 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7feb68107d00 con 0x7feb781083a0 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.956+0000 7feb63fff640 1 -- 172.21.15.49:0/3282658566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74017070 con 0x561366fa61b0 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.956+0000 7feb63fff640 1 -- 172.21.15.49:0/3282658566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb74013470 con 0x561366fa61b0 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.956+0000 7feb63fff640 1 -- 172.21.15.49:0/3282658566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74012630 con 0x561366fa61b0 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb8605d740 1 -- 172.21.15.49:0/3282658566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 msgr2=0x561367376be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb7e086640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7feb640b6700 0x7feb640b8c10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feb7000f4c0 tx=0x7feb70007740 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb8605d740 1 --2- 172.21.15.49:0/3282658566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x561367376be0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7feb74009a70 tx=0x7feb74009f30 comp rx=0 tx=0).stop 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb8605d740 1 -- 172.21.15.49:0/3282658566 shutdown_connections 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb8605d740 1 --2- 172.21.15.49:0/3282658566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x561367377120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb8605d740 1 --2- 172.21.15.49:0/3282658566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x561367376be0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.964 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb8605d740 1 --2- 172.21.15.49:0/3282658566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 0x5613673766a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb8605d740 1 -- 172.21.15.49:0/3282658566 >> 172.21.15.49:0/3282658566 conn(0x561366fc3460 msgr2=0x561367374590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb8605d740 1 -- 172.21.15.49:0/3282658566 shutdown_connections 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.957+0000 7feb8605d740 1 -- 172.21.15.49:0/3282658566 wait complete. 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb8605d740 1 -- start start 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb8605d740 1 Processor -- start 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb8605d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 0x561367381d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb8605d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x561367382240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb8605d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fcf070 0x561367382780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb8605d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x56136713d700 con 0x561366fcf070 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb8605d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x561367277160 con 0x561366fae390 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb8605d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x561367384ed0 con 0x561366fa61b0 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb8605d740 10 client.0 _ll_register_callbacks cb 0x5613672909e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:43.965 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.958+0000 7feb7e086640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fcf070 0x561367382780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7e086640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fcf070 0x561367382780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34576/0 (socket says 172.21.15.49:34576) 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7e086640 1 -- 172.21.15.49:0/706587814 learned_addr learned my addr 172.21.15.49:0/706587814 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7d885640 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 0x561367381d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7d084640 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x561367382240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7d084640 1 -- 172.21.15.49:0/706587814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 msgr2=0x561367381d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7d084640 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 0x561367381d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7d084640 1 -- 172.21.15.49:0/706587814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fcf070 msgr2=0x561367382780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7d084640 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fcf070 0x561367382780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7d084640 1 -- 172.21.15.49:0/706587814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613672a4c90 con 0x561366fae390 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7e086640 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fcf070 0x561367382780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb7d084640 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x561367382240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb68105400 tx=0x7feb6810b3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=741630a1e94eb426 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb617fa640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.959+0000 7feb617fa640 1 -- 172.21.15.49:0/706587814 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68049070 con 0x561366fae390 2024-09-21T06:43:43.966 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb8605d740 1 -- 172.21.15.49:0/706587814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb74013470 con 0x561366fae390 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb617fa640 1 -- 172.21.15.49:0/706587814 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7feb680d7090 con 0x561366fae390 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb617fa640 1 -- 172.21.15.49:0/706587814 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feb680c99a0 con 0x561366fae390 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb8605d740 10 client.26621 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb8605d740 1 -- 172.21.15.49:0/706587814 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x561367390b50 con 0x561366fae390 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb617fa640 1 -- 172.21.15.49:0/706587814 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb74013470 con 0x561366fae390 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb617fa640 1 -- 172.21.15.49:0/706587814 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7feb6810b020 con 0x561366fae390 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb8605d740 10 client.26621 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb8605d740 10 client.26621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb8605d740 20 client.26621 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb8605d740 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561366f8d9f0 0x561367394070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb8605d740 4 client.26621 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.960+0000 7feb8605d740 1 -- 172.21.15.49:0/706587814 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613672eedf0 con 0x561366f8d9f0 2024-09-21T06:43:43.967 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.961+0000 7feb7d885640 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561366f8d9f0 0x561367394070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.961+0000 7feb617fa640 10 client.26621 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:43.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.961+0000 7feb7d885640 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561366f8d9f0 0x561367394070 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8569fba3cc6a3f8 server_cookie=7a36bf6557c6098 in_seq=0 out_seq=0 2024-09-21T06:43:43.968 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb617fa640 1 -- 172.21.15.49:0/706587814 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613672eedf0 con 0x561366f8d9f0 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb617fa640 10 client.26621 handle_command_reply: tid=0 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb8605d740 1 client.26621 shutdown 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb8605d740 1 -- 172.21.15.49:0/706587814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 msgr2=0x561367382240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb8605d740 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x561367382240 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb68105400 tx=0x7feb6810b3a0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb8605d740 1 -- 172.21.15.49:0/706587814 shutdown_connections 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb8605d740 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561366f8d9f0 0x561367394070 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb8605d740 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fcf070 0x561367382780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb8605d740 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x561367382240 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb617fa640 0 client.26621 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb8605d740 1 --2- 172.21.15.49:0/706587814 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 0x561367381d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.962+0000 7feb8605d740 1 -- 172.21.15.49:0/706587814 >> 172.21.15.49:0/706587814 conn(0x561366fc3460 msgr2=0x561367378090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.963+0000 7feb8605d740 1 -- 172.21.15.49:0/706587814 shutdown_connections 2024-09-21T06:43:43.969 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.963+0000 7feb8605d740 1 -- 172.21.15.49:0/706587814 wait complete. 2024-09-21T06:43:43.970 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.963+0000 7feb8605d740 20 client.26621 trim_cache size 0 max 16384 2024-09-21T06:43:43.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb8605d740 1 Processor -- start 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb8605d740 1 -- start start 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb8605d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x5613673745c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb8605d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x56136737eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb8605d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 0x56136737f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb8605d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feb781b4410 con 0x561366fa61b0 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb8605d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb781b1ce0 con 0x561366fae390 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb8605d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feb781afb70 con 0x561366fcf070 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb7d885640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x5613673745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb7d885640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x5613673745c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34580/0 (socket says 172.21.15.49:34580) 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.976+0000 7feb7d885640 1 -- 172.21.15.49:0/216786086 learned_addr learned my addr 172.21.15.49:0/216786086 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb7d084640 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x56136737eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb7d885640 1 -- 172.21.15.49:0/216786086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 msgr2=0x56136737f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb7e086640 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 0x56136737f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.979 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb7d885640 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 0x56136737f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb7d885640 1 -- 172.21.15.49:0/216786086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 msgr2=0x56136737eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb7d885640 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x56136737eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb7d885640 1 -- 172.21.15.49:0/216786086 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561367382fc0 con 0x561366fa61b0 2024-09-21T06:43:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb7d084640 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x56136737eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb7d885640 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x5613673745c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7feb74004810 tx=0x7feb74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de3fff36fe24942 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb637fe640 1 -- 172.21.15.49:0/216786086 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb74017040 con 0x561366fa61b0 2024-09-21T06:43:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb637fe640 1 -- 172.21.15.49:0/216786086 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb7400edc0 con 0x561366fa61b0 2024-09-21T06:43:43.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.977+0000 7feb637fe640 1 -- 172.21.15.49:0/216786086 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7401c920 con 0x561366fa61b0 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 -- 172.21.15.49:0/216786086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 msgr2=0x5613673745c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x5613673745c0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7feb74004810 tx=0x7feb74008040 comp rx=0 tx=0).stop 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 -- 172.21.15.49:0/216786086 shutdown_connections 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fcf070 0x56136737f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fae390 0x56136737eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 --2- 172.21.15.49:0/216786086 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fa61b0 0x5613673745c0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 -- 172.21.15.49:0/216786086 >> 172.21.15.49:0/216786086 conn(0x561366fc3460 msgr2=0x561367373eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 -- 172.21.15.49:0/216786086 shutdown_connections 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 -- 172.21.15.49:0/216786086 wait complete. 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 -- start start 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.978+0000 7feb8605d740 1 Processor -- start 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb8605d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 0x561367386530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.984 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb8605d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fae390 0x561367386ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb8605d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fcf070 0x5613673fda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb8605d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7feb781b01c0 con 0x561366fae390 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb8605d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7feb781b1610 con 0x561366fcf070 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb8605d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7feb781b0870 con 0x561366fa61b0 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d084640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fae390 0x561367386ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d084640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fae390 0x561367386ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:34582/0 (socket says 172.21.15.49:34582) 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb8605d740 10 client.0 _ll_register_callbacks cb 0x7feb68005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d084640 1 -- 172.21.15.49:0/1296704019 learned_addr learned my addr 172.21.15.49:0/1296704019 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d885640 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 0x561367386530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7e086640 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fcf070 0x5613673fda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d084640 1 -- 172.21.15.49:0/1296704019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 msgr2=0x561367386530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d084640 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 0x561367386530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d084640 1 -- 172.21.15.49:0/1296704019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fcf070 msgr2=0x5613673fda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d084640 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fcf070 0x5613673fda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d084640 1 -- 172.21.15.49:0/1296704019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613673fdfb0 con 0x561366fae390 2024-09-21T06:43:43.985 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7d885640 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 0x561367386530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.979+0000 7feb7e086640 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fcf070 0x5613673fda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb7d084640 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fae390 0x561367386ab0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7feb680b50f0 tx=0x7feb6810b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5208279ae2a11e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb617fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb617fa640 1 -- 172.21.15.49:0/1296704019 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb68049070 con 0x561366fae390 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb617fa640 1 -- 172.21.15.49:0/1296704019 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7feb6803bbb0 con 0x561366fae390 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb8605d740 1 -- 172.21.15.49:0/1296704019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb7400edc0 con 0x561366fae390 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb617fa640 1 -- 172.21.15.49:0/1296704019 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7feb68003e60 con 0x561366fae390 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb8605d740 10 client.17262 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb8605d740 1 -- 172.21.15.49:0/1296704019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5613673fdfb0 con 0x561366fae390 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb617fa640 1 -- 172.21.15.49:0/1296704019 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feb7400edc0 con 0x561366fae390 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb617fa640 1 -- 172.21.15.49:0/1296704019 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7feb680ccd60 con 0x561366fae390 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb8605d740 10 client.17262 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb8605d740 10 client.17262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb8605d740 20 client.17262 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb8605d740 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561366f62da0 0x561367401440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb8605d740 4 client.17262 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.980+0000 7feb8605d740 1 -- 172.21.15.49:0/1296704019 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5613672ea8a0 con 0x561366f62da0 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.981+0000 7feb7d885640 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561366f62da0 0x561367401440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.981+0000 7feb7d885640 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561366f62da0 0x561367401440 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0b096234fe20122 server_cookie=a90b28db13249ae4 in_seq=0 out_seq=0 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.981+0000 7feb617fa640 10 client.17262 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.981+0000 7feb617fa640 1 -- 172.21.15.49:0/1296704019 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5613672ea8a0 con 0x561366f62da0 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.981+0000 7feb617fa640 10 client.17262 handle_command_reply: tid=0 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.981+0000 7feb8605d740 1 client.17262 shutdown 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 -- 172.21.15.49:0/1296704019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fae390 msgr2=0x561367386ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fae390 0x561367386ab0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7feb680b50f0 tx=0x7feb6810b900 comp rx=0 tx=0).stop 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 -- 172.21.15.49:0/1296704019 shutdown_connections 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x561366f62da0 0x561367401440 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x561366fcf070 0x5613673fda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x561366fae390 0x561367386ab0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb617fa640 0 client.17262 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:43.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 --2- 172.21.15.49:0/1296704019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x561366fa61b0 0x561367386530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 -- 172.21.15.49:0/1296704019 >> 172.21.15.49:0/1296704019 conn(0x561366fc3460 msgr2=0x5613673776d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 -- 172.21.15.49:0/1296704019 shutdown_connections 2024-09-21T06:43:43.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 1 -- 172.21.15.49:0/1296704019 wait complete. 2024-09-21T06:43:43.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb8605d740 20 client.17262 trim_cache size 0 max 16384 2024-09-21T06:43:43.988 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:43:43.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb7fae9640 1 -- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7feb640b6700 msgr2=0x7feb640b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb7fae9640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7feb640b6700 0x7feb640b8c10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feb7000f4c0 tx=0x7feb70007740 comp rx=0 tx=0).stop 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb7fae9640 1 -- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 msgr2=0x7feb78199ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.982+0000 7feb7fae9640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 0x7feb78199ad0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7feb68031a90 tx=0x7feb68004270 comp rx=0 tx=0).stop 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.983+0000 7feb7fae9640 1 -- 172.21.15.49:0/256455998 shutdown_connections 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.983+0000 7feb7fae9640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7feb640b6700 0x7feb640b8c10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.983+0000 7feb7fae9640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7feb78108cf0 0x7feb7819ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.983+0000 7feb7fae9640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7feb781083a0 0x7feb78199ad0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.983+0000 7feb7fae9640 1 --2- 172.21.15.49:0/256455998 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7feb78102a60 0x7feb78199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.983+0000 7feb7fae9640 1 -- 172.21.15.49:0/256455998 >> 172.21.15.49:0/256455998 conn(0x7feb78079730 msgr2=0x7feb78105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.983+0000 7feb7fae9640 1 -- 172.21.15.49:0/256455998 shutdown_connections 2024-09-21T06:43:43.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:43.983+0000 7feb7fae9640 1 -- 172.21.15.49:0/256455998 wait complete. 2024-09-21T06:43:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:43 smithi079 ceph-mon[34346]: pgmap v533: 97 pgs: 97 active+clean; 6.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:43:44.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:43 smithi098 ceph-mon[34704]: pgmap v533: 97 pgs: 97 active+clean; 6.7 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-09-21T06:43:45.748 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:43:45.748 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:43:46.023 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:46.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:45 smithi079 ceph-mon[34346]: pgmap v534: 97 pgs: 97 active+clean; 6.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:43:46.145 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:45 smithi049 ceph-mon[31177]: pgmap v534: 97 pgs: 97 active+clean; 6.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:43:46.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:45 smithi098 ceph-mon[34704]: pgmap v534: 97 pgs: 97 active+clean; 6.8 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:43:46.619 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.618+0000 7f0b5924c640 1 -- 172.21.15.49:0/73609961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 msgr2=0x7f0b54103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.618+0000 7f0b5924c640 1 --2- 172.21.15.49:0/73609961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 0x7f0b54103fc0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009900 tx=0x7f0b4402a410 comp rx=0 tx=0).stop 2024-09-21T06:43:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.618+0000 7f0b5924c640 1 -- 172.21.15.49:0/73609961 shutdown_connections 2024-09-21T06:43:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.618+0000 7f0b5924c640 1 --2- 172.21.15.49:0/73609961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b54109e40 0x7f0b54110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.618+0000 7f0b5924c640 1 --2- 172.21.15.49:0/73609961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b541094f0 0x7f0b54109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.618+0000 7f0b5924c640 1 --2- 172.21.15.49:0/73609961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 0x7f0b54103fc0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.618+0000 7f0b5924c640 1 -- 172.21.15.49:0/73609961 >> 172.21.15.49:0/73609961 conn(0x7f0b540ff600 msgr2=0x7f0b54101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.618+0000 7f0b5924c640 1 -- 172.21.15.49:0/73609961 shutdown_connections 2024-09-21T06:43:46.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.618+0000 7f0b5924c640 1 -- 172.21.15.49:0/73609961 wait complete. 2024-09-21T06:43:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5924c640 1 Processor -- start 2024-09-21T06:43:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5924c640 1 -- start start 2024-09-21T06:43:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5924c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 0x7f0b54075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5924c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b541094f0 0x7f0b54075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5924c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b54109e40 0x7f0b54076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5924c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54113b50 con 0x7f0b54103bb0 2024-09-21T06:43:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5924c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541139d0 con 0x7f0b54109e40 2024-09-21T06:43:46.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5924c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b54113cd0 con 0x7f0b541094f0 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b52d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 0x7f0b54075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b52d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 0x7f0b54075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44622/0 (socket says 172.21.15.49:44622) 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b52d9d640 1 -- 172.21.15.49:0/3216331214 learned_addr learned my addr 172.21.15.49:0/3216331214 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5259c640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b541094f0 0x7f0b54075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.619+0000 7f0b5359e640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b54109e40 0x7f0b54076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b52d9d640 1 -- 172.21.15.49:0/3216331214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b541094f0 msgr2=0x7f0b54075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b52d9d640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b541094f0 0x7f0b54075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b52d9d640 1 -- 172.21.15.49:0/3216331214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b54109e40 msgr2=0x7f0b54076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b52d9d640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b54109e40 0x7f0b54076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b52d9d640 1 -- 172.21.15.49:0/3216331214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b541a87e0 con 0x7f0b54103bb0 2024-09-21T06:43:46.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b52d9d640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 0x7f0b54075710 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0b44005ab0 tx=0x7f0b44003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:46.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b3bfff640 1 -- 172.21.15.49:0/3216331214 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4403f070 con 0x7f0b54103bb0 2024-09-21T06:43:46.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b5924c640 1 -- 172.21.15.49:0/3216331214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b541a8a70 con 0x7f0b54103bb0 2024-09-21T06:43:46.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b3bfff640 1 -- 172.21.15.49:0/3216331214 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b44031d60 con 0x7f0b54103bb0 2024-09-21T06:43:46.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b3bfff640 1 -- 172.21.15.49:0/3216331214 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b44035030 con 0x7f0b54103bb0 2024-09-21T06:43:46.624 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.620+0000 7f0b5924c640 1 -- 172.21.15.49:0/3216331214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b541a8fa0 con 0x7f0b54103bb0 2024-09-21T06:43:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5f7c0740 1 Processor -- start 2024-09-21T06:43:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5f7c0740 1 -- start start 2024-09-21T06:43:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b3bfff640 1 -- 172.21.15.49:0/3216331214 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0b44042070 con 0x7f0b54103bb0 2024-09-21T06:43:46.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e39fa990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e39faed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d4e3970e60 con 0x55d4e3653350 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d4e3960290 con 0x55d4e3632670 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d4e39640a0 con 0x55d4e362a490 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44636/0 (socket says 172.21.15.49:44636) 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.623+0000 7f0b5359e640 1 -- 172.21.15.49:0/926779521 learned_addr learned my addr 172.21.15.49:0/926779521 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b5259c640 1 --2- 172.21.15.49:0/926779521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e39faed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b52d9d640 1 --2- 172.21.15.49:0/926779521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e39fa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b5359e640 1 -- 172.21.15.49:0/926779521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 msgr2=0x55d4e39fa990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b5359e640 1 --2- 172.21.15.49:0/926779521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e39fa990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b5359e640 1 -- 172.21.15.49:0/926779521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 msgr2=0x55d4e39faed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b5359e640 1 --2- 172.21.15.49:0/926779521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e39faed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.626 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b5359e640 1 -- 172.21.15.49:0/926779521 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e36be930 con 0x55d4e3653350 2024-09-21T06:43:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b5359e640 1 --2- 172.21.15.49:0/926779521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fa450 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0039f0 tx=0x7f0b4c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643fc4981c0a4b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b397fa640 1 -- 172.21.15.49:0/926779521 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c01a470 con 0x55d4e3653350 2024-09-21T06:43:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b397fa640 1 -- 172.21.15.49:0/926779521 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b4c015070 con 0x55d4e3653350 2024-09-21T06:43:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.624+0000 7f0b397fa640 1 -- 172.21.15.49:0/926779521 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0107e0 con 0x55d4e3653350 2024-09-21T06:43:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b3bfff640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b3c0b6700 0x7f0b3c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b52d9d640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b3c0b6700 0x7f0b3c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.630 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b3bfff640 1 -- 172.21.15.49:0/3216331214 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f0b44107eb0 con 0x7f0b54103bb0 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/926779521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 msgr2=0x55d4e39fa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/926779521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fa450 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0039f0 tx=0x7f0b4c003eb0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b52d9d640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b3c0b6700 0x7f0b3c0b8c10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0b44105660 tx=0x7f0b44047000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/926779521 shutdown_connections 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/926779521 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e39faed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/926779521 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e39fa990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/926779521 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fa450 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.625+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/926779521 >> 172.21.15.49:0/926779521 conn(0x55d4e3647740 msgr2=0x55d4e39f8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/926779521 shutdown_connections 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/926779521 wait complete. 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 -- start start 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 Processor -- start 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e3a06060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e3a065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a11f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d4e37c1890 con 0x55d4e3653350 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d4e38fad40 con 0x55d4e3632670 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d4e3a08c30 con 0x55d4e362a490 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.626+0000 7f0b5f7c0740 10 client.0 _ll_register_callbacks cb 0x55d4e395ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a11f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a11f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44644/0 (socket says 172.21.15.49:44644) 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 -- 172.21.15.49:0/2175208399 learned_addr learned my addr 172.21.15.49:0/2175208399 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e3a06060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5259c640 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e3a065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 -- 172.21.15.49:0/2175208399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 msgr2=0x55d4e3a06060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e3a06060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 -- 172.21.15.49:0/2175208399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 msgr2=0x55d4e3a065a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e3a065a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 -- 172.21.15.49:0/2175208399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4e3a12510 con 0x55d4e3653350 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5359e640 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a11f50 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0049a0 tx=0x7f0b4c010440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19377fb0b0988 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b36ff5640 1 -- 172.21.15.49:0/2175208399 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004a40 con 0x55d4e3653350 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b36ff5640 1 -- 172.21.15.49:0/2175208399 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f0b4c004be0 con 0x55d4e3653350 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.627+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/2175208399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b4c015070 con 0x55d4e3653350 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b36ff5640 1 -- 172.21.15.49:0/2175208399 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b4c010580 con 0x55d4e3653350 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b5f7c0740 10 client.17274 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/2175208399 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d4e3a14e40 con 0x55d4e3653350 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b36ff5640 1 -- 172.21.15.49:0/2175208399 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b4c015070 con 0x55d4e3653350 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b36ff5640 1 -- 172.21.15.49:0/2175208399 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0b4c01a6a0 con 0x55d4e3653350 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b5f7c0740 10 client.17274 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b5f7c0740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b5f7c0740 20 client.17274 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:46.633 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4e3611cd0 0x55d4e3a18200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b5f7c0740 4 client.17274 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:46.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/2175208399 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4e3972db0 con 0x55d4e3611cd0 2024-09-21T06:43:46.634 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.628+0000 7f0b5259c640 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4e3611cd0 0x55d4e3a18200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.629+0000 7f0b36ff5640 10 client.17274 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.629+0000 7f0b5259c640 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4e3611cd0 0x55d4e3a18200 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1762e02c5b89faf server_cookie=a10f69e471a6fa4d in_seq=0 out_seq=0 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b36ff5640 1 -- 172.21.15.49:0/2175208399 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d4e3972db0 con 0x55d4e3611cd0 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b36ff5640 10 client.17274 handle_command_reply: tid=0 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 client.17274 shutdown 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/2175208399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 msgr2=0x55d4e3a11f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a11f50 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0049a0 tx=0x7f0b4c010440 comp rx=0 tx=0).stop 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/2175208399 shutdown_connections 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4e3611cd0 0x55d4e3a18200 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a11f50 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e3a065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.635 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/2175208399 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e3a06060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/2175208399 >> 172.21.15.49:0/2175208399 conn(0x55d4e3647740 msgr2=0x55d4e39fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:46.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b36ff5640 0 client.17274 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:46.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/2175208399 shutdown_connections 2024-09-21T06:43:46.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/2175208399 wait complete. 2024-09-21T06:43:46.636 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.630+0000 7f0b5f7c0740 20 client.17274 trim_cache size 0 max 16384 2024-09-21T06:43:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5f7c0740 1 Processor -- start 2024-09-21T06:43:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5f7c0740 1 -- start start 2024-09-21T06:43:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e3a01610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e3a056f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541b43d0 con 0x55d4e3653350 2024-09-21T06:43:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541b1ca0 con 0x55d4e3632670 2024-09-21T06:43:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541afb10 con 0x55d4e362a490 2024-09-21T06:43:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44648/0 (socket says 172.21.15.49:44648) 2024-09-21T06:43:46.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 -- 172.21.15.49:0/3509214762 learned_addr learned my addr 172.21.15.49:0/3509214762 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e3a01610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5259c640 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e3a056f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.651 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 -- 172.21.15.49:0/3509214762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 msgr2=0x55d4e3a01610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e3a01610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 -- 172.21.15.49:0/3509214762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 msgr2=0x55d4e3a056f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e3a056f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 -- 172.21.15.49:0/3509214762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e3a06db0 con 0x55d4e3653350 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5259c640 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e3a056f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.648+0000 7f0b5359e640 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fbb90 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c000f60 tx=0x7f0b4c0104b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704d493802d08da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.649+0000 7f0b38ff9640 1 -- 172.21.15.49:0/3509214762 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c011bc0 con 0x55d4e3653350 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.649+0000 7f0b38ff9640 1 -- 172.21.15.49:0/3509214762 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b4c015040 con 0x55d4e3653350 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.649+0000 7f0b38ff9640 1 -- 172.21.15.49:0/3509214762 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c010c20 con 0x55d4e3653350 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.649+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/3509214762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 msgr2=0x55d4e39fbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.649+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fbb90 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c000f60 tx=0x7f0b4c0104b0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.649+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/3509214762 shutdown_connections 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.649+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e39fbb90 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e3632670 0x55d4e3a056f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/3509214762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e362a490 0x55d4e3a01610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/3509214762 >> 172.21.15.49:0/3509214762 conn(0x55d4e3647740 msgr2=0x55d4e39fb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:46.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/3509214762 shutdown_connections 2024-09-21T06:43:46.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/3509214762 wait complete. 2024-09-21T06:43:46.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 -- start start 2024-09-21T06:43:46.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 Processor -- start 2024-09-21T06:43:46.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e362a490 0x55d4e3a1ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e3632670 0x55d4e3a18f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541b0160 con 0x55d4e3653350 2024-09-21T06:43:46.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541b15d0 con 0x55d4e362a490 2024-09-21T06:43:46.655 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0b541b0830 con 0x55d4e3632670 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.650+0000 7f0b5f7c0740 10 client.0 _ll_register_callbacks cb 0x7f0b48009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44650/0 (socket says 172.21.15.49:44650) 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 -- 172.21.15.49:0/1772346125 learned_addr learned my addr 172.21.15.49:0/1772346125 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e362a490 0x55d4e3a1ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5259c640 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e3632670 0x55d4e3a18f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 -- 172.21.15.49:0/1772346125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e3632670 msgr2=0x55d4e3a18f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e3632670 0x55d4e3a18f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 -- 172.21.15.49:0/1772346125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e362a490 msgr2=0x55d4e3a1ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e362a490 0x55d4e3a1ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 -- 172.21.15.49:0/1772346125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4e3a19c40 con 0x55d4e3653350 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5359e640 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a194b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009df0 tx=0x7f0b4c003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b2f24959b6af1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b36ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:46.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b36ff5640 1 -- 172.21.15.49:0/1772346125 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c004740 con 0x55d4e3653350 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b36ff5640 1 -- 172.21.15.49:0/1772346125 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f0b4c011bd0 con 0x55d4e3653350 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.651+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/1772346125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b4c015040 con 0x55d4e3653350 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b36ff5640 1 -- 172.21.15.49:0/1772346125 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0b4c01a470 con 0x55d4e3653350 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b5f7c0740 10 client.17280 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/1772346125 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d4e3a828b0 con 0x55d4e3653350 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b36ff5640 1 -- 172.21.15.49:0/1772346125 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b4c015040 con 0x55d4e3653350 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b36ff5640 1 -- 172.21.15.49:0/1772346125 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0b4c01ace0 con 0x55d4e3653350 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b5f7c0740 10 client.17280 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b5f7c0740 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b5f7c0740 20 client.17280 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4e35e7080 0x55d4e3a84e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b5f7c0740 4 client.17280 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/1772346125 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d4e396e860 con 0x55d4e35e7080 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.652+0000 7f0b5259c640 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4e35e7080 0x55d4e3a84e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.653+0000 7f0b5259c640 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4e35e7080 0x55d4e3a84e20 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b3085ad506fe133 server_cookie=89bf5eddbedf1d5d in_seq=0 out_seq=0 2024-09-21T06:43:46.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.653+0000 7f0b36ff5640 10 client.17280 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:46.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b36ff5640 1 -- 172.21.15.49:0/1772346125 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d4e396e860 con 0x55d4e35e7080 2024-09-21T06:43:46.658 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b36ff5640 10 client.17280 handle_command_reply: tid=0 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 client.17280 shutdown 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/1772346125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 msgr2=0x55d4e3a194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a194b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c009df0 tx=0x7f0b4c003eb0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/1772346125 shutdown_connections 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55d4e35e7080 0x55d4e3a84e20 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b36ff5640 0 client.17280 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d4e3653350 0x55d4e3a194b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d4e3632670 0x55d4e3a18f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 --2- 172.21.15.49:0/1772346125 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d4e362a490 0x55d4e3a1ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/1772346125 >> 172.21.15.49:0/1772346125 conn(0x55d4e3647740 msgr2=0x55d4e39fb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/1772346125 shutdown_connections 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 1 -- 172.21.15.49:0/1772346125 wait complete. 2024-09-21T06:43:46.659 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.655+0000 7f0b5f7c0740 20 client.17280 trim_cache size 0 max 16384 2024-09-21T06:43:46.660 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:43:46.660 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:43:46.660 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "5909134b-6be3-4b78-b014-cd698f8e6b28", 2024-09-21T06:43:46.660 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:43:46.660 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:43:46.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 -- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b3c0b6700 msgr2=0x7f0b3c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b3c0b6700 0x7f0b3c0b8c10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0b44105660 tx=0x7f0b44047000 comp rx=0 tx=0).stop 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 -- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 msgr2=0x7f0b54075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 0x7f0b54075710 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0b44005ab0 tx=0x7f0b44003c80 comp rx=0 tx=0).stop 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 -- 172.21.15.49:0/3216331214 shutdown_connections 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0b3c0b6700 0x7f0b3c0b8c10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0b54109e40 0x7f0b54076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0b541094f0 0x7f0b54075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 --2- 172.21.15.49:0/3216331214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0b54103bb0 0x7f0b54075710 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 -- 172.21.15.49:0/3216331214 >> 172.21.15.49:0/3216331214 conn(0x7f0b540ff600 msgr2=0x7f0b54101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 -- 172.21.15.49:0/3216331214 shutdown_connections 2024-09-21T06:43:46.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:46.656+0000 7f0b5924c640 1 -- 172.21.15.49:0/3216331214 wait complete. 2024-09-21T06:43:47.508 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:43:47.765 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:47 smithi079 ceph-mon[34346]: pgmap v535: 97 pgs: 97 active+clean; 6.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:43:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:47 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:43:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:47 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:47 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:43:48.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:47 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:43:48.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:47 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:48.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:47 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:48.148 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:47 smithi049 ceph-mon[31177]: pgmap v535: 97 pgs: 97 active+clean; 6.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:43:48.148 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:47 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:43:48.148 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:47 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:48.148 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:47 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:43:48.148 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:47 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:43:48.148 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:47 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:48.148 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:47 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 -- 172.21.15.49:0/766787175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088109df0 msgr2=0x7f8088110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 --2- 172.21.15.49:0/766787175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088109df0 0x7f8088110620 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f8080009ca0 tx=0x7f808002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 -- 172.21.15.49:0/766787175 shutdown_connections 2024-09-21T06:43:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 --2- 172.21.15.49:0/766787175 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088109df0 0x7f8088110620 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 --2- 172.21.15.49:0/766787175 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80881094a0 0x7f80881098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 --2- 172.21.15.49:0/766787175 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8088103b60 0x7f8088103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 -- 172.21.15.49:0/766787175 >> 172.21.15.49:0/766787175 conn(0x7f808807b850 msgr2=0x7f808807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 -- 172.21.15.49:0/766787175 shutdown_connections 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 -- 172.21.15.49:0/766787175 wait complete. 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 Processor -- start 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.240+0000 7f8090696640 1 -- start start 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f8090696640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088103b60 0x7f8088075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f8090696640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80881094a0 0x7f8088075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f8090696640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8088109df0 0x7f8088076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f8090696640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8088113ab0 con 0x7f8088103b60 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f8090696640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8088113930 con 0x7f8088109df0 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f8090696640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8088113c30 con 0x7f80881094a0 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808e432640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088103b60 0x7f8088075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808e432640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088103b60 0x7f8088075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44668/0 (socket says 172.21.15.49:44668) 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808e432640 1 -- 172.21.15.49:0/1380547913 learned_addr learned my addr 172.21.15.49:0/1380547913 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808dc31640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80881094a0 0x7f8088075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808ec33640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8088109df0 0x7f8088076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808e432640 1 -- 172.21.15.49:0/1380547913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80881094a0 msgr2=0x7f8088075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808e432640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80881094a0 0x7f8088075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808e432640 1 -- 172.21.15.49:0/1380547913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8088109df0 msgr2=0x7f8088076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808e432640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8088109df0 0x7f8088076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808e432640 1 -- 172.21.15.49:0/1380547913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80881a8700 con 0x7f8088103b60 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.241+0000 7f808e432640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088103b60 0x7f8088075710 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f808400e9f0 tx=0x7f808400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.242+0000 7f807f7fe640 1 -- 172.21.15.49:0/1380547913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808400cd80 con 0x7f8088103b60 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.242+0000 7f8090696640 1 -- 172.21.15.49:0/1380547913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80881a89f0 con 0x7f8088103b60 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.242+0000 7f807f7fe640 1 -- 172.21.15.49:0/1380547913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80840108e0 con 0x7f8088103b60 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.242+0000 7f807f7fe640 1 -- 172.21.15.49:0/1380547913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8084018980 con 0x7f8088103b60 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.242+0000 7f8090696640 1 -- 172.21.15.49:0/1380547913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80881a8f80 con 0x7f8088103b60 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.244+0000 7f8096c0a740 1 Processor -- start 2024-09-21T06:43:48.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f8096c0a740 1 -- start start 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f807f7fe640 1 -- 172.21.15.49:0/1380547913 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8084010430 con 0x7f8088103b60 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cf10070 0x55a23d2b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cee71b0 0x55a23d2b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23ceef390 0x55a23d2b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f8096c0a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a23d22de50 con 0x55a23ceef390 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f8096c0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a23d21d280 con 0x55a23cf10070 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f8096c0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a23d221090 con 0x55a23cee71b0 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808dc31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23ceef390 0x55a23d2b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808dc31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23ceef390 0x55a23d2b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44678/0 (socket says 172.21.15.49:44678) 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808dc31640 1 -- 172.21.15.49:0/2092852115 learned_addr learned my addr 172.21.15.49:0/2092852115 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808e432640 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cee71b0 0x55a23d2b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808ec33640 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cf10070 0x55a23d2b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808dc31640 1 -- 172.21.15.49:0/2092852115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cee71b0 msgr2=0x55a23d2b7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808dc31640 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cee71b0 0x55a23d2b7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808dc31640 1 -- 172.21.15.49:0/2092852115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cf10070 msgr2=0x55a23d2b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808dc31640 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cf10070 0x55a23d2b7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808dc31640 1 -- 172.21.15.49:0/2092852115 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a23cf7b650 con 0x55a23ceef390 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.245+0000 7f808ec33640 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cf10070 0x55a23d2b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.246+0000 7f808dc31640 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23ceef390 0x55a23d2b80d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f807800bc30 tx=0x7f80780107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3ea84e863f2b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.246+0000 7f807cff9640 1 -- 172.21.15.49:0/2092852115 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807801c480 con 0x55a23ceef390 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.246+0000 7f807f7fe640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f80740b6680 0x7f80740b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.246+0000 7f807cff9640 1 -- 172.21.15.49:0/2092852115 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f807801cad0 con 0x55a23ceef390 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.246+0000 7f807cff9640 1 -- 172.21.15.49:0/2092852115 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078011b50 con 0x55a23ceef390 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.246+0000 7f808ec33640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f80740b6680 0x7f80740b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.246+0000 7f807f7fe640 1 -- 172.21.15.49:0/1380547913 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f80840e7b40 con 0x7f8088103b60 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 -- 172.21.15.49:0/2092852115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23ceef390 msgr2=0x55a23d2b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f808ec33640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f80740b6680 0x7f80740b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f80800094e0 tx=0x7f80800093f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23ceef390 0x55a23d2b80d0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f807800bc30 tx=0x7f80780107a0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 -- 172.21.15.49:0/2092852115 shutdown_connections 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23ceef390 0x55a23d2b80d0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cee71b0 0x55a23d2b7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 --2- 172.21.15.49:0/2092852115 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cf10070 0x55a23d2b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 -- 172.21.15.49:0/2092852115 >> 172.21.15.49:0/2092852115 conn(0x55a23cf04460 msgr2=0x55a23d2b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 -- 172.21.15.49:0/2092852115 shutdown_connections 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 -- 172.21.15.49:0/2092852115 wait complete. 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.247+0000 7f8096c0a740 1 -- start start 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f8096c0a740 1 Processor -- start 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cf10070 0x55a23d2c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cece9f0 0x55a23d2cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f8096c0a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a23d07e700 con 0x55a23cf10070 2024-09-21T06:43:48.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f8096c0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a23d1b8110 con 0x55a23cee71b0 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f8096c0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a23d2c5e30 con 0x55a23cece9f0 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f8096c0a740 10 client.0 _ll_register_callbacks cb 0x55a23d1d1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808dc31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cf10070 0x55a23d2c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808dc31640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cf10070 0x55a23d2c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44688/0 (socket says 172.21.15.49:44688) 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808dc31640 1 -- 172.21.15.49:0/846786661 learned_addr learned my addr 172.21.15.49:0/846786661 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808ec33640 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cece9f0 0x55a23d2cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808e432640 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808dc31640 1 -- 172.21.15.49:0/846786661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cece9f0 msgr2=0x55a23d2cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808dc31640 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cece9f0 0x55a23d2cf120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808dc31640 1 -- 172.21.15.49:0/846786661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 msgr2=0x55a23d2c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808dc31640 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.248+0000 7f808dc31640 1 -- 172.21.15.49:0/846786661 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a23d1e5c40 con 0x55a23cf10070 2024-09-21T06:43:48.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f808dc31640 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cf10070 0x55a23d2c32a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8078005890 tx=0x7f807800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83394e0fc184d120 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8071ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8071ffb640 1 -- 172.21.15.49:0/846786661 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078004020 con 0x55a23cf10070 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8071ffb640 1 -- 172.21.15.49:0/846786661 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f80780041c0 con 0x55a23cf10070 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8096c0a740 1 -- 172.21.15.49:0/846786661 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f807801cad0 con 0x55a23cf10070 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8071ffb640 1 -- 172.21.15.49:0/846786661 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f80780043e0 con 0x55a23cf10070 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8096c0a740 10 client.17292 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8096c0a740 1 -- 172.21.15.49:0/846786661 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a23d2d1ba0 con 0x55a23cf10070 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8071ffb640 1 -- 172.21.15.49:0/846786661 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f807801cad0 con 0x55a23cf10070 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8071ffb640 1 -- 172.21.15.49:0/846786661 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8078005040 con 0x55a23cf10070 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8096c0a740 10 client.17292 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8096c0a740 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.249+0000 7f8096c0a740 20 client.17292 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:48.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.250+0000 7f8096c0a740 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a23cea3da0 0x55a23d2d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.250+0000 7f8096c0a740 4 client.17292 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.250+0000 7f8096c0a740 1 -- 172.21.15.49:0/846786661 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a23d22fda0 con 0x55a23cea3da0 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.250+0000 7f808e432640 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a23cea3da0 0x55a23d2d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.250+0000 7f808e432640 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a23cea3da0 0x55a23d2d4f00 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8dc61b375b68752 server_cookie=b675306235a52c52 in_seq=0 out_seq=0 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.250+0000 7f8071ffb640 10 client.17292 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8071ffb640 1 -- 172.21.15.49:0/846786661 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a23d22fda0 con 0x55a23cea3da0 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8071ffb640 10 client.17292 handle_command_reply: tid=0 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 client.17292 shutdown 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 -- 172.21.15.49:0/846786661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cf10070 msgr2=0x55a23d2c32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cf10070 0x55a23d2c32a0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f8078005890 tx=0x7f807800b8d0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 -- 172.21.15.49:0/846786661 shutdown_connections 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a23cea3da0 0x55a23d2d4f00 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cece9f0 0x55a23d2cf120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cf10070 0x55a23d2c32a0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 --2- 172.21.15.49:0/846786661 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 -- 172.21.15.49:0/846786661 >> 172.21.15.49:0/846786661 conn(0x55a23cf04460 msgr2=0x55a23d2ba830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8071ffb640 0 client.17292 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 -- 172.21.15.49:0/846786661 shutdown_connections 2024-09-21T06:43:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.251+0000 7f8096c0a740 1 -- 172.21.15.49:0/846786661 wait complete. 2024-09-21T06:43:48.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.252+0000 7f8096c0a740 20 client.17292 trim_cache size 0 max 16384 2024-09-21T06:43:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.269+0000 7f8096c0a740 1 Processor -- start 2024-09-21T06:43:48.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.269+0000 7f8096c0a740 1 -- start start 2024-09-21T06:43:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2bae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2bff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 0x55a23d2c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f8096c0a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f80881b43a0 con 0x55a23cece9f0 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f8096c0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f80881b1c70 con 0x55a23cee71b0 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f8096c0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f80881afae0 con 0x55a23cf10070 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808e432640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808e432640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2bae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44700/0 (socket says 172.21.15.49:44700) 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808e432640 1 -- 172.21.15.49:0/1177992305 learned_addr learned my addr 172.21.15.49:0/1177992305 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808dc31640 1 --2- 172.21.15.49:0/1177992305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808ec33640 1 --2- 172.21.15.49:0/1177992305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 0x55a23d2c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808e432640 1 -- 172.21.15.49:0/1177992305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 msgr2=0x55a23d2c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808e432640 1 --2- 172.21.15.49:0/1177992305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 0x55a23d2c0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808e432640 1 -- 172.21.15.49:0/1177992305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 msgr2=0x55a23d2bff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808e432640 1 --2- 172.21.15.49:0/1177992305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2bff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808e432640 1 -- 172.21.15.49:0/1177992305 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a23d2b9940 con 0x55a23cece9f0 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.270+0000 7f808e432640 1 --2- 172.21.15.49:0/1177992305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2bae60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f80840ad640 tx=0x7f80840ea0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f32477fff20f5b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:48.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.271+0000 7f8073fff640 1 -- 172.21.15.49:0/1177992305 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80840a90b0 con 0x55a23cece9f0 2024-09-21T06:43:48.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.271+0000 7f8073fff640 1 -- 172.21.15.49:0/1177992305 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8084010720 con 0x55a23cece9f0 2024-09-21T06:43:48.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.271+0000 7f8073fff640 1 -- 172.21.15.49:0/1177992305 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80840a9bb0 con 0x55a23cece9f0 2024-09-21T06:43:48.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.271+0000 7f8096c0a740 1 -- 172.21.15.49:0/1177992305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 msgr2=0x55a23d2bae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:48.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.271+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1177992305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2bae60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f80840ad640 tx=0x7f80840ea0c0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.271+0000 7f8096c0a740 1 -- 172.21.15.49:0/1177992305 shutdown_connections 2024-09-21T06:43:48.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.271+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1177992305 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 0x55a23d2c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.271+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1177992305 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2bff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.271+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1177992305 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2bae60 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 -- 172.21.15.49:0/1177992305 >> 172.21.15.49:0/1177992305 conn(0x55a23cf04460 msgr2=0x55a23d2ba750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 -- 172.21.15.49:0/1177992305 shutdown_connections 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 -- 172.21.15.49:0/1177992305 wait complete. 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 -- start start 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 Processor -- start 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2d6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2d6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 0x55a23d33e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f80881b0130 con 0x55a23cece9f0 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f80881b15a0 con 0x55a23cee71b0 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f80881b0800 con 0x55a23cf10070 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f8096c0a740 10 client.0 _ll_register_callbacks cb 0x7f807800ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:48.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.272+0000 7f808e432640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2d6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808e432640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2d6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44714/0 (socket says 172.21.15.49:44714) 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808e432640 1 -- 172.21.15.49:0/1784644882 learned_addr learned my addr 172.21.15.49:0/1784644882 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808ec33640 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 0x55a23d33e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808dc31640 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2d6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808e432640 1 -- 172.21.15.49:0/1784644882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 msgr2=0x55a23d33e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808e432640 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 0x55a23d33e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808e432640 1 -- 172.21.15.49:0/1784644882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 msgr2=0x55a23d2d6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808e432640 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2d6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808e432640 1 -- 172.21.15.49:0/1784644882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a23d33ecf0 con 0x55a23cece9f0 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f808e432640 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2d6770 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f80840ad8d0 tx=0x7f80840e7f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf15ce56e4e6fb58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f8071ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f8071ffb640 1 -- 172.21.15.49:0/1784644882 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80840ad450 con 0x55a23cece9f0 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f8096c0a740 1 -- 172.21.15.49:0/1784644882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a23d22b850 con 0x55a23cece9f0 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f8071ffb640 1 -- 172.21.15.49:0/1784644882 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7f80840b2070 con 0x55a23cece9f0 2024-09-21T06:43:48.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.273+0000 7f8071ffb640 1 -- 172.21.15.49:0/1784644882 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f80840ae040 con 0x55a23cece9f0 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8096c0a740 10 client.17298 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8096c0a740 1 -- 172.21.15.49:0/1784644882 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a23d33ff60 con 0x55a23cece9f0 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8071ffb640 1 -- 172.21.15.49:0/1784644882 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a23d22b850 con 0x55a23cece9f0 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8071ffb640 1 -- 172.21.15.49:0/1784644882 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f80840a9450 con 0x55a23cece9f0 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8096c0a740 10 client.17298 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8096c0a740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8096c0a740 20 client.17298 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a23d3404f0 0x55a23d342910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8096c0a740 4 client.17298 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f8096c0a740 1 -- 172.21.15.49:0/1784644882 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a23d228c80 con 0x55a23d3404f0 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.274+0000 7f808dc31640 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a23d3404f0 0x55a23d342910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f808dc31640 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a23d3404f0 0x55a23d342910 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3481bbab10897996 server_cookie=38fe1b1d01546b24 in_seq=0 out_seq=0 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8071ffb640 10 client.17298 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8071ffb640 1 -- 172.21.15.49:0/1784644882 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3694 (crc 0 0 0) 0x55a23d228c80 con 0x55a23d3404f0 2024-09-21T06:43:48.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8071ffb640 10 client.17298 handle_command_reply: tid=0 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 client.17298 shutdown 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 -- 172.21.15.49:0/1784644882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 msgr2=0x55a23d2d6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2d6770 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f80840ad8d0 tx=0x7f80840e7f30 comp rx=0 tx=0).stop 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 -- 172.21.15.49:0/1784644882 shutdown_connections 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55a23d3404f0 0x55a23d342910 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a23cf10070 0x55a23d33e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a23cee71b0 0x55a23d2d6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 --2- 172.21.15.49:0/1784644882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a23cece9f0 0x55a23d2d6770 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 -- 172.21.15.49:0/1784644882 >> 172.21.15.49:0/1784644882 conn(0x55a23cf04460 msgr2=0x55a23d2b8680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8071ffb640 0 client.17298 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 -- 172.21.15.49:0/1784644882 shutdown_connections 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 1 -- 172.21.15.49:0/1784644882 wait complete. 2024-09-21T06:43:48.281 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.275+0000 7f8096c0a740 20 client.17298 trim_cache size 0 max 16384 2024-09-21T06:43:48.282 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:43:48.282 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:43:48.282 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:43:48.282 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:43:48.282 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.282 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "5909134b-6be3-4b78-b014-cd698f8e6b28", 2024-09-21T06:43:48.282 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:43:48.282 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:43:48.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.283 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.284 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.285 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:43:48.286 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:43:48.289 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:43:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 -- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f80740b6680 msgr2=0x7f80740b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f80740b6680 0x7f80740b8b90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f80800094e0 tx=0x7f80800093f0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 -- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088103b60 msgr2=0x7f8088075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088103b60 0x7f8088075710 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f808400e9f0 tx=0x7f808400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 -- 172.21.15.49:0/1380547913 shutdown_connections 2024-09-21T06:43:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f80740b6680 0x7f80740b8b90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8088109df0 0x7f8088076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f80881094a0 0x7f8088075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 --2- 172.21.15.49:0/1380547913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8088103b60 0x7f8088075710 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:48.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 -- 172.21.15.49:0/1380547913 >> 172.21.15.49:0/1380547913 conn(0x7f808807b850 msgr2=0x7f8088105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:48.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 -- 172.21.15.49:0/1380547913 shutdown_connections 2024-09-21T06:43:48.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:43:48.276+0000 7f8090696640 1 -- 172.21.15.49:0/1380547913 wait complete. 2024-09-21T06:43:48.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:47 smithi098 ceph-mon[34704]: pgmap v535: 97 pgs: 97 active+clean; 6.8 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:43:48.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:47 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:43:48.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:47 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:48.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:47 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:43:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:47 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:43:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:47 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:47 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:48.997 INFO:tasks.cephfs.filesystem:scrub status for tag:5909134b-6be3-4b78-b014-cd698f8e6b28 - {'path': '/', 'tag': '5909134b-6be3-4b78-b014-cd698f8e6b28', 'options': 'recursive,force'} 2024-09-21T06:43:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:49 smithi079 ceph-mon[34346]: pgmap v536: 97 pgs: 97 active+clean; 6.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-09-21T06:43:50.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:49 smithi049 ceph-mon[31177]: pgmap v536: 97 pgs: 97 active+clean; 6.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-09-21T06:43:50.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:49 smithi098 ceph-mon[34704]: pgmap v536: 97 pgs: 97 active+clean; 6.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-09-21T06:43:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:51 smithi079 ceph-mon[34346]: pgmap v537: 97 pgs: 97 active+clean; 6.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:43:52.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:51 smithi049 ceph-mon[31177]: pgmap v537: 97 pgs: 97 active+clean; 6.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:43:52.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:51 smithi098 ceph-mon[34704]: pgmap v537: 97 pgs: 97 active+clean; 6.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:43:54.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:53 smithi049 ceph-mon[31177]: pgmap v538: 97 pgs: 97 active+clean; 6.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:43:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:53 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:43:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:53 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:43:54.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:53 smithi098 ceph-mon[34704]: pgmap v538: 97 pgs: 97 active+clean; 6.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:43:54.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:53 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:43:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:53 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:43:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:53 smithi079 ceph-mon[34346]: pgmap v538: 97 pgs: 97 active+clean; 6.9 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:43:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:53 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:43:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:53 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:43:55.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:43:55.224 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:43:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:43:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:43:55.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:43:55.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:43:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:43:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:55.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:43:55.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:43:55.320 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 -- 172.21.15.49:0/1771474587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 msgr2=0x7ff3f810f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 --2- 172.21.15.49:0/1771474587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 0x7ff3f810f470 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009900 tx=0x7ff3f002a410 comp rx=0 tx=0).stop 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 -- 172.21.15.49:0/1771474587 shutdown_connections 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 --2- 172.21.15.49:0/1771474587 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 0x7ff3f810f470 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 --2- 172.21.15.49:0/1771474587 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3f81082f0 0x7ff3f8108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 --2- 172.21.15.49:0/1771474587 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f81029c0 0x7ff3f8102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 -- 172.21.15.49:0/1771474587 >> 172.21.15.49:0/1771474587 conn(0x7ff3f80fe3c0 msgr2=0x7ff3f8100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 -- 172.21.15.49:0/1771474587 shutdown_connections 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 -- 172.21.15.49:0/1771474587 wait complete. 2024-09-21T06:43:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 Processor -- start 2024-09-21T06:43:56.152 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.149+0000 7ff3ff112640 1 -- start start 2024-09-21T06:43:56.153 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3ff112640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f81029c0 0x7ff3f81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.153 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3ff112640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3f81082f0 0x7ff3f8199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.153 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3ff112640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 0x7ff3f819eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3ff112640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8112900 con 0x7ff3f8108c40 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3ff112640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8112780 con 0x7ff3f81029c0 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3ff112640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8112a80 con 0x7ff3f81082f0 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3fd6af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 0x7ff3f819eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3fd6af640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 0x7ff3f819eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44730/0 (socket says 172.21.15.49:44730) 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3fd6af640 1 -- 172.21.15.49:0/865676637 learned_addr learned my addr 172.21.15.49:0/865676637 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3f81082f0 0x7ff3f8199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3fceae640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f81029c0 0x7ff3f81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3fd6af640 1 -- 172.21.15.49:0/865676637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3f81082f0 msgr2=0x7ff3f8199880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3fd6af640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3f81082f0 0x7ff3f8199880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3fd6af640 1 -- 172.21.15.49:0/865676637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f81029c0 msgr2=0x7ff3f81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3fd6af640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f81029c0 0x7ff3f81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.150+0000 7ff3fd6af640 1 -- 172.21.15.49:0/865676637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f819f210 con 0x7ff3f8108c40 2024-09-21T06:43:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.151+0000 7ff3fd6af640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 0x7ff3f819eb10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0004770 tx=0x7ff3f0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.151+0000 7ff3f5ffb640 1 -- 172.21.15.49:0/865676637 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f003f030 con 0x7ff3f8108c40 2024-09-21T06:43:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.151+0000 7ff3f5ffb640 1 -- 172.21.15.49:0/865676637 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3f0004440 con 0x7ff3f8108c40 2024-09-21T06:43:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.151+0000 7ff3ff112640 1 -- 172.21.15.49:0/865676637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f819f4a0 con 0x7ff3f8108c40 2024-09-21T06:43:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.151+0000 7ff3f5ffb640 1 -- 172.21.15.49:0/865676637 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0035070 con 0x7ff3f8108c40 2024-09-21T06:43:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.151+0000 7ff3ff112640 1 -- 172.21.15.49:0/865676637 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f81a5c90 con 0x7ff3f8108c40 2024-09-21T06:43:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.154+0000 7ff406078740 1 Processor -- start 2024-09-21T06:43:56.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.154+0000 7ff3f5ffb640 1 -- 172.21.15.49:0/865676637 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ff3f0042030 con 0x7ff3f8108c40 2024-09-21T06:43:56.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.154+0000 7ff406078740 1 -- start start 2024-09-21T06:43:56.157 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.154+0000 7ff406078740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 0x558e2510fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.157 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff406078740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e25110100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff406078740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 0x558e25110640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff406078740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558e250826f0 con 0x558e24d3f2f0 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff406078740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e25071b20 con 0x558e24d474d0 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff406078740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558e25075930 con 0x558e24d681b0 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3fceae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e25110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3fceae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e25110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44746/0 (socket says 172.21.15.49:44746) 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3fceae640 1 -- 172.21.15.49:0/112196719 learned_addr learned my addr 172.21.15.49:0/112196719 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/112196719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 0x558e2510fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/112196719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 0x558e25110640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3fceae640 1 -- 172.21.15.49:0/112196719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 msgr2=0x558e2510fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3fceae640 1 --2- 172.21.15.49:0/112196719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 0x558e2510fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3fceae640 1 -- 172.21.15.49:0/112196719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 msgr2=0x558e25110640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3fceae640 1 --2- 172.21.15.49:0/112196719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 0x558e25110640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3f5ffb640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3e40b6680 0x7ff3e40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.158 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3fceae640 1 -- 172.21.15.49:0/112196719 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e25037530 con 0x558e24d3f2f0 2024-09-21T06:43:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3e40b6680 0x7ff3e40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3f5ffb640 1 -- 172.21.15.49:0/865676637 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7ff3f0107a80 con 0x7ff3f8108c40 2024-09-21T06:43:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.155+0000 7ff3fceae640 1 --2- 172.21.15.49:0/112196719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e25110100 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009cf0 tx=0x7ff3e8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd67adeb6e21e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.156+0000 7ff3eeffd640 1 -- 172.21.15.49:0/112196719 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e801e070 con 0x558e24d3f2f0 2024-09-21T06:43:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.156+0000 7ff3eeffd640 1 -- 172.21.15.49:0/112196719 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3e8009de0 con 0x558e24d3f2f0 2024-09-21T06:43:56.159 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.156+0000 7ff3eeffd640 1 -- 172.21.15.49:0/112196719 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8019450 con 0x558e24d3f2f0 2024-09-21T06:43:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.156+0000 7ff406078740 1 -- 172.21.15.49:0/112196719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 msgr2=0x558e25110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.156+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3e40b6680 0x7ff3e40b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8101c10 tx=0x7ff3e0004a40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.156+0000 7ff406078740 1 --2- 172.21.15.49:0/112196719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e25110100 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009cf0 tx=0x7ff3e8011810 comp rx=0 tx=0).stop 2024-09-21T06:43:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.157+0000 7ff406078740 1 -- 172.21.15.49:0/112196719 shutdown_connections 2024-09-21T06:43:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.157+0000 7ff406078740 1 --2- 172.21.15.49:0/112196719 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 0x558e25110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.157+0000 7ff406078740 1 --2- 172.21.15.49:0/112196719 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e25110100 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.157+0000 7ff406078740 1 --2- 172.21.15.49:0/112196719 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 0x558e2510fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.157+0000 7ff406078740 1 -- 172.21.15.49:0/112196719 >> 172.21.15.49:0/112196719 conn(0x558e24d5c300 msgr2=0x558e2510dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.157+0000 7ff406078740 1 -- 172.21.15.49:0/112196719 shutdown_connections 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.157+0000 7ff406078740 1 -- 172.21.15.49:0/112196719 wait complete. 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.157+0000 7ff406078740 1 -- start start 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.157+0000 7ff406078740 1 Processor -- start 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff406078740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d3f2f0 0x558e2511b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff406078740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d474d0 0x558e2511b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff406078740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 0x558e25127660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff406078740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558e24fa9ab0 con 0x558e24d474d0 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff406078740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558e25017730 con 0x558e24d681b0 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff406078740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558e2511e340 con 0x558e24d3f2f0 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff406078740 10 client.0 _ll_register_callbacks cb 0x558e2506b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d474d0 0x558e2511b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3f7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d474d0 0x558e2511b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44750/0 (socket says 172.21.15.49:44750) 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3f7fff640 1 -- 172.21.15.49:0/496485334 learned_addr learned my addr 172.21.15.49:0/496485334 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3fd6af640 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 0x558e25127660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3fceae640 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d3f2f0 0x558e2511b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3f7fff640 1 -- 172.21.15.49:0/496485334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d3f2f0 msgr2=0x558e2511b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d3f2f0 0x558e2511b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3f7fff640 1 -- 172.21.15.49:0/496485334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 msgr2=0x558e25127660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 0x558e25127660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3f7fff640 1 -- 172.21.15.49:0/496485334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e24dd3790 con 0x558e24d474d0 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d474d0 0x558e2511b7b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000ff70 tx=0x7ff3e0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dc0c70fff9c5ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.158+0000 7ff3d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff3d7fff640 1 -- 172.21.15.49:0/496485334 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e002e060 con 0x558e24d474d0 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff3d7fff640 1 -- 172.21.15.49:0/496485334 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7ff3e000e5c0 con 0x558e24d474d0 2024-09-21T06:43:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff406078740 1 -- 172.21.15.49:0/496485334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e8009de0 con 0x558e24d474d0 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff3d7fff640 1 -- 172.21.15.49:0/496485334 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff3e0004b20 con 0x558e24d474d0 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff406078740 10 client.17310 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff406078740 1 -- 172.21.15.49:0/496485334 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e24e4c620 con 0x558e24d474d0 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff3d7fff640 1 -- 172.21.15.49:0/496485334 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3e8009de0 con 0x558e24d474d0 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff3d7fff640 1 -- 172.21.15.49:0/496485334 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff3e0005020 con 0x558e24d474d0 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff406078740 10 client.17310 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff406078740 10 client.17310 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff406078740 20 client.17310 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff406078740 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558e24d26d80 0x558e2512d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff406078740 4 client.17310 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.159+0000 7ff406078740 1 -- 172.21.15.49:0/496485334 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e25084640 con 0x558e24d26d80 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.160+0000 7ff3fceae640 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558e24d26d80 0x558e2512d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.160+0000 7ff3fceae640 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558e24d26d80 0x558e2512d490 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b95c0e492fee8912 server_cookie=171f8104ce2133d1 in_seq=0 out_seq=0 2024-09-21T06:43:56.166 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.160+0000 7ff3d7fff640 10 client.17310 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff3d7fff640 1 -- 172.21.15.49:0/496485334 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558e25084640 con 0x558e24d26d80 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff3d7fff640 10 client.17310 handle_command_reply: tid=0 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 client.17310 shutdown 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 -- 172.21.15.49:0/496485334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d474d0 msgr2=0x558e2511b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d474d0 0x558e2511b7b0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000ff70 tx=0x7ff3e0004ab0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 -- 172.21.15.49:0/496485334 shutdown_connections 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558e24d26d80 0x558e2512d490 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 0x558e25127660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d474d0 0x558e2511b7b0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 --2- 172.21.15.49:0/496485334 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d3f2f0 0x558e2511b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 -- 172.21.15.49:0/496485334 >> 172.21.15.49:0/496485334 conn(0x558e24d5c300 msgr2=0x558e25110bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff3d7fff640 0 client.17310 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 -- 172.21.15.49:0/496485334 shutdown_connections 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 1 -- 172.21.15.49:0/496485334 wait complete. 2024-09-21T06:43:56.167 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.161+0000 7ff406078740 20 client.17310 trim_cache size 0 max 16384 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff406078740 1 Processor -- start 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff406078740 1 -- start start 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff406078740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2510dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff406078740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d474d0 0x558e25127560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff406078740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 0x558e25118440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff406078740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f81afeb0 con 0x558e24d3f2f0 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff406078740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f81ad780 con 0x558e24d681b0 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff406078740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f81ab5f0 con 0x558e24d474d0 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff3fceae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2510dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff3fceae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2510dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44760/0 (socket says 172.21.15.49:44760) 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.176+0000 7ff3fceae640 1 -- 172.21.15.49:0/3185074225 learned_addr learned my addr 172.21.15.49:0/3185074225 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3fd6af640 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 0x558e25118440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.179 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d474d0 0x558e25127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3fceae640 1 -- 172.21.15.49:0/3185074225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d474d0 msgr2=0x558e25127560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3fceae640 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d474d0 0x558e25127560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3fceae640 1 -- 172.21.15.49:0/3185074225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 msgr2=0x558e25118440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3fceae640 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 0x558e25118440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3fceae640 1 -- 172.21.15.49:0/3185074225 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e2511c530 con 0x558e24d3f2f0 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3fd6af640 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 0x558e25118440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d474d0 0x558e25127560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3fceae640 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2510dae0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8000c00 tx=0x7ff3e80097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac803bcafbace7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3ee7fc640 1 -- 172.21.15.49:0/3185074225 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e801e040 con 0x558e24d3f2f0 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3ee7fc640 1 -- 172.21.15.49:0/3185074225 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3e8029070 con 0x558e24d3f2f0 2024-09-21T06:43:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.177+0000 7ff3ee7fc640 1 -- 172.21.15.49:0/3185074225 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e802d6d0 con 0x558e24d3f2f0 2024-09-21T06:43:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 -- 172.21.15.49:0/3185074225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 msgr2=0x558e2510dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2510dae0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8000c00 tx=0x7ff3e80097e0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 -- 172.21.15.49:0/3185074225 shutdown_connections 2024-09-21T06:43:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d681b0 0x558e25118440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d474d0 0x558e25127560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 --2- 172.21.15.49:0/3185074225 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2510dae0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 -- 172.21.15.49:0/3185074225 >> 172.21.15.49:0/3185074225 conn(0x558e24d5c300 msgr2=0x558e2510d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 -- 172.21.15.49:0/3185074225 shutdown_connections 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 -- 172.21.15.49:0/3185074225 wait complete. 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 -- start start 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.178+0000 7ff406078740 1 Processor -- start 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff406078740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2511edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff406078740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 0x558e2511f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff406078740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 0x558e25195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff406078740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f81abc40 con 0x558e24d3f2f0 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff406078740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f81ad0b0 con 0x558e24d474d0 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff406078740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f81ac310 con 0x558e24d681b0 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff406078740 10 client.0 _ll_register_callbacks cb 0x7ff3e00118b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fceae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2511edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fceae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2511edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44772/0 (socket says 172.21.15.49:44772) 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fceae640 1 -- 172.21.15.49:0/4094254039 learned_addr learned my addr 172.21.15.49:0/4094254039 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 0x558e2511f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fd6af640 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 0x558e25195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fceae640 1 -- 172.21.15.49:0/4094254039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 msgr2=0x558e25195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fceae640 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 0x558e25195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fceae640 1 -- 172.21.15.49:0/4094254039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 msgr2=0x558e2511f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fceae640 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 0x558e2511f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fceae640 1 -- 172.21.15.49:0/4094254039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e25196410 con 0x558e24d3f2f0 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3fceae640 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2511edc0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800a010 tx=0x7ff3e8009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4475ec18a1e81567 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.179+0000 7ff3d7fff640 1 -- 172.21.15.49:0/4094254039 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e801e030 con 0x558e24d3f2f0 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff3d7fff640 1 -- 172.21.15.49:0/4094254039 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8594+0+0 (secure 0 0 0) 0x7ff3e8016040 con 0x558e24d3f2f0 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff406078740 1 -- 172.21.15.49:0/4094254039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e8029070 con 0x558e24d3f2f0 2024-09-21T06:43:56.185 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff3d7fff640 1 -- 172.21.15.49:0/4094254039 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff3e80036f0 con 0x558e24d3f2f0 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff406078740 10 client.17316 fetch_fsmap learned FSMap version 27 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff406078740 1 -- 172.21.15.49:0/4094254039 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558e251974e0 con 0x558e24d3f2f0 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff3d7fff640 1 -- 172.21.15.49:0/4094254039 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3e8029070 con 0x558e24d3f2f0 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff3d7fff640 1 -- 172.21.15.49:0/4094254039 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7ff3e802d9f0 con 0x558e24d3f2f0 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff406078740 10 client.17316 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff406078740 10 client.17316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff406078740 20 client.17316 populate_metadata read hostname 'smithi049' 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff406078740 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558e24cfc1c0 0x558e251999c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff406078740 4 client.17316 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff406078740 1 -- 172.21.15.49:0/4094254039 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558e2512da80 con 0x558e24cfc1c0 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.180+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558e24cfc1c0 0x558e251999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.181+0000 7ff3d7fff640 10 client.17316 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:56.186 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.181+0000 7ff3f7fff640 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558e24cfc1c0 0x558e251999c0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7e6000ddaa0a35 server_cookie=a0cb5eac8c3e557d in_seq=0 out_seq=0 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.188+0000 7ff3d7fff640 1 -- 172.21.15.49:0/4094254039 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558e2512da80 con 0x558e24cfc1c0 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.188+0000 7ff3d7fff640 10 client.17316 handle_command_reply: tid=0 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 client.17316 shutdown 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 -- 172.21.15.49:0/4094254039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 msgr2=0x558e2511edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2511edc0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff3e800a010 tx=0x7ff3e8009910 comp rx=0 tx=0).stop 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 -- 172.21.15.49:0/4094254039 shutdown_connections 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x558e24cfc1c0 0x558e251999c0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558e24d681b0 0x558e25195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558e24d474d0 0x558e2511f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff3d7fff640 0 client.17316 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 --2- 172.21.15.49:0/4094254039 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558e24d3f2f0 0x558e2511edc0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.191 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 -- 172.21.15.49:0/4094254039 >> 172.21.15.49:0/4094254039 conn(0x558e24d5c300 msgr2=0x558e25109ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:56.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 -- 172.21.15.49:0/4094254039 shutdown_connections 2024-09-21T06:43:56.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 1 -- 172.21.15.49:0/4094254039 wait complete. 2024-09-21T06:43:56.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.189+0000 7ff406078740 20 client.17316 trim_cache size 0 max 16384 2024-09-21T06:43:56.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:43:56.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:43:56.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:43:56.192 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:43:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 -- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3e40b6680 msgr2=0x7ff3e40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3e40b6680 0x7ff3e40b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8101c10 tx=0x7ff3e0004a40 comp rx=0 tx=0).stop 2024-09-21T06:43:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 -- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 msgr2=0x7ff3f819eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 0x7ff3f819eb10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0004770 tx=0x7ff3f0004040 comp rx=0 tx=0).stop 2024-09-21T06:43:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 -- 172.21.15.49:0/865676637 shutdown_connections 2024-09-21T06:43:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ff3e40b6680 0x7ff3e40b8b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ff3f8108c40 0x7ff3f819eb10 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ff3f81082f0 0x7ff3f8199880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.193 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 --2- 172.21.15.49:0/865676637 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ff3f81029c0 0x7ff3f81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 -- 172.21.15.49:0/865676637 >> 172.21.15.49:0/865676637 conn(0x7ff3f80fe3c0 msgr2=0x7ff3f81078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:56.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 -- 172.21.15.49:0/865676637 shutdown_connections 2024-09-21T06:43:56.194 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:43:56.190+0000 7ff3ff112640 1 -- 172.21.15.49:0/865676637 wait complete. 2024-09-21T06:43:56.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:55 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-21T06:43:56.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:55 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi079 to 176.0M 2024-09-21T06:43:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:55 smithi049 ceph-mon[31177]: Adjusting osd_memory_target on smithi049 to 176.0M 2024-09-21T06:43:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:55 smithi049 ceph-mon[31177]: Unable to set osd_memory_target on smithi098 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-21T06:43:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:55 smithi049 ceph-mon[31177]: Unable to set osd_memory_target on smithi079 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-21T06:43:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:55 smithi049 ceph-mon[31177]: Unable to set osd_memory_target on smithi049 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-21T06:43:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:55 smithi049 ceph-mon[31177]: pgmap v539: 97 pgs: 97 active+clean; 7.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 15 op/s 2024-09-21T06:43:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:55 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-21T06:43:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:55 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi079 to 176.0M 2024-09-21T06:43:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:55 smithi098 ceph-mon[34704]: Adjusting osd_memory_target on smithi049 to 176.0M 2024-09-21T06:43:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:55 smithi098 ceph-mon[34704]: Unable to set osd_memory_target on smithi098 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-21T06:43:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:55 smithi098 ceph-mon[34704]: Unable to set osd_memory_target on smithi079 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-21T06:43:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:55 smithi098 ceph-mon[34704]: Unable to set osd_memory_target on smithi049 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-21T06:43:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:55 smithi098 ceph-mon[34704]: pgmap v539: 97 pgs: 97 active+clean; 7.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 15 op/s 2024-09-21T06:43:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:55 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi098 to 176.0M 2024-09-21T06:43:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:55 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi079 to 176.0M 2024-09-21T06:43:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:55 smithi079 ceph-mon[34346]: Adjusting osd_memory_target on smithi049 to 176.0M 2024-09-21T06:43:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:55 smithi079 ceph-mon[34346]: Unable to set osd_memory_target on smithi098 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-21T06:43:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:55 smithi079 ceph-mon[34346]: Unable to set osd_memory_target on smithi079 to 184588902: error parsing value: Value '184588902' is below minimum 939524096 2024-09-21T06:43:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:55 smithi079 ceph-mon[34346]: Unable to set osd_memory_target on smithi049 to 184555929: error parsing value: Value '184555929' is below minimum 939524096 2024-09-21T06:43:56.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:55 smithi079 ceph-mon[34346]: pgmap v539: 97 pgs: 97 active+clean; 7.0 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 15 op/s 2024-09-21T06:43:58.098 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:57 smithi098 ceph-mon[34704]: pgmap v540: 97 pgs: 97 active+clean; 7.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 KiB/s wr, 14 op/s 2024-09-21T06:43:58.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:57 smithi049 ceph-mon[31177]: pgmap v540: 97 pgs: 97 active+clean; 7.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 KiB/s wr, 14 op/s 2024-09-21T06:43:58.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:57 smithi079 ceph-mon[34346]: pgmap v540: 97 pgs: 97 active+clean; 7.1 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 KiB/s wr, 14 op/s 2024-09-21T06:43:59.710 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.710 INFO:tasks.workunit.client.0.smithi049.stdout:313/600: open fd = 3 2024-09-21T06:43:59.710 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:314/600: open fd = 3 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:315/600: open fd = 3 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:316/600: open fd = 3 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.711 INFO:tasks.workunit.client.0.smithi049.stdout:317/600: open fd = 3 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:318/600: open fd = 3 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:319/600: open fd = 3 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:320/600: open fd = 3 2024-09-21T06:43:59.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:321/600: open fd = 3 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:322/600: open fd = 3 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:323/600: open fd = 3 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.713 INFO:tasks.workunit.client.0.smithi049.stdout:324/600: open fd = 3 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:325/600: open fd = 3 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:326/600: open fd = 3 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:327/600: open fd = 3 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.714 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:328/600: open fd = 3 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:329/600: open fd = 3 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:330/600: open fd = 3 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:331/600: open fd = 3 2024-09-21T06:43:59.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:332/600: open fd = 3 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:333/600: open fd = 3 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:334/600: open fd = 3 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.716 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:335/600: open fd = 3 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:336/600: open fd = 3 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:337/600: open fd = 3 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:338/600: open fd = 3 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:339/600: open fd = 3 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:340/600: open fd = 3 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:341/600: open fd = 3 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.718 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:342/600: open fd = 3 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:343/600: open fd = 3 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:344/600: open fd = 3 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.719 INFO:tasks.workunit.client.0.smithi049.stdout:345/600: open fd = 3 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:346/600: open fd = 3 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:347/600: open fd = 3 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:348/600: open fd = 3 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.720 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:349/600: open fd = 3 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:350/600: open fd = 3 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:351/600: open fd = 3 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:352/600: open fd = 3 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.721 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:353/600: open fd = 3 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:354/600: open fd = 3 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:355/600: open fd = 3 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:356/600: open fd = 3 2024-09-21T06:43:59.722 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:357/600: open fd = 3 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:358/600: open fd = 3 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:359/600: open fd = 3 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.723 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:360/600: open fd = 3 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:361/600: open fd = 3 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:362/600: open fd = 3 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.724 INFO:tasks.workunit.client.0.smithi049.stdout:363/600: open fd = 3 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:364/600: open fd = 3 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:365/600: open fd = 3 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:366/600: open fd = 3 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.725 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:367/600: open fd = 3 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:368/600: open fd = 3 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:369/600: open fd = 3 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:370/600: open fd = 3 2024-09-21T06:43:59.726 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:371/600: open fd = 3 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:372/600: open fd = 3 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:373/600: open fd = 3 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:43:59.727 INFO:tasks.workunit.client.0.smithi049.stdout:374/600: open fd = 3 2024-09-21T06:43:59.728 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.728 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:43:59.728 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:44:00.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:43:59 smithi049 ceph-mon[31177]: pgmap v541: 97 pgs: 97 active+clean; 7.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-21T06:44:00.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:43:59 smithi098 ceph-mon[34704]: pgmap v541: 97 pgs: 97 active+clean; 7.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-21T06:44:00.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:43:59 smithi079 ceph-mon[34346]: pgmap v541: 97 pgs: 97 active+clean; 7.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 33 KiB/s wr, 16 op/s 2024-09-21T06:44:02.121 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:01 smithi079 ceph-mon[34346]: pgmap v542: 97 pgs: 97 active+clean; 7.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:44:02.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:01 smithi049 ceph-mon[31177]: pgmap v542: 97 pgs: 97 active+clean; 7.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:44:02.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:01 smithi098 ceph-mon[34704]: pgmap v542: 97 pgs: 97 active+clean; 7.2 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:44:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:03 smithi049 ceph-mon[31177]: pgmap v543: 97 pgs: 97 active+clean; 7.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-21T06:44:04.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:03 smithi098 ceph-mon[34704]: pgmap v543: 97 pgs: 97 active+clean; 7.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-21T06:44:04.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:03 smithi079 ceph-mon[34346]: pgmap v543: 97 pgs: 97 active+clean; 7.2 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-21T06:44:06.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:05 smithi049 ceph-mon[31177]: pgmap v544: 97 pgs: 97 active+clean; 7.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 31 op/s 2024-09-21T06:44:06.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:05 smithi098 ceph-mon[34704]: pgmap v544: 97 pgs: 97 active+clean; 7.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 31 op/s 2024-09-21T06:44:06.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:05 smithi079 ceph-mon[34346]: pgmap v544: 97 pgs: 97 active+clean; 7.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 76 KiB/s wr, 31 op/s 2024-09-21T06:44:08.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:07 smithi049 ceph-mon[31177]: pgmap v545: 97 pgs: 97 active+clean; 7.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 70 KiB/s wr, 30 op/s 2024-09-21T06:44:08.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:07 smithi098 ceph-mon[34704]: pgmap v545: 97 pgs: 97 active+clean; 7.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 70 KiB/s wr, 30 op/s 2024-09-21T06:44:08.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:07 smithi079 ceph-mon[34346]: pgmap v545: 97 pgs: 97 active+clean; 7.3 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 70 KiB/s wr, 30 op/s 2024-09-21T06:44:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.303+0000 7eff71a9b640 1 -- 172.21.15.49:0/3036313836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1082f0 msgr2=0x7eff6c108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.303+0000 7eff71a9b640 1 --2- 172.21.15.49:0/3036313836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1082f0 0x7eff6c108700 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7eff60009900 tx=0x7eff6002a410 comp rx=0 tx=0).stop 2024-09-21T06:44:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.303+0000 7eff71a9b640 1 -- 172.21.15.49:0/3036313836 shutdown_connections 2024-09-21T06:44:09.305 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.303+0000 7eff71a9b640 1 --2- 172.21.15.49:0/3036313836 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff6c108c40 0x7eff6c10f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.303+0000 7eff71a9b640 1 --2- 172.21.15.49:0/3036313836 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1082f0 0x7eff6c108700 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.303+0000 7eff71a9b640 1 --2- 172.21.15.49:0/3036313836 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff6c1029c0 0x7eff6c102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.303+0000 7eff71a9b640 1 -- 172.21.15.49:0/3036313836 >> 172.21.15.49:0/3036313836 conn(0x7eff6c0fe3c0 msgr2=0x7eff6c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.303+0000 7eff71a9b640 1 -- 172.21.15.49:0/3036313836 shutdown_connections 2024-09-21T06:44:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.303+0000 7eff71a9b640 1 -- 172.21.15.49:0/3036313836 wait complete. 2024-09-21T06:44:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.304+0000 7eff71a9b640 1 Processor -- start 2024-09-21T06:44:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.304+0000 7eff71a9b640 1 -- start start 2024-09-21T06:44:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff71a9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1029c0 0x7eff6c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff71a9b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff6c1082f0 0x7eff6c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff71a9b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff6c108c40 0x7eff6c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff71a9b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c112900 con 0x7eff6c1029c0 2024-09-21T06:44:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff71a9b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c112780 con 0x7eff6c1082f0 2024-09-21T06:44:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff71a9b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c112a80 con 0x7eff6c108c40 2024-09-21T06:44:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1029c0 0x7eff6c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6b7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1029c0 0x7eff6c19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55790/0 (socket says 172.21.15.49:55790) 2024-09-21T06:44:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6b7fe640 1 -- 172.21.15.49:0/2296092346 learned_addr learned my addr 172.21.15.49:0/2296092346 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6affd640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff6c1082f0 0x7eff6c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6bfff640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff6c108c40 0x7eff6c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6b7fe640 1 -- 172.21.15.49:0/2296092346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff6c108c40 msgr2=0x7eff6c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6b7fe640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff6c108c40 0x7eff6c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6b7fe640 1 -- 172.21.15.49:0/2296092346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff6c1082f0 msgr2=0x7eff6c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6b7fe640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff6c1082f0 0x7eff6c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6b7fe640 1 -- 172.21.15.49:0/2296092346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6c1a0380 con 0x7eff6c1029c0 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff6b7fe640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1029c0 0x7eff6c19a450 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00e9f0 tx=0x7eff5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.305+0000 7eff68ff9640 1 -- 172.21.15.49:0/2296092346 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c00cd80 con 0x7eff6c1029c0 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.306+0000 7eff71a9b640 1 -- 172.21.15.49:0/2296092346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6c1a0670 con 0x7eff6c1029c0 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.306+0000 7eff68ff9640 1 -- 172.21.15.49:0/2296092346 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff5c0054d0 con 0x7eff6c1029c0 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.306+0000 7eff68ff9640 1 -- 172.21.15.49:0/2296092346 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff5c010690 con 0x7eff6c1029c0 2024-09-21T06:44:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.306+0000 7eff71a9b640 1 -- 172.21.15.49:0/2296092346 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6c1a6e00 con 0x7eff6c1029c0 2024-09-21T06:44:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.308+0000 7eff78a13740 1 Processor -- start 2024-09-21T06:44:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff78a13740 1 -- start start 2024-09-21T06:44:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff68ff9640 1 -- 172.21.15.49:0/2296092346 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7eff5c004e90 con 0x7eff6c1029c0 2024-09-21T06:44:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff78a13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7d01b0 0x5644ccb759b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff78a13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 0x5644ccb75ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff78a13740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7af4d0 0x5644ccb76430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff78a13740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5644ccaea6f0 con 0x5644cc7af4d0 2024-09-21T06:44:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff78a13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5644ccad9b20 con 0x5644cc7d01b0 2024-09-21T06:44:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff78a13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5644ccadd930 con 0x5644cc7a72f0 2024-09-21T06:44:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7d01b0 0x5644ccb759b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7d01b0 0x5644ccb759b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:53358/0 (socket says 172.21.15.49:53358) 2024-09-21T06:44:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6bfff640 1 -- 172.21.15.49:0/2621886803 learned_addr learned my addr 172.21.15.49:0/2621886803 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7af4d0 0x5644ccb76430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6b7fe640 1 --2- 172.21.15.49:0/2621886803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 0x5644ccb75ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6bfff640 1 -- 172.21.15.49:0/2621886803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 msgr2=0x5644ccb75ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6bfff640 1 --2- 172.21.15.49:0/2621886803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 0x5644ccb75ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6bfff640 1 -- 172.21.15.49:0/2621886803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7af4d0 msgr2=0x5644ccb76430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6bfff640 1 --2- 172.21.15.49:0/2621886803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7af4d0 0x5644ccb76430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.309+0000 7eff6bfff640 1 -- 172.21.15.49:0/2621886803 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644cca9f530 con 0x5644cc7d01b0 2024-09-21T06:44:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.310+0000 7eff6bfff640 1 --2- 172.21.15.49:0/2621886803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7d01b0 0x5644ccb759b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7eff64009fd0 tx=0x7eff640118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6a9af2a81b32086 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.310+0000 7eff68ff9640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7eff540b6680 0x7eff540b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.310+0000 7eff6b7fe640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7eff540b6680 0x7eff540b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.310+0000 7eff51ffb640 1 -- 172.21.15.49:0/2621886803 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64004d20 con 0x5644cc7d01b0 2024-09-21T06:44:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.310+0000 7eff51ffb640 1 -- 172.21.15.49:0/2621886803 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff64004050 con 0x5644cc7d01b0 2024-09-21T06:44:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.310+0000 7eff51ffb640 1 -- 172.21.15.49:0/2621886803 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64005260 con 0x5644cc7d01b0 2024-09-21T06:44:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.310+0000 7eff68ff9640 1 -- 172.21.15.49:0/2296092346 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8638+0+0 (secure 0 0 0) 0x7eff5c0e7b60 con 0x7eff6c1029c0 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff78a13740 1 -- 172.21.15.49:0/2621886803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7d01b0 msgr2=0x5644ccb759b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff6b7fe640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7eff540b6680 0x7eff540b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0e52f0 tx=0x7eff5c004a90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff78a13740 1 --2- 172.21.15.49:0/2621886803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7d01b0 0x5644ccb759b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7eff64009fd0 tx=0x7eff640118d0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff78a13740 1 -- 172.21.15.49:0/2621886803 shutdown_connections 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff78a13740 1 --2- 172.21.15.49:0/2621886803 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7af4d0 0x5644ccb76430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff78a13740 1 --2- 172.21.15.49:0/2621886803 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 0x5644ccb75ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff78a13740 1 --2- 172.21.15.49:0/2621886803 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7d01b0 0x5644ccb759b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff78a13740 1 -- 172.21.15.49:0/2621886803 >> 172.21.15.49:0/2621886803 conn(0x5644cc7c4300 msgr2=0x5644ccb738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff78a13740 1 -- 172.21.15.49:0/2621886803 shutdown_connections 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.311+0000 7eff78a13740 1 -- 172.21.15.49:0/2621886803 wait complete. 2024-09-21T06:44:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.312+0000 7eff78a13740 1 -- start start 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.312+0000 7eff78a13740 1 Processor -- start 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.312+0000 7eff78a13740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7a72f0 0x5644ccb853b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff78a13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 0x5644ccb858f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff78a13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7d01b0 0x5644ccb85e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff78a13740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5644cca11ab0 con 0x5644cc7a72f0 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff78a13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5644cca7f730 con 0x5644cc7af4d0 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff78a13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5644ccb88510 con 0x5644cc7d01b0 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff78a13740 10 client.0 _ll_register_callbacks cb 0x5644ccad36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7a72f0 0x5644ccb853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7a72f0 0x5644ccb853b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55812/0 (socket says 172.21.15.49:55812) 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 -- 172.21.15.49:0/61224696 learned_addr learned my addr 172.21.15.49:0/61224696 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6affd640 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 0x5644ccb858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7d01b0 0x5644ccb85e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 -- 172.21.15.49:0/61224696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7d01b0 msgr2=0x5644ccb85e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7d01b0 0x5644ccb85e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 -- 172.21.15.49:0/61224696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 msgr2=0x5644ccb858f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 0x5644ccb858f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 -- 172.21.15.49:0/61224696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644cc83b790 con 0x5644cc7a72f0 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6affd640 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 0x5644ccb858f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff6bfff640 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7a72f0 0x5644ccb853b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7eff64003fc0 tx=0x7eff64005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2e692a0f3eca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff4affd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.313+0000 7eff4affd640 1 -- 172.21.15.49:0/61224696 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64004a40 con 0x5644cc7a72f0 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff4affd640 1 -- 172.21.15.49:0/61224696 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8638+0+0 (secure 0 0 0) 0x7eff64004be0 con 0x5644cc7a72f0 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff78a13740 1 -- 172.21.15.49:0/61224696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff64004050 con 0x5644cc7a72f0 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff4affd640 1 -- 172.21.15.49:0/61224696 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff64036050 con 0x5644cc7a72f0 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff78a13740 10 client.17328 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff78a13740 1 -- 172.21.15.49:0/61224696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5644cc8b4620 con 0x5644cc7a72f0 2024-09-21T06:44:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff4affd640 1 -- 172.21.15.49:0/61224696 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff64004050 con 0x5644cc7a72f0 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff4affd640 1 -- 172.21.15.49:0/61224696 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7eff6400f4e0 con 0x5644cc7a72f0 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff78a13740 10 client.17328 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff78a13740 10 client.17328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff78a13740 20 client.17328 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff78a13740 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5644cc78ed80 0x5644ccb973f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff78a13740 4 client.17328 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.314+0000 7eff78a13740 1 -- 172.21.15.49:0/61224696 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644ccaec640 con 0x5644cc78ed80 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.315+0000 7eff6affd640 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5644cc78ed80 0x5644ccb973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.315+0000 7eff6affd640 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5644cc78ed80 0x5644ccb973f0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59d37eb630fb66fe server_cookie=9f693fcaf013c0bd in_seq=0 out_seq=0 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.315+0000 7eff4affd640 10 client.17328 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff4affd640 1 -- 172.21.15.49:0/61224696 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644ccaec640 con 0x5644cc78ed80 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff4affd640 10 client.17328 handle_command_reply: tid=0 2024-09-21T06:44:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 client.17328 shutdown 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 -- 172.21.15.49:0/61224696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7a72f0 msgr2=0x5644ccb853b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7a72f0 0x5644ccb853b0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7eff64003fc0 tx=0x7eff64005bd0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 -- 172.21.15.49:0/61224696 shutdown_connections 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5644cc78ed80 0x5644ccb973f0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7d01b0 0x5644ccb85e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 0x5644ccb858f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 --2- 172.21.15.49:0/61224696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7a72f0 0x5644ccb853b0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff4affd640 0 client.17328 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 -- 172.21.15.49:0/61224696 >> 172.21.15.49:0/61224696 conn(0x5644cc7c4300 msgr2=0x5644ccb71ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 -- 172.21.15.49:0/61224696 shutdown_connections 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 1 -- 172.21.15.49:0/61224696 wait complete. 2024-09-21T06:44:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.316+0000 7eff78a13740 20 client.17328 trim_cache size 0 max 16384 2024-09-21T06:44:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.331+0000 7eff78a13740 1 Processor -- start 2024-09-21T06:44:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.331+0000 7eff78a13740 1 -- start start 2024-09-21T06:44:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.331+0000 7eff78a13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 0x5644ccb80ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.331+0000 7eff78a13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 0x5644ccb917a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.331+0000 7eff78a13740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccb86fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.331+0000 7eff78a13740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c1b0010 con 0x5644cc7d01b0 2024-09-21T06:44:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.331+0000 7eff78a13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c1ad8e0 con 0x5644cc7af4d0 2024-09-21T06:44:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.331+0000 7eff78a13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c1ab750 con 0x5644cc7a72f0 2024-09-21T06:44:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccb86fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccb86fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55822/0 (socket says 172.21.15.49:55822) 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 -- 172.21.15.49:0/1837649917 learned_addr learned my addr 172.21.15.49:0/1837649917 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6affd640 1 --2- 172.21.15.49:0/1837649917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 0x5644ccb917a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 --2- 172.21.15.49:0/1837649917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 0x5644ccb80ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 -- 172.21.15.49:0/1837649917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 msgr2=0x5644ccb80ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 --2- 172.21.15.49:0/1837649917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 0x5644ccb80ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 -- 172.21.15.49:0/1837649917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 msgr2=0x5644ccb917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 --2- 172.21.15.49:0/1837649917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 0x5644ccb917a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 -- 172.21.15.49:0/1837649917 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644ccb86670 con 0x5644cc7d01b0 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff6bfff640 1 --2- 172.21.15.49:0/1837649917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccb86fe0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7eff64005d70 tx=0x7eff64004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f9614f94e72af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff517fa640 1 -- 172.21.15.49:0/1837649917 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64004000 con 0x5644cc7d01b0 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff517fa640 1 -- 172.21.15.49:0/1837649917 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff6402d070 con 0x5644cc7d01b0 2024-09-21T06:44:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.332+0000 7eff517fa640 1 -- 172.21.15.49:0/1837649917 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64005030 con 0x5644cc7d01b0 2024-09-21T06:44:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 -- 172.21.15.49:0/1837649917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 msgr2=0x5644ccb86fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 --2- 172.21.15.49:0/1837649917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccb86fe0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7eff64005d70 tx=0x7eff64004800 comp rx=0 tx=0).stop 2024-09-21T06:44:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 -- 172.21.15.49:0/1837649917 shutdown_connections 2024-09-21T06:44:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 --2- 172.21.15.49:0/1837649917 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccb86fe0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 --2- 172.21.15.49:0/1837649917 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7af4d0 0x5644ccb917a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 --2- 172.21.15.49:0/1837649917 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7a72f0 0x5644ccb80ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 -- 172.21.15.49:0/1837649917 >> 172.21.15.49:0/1837649917 conn(0x5644cc7c4300 msgr2=0x5644ccb868d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 -- 172.21.15.49:0/1837649917 shutdown_connections 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 -- 172.21.15.49:0/1837649917 wait complete. 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.333+0000 7eff78a13740 1 -- start start 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff78a13740 1 Processor -- start 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff78a13740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7a72f0 0x5644ccb89000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff78a13740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7af4d0 0x5644ccb89540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff78a13740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccbffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff78a13740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c1abda0 con 0x5644cc7d01b0 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff78a13740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c1ad210 con 0x5644cc7a72f0 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff78a13740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c1ac470 con 0x5644cc7af4d0 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff78a13740 10 client.0 _ll_register_callbacks cb 0x7eff5c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccbffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccbffcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55824/0 (socket says 172.21.15.49:55824) 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6bfff640 1 -- 172.21.15.49:0/2755478564 learned_addr learned my addr 172.21.15.49:0/2755478564 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6bfff640 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7a72f0 0x5644ccb89000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6affd640 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7af4d0 0x5644ccb89540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6bfff640 1 -- 172.21.15.49:0/2755478564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7af4d0 msgr2=0x5644ccb89540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6bfff640 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7af4d0 0x5644ccb89540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6bfff640 1 -- 172.21.15.49:0/2755478564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7a72f0 msgr2=0x5644ccb89000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6bfff640 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7a72f0 0x5644ccb89000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.334+0000 7eff6bfff640 1 -- 172.21.15.49:0/2755478564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644ccc00230 con 0x5644cc7d01b0 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff6bfff640 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccbffcc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7eff64009ad0 tx=0x7eff6400f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df59e87691f58cfe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff4affd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff4affd640 1 -- 172.21.15.49:0/2755478564 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6403f040 con 0x5644cc7d01b0 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff4affd640 1 -- 172.21.15.49:0/2755478564 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8638+0+0 (secure 0 0 0) 0x7eff6400faf0 con 0x5644cc7d01b0 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff78a13740 1 -- 172.21.15.49:0/2755478564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff6402d070 con 0x5644cc7d01b0 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff4affd640 1 -- 172.21.15.49:0/2755478564 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7eff6404e050 con 0x5644cc7d01b0 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff78a13740 10 client.17334 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:09.341 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff78a13740 1 -- 172.21.15.49:0/2755478564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5644ccc01480 con 0x5644cc7d01b0 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff4affd640 1 -- 172.21.15.49:0/2755478564 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff6402d070 con 0x5644cc7d01b0 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff4affd640 1 -- 172.21.15.49:0/2755478564 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7eff64005250 con 0x5644cc7d01b0 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff78a13740 10 client.17334 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff78a13740 10 client.17334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff78a13740 20 client.17334 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff78a13740 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5644cc7641c0 0x5644ccc03ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff78a13740 4 client.17334 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.335+0000 7eff78a13740 1 -- 172.21.15.49:0/2755478564 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5644ccae80f0 con 0x5644cc7641c0 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.336+0000 7eff6affd640 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5644cc7641c0 0x5644ccc03ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.336+0000 7eff4affd640 10 client.17334 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:09.342 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.336+0000 7eff6affd640 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5644cc7641c0 0x5644ccc03ae0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=583fb94b1e3e51cc server_cookie=158359176e8f1f03 in_seq=0 out_seq=0 2024-09-21T06:44:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff4affd640 1 -- 172.21.15.49:0/2755478564 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5644ccae80f0 con 0x5644cc7641c0 2024-09-21T06:44:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff4affd640 10 client.17334 handle_command_reply: tid=0 2024-09-21T06:44:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 client.17334 shutdown 2024-09-21T06:44:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 -- 172.21.15.49:0/2755478564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 msgr2=0x5644ccbffcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccbffcc0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7eff64009ad0 tx=0x7eff6400f680 comp rx=0 tx=0).stop 2024-09-21T06:44:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 -- 172.21.15.49:0/2755478564 shutdown_connections 2024-09-21T06:44:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5644cc7641c0 0x5644ccc03ae0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5644cc7d01b0 0x5644ccbffcc0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff4affd640 0 client.17334 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5644cc7af4d0 0x5644ccb89540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 --2- 172.21.15.49:0/2755478564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5644cc7a72f0 0x5644ccb89000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 -- 172.21.15.49:0/2755478564 >> 172.21.15.49:0/2755478564 conn(0x5644cc7c4300 msgr2=0x5644ccb77300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 -- 172.21.15.49:0/2755478564 shutdown_connections 2024-09-21T06:44:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 1 -- 172.21.15.49:0/2755478564 wait complete. 2024-09-21T06:44:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.344+0000 7eff78a13740 20 client.17334 trim_cache size 0 max 16384 2024-09-21T06:44:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:44:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:44:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:44:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:44:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 -- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7eff540b6680 msgr2=0x7eff540b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7eff540b6680 0x7eff540b8b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0e52f0 tx=0x7eff5c004a90 comp rx=0 tx=0).stop 2024-09-21T06:44:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 -- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1029c0 msgr2=0x7eff6c19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1029c0 0x7eff6c19a450 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7eff5c00e9f0 tx=0x7eff5c00edf0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 -- 172.21.15.49:0/2296092346 shutdown_connections 2024-09-21T06:44:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7eff540b6680 0x7eff540b8b90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7eff6c108c40 0x7eff6c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7eff6c1082f0 0x7eff6c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 --2- 172.21.15.49:0/2296092346 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7eff6c1029c0 0x7eff6c19a450 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 -- 172.21.15.49:0/2296092346 >> 172.21.15.49:0/2296092346 conn(0x7eff6c0fe3c0 msgr2=0x7eff6c06b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 -- 172.21.15.49:0/2296092346 shutdown_connections 2024-09-21T06:44:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:09.345+0000 7eff71a9b640 1 -- 172.21.15.49:0/2296092346 wait complete. 2024-09-21T06:44:10.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:09 smithi049 ceph-mon[31177]: pgmap v546: 97 pgs: 97 active+clean; 7.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 KiB/s wr, 31 op/s 2024-09-21T06:44:10.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:09 smithi049 ceph-mon[31177]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:44:10.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:09 smithi098 ceph-mon[34704]: pgmap v546: 97 pgs: 97 active+clean; 7.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 KiB/s wr, 31 op/s 2024-09-21T06:44:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:09 smithi098 ceph-mon[34704]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:44:10.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:09 smithi079 ceph-mon[34346]: pgmap v546: 97 pgs: 97 active+clean; 7.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 KiB/s wr, 31 op/s 2024-09-21T06:44:10.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:09 smithi079 ceph-mon[34346]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:44:12.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:11 smithi049 ceph-mon[31177]: pgmap v548: 97 pgs: 97 active+clean; 7.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 32 op/s 2024-09-21T06:44:12.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:11 smithi098 ceph-mon[34704]: pgmap v548: 97 pgs: 97 active+clean; 7.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 32 op/s 2024-09-21T06:44:12.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:11 smithi079 ceph-mon[34346]: pgmap v548: 97 pgs: 97 active+clean; 7.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 32 op/s 2024-09-21T06:44:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:13 smithi049 ceph-mon[31177]: pgmap v549: 97 pgs: 97 active+clean; 7.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 33 op/s 2024-09-21T06:44:14.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:13 smithi098 ceph-mon[34704]: pgmap v549: 97 pgs: 97 active+clean; 7.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 33 op/s 2024-09-21T06:44:14.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:13 smithi079 ceph-mon[34346]: pgmap v549: 97 pgs: 97 active+clean; 7.4 MiB data, 402 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 78 KiB/s wr, 33 op/s 2024-09-21T06:44:16.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:15 smithi049 ceph-mon[31177]: pgmap v550: 97 pgs: 97 active+clean; 7.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-21T06:44:16.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:15 smithi098 ceph-mon[34704]: pgmap v550: 97 pgs: 97 active+clean; 7.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-21T06:44:16.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:15 smithi079 ceph-mon[34346]: pgmap v550: 97 pgs: 97 active+clean; 7.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 13 op/s 2024-09-21T06:44:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:17 smithi049 ceph-mon[31177]: pgmap v551: 97 pgs: 97 active+clean; 7.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-21T06:44:18.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:17 smithi098 ceph-mon[34704]: pgmap v551: 97 pgs: 97 active+clean; 7.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-21T06:44:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:17 smithi079 ceph-mon[34346]: pgmap v551: 97 pgs: 97 active+clean; 7.5 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-21T06:44:18.999 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:44:19.272 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:19.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.857+0000 7f5e4442f640 1 -- 172.21.15.49:0/3336844260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c104840 msgr2=0x7f5e3c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.857+0000 7f5e4442f640 1 --2- 172.21.15.49:0/3336844260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c104840 0x7f5e3c104c50 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009900 tx=0x7f5e3402a410 comp rx=0 tx=0).stop 2024-09-21T06:44:19.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.857+0000 7f5e4442f640 1 -- 172.21.15.49:0/3336844260 shutdown_connections 2024-09-21T06:44:19.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.857+0000 7f5e4442f640 1 --2- 172.21.15.49:0/3336844260 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e3c10ddf0 0x7f5e3c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.861 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.857+0000 7f5e4442f640 1 --2- 172.21.15.49:0/3336844260 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e3c105270 0x7f5e3c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.857+0000 7f5e4442f640 1 --2- 172.21.15.49:0/3336844260 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c104840 0x7f5e3c104c50 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.857+0000 7f5e4442f640 1 -- 172.21.15.49:0/3336844260 >> 172.21.15.49:0/3336844260 conn(0x7f5e3c079730 msgr2=0x7f5e3c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.857+0000 7f5e4442f640 1 -- 172.21.15.49:0/3336844260 shutdown_connections 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.857+0000 7f5e4442f640 1 -- 172.21.15.49:0/3336844260 wait complete. 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.858+0000 7f5e4442f640 1 Processor -- start 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.858+0000 7f5e4442f640 1 -- start start 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.858+0000 7f5e4442f640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e3c104840 0x7f5e3c19a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.858+0000 7f5e4442f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c105270 0x7f5e3c19ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.858+0000 7f5e4442f640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e3c10ddf0 0x7f5e3c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.858+0000 7f5e4442f640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c113a70 con 0x7f5e3c105270 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.858+0000 7f5e4442f640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c1138f0 con 0x7f5e3c10ddf0 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.858+0000 7f5e4442f640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c113bf0 con 0x7f5e3c104840 2024-09-21T06:44:19.862 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.858+0000 7f5e419ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c105270 0x7f5e3c19ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e419ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c105270 0x7f5e3c19ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52938/0 (socket says 172.21.15.49:52938) 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e421cb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e3c104840 0x7f5e3c19a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e419ca640 1 -- 172.21.15.49:0/1890405560 learned_addr learned my addr 172.21.15.49:0/1890405560 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e429cc640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e3c10ddf0 0x7f5e3c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e419ca640 1 -- 172.21.15.49:0/1890405560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e3c104840 msgr2=0x7f5e3c19a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e419ca640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e3c104840 0x7f5e3c19a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e419ca640 1 -- 172.21.15.49:0/1890405560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e3c10ddf0 msgr2=0x7f5e3c19fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e419ca640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e3c10ddf0 0x7f5e3c19fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e419ca640 1 -- 172.21.15.49:0/1890405560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3c1a0410 con 0x7f5e3c105270 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e419ca640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c105270 0x7f5e3c19ab00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c8c0 tx=0x7f5e3000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e3b7fe640 1 -- 172.21.15.49:0/1890405560 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e30007bb0 con 0x7f5e3c105270 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e4442f640 1 -- 172.21.15.49:0/1890405560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3c1a0700 con 0x7f5e3c105270 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e3b7fe640 1 -- 172.21.15.49:0/1890405560 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e30007d50 con 0x7f5e3c105270 2024-09-21T06:44:19.863 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.859+0000 7f5e3b7fe640 1 -- 172.21.15.49:0/1890405560 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e300187c0 con 0x7f5e3c105270 2024-09-21T06:44:19.864 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.860+0000 7f5e4442f640 1 -- 172.21.15.49:0/1890405560 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3c1a6f20 con 0x7f5e3c105270 2024-09-21T06:44:19.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.862+0000 7f5e4a9a3740 1 Processor -- start 2024-09-21T06:44:19.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.862+0000 7f5e4a9a3740 1 -- start start 2024-09-21T06:44:19.865 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.862+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b8d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.862+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 0x563718b8db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.862+0000 7f5e3b7fe640 1 -- 172.21.15.49:0/1890405560 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5e3000fa20 con 0x7f5e3c105270 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.862+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187c5390 0x563718b8e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.862+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563718b03e50 con 0x5637187e6070 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.862+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563718af3280 con 0x5637187bd1b0 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.862+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563718af7090 con 0x5637187c5390 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e429cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b8d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e429cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b8d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52944/0 (socket says 172.21.15.49:52944) 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e429cc640 1 -- 172.21.15.49:0/132347816 learned_addr learned my addr 172.21.15.49:0/132347816 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e419ca640 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187c5390 0x563718b8e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e421cb640 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 0x563718b8db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e429cc640 1 -- 172.21.15.49:0/132347816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187c5390 msgr2=0x563718b8e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e429cc640 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187c5390 0x563718b8e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e429cc640 1 -- 172.21.15.49:0/132347816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 msgr2=0x563718b8db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e429cc640 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 0x563718b8db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e429cc640 1 -- 172.21.15.49:0/132347816 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563718851650 con 0x5637187e6070 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e419ca640 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187c5390 0x563718b8e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e421cb640 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 0x563718b8db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e429cc640 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b8d650 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009f70 tx=0x7f5e2c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f997a878c1107022 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.863+0000 7f5e3b7fe640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b66b0 0x7f5e240b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.864+0000 7f5e38d9a640 1 -- 172.21.15.49:0/132347816 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c016070 con 0x5637187e6070 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.864+0000 7f5e421cb640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b66b0 0x7f5e240b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.864+0000 7f5e3b7fe640 1 -- 172.21.15.49:0/1890405560 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f5e300e7770 con 0x7f5e3c105270 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.864+0000 7f5e38d9a640 1 -- 172.21.15.49:0/132347816 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e2c004d20 con 0x5637187e6070 2024-09-21T06:44:19.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.864+0000 7f5e38d9a640 1 -- 172.21.15.49:0/132347816 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c012790 con 0x5637187e6070 2024-09-21T06:44:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e421cb640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b66b0 0x7f5e240b8bc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e34000c00 tx=0x7f5e34031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/132347816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 msgr2=0x563718b8d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b8d650 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009f70 tx=0x7f5e2c010800 comp rx=0 tx=0).stop 2024-09-21T06:44:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/132347816 shutdown_connections 2024-09-21T06:44:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187c5390 0x563718b8e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.871 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 0x563718b8db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/132347816 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b8d650 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/132347816 >> 172.21.15.49:0/132347816 conn(0x5637187da460 msgr2=0x563718b8b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/132347816 shutdown_connections 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/132347816 wait complete. 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 -- start start 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.865+0000 7f5e4a9a3740 1 Processor -- start 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 0x563718b98dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b99310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187e6070 0x563718ba5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563718954700 con 0x5637187c5390 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563718a8e110 con 0x5637187bd1b0 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563718b9be30 con 0x5637187e6070 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e4a9a3740 10 client.0 _ll_register_callbacks cb 0x563718aa7990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e419ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b99310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e419ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b99310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52958/0 (socket says 172.21.15.49:52958) 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e419ca640 1 -- 172.21.15.49:0/751707483 learned_addr learned my addr 172.21.15.49:0/751707483 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:19.872 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e429cc640 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187e6070 0x563718ba5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e421cb640 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 0x563718b98dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e419ca640 1 -- 172.21.15.49:0/751707483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187e6070 msgr2=0x563718ba5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e419ca640 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187e6070 0x563718ba5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e419ca640 1 -- 172.21.15.49:0/751707483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 msgr2=0x563718b98dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e419ca640 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 0x563718b98dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e419ca640 1 -- 172.21.15.49:0/751707483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563718abbc40 con 0x5637187c5390 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e419ca640 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b99310 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f5e300e4ed0 tx=0x7f5e300b6e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e17d19a4326c1cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.866+0000 7f5e21ffb640 1 -- 172.21.15.49:0/751707483 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e300acec0 con 0x5637187c5390 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e21ffb640 1 -- 172.21.15.49:0/751707483 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f5e300ac240 con 0x5637187c5390 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/751707483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e2c004d20 con 0x5637187c5390 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e21ffb640 1 -- 172.21.15.49:0/751707483 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e300acce0 con 0x5637187c5390 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e4a9a3740 10 client.17346 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/751707483 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563718ba7bf0 con 0x5637187c5390 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e21ffb640 1 -- 172.21.15.49:0/751707483 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e2c004d20 con 0x5637187c5390 2024-09-21T06:44:19.873 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e21ffb640 1 -- 172.21.15.49:0/751707483 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5e300ac440 con 0x5637187c5390 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e4a9a3740 10 client.17346 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e4a9a3740 10 client.17346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e4a9a3740 20 client.17346 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5637187a49f0 0x563718baaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e4a9a3740 4 client.17346 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.867+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/751707483 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563718b05da0 con 0x5637187a49f0 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.868+0000 7f5e421cb640 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5637187a49f0 0x563718baaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.868+0000 7f5e21ffb640 10 client.17346 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.868+0000 7f5e421cb640 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5637187a49f0 0x563718baaf50 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d2de0f82963f9fb server_cookie=ca71889e1dbdb7d1 in_seq=0 out_seq=0 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e21ffb640 1 -- 172.21.15.49:0/751707483 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563718b05da0 con 0x5637187a49f0 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e21ffb640 10 client.17346 handle_command_reply: tid=0 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 client.17346 shutdown 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/751707483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 msgr2=0x563718b99310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b99310 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f5e300e4ed0 tx=0x7f5e300b6e00 comp rx=0 tx=0).stop 2024-09-21T06:44:19.874 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/751707483 shutdown_connections 2024-09-21T06:44:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5637187a49f0 0x563718baaf50 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187e6070 0x563718ba5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b99310 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/751707483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187bd1b0 0x563718b98dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/751707483 >> 172.21.15.49:0/751707483 conn(0x5637187da460 msgr2=0x563718b90830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e21ffb640 0 client.17346 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/751707483 shutdown_connections 2024-09-21T06:44:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/751707483 wait complete. 2024-09-21T06:44:19.875 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.869+0000 7f5e4a9a3740 20 client.17346 trim_cache size 0 max 16384 2024-09-21T06:44:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e4a9a3740 1 Processor -- start 2024-09-21T06:44:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e4a9a3740 1 -- start start 2024-09-21T06:44:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b8b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187c5390 0x563718ba5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b90750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c1b4410 con 0x5637187e6070 2024-09-21T06:44:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c1b1ce0 con 0x5637187c5390 2024-09-21T06:44:19.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c1afb50 con 0x5637187bd1b0 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e429cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b90750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e429cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b90750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52970/0 (socket says 172.21.15.49:52970) 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e429cc640 1 -- 172.21.15.49:0/3279632563 learned_addr learned my addr 172.21.15.49:0/3279632563 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e421cb640 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b8b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.887+0000 7f5e419ca640 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187c5390 0x563718ba5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e429cc640 1 -- 172.21.15.49:0/3279632563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 msgr2=0x563718b8b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e429cc640 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b8b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e429cc640 1 -- 172.21.15.49:0/3279632563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187c5390 msgr2=0x563718ba5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e429cc640 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187c5390 0x563718ba5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e429cc640 1 -- 172.21.15.49:0/3279632563 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563718b8f940 con 0x5637187e6070 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e421cb640 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b8b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:19.890 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e429cc640 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b90750 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c019000 tx=0x7f5e2c009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2e453810cd0201 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e23fff640 1 -- 172.21.15.49:0/3279632563 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c016030 con 0x5637187e6070 2024-09-21T06:44:19.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e23fff640 1 -- 172.21.15.49:0/3279632563 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e2c02a070 con 0x5637187e6070 2024-09-21T06:44:19.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.888+0000 7f5e23fff640 1 -- 172.21.15.49:0/3279632563 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c025ab0 con 0x5637187e6070 2024-09-21T06:44:19.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/3279632563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 msgr2=0x563718b90750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b90750 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c019000 tx=0x7f5e2c009f00 comp rx=0 tx=0).stop 2024-09-21T06:44:19.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/3279632563 shutdown_connections 2024-09-21T06:44:19.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187e6070 0x563718b90750 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187c5390 0x563718ba5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.893 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/3279632563 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b8b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/3279632563 >> 172.21.15.49:0/3279632563 conn(0x5637187da460 msgr2=0x563718b8ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/3279632563 shutdown_connections 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/3279632563 wait complete. 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 -- start start 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.889+0000 7f5e4a9a3740 1 Processor -- start 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b9d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b9d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e4a9a3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187e6070 0x563718b9dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c1b01a0 con 0x5637187c5390 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c1b1610 con 0x5637187e6070 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e4a9a3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5e3c1b0870 con 0x5637187bd1b0 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e4a9a3740 10 client.0 _ll_register_callbacks cb 0x7f5e30007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e419ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b9d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e419ca640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b9d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52978/0 (socket says 172.21.15.49:52978) 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e419ca640 1 -- 172.21.15.49:0/2686432371 learned_addr learned my addr 172.21.15.49:0/2686432371 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e429cc640 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187e6070 0x563718b9dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e421cb640 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b9d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e419ca640 1 -- 172.21.15.49:0/2686432371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 msgr2=0x563718b9d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e419ca640 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b9d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e419ca640 1 -- 172.21.15.49:0/2686432371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187e6070 msgr2=0x563718b9dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e419ca640 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187e6070 0x563718b9dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e419ca640 1 -- 172.21.15.49:0/2686432371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563718c14930 con 0x5637187c5390 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e421cb640 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b9d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e419ca640 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b9d680 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000c00 tx=0x7f5e300acc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde9b3dc9c9b36f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e21ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.890+0000 7f5e21ffb640 1 -- 172.21.15.49:0/2686432371 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e300acec0 con 0x5637187c5390 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e21ffb640 1 -- 172.21.15.49:0/2686432371 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f5e300ac440 con 0x5637187c5390 2024-09-21T06:44:19.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/2686432371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e2c02a070 con 0x5637187c5390 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e21ffb640 1 -- 172.21.15.49:0/2686432371 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5e300ad080 con 0x5637187c5390 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e4a9a3740 10 client.17352 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/2686432371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563718c15ba0 con 0x5637187c5390 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e21ffb640 1 -- 172.21.15.49:0/2686432371 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e2c02a070 con 0x5637187c5390 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e21ffb640 1 -- 172.21.15.49:0/2686432371 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5e300b6560 con 0x5637187c5390 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e4a9a3740 10 client.17352 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e4a9a3740 10 client.17352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e4a9a3740 20 client.17352 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563718779da0 0x563718c180e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e4a9a3740 4 client.17352 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.891+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/2686432371 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563718b86990 con 0x563718779da0 2024-09-21T06:44:19.896 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e421cb640 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563718779da0 0x563718c180e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e21ffb640 10 client.17352 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:19.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e421cb640 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563718779da0 0x563718c180e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=410f621f2da9834b server_cookie=4786fc554025bf89 in_seq=0 out_seq=0 2024-09-21T06:44:19.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e21ffb640 1 -- 172.21.15.49:0/2686432371 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x563718b86990 con 0x563718779da0 2024-09-21T06:44:19.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e21ffb640 10 client.17352 handle_command_reply: tid=0 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e4a9a3740 1 client.17352 shutdown 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/2686432371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 msgr2=0x563718b9d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b9d680 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f5e30000c00 tx=0x7f5e300acc20 comp rx=0 tx=0).stop 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/2686432371 shutdown_connections 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563718779da0 0x563718c180e0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5637187e6070 0x563718b9dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.892+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5637187c5390 0x563718b9d680 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4a9a3740 1 --2- 172.21.15.49:0/2686432371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5637187bd1b0 0x563718b9d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/2686432371 >> 172.21.15.49:0/2686432371 conn(0x5637187da460 msgr2=0x563718b90750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e21ffb640 0 client.17352 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/2686432371 shutdown_connections 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4a9a3740 1 -- 172.21.15.49:0/2686432371 wait complete. 2024-09-21T06:44:19.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4a9a3740 20 client.17352 trim_cache size 0 max 16384 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.899 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.900 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.901 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:44:19.902 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.903 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:19.905 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:44:19.906 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:44:19.906 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:44:19.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 -- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b66b0 msgr2=0x7f5e240b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b66b0 0x7f5e240b8bc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e34000c00 tx=0x7f5e34031400 comp rx=0 tx=0).stop 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 -- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c105270 msgr2=0x7f5e3c19ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c105270 0x7f5e3c19ab00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000c8c0 tx=0x7f5e3000cd80 comp rx=0 tx=0).stop 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 -- 172.21.15.49:0/1890405560 shutdown_connections 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b66b0 0x7f5e240b8bc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e3c10ddf0 0x7f5e3c19fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e3c105270 0x7f5e3c19ab00 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 --2- 172.21.15.49:0/1890405560 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e3c104840 0x7f5e3c19a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 -- 172.21.15.49:0/1890405560 >> 172.21.15.49:0/1890405560 conn(0x7f5e3c079730 msgr2=0x7f5e3c100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 -- 172.21.15.49:0/1890405560 shutdown_connections 2024-09-21T06:44:19.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:19.893+0000 7f5e4442f640 1 -- 172.21.15.49:0/1890405560 wait complete. 2024-09-21T06:44:19.907 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:19 smithi049 ceph-mon[31177]: pgmap v552: 97 pgs: 97 active+clean; 7.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:44:19.907 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:19 smithi049 ceph-mon[31177]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:44:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:19 smithi098 ceph-mon[34704]: pgmap v552: 97 pgs: 97 active+clean; 7.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:44:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:19 smithi098 ceph-mon[34704]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:44:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:19 smithi079 ceph-mon[34346]: pgmap v552: 97 pgs: 97 active+clean; 7.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:44:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:19 smithi079 ceph-mon[34346]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:44:20.777 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:44:20.778 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:44:21.040 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:21.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.507+0000 7f18c66bd640 1 -- 172.21.15.49:0/2225452026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18c0102a70 msgr2=0x7f18c0102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:21.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.507+0000 7f18c66bd640 1 --2- 172.21.15.49:0/2225452026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18c0102a70 0x7f18c0102e80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009900 tx=0x7f18b002a410 comp rx=0 tx=0).stop 2024-09-21T06:44:21.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.507+0000 7f18c66bd640 1 -- 172.21.15.49:0/2225452026 shutdown_connections 2024-09-21T06:44:21.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.507+0000 7f18c66bd640 1 --2- 172.21.15.49:0/2225452026 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18c0108d00 0x7f18c006bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.507+0000 7f18c66bd640 1 --2- 172.21.15.49:0/2225452026 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18c01083b0 0x7f18c01087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.507+0000 7f18c66bd640 1 --2- 172.21.15.49:0/2225452026 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18c0102a70 0x7f18c0102e80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.507+0000 7f18c66bd640 1 -- 172.21.15.49:0/2225452026 >> 172.21.15.49:0/2225452026 conn(0x7f18c0079710 msgr2=0x7f18c0079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:21.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.507+0000 7f18c66bd640 1 -- 172.21.15.49:0/2225452026 shutdown_connections 2024-09-21T06:44:21.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.507+0000 7f18c66bd640 1 -- 172.21.15.49:0/2225452026 wait complete. 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.508+0000 7f18c66bd640 1 Processor -- start 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.508+0000 7f18c66bd640 1 -- start start 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.508+0000 7f18c66bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18c0102a70 0x7f18c019c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18c66bd640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18c01083b0 0x7f18c019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18c66bd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18c0108d00 0x7f18c01a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18c66bd640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0115cd0 con 0x7f18c0102a70 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18c66bd640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0115b50 con 0x7f18c0108d00 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18c66bd640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f18c0115e50 con 0x7f18c01083b0 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18c0102a70 0x7f18c019c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18c0102a70 0x7f18c019c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:52998/0 (socket says 172.21.15.49:52998) 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bffff640 1 -- 172.21.15.49:0/1816947711 learned_addr learned my addr 172.21.15.49:0/1816947711 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18c4c5a640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18c0108d00 0x7f18c01a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:21.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bf7fe640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18c01083b0 0x7f18c019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bffff640 1 -- 172.21.15.49:0/1816947711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18c01083b0 msgr2=0x7f18c019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bffff640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18c01083b0 0x7f18c019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bffff640 1 -- 172.21.15.49:0/1816947711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18c0108d00 msgr2=0x7f18c01a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bffff640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18c0108d00 0x7f18c01a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bffff640 1 -- 172.21.15.49:0/1816947711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c01a25c0 con 0x7f18c0102a70 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.509+0000 7f18bffff640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18c0102a70 0x7f18c019c710 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005940 tx=0x7f18b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.510+0000 7f18bd7fa640 1 -- 172.21.15.49:0/1816947711 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b003f030 con 0x7f18c0102a70 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.510+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c01a2850 con 0x7f18c0102a70 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.510+0000 7f18bd7fa640 1 -- 172.21.15.49:0/1816947711 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18b0003aa0 con 0x7f18c0102a70 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.510+0000 7f18bd7fa640 1 -- 172.21.15.49:0/1816947711 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b0035070 con 0x7f18c0102a70 2024-09-21T06:44:21.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.510+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c01a2d80 con 0x7f18c0102a70 2024-09-21T06:44:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.511+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c0103cf0 con 0x7f18c0102a70 2024-09-21T06:44:21.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.513+0000 7f18bd7fa640 1 -- 172.21.15.49:0/1816947711 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f18b0042030 con 0x7f18c0102a70 2024-09-21T06:44:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.513+0000 7f18bd7fa640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18a80b66b0 0x7f18a80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.513+0000 7f18bf7fe640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18a80b66b0 0x7f18a80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.513+0000 7f18bd7fa640 1 -- 172.21.15.49:0/1816947711 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f18b0108050 con 0x7f18c0102a70 2024-09-21T06:44:21.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.514+0000 7f18bf7fe640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18a80b66b0 0x7f18a80b8bc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f18c0079e60 tx=0x7f18b400a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:21.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.516+0000 7f18bd7fa640 1 -- 172.21.15.49:0/1816947711 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18c01a2d80 con 0x7f18c0102a70 2024-09-21T06:44:21.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:21 smithi049 ceph-mon[31177]: pgmap v554: 97 pgs: 97 active+clean; 7.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:44:21.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.746+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18c019d840 con 0x7f18c0102a70 2024-09-21T06:44:21.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.746+0000 7f18bd7fa640 1 -- 172.21.15.49:0/1816947711 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f18c019d840 con 0x7f18c0102a70 2024-09-21T06:44:21.748 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:44:21.748 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:44:21.749 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:44:21.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18a80b66b0 msgr2=0x7f18a80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:21.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18a80b66b0 0x7f18a80b8bc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f18c0079e60 tx=0x7f18b400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18c0102a70 msgr2=0x7f18c019c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18c0102a70 0x7f18c019c710 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f18b0005940 tx=0x7f18b0004270 comp rx=0 tx=0).stop 2024-09-21T06:44:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 shutdown_connections 2024-09-21T06:44:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f18a80b66b0 0x7f18a80b8bc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f18c0108d00 0x7f18c01a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f18c01083b0 0x7f18c019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 --2- 172.21.15.49:0/1816947711 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f18c0102a70 0x7f18c019c710 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 >> 172.21.15.49:0/1816947711 conn(0x7f18c0079710 msgr2=0x7f18c010a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 shutdown_connections 2024-09-21T06:44:21.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:21.749+0000 7f18c66bd640 1 -- 172.21.15.49:0/1816947711 wait complete. 2024-09-21T06:44:22.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:21 smithi098 ceph-mon[34704]: pgmap v554: 97 pgs: 97 active+clean; 7.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:44:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:21 smithi079 ceph-mon[34346]: pgmap v554: 97 pgs: 97 active+clean; 7.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:44:22.430 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:44:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.448+0000 7f67eb1c3640 1 -- 172.21.15.49:0/88640847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105a70 msgr2=0x7f67e410f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.448+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/88640847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105a70 0x7f67e410f4c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009cd0 tx=0x7f67dc02a8e0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.448+0000 7f67eb1c3640 1 -- 172.21.15.49:0/88640847 shutdown_connections 2024-09-21T06:44:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.448+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/88640847 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105a70 0x7f67e410f4c0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.448+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/88640847 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67e4105120 0x7f67e4105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.448+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/88640847 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67e4103160 0x7f67e4103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.448+0000 7f67eb1c3640 1 -- 172.21.15.49:0/88640847 >> 172.21.15.49:0/88640847 conn(0x7f67e4079ce0 msgr2=0x7f67e407a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.449+0000 7f67eb1c3640 1 -- 172.21.15.49:0/88640847 shutdown_connections 2024-09-21T06:44:22.451 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.449+0000 7f67eb1c3640 1 -- 172.21.15.49:0/88640847 wait complete. 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.449+0000 7f67eb1c3640 1 Processor -- start 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.449+0000 7f67eb1c3640 1 -- start start 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67eb1c3640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67e4103160 0x7f67e4199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67eb1c3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105120 0x7f67e4199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67eb1c3640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67e4105a70 0x7f67e419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67eb1c3640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4112990 con 0x7f67e4105120 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67eb1c3640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4112810 con 0x7f67e4105a70 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67eb1c3640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f67e4112b10 con 0x7f67e4103160 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105120 0x7f67e4199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105120 0x7f67e4199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53020/0 (socket says 172.21.15.49:53020) 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e3fff640 1 -- 172.21.15.49:0/2675474720 learned_addr learned my addr 172.21.15.49:0/2675474720 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67e4103160 0x7f67e4199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e9760640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67e4105a70 0x7f67e419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e3fff640 1 -- 172.21.15.49:0/2675474720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67e4103160 msgr2=0x7f67e4199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e3fff640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67e4103160 0x7f67e4199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e3fff640 1 -- 172.21.15.49:0/2675474720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67e4105a70 msgr2=0x7f67e419eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e3fff640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67e4105a70 0x7f67e419eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e3fff640 1 -- 172.21.15.49:0/2675474720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e419f2a0 con 0x7f67e4105120 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e3fff640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105120 0x7f67e4199910 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f67d000b450 tx=0x7f67d000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.450+0000 7f67e1ffb640 1 -- 172.21.15.49:0/2675474720 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d0015020 con 0x7f67e4105120 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.451+0000 7f67e1ffb640 1 -- 172.21.15.49:0/2675474720 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67d0011d40 con 0x7f67e4105120 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.451+0000 7f67eb1c3640 1 -- 172.21.15.49:0/2675474720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e419f590 con 0x7f67e4105120 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.451+0000 7f67e1ffb640 1 -- 172.21.15.49:0/2675474720 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d000f340 con 0x7f67e4105120 2024-09-21T06:44:22.454 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.451+0000 7f67eb1c3640 1 -- 172.21.15.49:0/2675474720 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e41a5d20 con 0x7f67e4105120 2024-09-21T06:44:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67f220c740 1 Processor -- start 2024-09-21T06:44:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67f220c740 1 -- start start 2024-09-21T06:44:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67f220c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 0x55cd387e19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67f220c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd384132f0 0x55cd387e1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67f220c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd387e2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67f220c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cd387566f0 con 0x55cd3841b4d0 2024-09-21T06:44:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67f220c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cd38745b20 con 0x55cd384132f0 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67f220c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55cd38749930 con 0x55cd3843c1b0 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67e1ffb640 1 -- 172.21.15.49:0/2675474720 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f67d0018020 con 0x7f67e4105120 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd387e2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67e9760640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 0x55cd387e19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd387e2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53022/0 (socket says 172.21.15.49:53022) 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67e3fff640 1 -- 172.21.15.49:0/1716866265 learned_addr learned my addr 172.21.15.49:0/1716866265 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.454+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/1716866265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd384132f0 0x55cd387e1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e9760640 1 -- 172.21.15.49:0/1716866265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd384132f0 msgr2=0x55cd387e1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e9760640 1 --2- 172.21.15.49:0/1716866265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd384132f0 0x55cd387e1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e9760640 1 -- 172.21.15.49:0/1716866265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 msgr2=0x55cd387e2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e9760640 1 --2- 172.21.15.49:0/1716866265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd387e2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e9760640 1 -- 172.21.15.49:0/1716866265 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd3870b530 con 0x55cd3843c1b0 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e3fff640 1 --2- 172.21.15.49:0/1716866265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd387e2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e9760640 1 --2- 172.21.15.49:0/1716866265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 0x55cd387e19b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009ca0 tx=0x7f67dc0314e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e412f877a2a640 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e1ffb640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f67d40b6680 0x7f67d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67ceffd640 1 -- 172.21.15.49:0/1716866265 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc049070 con 0x55cd3843c1b0 2024-09-21T06:44:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67ceffd640 1 -- 172.21.15.49:0/1716866265 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67dc036040 con 0x55cd3843c1b0 2024-09-21T06:44:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67ceffd640 1 -- 172.21.15.49:0/1716866265 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc004260 con 0x55cd3843c1b0 2024-09-21T06:44:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f67d40b6680 0x7f67d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.455+0000 7f67e1ffb640 1 -- 172.21.15.49:0/2675474720 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f67d00e7100 con 0x7f67e4105120 2024-09-21T06:44:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67f220c740 1 -- 172.21.15.49:0/1716866265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 msgr2=0x55cd387e19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67f220c740 1 --2- 172.21.15.49:0/1716866265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 0x55cd387e19b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009ca0 tx=0x7f67dc0314e0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f67d40b6680 0x7f67d40b8b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55cd387e08c0 tx=0x7f67d800b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67f220c740 1 -- 172.21.15.49:0/1716866265 shutdown_connections 2024-09-21T06:44:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67f220c740 1 --2- 172.21.15.49:0/1716866265 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd387e2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67f220c740 1 --2- 172.21.15.49:0/1716866265 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd384132f0 0x55cd387e1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67f220c740 1 --2- 172.21.15.49:0/1716866265 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 0x55cd387e19b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67f220c740 1 -- 172.21.15.49:0/1716866265 >> 172.21.15.49:0/1716866265 conn(0x55cd38430300 msgr2=0x55cd387df8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67f220c740 1 -- 172.21.15.49:0/1716866265 shutdown_connections 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.456+0000 7f67f220c740 1 -- 172.21.15.49:0/1716866265 wait complete. 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.457+0000 7f67f220c740 1 -- start start 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.457+0000 7f67f220c740 1 Processor -- start 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.457+0000 7f67f220c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 0x55cd387ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.457+0000 7f67f220c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 0x55cd387ef720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.457+0000 7f67f220c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3843c1b0 0x55cd387efca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.457+0000 7f67f220c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55cd3867dab0 con 0x55cd3843c1b0 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.457+0000 7f67f220c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55cd386eb730 con 0x55cd3841b4d0 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67f220c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55cd387f22b0 con 0x55cd384132f0 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67f220c740 10 client.0 _ll_register_callbacks cb 0x55cd3873f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e9760640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3843c1b0 0x55cd387efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e9760640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3843c1b0 0x55cd387efca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53026/0 (socket says 172.21.15.49:53026) 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e9760640 1 -- 172.21.15.49:0/2285550389 learned_addr learned my addr 172.21.15.49:0/2285550389 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 0x55cd387ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e3fff640 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 0x55cd387ef720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e9760640 1 -- 172.21.15.49:0/2285550389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 msgr2=0x55cd387ef1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e9760640 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 0x55cd387ef1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e9760640 1 -- 172.21.15.49:0/2285550389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 msgr2=0x55cd387ef720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e9760640 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 0x55cd387ef720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e9760640 1 -- 172.21.15.49:0/2285550389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd384a7790 con 0x55cd3843c1b0 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 0x55cd387ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67e9760640 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3843c1b0 0x55cd387efca0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009bf0 tx=0x7f67dc031b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5b5f7cc048a8f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.458+0000 7f67c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67c3fff640 1 -- 172.21.15.49:0/2285550389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc049070 con 0x55cd3843c1b0 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67c3fff640 1 -- 172.21.15.49:0/2285550389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f67dc004190 con 0x55cd3843c1b0 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67f220c740 1 -- 172.21.15.49:0/2285550389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67dc036040 con 0x55cd3843c1b0 2024-09-21T06:44:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67c3fff640 1 -- 172.21.15.49:0/2285550389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f67dc009800 con 0x55cd3843c1b0 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67f220c740 10 client.17370 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67f220c740 1 -- 172.21.15.49:0/2285550389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd38520620 con 0x55cd3843c1b0 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67c3fff640 1 -- 172.21.15.49:0/2285550389 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67dc036040 con 0x55cd3843c1b0 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67c3fff640 1 -- 172.21.15.49:0/2285550389 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f67dc030070 con 0x55cd3843c1b0 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67f220c740 10 client.17370 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67f220c740 10 client.17370 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67f220c740 20 client.17370 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67f220c740 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cd383fad80 0x55cd38801150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67f220c740 4 client.17370 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.459+0000 7f67f220c740 1 -- 172.21.15.49:0/2285550389 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd38758640 con 0x55cd383fad80 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.460+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cd383fad80 0x55cd38801150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.460+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cd383fad80 0x55cd38801150 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64ac00299dcef801 server_cookie=4b333a9173c8b64b in_seq=0 out_seq=0 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.460+0000 7f67c3fff640 10 client.17370 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67c3fff640 1 -- 172.21.15.49:0/2285550389 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cd38758640 con 0x55cd383fad80 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67c3fff640 10 client.17370 handle_command_reply: tid=0 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 client.17370 shutdown 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 -- 172.21.15.49:0/2285550389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3843c1b0 msgr2=0x55cd387efca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3843c1b0 0x55cd387efca0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009bf0 tx=0x7f67dc031b00 comp rx=0 tx=0).stop 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 -- 172.21.15.49:0/2285550389 shutdown_connections 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cd383fad80 0x55cd38801150 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3843c1b0 0x55cd387efca0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 0x55cd387ef720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 --2- 172.21.15.49:0/2285550389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 0x55cd387ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 -- 172.21.15.49:0/2285550389 >> 172.21.15.49:0/2285550389 conn(0x55cd38430300 msgr2=0x55cd387ddea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67c3fff640 0 client.17370 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 -- 172.21.15.49:0/2285550389 shutdown_connections 2024-09-21T06:44:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 1 -- 172.21.15.49:0/2285550389 wait complete. 2024-09-21T06:44:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.461+0000 7f67f220c740 20 client.17370 trim_cache size 0 max 16384 2024-09-21T06:44:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67f220c740 1 Processor -- start 2024-09-21T06:44:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67f220c740 1 -- start start 2024-09-21T06:44:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67f220c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd384132f0 0x55cd387f0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67f220c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 0x55cd387ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67f220c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 0x55cd387efc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67f220c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41aff50 con 0x55cd384132f0 2024-09-21T06:44:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67f220c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41ad820 con 0x55cd3841b4d0 2024-09-21T06:44:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67f220c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41ab690 con 0x55cd3843c1b0 2024-09-21T06:44:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67e8f5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd384132f0 0x55cd387f0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67e8f5f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd384132f0 0x55cd387f0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53036/0 (socket says 172.21.15.49:53036) 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67e8f5f640 1 -- 172.21.15.49:0/3783157494 learned_addr learned my addr 172.21.15.49:0/3783157494 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67e3fff640 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 0x55cd387ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.476+0000 7f67e9760640 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 0x55cd387efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67e8f5f640 1 -- 172.21.15.49:0/3783157494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 msgr2=0x55cd387efc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 0x55cd387efc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67e8f5f640 1 -- 172.21.15.49:0/3783157494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 msgr2=0x55cd387ef6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 0x55cd387ef6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67e8f5f640 1 -- 172.21.15.49:0/3783157494 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd383fafb0 con 0x55cd384132f0 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67e3fff640 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 0x55cd387ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd384132f0 0x55cd387f0e10 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f67d80043f0 tx=0x7f67d8004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5989e8bb73f7e37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67ce7fc640 1 -- 172.21.15.49:0/3783157494 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d801ea90 con 0x55cd384132f0 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67ce7fc640 1 -- 172.21.15.49:0/3783157494 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67d801ec30 con 0x55cd384132f0 2024-09-21T06:44:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.477+0000 7f67ce7fc640 1 -- 172.21.15.49:0/3783157494 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d801d670 con 0x55cd384132f0 2024-09-21T06:44:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.478+0000 7f67f220c740 1 -- 172.21.15.49:0/3783157494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd384132f0 msgr2=0x55cd387f0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.478+0000 7f67f220c740 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd384132f0 0x55cd387f0e10 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f67d80043f0 tx=0x7f67d8004610 comp rx=0 tx=0).stop 2024-09-21T06:44:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.478+0000 7f67f220c740 1 -- 172.21.15.49:0/3783157494 shutdown_connections 2024-09-21T06:44:22.484 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.478+0000 7f67f220c740 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd3843c1b0 0x55cd387efc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.478+0000 7f67f220c740 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3841b4d0 0x55cd387ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.478+0000 7f67f220c740 1 --2- 172.21.15.49:0/3783157494 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd384132f0 0x55cd387f0e10 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.478+0000 7f67f220c740 1 -- 172.21.15.49:0/3783157494 >> 172.21.15.49:0/3783157494 conn(0x55cd38430300 msgr2=0x55cd387f0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.479+0000 7f67f220c740 1 -- 172.21.15.49:0/3783157494 shutdown_connections 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.479+0000 7f67f220c740 1 -- 172.21.15.49:0/3783157494 wait complete. 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.479+0000 7f67f220c740 1 -- start start 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.479+0000 7f67f220c740 1 Processor -- start 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67f220c740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 0x55cd388046c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67f220c740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd38801b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67f220c740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3843c1b0 0x55cd388020c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67f220c740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41abce0 con 0x55cd3841b4d0 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67f220c740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41ad150 con 0x55cd3843c1b0 2024-09-21T06:44:22.485 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67f220c740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f67e41ac3b0 con 0x55cd384132f0 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67f220c740 10 client.0 _ll_register_callbacks cb 0x7f67d800b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd38801b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd38801b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53050/0 (socket says 172.21.15.49:53050) 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e3fff640 1 -- 172.21.15.49:0/535258920 learned_addr learned my addr 172.21.15.49:0/535258920 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 0x55cd388046c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e9760640 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3843c1b0 0x55cd388020c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e3fff640 1 -- 172.21.15.49:0/535258920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 msgr2=0x55cd388046c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e3fff640 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 0x55cd388046c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e3fff640 1 -- 172.21.15.49:0/535258920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3843c1b0 msgr2=0x55cd388020c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e3fff640 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3843c1b0 0x55cd388020c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e3fff640 1 -- 172.21.15.49:0/535258920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd38802600 con 0x55cd3841b4d0 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e9760640 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3843c1b0 0x55cd388020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67e3fff640 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd38801b80 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f67d00ace30 tx=0x7f67d00ea760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72332cfb3308d4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.480+0000 7f67c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67c3fff640 1 -- 172.21.15.49:0/535258920 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d00ac610 con 0x55cd3841b4d0 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67c3fff640 1 -- 172.21.15.49:0/535258920 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f67d00e4a20 con 0x55cd3841b4d0 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67f220c740 1 -- 172.21.15.49:0/535258920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67d801ec30 con 0x55cd3841b4d0 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67c3fff640 1 -- 172.21.15.49:0/535258920 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f67d0009280 con 0x55cd3841b4d0 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67f220c740 10 client.17376 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67f220c740 1 -- 172.21.15.49:0/535258920 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55cd3886b5d0 con 0x55cd3841b4d0 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67c3fff640 1 -- 172.21.15.49:0/535258920 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67d801ec30 con 0x55cd3841b4d0 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67c3fff640 1 -- 172.21.15.49:0/535258920 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f67d00d4260 con 0x55cd3841b4d0 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67f220c740 10 client.17376 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67f220c740 10 client.17376 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67f220c740 20 client.17376 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67f220c740 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cd383d01c0 0x55cd3886dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67f220c740 4 client.17376 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:44:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.481+0000 7f67f220c740 1 -- 172.21.15.49:0/535258920 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd387540f0 con 0x55cd383d01c0 2024-09-21T06:44:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.482+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cd383d01c0 0x55cd3886dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.482+0000 7f67c3fff640 10 client.17376 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.482+0000 7f67e8f5f640 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cd383d01c0 0x55cd3886dd90 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a08c8e8e5599a4c server_cookie=920a95bc21b0ddb0 in_seq=0 out_seq=0 2024-09-21T06:44:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67c3fff640 1 -- 172.21.15.49:0/535258920 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd387540f0 con 0x55cd383d01c0 2024-09-21T06:44:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67c3fff640 10 client.17376 handle_command_reply: tid=0 2024-09-21T06:44:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 client.17376 shutdown 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 -- 172.21.15.49:0/535258920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 msgr2=0x55cd38801b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd38801b80 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f67d00ace30 tx=0x7f67d00ea760 comp rx=0 tx=0).stop 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 -- 172.21.15.49:0/535258920 shutdown_connections 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55cd383d01c0 0x55cd3886dd90 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67c3fff640 0 client.17376 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55cd3843c1b0 0x55cd388020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55cd3841b4d0 0x55cd38801b80 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 --2- 172.21.15.49:0/535258920 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55cd384132f0 0x55cd388046c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 -- 172.21.15.49:0/535258920 >> 172.21.15.49:0/535258920 conn(0x55cd38430300 msgr2=0x55cd387e2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 -- 172.21.15.49:0/535258920 shutdown_connections 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.490+0000 7f67f220c740 1 -- 172.21.15.49:0/535258920 wait complete. 2024-09-21T06:44:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67f220c740 20 client.17376 trim_cache size 0 max 16384 2024-09-21T06:44:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:44:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:44:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:44:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 -- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f67d40b6680 msgr2=0x7f67d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f67d40b6680 0x7f67d40b8b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55cd387e08c0 tx=0x7f67d800b390 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 -- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105120 msgr2=0x7f67e4199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105120 0x7f67e4199910 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f67d000b450 tx=0x7f67d000b910 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 -- 172.21.15.49:0/2675474720 shutdown_connections 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f67d40b6680 0x7f67d40b8b90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f67e4105a70 0x7f67e419eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f67e4105120 0x7f67e4199910 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 --2- 172.21.15.49:0/2675474720 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f67e4103160 0x7f67e4199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.491+0000 7f67eb1c3640 1 -- 172.21.15.49:0/2675474720 >> 172.21.15.49:0/2675474720 conn(0x7f67e4079ce0 msgr2=0x7f67e4106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.492+0000 7f67eb1c3640 1 -- 172.21.15.49:0/2675474720 shutdown_connections 2024-09-21T06:44:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:22.492+0000 7f67eb1c3640 1 -- 172.21.15.49:0/2675474720 wait complete. 2024-09-21T06:44:22.696 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:22.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:22 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1816947711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:44:23.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:22 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1816947711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:44:23.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:22 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1816947711' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:44:23.199 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.198+0000 7fd22c561640 1 -- 172.21.15.49:0/3199926682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd22410de60 msgr2=0x7fd224110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.198+0000 7fd22c561640 1 --2- 172.21.15.49:0/3199926682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd22410de60 0x7fd224110330 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009ca0 tx=0x7fd21c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.198+0000 7fd22c561640 1 -- 172.21.15.49:0/3199926682 shutdown_connections 2024-09-21T06:44:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.198+0000 7fd22c561640 1 --2- 172.21.15.49:0/3199926682 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd22410de60 0x7fd224110330 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.198+0000 7fd22c561640 1 --2- 172.21.15.49:0/3199926682 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd224105380 0x7fd22410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.198+0000 7fd22c561640 1 --2- 172.21.15.49:0/3199926682 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd224104a30 0x7fd224104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.198+0000 7fd22c561640 1 -- 172.21.15.49:0/3199926682 >> 172.21.15.49:0/3199926682 conn(0x7fd224079760 msgr2=0x7fd224079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.198+0000 7fd22c561640 1 -- 172.21.15.49:0/3199926682 shutdown_connections 2024-09-21T06:44:23.200 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.198+0000 7fd22c561640 1 -- 172.21.15.49:0/3199926682 wait complete. 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22c561640 1 Processor -- start 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22c561640 1 -- start start 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22c561640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd224104a30 0x7fd22419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22c561640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd224105380 0x7fd22419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22c561640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22410de60 0x7fd22419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22c561640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd224113aa0 con 0x7fd224105380 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22c561640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd224113920 con 0x7fd22410de60 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22c561640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd224113c20 con 0x7fd224104a30 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd229afc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd224105380 0x7fd22419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.202 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd229afc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd224105380 0x7fd22419a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53070/0 (socket says 172.21.15.49:53070) 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd229afc640 1 -- 172.21.15.49:0/3238944484 learned_addr learned my addr 172.21.15.49:0/3238944484 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22aafe640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22410de60 0x7fd22419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.199+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd224104a30 0x7fd22419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd229afc640 1 -- 172.21.15.49:0/3238944484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd224104a30 msgr2=0x7fd22419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd229afc640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd224104a30 0x7fd22419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd229afc640 1 -- 172.21.15.49:0/3238944484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22410de60 msgr2=0x7fd22419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd229afc640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22410de60 0x7fd22419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd229afc640 1 -- 172.21.15.49:0/3238944484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2241a0380 con 0x7fd224105380 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd229afc640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd224105380 0x7fd22419a9b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d740 tx=0x7fd21400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd21b7fe640 1 -- 172.21.15.49:0/3238944484 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214017070 con 0x7fd224105380 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd22c561640 1 -- 172.21.15.49:0/3238944484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2241a0670 con 0x7fd224105380 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd21b7fe640 1 -- 172.21.15.49:0/3238944484 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21400de50 con 0x7fd224105380 2024-09-21T06:44:23.203 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd21b7fe640 1 -- 172.21.15.49:0/3238944484 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21400f620 con 0x7fd224105380 2024-09-21T06:44:23.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.200+0000 7fd22c561640 1 -- 172.21.15.49:0/3238944484 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd224102650 con 0x7fd224105380 2024-09-21T06:44:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.203+0000 7fd232ad5740 1 Processor -- start 2024-09-21T06:44:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.203+0000 7fd232ad5740 1 -- start start 2024-09-21T06:44:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.203+0000 7fd21b7fe640 1 -- 172.21.15.49:0/3238944484 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd21401a070 con 0x7fd224105380 2024-09-21T06:44:23.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.203+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69ee070 0x55a2e6d952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.203+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 0x55a2e6d95800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.203+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6d95d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd232ad5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a2e6d0bea0 con 0x55a2e69cd390 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd232ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a2e6cfb2d0 con 0x55a2e69ee070 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd232ad5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a2e6cff0e0 con 0x55a2e69c51b0 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd229afc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6d95d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd229afc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6d95d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53074/0 (socket says 172.21.15.49:53074) 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd229afc640 1 -- 172.21.15.49:0/727386240 learned_addr learned my addr 172.21.15.49:0/727386240 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd22aafe640 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69ee070 0x55a2e6d952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 0x55a2e6d95800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd229afc640 1 -- 172.21.15.49:0/727386240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 msgr2=0x55a2e6d95800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd229afc640 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 0x55a2e6d95800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd229afc640 1 -- 172.21.15.49:0/727386240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69ee070 msgr2=0x55a2e6d952c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd229afc640 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69ee070 0x55a2e6d952c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd229afc640 1 -- 172.21.15.49:0/727386240 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2e6a59650 con 0x55a2e69cd390 2024-09-21T06:44:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd22aafe640 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69ee070 0x55a2e6d952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.204+0000 7fd229afc640 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6d95d40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fd2140e4810 tx=0x7fd2140ef890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e43bcb0692443cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:23.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.205+0000 7fd21b7fe640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd2100b6680 0x7fd2100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.205+0000 7fd22aafe640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd2100b6680 0x7fd2100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.205+0000 7fd218ff9640 1 -- 172.21.15.49:0/727386240 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2140fa070 con 0x55a2e69cd390 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.205+0000 7fd21b7fe640 1 -- 172.21.15.49:0/3238944484 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fd2140e71a0 con 0x7fd224105380 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.205+0000 7fd218ff9640 1 -- 172.21.15.49:0/727386240 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2140234c0 con 0x55a2e69cd390 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.205+0000 7fd218ff9640 1 -- 172.21.15.49:0/727386240 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2140acd70 con 0x55a2e69cd390 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 -- 172.21.15.49:0/727386240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 msgr2=0x55a2e6d95d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd22aafe640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd2100b6680 0x7fd2100b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd21c02f500 tx=0x7fd21c02f490 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6d95d40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fd2140e4810 tx=0x7fd2140ef890 comp rx=0 tx=0).stop 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 -- 172.21.15.49:0/727386240 shutdown_connections 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6d95d40 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 0x55a2e6d95800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 --2- 172.21.15.49:0/727386240 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69ee070 0x55a2e6d952c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 -- 172.21.15.49:0/727386240 >> 172.21.15.49:0/727386240 conn(0x55a2e69e2460 msgr2=0x55a2e6d931b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 -- 172.21.15.49:0/727386240 shutdown_connections 2024-09-21T06:44:23.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 -- 172.21.15.49:0/727386240 wait complete. 2024-09-21T06:44:23.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.206+0000 7fd232ad5740 1 -- start start 2024-09-21T06:44:23.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd232ad5740 1 Processor -- start 2024-09-21T06:44:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 0x55a2e6da08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69cd390 0x55a2e6da0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6da1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd232ad5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a2e6b5c700 con 0x55a2e69ee070 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd232ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a2e6c96160 con 0x55a2e69cd390 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd232ad5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a2e6da3aa0 con 0x55a2e69c51b0 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd232ad5740 10 client.0 _ll_register_callbacks cb 0x55a2e6caf9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd22aafe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6da1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd22aafe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6da1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53084/0 (socket says 172.21.15.49:53084) 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd22aafe640 1 -- 172.21.15.49:0/3654591617 learned_addr learned my addr 172.21.15.49:0/3654591617 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 0x55a2e6da08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd229afc640 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69cd390 0x55a2e6da0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd22aafe640 1 -- 172.21.15.49:0/3654591617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 msgr2=0x55a2e6da08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd22aafe640 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 0x55a2e6da08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd22aafe640 1 -- 172.21.15.49:0/3654591617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69cd390 msgr2=0x55a2e6da0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd22aafe640 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69cd390 0x55a2e6da0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd22aafe640 1 -- 172.21.15.49:0/3654591617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2e6cc3c90 con 0x55a2e69ee070 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.207+0000 7fd229afc640 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69cd390 0x55a2e6da0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd22aafe640 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6da1330 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009ca0 tx=0x7fd21c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75720a254e603d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd20dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd20dffb640 1 -- 172.21.15.49:0/3654591617 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c003d80 con 0x55a2e69ee070 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd20dffb640 1 -- 172.21.15.49:0/3654591617 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fd21c004040 con 0x55a2e69ee070 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd232ad5740 1 -- 172.21.15.49:0/3654591617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2140234c0 con 0x55a2e69ee070 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd20dffb640 1 -- 172.21.15.49:0/3654591617 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd21c004240 con 0x55a2e69ee070 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd232ad5740 10 client.17388 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd232ad5740 1 -- 172.21.15.49:0/3654591617 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a2e6daf6f0 con 0x55a2e69ee070 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd20dffb640 1 -- 172.21.15.49:0/3654591617 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2140234c0 con 0x55a2e69ee070 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.208+0000 7fd20dffb640 1 -- 172.21.15.49:0/3654591617 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd21c051070 con 0x55a2e69ee070 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.209+0000 7fd232ad5740 10 client.17388 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:23.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.209+0000 7fd232ad5740 10 client.17388 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.209+0000 7fd232ad5740 20 client.17388 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.209+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a2e69ac9f0 0x55a2e6db2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.209+0000 7fd232ad5740 4 client.17388 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.209+0000 7fd232ad5740 1 -- 172.21.15.49:0/3654591617 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2e6d0ddf0 con 0x55a2e69ac9f0 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.209+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a2e69ac9f0 0x55a2e6db2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.209+0000 7fd20dffb640 10 client.17388 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.209+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a2e69ac9f0 0x55a2e6db2b10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b1fa0c32669f77e server_cookie=82deb7b5cc64c98 in_seq=0 out_seq=0 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.210+0000 7fd20dffb640 1 -- 172.21.15.49:0/3654591617 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2e6d0ddf0 con 0x55a2e69ac9f0 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.210+0000 7fd20dffb640 10 client.17388 handle_command_reply: tid=0 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.210+0000 7fd232ad5740 1 client.17388 shutdown 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 -- 172.21.15.49:0/3654591617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 msgr2=0x55a2e6da1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6da1330 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd21c009ca0 tx=0x7fd21c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 -- 172.21.15.49:0/3654591617 shutdown_connections 2024-09-21T06:44:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a2e69ac9f0 0x55a2e6db2b10 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6da1330 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69cd390 0x55a2e6da0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3654591617 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69c51b0 0x55a2e6da08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 -- 172.21.15.49:0/3654591617 >> 172.21.15.49:0/3654591617 conn(0x55a2e69e2460 msgr2=0x55a2e6d984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd20dffb640 0 client.17388 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:44:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 -- 172.21.15.49:0/3654591617 shutdown_connections 2024-09-21T06:44:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 1 -- 172.21.15.49:0/3654591617 wait complete. 2024-09-21T06:44:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.211+0000 7fd232ad5740 20 client.17388 trim_cache size 0 max 16384 2024-09-21T06:44:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.224+0000 7fd232ad5740 1 Processor -- start 2024-09-21T06:44:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.224+0000 7fd232ad5740 1 -- start start 2024-09-21T06:44:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.224+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 0x55a2e6dacc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.224+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69cd390 0x55a2e6d96a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.224+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6d9daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.224+0000 7fd232ad5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b4310 con 0x55a2e69ee070 2024-09-21T06:44:23.227 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.224+0000 7fd232ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b1be0 con 0x55a2e69c51b0 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.224+0000 7fd232ad5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241afa50 con 0x55a2e69cd390 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22aafe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6d9daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22aafe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6d9daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53090/0 (socket says 172.21.15.49:53090) 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22aafe640 1 -- 172.21.15.49:0/3861868804 learned_addr learned my addr 172.21.15.49:0/3861868804 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 0x55a2e6dacc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd229afc640 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69cd390 0x55a2e6d96a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22aafe640 1 -- 172.21.15.49:0/3861868804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69cd390 msgr2=0x55a2e6d96a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22aafe640 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69cd390 0x55a2e6d96a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22aafe640 1 -- 172.21.15.49:0/3861868804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 msgr2=0x55a2e6dacc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22aafe640 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 0x55a2e6dacc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22aafe640 1 -- 172.21.15.49:0/3861868804 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2e69acc20 con 0x55a2e69ee070 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd229afc640 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69cd390 0x55a2e6d96a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:23.228 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 0x55a2e6dacc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:23.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd22aafe640 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6d9daa0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fd21c02ade0 tx=0x7fd21c0041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f3bd23f43fd690 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:23.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd20ffff640 1 -- 172.21.15.49:0/3861868804 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c004b40 con 0x55a2e69ee070 2024-09-21T06:44:23.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd20ffff640 1 -- 172.21.15.49:0/3861868804 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21c036050 con 0x55a2e69ee070 2024-09-21T06:44:23.229 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.225+0000 7fd20ffff640 1 -- 172.21.15.49:0/3861868804 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21c02f9e0 con 0x55a2e69ee070 2024-09-21T06:44:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.226+0000 7fd232ad5740 1 -- 172.21.15.49:0/3861868804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 msgr2=0x55a2e6d9daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.226+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6d9daa0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fd21c02ade0 tx=0x7fd21c0041d0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.232 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.226+0000 7fd232ad5740 1 -- 172.21.15.49:0/3861868804 shutdown_connections 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.226+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69ee070 0x55a2e6d9daa0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.226+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69cd390 0x55a2e6d96a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.226+0000 7fd232ad5740 1 --2- 172.21.15.49:0/3861868804 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 0x55a2e6dacc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.226+0000 7fd232ad5740 1 -- 172.21.15.49:0/3861868804 >> 172.21.15.49:0/3861868804 conn(0x55a2e69e2460 msgr2=0x55a2e6d962f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.226+0000 7fd232ad5740 1 -- 172.21.15.49:0/3861868804 shutdown_connections 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.226+0000 7fd232ad5740 1 -- 172.21.15.49:0/3861868804 wait complete. 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd232ad5740 1 -- start start 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd232ad5740 1 Processor -- start 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 0x55a2e6da9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6da4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd232ad5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69ee070 0x55a2e6da5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd232ad5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b00a0 con 0x55a2e69cd390 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd232ad5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b1510 con 0x55a2e69c51b0 2024-09-21T06:44:23.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd232ad5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd2241b0770 con 0x55a2e69ee070 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd232ad5740 10 client.0 _ll_register_callbacks cb 0x7fd21c02f310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd229afc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6da4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd229afc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6da4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53092/0 (socket says 172.21.15.49:53092) 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd229afc640 1 -- 172.21.15.49:0/1882323216 learned_addr learned my addr 172.21.15.49:0/1882323216 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 0x55a2e6da9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd22aafe640 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69ee070 0x55a2e6da5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.227+0000 7fd229afc640 1 -- 172.21.15.49:0/1882323216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69ee070 msgr2=0x55a2e6da5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd229afc640 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69ee070 0x55a2e6da5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd229afc640 1 -- 172.21.15.49:0/1882323216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 msgr2=0x55a2e6da9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd229afc640 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 0x55a2e6da9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd229afc640 1 -- 172.21.15.49:0/1882323216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2e6e1c4f0 con 0x55a2e69cd390 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd229afc640 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6da4b40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd2140effd0 tx=0x7fd214010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6e4a0613c2d47f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd20dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd20dffb640 1 -- 172.21.15.49:0/1882323216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214021070 con 0x55a2e69cd390 2024-09-21T06:44:23.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd20dffb640 1 -- 172.21.15.49:0/1882323216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fd2140e4b20 con 0x55a2e69cd390 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd232ad5740 1 -- 172.21.15.49:0/1882323216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd21c036050 con 0x55a2e69cd390 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd20dffb640 1 -- 172.21.15.49:0/1882323216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd214008230 con 0x55a2e69cd390 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd232ad5740 10 client.17394 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd232ad5740 1 -- 172.21.15.49:0/1882323216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a2e6e1d550 con 0x55a2e69cd390 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd20dffb640 1 -- 172.21.15.49:0/1882323216 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd21c036050 con 0x55a2e69cd390 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd20dffb640 1 -- 172.21.15.49:0/1882323216 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd2140a9210 con 0x55a2e69cd390 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd232ad5740 10 client.17394 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.228+0000 7fd232ad5740 10 client.17394 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd232ad5740 20 client.17394 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd232ad5740 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a2e6981da0 0x55a2e6e1f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd232ad5740 4 client.17394 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd232ad5740 1 -- 172.21.15.49:0/1882323216 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a2e6d098a0 con 0x55a2e6981da0 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a2e6981da0 0x55a2e6e1f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:23.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd20dffb640 10 client.17394 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd22a2fd640 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a2e6981da0 0x55a2e6e1f820 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bf3e9db652e50de server_cookie=f49a42f724df8d6f in_seq=0 out_seq=0 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd20dffb640 1 -- 172.21.15.49:0/1882323216 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a2e6d098a0 con 0x55a2e6981da0 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd20dffb640 10 client.17394 handle_command_reply: tid=0 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.229+0000 7fd232ad5740 1 client.17394 shutdown 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 -- 172.21.15.49:0/1882323216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 msgr2=0x55a2e6da4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6da4b40 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd2140effd0 tx=0x7fd214010c70 comp rx=0 tx=0).stop 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 -- 172.21.15.49:0/1882323216 shutdown_connections 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a2e6981da0 0x55a2e6e1f820 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a2e69ee070 0x55a2e6da5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a2e69cd390 0x55a2e6da4b40 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd20dffb640 0 client.17394 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 --2- 172.21.15.49:0/1882323216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a2e69c51b0 0x55a2e6da9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 -- 172.21.15.49:0/1882323216 >> 172.21.15.49:0/1882323216 conn(0x55a2e69e2460 msgr2=0x55a2e6d96a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 -- 172.21.15.49:0/1882323216 shutdown_connections 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 1 -- 172.21.15.49:0/1882323216 wait complete. 2024-09-21T06:44:23.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd232ad5740 20 client.17394 trim_cache size 0 max 16384 2024-09-21T06:44:23.237 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:44:23.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 -- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd2100b6680 msgr2=0x7fd2100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:23.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd2100b6680 0x7fd2100b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd21c02f500 tx=0x7fd21c02f490 comp rx=0 tx=0).stop 2024-09-21T06:44:23.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 -- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd224105380 msgr2=0x7fd22419a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:23.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd224105380 0x7fd22419a9b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fd21400d740 tx=0x7fd21400dc00 comp rx=0 tx=0).stop 2024-09-21T06:44:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 -- 172.21.15.49:0/3238944484 shutdown_connections 2024-09-21T06:44:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd2100b6680 0x7fd2100b8b90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd22410de60 0x7fd22419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd224105380 0x7fd22419a9b0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 --2- 172.21.15.49:0/3238944484 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd224104a30 0x7fd22419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.230+0000 7fd22c561640 1 -- 172.21.15.49:0/3238944484 >> 172.21.15.49:0/3238944484 conn(0x7fd224079760 msgr2=0x7fd224105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.231+0000 7fd22c561640 1 -- 172.21.15.49:0/3238944484 shutdown_connections 2024-09-21T06:44:23.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:23.231+0000 7fd22c561640 1 -- 172.21.15.49:0/3238944484 wait complete. 2024-09-21T06:44:23.876 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:23 smithi049 ceph-mon[31177]: pgmap v555: 97 pgs: 97 active+clean; 7.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:44:23.906 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:44:24.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:23 smithi098 ceph-mon[34704]: pgmap v555: 97 pgs: 97 active+clean; 7.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:44:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:23 smithi079 ceph-mon[34346]: pgmap v555: 97 pgs: 97 active+clean; 7.6 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:44:24.206 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.682+0000 7f84eb579640 1 -- 172.21.15.49:0/4029252797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e4108d20 msgr2=0x7f84e410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.682+0000 7f84eb579640 1 --2- 172.21.15.49:0/4029252797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e4108d20 0x7f84e410f550 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009ca0 tx=0x7f84dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.682+0000 7f84eb579640 1 -- 172.21.15.49:0/4029252797 shutdown_connections 2024-09-21T06:44:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.682+0000 7f84eb579640 1 --2- 172.21.15.49:0/4029252797 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e4108d20 0x7f84e410f550 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.682+0000 7f84eb579640 1 --2- 172.21.15.49:0/4029252797 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e41083d0 0x7f84e41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.682+0000 7f84eb579640 1 --2- 172.21.15.49:0/4029252797 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e4102ae0 0x7f84e4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.682+0000 7f84eb579640 1 -- 172.21.15.49:0/4029252797 >> 172.21.15.49:0/4029252797 conn(0x7f84e4079760 msgr2=0x7f84e4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:24.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.682+0000 7f84eb579640 1 -- 172.21.15.49:0/4029252797 shutdown_connections 2024-09-21T06:44:24.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.682+0000 7f84eb579640 1 -- 172.21.15.49:0/4029252797 wait complete. 2024-09-21T06:44:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84eb579640 1 Processor -- start 2024-09-21T06:44:24.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84eb579640 1 -- start start 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84eb579640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4102ae0 0x7f84e40ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84eb579640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e41083d0 0x7f84e40ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84eb579640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e4108d20 0x7f84e41000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84eb579640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41129e0 con 0x7f84e41083d0 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84eb579640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4112860 con 0x7f84e4102ae0 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84eb579640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84e4112b60 con 0x7f84e4108d20 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84e8b14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e41083d0 0x7f84e40ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84e8b14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e41083d0 0x7f84e40ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53116/0 (socket says 172.21.15.49:53116) 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.683+0000 7f84e8b14640 1 -- 172.21.15.49:0/3946175651 learned_addr learned my addr 172.21.15.49:0/3946175651 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84e9b16640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e4108d20 0x7f84e41000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84e9315640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4102ae0 0x7f84e40ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84e8b14640 1 -- 172.21.15.49:0/3946175651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e4108d20 msgr2=0x7f84e41000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:24.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84e8b14640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e4108d20 0x7f84e41000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84e8b14640 1 -- 172.21.15.49:0/3946175651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4102ae0 msgr2=0x7f84e40ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84e8b14640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4102ae0 0x7f84e40ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84e8b14640 1 -- 172.21.15.49:0/3946175651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41a8610 con 0x7f84e41083d0 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84e9315640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4102ae0 0x7f84e40ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84e8b14640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e41083d0 0x7f84e40ffbb0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c970 tx=0x7f84d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84d67fc640 1 -- 172.21.15.49:0/3946175651 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8014070 con 0x7f84e41083d0 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84d67fc640 1 -- 172.21.15.49:0/3946175651 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84d8004440 con 0x7f84e41083d0 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84d67fc640 1 -- 172.21.15.49:0/3946175651 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8003e50 con 0x7f84e41083d0 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84eb579640 1 -- 172.21.15.49:0/3946175651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e41a8900 con 0x7f84e41083d0 2024-09-21T06:44:24.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.684+0000 7f84eb579640 1 -- 172.21.15.49:0/3946175651 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41a8df0 con 0x7f84e41083d0 2024-09-21T06:44:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.687+0000 7f84d67fc640 1 -- 172.21.15.49:0/3946175651 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f84d8017070 con 0x7f84e41083d0 2024-09-21T06:44:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.687+0000 7f84f1aed740 1 Processor -- start 2024-09-21T06:44:24.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.687+0000 7f84f1aed740 1 -- start start 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 0x5633ff0592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec891b0 0x5633ff059800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 0x5633ff059d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84f1aed740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5633fefcfea0 con 0x5633fec891b0 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84f1aed740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5633fefbf2d0 con 0x5633fecb2070 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84f1aed740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5633fefc30e0 con 0x5633fec91390 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9315640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec891b0 0x5633ff059800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9315640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec891b0 0x5633ff059800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53124/0 (socket says 172.21.15.49:53124) 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9315640 1 -- 172.21.15.49:0/1974275479 learned_addr learned my addr 172.21.15.49:0/1974275479 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e8b14640 1 --2- 172.21.15.49:0/1974275479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 0x5633ff059d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9b16640 1 --2- 172.21.15.49:0/1974275479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 0x5633ff0592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9315640 1 -- 172.21.15.49:0/1974275479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 msgr2=0x5633ff059d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9315640 1 --2- 172.21.15.49:0/1974275479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 0x5633ff059d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9315640 1 -- 172.21.15.49:0/1974275479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 msgr2=0x5633ff0592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9315640 1 --2- 172.21.15.49:0/1974275479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 0x5633ff0592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9315640 1 -- 172.21.15.49:0/1974275479 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633fed1d650 con 0x5633fec891b0 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84d67fc640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84d00b6820 0x7f84d00b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9315640 1 --2- 172.21.15.49:0/1974275479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec891b0 0x5633ff059800 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009c30 tx=0x7f84e000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c021a59cc181acf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.688+0000 7f84e9b16640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84d00b6820 0x7f84d00b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.689+0000 7f84d67fc640 1 -- 172.21.15.49:0/3946175651 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f84d80e76c0 con 0x7f84e41083d0 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.689+0000 7f84cf7fe640 1 -- 172.21.15.49:0/1974275479 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0016070 con 0x5633fec891b0 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.689+0000 7f84cf7fe640 1 -- 172.21.15.49:0/1974275479 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84e00054d0 con 0x5633fec891b0 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.689+0000 7f84cf7fe640 1 -- 172.21.15.49:0/1974275479 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e0011470 con 0x5633fec891b0 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 -- 172.21.15.49:0/1974275479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec891b0 msgr2=0x5633ff059800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 --2- 172.21.15.49:0/1974275479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec891b0 0x5633ff059800 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f84e0009c30 tx=0x7f84e000e6c0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84e9b16640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84d00b6820 0x7f84d00b8d30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0094e0 tx=0x7f84dc009380 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 -- 172.21.15.49:0/1974275479 shutdown_connections 2024-09-21T06:44:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 --2- 172.21.15.49:0/1974275479 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 0x5633ff059d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 --2- 172.21.15.49:0/1974275479 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec891b0 0x5633ff059800 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 --2- 172.21.15.49:0/1974275479 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 0x5633ff0592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 -- 172.21.15.49:0/1974275479 >> 172.21.15.49:0/1974275479 conn(0x5633feca6460 msgr2=0x5633ff0571b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 -- 172.21.15.49:0/1974275479 shutdown_connections 2024-09-21T06:44:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 -- 172.21.15.49:0/1974275479 wait complete. 2024-09-21T06:44:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 -- start start 2024-09-21T06:44:24.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.690+0000 7f84f1aed740 1 Processor -- start 2024-09-21T06:44:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 0x5633ff0648e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec91390 0x5633ff064e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 0x5633ff065360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84f1aed740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5633fee20700 con 0x5633fec91390 2024-09-21T06:44:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84f1aed740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5633fef5a160 con 0x5633fecb2070 2024-09-21T06:44:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84f1aed740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5633ff067aa0 con 0x5633fec891b0 2024-09-21T06:44:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84f1aed740 10 client.0 _ll_register_callbacks cb 0x5633fef739e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e8b14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec91390 0x5633ff064e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.696 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e8b14640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec91390 0x5633ff064e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53126/0 (socket says 172.21.15.49:53126) 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e8b14640 1 -- 172.21.15.49:0/310810876 learned_addr learned my addr 172.21.15.49:0/310810876 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e9315640 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 0x5633ff0648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e9b16640 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 0x5633ff065360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e8b14640 1 -- 172.21.15.49:0/310810876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 msgr2=0x5633ff0648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e8b14640 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 0x5633ff0648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e8b14640 1 -- 172.21.15.49:0/310810876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 msgr2=0x5633ff065360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e8b14640 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 0x5633ff065360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e8b14640 1 -- 172.21.15.49:0/310810876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633fef87c90 con 0x5633fec91390 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84e8b14640 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec91390 0x5633ff064e20 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f84d80e4e20 tx=0x7f84d800a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a75826ca7b7926e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.691+0000 7f84ccff9640 1 -- 172.21.15.49:0/310810876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d80a9360 con 0x5633fec91390 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84ccff9640 1 -- 172.21.15.49:0/310810876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f84d80e7b70 con 0x5633fec91390 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84f1aed740 1 -- 172.21.15.49:0/310810876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84e00054d0 con 0x5633fec91390 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84ccff9640 1 -- 172.21.15.49:0/310810876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f84d80acc30 con 0x5633fec91390 2024-09-21T06:44:24.697 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84f1aed740 10 client.17406 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84f1aed740 1 -- 172.21.15.49:0/310810876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5633ff073710 con 0x5633fec91390 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84ccff9640 1 -- 172.21.15.49:0/310810876 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84e00054d0 con 0x5633fec91390 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84ccff9640 1 -- 172.21.15.49:0/310810876 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f84d80a8e10 con 0x5633fec91390 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84f1aed740 10 client.17406 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84f1aed740 10 client.17406 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84f1aed740 20 client.17406 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84f1aed740 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5633fec709f0 0x5633ff076ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84f1aed740 4 client.17406 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.692+0000 7f84f1aed740 1 -- 172.21.15.49:0/310810876 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633fefd1df0 con 0x5633fec709f0 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.693+0000 7f84e9315640 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5633fec709f0 0x5633ff076ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.693+0000 7f84e9315640 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5633fec709f0 0x5633ff076ac0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f6f5ee493c30c48 server_cookie=52315d760519c104 in_seq=0 out_seq=0 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.693+0000 7f84ccff9640 10 client.17406 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84ccff9640 1 -- 172.21.15.49:0/310810876 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5633fefd1df0 con 0x5633fec709f0 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84ccff9640 10 client.17406 handle_command_reply: tid=0 2024-09-21T06:44:24.698 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 client.17406 shutdown 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 -- 172.21.15.49:0/310810876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec91390 msgr2=0x5633ff064e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec91390 0x5633ff064e20 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f84d80e4e20 tx=0x7f84d800a630 comp rx=0 tx=0).stop 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 -- 172.21.15.49:0/310810876 shutdown_connections 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5633fec709f0 0x5633ff076ac0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fecb2070 0x5633ff065360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fec91390 0x5633ff064e20 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 --2- 172.21.15.49:0/310810876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 0x5633ff0648e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 -- 172.21.15.49:0/310810876 >> 172.21.15.49:0/310810876 conn(0x5633feca6460 msgr2=0x5633ff05c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84ccff9640 0 client.17406 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 -- 172.21.15.49:0/310810876 shutdown_connections 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 1 -- 172.21.15.49:0/310810876 wait complete. 2024-09-21T06:44:24.699 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.694+0000 7f84f1aed740 20 client.17406 trim_cache size 0 max 16384 2024-09-21T06:44:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.707+0000 7f84f1aed740 1 Processor -- start 2024-09-21T06:44:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.707+0000 7f84f1aed740 1 -- start start 2024-09-21T06:44:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 0x5633ff0667c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec91390 0x5633ff05a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff05cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84f1aed740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41b4300 con 0x5633fecb2070 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84f1aed740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41b1bd0 con 0x5633fec91390 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84f1aed740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41afa40 con 0x5633fec891b0 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9b16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff05cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9b16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff05cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53134/0 (socket says 172.21.15.49:53134) 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9b16640 1 -- 172.21.15.49:0/1744751589 learned_addr learned my addr 172.21.15.49:0/1744751589 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9315640 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 0x5633ff0667c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e8b14640 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec91390 0x5633ff05a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9b16640 1 -- 172.21.15.49:0/1744751589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 msgr2=0x5633ff0667c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9b16640 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 0x5633ff0667c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9b16640 1 -- 172.21.15.49:0/1744751589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec91390 msgr2=0x5633ff05a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9b16640 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec91390 0x5633ff05a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9b16640 1 -- 172.21.15.49:0/1744751589 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633ff051440 con 0x5633fecb2070 2024-09-21T06:44:24.711 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9315640 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 0x5633ff0667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:24.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.708+0000 7f84e9b16640 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff05cad0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009ca0 tx=0x7f84dc041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc27fa6e18e2b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:24.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84ceffd640 1 -- 172.21.15.49:0/1744751589 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc003970 con 0x5633fecb2070 2024-09-21T06:44:24.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84ceffd640 1 -- 172.21.15.49:0/1744751589 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84dc036040 con 0x5633fecb2070 2024-09-21T06:44:24.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84ceffd640 1 -- 172.21.15.49:0/1744751589 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc02f610 con 0x5633fecb2070 2024-09-21T06:44:24.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84f1aed740 1 -- 172.21.15.49:0/1744751589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 msgr2=0x5633ff05cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84f1aed740 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff05cad0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f84dc009ca0 tx=0x7f84dc041000 comp rx=0 tx=0).stop 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84f1aed740 1 -- 172.21.15.49:0/1744751589 shutdown_connections 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84f1aed740 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff05cad0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84f1aed740 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec91390 0x5633ff05a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84f1aed740 1 --2- 172.21.15.49:0/1744751589 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec891b0 0x5633ff0667c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84f1aed740 1 -- 172.21.15.49:0/1744751589 >> 172.21.15.49:0/1744751589 conn(0x5633feca6460 msgr2=0x5633ff05c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.709+0000 7f84f1aed740 1 -- 172.21.15.49:0/1744751589 shutdown_connections 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.710+0000 7f84f1aed740 1 -- 172.21.15.49:0/1744751589 wait complete. 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.710+0000 7f84f1aed740 1 -- start start 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.710+0000 7f84f1aed740 1 Processor -- start 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.710+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec891b0 0x5633ff068c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.710+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 0x5633ff069150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.710+0000 7f84f1aed740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff069690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.710+0000 7f84f1aed740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41b0090 con 0x5633fecb2070 2024-09-21T06:44:24.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.710+0000 7f84f1aed740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41b1500 con 0x5633fec891b0 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.710+0000 7f84f1aed740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f84e41b0760 con 0x5633fec91390 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84f1aed740 10 client.0 _ll_register_callbacks cb 0x7f84d800c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9b16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9b16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff069690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53142/0 (socket says 172.21.15.49:53142) 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9b16640 1 -- 172.21.15.49:0/4248080609 learned_addr learned my addr 172.21.15.49:0/4248080609 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9315640 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec891b0 0x5633ff068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e8b14640 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 0x5633ff069150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9b16640 1 -- 172.21.15.49:0/4248080609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 msgr2=0x5633ff069150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9b16640 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 0x5633ff069150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9b16640 1 -- 172.21.15.49:0/4248080609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec891b0 msgr2=0x5633ff068c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9b16640 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec891b0 0x5633ff068c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9b16640 1 -- 172.21.15.49:0/4248080609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633ff0e0480 con 0x5633fecb2070 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9315640 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec891b0 0x5633ff068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84e9b16640 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff069690 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f84dc043040 tx=0x7f84dc032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440e939f21c5ec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84ccff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:24.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84ccff9640 1 -- 172.21.15.49:0/4248080609 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc061060 con 0x5633fecb2070 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84ccff9640 1 -- 172.21.15.49:0/4248080609 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f84dc003b80 con 0x5633fecb2070 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.711+0000 7f84f1aed740 1 -- 172.21.15.49:0/4248080609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84dc036040 con 0x5633fecb2070 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84ccff9640 1 -- 172.21.15.49:0/4248080609 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f84dc004850 con 0x5633fecb2070 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84f1aed740 10 client.17412 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84f1aed740 1 -- 172.21.15.49:0/4248080609 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5633ff0e1640 con 0x5633fecb2070 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84ccff9640 1 -- 172.21.15.49:0/4248080609 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84dc036040 con 0x5633fecb2070 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84ccff9640 1 -- 172.21.15.49:0/4248080609 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f84dc0305c0 con 0x5633fecb2070 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84f1aed740 10 client.17412 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84f1aed740 10 client.17412 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84f1aed740 20 client.17412 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84f1aed740 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5633fec45da0 0x5633ff0e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84f1aed740 4 client.17412 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84f1aed740 1 -- 172.21.15.49:0/4248080609 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633fefcd8a0 con 0x5633fec45da0 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.712+0000 7f84e9315640 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5633fec45da0 0x5633ff0e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:24.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84ccff9640 10 client.17412 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84e9315640 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5633fec45da0 0x5633ff0e3da0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7030091f028f3b48 server_cookie=a2b54f43cffb2819 in_seq=0 out_seq=0 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84ccff9640 1 -- 172.21.15.49:0/4248080609 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633fefcd8a0 con 0x5633fec45da0 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84ccff9640 10 client.17412 handle_command_reply: tid=0 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 client.17412 shutdown 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 -- 172.21.15.49:0/4248080609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 msgr2=0x5633ff069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff069690 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f84dc043040 tx=0x7f84dc032c30 comp rx=0 tx=0).stop 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 -- 172.21.15.49:0/4248080609 shutdown_connections 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5633fec45da0 0x5633ff0e3da0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5633fecb2070 0x5633ff069690 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5633fec91390 0x5633ff069150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84ccff9640 0 client.17412 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 --2- 172.21.15.49:0/4248080609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5633fec891b0 0x5633ff068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 -- 172.21.15.49:0/4248080609 >> 172.21.15.49:0/4248080609 conn(0x5633feca6460 msgr2=0x5633ff05cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:24.719 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 -- 172.21.15.49:0/4248080609 shutdown_connections 2024-09-21T06:44:24.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.713+0000 7f84f1aed740 1 -- 172.21.15.49:0/4248080609 wait complete. 2024-09-21T06:44:24.720 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84f1aed740 20 client.17412 trim_cache size 0 max 16384 2024-09-21T06:44:24.720 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 -- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84d00b6820 msgr2=0x7f84d00b8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84d00b6820 0x7f84d00b8d30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0094e0 tx=0x7f84dc009380 comp rx=0 tx=0).stop 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 -- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e41083d0 msgr2=0x7f84e40ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e41083d0 0x7f84e40ffbb0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c970 tx=0x7f84d800ce30 comp rx=0 tx=0).stop 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 -- 172.21.15.49:0/3946175651 shutdown_connections 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f84d00b6820 0x7f84d00b8d30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f84e4108d20 0x7f84e41000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f84e41083d0 0x7f84e40ffbb0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 --2- 172.21.15.49:0/3946175651 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f84e4102ae0 0x7f84e40ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 -- 172.21.15.49:0/3946175651 >> 172.21.15.49:0/3946175651 conn(0x7f84e4079760 msgr2=0x7f84e4101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 -- 172.21.15.49:0/3946175651 shutdown_connections 2024-09-21T06:44:24.721 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:24.714+0000 7f84eb579640 1 -- 172.21.15.49:0/3946175651 wait complete. 2024-09-21T06:44:25.508 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:44:25.772 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:25.893 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:25 smithi049 ceph-mon[31177]: pgmap v556: 97 pgs: 97 active+clean; 7.7 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T06:44:26.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:25 smithi098 ceph-mon[34704]: pgmap v556: 97 pgs: 97 active+clean; 7.7 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T06:44:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:25 smithi079 ceph-mon[34346]: pgmap v556: 97 pgs: 97 active+clean; 7.7 MiB data, 403 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T06:44:26.233 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.231+0000 7f5d36da5640 1 -- 172.21.15.49:0/4147619609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d301049b0 msgr2=0x7f5d30104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.231+0000 7f5d36da5640 1 --2- 172.21.15.49:0/4147619609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d301049b0 0x7f5d30104dc0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5d24009900 tx=0x7f5d2402a410 comp rx=0 tx=0).stop 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.231+0000 7f5d36da5640 1 -- 172.21.15.49:0/4147619609 shutdown_connections 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.231+0000 7f5d36da5640 1 --2- 172.21.15.49:0/4147619609 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d3010de10 0x7f5d30110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.231+0000 7f5d36da5640 1 --2- 172.21.15.49:0/4147619609 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d30105300 0x7f5d3010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.231+0000 7f5d36da5640 1 --2- 172.21.15.49:0/4147619609 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d301049b0 0x7f5d30104dc0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.231+0000 7f5d36da5640 1 -- 172.21.15.49:0/4147619609 >> 172.21.15.49:0/4147619609 conn(0x7f5d30079730 msgr2=0x7f5d30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.231+0000 7f5d36da5640 1 -- 172.21.15.49:0/4147619609 shutdown_connections 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.231+0000 7f5d36da5640 1 -- 172.21.15.49:0/4147619609 wait complete. 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.232+0000 7f5d36da5640 1 Processor -- start 2024-09-21T06:44:26.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.232+0000 7f5d36da5640 1 -- start start 2024-09-21T06:44:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.232+0000 7f5d36da5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d301049b0 0x7f5d3019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.232+0000 7f5d36da5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d30105300 0x7f5d3019ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.232+0000 7f5d36da5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d3010de10 0x7f5d3019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.232+0000 7f5d36da5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30113a90 con 0x7f5d30105300 2024-09-21T06:44:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.232+0000 7f5d36da5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30113910 con 0x7f5d3010de10 2024-09-21T06:44:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.232+0000 7f5d36da5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30113c10 con 0x7f5d301049b0 2024-09-21T06:44:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d30105300 0x7f5d3019ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d30105300 0x7f5d3019ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46778/0 (socket says 172.21.15.49:46778) 2024-09-21T06:44:26.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2ffff640 1 -- 172.21.15.49:0/2053080611 learned_addr learned my addr 172.21.15.49:0/2053080611 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d35342640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d3010de10 0x7f5d3019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d34b41640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d301049b0 0x7f5d3019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2ffff640 1 -- 172.21.15.49:0/2053080611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d301049b0 msgr2=0x7f5d3019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d301049b0 0x7f5d3019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2ffff640 1 -- 172.21.15.49:0/2053080611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d3010de10 msgr2=0x7f5d3019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d3010de10 0x7f5d3019fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2ffff640 1 -- 172.21.15.49:0/2053080611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d301a0470 con 0x7f5d30105300 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d35342640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d3010de10 0x7f5d3019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d30105300 0x7f5d3019ab60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00d750 tx=0x7f5d1c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2dffb640 1 -- 172.21.15.49:0/2053080611 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c017070 con 0x7f5d30105300 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d36da5640 1 -- 172.21.15.49:0/2053080611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d301a0760 con 0x7f5d30105300 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2dffb640 1 -- 172.21.15.49:0/2053080611 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d1c0054d0 con 0x7f5d30105300 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.233+0000 7f5d2dffb640 1 -- 172.21.15.49:0/2053080611 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c004c30 con 0x7f5d30105300 2024-09-21T06:44:26.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.234+0000 7f5d36da5640 1 -- 172.21.15.49:0/2053080611 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d301a0c50 con 0x7f5d30105300 2024-09-21T06:44:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.236+0000 7f5d2dffb640 1 -- 172.21.15.49:0/2053080611 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5d1c004dd0 con 0x7f5d30105300 2024-09-21T06:44:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.236+0000 7f5d3d319740 1 Processor -- start 2024-09-21T06:44:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.236+0000 7f5d3d319740 1 -- start start 2024-09-21T06:44:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.236+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f0fffa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f0fffabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f0fffb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d3d319740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555f0ff70ea0 con 0x555f0fc53070 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d3d319740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555f0ff602d0 con 0x555f0fc2a1b0 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d3d319740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f0ff640e0 con 0x555f0fc32390 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d35342640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f0fffa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d35342640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f0fffa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46792/0 (socket says 172.21.15.49:46792) 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d35342640 1 -- 172.21.15.49:0/2887563328 learned_addr learned my addr 172.21.15.49:0/2887563328 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d34b41640 1 --2- 172.21.15.49:0/2887563328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f0fffabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/2887563328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f0fffb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d2dffb640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d200b66b0 0x7f5d200b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d35342640 1 -- 172.21.15.49:0/2887563328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 msgr2=0x555f0fffb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d35342640 1 --2- 172.21.15.49:0/2887563328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f0fffb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d35342640 1 -- 172.21.15.49:0/2887563328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 msgr2=0x555f0fffabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d35342640 1 --2- 172.21.15.49:0/2887563328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f0fffabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d35342640 1 -- 172.21.15.49:0/2887563328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0fcbe650 con 0x555f0fc53070 2024-09-21T06:44:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d2dffb640 1 -- 172.21.15.49:0/2053080611 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f5d1c0e7220 con 0x7f5d30105300 2024-09-21T06:44:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.237+0000 7f5d35342640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d200b66b0 0x7f5d200b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.238+0000 7f5d35342640 1 --2- 172.21.15.49:0/2887563328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f0fffa6a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007e60 tx=0x7f5d2800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ec3e671c3c8a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.238+0000 7f5d1affd640 1 -- 172.21.15.49:0/2887563328 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28014070 con 0x555f0fc53070 2024-09-21T06:44:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.238+0000 7f5d1affd640 1 -- 172.21.15.49:0/2887563328 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d28010c60 con 0x555f0fc53070 2024-09-21T06:44:26.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.238+0000 7f5d1affd640 1 -- 172.21.15.49:0/2887563328 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d280197d0 con 0x555f0fc53070 2024-09-21T06:44:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 -- 172.21.15.49:0/2887563328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 msgr2=0x555f0fffa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2887563328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f0fffa6a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007e60 tx=0x7f5d2800e720 comp rx=0 tx=0).stop 2024-09-21T06:44:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d35342640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d200b66b0 0x7f5d200b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007fd0 tx=0x7f5d28019e20 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 -- 172.21.15.49:0/2887563328 shutdown_connections 2024-09-21T06:44:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2887563328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f0fffb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2887563328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f0fffabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2887563328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f0fffa6a0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 -- 172.21.15.49:0/2887563328 >> 172.21.15.49:0/2887563328 conn(0x555f0fc47460 msgr2=0x555f0fff8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 -- 172.21.15.49:0/2887563328 shutdown_connections 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 -- 172.21.15.49:0/2887563328 wait complete. 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 -- start start 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.239+0000 7f5d3d319740 1 Processor -- start 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f1000a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f1000a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f100164e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d3d319740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555f0fdc1700 con 0x555f0fc53070 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d3d319740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555f0fefb160 con 0x555f0fc2a1b0 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d3d319740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555f1000d1b0 con 0x555f0fc32390 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d3d319740 10 client.0 _ll_register_callbacks cb 0x555f0ff149e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d35342640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f100164e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d35342640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f100164e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46802/0 (socket says 172.21.15.49:46802) 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d35342640 1 -- 172.21.15.49:0/1170778979 learned_addr learned my addr 172.21.15.49:0/1170778979 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:26.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d34b41640 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f1000a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.240+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f1000a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d35342640 1 -- 172.21.15.49:0/1170778979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 msgr2=0x555f1000a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d35342640 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f1000a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d35342640 1 -- 172.21.15.49:0/1170778979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 msgr2=0x555f1000a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d35342640 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f1000a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d35342640 1 -- 172.21.15.49:0/1170778979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0ff28c90 con 0x555f0fc53070 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d35342640 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f100164e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5d28005c70 tx=0x7f5d28014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f74d9b3232e8cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d0ffff640 1 -- 172.21.15.49:0/1170778979 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28035060 con 0x555f0fc53070 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d0ffff640 1 -- 172.21.15.49:0/1170778979 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f5d28019450 con 0x555f0fc53070 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d3d319740 1 -- 172.21.15.49:0/1170778979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d28010c60 con 0x555f0fc53070 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d0ffff640 1 -- 172.21.15.49:0/1170778979 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d28010e10 con 0x555f0fc53070 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d3d319740 10 client.17424 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d3d319740 1 -- 172.21.15.49:0/1170778979 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555f10018ed0 con 0x555f0fc53070 2024-09-21T06:44:26.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.241+0000 7f5d0ffff640 1 -- 172.21.15.49:0/1170778979 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d28010c60 con 0x555f0fc53070 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d0ffff640 1 -- 172.21.15.49:0/1170778979 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5d2802f070 con 0x555f0fc53070 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d3d319740 10 client.17424 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d3d319740 10 client.17424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d3d319740 20 client.17424 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d3d319740 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555f0fc119f0 0x555f1001c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d3d319740 4 client.17424 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d3d319740 1 -- 172.21.15.49:0/1170778979 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f0ff72df0 con 0x555f0fc119f0 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d34b41640 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555f0fc119f0 0x555f1001c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d34b41640 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555f0fc119f0 0x555f1001c2f0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f97f76205855c72 server_cookie=b1d399f6aef66859 in_seq=0 out_seq=0 2024-09-21T06:44:26.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.242+0000 7f5d0ffff640 10 client.17424 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:26.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d0ffff640 1 -- 172.21.15.49:0/1170778979 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555f0ff72df0 con 0x555f0fc119f0 2024-09-21T06:44:26.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d0ffff640 10 client.17424 handle_command_reply: tid=0 2024-09-21T06:44:26.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d3d319740 1 client.17424 shutdown 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d3d319740 1 -- 172.21.15.49:0/1170778979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 msgr2=0x555f100164e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d3d319740 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f100164e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5d28005c70 tx=0x7f5d28014000 comp rx=0 tx=0).stop 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d3d319740 1 -- 172.21.15.49:0/1170778979 shutdown_connections 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d3d319740 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555f0fc119f0 0x555f1001c2f0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d3d319740 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f100164e0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d3d319740 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f1000a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d3d319740 1 --2- 172.21.15.49:0/1170778979 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f1000a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.243+0000 7f5d0ffff640 0 client.17424 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.244+0000 7f5d3d319740 1 -- 172.21.15.49:0/1170778979 >> 172.21.15.49:0/1170778979 conn(0x555f0fc47460 msgr2=0x555f0fff6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.244+0000 7f5d3d319740 1 -- 172.21.15.49:0/1170778979 shutdown_connections 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.244+0000 7f5d3d319740 1 -- 172.21.15.49:0/1170778979 wait complete. 2024-09-21T06:44:26.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.244+0000 7f5d3d319740 20 client.17424 trim_cache size 0 max 16384 2024-09-21T06:44:26.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d3d319740 1 Processor -- start 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d3d319740 1 -- start start 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc2a1b0 0x555f1000c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc32390 0x555f0fffbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc53070 0x555f100163e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d3d319740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301affc0 con 0x555f0fc32390 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d3d319740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301ad890 con 0x555f0fc53070 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d3d319740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301ab700 con 0x555f0fc2a1b0 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc32390 0x555f0fffbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc32390 0x555f0fffbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46814/0 (socket says 172.21.15.49:46814) 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.257+0000 7f5d2ffff640 1 -- 172.21.15.49:0/242311562 learned_addr learned my addr 172.21.15.49:0/242311562 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d34b41640 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc2a1b0 0x555f1000c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d35342640 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc53070 0x555f100163e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d2ffff640 1 -- 172.21.15.49:0/242311562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc2a1b0 msgr2=0x555f1000c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc2a1b0 0x555f1000c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d2ffff640 1 -- 172.21.15.49:0/242311562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc53070 msgr2=0x555f100163e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc53070 0x555f100163e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d2ffff640 1 -- 172.21.15.49:0/242311562 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0fffcbc0 con 0x555f0fc32390 2024-09-21T06:44:26.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d35342640 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc53070 0x555f100163e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:26.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc32390 0x555f0fffbde0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0a95f0 tx=0x7f5d1c0a97a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa51e22d426c7c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d1a7fc640 1 -- 172.21.15.49:0/242311562 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c020040 con 0x555f0fc32390 2024-09-21T06:44:26.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d1a7fc640 1 -- 172.21.15.49:0/242311562 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d1c0acb30 con 0x555f0fc32390 2024-09-21T06:44:26.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.258+0000 7f5d1a7fc640 1 -- 172.21.15.49:0/242311562 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0c2040 con 0x555f0fc32390 2024-09-21T06:44:26.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 -- 172.21.15.49:0/242311562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc32390 msgr2=0x555f0fffbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc32390 0x555f0fffbde0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0a95f0 tx=0x7f5d1c0a97a0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 -- 172.21.15.49:0/242311562 shutdown_connections 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc53070 0x555f100163e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc32390 0x555f0fffbde0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 --2- 172.21.15.49:0/242311562 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc2a1b0 0x555f1000c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 -- 172.21.15.49:0/242311562 >> 172.21.15.49:0/242311562 conn(0x555f0fc47460 msgr2=0x555f0fffb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 -- 172.21.15.49:0/242311562 shutdown_connections 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 -- 172.21.15.49:0/242311562 wait complete. 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.259+0000 7f5d3d319740 1 -- start start 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d3d319740 1 Processor -- start 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f10010bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f10011130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d3d319740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f10085ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d3d319740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301abd50 con 0x555f0fc53070 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d3d319740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301ad1c0 con 0x555f0fc2a1b0 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d3d319740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301ac420 con 0x555f0fc32390 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d3d319740 10 client.0 _ll_register_callbacks cb 0x7f5d24009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d35342640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f10085ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d35342640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f10085ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46816/0 (socket says 172.21.15.49:46816) 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d35342640 1 -- 172.21.15.49:0/2787685593 learned_addr learned my addr 172.21.15.49:0/2787685593 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f10011130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.260+0000 7f5d34b41640 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f10010bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d35342640 1 -- 172.21.15.49:0/2787685593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 msgr2=0x555f10011130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d35342640 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f10011130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d35342640 1 -- 172.21.15.49:0/2787685593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 msgr2=0x555f10010bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d35342640 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f10010bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d35342640 1 -- 172.21.15.49:0/2787685593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f10086160 con 0x555f0fc53070 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d2ffff640 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f10011130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:26.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d35342640 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f10085ba0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800f790 tx=0x7f5d280075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acdbf9248821777 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d0ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d0ffff640 1 -- 172.21.15.49:0/2787685593 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d28035070 con 0x555f0fc53070 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d0ffff640 1 -- 172.21.15.49:0/2787685593 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f5d280195f0 con 0x555f0fc53070 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d3d319740 1 -- 172.21.15.49:0/2787685593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d1c0acb30 con 0x555f0fc53070 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d0ffff640 1 -- 172.21.15.49:0/2787685593 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d2800ec20 con 0x555f0fc53070 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d3d319740 10 client.17430 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d3d319740 1 -- 172.21.15.49:0/2787685593 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555f10087350 con 0x555f0fc53070 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.261+0000 7f5d0ffff640 1 -- 172.21.15.49:0/2787685593 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d1c0acb30 con 0x555f0fc53070 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d0ffff640 1 -- 172.21.15.49:0/2787685593 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5d2803f020 con 0x555f0fc53070 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d3d319740 10 client.17430 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d3d319740 10 client.17430 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d3d319740 20 client.17430 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555f0fbe6da0 0x555f10089ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.267 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d3d319740 4 client.17430 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d3d319740 1 -- 172.21.15.49:0/2787685593 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555f0ff6e8a0 con 0x555f0fbe6da0 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d34b41640 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555f0fbe6da0 0x555f10089ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d34b41640 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555f0fbe6da0 0x555f10089ab0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c519d1652fc477b server_cookie=70413377d0310414 in_seq=0 out_seq=0 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.262+0000 7f5d0ffff640 10 client.17430 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d0ffff640 1 -- 172.21.15.49:0/2787685593 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555f0ff6e8a0 con 0x555f0fbe6da0 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d0ffff640 10 client.17430 handle_command_reply: tid=0 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 client.17430 shutdown 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 -- 172.21.15.49:0/2787685593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 msgr2=0x555f10085ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f10085ba0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800f790 tx=0x7f5d280075a0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 -- 172.21.15.49:0/2787685593 shutdown_connections 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555f0fbe6da0 0x555f10089ab0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555f0fc53070 0x555f10085ba0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555f0fc32390 0x555f10011130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 --2- 172.21.15.49:0/2787685593 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555f0fc2a1b0 0x555f10010bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d0ffff640 0 client.17430 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:26.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 -- 172.21.15.49:0/2787685593 >> 172.21.15.49:0/2787685593 conn(0x555f0fc47460 msgr2=0x555f1000bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 -- 172.21.15.49:0/2787685593 shutdown_connections 2024-09-21T06:44:26.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 1 -- 172.21.15.49:0/2787685593 wait complete. 2024-09-21T06:44:26.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.263+0000 7f5d3d319740 20 client.17430 trim_cache size 0 max 16384 2024-09-21T06:44:26.269 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:44:26.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 -- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d200b66b0 msgr2=0x7f5d200b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d200b66b0 0x7f5d200b8bc0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5d28007fd0 tx=0x7f5d28019e20 comp rx=0 tx=0).stop 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 -- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d30105300 msgr2=0x7f5d3019ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d30105300 0x7f5d3019ab60 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00d750 tx=0x7f5d1c00dc10 comp rx=0 tx=0).stop 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 -- 172.21.15.49:0/2053080611 shutdown_connections 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d200b66b0 0x7f5d200b8bc0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d3010de10 0x7f5d3019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d30105300 0x7f5d3019ab60 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 --2- 172.21.15.49:0/2053080611 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d301049b0 0x7f5d3019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 -- 172.21.15.49:0/2053080611 >> 172.21.15.49:0/2053080611 conn(0x7f5d30079730 msgr2=0x7f5d301008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 -- 172.21.15.49:0/2053080611 shutdown_connections 2024-09-21T06:44:26.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:26.264+0000 7f5d36da5640 1 -- 172.21.15.49:0/2053080611 wait complete. 2024-09-21T06:44:27.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:27 smithi049 ceph-mon[31177]: pgmap v557: 97 pgs: 97 active+clean; 7.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:44:27.974 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:44:27.974 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:44:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:27 smithi098 ceph-mon[34704]: pgmap v557: 97 pgs: 97 active+clean; 7.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:44:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:27 smithi079 ceph-mon[34346]: pgmap v557: 97 pgs: 97 active+clean; 7.7 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:44:28.245 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.699+0000 7fb556c21640 1 -- 172.21.15.49:0/4264643407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5501083d0 msgr2=0x7fb5501087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.699+0000 7fb556c21640 1 --2- 172.21.15.49:0/4264643407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5501083d0 0x7fb5501087e0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fb53c009900 tx=0x7fb53c02a410 comp rx=0 tx=0).stop 2024-09-21T06:44:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.699+0000 7fb556c21640 1 -- 172.21.15.49:0/4264643407 shutdown_connections 2024-09-21T06:44:28.701 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.699+0000 7fb556c21640 1 --2- 172.21.15.49:0/4264643407 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb550108d20 0x7fb55010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.699+0000 7fb556c21640 1 --2- 172.21.15.49:0/4264643407 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb5501083d0 0x7fb5501087e0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.699+0000 7fb556c21640 1 --2- 172.21.15.49:0/4264643407 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb550102ae0 0x7fb550102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.699+0000 7fb556c21640 1 -- 172.21.15.49:0/4264643407 >> 172.21.15.49:0/4264643407 conn(0x7fb550079760 msgr2=0x7fb550079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.699+0000 7fb556c21640 1 -- 172.21.15.49:0/4264643407 shutdown_connections 2024-09-21T06:44:28.702 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.699+0000 7fb556c21640 1 -- 172.21.15.49:0/4264643407 wait complete. 2024-09-21T06:44:28.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.700+0000 7fb556c21640 1 Processor -- start 2024-09-21T06:44:28.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.700+0000 7fb556c21640 1 -- start start 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.700+0000 7fb556c21640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb550102ae0 0x7fb55019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.700+0000 7fb556c21640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5501083d0 0x7fb55019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.700+0000 7fb556c21640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550108d20 0x7fb55019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.700+0000 7fb556c21640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb550112990 con 0x7fb550108d20 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.700+0000 7fb556c21640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb550112810 con 0x7fb550102ae0 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.700+0000 7fb556c21640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb550112b10 con 0x7fb5501083d0 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5551be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550108d20 0x7fb55019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5551be640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550108d20 0x7fb55019fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46826/0 (socket says 172.21.15.49:46826) 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5551be640 1 -- 172.21.15.49:0/700816806 learned_addr learned my addr 172.21.15.49:0/700816806 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5549bd640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb550102ae0 0x7fb55019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb54ffff640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5501083d0 0x7fb55019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5551be640 1 -- 172.21.15.49:0/700816806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5501083d0 msgr2=0x7fb55019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5551be640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5501083d0 0x7fb55019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5551be640 1 -- 172.21.15.49:0/700816806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb550102ae0 msgr2=0x7fb55019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5551be640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb550102ae0 0x7fb55019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5551be640 1 -- 172.21.15.49:0/700816806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5501a0420 con 0x7fb550108d20 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5549bd640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb550102ae0 0x7fb55019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb54ffff640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5501083d0 0x7fb55019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb5551be640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550108d20 0x7fb55019fcf0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb54800eaa0 tx=0x7fb54800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb54dffb640 1 -- 172.21.15.49:0/700816806 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54800cdb0 con 0x7fb550108d20 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb54dffb640 1 -- 172.21.15.49:0/700816806 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb548005020 con 0x7fb550108d20 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb556c21640 1 -- 172.21.15.49:0/700816806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5501a0710 con 0x7fb550108d20 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.701+0000 7fb54dffb640 1 -- 172.21.15.49:0/700816806 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5480116d0 con 0x7fb550108d20 2024-09-21T06:44:28.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.702+0000 7fb556c21640 1 -- 172.21.15.49:0/700816806 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5501a6e70 con 0x7fb550108d20 2024-09-21T06:44:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.704+0000 7fb55d195740 1 Processor -- start 2024-09-21T06:44:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.704+0000 7fb54dffb640 1 -- 172.21.15.49:0/700816806 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fb5480051d0 con 0x7fb550108d20 2024-09-21T06:44:28.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.704+0000 7fb55d195740 1 -- start start 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb55d195740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7330350 0x5620e76d7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb55d195740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76d7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb55d195740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e730f670 0x5620e76d7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb55d195740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5620e764de60 con 0x5620e7307490 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb55d195740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5620e763d290 con 0x5620e7330350 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb55d195740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5620e76410a0 con 0x5620e730f670 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb5549bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76d7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb5549bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76d7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46838/0 (socket says 172.21.15.49:46838) 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb5549bd640 1 -- 172.21.15.49:0/3170516385 learned_addr learned my addr 172.21.15.49:0/3170516385 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb54ffff640 1 --2- 172.21.15.49:0/3170516385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e730f670 0x5620e76d7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb54ffff640 1 --2- 172.21.15.49:0/3170516385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7330350 0x5620e76d7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb5549bd640 1 -- 172.21.15.49:0/3170516385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e730f670 msgr2=0x5620e76d7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:28.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb5549bd640 1 --2- 172.21.15.49:0/3170516385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e730f670 0x5620e76d7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb5549bd640 1 -- 172.21.15.49:0/3170516385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7330350 msgr2=0x5620e76d7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb5549bd640 1 --2- 172.21.15.49:0/3170516385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7330350 0x5620e76d7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb54dffb640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb5400b6680 0x7fb5400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb5549bd640 1 -- 172.21.15.49:0/3170516385 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620e739b930 con 0x5620e7307490 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.705+0000 7fb5551be640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb5400b6680 0x7fb5400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.706+0000 7fb5549bd640 1 --2- 172.21.15.49:0/3170516385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76d7970 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb54400bd40 tx=0x7fb54400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d169bda1a4a4c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.706+0000 7fb54dffb640 1 -- 172.21.15.49:0/700816806 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fb5480e7990 con 0x7fb550108d20 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.706+0000 7fb53affd640 1 -- 172.21.15.49:0/3170516385 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544015070 con 0x5620e7307490 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.706+0000 7fb53affd640 1 -- 172.21.15.49:0/3170516385 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb54400be30 con 0x5620e7307490 2024-09-21T06:44:28.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.706+0000 7fb53affd640 1 -- 172.21.15.49:0/3170516385 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544011980 con 0x5620e7307490 2024-09-21T06:44:28.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 -- 172.21.15.49:0/3170516385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 msgr2=0x5620e76d7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 --2- 172.21.15.49:0/3170516385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76d7970 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fb54400bd40 tx=0x7fb54400f730 comp rx=0 tx=0).stop 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb5551be640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb5400b6680 0x7fb5400b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5480e5140 tx=0x7fb54807a440 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 -- 172.21.15.49:0/3170516385 shutdown_connections 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 --2- 172.21.15.49:0/3170516385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e730f670 0x5620e76d7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 --2- 172.21.15.49:0/3170516385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76d7970 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 --2- 172.21.15.49:0/3170516385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7330350 0x5620e76d7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 -- 172.21.15.49:0/3170516385 >> 172.21.15.49:0/3170516385 conn(0x5620e7324740 msgr2=0x5620e76d5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 -- 172.21.15.49:0/3170516385 shutdown_connections 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 -- 172.21.15.49:0/3170516385 wait complete. 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 -- start start 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.707+0000 7fb55d195740 1 Processor -- start 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb55d195740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7307490 0x5620e76e3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb55d195740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e730f670 0x5620e76e3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb55d195740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7330350 0x5620e76eef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb55d195740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5620e749e890 con 0x5620e730f670 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb55d195740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5620e75d7d40 con 0x5620e7307490 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb55d195740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5620e76e5c10 con 0x5620e7330350 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb55d195740 10 client.0 _ll_register_callbacks cb 0x5620e763bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb5549bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e730f670 0x5620e76e3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb5549bd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e730f670 0x5620e76e3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46840/0 (socket says 172.21.15.49:46840) 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb5549bd640 1 -- 172.21.15.49:0/694323897 learned_addr learned my addr 172.21.15.49:0/694323897 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb54ffff640 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7307490 0x5620e76e3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb54ffff640 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7330350 0x5620e76eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb5549bd640 1 -- 172.21.15.49:0/694323897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7330350 msgr2=0x5620e76eef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb5549bd640 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7330350 0x5620e76eef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.715 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb5549bd640 1 -- 172.21.15.49:0/694323897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7307490 msgr2=0x5620e76e3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb5549bd640 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7307490 0x5620e76e3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb5549bd640 1 -- 172.21.15.49:0/694323897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620e76ef4c0 con 0x5620e730f670 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb54ffff640 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7330350 0x5620e76eef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb5549bd640 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e730f670 0x5620e76e3540 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb544006010 tx=0x7fb54400bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df639d490c4b8961 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.708+0000 7fb52ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb52ffff640 1 -- 172.21.15.49:0/694323897 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544027020 con 0x5620e730f670 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb52ffff640 1 -- 172.21.15.49:0/694323897 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fb5440054d0 con 0x5620e730f670 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb55d195740 1 -- 172.21.15.49:0/694323897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb54400be30 con 0x5620e730f670 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb52ffff640 1 -- 172.21.15.49:0/694323897 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb54402f050 con 0x5620e730f670 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb55d195740 10 client.17442 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb55d195740 1 -- 172.21.15.49:0/694323897 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5620e76f1dd0 con 0x5620e730f670 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb52ffff640 1 -- 172.21.15.49:0/694323897 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb54400be30 con 0x5620e730f670 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb52ffff640 1 -- 172.21.15.49:0/694323897 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb544022070 con 0x5620e730f670 2024-09-21T06:44:28.716 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb55d195740 10 client.17442 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb55d195740 10 client.17442 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb55d195740 20 client.17442 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb55d195740 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5620e72eecd0 0x5620e76f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb55d195740 4 client.17442 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.709+0000 7fb55d195740 1 -- 172.21.15.49:0/694323897 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620e764fdb0 con 0x5620e72eecd0 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.710+0000 7fb54ffff640 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5620e72eecd0 0x5620e76f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.710+0000 7fb54ffff640 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5620e72eecd0 0x5620e76f51e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dffef51937225c20 server_cookie=c73e6c3a097053a1 in_seq=0 out_seq=0 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.710+0000 7fb52ffff640 10 client.17442 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb52ffff640 1 -- 172.21.15.49:0/694323897 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620e764fdb0 con 0x5620e72eecd0 2024-09-21T06:44:28.717 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb52ffff640 10 client.17442 handle_command_reply: tid=0 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb55d195740 1 client.17442 shutdown 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb55d195740 1 -- 172.21.15.49:0/694323897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e730f670 msgr2=0x5620e76e3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb55d195740 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e730f670 0x5620e76e3540 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fb544006010 tx=0x7fb54400bab0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb55d195740 1 -- 172.21.15.49:0/694323897 shutdown_connections 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb55d195740 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5620e72eecd0 0x5620e76f51e0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb52ffff640 0 client.17442 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb55d195740 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7330350 0x5620e76eef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb55d195740 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e730f670 0x5620e76e3540 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb55d195740 1 --2- 172.21.15.49:0/694323897 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7307490 0x5620e76e3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.711+0000 7fb55d195740 1 -- 172.21.15.49:0/694323897 >> 172.21.15.49:0/694323897 conn(0x5620e7324740 msgr2=0x5620e76da5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.712+0000 7fb55d195740 1 -- 172.21.15.49:0/694323897 shutdown_connections 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.712+0000 7fb55d195740 1 -- 172.21.15.49:0/694323897 wait complete. 2024-09-21T06:44:28.718 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.712+0000 7fb55d195740 20 client.17442 trim_cache size 0 max 16384 2024-09-21T06:44:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.729+0000 7fb55d195740 1 Processor -- start 2024-09-21T06:44:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.729+0000 7fb55d195740 1 -- start start 2024-09-21T06:44:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb55d195740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7324740 0x5620e76eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb55d195740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e72eecd0 0x5620e76dd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb55d195740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76f8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb55d195740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501b2220 con 0x5620e7307490 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb55d195740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501afaf0 con 0x5620e7324740 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb55d195740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501ad960 con 0x5620e72eecd0 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46844/0 (socket says 172.21.15.49:46844) 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 -- 172.21.15.49:0/2935103623 learned_addr learned my addr 172.21.15.49:0/2935103623 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb5549bd640 1 --2- 172.21.15.49:0/2935103623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e72eecd0 0x5620e76dd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 --2- 172.21.15.49:0/2935103623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7324740 0x5620e76eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 -- 172.21.15.49:0/2935103623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e72eecd0 msgr2=0x5620e76dd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 --2- 172.21.15.49:0/2935103623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e72eecd0 0x5620e76dd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 -- 172.21.15.49:0/2935103623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7324740 msgr2=0x5620e76eeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 --2- 172.21.15.49:0/2935103623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7324740 0x5620e76eeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 -- 172.21.15.49:0/2935103623 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620e76e40c0 con 0x5620e7307490 2024-09-21T06:44:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.730+0000 7fb54ffff640 1 --2- 172.21.15.49:0/2935103623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76f8200 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb53c031440 tx=0x7fb53c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ec423a34328ca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.731+0000 7fb53a7fc640 1 -- 172.21.15.49:0/2935103623 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c035040 con 0x5620e7307490 2024-09-21T06:44:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.731+0000 7fb53a7fc640 1 -- 172.21.15.49:0/2935103623 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb53c031cf0 con 0x5620e7307490 2024-09-21T06:44:28.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.731+0000 7fb53a7fc640 1 -- 172.21.15.49:0/2935103623 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0327e0 con 0x5620e7307490 2024-09-21T06:44:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.731+0000 7fb55d195740 1 -- 172.21.15.49:0/2935103623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 msgr2=0x5620e76f8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.731+0000 7fb55d195740 1 --2- 172.21.15.49:0/2935103623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76f8200 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fb53c031440 tx=0x7fb53c009260 comp rx=0 tx=0).stop 2024-09-21T06:44:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.732+0000 7fb55d195740 1 -- 172.21.15.49:0/2935103623 shutdown_connections 2024-09-21T06:44:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.732+0000 7fb55d195740 1 --2- 172.21.15.49:0/2935103623 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7307490 0x5620e76f8200 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.732+0000 7fb55d195740 1 --2- 172.21.15.49:0/2935103623 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e72eecd0 0x5620e76dd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.732+0000 7fb55d195740 1 --2- 172.21.15.49:0/2935103623 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e7324740 0x5620e76eeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.732+0000 7fb55d195740 1 -- 172.21.15.49:0/2935103623 >> 172.21.15.49:0/2935103623 conn(0x5620e76d53c0 msgr2=0x5620e76e1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:28.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.732+0000 7fb55d195740 1 -- 172.21.15.49:0/2935103623 shutdown_connections 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.732+0000 7fb55d195740 1 -- 172.21.15.49:0/2935103623 wait complete. 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.732+0000 7fb55d195740 1 -- start start 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.732+0000 7fb55d195740 1 Processor -- start 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb55d195740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e72eecd0 0x5620e76f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb55d195740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7307490 0x5620e76f7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb55d195740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7324740 0x5620e7758930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb55d195740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501adfb0 con 0x5620e7324740 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb55d195740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501af420 con 0x5620e72eecd0 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb55d195740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501ae680 con 0x5620e7307490 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb55d195740 10 client.0 _ll_register_callbacks cb 0x7fb53c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7324740 0x5620e7758930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7324740 0x5620e7758930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46850/0 (socket says 172.21.15.49:46850) 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 -- 172.21.15.49:0/475697044 learned_addr learned my addr 172.21.15.49:0/475697044 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:28.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb5549bd640 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7307490 0x5620e76f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e72eecd0 0x5620e76f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 -- 172.21.15.49:0/475697044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7307490 msgr2=0x5620e76f7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7307490 0x5620e76f7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 -- 172.21.15.49:0/475697044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e72eecd0 msgr2=0x5620e76f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e72eecd0 0x5620e76f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 -- 172.21.15.49:0/475697044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620e7758fa0 con 0x5620e7324740 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb54ffff640 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7324740 0x5620e7758930 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005f70 tx=0x7fb53c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f29c4ff62090c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb52ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.733+0000 7fb52ffff640 1 -- 172.21.15.49:0/475697044 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53c035040 con 0x5620e7324740 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb52ffff640 1 -- 172.21.15.49:0/475697044 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fb53c032870 con 0x5620e7324740 2024-09-21T06:44:28.739 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb55d195740 1 -- 172.21.15.49:0/475697044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb53c031cf0 con 0x5620e7324740 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb52ffff640 1 -- 172.21.15.49:0/475697044 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb53c032000 con 0x5620e7324740 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb55d195740 10 client.17448 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb55d195740 1 -- 172.21.15.49:0/475697044 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5620e7760320 con 0x5620e7324740 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb52ffff640 1 -- 172.21.15.49:0/475697044 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb53c031cf0 con 0x5620e7324740 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb52ffff640 1 -- 172.21.15.49:0/475697044 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fb53c03a040 con 0x5620e7324740 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb55d195740 10 client.17448 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb55d195740 10 client.17448 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb55d195740 20 client.17448 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb55d195740 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5620e730f670 0x5620e7762a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb55d195740 4 client.17448 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.734+0000 7fb55d195740 1 -- 172.21.15.49:0/475697044 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5620e764b860 con 0x5620e730f670 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.735+0000 7fb5549bd640 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5620e730f670 0x5620e7762a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.735+0000 7fb5549bd640 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5620e730f670 0x5620e7762a80 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49366c53032b1ab0 server_cookie=2b498e0a26f2dc97 in_seq=0 out_seq=0 2024-09-21T06:44:28.740 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.735+0000 7fb52ffff640 10 client.17448 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:28.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb52ffff640 1 -- 172.21.15.49:0/475697044 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5620e764b860 con 0x5620e730f670 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb52ffff640 10 client.17448 handle_command_reply: tid=0 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 client.17448 shutdown 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 -- 172.21.15.49:0/475697044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7324740 msgr2=0x5620e7758930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7324740 0x5620e7758930 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fb53c005f70 tx=0x7fb53c0095c0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 -- 172.21.15.49:0/475697044 shutdown_connections 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5620e730f670 0x5620e7762a80 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5620e7324740 0x5620e7758930 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5620e7307490 0x5620e76f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 --2- 172.21.15.49:0/475697044 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5620e72eecd0 0x5620e76f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 -- 172.21.15.49:0/475697044 >> 172.21.15.49:0/475697044 conn(0x5620e76d53c0 msgr2=0x5620e76e4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb52ffff640 0 client.17448 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 -- 172.21.15.49:0/475697044 shutdown_connections 2024-09-21T06:44:28.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 1 -- 172.21.15.49:0/475697044 wait complete. 2024-09-21T06:44:28.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.737+0000 7fb55d195740 20 client.17448 trim_cache size 0 max 16384 2024-09-21T06:44:28.743 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:44:28.743 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:44:28.743 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "20658a62-3597-419e-8e53-a67d667c8a2e", 2024-09-21T06:44:28.743 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:44:28.743 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 -- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb5400b6680 msgr2=0x7fb5400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb5400b6680 0x7fb5400b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fb5480e5140 tx=0x7fb54807a440 comp rx=0 tx=0).stop 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 -- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550108d20 msgr2=0x7fb55019fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550108d20 0x7fb55019fcf0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fb54800eaa0 tx=0x7fb54800ef60 comp rx=0 tx=0).stop 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 -- 172.21.15.49:0/700816806 shutdown_connections 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb5400b6680 0x7fb5400b8b90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb550108d20 0x7fb55019fcf0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb5501083d0 0x7fb55019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 --2- 172.21.15.49:0/700816806 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb550102ae0 0x7fb55019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 -- 172.21.15.49:0/700816806 >> 172.21.15.49:0/700816806 conn(0x7fb550079760 msgr2=0x7fb55006bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:28.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 -- 172.21.15.49:0/700816806 shutdown_connections 2024-09-21T06:44:28.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:28.738+0000 7fb556c21640 1 -- 172.21.15.49:0/700816806 wait complete. 2024-09-21T06:44:29.498 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:44:29.756 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:29.953 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:29 smithi049 ceph-mon[31177]: pgmap v558: 97 pgs: 97 active+clean; 7.8 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:44:29.953 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:29 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:44:29.954 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:29 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:29.954 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:29 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:44:29.954 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:29 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:44:29.954 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:29 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:29.954 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:29 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:30.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:29 smithi098 ceph-mon[34704]: pgmap v558: 97 pgs: 97 active+clean; 7.8 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:44:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:29 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:44:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:29 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:29 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:44:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:29 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:44:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:29 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:30.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:29 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:29 smithi079 ceph-mon[34346]: pgmap v558: 97 pgs: 97 active+clean; 7.8 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:44:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:29 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:44:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:29 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:29 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:44:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:29 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:44:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:29 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:30.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:29 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.274+0000 7fa99ba45640 1 -- 172.21.15.49:0/1707070385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa994109e10 msgr2=0x7fa994110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.274+0000 7fa99ba45640 1 --2- 172.21.15.49:0/1707070385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa994109e10 0x7fa994110640 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009ca0 tx=0x7fa98c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.274+0000 7fa99ba45640 1 -- 172.21.15.49:0/1707070385 shutdown_connections 2024-09-21T06:44:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.274+0000 7fa99ba45640 1 --2- 172.21.15.49:0/1707070385 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa994109e10 0x7fa994110640 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.274+0000 7fa99ba45640 1 --2- 172.21.15.49:0/1707070385 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa9941094c0 0x7fa9941098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.274+0000 7fa99ba45640 1 --2- 172.21.15.49:0/1707070385 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994103b80 0x7fa994103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.274+0000 7fa99ba45640 1 -- 172.21.15.49:0/1707070385 >> 172.21.15.49:0/1707070385 conn(0x7fa9940ff610 msgr2=0x7fa994101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:30.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.274+0000 7fa99ba45640 1 -- 172.21.15.49:0/1707070385 shutdown_connections 2024-09-21T06:44:30.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.274+0000 7fa99ba45640 1 -- 172.21.15.49:0/1707070385 wait complete. 2024-09-21T06:44:30.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.275+0000 7fa99ba45640 1 Processor -- start 2024-09-21T06:44:30.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.275+0000 7fa99ba45640 1 -- start start 2024-09-21T06:44:30.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.275+0000 7fa99ba45640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994103b80 0x7fa994075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa99ba45640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9941094c0 0x7fa994075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa99ba45640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa994109e10 0x7fa994076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa99ba45640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa994113ad0 con 0x7fa9941094c0 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa99ba45640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa994113950 con 0x7fa994103b80 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa99ba45640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa994113c50 con 0x7fa994109e10 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa9997e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994103b80 0x7fa994075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa998fe0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9941094c0 0x7fa994075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa9997e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994103b80 0x7fa994075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:49630/0 (socket says 172.21.15.49:49630) 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa998fe0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9941094c0 0x7fa994075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46868/0 (socket says 172.21.15.49:46868) 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa9997e1640 1 -- 172.21.15.49:0/2149005046 learned_addr learned my addr 172.21.15.49:0/2149005046 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa999fe2640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa994109e10 0x7fa994076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa998fe0640 1 -- 172.21.15.49:0/2149005046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa994109e10 msgr2=0x7fa994076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa998fe0640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa994109e10 0x7fa994076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa998fe0640 1 -- 172.21.15.49:0/2149005046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994103b80 msgr2=0x7fa994075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:30.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa998fe0640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994103b80 0x7fa994075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa998fe0640 1 -- 172.21.15.49:0/2149005046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9941a8650 con 0x7fa9941094c0 2024-09-21T06:44:30.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.276+0000 7fa998fe0640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9941094c0 0x7fa994075c50 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa99406a800 tx=0x7fa98400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:30.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.277+0000 7fa98a7fc640 1 -- 172.21.15.49:0/2149005046 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984017070 con 0x7fa9941094c0 2024-09-21T06:44:30.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.277+0000 7fa98a7fc640 1 -- 172.21.15.49:0/2149005046 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9840099a0 con 0x7fa9941094c0 2024-09-21T06:44:30.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.277+0000 7fa99ba45640 1 -- 172.21.15.49:0/2149005046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9941a8940 con 0x7fa9941094c0 2024-09-21T06:44:30.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.277+0000 7fa98a7fc640 1 -- 172.21.15.49:0/2149005046 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9840047a0 con 0x7fa9941094c0 2024-09-21T06:44:30.280 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.277+0000 7fa99ba45640 1 -- 172.21.15.49:0/2149005046 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9941a8e30 con 0x7fa9941094c0 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa9a1fb9740 1 Processor -- start 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa98a7fc640 1 -- 172.21.15.49:0/2149005046 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fa984004940 con 0x7fa9941094c0 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa9a1fb9740 1 -- start start 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef0a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef0ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef0b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f38ee80e50 con 0x55f38eb63070 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f38ee70280 con 0x55f38eb3a1b0 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f38ee74090 con 0x55f38eb42390 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa999fe2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef0a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.283 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa999fe2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef0a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46882/0 (socket says 172.21.15.49:46882) 2024-09-21T06:44:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa999fe2640 1 -- 172.21.15.49:0/1727008421 learned_addr learned my addr 172.21.15.49:0/1727008421 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa9997e1640 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef0ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.280+0000 7fa998fe0640 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef0b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa999fe2640 1 -- 172.21.15.49:0/1727008421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 msgr2=0x55f38ef0b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa999fe2640 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef0b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa999fe2640 1 -- 172.21.15.49:0/1727008421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 msgr2=0x55f38ef0ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa999fe2640 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef0ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.284 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa999fe2640 1 -- 172.21.15.49:0/1727008421 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f38ebce650 con 0x55f38eb63070 2024-09-21T06:44:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa998fe0640 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef0b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa98a7fc640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9800b6680 0x7fa9800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa9997e1640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9800b6680 0x7fa9800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa999fe2640 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef0a650 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009920 tx=0x7fa98c009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8660c7cbde3938b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:30.285 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa98a7fc640 1 -- 172.21.15.49:0/2149005046 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fa9840e7310 con 0x7fa9941094c0 2024-09-21T06:44:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa97f7fe640 1 -- 172.21.15.49:0/1727008421 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c031e30 con 0x55f38eb63070 2024-09-21T06:44:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa97f7fe640 1 -- 172.21.15.49:0/1727008421 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa98c036030 con 0x55f38eb63070 2024-09-21T06:44:30.286 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.281+0000 7fa97f7fe640 1 -- 172.21.15.49:0/1727008421 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c004280 con 0x55f38eb63070 2024-09-21T06:44:30.289 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1727008421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 msgr2=0x55f38ef0a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9997e1640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9800b6680 0x7fa9800b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55f38ef092d0 tx=0x7fa99000a380 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef0a650 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009920 tx=0x7fa98c009950 comp rx=0 tx=0).stop 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1727008421 shutdown_connections 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef0b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef0ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/1727008421 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef0a650 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1727008421 >> 172.21.15.49:0/1727008421 conn(0x55f38eb57460 msgr2=0x55f38ef08540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1727008421 shutdown_connections 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.282+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1727008421 wait complete. 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.283+0000 7fa9a1fb9740 1 -- start start 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.283+0000 7fa9a1fb9740 1 Processor -- start 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.283+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef15ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.290 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.283+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb42390 0x55f38ef161e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.283+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb63070 0x55f38ef16720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.283+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f38ecd1700 con 0x55f38eb42390 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.283+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f38ee0b110 con 0x55f38eb3a1b0 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.283+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f38ef18c50 con 0x55f38eb63070 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa998fe0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb42390 0x55f38ef161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa9a1fb9740 10 client.0 _ll_register_callbacks cb 0x55f38ee24990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa998fe0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb42390 0x55f38ef161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46888/0 (socket says 172.21.15.49:46888) 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa9997e1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef15ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa998fe0640 1 -- 172.21.15.49:0/3822276745 learned_addr learned my addr 172.21.15.49:0/3822276745 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa999fe2640 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb63070 0x55f38ef16720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa998fe0640 1 -- 172.21.15.49:0/3822276745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb63070 msgr2=0x55f38ef16720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa998fe0640 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb63070 0x55f38ef16720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.291 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa998fe0640 1 -- 172.21.15.49:0/3822276745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 msgr2=0x55f38ef15ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa998fe0640 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef15ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa998fe0640 1 -- 172.21.15.49:0/3822276745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f38ee38c40 con 0x55f38eb42390 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa9997e1640 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef15ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa998fe0640 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb42390 0x55f38ef161e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa9840e5010 tx=0x7fa9840a9760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ab48416b7f7df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa97cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa97cff9640 1 -- 172.21.15.49:0/3822276745 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9840aca60 con 0x55f38eb42390 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa97cff9640 1 -- 172.21.15.49:0/3822276745 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fa9840ead50 con 0x55f38eb42390 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.284+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/3822276745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa98c036030 con 0x55f38eb42390 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa97cff9640 1 -- 172.21.15.49:0/3822276745 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa9840ac880 con 0x55f38eb42390 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa9a1fb9740 10 client.17460 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/3822276745 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f38ef24900 con 0x55f38eb42390 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa97cff9640 1 -- 172.21.15.49:0/3822276745 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa98c036030 con 0x55f38eb42390 2024-09-21T06:44:30.292 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa97cff9640 1 -- 172.21.15.49:0/3822276745 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa9840981a0 con 0x55f38eb42390 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa9a1fb9740 10 client.17460 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa9a1fb9740 10 client.17460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa9a1fb9740 20 client.17460 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f38eb219f0 0x55f38ef27cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa9a1fb9740 4 client.17460 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/3822276745 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f38ee82da0 con 0x55f38eb219f0 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.285+0000 7fa9997e1640 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f38eb219f0 0x55f38ef27cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.286+0000 7fa9997e1640 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f38eb219f0 0x55f38ef27cd0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f5e62727da9c07c server_cookie=a75b13737b4a72be in_seq=0 out_seq=0 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.286+0000 7fa97cff9640 10 client.17460 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa97cff9640 1 -- 172.21.15.49:0/3822276745 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f38ee82da0 con 0x55f38eb219f0 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa97cff9640 10 client.17460 handle_command_reply: tid=0 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 client.17460 shutdown 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/3822276745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb42390 msgr2=0x55f38ef161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb42390 0x55f38ef161e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa9840e5010 tx=0x7fa9840a9760 comp rx=0 tx=0).stop 2024-09-21T06:44:30.293 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/3822276745 shutdown_connections 2024-09-21T06:44:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f38eb219f0 0x55f38ef27cd0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb63070 0x55f38ef16720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb42390 0x55f38ef161e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa97cff9640 0 client.17460 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/3822276745 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef15ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/3822276745 >> 172.21.15.49:0/3822276745 conn(0x55f38eb57460 msgr2=0x55f38ef0d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/3822276745 shutdown_connections 2024-09-21T06:44:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/3822276745 wait complete. 2024-09-21T06:44:30.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.287+0000 7fa9a1fb9740 20 client.17460 trim_cache size 0 max 16384 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.305+0000 7fa9a1fb9740 1 Processor -- start 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.305+0000 7fa9a1fb9740 1 -- start start 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.305+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb3a1b0 0x55f38ef17b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb42390 0x55f38ef0b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef21540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941b41c0 con 0x55f38eb63070 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941b1a90 con 0x55f38eb42390 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941af900 con 0x55f38eb3a1b0 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa999fe2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef21540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa999fe2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef21540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46892/0 (socket says 172.21.15.49:46892) 2024-09-21T06:44:30.308 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa999fe2640 1 -- 172.21.15.49:0/1428552391 learned_addr learned my addr 172.21.15.49:0/1428552391 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa9997e1640 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb3a1b0 0x55f38ef17b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa998fe0640 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb42390 0x55f38ef0b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa999fe2640 1 -- 172.21.15.49:0/1428552391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb3a1b0 msgr2=0x55f38ef17b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa999fe2640 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb3a1b0 0x55f38ef17b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa999fe2640 1 -- 172.21.15.49:0/1428552391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb42390 msgr2=0x55f38ef0b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa999fe2640 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb42390 0x55f38ef0b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa999fe2640 1 -- 172.21.15.49:0/1428552391 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f38ef141a0 con 0x55f38eb63070 2024-09-21T06:44:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa998fe0640 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb42390 0x55f38ef0b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:30.309 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.306+0000 7fa999fe2640 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef21540 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0099c0 tx=0x7fa98c003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f71aa2400ee2a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:30.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.307+0000 7fa97effd640 1 -- 172.21.15.49:0/1428552391 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c055020 con 0x55f38eb63070 2024-09-21T06:44:30.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.307+0000 7fa97effd640 1 -- 172.21.15.49:0/1428552391 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa98c036040 con 0x55f38eb63070 2024-09-21T06:44:30.312 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.307+0000 7fa97effd640 1 -- 172.21.15.49:0/1428552391 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c04a040 con 0x55f38eb63070 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.307+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1428552391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 msgr2=0x55f38ef21540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.307+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef21540 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0099c0 tx=0x7fa98c003e50 comp rx=0 tx=0).stop 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.308+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1428552391 shutdown_connections 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.308+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef21540 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.308+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb42390 0x55f38ef0b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.308+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/1428552391 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb3a1b0 0x55f38ef17b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.308+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1428552391 >> 172.21.15.49:0/1428552391 conn(0x55f38eb57460 msgr2=0x55f38ef20e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.308+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1428552391 shutdown_connections 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.308+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/1428552391 wait complete. 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.308+0000 7fa9a1fb9740 1 -- start start 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.308+0000 7fa9a1fb9740 1 Processor -- start 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef1a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.313 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef1ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa9a1fb9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef8b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941aff50 con 0x55f38eb63070 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941b13c0 con 0x55f38eb3a1b0 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa9a1fb9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fa9941b0620 con 0x55f38eb42390 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa9a1fb9740 10 client.0 _ll_register_callbacks cb 0x7fa9840050c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa999fe2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef8b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa999fe2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef8b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46902/0 (socket says 172.21.15.49:46902) 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa999fe2640 1 -- 172.21.15.49:0/301524216 learned_addr learned my addr 172.21.15.49:0/301524216 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa998fe0640 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef1ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa9997e1640 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef1a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa999fe2640 1 -- 172.21.15.49:0/301524216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 msgr2=0x55f38ef1ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa999fe2640 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef1ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa999fe2640 1 -- 172.21.15.49:0/301524216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 msgr2=0x55f38ef1a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:30.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa999fe2640 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef1a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.309+0000 7fa999fe2640 1 -- 172.21.15.49:0/301524216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f38ef8bdb0 con 0x55f38eb63070 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.310+0000 7fa998fe0640 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef1ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.310+0000 7fa999fe2640 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef8b740 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa98c005e30 tx=0x7fa98c02f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e0ea5094ed42aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.310+0000 7fa97cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.310+0000 7fa97cff9640 1 -- 172.21.15.49:0/301524216 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98c055030 con 0x55f38eb63070 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.310+0000 7fa97cff9640 1 -- 172.21.15.49:0/301524216 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fa98c02f660 con 0x55f38eb63070 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.310+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/301524216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa98c036040 con 0x55f38eb63070 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.310+0000 7fa97cff9640 1 -- 172.21.15.49:0/301524216 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa98c067050 con 0x55f38eb63070 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.310+0000 7fa9a1fb9740 10 client.17466 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.310+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/301524216 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f38ef93100 con 0x55f38eb63070 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa97cff9640 1 -- 172.21.15.49:0/301524216 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa98c036040 con 0x55f38eb63070 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa97cff9640 1 -- 172.21.15.49:0/301524216 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fa98c062030 con 0x55f38eb63070 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa9a1fb9740 10 client.17466 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:30.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa9a1fb9740 10 client.17466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa9a1fb9740 20 client.17466 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f38eaf6da0 0x55f38ef955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa9a1fb9740 4 client.17466 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:44:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/301524216 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f38ee7e850 con 0x55f38eaf6da0 2024-09-21T06:44:30.316 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa9997e1640 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f38eaf6da0 0x55f38ef955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa9997e1640 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f38eaf6da0 0x55f38ef955d0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a96e189e5083369 server_cookie=628bf19a19191d7 in_seq=0 out_seq=0 2024-09-21T06:44:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.311+0000 7fa97cff9640 10 client.17466 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa97cff9640 1 -- 172.21.15.49:0/301524216 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3978 (crc 0 0 0) 0x55f38ee7e850 con 0x55f38eaf6da0 2024-09-21T06:44:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa97cff9640 10 client.17466 handle_command_reply: tid=0 2024-09-21T06:44:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 client.17466 shutdown 2024-09-21T06:44:30.317 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/301524216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 msgr2=0x55f38ef8b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef8b740 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa98c005e30 tx=0x7fa98c02f390 comp rx=0 tx=0).stop 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/301524216 shutdown_connections 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f38eaf6da0 0x55f38ef955d0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f38eb63070 0x55f38ef8b740 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f38eb42390 0x55f38ef1ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 --2- 172.21.15.49:0/301524216 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f38eb3a1b0 0x55f38ef1a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/301524216 >> 172.21.15.49:0/301524216 conn(0x55f38eb57460 msgr2=0x55f38ef178e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa97cff9640 0 client.17466 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/301524216 shutdown_connections 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 1 -- 172.21.15.49:0/301524216 wait complete. 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.312+0000 7fa9a1fb9740 20 client.17466 trim_cache size 0 max 16384 2024-09-21T06:44:30.318 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "20658a62-3597-419e-8e53-a67d667c8a2e", 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.319 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:44:30.320 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.321 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:44:30.322 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:44:30.322 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.322 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.322 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.322 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.322 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:44:30.405 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.406 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:44:30.407 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.408 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:44:30.409 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:44:30.410 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:44:30.410 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:44:30.410 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:44:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 -- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9800b6680 msgr2=0x7fa9800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9800b6680 0x7fa9800b8b90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x55f38ef092d0 tx=0x7fa99000a380 comp rx=0 tx=0).stop 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 -- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9941094c0 msgr2=0x7fa994075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9941094c0 0x7fa994075c50 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa99406a800 tx=0x7fa98400dbb0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 -- 172.21.15.49:0/2149005046 shutdown_connections 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fa9800b6680 0x7fa9800b8b90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fa994109e10 0x7fa994076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fa9941094c0 0x7fa994075c50 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 --2- 172.21.15.49:0/2149005046 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fa994103b80 0x7fa994075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 -- 172.21.15.49:0/2149005046 >> 172.21.15.49:0/2149005046 conn(0x7fa9940ff610 msgr2=0x7fa994108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 -- 172.21.15.49:0/2149005046 shutdown_connections 2024-09-21T06:44:30.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:44:30.313+0000 7fa99ba45640 1 -- 172.21.15.49:0/2149005046 wait complete. 2024-09-21T06:44:31.218 INFO:tasks.cephfs.filesystem:scrub status for tag:20658a62-3597-419e-8e53-a67d667c8a2e - {'path': '/', 'tag': '20658a62-3597-419e-8e53-a67d667c8a2e', 'options': 'recursive,force'} 2024-09-21T06:44:31.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:31 smithi049 ceph-mon[31177]: pgmap v559: 97 pgs: 97 active+clean; 7.8 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:44:32.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:31 smithi098 ceph-mon[34704]: pgmap v559: 97 pgs: 97 active+clean; 7.8 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:44:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:31 smithi079 ceph-mon[34346]: pgmap v559: 97 pgs: 97 active+clean; 7.8 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:44:33.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:33 smithi049 ceph-mon[31177]: pgmap v560: 97 pgs: 97 active+clean; 7.8 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-21T06:44:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:33 smithi098 ceph-mon[34704]: pgmap v560: 97 pgs: 97 active+clean; 7.8 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-21T06:44:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:33 smithi079 ceph-mon[34346]: pgmap v560: 97 pgs: 97 active+clean; 7.8 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 13 op/s 2024-09-21T06:44:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.609+0000 7f4f17db0640 1 -- 172.21.15.49:0/2267814373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 msgr2=0x7f4f1010f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.609+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2267814373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 0x7f4f1010f480 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009ca0 tx=0x7f4f0802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.609+0000 7f4f17db0640 1 -- 172.21.15.49:0/2267814373 shutdown_connections 2024-09-21T06:44:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.609+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2267814373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 0x7f4f1010f480 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.609+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2267814373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f10108300 0x7f4f10108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.609+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2267814373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f101029d0 0x7f4f10102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.609+0000 7f4f17db0640 1 -- 172.21.15.49:0/2267814373 >> 172.21.15.49:0/2267814373 conn(0x7f4f1007a710 msgr2=0x7f4f1007ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.609+0000 7f4f17db0640 1 -- 172.21.15.49:0/2267814373 shutdown_connections 2024-09-21T06:44:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.609+0000 7f4f17db0640 1 -- 172.21.15.49:0/2267814373 wait complete. 2024-09-21T06:44:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f17db0640 1 Processor -- start 2024-09-21T06:44:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f17db0640 1 -- start start 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f17db0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f101029d0 0x7f4f1019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f17db0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10108300 0x7f4f1019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f17db0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 0x7f4f1019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f17db0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10112910 con 0x7f4f10108c50 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f17db0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10112790 con 0x7f4f101029d0 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f17db0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4f10112a90 con 0x7f4f10108300 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f1634d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 0x7f4f1019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f1634d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 0x7f4f1019fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46928/0 (socket says 172.21.15.49:46928) 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.610+0000 7f4f1634d640 1 -- 172.21.15.49:0/2868505011 learned_addr learned my addr 172.21.15.49:0/2868505011 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f1534b640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10108300 0x7f4f1019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f101029d0 0x7f4f1019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f1634d640 1 -- 172.21.15.49:0/2868505011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10108300 msgr2=0x7f4f1019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f1634d640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10108300 0x7f4f1019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f1634d640 1 -- 172.21.15.49:0/2868505011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f101029d0 msgr2=0x7f4f1019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f1634d640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f101029d0 0x7f4f1019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f1634d640 1 -- 172.21.15.49:0/2868505011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f101a02f0 con 0x7f4f10108c50 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f1534b640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10108300 0x7f4f1019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f101029d0 0x7f4f1019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f1634d640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 0x7f4f1019fbf0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f4f08005cc0 tx=0x7f4f0802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f02ffd640 1 -- 172.21.15.49:0/2868505011 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f08003bf0 con 0x7f4f10108c50 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f02ffd640 1 -- 172.21.15.49:0/2868505011 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f08003d90 con 0x7f4f10108c50 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f17db0640 1 -- 172.21.15.49:0/2868505011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f101a0580 con 0x7f4f10108c50 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f02ffd640 1 -- 172.21.15.49:0/2868505011 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0802fbc0 con 0x7f4f10108c50 2024-09-21T06:44:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.611+0000 7f4f17db0640 1 -- 172.21.15.49:0/2868505011 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f101a6d70 con 0x7f4f10108c50 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.614+0000 7f4f02ffd640 1 -- 172.21.15.49:0/2868505011 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f4f0802fd60 con 0x7f4f10108c50 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.614+0000 7f4f1edf3740 1 Processor -- start 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1edf3740 1 -- start start 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b373b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b373c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5604b36b06f0 con 0x5604b33754d0 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5604b369fb20 con 0x5604b336d2f0 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5604b36a3930 con 0x5604b33961b0 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1534b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b373c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1534b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b373c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46936/0 (socket says 172.21.15.49:46936) 2024-09-21T06:44:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1534b640 1 -- 172.21.15.49:0/2693421001 learned_addr learned my addr 172.21.15.49:0/2693421001 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1534b640 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b373b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f02ffd640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4efc0b6680 0x7f4efc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f15b4c640 1 -- 172.21.15.49:0/2693421001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 msgr2=0x5604b373b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b373b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f15b4c640 1 -- 172.21.15.49:0/2693421001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 msgr2=0x5604b373c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b373c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f15b4c640 1 -- 172.21.15.49:0/2693421001 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b3665530 con 0x5604b336d2f0 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1634d640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4efc0b6680 0x7f4efc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.615+0000 7f4f1534b640 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b373c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.616+0000 7f4f02ffd640 1 -- 172.21.15.49:0/2868505011 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f4f08108dc0 con 0x7f4f10108c50 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.616+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373bef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009b90 tx=0x7f4f0c00e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7204da0870fb1d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.616+0000 7f4efbfff640 1 -- 172.21.15.49:0/2693421001 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c016070 con 0x5604b336d2f0 2024-09-21T06:44:35.619 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.616+0000 7f4f1634d640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4efc0b6680 0x7f4efc0b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4f08106570 tx=0x7f4f080b6040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.616+0000 7f4efbfff640 1 -- 172.21.15.49:0/2693421001 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f0c0054d0 con 0x5604b336d2f0 2024-09-21T06:44:35.620 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.616+0000 7f4efbfff640 1 -- 172.21.15.49:0/2693421001 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c004e40 con 0x5604b336d2f0 2024-09-21T06:44:35.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2693421001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 msgr2=0x5604b373bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:35.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373bef0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009b90 tx=0x7f4f0c00e6c0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2693421001 shutdown_connections 2024-09-21T06:44:35.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b373c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373bef0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2693421001 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b373b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.624 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2693421001 >> 172.21.15.49:0/2693421001 conn(0x5604b338a300 msgr2=0x5604b37398a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2693421001 shutdown_connections 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2693421001 wait complete. 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.617+0000 7f4f1edf3740 1 -- start start 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1edf3740 1 Processor -- start 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b336d2f0 0x5604b374b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b33754d0 0x5604b374b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33961b0 0x5604b374be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5604b35d7ab0 con 0x5604b33961b0 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5604b3645730 con 0x5604b33754d0 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5604b374e510 con 0x5604b336d2f0 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1edf3740 10 client.0 _ll_register_callbacks cb 0x5604b36996b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1534b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33961b0 0x5604b374be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1534b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33961b0 0x5604b374be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46940/0 (socket says 172.21.15.49:46940) 2024-09-21T06:44:35.625 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.618+0000 7f4f1534b640 1 -- 172.21.15.49:0/3771546659 learned_addr learned my addr 172.21.15.49:0/3771546659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b33754d0 0x5604b374b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1534b640 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b336d2f0 0x5604b374b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1534b640 1 -- 172.21.15.49:0/3771546659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b336d2f0 msgr2=0x5604b374b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1534b640 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b336d2f0 0x5604b374b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1534b640 1 -- 172.21.15.49:0/3771546659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b33754d0 msgr2=0x5604b374b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1534b640 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b33754d0 0x5604b374b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1534b640 1 -- 172.21.15.49:0/3771546659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b3401790 con 0x5604b33961b0 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1534b640 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33961b0 0x5604b374be80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4f04013fa0 tx=0x7f4f04015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f38b0e068fb5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4ef97fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4ef97fa640 1 -- 172.21.15.49:0/3771546659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f04004020 con 0x5604b33961b0 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1edf3740 1 -- 172.21.15.49:0/3771546659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f0c0054d0 con 0x5604b33961b0 2024-09-21T06:44:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4ef97fa640 1 -- 172.21.15.49:0/3771546659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f4f040041c0 con 0x5604b33961b0 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4ef97fa640 1 -- 172.21.15.49:0/3771546659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4f040043c0 con 0x5604b33961b0 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1edf3740 10 client.17478 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.619+0000 7f4f1edf3740 1 -- 172.21.15.49:0/3771546659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5604b347a620 con 0x5604b33961b0 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.620+0000 7f4ef97fa640 1 -- 172.21.15.49:0/3771546659 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f0c0054d0 con 0x5604b33961b0 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.620+0000 7f4ef97fa640 1 -- 172.21.15.49:0/3771546659 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4f0400f040 con 0x5604b33961b0 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.620+0000 7f4f1edf3740 10 client.17478 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.620+0000 7f4f1edf3740 10 client.17478 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.620+0000 7f4f1edf3740 20 client.17478 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.620+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5604b3354d80 0x5604b375d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.620+0000 7f4f1edf3740 4 client.17478 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.620+0000 7f4f1edf3740 1 -- 172.21.15.49:0/3771546659 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604b36b2640 con 0x5604b3354d80 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.620+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5604b3354d80 0x5604b375d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.621+0000 7f4ef97fa640 10 client.17478 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.621+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5604b3354d80 0x5604b375d550 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7b901f8077fe774 server_cookie=f92cdae87b00126f in_seq=0 out_seq=0 2024-09-21T06:44:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.621+0000 7f4ef97fa640 1 -- 172.21.15.49:0/3771546659 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604b36b2640 con 0x5604b3354d80 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.621+0000 7f4ef97fa640 10 client.17478 handle_command_reply: tid=0 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 client.17478 shutdown 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 -- 172.21.15.49:0/3771546659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33961b0 msgr2=0x5604b374be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33961b0 0x5604b374be80 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4f04013fa0 tx=0x7f4f04015040 comp rx=0 tx=0).stop 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 -- 172.21.15.49:0/3771546659 shutdown_connections 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5604b3354d80 0x5604b375d550 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33961b0 0x5604b374be80 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b33754d0 0x5604b374b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/3771546659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b336d2f0 0x5604b374b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4ef97fa640 0 client.17478 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 -- 172.21.15.49:0/3771546659 >> 172.21.15.49:0/3771546659 conn(0x5604b338a300 msgr2=0x5604b373d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 -- 172.21.15.49:0/3771546659 shutdown_connections 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 1 -- 172.21.15.49:0/3771546659 wait complete. 2024-09-21T06:44:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.622+0000 7f4f1edf3740 20 client.17478 trim_cache size 0 max 16384 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f1edf3740 1 Processor -- start 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f1edf3740 1 -- start start 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b374be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f101aff60 con 0x5604b33754d0 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f101ad830 con 0x5604b336d2f0 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4f101ab6a0 con 0x5604b33961b0 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f15b4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f15b4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46954/0 (socket says 172.21.15.49:46954) 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.637+0000 7f4f15b4c640 1 -- 172.21.15.49:0/816113043 learned_addr learned my addr 172.21.15.49:0/816113043 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4f1534b640 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b374be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4f1534b640 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4f15b4c640 1 -- 172.21.15.49:0/816113043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 msgr2=0x5604b374be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b374be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4f15b4c640 1 -- 172.21.15.49:0/816113043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 msgr2=0x5604b373d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4f15b4c640 1 -- 172.21.15.49:0/816113043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b37498e0 con 0x5604b33754d0 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4f1534b640 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374b8e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x5604b373a630 tx=0x7f4f0c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6505785d020526 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4efb7fe640 1 -- 172.21.15.49:0/816113043 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c016040 con 0x5604b33754d0 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4efb7fe640 1 -- 172.21.15.49:0/816113043 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f0c009e80 con 0x5604b33754d0 2024-09-21T06:44:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.638+0000 7f4efb7fe640 1 -- 172.21.15.49:0/816113043 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c0256a0 con 0x5604b33754d0 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 -- 172.21.15.49:0/816113043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 msgr2=0x5604b374b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374b8e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x5604b373a630 tx=0x7f4f0c009880 comp rx=0 tx=0).stop 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 -- 172.21.15.49:0/816113043 shutdown_connections 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b374be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374b8e0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/816113043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b373d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 -- 172.21.15.49:0/816113043 >> 172.21.15.49:0/816113043 conn(0x5604b338a300 msgr2=0x5604b373c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 -- 172.21.15.49:0/816113043 shutdown_connections 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 -- 172.21.15.49:0/816113043 wait complete. 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 -- start start 2024-09-21T06:44:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.639+0000 7f4f1edf3740 1 Processor -- start 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b3753ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f1edf3740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b374f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f101abcf0 con 0x5604b33754d0 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f101ad160 con 0x5604b336d2f0 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f1edf3740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4f101ac3c0 con 0x5604b33961b0 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f1edf3740 10 client.0 _ll_register_callbacks cb 0x7f4f04013be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f15b4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f15b4c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46962/0 (socket says 172.21.15.49:46962) 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f15b4c640 1 -- 172.21.15.49:0/2202367738 learned_addr learned my addr 172.21.15.49:0/2202367738 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f1534b640 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b3753ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f15b4c640 1 -- 172.21.15.49:0/2202367738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 msgr2=0x5604b374f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f1534b640 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b374f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b374f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f15b4c640 1 -- 172.21.15.49:0/2202367738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 msgr2=0x5604b3753ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b3753ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.640+0000 7f4f15b4c640 1 -- 172.21.15.49:0/2202367738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b374ffa0 con 0x5604b33754d0 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4f1534b640 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b374f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4f15b4c640 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374f3c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009ab0 tx=0x7f4f0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7dbaeb5d00f7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4ef97fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4ef97fa640 1 -- 172.21.15.49:0/2202367738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c034070 con 0x5604b33754d0 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4ef97fa640 1 -- 172.21.15.49:0/2202367738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f4f0c004220 con 0x5604b33754d0 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2202367738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604b36ae0f0 con 0x5604b33754d0 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4ef97fa640 1 -- 172.21.15.49:0/2202367738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4f0c03f050 con 0x5604b33754d0 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4f1edf3740 10 client.17484 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2202367738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5604b37c7d30 con 0x5604b33754d0 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4ef97fa640 1 -- 172.21.15.49:0/2202367738 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5604b36ae0f0 con 0x5604b33754d0 2024-09-21T06:44:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4ef97fa640 1 -- 172.21.15.49:0/2202367738 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f4f0c00f040 con 0x5604b33754d0 2024-09-21T06:44:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4f1edf3740 10 client.17484 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4f1edf3740 10 client.17484 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4f1edf3740 20 client.17484 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.641+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5604b332a1c0 0x5604b37ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.642+0000 7f4f1edf3740 4 client.17484 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:44:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.642+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2202367738 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604b36ab520 con 0x5604b332a1c0 2024-09-21T06:44:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.642+0000 7f4f1534b640 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5604b332a1c0 0x5604b37ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.642+0000 7f4f1534b640 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5604b332a1c0 0x5604b37ca2d0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b4112182d1328c9 server_cookie=1686ae8cee40f484 in_seq=0 out_seq=0 2024-09-21T06:44:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.642+0000 7f4ef97fa640 10 client.17484 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4ef97fa640 1 -- 172.21.15.49:0/2202367738 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604b36ab520 con 0x5604b332a1c0 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4ef97fa640 10 client.17484 handle_command_reply: tid=0 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 client.17484 shutdown 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2202367738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 msgr2=0x5604b374f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374f3c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c009ab0 tx=0x7f4f0c004750 comp rx=0 tx=0).stop 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2202367738 shutdown_connections 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5604b332a1c0 0x5604b37ca2d0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5604b33961b0 0x5604b374f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5604b33754d0 0x5604b374f3c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 --2- 172.21.15.49:0/2202367738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5604b336d2f0 0x5604b3753ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4ef97fa640 0 client.17484 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2202367738 >> 172.21.15.49:0/2202367738 conn(0x5604b338a300 msgr2=0x5604b374c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2202367738 shutdown_connections 2024-09-21T06:44:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 1 -- 172.21.15.49:0/2202367738 wait complete. 2024-09-21T06:44:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.650+0000 7f4f1edf3740 20 client.17484 trim_cache size 0 max 16384 2024-09-21T06:44:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:44:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:44:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:44:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:44:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 -- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4efc0b6680 msgr2=0x7f4efc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4efc0b6680 0x7f4efc0b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4f08106570 tx=0x7f4f080b6040 comp rx=0 tx=0).stop 2024-09-21T06:44:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 -- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 msgr2=0x7f4f1019fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 0x7f4f1019fbf0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f4f08005cc0 tx=0x7f4f0802f380 comp rx=0 tx=0).stop 2024-09-21T06:44:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 -- 172.21.15.49:0/2868505011 shutdown_connections 2024-09-21T06:44:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4efc0b6680 0x7f4efc0b8b90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f10108c50 0x7f4f1019fbf0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f10108300 0x7f4f1019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 --2- 172.21.15.49:0/2868505011 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f101029d0 0x7f4f1019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 -- 172.21.15.49:0/2868505011 >> 172.21.15.49:0/2868505011 conn(0x7f4f1007a710 msgr2=0x7f4f10101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 -- 172.21.15.49:0/2868505011 shutdown_connections 2024-09-21T06:44:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:35.651+0000 7f4f17db0640 1 -- 172.21.15.49:0/2868505011 wait complete. 2024-09-21T06:44:35.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:35 smithi049 ceph-mon[31177]: pgmap v561: 97 pgs: 97 active+clean; 7.9 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-09-21T06:44:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:35 smithi098 ceph-mon[34704]: pgmap v561: 97 pgs: 97 active+clean; 7.9 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-09-21T06:44:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:35 smithi079 ceph-mon[34346]: pgmap v561: 97 pgs: 97 active+clean; 7.9 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 15 op/s 2024-09-21T06:44:37.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:37 smithi049 ceph-mon[31177]: pgmap v562: 97 pgs: 97 active+clean; 7.9 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:44:38.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:37 smithi098 ceph-mon[34704]: pgmap v562: 97 pgs: 97 active+clean; 7.9 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:44:38.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:37 smithi079 ceph-mon[34346]: pgmap v562: 97 pgs: 97 active+clean; 7.9 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:44:38.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:38 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:44:39.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:38 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:44:39.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:38 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:44:39.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:39 smithi049 ceph-mon[31177]: pgmap v563: 97 pgs: 97 active+clean; 8.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 17 op/s 2024-09-21T06:44:39.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:39 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:44:40.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:39 smithi098 ceph-mon[34704]: pgmap v563: 97 pgs: 97 active+clean; 8.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 17 op/s 2024-09-21T06:44:40.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:39 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:44:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:39 smithi079 ceph-mon[34346]: pgmap v563: 97 pgs: 97 active+clean; 8.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 17 op/s 2024-09-21T06:44:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:39 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:44:41.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:41 smithi049 ceph-mon[31177]: pgmap v564: 97 pgs: 97 active+clean; 8.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:44:42.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:41 smithi098 ceph-mon[34704]: pgmap v564: 97 pgs: 97 active+clean; 8.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:44:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:41 smithi079 ceph-mon[34346]: pgmap v564: 97 pgs: 97 active+clean; 8.0 MiB data, 404 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:44:43.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:43 smithi049 ceph-mon[31177]: pgmap v565: 97 pgs: 97 active+clean; 8.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:44:44.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:43 smithi098 ceph-mon[34704]: pgmap v565: 97 pgs: 97 active+clean; 8.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:44:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:43 smithi079 ceph-mon[34346]: pgmap v565: 97 pgs: 97 active+clean; 8.0 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 14 op/s 2024-09-21T06:44:45.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:45 smithi049 ceph-mon[31177]: pgmap v566: 97 pgs: 97 active+clean; 8.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:44:46.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:45 smithi098 ceph-mon[34704]: pgmap v566: 97 pgs: 97 active+clean; 8.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:44:46.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:45 smithi079 ceph-mon[34346]: pgmap v566: 97 pgs: 97 active+clean; 8.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:44:47.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:47 smithi049 ceph-mon[31177]: pgmap v567: 97 pgs: 97 active+clean; 8.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-21T06:44:48.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:47 smithi098 ceph-mon[34704]: pgmap v567: 97 pgs: 97 active+clean; 8.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-21T06:44:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:47 smithi079 ceph-mon[34346]: pgmap v567: 97 pgs: 97 active+clean; 8.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 12 op/s 2024-09-21T06:44:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.762+0000 7f05bebba640 1 -- 172.21.15.49:0/449893942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 msgr2=0x7f05b8104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.762+0000 7f05bebba640 1 --2- 172.21.15.49:0/449893942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 0x7f05b8104bc0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f05a8009900 tx=0x7f05a802a410 comp rx=0 tx=0).stop 2024-09-21T06:44:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.762+0000 7f05bebba640 1 -- 172.21.15.49:0/449893942 shutdown_connections 2024-09-21T06:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.762+0000 7f05bebba640 1 --2- 172.21.15.49:0/449893942 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b810dd60 0x7f05b8110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.762+0000 7f05bebba640 1 --2- 172.21.15.49:0/449893942 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b81051e0 0x7f05b810d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.762+0000 7f05bebba640 1 --2- 172.21.15.49:0/449893942 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 0x7f05b8104bc0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.762+0000 7f05bebba640 1 -- 172.21.15.49:0/449893942 >> 172.21.15.49:0/449893942 conn(0x7f05b80fe3c0 msgr2=0x7f05b8100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.762+0000 7f05bebba640 1 -- 172.21.15.49:0/449893942 shutdown_connections 2024-09-21T06:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.762+0000 7f05bebba640 1 -- 172.21.15.49:0/449893942 wait complete. 2024-09-21T06:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bebba640 1 Processor -- start 2024-09-21T06:44:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bebba640 1 -- start start 2024-09-21T06:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bebba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 0x7f05b819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bebba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b81051e0 0x7f05b819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bebba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b810dd60 0x7f05b819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bebba640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81139e0 con 0x7f05b81047b0 2024-09-21T06:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bebba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8113860 con 0x7f05b81051e0 2024-09-21T06:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bebba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8113b60 con 0x7f05b810dd60 2024-09-21T06:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bc956640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 0x7f05b819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bc956640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 0x7f05b819a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44758/0 (socket says 172.21.15.49:44758) 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05bc956640 1 -- 172.21.15.49:0/3049489231 learned_addr learned my addr 172.21.15.49:0/3049489231 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.763+0000 7f05b7fff640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b81051e0 0x7f05b819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05bd157640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b810dd60 0x7f05b819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05bc956640 1 -- 172.21.15.49:0/3049489231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b810dd60 msgr2=0x7f05b819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05bc956640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b810dd60 0x7f05b819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05bc956640 1 -- 172.21.15.49:0/3049489231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b81051e0 msgr2=0x7f05b819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05bc956640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b81051e0 0x7f05b819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05bc956640 1 -- 172.21.15.49:0/3049489231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05b81a0330 con 0x7f05b81047b0 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05bc956640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 0x7f05b819a400 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f05a8005940 tx=0x7f05a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05b5ffb640 1 -- 172.21.15.49:0/3049489231 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a803f030 con 0x7f05b81047b0 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05bebba640 1 -- 172.21.15.49:0/3049489231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b81a05c0 con 0x7f05b81047b0 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05b5ffb640 1 -- 172.21.15.49:0/3049489231 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05a8003cb0 con 0x7f05b81047b0 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05b5ffb640 1 -- 172.21.15.49:0/3049489231 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a8035070 con 0x7f05b81047b0 2024-09-21T06:44:48.769 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.764+0000 7f05bebba640 1 -- 172.21.15.49:0/3049489231 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b81a6db0 con 0x7f05b81047b0 2024-09-21T06:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05c5c05740 1 Processor -- start 2024-09-21T06:44:48.770 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05c5c05740 1 -- start start 2024-09-21T06:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05b5ffb640 1 -- 172.21.15.49:0/3049489231 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f05a8042030 con 0x7f05b81047b0 2024-09-21T06:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6a4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05c5c05740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f8ba6186f0 con 0x55f8ba2d52f0 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05c5c05740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f8ba607b20 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05c5c05740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f8ba60b930 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05bc956640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05bc956640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44770/0 (socket says 172.21.15.49:44770) 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05bc956640 1 -- 172.21.15.49:0/4134713779 learned_addr learned my addr 172.21.15.49:0/4134713779 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.768+0000 7f05b7fff640 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05bd157640 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05bc956640 1 -- 172.21.15.49:0/4134713779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 msgr2=0x55f8ba6a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05bc956640 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05bc956640 1 -- 172.21.15.49:0/4134713779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 msgr2=0x55f8ba6a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05bc956640 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05bc956640 1 -- 172.21.15.49:0/4134713779 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ba5cd530 con 0x55f8ba2d52f0 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05bd157640 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05bc956640 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a3ef0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f05a8105690 tx=0x7f05a810bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cab75c906ea887 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05b5ffb640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05a00b6680 0x7f05a00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05bd157640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05a00b6680 0x7f05a00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f059effd640 1 -- 172.21.15.49:0/4134713779 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a80ca470 con 0x55f8ba2d52f0 2024-09-21T06:44:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f059effd640 1 -- 172.21.15.49:0/4134713779 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05a8115030 con 0x55f8ba2d52f0 2024-09-21T06:44:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f05b5ffb640 1 -- 172.21.15.49:0/3049489231 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f05a8108020 con 0x7f05b81047b0 2024-09-21T06:44:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.769+0000 7f059effd640 1 -- 172.21.15.49:0/4134713779 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05a80cbb10 con 0x55f8ba2d52f0 2024-09-21T06:44:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05c5c05740 1 -- 172.21.15.49:0/4134713779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2d52f0 msgr2=0x55f8ba6a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05bd157640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05a00b6680 0x7f05a00b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f05b0005fd0 tx=0x7f05b0009580 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a3ef0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f05a8105690 tx=0x7f05a810bf90 comp rx=0 tx=0).stop 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05c5c05740 1 -- 172.21.15.49:0/4134713779 shutdown_connections 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a3ef0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4134713779 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05c5c05740 1 -- 172.21.15.49:0/4134713779 >> 172.21.15.49:0/4134713779 conn(0x55f8ba2f2300 msgr2=0x55f8ba6a18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05c5c05740 1 -- 172.21.15.49:0/4134713779 shutdown_connections 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.770+0000 7f05c5c05740 1 -- 172.21.15.49:0/4134713779 wait complete. 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.771+0000 7f05c5c05740 1 -- start start 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.771+0000 7f05c5c05740 1 Processor -- start 2024-09-21T06:44:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6af560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05c5c05740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f8ba53fab0 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05c5c05740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f8ba5ad730 con 0x55f8ba2d52f0 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05c5c05740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f8ba6b1ef0 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05c5c05740 10 client.0 _ll_register_callbacks cb 0x55f8ba6016b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bd157640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bd157640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44784/0 (socket says 172.21.15.49:44784) 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bd157640 1 -- 172.21.15.49:0/4029326057 learned_addr learned my addr 172.21.15.49:0/4029326057 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bc956640 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05b7fff640 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bd157640 1 -- 172.21.15.49:0/4029326057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 msgr2=0x55f8ba6af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bd157640 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.780 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bd157640 1 -- 172.21.15.49:0/4029326057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 msgr2=0x55f8ba6af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bd157640 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bd157640 1 -- 172.21.15.49:0/4029326057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ba369790 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05bd157640 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb150 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f05b0012930 tx=0x7f05b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3140251010ddd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f0597fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f0597fff640 1 -- 172.21.15.49:0/4029326057 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b000ec60 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f0597fff640 1 -- 172.21.15.49:0/4029326057 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f05b000ee00 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.772+0000 7f05c5c05740 1 -- 172.21.15.49:0/4029326057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05a8115030 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f0597fff640 1 -- 172.21.15.49:0/4029326057 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f05b001f420 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f05c5c05740 10 client.17496 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f05c5c05740 1 -- 172.21.15.49:0/4029326057 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f8ba3e2620 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f0597fff640 1 -- 172.21.15.49:0/4029326057 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05a8115030 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f0597fff640 1 -- 172.21.15.49:0/4029326057 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f05b000f040 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f05c5c05740 10 client.17496 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f05c5c05740 10 client.17496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f05c5c05740 20 client.17496 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8ba2bcd80 0x55f8ba6c0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f05c5c05740 4 client.17496 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f05c5c05740 1 -- 172.21.15.49:0/4029326057 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8ba61a640 con 0x55f8ba2bcd80 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.773+0000 7f05bc956640 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8ba2bcd80 0x55f8ba6c0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.774+0000 7f05bc956640 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8ba2bcd80 0x55f8ba6c0f20 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1034ffe4ce447979 server_cookie=24196f03732b557 in_seq=0 out_seq=0 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.774+0000 7f0597fff640 10 client.17496 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f0597fff640 1 -- 172.21.15.49:0/4029326057 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8ba61a640 con 0x55f8ba2bcd80 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f0597fff640 10 client.17496 handle_command_reply: tid=0 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 client.17496 shutdown 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 -- 172.21.15.49:0/4029326057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2fe1b0 msgr2=0x55f8ba6bb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb150 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f05b0012930 tx=0x7f05b0004a40 comp rx=0 tx=0).stop 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 -- 172.21.15.49:0/4029326057 shutdown_connections 2024-09-21T06:44:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8ba2bcd80 0x55f8ba6c0f20 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb150 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f0597fff640 0 client.17496 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 --2- 172.21.15.49:0/4029326057 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 -- 172.21.15.49:0/4029326057 >> 172.21.15.49:0/4029326057 conn(0x55f8ba2f2300 msgr2=0x55f8ba6a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 -- 172.21.15.49:0/4029326057 shutdown_connections 2024-09-21T06:44:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 1 -- 172.21.15.49:0/4029326057 wait complete. 2024-09-21T06:44:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.775+0000 7f05c5c05740 20 client.17496 trim_cache size 0 max 16384 2024-09-21T06:44:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05c5c05740 1 Processor -- start 2024-09-21T06:44:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05c5c05740 1 -- start start 2024-09-21T06:44:48.793 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6bafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05c5c05740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81b2110 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05c5c05740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81af9e0 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05c5c05740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81ad850 con 0x55f8ba2d52f0 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6bafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6bafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44800/0 (socket says 172.21.15.49:44800) 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05b7fff640 1 -- 172.21.15.49:0/344282600 learned_addr learned my addr 172.21.15.49:0/344282600 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05bd157640 1 --2- 172.21.15.49:0/344282600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05bc956640 1 --2- 172.21.15.49:0/344282600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05b7fff640 1 -- 172.21.15.49:0/344282600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2d52f0 msgr2=0x55f8ba6a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05b7fff640 1 --2- 172.21.15.49:0/344282600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05b7fff640 1 -- 172.21.15.49:0/344282600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 msgr2=0x55f8ba6bb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05b7fff640 1 --2- 172.21.15.49:0/344282600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.790+0000 7f05b7fff640 1 -- 172.21.15.49:0/344282600 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8ba6ad500 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.791+0000 7f05b7fff640 1 --2- 172.21.15.49:0/344282600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6bafc0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00b850 tx=0x7f05ac00bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6732357105ddf7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.791+0000 7f059e7fc640 1 -- 172.21.15.49:0/344282600 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac003b50 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.791+0000 7f059e7fc640 1 -- 172.21.15.49:0/344282600 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05ac0054d0 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.791+0000 7f059e7fc640 1 -- 172.21.15.49:0/344282600 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac004da0 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 -- 172.21.15.49:0/344282600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 msgr2=0x55f8ba6bafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 --2- 172.21.15.49:0/344282600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6bafc0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f05ac00b850 tx=0x7f05ac00bd10 comp rx=0 tx=0).stop 2024-09-21T06:44:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 -- 172.21.15.49:0/344282600 shutdown_connections 2024-09-21T06:44:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 --2- 172.21.15.49:0/344282600 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6bb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 --2- 172.21.15.49:0/344282600 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6bafc0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 --2- 172.21.15.49:0/344282600 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 -- 172.21.15.49:0/344282600 >> 172.21.15.49:0/344282600 conn(0x55f8ba2f2300 msgr2=0x55f8ba6a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 -- 172.21.15.49:0/344282600 shutdown_connections 2024-09-21T06:44:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 -- 172.21.15.49:0/344282600 wait complete. 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 -- start start 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.792+0000 7f05c5c05740 1 Processor -- start 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05c5c05740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05c5c05740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81adea0 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05c5c05740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81af310 con 0x55f8ba2d52f0 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05c5c05740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81ae570 con 0x55f8ba2fe1b0 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05c5c05740 10 client.0 _ll_register_callbacks cb 0x7f05b0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:44810/0 (socket says 172.21.15.49:44810) 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05b7fff640 1 -- 172.21.15.49:0/2980563646 learned_addr learned my addr 172.21.15.49:0/2980563646 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05bc956640 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05bd157640 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05b7fff640 1 -- 172.21.15.49:0/2980563646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2fe1b0 msgr2=0x55f8ba6b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05b7fff640 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05b7fff640 1 -- 172.21.15.49:0/2980563646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 msgr2=0x55f8ba6b76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05b7fff640 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6b76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05b7fff640 1 -- 172.21.15.49:0/2980563646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8ba6b5760 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05b7fff640 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6b4bb0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f05ac004650 tx=0x7f05ac0050a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb11fbde67190a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f0597fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f0597fff640 1 -- 172.21.15.49:0/2980563646 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05ac003b50 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f0597fff640 1 -- 172.21.15.49:0/2980563646 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f05ac003cf0 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.793+0000 7f05c5c05740 1 -- 172.21.15.49:0/2980563646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05ac0054d0 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f0597fff640 1 -- 172.21.15.49:0/2980563646 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f05ac035050 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f05c5c05740 10 client.17502 fetch_fsmap learned FSMap version 27 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f05c5c05740 1 -- 172.21.15.49:0/2980563646 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f8ba72b780 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f0597fff640 1 -- 172.21.15.49:0/2980563646 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05ac0054d0 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f0597fff640 1 -- 172.21.15.49:0/2980563646 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f05ac011970 con 0x55f8ba2dd4d0 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f05c5c05740 10 client.17502 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f05c5c05740 10 client.17502 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f05c5c05740 20 client.17502 populate_metadata read hostname 'smithi049' 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f05c5c05740 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8ba2921c0 0x55f8ba72df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f05c5c05740 4 client.17502 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f05c5c05740 1 -- 172.21.15.49:0/2980563646 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f8ba6160f0 con 0x55f8ba2921c0 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.794+0000 7f05bc956640 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8ba2921c0 0x55f8ba72df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.795+0000 7f05bc956640 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8ba2921c0 0x55f8ba72df30 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=683ed072c6d48bc5 server_cookie=d2a275dc05490e24 in_seq=0 out_seq=0 2024-09-21T06:44:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.795+0000 7f0597fff640 10 client.17502 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f0597fff640 1 -- 172.21.15.49:0/2980563646 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f8ba6160f0 con 0x55f8ba2921c0 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f0597fff640 10 client.17502 handle_command_reply: tid=0 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 client.17502 shutdown 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 -- 172.21.15.49:0/2980563646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 msgr2=0x55f8ba6b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6b4bb0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f05ac004650 tx=0x7f05ac0050a0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 -- 172.21.15.49:0/2980563646 shutdown_connections 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f8ba2921c0 0x55f8ba72df30 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f8ba2fe1b0 0x55f8ba6b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f8ba2dd4d0 0x55f8ba6b4bb0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f0597fff640 0 client.17502 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:44:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 --2- 172.21.15.49:0/2980563646 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f8ba2d52f0 0x55f8ba6b76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 -- 172.21.15.49:0/2980563646 >> 172.21.15.49:0/2980563646 conn(0x55f8ba2f2300 msgr2=0x55f8ba69fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 -- 172.21.15.49:0/2980563646 shutdown_connections 2024-09-21T06:44:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 1 -- 172.21.15.49:0/2980563646 wait complete. 2024-09-21T06:44:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.803+0000 7f05c5c05740 20 client.17502 trim_cache size 0 max 16384 2024-09-21T06:44:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:44:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:44:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:44:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:44:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 -- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05a00b6680 msgr2=0x7f05a00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05a00b6680 0x7f05a00b8b90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f05b0005fd0 tx=0x7f05b0009580 comp rx=0 tx=0).stop 2024-09-21T06:44:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 -- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 msgr2=0x7f05b819a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 0x7f05b819a400 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f05a8005940 tx=0x7f05a80042f0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 -- 172.21.15.49:0/3049489231 shutdown_connections 2024-09-21T06:44:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f05a00b6680 0x7f05a00b8b90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f05b810dd60 0x7f05b819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.808 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f05b81051e0 0x7f05b819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 --2- 172.21.15.49:0/3049489231 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f05b81047b0 0x7f05b819a400 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:48.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 -- 172.21.15.49:0/3049489231 >> 172.21.15.49:0/3049489231 conn(0x7f05b80fe3c0 msgr2=0x7f05b8107900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:48.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 -- 172.21.15.49:0/3049489231 shutdown_connections 2024-09-21T06:44:48.809 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:44:48.804+0000 7f05bebba640 1 -- 172.21.15.49:0/3049489231 wait complete. 2024-09-21T06:44:49.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:49 smithi049 ceph-mon[31177]: pgmap v568: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:44:50.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:49 smithi098 ceph-mon[34704]: pgmap v568: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:44:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:49 smithi079 ceph-mon[34346]: pgmap v568: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:44:51.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:51 smithi049 ceph-mon[31177]: pgmap v569: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T06:44:52.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:51 smithi098 ceph-mon[34704]: pgmap v569: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T06:44:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:51 smithi079 ceph-mon[34346]: pgmap v569: 97 pgs: 97 active+clean; 8.2 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-09-21T06:44:53.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:53 smithi049 ceph-mon[31177]: pgmap v570: 97 pgs: 97 active+clean; 8.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-21T06:44:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:53 smithi098 ceph-mon[34704]: pgmap v570: 97 pgs: 97 active+clean; 8.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-21T06:44:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:53 smithi079 ceph-mon[34346]: pgmap v570: 97 pgs: 97 active+clean; 8.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-09-21T06:44:54.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:44:54.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:44:54.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:44:54.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:44:55.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:44:55.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:44:55.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:44:55.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:44:55.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:44:55.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:44:55.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:44:55.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:44:56.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:55 smithi098 ceph-mon[34704]: pgmap v571: 97 pgs: 97 active+clean; 8.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:44:56.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:55 smithi079 ceph-mon[34346]: pgmap v571: 97 pgs: 97 active+clean; 8.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:44:56.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:55 smithi049 ceph-mon[31177]: pgmap v571: 97 pgs: 97 active+clean; 8.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:44:58.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:57 smithi098 ceph-mon[34704]: pgmap v572: 97 pgs: 97 active+clean; 8.4 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:44:58.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:57 smithi079 ceph-mon[34346]: pgmap v572: 97 pgs: 97 active+clean; 8.4 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:44:58.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:57 smithi049 ceph-mon[31177]: pgmap v572: 97 pgs: 97 active+clean; 8.4 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:45:00.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:44:59 smithi098 ceph-mon[34704]: pgmap v573: 97 pgs: 97 active+clean; 8.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:45:00.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:44:59 smithi079 ceph-mon[34346]: pgmap v573: 97 pgs: 97 active+clean; 8.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:45:00.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:44:59 smithi049 ceph-mon[31177]: pgmap v573: 97 pgs: 97 active+clean; 8.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 14 op/s 2024-09-21T06:45:01.219 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:45:01.480 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:01.854 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:01 smithi049 ceph-mon[31177]: pgmap v574: 97 pgs: 97 active+clean; 8.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T06:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.908+0000 7f6535fc6640 1 -- 172.21.15.49:0/4140959441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 msgr2=0x7f6530110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.908+0000 7f6535fc6640 1 --2- 172.21.15.49:0/4140959441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 0x7f6530110260 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6528009ca0 tx=0x7f652802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.908+0000 7f6535fc6640 1 -- 172.21.15.49:0/4140959441 shutdown_connections 2024-09-21T06:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.908+0000 7f6535fc6640 1 --2- 172.21.15.49:0/4140959441 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 0x7f6530110260 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.908+0000 7f6535fc6640 1 --2- 172.21.15.49:0/4140959441 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530105260 0x7f653010d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.908+0000 7f6535fc6640 1 --2- 172.21.15.49:0/4140959441 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6530104910 0x7f6530104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.908+0000 7f6535fc6640 1 -- 172.21.15.49:0/4140959441 >> 172.21.15.49:0/4140959441 conn(0x7f65300fe3c0 msgr2=0x7f6530100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.908+0000 7f6535fc6640 1 -- 172.21.15.49:0/4140959441 shutdown_connections 2024-09-21T06:45:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.908+0000 7f6535fc6640 1 -- 172.21.15.49:0/4140959441 wait complete. 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.909+0000 7f6535fc6640 1 Processor -- start 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.909+0000 7f6535fc6640 1 -- start start 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f6535fc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530104910 0x7f653019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f6535fc6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6530105260 0x7f653019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f6535fc6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 0x7f653019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f6535fc6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f65301139f0 con 0x7f653010dd70 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f6535fc6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6530113870 con 0x7f6530104910 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f6535fc6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6530113b70 con 0x7f6530105260 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 0x7f653019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 0x7f653019fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38110/0 (socket says 172.21.15.49:38110) 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652ffff640 1 -- 172.21.15.49:0/744218454 learned_addr learned my addr 172.21.15.49:0/744218454 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652effd640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6530105260 0x7f653019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652f7fe640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530104910 0x7f653019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652ffff640 1 -- 172.21.15.49:0/744218454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6530105260 msgr2=0x7f653019a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652ffff640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6530105260 0x7f653019a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652ffff640 1 -- 172.21.15.49:0/744218454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530104910 msgr2=0x7f653019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652ffff640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530104910 0x7f653019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652ffff640 1 -- 172.21.15.49:0/744218454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65301a02e0 con 0x7f653010dd70 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.910+0000 7f652effd640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6530105260 0x7f653019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.911+0000 7f652ffff640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 0x7f653019fbe0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f65280098d0 tx=0x7f65280317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.911+0000 7f652cff9640 1 -- 172.21.15.49:0/744218454 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6528003b70 con 0x7f653010dd70 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.911+0000 7f652cff9640 1 -- 172.21.15.49:0/744218454 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6528003d10 con 0x7f653010dd70 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.911+0000 7f652cff9640 1 -- 172.21.15.49:0/744218454 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652802fa20 con 0x7f653010dd70 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.911+0000 7f6535fc6640 1 -- 172.21.15.49:0/744218454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65301a0570 con 0x7f653010dd70 2024-09-21T06:45:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.911+0000 7f6535fc6640 1 -- 172.21.15.49:0/744218454 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65301a6d60 con 0x7f653010dd70 2024-09-21T06:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.915+0000 7f652cff9640 1 -- 172.21.15.49:0/744218454 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f652802fc40 con 0x7f653010dd70 2024-09-21T06:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.915+0000 7f653d016740 1 Processor -- start 2024-09-21T06:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.915+0000 7f653d016740 1 -- start start 2024-09-21T06:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f653d016740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 0x55dede8929b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f653d016740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede892ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f653d016740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede893430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f653d016740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dede8076f0 con 0x55dede4cc4d0 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f653d016740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dede7f6b20 con 0x55dede4ed1b0 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f653d016740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55dede7fa930 con 0x55dede4c42f0 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f652effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede893430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f652effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede893430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38122/0 (socket says 172.21.15.49:38122) 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f652effd640 1 -- 172.21.15.49:0/161410230 learned_addr learned my addr 172.21.15.49:0/161410230 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f652effd640 1 --2- 172.21.15.49:0/161410230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 0x55dede8929b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f652cff9640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65180b6700 0x7f65180b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f652f7fe640 1 --2- 172.21.15.49:0/161410230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede892ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.916+0000 7f652ffff640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65180b6700 0x7f65180b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f652effd640 1 -- 172.21.15.49:0/161410230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 msgr2=0x55dede892ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f652effd640 1 --2- 172.21.15.49:0/161410230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede892ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.919 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f652effd640 1 -- 172.21.15.49:0/161410230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 msgr2=0x55dede8929b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f652effd640 1 --2- 172.21.15.49:0/161410230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 0x55dede8929b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f652effd640 1 -- 172.21.15.49:0/161410230 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dede7bc530 con 0x55dede4cc4d0 2024-09-21T06:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f652cff9640 1 -- 172.21.15.49:0/744218454 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f6528108940 con 0x7f653010dd70 2024-09-21T06:45:01.920 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f652effd640 1 --2- 172.21.15.49:0/161410230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede893430 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6524012b20 tx=0x7f652400bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72473f477e25ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f652ffff640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65180b6700 0x7f65180b8c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f65280cb9b0 tx=0x7f65280ca660 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f6515ffb640 1 -- 172.21.15.49:0/161410230 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65240108f0 con 0x55dede4cc4d0 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f6515ffb640 1 -- 172.21.15.49:0/161410230 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6524005020 con 0x55dede4cc4d0 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.917+0000 7f6515ffb640 1 -- 172.21.15.49:0/161410230 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524004b00 con 0x55dede4cc4d0 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 -- 172.21.15.49:0/161410230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 msgr2=0x55dede893430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 --2- 172.21.15.49:0/161410230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede893430 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6524012b20 tx=0x7f652400bb30 comp rx=0 tx=0).stop 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 -- 172.21.15.49:0/161410230 shutdown_connections 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 --2- 172.21.15.49:0/161410230 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede893430 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 --2- 172.21.15.49:0/161410230 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede892ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 --2- 172.21.15.49:0/161410230 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 0x55dede8929b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 -- 172.21.15.49:0/161410230 >> 172.21.15.49:0/161410230 conn(0x55dede4e1300 msgr2=0x55dede8908a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 -- 172.21.15.49:0/161410230 shutdown_connections 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 -- 172.21.15.49:0/161410230 wait complete. 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.919+0000 7f653d016740 1 -- start start 2024-09-21T06:45:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f653d016740 1 Processor -- start 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f653d016740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede89e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f653d016740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede89e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f653d016740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 0x55dede8aa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f653d016740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dede72eab0 con 0x55dede4cc4d0 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f653d016740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dede79c730 con 0x55dede4ed1b0 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f653d016740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55dede8a1130 con 0x55dede4c42f0 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f653d016740 10 client.0 _ll_register_callbacks cb 0x55dede7f06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f652f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede89e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f652f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede89e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38132/0 (socket says 172.21.15.49:38132) 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f652f7fe640 1 -- 172.21.15.49:0/716215377 learned_addr learned my addr 172.21.15.49:0/716215377 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f652effd640 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede89e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.920+0000 7f652effd640 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 0x55dede8aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f652f7fe640 1 -- 172.21.15.49:0/716215377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 msgr2=0x55dede89e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f652f7fe640 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede89e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f652f7fe640 1 -- 172.21.15.49:0/716215377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 msgr2=0x55dede8aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f652f7fe640 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 0x55dede8aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f652f7fe640 1 -- 172.21.15.49:0/716215377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dede558790 con 0x55dede4cc4d0 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f652effd640 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede89e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f652f7fe640 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede89e580 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f6520012740 tx=0x7f6520012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6ffea505afc53f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f650effd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f650effd640 1 -- 172.21.15.49:0/716215377 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652000f920 con 0x55dede4cc4d0 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f650effd640 1 -- 172.21.15.49:0/716215377 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f652000fac0 con 0x55dede4cc4d0 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f653d016740 1 -- 172.21.15.49:0/716215377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6524005020 con 0x55dede4cc4d0 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f650effd640 1 -- 172.21.15.49:0/716215377 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f652000fd00 con 0x55dede4cc4d0 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f653d016740 10 client.17514 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.921+0000 7f653d016740 1 -- 172.21.15.49:0/716215377 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dede5d1620 con 0x55dede4cc4d0 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.922+0000 7f650effd640 1 -- 172.21.15.49:0/716215377 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6524005020 con 0x55dede4cc4d0 2024-09-21T06:45:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.922+0000 7f650effd640 1 -- 172.21.15.49:0/716215377 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f652001c420 con 0x55dede4cc4d0 2024-09-21T06:45:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.922+0000 7f653d016740 10 client.17514 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.922+0000 7f653d016740 10 client.17514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.922+0000 7f653d016740 20 client.17514 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.922+0000 7f653d016740 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dede4abd80 0x55dede8b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.922+0000 7f653d016740 4 client.17514 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.922+0000 7f653d016740 1 -- 172.21.15.49:0/716215377 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dede809640 con 0x55dede4abd80 2024-09-21T06:45:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.922+0000 7f652effd640 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dede4abd80 0x55dede8b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.923+0000 7f650effd640 10 client.17514 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.923+0000 7f652effd640 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dede4abd80 0x55dede8b02a0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a74dd76131c14f5 server_cookie=75e830d3661c18d3 in_seq=0 out_seq=0 2024-09-21T06:45:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f650effd640 1 -- 172.21.15.49:0/716215377 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dede809640 con 0x55dede4abd80 2024-09-21T06:45:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f650effd640 10 client.17514 handle_command_reply: tid=0 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 client.17514 shutdown 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 -- 172.21.15.49:0/716215377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 msgr2=0x55dede89e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede89e580 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f6520012740 tx=0x7f6520012c00 comp rx=0 tx=0).stop 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 -- 172.21.15.49:0/716215377 shutdown_connections 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dede4abd80 0x55dede8b02a0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f650effd640 0 client.17514 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4ed1b0 0x55dede8aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4cc4d0 0x55dede89e580 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 --2- 172.21.15.49:0/716215377 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede89e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 -- 172.21.15.49:0/716215377 >> 172.21.15.49:0/716215377 conn(0x55dede4e1300 msgr2=0x55dede8939e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 -- 172.21.15.49:0/716215377 shutdown_connections 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 1 -- 172.21.15.49:0/716215377 wait complete. 2024-09-21T06:45:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.924+0000 7f653d016740 20 client.17514 trim_cache size 0 max 16384 2024-09-21T06:45:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.939+0000 7f653d016740 1 Processor -- start 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.939+0000 7f653d016740 1 -- start start 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.939+0000 7f653d016740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4abd80 0x55dede8943a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.939+0000 7f653d016740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede89fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.939+0000 7f653d016740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 0x55dede89b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.939+0000 7f653d016740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f65301b2030 con 0x55dede4abd80 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.939+0000 7f653d016740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65301af900 con 0x55dede4cc4d0 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.939+0000 7f653d016740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f65301ad770 con 0x55dede4c42f0 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4abd80 0x55dede8943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4abd80 0x55dede8943a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38142/0 (socket says 172.21.15.49:38142) 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652effd640 1 -- 172.21.15.49:0/2551020622 learned_addr learned my addr 172.21.15.49:0/2551020622 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652f7fe640 1 --2- 172.21.15.49:0/2551020622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede89fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652effd640 1 -- 172.21.15.49:0/2551020622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 msgr2=0x55dede89fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652effd640 1 --2- 172.21.15.49:0/2551020622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede89fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652effd640 1 -- 172.21.15.49:0/2551020622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 msgr2=0x55dede89b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652effd640 1 --2- 172.21.15.49:0/2551020622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 0x55dede89b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652effd640 1 -- 172.21.15.49:0/2551020622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dede894ce0 con 0x55dede4abd80 2024-09-21T06:45:01.943 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f652effd640 1 --2- 172.21.15.49:0/2551020622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4abd80 0x55dede8943a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6524010800 tx=0x7f652400bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfa316e51a19baf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.940+0000 7f65157fa640 1 -- 172.21.15.49:0/2551020622 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524038070 con 0x55dede4abd80 2024-09-21T06:45:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.941+0000 7f65157fa640 1 -- 172.21.15.49:0/2551020622 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6524010da0 con 0x55dede4abd80 2024-09-21T06:45:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.941+0000 7f65157fa640 1 -- 172.21.15.49:0/2551020622 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6524004ea0 con 0x55dede4abd80 2024-09-21T06:45:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.941+0000 7f653d016740 1 -- 172.21.15.49:0/2551020622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4abd80 msgr2=0x55dede8943a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.941+0000 7f653d016740 1 --2- 172.21.15.49:0/2551020622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4abd80 0x55dede8943a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6524010800 tx=0x7f652400bb30 comp rx=0 tx=0).stop 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.941+0000 7f653d016740 1 -- 172.21.15.49:0/2551020622 shutdown_connections 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.941+0000 7f653d016740 1 --2- 172.21.15.49:0/2551020622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 0x55dede89b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.941+0000 7f653d016740 1 --2- 172.21.15.49:0/2551020622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4c42f0 0x55dede89fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.941+0000 7f653d016740 1 --2- 172.21.15.49:0/2551020622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4abd80 0x55dede8943a0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.941+0000 7f653d016740 1 -- 172.21.15.49:0/2551020622 >> 172.21.15.49:0/2551020622 conn(0x55dede4e1300 msgr2=0x55dede89f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.942+0000 7f653d016740 1 -- 172.21.15.49:0/2551020622 shutdown_connections 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.942+0000 7f653d016740 1 -- 172.21.15.49:0/2551020622 wait complete. 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.942+0000 7f653d016740 1 -- start start 2024-09-21T06:45:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.942+0000 7f653d016740 1 Processor -- start 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.942+0000 7f653d016740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4abd80 0x55dede8a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.942+0000 7f653d016740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4c42f0 0x55dede8a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.942+0000 7f653d016740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 0x55dede8a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f653d016740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f65301addc0 con 0x55dede4c42f0 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f653d016740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f65301af230 con 0x55dede4cc4d0 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f653d016740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f65301ae490 con 0x55dede4abd80 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f653d016740 10 client.0 _ll_register_callbacks cb 0x7f6520009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4c42f0 0x55dede8a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4c42f0 0x55dede8a3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38152/0 (socket says 172.21.15.49:38152) 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652f7fe640 1 -- 172.21.15.49:0/1601310066 learned_addr learned my addr 172.21.15.49:0/1601310066 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652effd640 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4abd80 0x55dede8a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652effd640 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 0x55dede8a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652f7fe640 1 -- 172.21.15.49:0/1601310066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4abd80 msgr2=0x55dede8a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652f7fe640 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4abd80 0x55dede8a69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652f7fe640 1 -- 172.21.15.49:0/1601310066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 msgr2=0x55dede8a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652f7fe640 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 0x55dede8a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652f7fe640 1 -- 172.21.15.49:0/1601310066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dede8a4960 con 0x55dede4c42f0 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652effd640 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 0x55dede8a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f652f7fe640 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4c42f0 0x55dede8a3eb0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f652001ca00 tx=0x7f652000ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ad0d44dfd284e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f650effd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f650effd640 1 -- 172.21.15.49:0/1601310066 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652000f920 con 0x55dede4c42f0 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f653d016740 1 -- 172.21.15.49:0/1601310066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6524010da0 con 0x55dede4c42f0 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.943+0000 7f650effd640 1 -- 172.21.15.49:0/1601310066 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f652000fac0 con 0x55dede4c42f0 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f650effd640 1 -- 172.21.15.49:0/1601310066 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6520005040 con 0x55dede4c42f0 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f653d016740 10 client.17520 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f653d016740 1 -- 172.21.15.49:0/1601310066 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dede91a9a0 con 0x55dede4c42f0 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f650effd640 1 -- 172.21.15.49:0/1601310066 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6524010da0 con 0x55dede4c42f0 2024-09-21T06:45:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f650effd640 1 -- 172.21.15.49:0/1601310066 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f652002b060 con 0x55dede4c42f0 2024-09-21T06:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f653d016740 10 client.17520 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f653d016740 10 client.17520 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f653d016740 20 client.17520 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f653d016740 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dede4ed1b0 0x55dede91d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f653d016740 4 client.17520 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.944+0000 7f653d016740 1 -- 172.21.15.49:0/1601310066 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dede8050f0 con 0x55dede4ed1b0 2024-09-21T06:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.945+0000 7f652effd640 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dede4ed1b0 0x55dede91d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.945+0000 7f652effd640 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dede4ed1b0 0x55dede91d170 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00afd73e2e315d5 server_cookie=b4b2832f94be00c5 in_seq=0 out_seq=0 2024-09-21T06:45:01.950 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:01.945+0000 7f650effd640 10 client.17520 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.958+0000 7fed7539d640 1 -- 172.21.15.49:0/3719140083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 msgr2=0x7fed70104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.958+0000 7fed7539d640 1 --2- 172.21.15.49:0/3719140083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 0x7fed70104e40 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fed60009900 tx=0x7fed6002a410 comp rx=0 tx=0).stop 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.958+0000 7fed7539d640 1 -- 172.21.15.49:0/3719140083 shutdown_connections 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.958+0000 7fed7539d640 1 --2- 172.21.15.49:0/3719140083 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7010de60 0x7fed70110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.958+0000 7fed7539d640 1 --2- 172.21.15.49:0/3719140083 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed70105380 0x7fed7010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.958+0000 7fed7539d640 1 --2- 172.21.15.49:0/3719140083 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 0x7fed70104e40 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.958+0000 7fed7539d640 1 -- 172.21.15.49:0/3719140083 >> 172.21.15.49:0/3719140083 conn(0x7fed700797b0 msgr2=0x7fed70079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.958+0000 7fed7539d640 1 -- 172.21.15.49:0/3719140083 shutdown_connections 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.958+0000 7fed7539d640 1 -- 172.21.15.49:0/3719140083 wait complete. 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed7539d640 1 Processor -- start 2024-09-21T06:45:01.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed7539d640 1 -- start start 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed7539d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 0x7fed7019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed7539d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed70105380 0x7fed7019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed7539d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7010de60 0x7fed7019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed7539d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fed70113ac0 con 0x7fed70104a30 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed7539d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed70113940 con 0x7fed7010de60 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed7539d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fed70113c40 con 0x7fed70105380 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed6effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 0x7fed7019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed6effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 0x7fed7019a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38168/0 (socket says 172.21.15.49:38168) 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.960+0000 7fed6effd640 1 -- 172.21.15.49:0/3610470482 learned_addr learned my addr 172.21.15.49:0/3610470482 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed6e7fc640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed70105380 0x7fed7019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7010de60 0x7fed7019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed6effd640 1 -- 172.21.15.49:0/3610470482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed70105380 msgr2=0x7fed7019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed6effd640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed70105380 0x7fed7019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed6effd640 1 -- 172.21.15.49:0/3610470482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7010de60 msgr2=0x7fed7019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed6effd640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7010de60 0x7fed7019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed6effd640 1 -- 172.21.15.49:0/3610470482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed701a0400 con 0x7fed70104a30 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7010de60 0x7fed7019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed6effd640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 0x7fed7019a490 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fed60005940 tx=0x7fed60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed57fff640 1 -- 172.21.15.49:0/3610470482 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6003f030 con 0x7fed70104a30 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed57fff640 1 -- 172.21.15.49:0/3610470482 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed60003aa0 con 0x7fed70104a30 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed7539d640 1 -- 172.21.15.49:0/3610470482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed701a0690 con 0x7fed70104a30 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.961+0000 7fed57fff640 1 -- 172.21.15.49:0/3610470482 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed60035070 con 0x7fed70104a30 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.962+0000 7fed7539d640 1 -- 172.21.15.49:0/3610470482 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed701a6e50 con 0x7fed70104a30 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.964+0000 7fed7b911740 1 Processor -- start 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.964+0000 7fed7b911740 1 -- start start 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed57fff640 1 -- 172.21.15.49:0/3610470482 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fed60042030 con 0x7fed70104a30 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed7b911740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed7b911740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535a77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed7b911740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531df390 0x556e535a7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.974 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed7b911740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556e5351de50 con 0x556e53200070 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed7b911740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556e5350d280 con 0x556e531d71b0 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed7b911740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556e53511090 con 0x556e531df390 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38178/0 (socket says 172.21.15.49:38178) 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6f7fe640 1 -- 172.21.15.49:0/73743774 learned_addr learned my addr 172.21.15.49:0/73743774 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6effd640 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535a77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6e7fc640 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531df390 0x556e535a7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6f7fe640 1 -- 172.21.15.49:0/73743774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531df390 msgr2=0x556e535a7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531df390 0x556e535a7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6f7fe640 1 -- 172.21.15.49:0/73743774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 msgr2=0x556e535a77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535a77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6f7fe640 1 -- 172.21.15.49:0/73743774 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e5326b650 con 0x556e53200070 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.965+0000 7fed6effd640 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535a77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:01.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.966+0000 7fed57fff640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fed580b6680 0x7fed580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.966+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535a7270 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fed68009ea0 tx=0x7fed68009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598177b69fb0a24f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.966+0000 7fed6effd640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fed580b6680 0x7fed580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.966+0000 7fed57fff640 1 -- 172.21.15.49:0/3610470482 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fed60107f20 con 0x7fed70104a30 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.966+0000 7fed557fa640 1 -- 172.21.15.49:0/73743774 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68004d20 con 0x556e53200070 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.966+0000 7fed557fa640 1 -- 172.21.15.49:0/73743774 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed680054d0 con 0x556e53200070 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.966+0000 7fed557fa640 1 -- 172.21.15.49:0/73743774 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68011860 con 0x556e53200070 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 -- 172.21.15.49:0/73743774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 msgr2=0x556e535a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed6effd640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fed580b6680 0x7fed580b8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fed601056d0 tx=0x7fed6010ba70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535a7270 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fed68009ea0 tx=0x7fed68009f90 comp rx=0 tx=0).stop 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 -- 172.21.15.49:0/73743774 shutdown_connections 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531df390 0x556e535a7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535a77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 --2- 172.21.15.49:0/73743774 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535a7270 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 -- 172.21.15.49:0/73743774 >> 172.21.15.49:0/73743774 conn(0x556e531f4460 msgr2=0x556e535a5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:01.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 -- 172.21.15.49:0/73743774 shutdown_connections 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 -- 172.21.15.49:0/73743774 wait complete. 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.967+0000 7fed7b911740 1 -- start start 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed7b911740 1 Processor -- start 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed7b911740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed7b911740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531df390 0x556e535b72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed7b911740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 0x556e535c30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed7b911740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556e5336e700 con 0x556e531df390 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed7b911740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556e534a8110 con 0x556e531d71b0 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed7b911740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556e535b9d80 con 0x556e53200070 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed7b911740 10 client.0 _ll_register_callbacks cb 0x556e534c1990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed6e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531df390 0x556e535b72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed6e7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531df390 0x556e535b72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38184/0 (socket says 172.21.15.49:38184) 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed6e7fc640 1 -- 172.21.15.49:0/623368396 learned_addr learned my addr 172.21.15.49:0/623368396 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.968+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 0x556e535c30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed6e7fc640 1 -- 172.21.15.49:0/623368396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 msgr2=0x556e535c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed6e7fc640 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 0x556e535c30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed6e7fc640 1 -- 172.21.15.49:0/623368396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 msgr2=0x556e535b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed6e7fc640 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed6e7fc640 1 -- 172.21.15.49:0/623368396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e534d5c40 con 0x556e531df390 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 0x556e535c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed6e7fc640 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531df390 0x556e535b72b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fed640126e0 tx=0x7fed64012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d42de5a4d1e4dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed52ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed52ff5640 1 -- 172.21.15.49:0/623368396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64004020 con 0x556e531df390 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed7b911740 1 -- 172.21.15.49:0/623368396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed680054d0 con 0x556e531df390 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed52ff5640 1 -- 172.21.15.49:0/623368396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fed640041c0 con 0x556e531df390 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed52ff5640 1 -- 172.21.15.49:0/623368396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed6402d050 con 0x556e531df390 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed7b911740 10 client.17532 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.969+0000 7fed7b911740 1 -- 172.21.15.49:0/623368396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556e535ad650 con 0x556e531df390 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.970+0000 7fed52ff5640 1 -- 172.21.15.49:0/623368396 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed680054d0 con 0x556e531df390 2024-09-21T06:45:01.978 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.970+0000 7fed52ff5640 1 -- 172.21.15.49:0/623368396 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fed6401dc40 con 0x556e531df390 2024-09-21T06:45:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.970+0000 7fed7b911740 10 client.17532 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.970+0000 7fed7b911740 10 client.17532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.970+0000 7fed7b911740 20 client.17532 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.970+0000 7fed7b911740 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556e531be9f0 0x556e535b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.970+0000 7fed7b911740 4 client.17532 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.970+0000 7fed7b911740 1 -- 172.21.15.49:0/623368396 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e5351fda0 con 0x556e531be9f0 2024-09-21T06:45:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.970+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556e531be9f0 0x556e535b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.971+0000 7fed52ff5640 10 client.17532 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:01.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.971+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556e531be9f0 0x556e535b0bb0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=140f5192a32be213 server_cookie=6144f43a66e9f2c8 in_seq=0 out_seq=0 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.971+0000 7fed52ff5640 1 -- 172.21.15.49:0/623368396 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556e5351fda0 con 0x556e531be9f0 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.971+0000 7fed52ff5640 10 client.17532 handle_command_reply: tid=0 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.971+0000 7fed7b911740 1 client.17532 shutdown 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 -- 172.21.15.49:0/623368396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531df390 msgr2=0x556e535b72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531df390 0x556e535b72b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fed640126e0 tx=0x7fed64012ba0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 -- 172.21.15.49:0/623368396 shutdown_connections 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556e531be9f0 0x556e535b0bb0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed52ff5640 0 client.17532 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 0x556e535c30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531df390 0x556e535b72b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 --2- 172.21.15.49:0/623368396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 -- 172.21.15.49:0/623368396 >> 172.21.15.49:0/623368396 conn(0x556e531f4460 msgr2=0x556e535a3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 -- 172.21.15.49:0/623368396 shutdown_connections 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 1 -- 172.21.15.49:0/623368396 wait complete. 2024-09-21T06:45:01.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.972+0000 7fed7b911740 20 client.17532 trim_cache size 0 max 16384 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.989+0000 7fed7b911740 1 Processor -- start 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.989+0000 7fed7b911740 1 -- start start 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed7b911740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531be9f0 0x556e535b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed7b911740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed7b911740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed7b911740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fed701afec0 con 0x556e53200070 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed7b911740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed701ad790 con 0x556e531d71b0 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed7b911740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fed701ab600 con 0x556e531be9f0 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38200/0 (socket says 172.21.15.49:38200) 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 -- 172.21.15.49:0/4091671823 learned_addr learned my addr 172.21.15.49:0/4091671823 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/4091671823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531be9f0 0x556e535b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6e7fc640 1 --2- 172.21.15.49:0/4091671823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.992 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 -- 172.21.15.49:0/4091671823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531be9f0 msgr2=0x556e535b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/4091671823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531be9f0 0x556e535b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 -- 172.21.15.49:0/4091671823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 msgr2=0x556e535b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/4091671823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 -- 172.21.15.49:0/4091671823 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e535b8030 con 0x556e53200070 2024-09-21T06:45:01.993 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.990+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/4091671823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535b3f60 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fed68000f80 tx=0x7fed6800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcdc7539e7f20c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.991+0000 7fed54ff9640 1 -- 172.21.15.49:0/4091671823 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68033070 con 0x556e53200070 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.991+0000 7fed54ff9640 1 -- 172.21.15.49:0/4091671823 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed68004e00 con 0x556e53200070 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.991+0000 7fed54ff9640 1 -- 172.21.15.49:0/4091671823 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed680119d0 con 0x556e53200070 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 -- 172.21.15.49:0/4091671823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 msgr2=0x556e535b3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 --2- 172.21.15.49:0/4091671823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535b3f60 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fed68000f80 tx=0x7fed6800ff90 comp rx=0 tx=0).stop 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 -- 172.21.15.49:0/4091671823 shutdown_connections 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 --2- 172.21.15.49:0/4091671823 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e53200070 0x556e535b3f60 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 --2- 172.21.15.49:0/4091671823 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 --2- 172.21.15.49:0/4091671823 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e531be9f0 0x556e535b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 -- 172.21.15.49:0/4091671823 >> 172.21.15.49:0/4091671823 conn(0x556e531f4460 msgr2=0x556e535b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:01.995 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 -- 172.21.15.49:0/4091671823 shutdown_connections 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 -- 172.21.15.49:0/4091671823 wait complete. 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 -- start start 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.992+0000 7fed7b911740 1 Processor -- start 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed7b911740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531be9f0 0x556e535c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed7b911740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed7b911740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 0x556e53627f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed7b911740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fed701abc50 con 0x556e531be9f0 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed7b911740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fed701ad0c0 con 0x556e531d71b0 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed7b911740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fed701ac320 con 0x556e53200070 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed7b911740 10 client.0 _ll_register_callbacks cb 0x7fed64009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531be9f0 0x556e535c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531be9f0 0x556e535c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38212/0 (socket says 172.21.15.49:38212) 2024-09-21T06:45:01.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 -- 172.21.15.49:0/3865844529 learned_addr learned my addr 172.21.15.49:0/3865844529 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6e7fc640 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 0x556e53627f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 -- 172.21.15.49:0/3865844529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 msgr2=0x556e53627f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 0x556e53627f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 -- 172.21.15.49:0/3865844529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 msgr2=0x556e535c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 -- 172.21.15.49:0/3865844529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e53628590 con 0x556e531be9f0 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed6f7fe640 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531be9f0 0x556e535c86d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fed68009e70 tx=0x7fed680099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596461d8351a469 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed52ff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.993+0000 7fed52ff5640 1 -- 172.21.15.49:0/3865844529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68033040 con 0x556e531be9f0 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed52ff5640 1 -- 172.21.15.49:0/3865844529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7fed68005340 con 0x556e531be9f0 2024-09-21T06:45:01.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed7b911740 1 -- 172.21.15.49:0/3865844529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed68004e00 con 0x556e531be9f0 2024-09-21T06:45:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed52ff5640 1 -- 172.21.15.49:0/3865844529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fed68005540 con 0x556e531be9f0 2024-09-21T06:45:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed7b911740 10 client.17538 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed7b911740 1 -- 172.21.15.49:0/3865844529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556e5362f990 con 0x556e531be9f0 2024-09-21T06:45:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed52ff5640 1 -- 172.21.15.49:0/3865844529 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed68004e00 con 0x556e531be9f0 2024-09-21T06:45:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed52ff5640 1 -- 172.21.15.49:0/3865844529 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fed68039070 con 0x556e531be9f0 2024-09-21T06:45:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed7b911740 10 client.17538 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed7b911740 10 client.17538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:01.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed7b911740 20 client.17538 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed7b911740 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556e53193da0 0x556e53631dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed7b911740 4 client.17538 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed7b911740 1 -- 172.21.15.49:0/3865844529 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556e5351b850 con 0x556e53193da0 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.994+0000 7fed6e7fc640 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556e53193da0 0x556e53631dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed52ff5640 10 client.17538 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed6e7fc640 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556e53193da0 0x556e53631dd0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b3652f06a29623 server_cookie=d84a785e2122952b in_seq=0 out_seq=0 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed52ff5640 1 -- 172.21.15.49:0/3865844529 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x556e5351b850 con 0x556e53193da0 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed52ff5640 10 client.17538 handle_command_reply: tid=0 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed7b911740 1 client.17538 shutdown 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed7b911740 1 -- 172.21.15.49:0/3865844529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531be9f0 msgr2=0x556e535c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed7b911740 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531be9f0 0x556e535c86d0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fed68009e70 tx=0x7fed680099b0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed7b911740 1 -- 172.21.15.49:0/3865844529 shutdown_connections 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed7b911740 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556e53193da0 0x556e53631dd0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.995+0000 7fed7b911740 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556e53200070 0x556e53627f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.996+0000 7fed52ff5640 0 client.17538 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:02.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.996+0000 7fed7b911740 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556e531d71b0 0x556e535c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.996+0000 7fed7b911740 1 --2- 172.21.15.49:0/3865844529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556e531be9f0 0x556e535c86d0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.996+0000 7fed7b911740 1 -- 172.21.15.49:0/3865844529 >> 172.21.15.49:0/3865844529 conn(0x556e531f4460 msgr2=0x556e535b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.996+0000 7fed7b911740 1 -- 172.21.15.49:0/3865844529 shutdown_connections 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.996+0000 7fed7b911740 1 -- 172.21.15.49:0/3865844529 wait complete. 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.996+0000 7fed7b911740 20 client.17538 trim_cache size 0 max 16384 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.001 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:45:02.002 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:45:02.003 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:45:02.004 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:45:02.005 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:45:02.006 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:45:02.007 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:02.008 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:02.008 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:02.008 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:02.008 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:02.008 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:02.008 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:02.008 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:45:02.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 -- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fed580b6680 msgr2=0x7fed580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fed580b6680 0x7fed580b8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fed601056d0 tx=0x7fed6010ba70 comp rx=0 tx=0).stop 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 -- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 msgr2=0x7fed7019a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 0x7fed7019a490 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fed60005940 tx=0x7fed60004270 comp rx=0 tx=0).stop 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 -- 172.21.15.49:0/3610470482 shutdown_connections 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fed580b6680 0x7fed580b8b90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fed7010de60 0x7fed7019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fed70105380 0x7fed7019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 --2- 172.21.15.49:0/3610470482 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fed70104a30 0x7fed7019a490 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 -- 172.21.15.49:0/3610470482 >> 172.21.15.49:0/3610470482 conn(0x7fed700797b0 msgr2=0x7fed70100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 -- 172.21.15.49:0/3610470482 shutdown_connections 2024-09-21T06:45:02.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:01.997+0000 7fed7539d640 1 -- 172.21.15.49:0/3610470482 wait complete. 2024-09-21T06:45:02.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:01 smithi098 ceph-mon[34704]: pgmap v574: 97 pgs: 97 active+clean; 8.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T06:45:02.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:01 smithi079 ceph-mon[34346]: pgmap v574: 97 pgs: 97 active+clean; 8.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 11 op/s 2024-09-21T06:45:02.197 INFO:tasks.workunit.client.0.smithi049.stdout:375/600: open fd = 3 2024-09-21T06:45:02.197 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.197 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:376/600: open fd = 3 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:377/600: open fd = 3 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:378/600: open fd = 3 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.198 INFO:tasks.workunit.client.0.smithi049.stdout:379/600: open fd = 3 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:380/600: open fd = 3 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:381/600: open fd = 3 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:382/600: open fd = 3 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:383/600: open fd = 3 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:384/600: open fd = 3 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:385/600: open fd = 3 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:386/600: open fd = 3 2024-09-21T06:45:02.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:387/600: open fd = 3 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:388/600: open fd = 3 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:389/600: open fd = 3 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.201 INFO:tasks.workunit.client.0.smithi049.stdout:390/600: open fd = 3 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:391/600: open fd = 3 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:392/600: open fd = 3 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:393/600: open fd = 3 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:394/600: open fd = 3 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:395/600: open fd = 3 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:396/600: open fd = 3 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:397/600: open fd = 3 2024-09-21T06:45:02.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:398/600: open fd = 3 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:399/600: open fd = 3 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:400/600: open fd = 3 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.204 INFO:tasks.workunit.client.0.smithi049.stdout:401/600: open fd = 3 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:402/600: open fd = 3 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:403/600: open fd = 3 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:404/600: open fd = 3 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.205 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:405/600: open fd = 3 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:406/600: open fd = 3 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:407/600: open fd = 3 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:408/600: open fd = 3 2024-09-21T06:45:02.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:409/600: open fd = 3 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:410/600: open fd = 3 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:411/600: open fd = 3 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.207 INFO:tasks.workunit.client.0.smithi049.stdout:412/600: open fd = 3 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:413/600: open fd = 3 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:414/600: open fd = 3 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:415/600: open fd = 3 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.208 INFO:tasks.workunit.client.0.smithi049.stdout:416/600: open fd = 3 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:417/600: open fd = 3 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:418/600: open fd = 3 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:419/600: open fd = 3 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.209 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:420/600: open fd = 3 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:421/600: open fd = 3 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:422/600: open fd = 3 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:423/600: open fd = 3 2024-09-21T06:45:02.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:424/600: open fd = 3 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:425/600: open fd = 3 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:426/600: open fd = 3 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:427/600: open fd = 3 2024-09-21T06:45:02.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:428/600: open fd = 3 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:429/600: open fd = 3 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:430/600: open fd = 3 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.212 INFO:tasks.workunit.client.0.smithi049.stdout:431/600: open fd = 3 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:432/600: open fd = 3 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:433/600: open fd = 3 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:434/600: open fd = 3 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.213 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.214 INFO:tasks.workunit.client.0.smithi049.stdout:435/600: open fd = 3 2024-09-21T06:45:02.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.214 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.214 INFO:tasks.workunit.client.0.smithi049.stdout:436/600: open fd = 3 2024-09-21T06:45:02.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:45:02.214 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:45:02.789 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:45:02.789 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:45:03.058 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.546+0000 7f21cf053640 1 -- 172.21.15.49:0/151357898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 msgr2=0x7f21c8075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.546+0000 7f21cf053640 1 --2- 172.21.15.49:0/151357898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 0x7f21c8075b40 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009900 tx=0x7f21bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.546+0000 7f21cf053640 1 -- 172.21.15.49:0/151357898 shutdown_connections 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.546+0000 7f21cf053640 1 --2- 172.21.15.49:0/151357898 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c8110140 0x7f21c8112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.546+0000 7f21cf053640 1 --2- 172.21.15.49:0/151357898 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21c8076080 0x7f21c810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.546+0000 7f21cf053640 1 --2- 172.21.15.49:0/151357898 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 0x7f21c8075b40 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.546+0000 7f21cf053640 1 -- 172.21.15.49:0/151357898 >> 172.21.15.49:0/151357898 conn(0x7f21c807b850 msgr2=0x7f21c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.546+0000 7f21cf053640 1 -- 172.21.15.49:0/151357898 shutdown_connections 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.546+0000 7f21cf053640 1 -- 172.21.15.49:0/151357898 wait complete. 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21cf053640 1 Processor -- start 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21cf053640 1 -- start start 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21cf053640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 0x7f21c819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21cf053640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c8076080 0x7f21c819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21cf053640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21c8110140 0x7f21c81a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21cf053640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f21c8115ca0 con 0x7f21c8075730 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21cf053640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f21c8115b20 con 0x7f21c8076080 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21cf053640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f21c8115e20 con 0x7f21c8110140 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21ccdef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 0x7f21c819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21ccdef640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 0x7f21c819c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38234/0 (socket says 172.21.15.49:38234) 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21ccdef640 1 -- 172.21.15.49:0/1136980183 learned_addr learned my addr 172.21.15.49:0/1136980183 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.547+0000 7f21cd5f0640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21c8110140 0x7f21c81a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21c7fff640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c8076080 0x7f21c819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21ccdef640 1 -- 172.21.15.49:0/1136980183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21c8110140 msgr2=0x7f21c81a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21ccdef640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21c8110140 0x7f21c81a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21ccdef640 1 -- 172.21.15.49:0/1136980183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c8076080 msgr2=0x7f21c819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21ccdef640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c8076080 0x7f21c819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21ccdef640 1 -- 172.21.15.49:0/1136980183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c81a2680 con 0x7f21c8075730 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21cd5f0640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21c8110140 0x7f21c81a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21ccdef640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 0x7f21c819c710 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f21bc005940 tx=0x7f21bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21c5ffb640 1 -- 172.21.15.49:0/1136980183 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc03f030 con 0x7f21c8075730 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c81a2910 con 0x7f21c8075730 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21c5ffb640 1 -- 172.21.15.49:0/1136980183 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21bc003cb0 con 0x7f21c8075730 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21c5ffb640 1 -- 172.21.15.49:0/1136980183 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc035070 con 0x7f21c8075730 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.548+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c81a90d0 con 0x7f21c8075730 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.549+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c8075b40 con 0x7f21c8075730 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.551+0000 7f21c5ffb640 1 -- 172.21.15.49:0/1136980183 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f21bc042030 con 0x7f21c8075730 2024-09-21T06:45:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.552+0000 7f21c5ffb640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21b80b6680 0x7f21b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.552+0000 7f21c7fff640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21b80b6680 0x7f21b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.552+0000 7f21c5ffb640 1 -- 172.21.15.49:0/1136980183 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8594+0+0 (secure 0 0 0) 0x7f21bc108360 con 0x7f21c8075730 2024-09-21T06:45:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.552+0000 7f21c7fff640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21b80b6680 0x7f21b80b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f21b4005fd0 tx=0x7f21b4005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:03.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.555+0000 7f21c5ffb640 1 -- 172.21.15.49:0/1136980183 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21bc0ce860 con 0x7f21c8075730 2024-09-21T06:45:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f650effd640 1 -- 172.21.15.49:0/1601310066 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dede8050f0 con 0x55dede4ed1b0 2024-09-21T06:45:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f650effd640 10 client.17520 handle_command_reply: tid=0 2024-09-21T06:45:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 client.17520 shutdown 2024-09-21T06:45:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 -- 172.21.15.49:0/1601310066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4c42f0 msgr2=0x55dede8a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4c42f0 0x55dede8a3eb0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f652001ca00 tx=0x7f652000ff20 comp rx=0 tx=0).stop 2024-09-21T06:45:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 -- 172.21.15.49:0/1601310066 shutdown_connections 2024-09-21T06:45:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dede4ed1b0 0x55dede91d170 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dede4cc4d0 0x55dede8a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dede4c42f0 0x55dede8a3eb0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f650effd640 0 client.17520 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 --2- 172.21.15.49:0/1601310066 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dede4abd80 0x55dede8a69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 -- 172.21.15.49:0/1601310066 >> 172.21.15.49:0/1601310066 conn(0x55dede4e1300 msgr2=0x55dede88f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.565+0000 7f653d016740 1 -- 172.21.15.49:0/1601310066 shutdown_connections 2024-09-21T06:45:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f653d016740 1 -- 172.21.15.49:0/1601310066 wait complete. 2024-09-21T06:45:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f653d016740 20 client.17520 trim_cache size 0 max 16384 2024-09-21T06:45:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:45:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:45:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:45:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:45:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 -- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65180b6700 msgr2=0x7f65180b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65180b6700 0x7f65180b8c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f65280cb9b0 tx=0x7f65280ca660 comp rx=0 tx=0).stop 2024-09-21T06:45:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 -- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 msgr2=0x7f653019fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 0x7f653019fbe0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f65280098d0 tx=0x7f65280317b0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.574 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 -- 172.21.15.49:0/744218454 shutdown_connections 2024-09-21T06:45:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f65180b6700 0x7f65180b8c10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f653010dd70 0x7f653019fbe0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6530105260 0x7f653019a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 --2- 172.21.15.49:0/744218454 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6530104910 0x7f653019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 -- 172.21.15.49:0/744218454 >> 172.21.15.49:0/744218454 conn(0x7f65300fe3c0 msgr2=0x7f6530100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 -- 172.21.15.49:0/744218454 shutdown_connections 2024-09-21T06:45:03.575 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:03.566+0000 7f6535fc6640 1 -- 172.21.15.49:0/744218454 wait complete. 2024-09-21T06:45:03.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.787+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21c819d840 con 0x7f21c8075730 2024-09-21T06:45:03.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.788+0000 7f21c5ffb640 1 -- 172.21.15.49:0/1136980183 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f21bc0d2c40 con 0x7f21c8075730 2024-09-21T06:45:03.790 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:45:03.790 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:45:03.790 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:45:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21b80b6680 msgr2=0x7f21b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21b80b6680 0x7f21b80b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f21b4005fd0 tx=0x7f21b4005850 comp rx=0 tx=0).stop 2024-09-21T06:45:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 msgr2=0x7f21c819c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 0x7f21c819c710 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f21bc005940 tx=0x7f21bc0042f0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 shutdown_connections 2024-09-21T06:45:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f21b80b6680 0x7f21b80b8b90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f21c8110140 0x7f21c81a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f21c8076080 0x7f21c819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.792 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 --2- 172.21.15.49:0/1136980183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f21c8075730 0x7f21c819c710 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 >> 172.21.15.49:0/1136980183 conn(0x7f21c807b850 msgr2=0x7f21c8109ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 shutdown_connections 2024-09-21T06:45:03.793 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:03.790+0000 7f21cf053640 1 -- 172.21.15.49:0/1136980183 wait complete. 2024-09-21T06:45:04.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:03 smithi098 ceph-mon[34704]: pgmap v575: 97 pgs: 97 active+clean; 8.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-21T06:45:04.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:03 smithi079 ceph-mon[34346]: pgmap v575: 97 pgs: 97 active+clean; 8.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-21T06:45:04.142 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:03 smithi049 ceph-mon[31177]: pgmap v575: 97 pgs: 97 active+clean; 8.5 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 13 op/s 2024-09-21T06:45:04.480 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:45:04.741 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:05.015 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:04 smithi049 ceph-mon[31177]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:45:05.015 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:04 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1136980183' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:05.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:04 smithi098 ceph-mon[34704]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:45:05.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:04 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1136980183' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:05.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:04 smithi079 ceph-mon[34346]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:45:05.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:04 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1136980183' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:05.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.232+0000 7f28ce685640 1 -- 172.21.15.49:0/3441391336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 msgr2=0x7f28c81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.232+0000 7f28ce685640 1 --2- 172.21.15.49:0/3441391336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 0x7f28c81098b0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009900 tx=0x7f28bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:45:05.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.233+0000 7f28ce685640 1 -- 172.21.15.49:0/3441391336 shutdown_connections 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.233+0000 7f28ce685640 1 --2- 172.21.15.49:0/3441391336 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c8109df0 0x7f28c8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.233+0000 7f28ce685640 1 --2- 172.21.15.49:0/3441391336 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 0x7f28c81098b0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.233+0000 7f28ce685640 1 --2- 172.21.15.49:0/3441391336 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c8103b60 0x7f28c8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.233+0000 7f28ce685640 1 -- 172.21.15.49:0/3441391336 >> 172.21.15.49:0/3441391336 conn(0x7f28c807b850 msgr2=0x7f28c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.233+0000 7f28ce685640 1 -- 172.21.15.49:0/3441391336 shutdown_connections 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.233+0000 7f28ce685640 1 -- 172.21.15.49:0/3441391336 wait complete. 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.233+0000 7f28ce685640 1 Processor -- start 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.233+0000 7f28ce685640 1 -- start start 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28ce685640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c8103b60 0x7f28c8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28ce685640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 0x7f28c8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28ce685640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c8109df0 0x7f28c8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28ce685640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28c8113ab0 con 0x7f28c81094a0 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28ce685640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28c8113930 con 0x7f28c8109df0 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28ce685640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28c8113c30 con 0x7f28c8103b60 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28c77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 0x7f28c8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28c77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 0x7f28c8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38256/0 (socket says 172.21.15.49:38256) 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28c77fe640 1 -- 172.21.15.49:0/2084476234 learned_addr learned my addr 172.21.15.49:0/2084476234 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c8103b60 0x7f28c8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28ccc22640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c8109df0 0x7f28c8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28c77fe640 1 -- 172.21.15.49:0/2084476234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c8103b60 msgr2=0x7f28c8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28c77fe640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c8103b60 0x7f28c8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28c77fe640 1 -- 172.21.15.49:0/2084476234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c8109df0 msgr2=0x7f28c8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28c77fe640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c8109df0 0x7f28c8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.234+0000 7f28c77fe640 1 -- 172.21.15.49:0/2084476234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c81a8740 con 0x7f28c81094a0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.235+0000 7f28c77fe640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 0x7f28c8075c50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f28bc006010 tx=0x7f28bc004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.235+0000 7f28c57fa640 1 -- 172.21.15.49:0/2084476234 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc03f030 con 0x7f28c81094a0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.235+0000 7f28ce685640 1 -- 172.21.15.49:0/2084476234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c81a89d0 con 0x7f28c81094a0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.235+0000 7f28c57fa640 1 -- 172.21.15.49:0/2084476234 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28bc003aa0 con 0x7f28c81094a0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.235+0000 7f28c57fa640 1 -- 172.21.15.49:0/2084476234 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28bc035070 con 0x7f28c81094a0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.235+0000 7f28ce685640 1 -- 172.21.15.49:0/2084476234 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c81a8f00 con 0x7f28c81094a0 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.237+0000 7f28d4bf9740 1 Processor -- start 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.237+0000 7f28d4bf9740 1 -- start start 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28c57fa640 1 -- 172.21.15.49:0/2084476234 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f28bc042030 con 0x7f28c81094a0 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061016a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d311b0 0x55a506101be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 0x55a506102120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a506077ea0 con 0x55a505d5a070 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a5060672d0 con 0x55a505d39390 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a50606b0e0 con 0x55a505d311b0 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28ccc22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061016a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28ccc22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061016a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38268/0 (socket says 172.21.15.49:38268) 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28ccc22640 1 -- 172.21.15.49:0/141523321 learned_addr learned my addr 172.21.15.49:0/141523321 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28c7fff640 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d311b0 0x55a506101be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28c77fe640 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 0x55a506102120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28ccc22640 1 -- 172.21.15.49:0/141523321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d311b0 msgr2=0x55a506101be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28ccc22640 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d311b0 0x55a506101be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28ccc22640 1 -- 172.21.15.49:0/141523321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 msgr2=0x55a506102120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28ccc22640 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 0x55a506102120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28ccc22640 1 -- 172.21.15.49:0/141523321 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a505dc5650 con 0x55a505d5a070 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.238+0000 7f28c77fe640 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 0x55a506102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.239+0000 7f28ccc22640 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061016a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009ee0 tx=0x7f28c0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2d2f92b06a632f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.239+0000 7f28c57fa640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28b00b6680 0x7f28b00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.239+0000 7f28ae7fc640 1 -- 172.21.15.49:0/141523321 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0016070 con 0x55a505d5a070 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.239+0000 7f28c57fa640 1 -- 172.21.15.49:0/2084476234 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7f28bc107a20 con 0x7f28c81094a0 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.239+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28b00b6680 0x7f28b00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.239+0000 7f28ae7fc640 1 -- 172.21.15.49:0/141523321 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28c0004d20 con 0x55a505d5a070 2024-09-21T06:45:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.239+0000 7f28ae7fc640 1 -- 172.21.15.49:0/141523321 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c00126d0 con 0x55a505d5a070 2024-09-21T06:45:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 -- 172.21.15.49:0/141523321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 msgr2=0x55a5061016a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28b00b6680 0x7f28b00b8b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55a506100320 tx=0x7f28b8005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061016a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f28c0009ee0 tx=0x7f28c0010740 comp rx=0 tx=0).stop 2024-09-21T06:45:05.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 -- 172.21.15.49:0/141523321 shutdown_connections 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 0x55a506102120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d311b0 0x55a506101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/141523321 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061016a0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 -- 172.21.15.49:0/141523321 >> 172.21.15.49:0/141523321 conn(0x55a505d4e460 msgr2=0x55a5060ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 -- 172.21.15.49:0/141523321 shutdown_connections 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 -- 172.21.15.49:0/141523321 wait complete. 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.240+0000 7f28d4bf9740 1 -- start start 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28d4bf9740 1 Processor -- start 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d311b0 0x55a50610cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 0x55a50610d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061191f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55a505ec8700 con 0x55a505d5a070 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55a506002160 con 0x55a505d311b0 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55a50610fed0 con 0x55a505d39390 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28d4bf9740 10 client.0 _ll_register_callbacks cb 0x55a50601b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28ccc22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061191f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28ccc22640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061191f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38282/0 (socket says 172.21.15.49:38282) 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28ccc22640 1 -- 172.21.15.49:0/2333501783 learned_addr learned my addr 172.21.15.49:0/2333501783 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28c77fe640 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 0x55a50610d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.241+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d311b0 0x55a50610cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28ccc22640 1 -- 172.21.15.49:0/2333501783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 msgr2=0x55a50610d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28ccc22640 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 0x55a50610d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28ccc22640 1 -- 172.21.15.49:0/2333501783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d311b0 msgr2=0x55a50610cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28ccc22640 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d311b0 0x55a50610cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28ccc22640 1 -- 172.21.15.49:0/2333501783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a50602fc90 con 0x55a505d5a070 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28ccc22640 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061191f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f28c0000f80 tx=0x7f28c0004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cc3ea82f1cbe7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28a77fe640 1 -- 172.21.15.49:0/2333501783 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c0028060 con 0x55a505d5a070 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28a77fe640 1 -- 172.21.15.49:0/2333501783 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7f28c00050e0 con 0x55a505d5a070 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2333501783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28c0004d20 con 0x55a505d5a070 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28a77fe640 1 -- 172.21.15.49:0/2333501783 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28c0016070 con 0x55a505d5a070 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28d4bf9740 10 client.17556 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.242+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2333501783 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a50611bbd0 con 0x55a505d5a070 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.243+0000 7f28a77fe640 1 -- 172.21.15.49:0/2333501783 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28c0004d20 con 0x55a505d5a070 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.243+0000 7f28a77fe640 1 -- 172.21.15.49:0/2333501783 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f28c000f040 con 0x55a505d5a070 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.243+0000 7f28d4bf9740 10 client.17556 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.243+0000 7f28d4bf9740 10 client.17556 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.243+0000 7f28d4bf9740 20 client.17556 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.243+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a505d189f0 0x55a50611ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.243+0000 7f28d4bf9740 4 client.17556 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.243+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2333501783 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a506079df0 con 0x55a505d189f0 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.243+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a505d189f0 0x55a50611ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.244+0000 7f28a77fe640 10 client.17556 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.244+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a505d189f0 0x55a50611ef30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=790528299f0cde86 server_cookie=87169f1c9ff7e9d9 in_seq=0 out_seq=0 2024-09-21T06:45:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.244+0000 7f28a77fe640 1 -- 172.21.15.49:0/2333501783 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a506079df0 con 0x55a505d189f0 2024-09-21T06:45:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.244+0000 7f28a77fe640 10 client.17556 handle_command_reply: tid=0 2024-09-21T06:45:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.244+0000 7f28d4bf9740 1 client.17556 shutdown 2024-09-21T06:45:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2333501783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 msgr2=0x55a5061191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061191f0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f28c0000f80 tx=0x7f28c0004c70 comp rx=0 tx=0).stop 2024-09-21T06:45:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2333501783 shutdown_connections 2024-09-21T06:45:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a505d189f0 0x55a50611ef30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d5a070 0x55a5061191f0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 0x55a50610d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2333501783 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d311b0 0x55a50610cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2333501783 >> 172.21.15.49:0/2333501783 conn(0x55a505d4e460 msgr2=0x55a5061026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28a77fe640 0 client.17556 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:45:05.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2333501783 shutdown_connections 2024-09-21T06:45:05.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2333501783 wait complete. 2024-09-21T06:45:05.251 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.245+0000 7f28d4bf9740 20 client.17556 trim_cache size 0 max 16384 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.258+0000 7f28d4bf9740 1 Processor -- start 2024-09-21T06:45:05.260 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.258+0000 7f28d4bf9740 1 -- start start 2024-09-21T06:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.258+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a506102d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.258+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 0x55a5060ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.258+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d5a070 0x55a506119160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.258+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81b4440 con 0x55a505d311b0 2024-09-21T06:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.258+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81b1d10 con 0x55a505d5a070 2024-09-21T06:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.258+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81afb80 con 0x55a505d39390 2024-09-21T06:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a506102d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a506102d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38288/0 (socket says 172.21.15.49:38288) 2024-09-21T06:45:05.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c7fff640 1 -- 172.21.15.49:0/2308950511 learned_addr learned my addr 172.21.15.49:0/2308950511 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c77fe640 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 0x55a5060ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28ccc22640 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d5a070 0x55a506119160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c7fff640 1 -- 172.21.15.49:0/2308950511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 msgr2=0x55a5060ff5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 0x55a5060ff5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c7fff640 1 -- 172.21.15.49:0/2308950511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d5a070 msgr2=0x55a506119160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d5a070 0x55a506119160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c7fff640 1 -- 172.21.15.49:0/2308950511 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a50610b280 con 0x55a505d311b0 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28ccc22640 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d5a070 0x55a506119160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a506102d40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f28c8077160 tx=0x7f28b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c7e39ebd4598d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28adffb640 1 -- 172.21.15.49:0/2308950511 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8021e50 con 0x55a505d311b0 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28adffb640 1 -- 172.21.15.49:0/2308950511 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28b80210d0 con 0x55a505d311b0 2024-09-21T06:45:05.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.259+0000 7f28adffb640 1 -- 172.21.15.49:0/2308950511 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8003c80 con 0x55a505d311b0 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.260+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2308950511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 msgr2=0x55a506102d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.260+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a506102d40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f28c8077160 tx=0x7f28b8017000 comp rx=0 tx=0).stop 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.260+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2308950511 shutdown_connections 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.260+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d5a070 0x55a506119160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.260+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d39390 0x55a5060ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.260+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2308950511 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a506102d40 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.260+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2308950511 >> 172.21.15.49:0/2308950511 conn(0x55a505d4e460 msgr2=0x55a5060feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.260+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2308950511 shutdown_connections 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.260+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2308950511 wait complete. 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28d4bf9740 1 -- start start 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28d4bf9740 1 Processor -- start 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a50611faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 0x55a506120090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28d4bf9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d5a070 0x55a5061806d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81b01d0 con 0x55a505d311b0 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81b1640 con 0x55a505d39390 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28d4bf9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f28c81b08a0 con 0x55a505d5a070 2024-09-21T06:45:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28d4bf9740 10 client.0 _ll_register_callbacks cb 0x7f28b80095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a50611faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28c7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a50611faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38300/0 (socket says 172.21.15.49:38300) 2024-09-21T06:45:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28c7fff640 1 -- 172.21.15.49:0/2712077889 learned_addr learned my addr 172.21.15.49:0/2712077889 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.261+0000 7f28ccc22640 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d5a070 0x55a5061806d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28c77fe640 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 0x55a506120090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28c7fff640 1 -- 172.21.15.49:0/2712077889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d5a070 msgr2=0x55a5061806d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d5a070 0x55a5061806d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28c7fff640 1 -- 172.21.15.49:0/2712077889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 msgr2=0x55a506120090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 0x55a506120090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28c7fff640 1 -- 172.21.15.49:0/2712077889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a506180d40 con 0x55a505d311b0 2024-09-21T06:45:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28c7fff640 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a50611faf0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f28b8019040 tx=0x7f28b8003900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4ced5d15b74b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28a77fe640 1 -- 172.21.15.49:0/2712077889 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b8036070 con 0x55a505d311b0 2024-09-21T06:45:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2712077889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28b80210d0 con 0x55a505d311b0 2024-09-21T06:45:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28a77fe640 1 -- 172.21.15.49:0/2712077889 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7f28b8004050 con 0x55a505d311b0 2024-09-21T06:45:05.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28a77fe640 1 -- 172.21.15.49:0/2712077889 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28b8041050 con 0x55a505d311b0 2024-09-21T06:45:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28d4bf9740 10 client.17562 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.262+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2712077889 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a5061891d0 con 0x55a505d311b0 2024-09-21T06:45:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.263+0000 7f28a77fe640 1 -- 172.21.15.49:0/2712077889 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28b80210d0 con 0x55a505d311b0 2024-09-21T06:45:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.263+0000 7f28a77fe640 1 -- 172.21.15.49:0/2712077889 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f28b80047e0 con 0x55a505d311b0 2024-09-21T06:45:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.263+0000 7f28d4bf9740 10 client.17562 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.263+0000 7f28d4bf9740 10 client.17562 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:45:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.263+0000 7f28d4bf9740 20 client.17562 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.263+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a505cedda0 0x55a50618b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.263+0000 7f28d4bf9740 4 client.17562 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:05.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.263+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2712077889 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a5060758a0 con 0x55a505cedda0 2024-09-21T06:45:05.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.263+0000 7f28c77fe640 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a505cedda0 0x55a50618b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28a77fe640 10 client.17562 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:45:05.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28c77fe640 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a505cedda0 0x55a50618b930 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=774af5915756332b server_cookie=9b093237055d1378 in_seq=0 out_seq=0 2024-09-21T06:45:05.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28a77fe640 1 -- 172.21.15.49:0/2712077889 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a5060758a0 con 0x55a505cedda0 2024-09-21T06:45:05.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28a77fe640 10 client.17562 handle_command_reply: tid=0 2024-09-21T06:45:05.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 client.17562 shutdown 2024-09-21T06:45:05.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2712077889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 msgr2=0x55a50611faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a50611faf0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f28b8019040 tx=0x7f28b8003900 comp rx=0 tx=0).stop 2024-09-21T06:45:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2712077889 shutdown_connections 2024-09-21T06:45:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55a505cedda0 0x55a50618b930 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55a505d5a070 0x55a5061806d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55a505d39390 0x55a506120090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 --2- 172.21.15.49:0/2712077889 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55a505d311b0 0x55a50611faf0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2712077889 >> 172.21.15.49:0/2712077889 conn(0x55a505d4e460 msgr2=0x55a50610cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28a77fe640 0 client.17562 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:45:05.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2712077889 shutdown_connections 2024-09-21T06:45:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 1 -- 172.21.15.49:0/2712077889 wait complete. 2024-09-21T06:45:05.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.264+0000 7f28d4bf9740 20 client.17562 trim_cache size 0 max 16384 2024-09-21T06:45:05.275 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:45:05.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 -- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28b00b6680 msgr2=0x7f28b00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28b00b6680 0x7f28b00b8b90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x55a506100320 tx=0x7f28b8005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:05.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 -- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 msgr2=0x7f28c8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 0x7f28c8075c50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f28bc006010 tx=0x7f28bc004060 comp rx=0 tx=0).stop 2024-09-21T06:45:05.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 -- 172.21.15.49:0/2084476234 shutdown_connections 2024-09-21T06:45:05.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28b00b6680 0x7f28b00b8b90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f28c8109df0 0x7f28c8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f28c81094a0 0x7f28c8075c50 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 --2- 172.21.15.49:0/2084476234 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f28c8103b60 0x7f28c8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 -- 172.21.15.49:0/2084476234 >> 172.21.15.49:0/2084476234 conn(0x7f28c807b850 msgr2=0x7f28c8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 -- 172.21.15.49:0/2084476234 shutdown_connections 2024-09-21T06:45:05.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:05.265+0000 7f28ce685640 1 -- 172.21.15.49:0/2084476234 wait complete. 2024-09-21T06:45:05.902 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:05 smithi049 ceph-mon[31177]: pgmap v577: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 78 KiB/s wr, 32 op/s 2024-09-21T06:45:05.930 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:45:06.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:05 smithi098 ceph-mon[34704]: pgmap v577: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 78 KiB/s wr, 32 op/s 2024-09-21T06:45:06.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:05 smithi079 ceph-mon[34346]: pgmap v577: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 78 KiB/s wr, 32 op/s 2024-09-21T06:45:06.187 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.647+0000 7fc393411640 1 -- 172.21.15.49:0/3290489980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c108d30 msgr2=0x7fc38c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.647+0000 7fc393411640 1 --2- 172.21.15.49:0/3290489980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c108d30 0x7fc38c10f560 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fc384009ca0 tx=0x7fc38402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.647+0000 7fc393411640 1 -- 172.21.15.49:0/3290489980 shutdown_connections 2024-09-21T06:45:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.647+0000 7fc393411640 1 --2- 172.21.15.49:0/3290489980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c108d30 0x7fc38c10f560 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.647+0000 7fc393411640 1 --2- 172.21.15.49:0/3290489980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c1083e0 0x7fc38c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.647+0000 7fc393411640 1 --2- 172.21.15.49:0/3290489980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc38c102aa0 0x7fc38c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.672 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.647+0000 7fc393411640 1 -- 172.21.15.49:0/3290489980 >> 172.21.15.49:0/3290489980 conn(0x7fc38c0797e0 msgr2=0x7fc38c079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.648+0000 7fc393411640 1 -- 172.21.15.49:0/3290489980 shutdown_connections 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.648+0000 7fc393411640 1 -- 172.21.15.49:0/3290489980 wait complete. 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.648+0000 7fc393411640 1 Processor -- start 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.648+0000 7fc393411640 1 -- start start 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.648+0000 7fc393411640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c102aa0 0x7fc38c19b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.648+0000 7fc393411640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc38c1083e0 0x7fc38c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc393411640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c108d30 0x7fc38c19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc393411640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c1129a0 con 0x7fc38c102aa0 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc393411640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c112820 con 0x7fc38c108d30 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc393411640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c112b20 con 0x7fc38c1083e0 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3911ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c102aa0 0x7fc38c19b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3911ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c102aa0 0x7fc38c19b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33650/0 (socket says 172.21.15.49:33650) 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3911ad640 1 -- 172.21.15.49:0/3162354072 learned_addr learned my addr 172.21.15.49:0/3162354072 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:06.673 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3909ac640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc38c1083e0 0x7fc38c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3919ae640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c108d30 0x7fc38c19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3911ad640 1 -- 172.21.15.49:0/3162354072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc38c1083e0 msgr2=0x7fc38c19b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3911ad640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc38c1083e0 0x7fc38c19b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3911ad640 1 -- 172.21.15.49:0/3162354072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c108d30 msgr2=0x7fc38c19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3911ad640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c108d30 0x7fc38c19bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3911ad640 1 -- 172.21.15.49:0/3162354072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc38c1a6450 con 0x7fc38c102aa0 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3909ac640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc38c1083e0 0x7fc38c19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3911ad640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c102aa0 0x7fc38c19b250 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c920 tx=0x7fc38800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3827fc640 1 -- 172.21.15.49:0/3162354072 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388007c70 con 0x7fc38c102aa0 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc393411640 1 -- 172.21.15.49:0/3162354072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc38c1a6740 con 0x7fc38c102aa0 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc393411640 1 -- 172.21.15.49:0/3162354072 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc38c1a6cd0 con 0x7fc38c102aa0 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3827fc640 1 -- 172.21.15.49:0/3162354072 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc388007e10 con 0x7fc38c102aa0 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.649+0000 7fc3827fc640 1 -- 172.21.15.49:0/3162354072 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388018820 con 0x7fc38c102aa0 2024-09-21T06:45:06.674 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.652+0000 7fc399985740 1 Processor -- start 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.652+0000 7fc3827fc640 1 -- 172.21.15.49:0/3162354072 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fc38800f450 con 0x7fc38c102aa0 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.652+0000 7fc399985740 1 -- start start 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc399985740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85e00070 0x557a861a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc399985740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85dd71b0 0x557a861a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc399985740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861a8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc399985740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557a8611dea0 con 0x557a85ddf390 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc399985740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557a8610d2d0 con 0x557a85dd71b0 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc399985740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557a861110e0 con 0x557a85e00070 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3909ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3909ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861a8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33660/0 (socket says 172.21.15.49:33660) 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3909ac640 1 -- 172.21.15.49:0/3884174896 learned_addr learned my addr 172.21.15.49:0/3884174896 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3911ad640 1 --2- 172.21.15.49:0/3884174896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85dd71b0 0x557a861a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3919ae640 1 --2- 172.21.15.49:0/3884174896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85e00070 0x557a861a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.675 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3909ac640 1 -- 172.21.15.49:0/3884174896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85e00070 msgr2=0x557a861a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3909ac640 1 --2- 172.21.15.49:0/3884174896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85e00070 0x557a861a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3909ac640 1 -- 172.21.15.49:0/3884174896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85dd71b0 msgr2=0x557a861a7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3909ac640 1 --2- 172.21.15.49:0/3884174896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85dd71b0 0x557a861a7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3909ac640 1 -- 172.21.15.49:0/3884174896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a85e6b650 con 0x557a85ddf390 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3909ac640 1 --2- 172.21.15.49:0/3884174896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861a8120 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009c20 tx=0x7fc37c00e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d713499d0b810f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.653+0000 7fc3827fc640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3780b66b0 0x7fc3780b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.654+0000 7fc3777fe640 1 -- 172.21.15.49:0/3884174896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c016070 con 0x557a85ddf390 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.654+0000 7fc3919ae640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3780b66b0 0x7fc3780b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.654+0000 7fc3827fc640 1 -- 172.21.15.49:0/3162354072 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7fc3880e79d0 con 0x7fc38c102aa0 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.654+0000 7fc3777fe640 1 -- 172.21.15.49:0/3884174896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc37c0054d0 con 0x557a85ddf390 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.654+0000 7fc3777fe640 1 -- 172.21.15.49:0/3884174896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c011470 con 0x557a85ddf390 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 -- 172.21.15.49:0/3884174896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 msgr2=0x557a861a8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc3919ae640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3780b66b0 0x7fc3780b8bc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc384006010 tx=0x7fc3840093f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 --2- 172.21.15.49:0/3884174896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861a8120 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fc37c009c20 tx=0x7fc37c00e6c0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 -- 172.21.15.49:0/3884174896 shutdown_connections 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 --2- 172.21.15.49:0/3884174896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861a8120 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 --2- 172.21.15.49:0/3884174896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85dd71b0 0x557a861a7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 --2- 172.21.15.49:0/3884174896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85e00070 0x557a861a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 -- 172.21.15.49:0/3884174896 >> 172.21.15.49:0/3884174896 conn(0x557a85df4460 msgr2=0x557a861a5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 -- 172.21.15.49:0/3884174896 shutdown_connections 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 -- 172.21.15.49:0/3884174896 wait complete. 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 -- start start 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.655+0000 7fc399985740 1 Processor -- start 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc399985740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 0x557a861b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc399985740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861b7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc399985740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 0x557a861b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc399985740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557a85f6e700 con 0x557a85ddf390 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc399985740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557a860a8160 con 0x557a85e00070 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc399985740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557a861ba1b0 con 0x557a85dd71b0 2024-09-21T06:45:06.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc399985740 10 client.0 _ll_register_callbacks cb 0x557a860c19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3909ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3909ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861b7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33668/0 (socket says 172.21.15.49:33668) 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3909ac640 1 -- 172.21.15.49:0/1426475738 learned_addr learned my addr 172.21.15.49:0/1426475738 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3911ad640 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 0x557a861b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3919ae640 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 0x557a861b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3909ac640 1 -- 172.21.15.49:0/1426475738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 msgr2=0x557a861b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3909ac640 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 0x557a861b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3909ac640 1 -- 172.21.15.49:0/1426475738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 msgr2=0x557a861b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3909ac640 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 0x557a861b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3909ac640 1 -- 172.21.15.49:0/1426475738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a860d5c90 con 0x557a85ddf390 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3919ae640 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 0x557a861b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc3909ac640 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861b7620 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc37c004b70 tx=0x7fc37c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942d50c505708b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc374ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:06.678 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.656+0000 7fc374ff9640 1 -- 172.21.15.49:0/1426475738 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37c016040 con 0x557a85ddf390 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc399985740 1 -- 172.21.15.49:0/1426475738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc37c0054d0 con 0x557a85ddf390 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc374ff9640 1 -- 172.21.15.49:0/1426475738 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7fc37c004ee0 con 0x557a85ddf390 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc374ff9640 1 -- 172.21.15.49:0/1426475738 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc37c005790 con 0x557a85ddf390 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc399985740 10 client.17574 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc399985740 1 -- 172.21.15.49:0/1426475738 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557a861c5e90 con 0x557a85ddf390 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc374ff9640 1 -- 172.21.15.49:0/1426475738 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc37c0054d0 con 0x557a85ddf390 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc374ff9640 1 -- 172.21.15.49:0/1426475738 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc37c00f040 con 0x557a85ddf390 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc399985740 10 client.17574 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc399985740 10 client.17574 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc399985740 20 client.17574 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc399985740 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x557a85dbe9f0 0x557a861c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc399985740 4 client.17574 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.657+0000 7fc399985740 1 -- 172.21.15.49:0/1426475738 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a8611fdf0 con 0x557a85dbe9f0 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.658+0000 7fc3911ad640 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x557a85dbe9f0 0x557a861c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.679 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.658+0000 7fc374ff9640 10 client.17574 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.658+0000 7fc3911ad640 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x557a85dbe9f0 0x557a861c9250 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34404829ff831309 server_cookie=740233fda93f7f04 in_seq=0 out_seq=0 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc374ff9640 1 -- 172.21.15.49:0/1426475738 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a8611fdf0 con 0x557a85dbe9f0 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc374ff9640 10 client.17574 handle_command_reply: tid=0 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc399985740 1 client.17574 shutdown 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc399985740 1 -- 172.21.15.49:0/1426475738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 msgr2=0x557a861b7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc399985740 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861b7620 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fc37c004b70 tx=0x7fc37c0048f0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc399985740 1 -- 172.21.15.49:0/1426475738 shutdown_connections 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc399985740 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x557a85dbe9f0 0x557a861c9250 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc399985740 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 0x557a861b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc399985740 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85ddf390 0x557a861b7620 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc399985740 1 --2- 172.21.15.49:0/1426475738 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 0x557a861b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc374ff9640 0 client.17574 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.659+0000 7fc399985740 1 -- 172.21.15.49:0/1426475738 >> 172.21.15.49:0/1426475738 conn(0x557a85df4460 msgr2=0x557a861aa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.660+0000 7fc399985740 1 -- 172.21.15.49:0/1426475738 shutdown_connections 2024-09-21T06:45:06.680 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.660+0000 7fc399985740 1 -- 172.21.15.49:0/1426475738 wait complete. 2024-09-21T06:45:06.681 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.660+0000 7fc399985740 20 client.17574 trim_cache size 0 max 16384 2024-09-21T06:45:06.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.673+0000 7fc399985740 1 Processor -- start 2024-09-21T06:45:06.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.673+0000 7fc399985740 1 -- start start 2024-09-21T06:45:06.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.673+0000 7fc399985740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 0x557a861b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.673+0000 7fc399985740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85ddf390 0x557a861b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.673+0000 7fc399985740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85e00070 0x557a861b4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.673+0000 7fc399985740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c1affa0 con 0x557a85e00070 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.673+0000 7fc399985740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c1ad870 con 0x557a85ddf390 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.673+0000 7fc399985740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c1ab6e0 con 0x557a85dd71b0 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.673+0000 7fc3919ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85e00070 0x557a861b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3919ae640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85e00070 0x557a861b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33676/0 (socket says 172.21.15.49:33676) 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3919ae640 1 -- 172.21.15.49:0/2750514181 learned_addr learned my addr 172.21.15.49:0/2750514181 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3909ac640 1 --2- 172.21.15.49:0/2750514181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85ddf390 0x557a861b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3911ad640 1 --2- 172.21.15.49:0/2750514181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 0x557a861b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3919ae640 1 -- 172.21.15.49:0/2750514181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 msgr2=0x557a861b8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3919ae640 1 --2- 172.21.15.49:0/2750514181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 0x557a861b8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3919ae640 1 -- 172.21.15.49:0/2750514181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85ddf390 msgr2=0x557a861b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:06.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3919ae640 1 --2- 172.21.15.49:0/2750514181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85ddf390 0x557a861b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3919ae640 1 -- 172.21.15.49:0/2750514181 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a861b8180 con 0x557a85e00070 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc3919ae640 1 --2- 172.21.15.49:0/2750514181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85e00070 0x557a861b4810 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fc384031e10 tx=0x7fc38403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be83d82609baff3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc376ffd640 1 -- 172.21.15.49:0/2750514181 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3840318e0 con 0x557a85e00070 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc376ffd640 1 -- 172.21.15.49:0/2750514181 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc384036040 con 0x557a85e00070 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.674+0000 7fc376ffd640 1 -- 172.21.15.49:0/2750514181 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc384030940 con 0x557a85e00070 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.675+0000 7fc399985740 1 -- 172.21.15.49:0/2750514181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85e00070 msgr2=0x557a861b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.675+0000 7fc399985740 1 --2- 172.21.15.49:0/2750514181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85e00070 0x557a861b4810 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fc384031e10 tx=0x7fc38403f000 comp rx=0 tx=0).stop 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.675+0000 7fc399985740 1 -- 172.21.15.49:0/2750514181 shutdown_connections 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.675+0000 7fc399985740 1 --2- 172.21.15.49:0/2750514181 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85e00070 0x557a861b4810 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.675+0000 7fc399985740 1 --2- 172.21.15.49:0/2750514181 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85ddf390 0x557a861b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.675+0000 7fc399985740 1 --2- 172.21.15.49:0/2750514181 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85dd71b0 0x557a861b8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.675+0000 7fc399985740 1 -- 172.21.15.49:0/2750514181 >> 172.21.15.49:0/2750514181 conn(0x557a85df4460 msgr2=0x557a861b8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.675+0000 7fc399985740 1 -- 172.21.15.49:0/2750514181 shutdown_connections 2024-09-21T06:45:06.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.675+0000 7fc399985740 1 -- 172.21.15.49:0/2750514181 wait complete. 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc399985740 1 -- start start 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc399985740 1 Processor -- start 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc399985740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85dd71b0 0x557a861bbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc399985740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85ddf390 0x557a861bc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc399985740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 0x557a8622c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc399985740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c1abd30 con 0x557a85dd71b0 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc399985740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c1ad1a0 con 0x557a85e00070 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc399985740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc38c1ac400 con 0x557a85ddf390 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc399985740 10 client.0 _ll_register_callbacks cb 0x7fc3880eb470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc3911ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85dd71b0 0x557a861bbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc3911ad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85dd71b0 0x557a861bbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33692/0 (socket says 172.21.15.49:33692) 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc3911ad640 1 -- 172.21.15.49:0/1341864604 learned_addr learned my addr 172.21.15.49:0/1341864604 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc3919ae640 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 0x557a8622c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.676+0000 7fc3909ac640 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85ddf390 0x557a861bc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc3911ad640 1 -- 172.21.15.49:0/1341864604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85ddf390 msgr2=0x557a861bc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc3911ad640 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85ddf390 0x557a861bc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc3911ad640 1 -- 172.21.15.49:0/1341864604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 msgr2=0x557a8622c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc3911ad640 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 0x557a8622c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc3911ad640 1 -- 172.21.15.49:0/1341864604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a8622d060 con 0x557a85dd71b0 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc3911ad640 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85dd71b0 0x557a861bbe00 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc38801f000 tx=0x7fc38800fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401fdbb1d6a29e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc374ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc374ff9640 1 -- 172.21.15.49:0/1341864604 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3880ad2c0 con 0x557a85dd71b0 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc374ff9640 1 -- 172.21.15.49:0/1341864604 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7fc3880a9a20 con 0x557a85dd71b0 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc399985740 1 -- 172.21.15.49:0/1341864604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc384036040 con 0x557a85dd71b0 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc374ff9640 1 -- 172.21.15.49:0/1341864604 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc3880adeb0 con 0x557a85dd71b0 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc399985740 10 client.17580 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc399985740 1 -- 172.21.15.49:0/1341864604 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557a86234490 con 0x557a85dd71b0 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.677+0000 7fc374ff9640 1 -- 172.21.15.49:0/1341864604 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc384036040 con 0x557a85dd71b0 2024-09-21T06:45:06.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc374ff9640 1 -- 172.21.15.49:0/1341864604 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc3880b6d40 con 0x557a85dd71b0 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc399985740 10 client.17580 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc399985740 10 client.17580 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc399985740 20 client.17580 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc399985740 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x557a85d93da0 0x557a86236bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc399985740 4 client.17580 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc399985740 1 -- 172.21.15.49:0/1341864604 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a8611b8a0 con 0x557a85d93da0 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc3909ac640 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x557a85d93da0 0x557a86236bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc3909ac640 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x557a85d93da0 0x557a86236bb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=87aa6af9ec0330f8 server_cookie=ae18a2c3ee6c186d in_seq=0 out_seq=0 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.678+0000 7fc374ff9640 10 client.17580 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc374ff9640 1 -- 172.21.15.49:0/1341864604 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a8611b8a0 con 0x557a85d93da0 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc374ff9640 10 client.17580 handle_command_reply: tid=0 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 client.17580 shutdown 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 -- 172.21.15.49:0/1341864604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85dd71b0 msgr2=0x557a861bbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:06.690 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85dd71b0 0x557a861bbe00 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fc38801f000 tx=0x7fc38800fcc0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 -- 172.21.15.49:0/1341864604 shutdown_connections 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x557a85d93da0 0x557a86236bb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557a85e00070 0x557a8622c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557a85ddf390 0x557a861bc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 --2- 172.21.15.49:0/1341864604 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557a85dd71b0 0x557a861bbe00 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 -- 172.21.15.49:0/1341864604 >> 172.21.15.49:0/1341864604 conn(0x557a85df4460 msgr2=0x557a861a86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc374ff9640 0 client.17580 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 -- 172.21.15.49:0/1341864604 shutdown_connections 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 1 -- 172.21.15.49:0/1341864604 wait complete. 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.679+0000 7fc399985740 20 client.17580 trim_cache size 0 max 16384 2024-09-21T06:45:06.691 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:45:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 -- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3780b66b0 msgr2=0x7fc3780b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3780b66b0 0x7fc3780b8bc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc384006010 tx=0x7fc3840093f0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 -- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c102aa0 msgr2=0x7fc38c19b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c102aa0 0x7fc38c19b250 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fc38800c920 tx=0x7fc38800cde0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 -- 172.21.15.49:0/3162354072 shutdown_connections 2024-09-21T06:45:06.692 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc3780b66b0 0x7fc3780b8bc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc38c108d30 0x7fc38c19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc38c1083e0 0x7fc38c19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 --2- 172.21.15.49:0/3162354072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc38c102aa0 0x7fc38c19b250 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 -- 172.21.15.49:0/3162354072 >> 172.21.15.49:0/3162354072 conn(0x7fc38c0797e0 msgr2=0x7fc38c1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 -- 172.21.15.49:0/3162354072 shutdown_connections 2024-09-21T06:45:06.693 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:06.680+0000 7fc393411640 1 -- 172.21.15.49:0/3162354072 wait complete. 2024-09-21T06:45:07.421 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:45:07.680 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:08.039 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:07 smithi049 ceph-mon[31177]: pgmap v578: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 81 KiB/s wr, 33 op/s 2024-09-21T06:45:08.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:07 smithi098 ceph-mon[34704]: pgmap v578: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 81 KiB/s wr, 33 op/s 2024-09-21T06:45:08.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:07 smithi079 ceph-mon[34346]: pgmap v578: 97 pgs: 97 active+clean; 8.6 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 81 KiB/s wr, 33 op/s 2024-09-21T06:45:08.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.131+0000 7fadd0be9640 1 -- 172.21.15.49:0/704002725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc1094a0 msgr2=0x7fadcc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.131+0000 7fadd0be9640 1 --2- 172.21.15.49:0/704002725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc1094a0 0x7fadcc1098b0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009ca0 tx=0x7fadc002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.131+0000 7fadd0be9640 1 -- 172.21.15.49:0/704002725 shutdown_connections 2024-09-21T06:45:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.131+0000 7fadd0be9640 1 --2- 172.21.15.49:0/704002725 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadcc109df0 0x7fadcc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.131+0000 7fadd0be9640 1 --2- 172.21.15.49:0/704002725 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc1094a0 0x7fadcc1098b0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.131+0000 7fadd0be9640 1 --2- 172.21.15.49:0/704002725 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc103b60 0x7fadcc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.131+0000 7fadd0be9640 1 -- 172.21.15.49:0/704002725 >> 172.21.15.49:0/704002725 conn(0x7fadcc07b850 msgr2=0x7fadcc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.131+0000 7fadd0be9640 1 -- 172.21.15.49:0/704002725 shutdown_connections 2024-09-21T06:45:08.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.131+0000 7fadd0be9640 1 -- 172.21.15.49:0/704002725 wait complete. 2024-09-21T06:45:08.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadd0be9640 1 Processor -- start 2024-09-21T06:45:08.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadd0be9640 1 -- start start 2024-09-21T06:45:08.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadd0be9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc103b60 0x7fadcc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadd0be9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc1094a0 0x7fadcc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadd0be9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadcc109df0 0x7fadcc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadd0be9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc113ab0 con 0x7fadcc103b60 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadd0be9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc113930 con 0x7fadcc1094a0 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadd0be9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc113c30 con 0x7fadcc109df0 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadca59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc103b60 0x7fadcc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadca59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc103b60 0x7fadcc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33702/0 (socket says 172.21.15.49:33702) 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadca59c640 1 -- 172.21.15.49:0/2826463090 learned_addr learned my addr 172.21.15.49:0/2826463090 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.132+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc1094a0 0x7fadcc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadcad9d640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadcc109df0 0x7fadcc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadca59c640 1 -- 172.21.15.49:0/2826463090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadcc109df0 msgr2=0x7fadcc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadca59c640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadcc109df0 0x7fadcc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadca59c640 1 -- 172.21.15.49:0/2826463090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc1094a0 msgr2=0x7fadcc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadca59c640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc1094a0 0x7fadcc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadca59c640 1 -- 172.21.15.49:0/2826463090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc1a8840 con 0x7fadcc103b60 2024-09-21T06:45:08.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc1094a0 0x7fadcc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:08.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadca59c640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc103b60 0x7fadcc075710 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00d950 tx=0x7fadbc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:08.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadbb7fe640 1 -- 172.21.15.49:0/2826463090 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc017070 con 0x7fadcc103b60 2024-09-21T06:45:08.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadbb7fe640 1 -- 172.21.15.49:0/2826463090 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadbc009c30 con 0x7fadcc103b60 2024-09-21T06:45:08.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadd0be9640 1 -- 172.21.15.49:0/2826463090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc1a8b30 con 0x7fadcc103b60 2024-09-21T06:45:08.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadbb7fe640 1 -- 172.21.15.49:0/2826463090 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc00f620 con 0x7fadcc103b60 2024-09-21T06:45:08.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.133+0000 7fadd0be9640 1 -- 172.21.15.49:0/2826463090 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1a9090 con 0x7fadcc103b60 2024-09-21T06:45:08.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadd715d740 1 Processor -- start 2024-09-21T06:45:08.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadd715d740 1 -- start start 2024-09-21T06:45:08.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadd715d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e5576056a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadd715d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e5572351b0 0x55e557605be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadd715d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557606120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadbb7fe640 1 -- 172.21.15.49:0/2826463090 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fadbc010460 con 0x7fadcc103b60 2024-09-21T06:45:08.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadd715d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e55757bea0 con 0x55e55723d390 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadd715d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e55756b2d0 con 0x55e5572351b0 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadd715d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e55756f0e0 con 0x55e55725e070 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.136+0000 7fadc9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557606120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadc9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557606120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33706/0 (socket says 172.21.15.49:33706) 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadc9d9b640 1 -- 172.21.15.49:0/1911593401 learned_addr learned my addr 172.21.15.49:0/1911593401 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadcad9d640 1 --2- 172.21.15.49:0/1911593401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e5576056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadca59c640 1 --2- 172.21.15.49:0/1911593401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e5572351b0 0x55e557605be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadc9d9b640 1 -- 172.21.15.49:0/1911593401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 msgr2=0x55e5576056a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/1911593401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e5576056a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadc9d9b640 1 -- 172.21.15.49:0/1911593401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e5572351b0 msgr2=0x55e557605be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:08.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/1911593401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e5572351b0 0x55e557605be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadc9d9b640 1 -- 172.21.15.49:0/1911593401 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5572c9650 con 0x55e55723d390 2024-09-21T06:45:08.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/1911593401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557606120 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fadcc06c9f0 tx=0x7fadc0009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd9e4d87518bb78 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:08.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadbb7fe640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fadb40b6700 0x7fadb40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadb8ff9640 1 -- 172.21.15.49:0/1911593401 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0031db0 con 0x55e55723d390 2024-09-21T06:45:08.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadb8ff9640 1 -- 172.21.15.49:0/1911593401 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc0036040 con 0x55e55723d390 2024-09-21T06:45:08.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.137+0000 7fadb8ff9640 1 -- 172.21.15.49:0/1911593401 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc00042a0 con 0x55e55723d390 2024-09-21T06:45:08.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.138+0000 7fadcad9d640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fadb40b6700 0x7fadb40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.138+0000 7fadbb7fe640 1 -- 172.21.15.49:0/2826463090 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7fadbc0e7420 con 0x7fadcc103b60 2024-09-21T06:45:08.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.138+0000 7fadd715d740 1 -- 172.21.15.49:0/1911593401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 msgr2=0x55e557606120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.138+0000 7fadcad9d640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fadb40b6700 0x7fadb40b8c10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005fd0 tx=0x7fadc400d410 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.138+0000 7fadd715d740 1 --2- 172.21.15.49:0/1911593401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557606120 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fadcc06c9f0 tx=0x7fadc0009880 comp rx=0 tx=0).stop 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 -- 172.21.15.49:0/1911593401 shutdown_connections 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 --2- 172.21.15.49:0/1911593401 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557606120 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 --2- 172.21.15.49:0/1911593401 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e5572351b0 0x55e557605be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 --2- 172.21.15.49:0/1911593401 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e5576056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 -- 172.21.15.49:0/1911593401 >> 172.21.15.49:0/1911593401 conn(0x55e557252460 msgr2=0x55e557603590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 -- 172.21.15.49:0/1911593401 shutdown_connections 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 -- 172.21.15.49:0/1911593401 wait complete. 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 -- start start 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 Processor -- start 2024-09-21T06:45:08.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5572351b0 0x55e557610d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.139+0000 7fadd715d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557611280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadd715d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55725e070 0x55e55761d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadd715d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55e5573cc700 con 0x55e55723d390 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadd715d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55e557506160 con 0x55e55725e070 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadd715d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55e557613e20 con 0x55e5572351b0 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadd715d740 10 client.0 _ll_register_callbacks cb 0x55e55751f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadc9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557611280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadc9d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557611280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33718/0 (socket says 172.21.15.49:33718) 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadc9d9b640 1 -- 172.21.15.49:0/2865654839 learned_addr learned my addr 172.21.15.49:0/2865654839 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadca59c640 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5572351b0 0x55e557610d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadcad9d640 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55725e070 0x55e55761d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadc9d9b640 1 -- 172.21.15.49:0/2865654839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5572351b0 msgr2=0x55e557610d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5572351b0 0x55e557610d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadc9d9b640 1 -- 172.21.15.49:0/2865654839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55725e070 msgr2=0x55e55761d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55725e070 0x55e55761d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadc9d9b640 1 -- 172.21.15.49:0/2865654839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e557533c90 con 0x55e55723d390 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557611280 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fadc0003d60 tx=0x7fadc002f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3dcbdec9337ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.140+0000 7fadb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadb1ffb640 1 -- 172.21.15.49:0/2865654839 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0052020 con 0x55e55723d390 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadb1ffb640 1 -- 172.21.15.49:0/2865654839 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7fadc0031db0 con 0x55e55723d390 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadd715d740 1 -- 172.21.15.49:0/2865654839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc0036040 con 0x55e55723d390 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadb1ffb640 1 -- 172.21.15.49:0/2865654839 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fadc005d050 con 0x55e55723d390 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadd715d740 10 client.17592 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadd715d740 1 -- 172.21.15.49:0/2865654839 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e55761fb10 con 0x55e55723d390 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadb1ffb640 1 -- 172.21.15.49:0/2865654839 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadc0036040 con 0x55e55723d390 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadb1ffb640 1 -- 172.21.15.49:0/2865654839 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fadc004d030 con 0x55e55723d390 2024-09-21T06:45:08.148 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadd715d740 10 client.17592 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadd715d740 10 client.17592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadd715d740 20 client.17592 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadd715d740 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e55721c9f0 0x55e557622e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadd715d740 4 client.17592 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.141+0000 7fadd715d740 1 -- 172.21.15.49:0/2865654839 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e55757ddf0 con 0x55e55721c9f0 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.142+0000 7fadca59c640 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e55721c9f0 0x55e557622e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.142+0000 7fadb1ffb640 10 client.17592 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.142+0000 7fadca59c640 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e55721c9f0 0x55e557622e70 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5acdb04d80d53ee server_cookie=3dd17e47122dd9e1 in_seq=0 out_seq=0 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadb1ffb640 1 -- 172.21.15.49:0/2865654839 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e55757ddf0 con 0x55e55721c9f0 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadb1ffb640 10 client.17592 handle_command_reply: tid=0 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 client.17592 shutdown 2024-09-21T06:45:08.149 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 -- 172.21.15.49:0/2865654839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 msgr2=0x55e557611280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557611280 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fadc0003d60 tx=0x7fadc002f390 comp rx=0 tx=0).stop 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 -- 172.21.15.49:0/2865654839 shutdown_connections 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e55721c9f0 0x55e557622e70 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55725e070 0x55e55761d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e55723d390 0x55e557611280 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 --2- 172.21.15.49:0/2865654839 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e5572351b0 0x55e557610d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 -- 172.21.15.49:0/2865654839 >> 172.21.15.49:0/2865654839 conn(0x55e557252460 msgr2=0x55e557608830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadb1ffb640 0 client.17592 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 -- 172.21.15.49:0/2865654839 shutdown_connections 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 1 -- 172.21.15.49:0/2865654839 wait complete. 2024-09-21T06:45:08.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.143+0000 7fadd715d740 20 client.17592 trim_cache size 0 max 16384 2024-09-21T06:45:08.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadd715d740 1 Processor -- start 2024-09-21T06:45:08.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadd715d740 1 -- start start 2024-09-21T06:45:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadd715d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e55761d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadd715d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 0x55e557610af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadd715d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557611030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadd715d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b4490 con 0x55e5572351b0 2024-09-21T06:45:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadd715d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b1d60 con 0x55e55723d390 2024-09-21T06:45:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadd715d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1afbd0 con 0x55e55725e070 2024-09-21T06:45:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadca59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e55761d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadca59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e55761d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33722/0 (socket says 172.21.15.49:33722) 2024-09-21T06:45:08.160 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadca59c640 1 -- 172.21.15.49:0/834768002 learned_addr learned my addr 172.21.15.49:0/834768002 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadcad9d640 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557611030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 0x55e557610af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadca59c640 1 -- 172.21.15.49:0/834768002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 msgr2=0x55e557611030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadca59c640 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557611030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadca59c640 1 -- 172.21.15.49:0/834768002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 msgr2=0x55e557610af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadca59c640 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 0x55e557610af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadca59c640 1 -- 172.21.15.49:0/834768002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e557611de0 con 0x55e5572351b0 2024-09-21T06:45:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadcad9d640 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557611030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:08.161 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.157+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 0x55e557610af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.158+0000 7fadca59c640 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e55761d080 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fadbc092fd0 tx=0x7fadbc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef47b640dd01b95e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.158+0000 7fadb3fff640 1 -- 172.21.15.49:0/834768002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc08df90 con 0x55e5572351b0 2024-09-21T06:45:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.158+0000 7fadb3fff640 1 -- 172.21.15.49:0/834768002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadbc0acd10 con 0x55e5572351b0 2024-09-21T06:45:08.162 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.158+0000 7fadb3fff640 1 -- 172.21.15.49:0/834768002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc020040 con 0x55e5572351b0 2024-09-21T06:45:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 -- 172.21.15.49:0/834768002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 msgr2=0x55e55761d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e55761d080 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fadbc092fd0 tx=0x7fadbc005880 comp rx=0 tx=0).stop 2024-09-21T06:45:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 -- 172.21.15.49:0/834768002 shutdown_connections 2024-09-21T06:45:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557611030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 0x55e557610af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 --2- 172.21.15.49:0/834768002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e55761d080 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 -- 172.21.15.49:0/834768002 >> 172.21.15.49:0/834768002 conn(0x55e557252460 msgr2=0x55e55760bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 -- 172.21.15.49:0/834768002 shutdown_connections 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 -- 172.21.15.49:0/834768002 wait complete. 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 -- start start 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.159+0000 7fadd715d740 1 Processor -- start 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadd715d740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e5576264a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadd715d740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 0x55e5576239c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadd715d740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557623f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadd715d740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b0220 con 0x55e5572351b0 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadd715d740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b1690 con 0x55e55723d390 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadd715d740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b08f0 con 0x55e55725e070 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadca59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e5576264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadd715d740 10 client.0 _ll_register_callbacks cb 0x7fadc400d2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadca59c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e5576264a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33738/0 (socket says 172.21.15.49:33738) 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadca59c640 1 -- 172.21.15.49:0/3287453084 learned_addr learned my addr 172.21.15.49:0/3287453084 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:08.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 0x55e5576239c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadcad9d640 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557623f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadca59c640 1 -- 172.21.15.49:0/3287453084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 msgr2=0x55e557623f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadca59c640 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557623f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadca59c640 1 -- 172.21.15.49:0/3287453084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 msgr2=0x55e5576239c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadca59c640 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 0x55e5576239c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadca59c640 1 -- 172.21.15.49:0/3287453084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5576244c0 con 0x55e5572351b0 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadcad9d640 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557623f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadca59c640 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e5576264a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0ad190 tx=0x7fadbc0ad900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b149f04715568c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.160+0000 7fadb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadb1ffb640 1 -- 172.21.15.49:0/3287453084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc020050 con 0x55e5572351b0 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadb1ffb640 1 -- 172.21.15.49:0/3287453084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7fadbc0eadc0 con 0x55e5572351b0 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadd715d740 1 -- 172.21.15.49:0/3287453084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadbc0acd10 con 0x55e5572351b0 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadb1ffb640 1 -- 172.21.15.49:0/3287453084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fadbc0b1ce0 con 0x55e5572351b0 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadd715d740 10 client.17598 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:08.168 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadd715d740 1 -- 172.21.15.49:0/3287453084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e55768d340 con 0x55e5572351b0 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadb1ffb640 1 -- 172.21.15.49:0/3287453084 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadbc0acd10 con 0x55e5572351b0 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadb1ffb640 1 -- 172.21.15.49:0/3287453084 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fadbc098200 con 0x55e5572351b0 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadd715d740 10 client.17598 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadd715d740 10 client.17598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadd715d740 20 client.17598 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadd715d740 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e5571f1da0 0x55e55768f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadd715d740 4 client.17598 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadd715d740 1 -- 172.21.15.49:0/3287453084 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e5575798a0 con 0x55e5571f1da0 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.161+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e5571f1da0 0x55e55768f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadb1ffb640 10 client.17598 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadc9d9b640 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e5571f1da0 0x55e55768f9f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5778c20e9436e403 server_cookie=bf6152761f5a1d7 in_seq=0 out_seq=0 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadb1ffb640 1 -- 172.21.15.49:0/3287453084 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5575798a0 con 0x55e5571f1da0 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadb1ffb640 10 client.17598 handle_command_reply: tid=0 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadd715d740 1 client.17598 shutdown 2024-09-21T06:45:08.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadd715d740 1 -- 172.21.15.49:0/3287453084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 msgr2=0x55e5576264a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadd715d740 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e5576264a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0ad190 tx=0x7fadbc0ad900 comp rx=0 tx=0).stop 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadd715d740 1 -- 172.21.15.49:0/3287453084 shutdown_connections 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadd715d740 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55e5571f1da0 0x55e55768f9f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadb1ffb640 0 client.17598 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadd715d740 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55e55725e070 0x55e557623f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadd715d740 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55e55723d390 0x55e5576239c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadd715d740 1 --2- 172.21.15.49:0/3287453084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55e5572351b0 0x55e5576264a0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.162+0000 7fadd715d740 1 -- 172.21.15.49:0/3287453084 >> 172.21.15.49:0/3287453084 conn(0x55e557252460 msgr2=0x55e557610af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd715d740 1 -- 172.21.15.49:0/3287453084 shutdown_connections 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd715d740 1 -- 172.21.15.49:0/3287453084 wait complete. 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd715d740 20 client.17598 trim_cache size 0 max 16384 2024-09-21T06:45:08.170 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:45:08.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 -- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fadb40b6700 msgr2=0x7fadb40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:08.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fadb40b6700 0x7fadb40b8c10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005fd0 tx=0x7fadc400d410 comp rx=0 tx=0).stop 2024-09-21T06:45:08.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 -- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc103b60 msgr2=0x7fadcc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc103b60 0x7fadcc075710 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fadbc00d950 tx=0x7fadbc00de10 comp rx=0 tx=0).stop 2024-09-21T06:45:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 -- 172.21.15.49:0/2826463090 shutdown_connections 2024-09-21T06:45:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fadb40b6700 0x7fadb40b8c10 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fadcc109df0 0x7fadcc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fadcc1094a0 0x7fadcc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 --2- 172.21.15.49:0/2826463090 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fadcc103b60 0x7fadcc075710 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 -- 172.21.15.49:0/2826463090 >> 172.21.15.49:0/2826463090 conn(0x7fadcc07b850 msgr2=0x7fadcc105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 -- 172.21.15.49:0/2826463090 shutdown_connections 2024-09-21T06:45:08.172 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:08.163+0000 7fadd0be9640 1 -- 172.21.15.49:0/2826463090 wait complete. 2024-09-21T06:45:09.990 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:45:09.990 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:45:10.019 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:09 smithi049 ceph-mon[31177]: pgmap v579: 97 pgs: 97 active+clean; 8.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 34 op/s 2024-09-21T06:45:10.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:09 smithi098 ceph-mon[34704]: pgmap v579: 97 pgs: 97 active+clean; 8.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 34 op/s 2024-09-21T06:45:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:09 smithi079 ceph-mon[34346]: pgmap v579: 97 pgs: 97 active+clean; 8.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 34 op/s 2024-09-21T06:45:10.262 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:10.722 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.718+0000 7f16ec076640 1 -- 172.21.15.49:0/3205206854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e41083a0 msgr2=0x7f16e41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.718+0000 7f16ec076640 1 --2- 172.21.15.49:0/3205206854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e41083a0 0x7f16e41087b0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009900 tx=0x7f16d402a410 comp rx=0 tx=0).stop 2024-09-21T06:45:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.718+0000 7f16ec076640 1 -- 172.21.15.49:0/3205206854 shutdown_connections 2024-09-21T06:45:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.718+0000 7f16ec076640 1 --2- 172.21.15.49:0/3205206854 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16e4108cf0 0x7f16e410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.718+0000 7f16ec076640 1 --2- 172.21.15.49:0/3205206854 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e41083a0 0x7f16e41087b0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.718+0000 7f16ec076640 1 --2- 172.21.15.49:0/3205206854 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e4102a60 0x7f16e4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.718+0000 7f16ec076640 1 -- 172.21.15.49:0/3205206854 >> 172.21.15.49:0/3205206854 conn(0x7f16e4079730 msgr2=0x7f16e4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:10.723 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.718+0000 7f16ec076640 1 -- 172.21.15.49:0/3205206854 shutdown_connections 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.718+0000 7f16ec076640 1 -- 172.21.15.49:0/3205206854 wait complete. 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.719+0000 7f16ec076640 1 Processor -- start 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.719+0000 7f16ec076640 1 -- start start 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.719+0000 7f16ec076640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e4102a60 0x7f16e419b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.719+0000 7f16ec076640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16e41083a0 0x7f16e419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.719+0000 7f16ec076640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e4108cf0 0x7f16e419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.719+0000 7f16ec076640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4112960 con 0x7f16e4102a60 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.719+0000 7f16ec076640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41127e0 con 0x7f16e4108cf0 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.719+0000 7f16ec076640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16e4112ae0 con 0x7f16e41083a0 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9e12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e4102a60 0x7f16e419b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9e12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e4102a60 0x7f16e419b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33750/0 (socket says 172.21.15.49:33750) 2024-09-21T06:45:10.724 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9e12640 1 -- 172.21.15.49:0/133886164 learned_addr learned my addr 172.21.15.49:0/133886164 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16ea613640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e4108cf0 0x7f16e419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9611640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16e41083a0 0x7f16e419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9e12640 1 -- 172.21.15.49:0/133886164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16e41083a0 msgr2=0x7f16e419b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9e12640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16e41083a0 0x7f16e419b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9e12640 1 -- 172.21.15.49:0/133886164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e4108cf0 msgr2=0x7f16e419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9e12640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e4108cf0 0x7f16e419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9e12640 1 -- 172.21.15.49:0/133886164 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e41a6590 con 0x7f16e4102a60 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9611640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16e41083a0 0x7f16e419b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16e9e12640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e4102a60 0x7f16e419b2d0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f16e000d950 tx=0x7f16e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16daffd640 1 -- 172.21.15.49:0/133886164 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e0017030 con 0x7f16e4102a60 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16ec076640 1 -- 172.21.15.49:0/133886164 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e41a6880 con 0x7f16e4102a60 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16daffd640 1 -- 172.21.15.49:0/133886164 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16e0004020 con 0x7f16e4102a60 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16daffd640 1 -- 172.21.15.49:0/133886164 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00047a0 con 0x7f16e4102a60 2024-09-21T06:45:10.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.720+0000 7f16ec076640 1 -- 172.21.15.49:0/133886164 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e41a6e10 con 0x7f16e4102a60 2024-09-21T06:45:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.723+0000 7f16f25ea740 1 Processor -- start 2024-09-21T06:45:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.723+0000 7f16daffd640 1 -- 172.21.15.49:0/133886164 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f16e0009a30 con 0x7f16e4102a60 2024-09-21T06:45:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.723+0000 7f16f25ea740 1 -- start start 2024-09-21T06:45:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 0x562ca0f24430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b54490 0x562ca0f24970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b5c670 0x562ca0f24eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16f25ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562ca0e9ae60 con 0x562ca0b5c670 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16f25ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ca0e8a290 con 0x562ca0b54490 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16f25ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ca0e8e0a0 con 0x562ca0b7d350 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16e9611640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b5c670 0x562ca0f24eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16e9611640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b5c670 0x562ca0f24eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33752/0 (socket says 172.21.15.49:33752) 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16e9611640 1 -- 172.21.15.49:0/2571557895 learned_addr learned my addr 172.21.15.49:0/2571557895 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16e9e12640 1 --2- 172.21.15.49:0/2571557895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b54490 0x562ca0f24970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16ea613640 1 --2- 172.21.15.49:0/2571557895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 0x562ca0f24430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16e9611640 1 -- 172.21.15.49:0/2571557895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 msgr2=0x562ca0f24430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16e9611640 1 --2- 172.21.15.49:0/2571557895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 0x562ca0f24430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16e9611640 1 -- 172.21.15.49:0/2571557895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b54490 msgr2=0x562ca0f24970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16e9611640 1 --2- 172.21.15.49:0/2571557895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b54490 0x562ca0f24970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16e9611640 1 -- 172.21.15.49:0/2571557895 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ca0be8930 con 0x562ca0b5c670 2024-09-21T06:45:10.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.724+0000 7f16daffd640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16d00b6680 0x7f16d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.725+0000 7f16ea613640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16d00b6680 0x7f16d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.725+0000 7f16e9611640 1 --2- 172.21.15.49:0/2571557895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b5c670 0x562ca0f24eb0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f16d4000c00 tx=0x7f16d4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcff66d9d3d4ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.725+0000 7f16daffd640 1 -- 172.21.15.49:0/133886164 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7f16e00e7300 con 0x7f16e4102a60 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.725+0000 7f16cffff640 1 -- 172.21.15.49:0/2571557895 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d403f070 con 0x562ca0b5c670 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.725+0000 7f16cffff640 1 -- 172.21.15.49:0/2571557895 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16d40316a0 con 0x562ca0b5c670 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.725+0000 7f16cffff640 1 -- 172.21.15.49:0/2571557895 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16d4035070 con 0x562ca0b5c670 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 -- 172.21.15.49:0/2571557895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b5c670 msgr2=0x562ca0f24eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 --2- 172.21.15.49:0/2571557895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b5c670 0x562ca0f24eb0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f16d4000c00 tx=0x7f16d4032ce0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16ea613640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16d00b6680 0x7f16d00b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f16dc005fd0 tx=0x7f16dc0096e0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 -- 172.21.15.49:0/2571557895 shutdown_connections 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 --2- 172.21.15.49:0/2571557895 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b5c670 0x562ca0f24eb0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 --2- 172.21.15.49:0/2571557895 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b54490 0x562ca0f24970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 --2- 172.21.15.49:0/2571557895 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 0x562ca0f24430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 -- 172.21.15.49:0/2571557895 >> 172.21.15.49:0/2571557895 conn(0x562ca0b71740 msgr2=0x562ca0f22320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:10.732 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 -- 172.21.15.49:0/2571557895 shutdown_connections 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 -- 172.21.15.49:0/2571557895 wait complete. 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.726+0000 7f16f25ea740 1 -- start start 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16f25ea740 1 Processor -- start 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b54490 0x562ca0f343e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f34920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 0x562ca0f40240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16f25ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562ca0ceb890 con 0x562ca0b54490 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16f25ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ca0e24d40 con 0x562ca0b5c670 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16f25ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ca0f36f10 con 0x562ca0b7d350 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16f25ea740 10 client.0 _ll_register_callbacks cb 0x562ca0e88c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16e9e12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b54490 0x562ca0f343e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16e9e12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b54490 0x562ca0f343e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33758/0 (socket says 172.21.15.49:33758) 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16e9e12640 1 -- 172.21.15.49:0/512396491 learned_addr learned my addr 172.21.15.49:0/512396491 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:10.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16ea613640 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 0x562ca0f40240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.727+0000 7f16e9611640 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f34920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16e9e12640 1 -- 172.21.15.49:0/512396491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 msgr2=0x562ca0f40240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16e9e12640 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 0x562ca0f40240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16e9e12640 1 -- 172.21.15.49:0/512396491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 msgr2=0x562ca0f34920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16e9e12640 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f34920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16e9e12640 1 -- 172.21.15.49:0/512396491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ca0f407d0 con 0x562ca0b54490 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16e9611640 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f34920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16e9e12640 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b54490 0x562ca0f343e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f16e00aa350 tx=0x7f16e00eaa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee8569f137d6c6f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:10.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16cd7fa640 1 -- 172.21.15.49:0/512396491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16e00a9730 con 0x562ca0b54490 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16cd7fa640 1 -- 172.21.15.49:0/512396491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7f16e00a9350 con 0x562ca0b54490 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16f25ea740 1 -- 172.21.15.49:0/512396491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16d40316a0 con 0x562ca0b54490 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16cd7fa640 1 -- 172.21.15.49:0/512396491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f16e00ac850 con 0x562ca0b54490 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16f25ea740 10 client.17610 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16f25ea740 1 -- 172.21.15.49:0/512396491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562ca0f43140 con 0x562ca0b54490 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.728+0000 7f16cd7fa640 1 -- 172.21.15.49:0/512396491 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16d40316a0 con 0x562ca0b54490 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.729+0000 7f16cd7fa640 1 -- 172.21.15.49:0/512396491 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f16e00981a0 con 0x562ca0b54490 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.729+0000 7f16f25ea740 10 client.17610 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.729+0000 7f16f25ea740 10 client.17610 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.729+0000 7f16f25ea740 20 client.17610 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.729+0000 7f16f25ea740 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ca0b3bcd0 0x562ca0f46650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.729+0000 7f16f25ea740 4 client.17610 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:10.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.729+0000 7f16f25ea740 1 -- 172.21.15.49:0/512396491 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ca0e9cdb0 con 0x562ca0b3bcd0 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.729+0000 7f16e9611640 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ca0b3bcd0 0x562ca0f46650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.730+0000 7f16e9611640 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ca0b3bcd0 0x562ca0f46650 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd969d74201f94f6 server_cookie=2f1db6e5d32f441d in_seq=0 out_seq=0 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.730+0000 7f16cd7fa640 10 client.17610 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.730+0000 7f16cd7fa640 1 -- 172.21.15.49:0/512396491 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ca0e9cdb0 con 0x562ca0b3bcd0 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.730+0000 7f16cd7fa640 10 client.17610 handle_command_reply: tid=0 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.730+0000 7f16f25ea740 1 client.17610 shutdown 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.730+0000 7f16f25ea740 1 -- 172.21.15.49:0/512396491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b54490 msgr2=0x562ca0f343e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.730+0000 7f16f25ea740 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b54490 0x562ca0f343e0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f16e00aa350 tx=0x7f16e00eaa40 comp rx=0 tx=0).stop 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16f25ea740 1 -- 172.21.15.49:0/512396491 shutdown_connections 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16f25ea740 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ca0b3bcd0 0x562ca0f46650 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16f25ea740 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b7d350 0x562ca0f40240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16cd7fa640 0 client.17610 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:10.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16f25ea740 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f34920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16f25ea740 1 --2- 172.21.15.49:0/512396491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b54490 0x562ca0f343e0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16f25ea740 1 -- 172.21.15.49:0/512396491 >> 172.21.15.49:0/512396491 conn(0x562ca0b71740 msgr2=0x562ca0f20850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16f25ea740 1 -- 172.21.15.49:0/512396491 shutdown_connections 2024-09-21T06:45:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16f25ea740 1 -- 172.21.15.49:0/512396491 wait complete. 2024-09-21T06:45:10.738 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.731+0000 7f16f25ea740 20 client.17610 trim_cache size 0 max 16384 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16f25ea740 1 Processor -- start 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16f25ea740 1 -- start start 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 0x562ca0f20850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f20d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f313d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16f25ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41b0020 con 0x562ca0b7d350 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16f25ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41ad8f0 con 0x562ca0b5c670 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16f25ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41ab760 con 0x562ca0b54490 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16ea613640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f313d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16ea613640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f313d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33766/0 (socket says 172.21.15.49:33766) 2024-09-21T06:45:10.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16ea613640 1 -- 172.21.15.49:0/204408095 learned_addr learned my addr 172.21.15.49:0/204408095 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16e9e12640 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 0x562ca0f20850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.749+0000 7f16e9611640 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f20d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16ea613640 1 -- 172.21.15.49:0/204408095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 msgr2=0x562ca0f20850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16ea613640 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 0x562ca0f20850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16ea613640 1 -- 172.21.15.49:0/204408095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 msgr2=0x562ca0f20d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16ea613640 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f20d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16ea613640 1 -- 172.21.15.49:0/204408095 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ca0f40580 con 0x562ca0b7d350 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16e9611640 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f20d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16ea613640 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f313d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0096b0 tx=0x7f16dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc1dab700f698c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16cf7fe640 1 -- 172.21.15.49:0/204408095 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc02c070 con 0x562ca0b7d350 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16cf7fe640 1 -- 172.21.15.49:0/204408095 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16dc01dd30 con 0x562ca0b7d350 2024-09-21T06:45:10.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.750+0000 7f16cf7fe640 1 -- 172.21.15.49:0/204408095 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc01e610 con 0x562ca0b7d350 2024-09-21T06:45:10.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 -- 172.21.15.49:0/204408095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 msgr2=0x562ca0f313d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f313d0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f16dc0096b0 tx=0x7f16dc015000 comp rx=0 tx=0).stop 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 -- 172.21.15.49:0/204408095 shutdown_connections 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f313d0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f20d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 --2- 172.21.15.49:0/204408095 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 0x562ca0f20850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 -- 172.21.15.49:0/204408095 >> 172.21.15.49:0/204408095 conn(0x562ca0b71740 msgr2=0x562ca0f32a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 -- 172.21.15.49:0/204408095 shutdown_connections 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 -- 172.21.15.49:0/204408095 wait complete. 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 -- start start 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.751+0000 7f16f25ea740 1 Processor -- start 2024-09-21T06:45:10.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 0x562ca0f3c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f3c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16f25ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f37160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16f25ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41abdb0 con 0x562ca0b7d350 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16f25ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41ad220 con 0x562ca0b5c670 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16f25ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f16e41ac480 con 0x562ca0b54490 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16f25ea740 10 client.0 _ll_register_callbacks cb 0x7f16e00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16ea613640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f37160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16ea613640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f37160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33774/0 (socket says 172.21.15.49:33774) 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16ea613640 1 -- 172.21.15.49:0/1463080746 learned_addr learned my addr 172.21.15.49:0/1463080746 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16e9e12640 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 0x562ca0f3c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16e9611640 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f3c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16ea613640 1 -- 172.21.15.49:0/1463080746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 msgr2=0x562ca0f3c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:10.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16ea613640 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 0x562ca0f3c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16ea613640 1 -- 172.21.15.49:0/1463080746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 msgr2=0x562ca0f3c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16ea613640 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f3c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.752+0000 7f16ea613640 1 -- 172.21.15.49:0/1463080746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ca0f376a0 con 0x562ca0b7d350 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16ea613640 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f37160 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00a010 tx=0x7f16dc027640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6863bd8d370d4ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16cd7fa640 1 -- 172.21.15.49:0/1463080746 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16dc02c040 con 0x562ca0b7d350 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16cd7fa640 1 -- 172.21.15.49:0/1463080746 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7f16dc0277b0 con 0x562ca0b7d350 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16f25ea740 1 -- 172.21.15.49:0/1463080746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16dc01dd30 con 0x562ca0b7d350 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16cd7fa640 1 -- 172.21.15.49:0/1463080746 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f16dc040050 con 0x562ca0b7d350 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16f25ea740 10 client.17616 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:10.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16f25ea740 1 -- 172.21.15.49:0/1463080746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562ca0fb15e0 con 0x562ca0b7d350 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16cd7fa640 1 -- 172.21.15.49:0/1463080746 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16dc01dd30 con 0x562ca0b7d350 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16cd7fa640 1 -- 172.21.15.49:0/1463080746 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f16dc00f040 con 0x562ca0b7d350 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16f25ea740 10 client.17616 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.753+0000 7f16f25ea740 10 client.17616 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.754+0000 7f16f25ea740 20 client.17616 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.754+0000 7f16f25ea740 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ca0b11080 0x562ca0fb3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.754+0000 7f16f25ea740 4 client.17616 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.754+0000 7f16f25ea740 1 -- 172.21.15.49:0/1463080746 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562ca0e98860 con 0x562ca0b11080 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.754+0000 7f16e9e12640 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ca0b11080 0x562ca0fb3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.754+0000 7f16e9e12640 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ca0b11080 0x562ca0fb3c50 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eecb41fd09895136 server_cookie=e9ce2310918b563b in_seq=0 out_seq=0 2024-09-21T06:45:10.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.754+0000 7f16cd7fa640 10 client.17616 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16cd7fa640 1 -- 172.21.15.49:0/1463080746 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562ca0e98860 con 0x562ca0b11080 2024-09-21T06:45:10.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16cd7fa640 10 client.17616 handle_command_reply: tid=0 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16f25ea740 1 client.17616 shutdown 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16f25ea740 1 -- 172.21.15.49:0/1463080746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 msgr2=0x562ca0f37160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16f25ea740 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f37160 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00a010 tx=0x7f16dc027640 comp rx=0 tx=0).stop 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16f25ea740 1 -- 172.21.15.49:0/1463080746 shutdown_connections 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16f25ea740 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ca0b11080 0x562ca0fb3c50 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16f25ea740 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ca0b7d350 0x562ca0f37160 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16f25ea740 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ca0b5c670 0x562ca0f3c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16f25ea740 1 --2- 172.21.15.49:0/1463080746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ca0b54490 0x562ca0f3c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16cd7fa640 0 client.17616 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.756+0000 7f16f25ea740 1 -- 172.21.15.49:0/1463080746 >> 172.21.15.49:0/1463080746 conn(0x562ca0b71740 msgr2=0x562ca0f25460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16f25ea740 1 -- 172.21.15.49:0/1463080746 shutdown_connections 2024-09-21T06:45:10.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16f25ea740 1 -- 172.21.15.49:0/1463080746 wait complete. 2024-09-21T06:45:10.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16f25ea740 20 client.17616 trim_cache size 0 max 16384 2024-09-21T06:45:10.763 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:45:10.763 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:45:10.763 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "877238a7-c1a9-416c-8f9e-d40ecea3c71a", 2024-09-21T06:45:10.763 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:45:10.763 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 -- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16d00b6680 msgr2=0x7f16d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16d00b6680 0x7f16d00b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f16dc005fd0 tx=0x7f16dc0096e0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 -- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e4102a60 msgr2=0x7f16e419b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e4102a60 0x7f16e419b2d0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f16e000d950 tx=0x7f16e000de10 comp rx=0 tx=0).stop 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 -- 172.21.15.49:0/133886164 shutdown_connections 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16d00b6680 0x7f16d00b8b90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f16e4108cf0 0x7f16e419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16e41083a0 0x7f16e419b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 --2- 172.21.15.49:0/133886164 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f16e4102a60 0x7f16e419b2d0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.757+0000 7f16ec076640 1 -- 172.21.15.49:0/133886164 >> 172.21.15.49:0/133886164 conn(0x7f16e4079730 msgr2=0x7f16e41044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:10.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.758+0000 7f16ec076640 1 -- 172.21.15.49:0/133886164 shutdown_connections 2024-09-21T06:45:10.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:10.758+0000 7f16ec076640 1 -- 172.21.15.49:0/133886164 wait complete. 2024-09-21T06:45:11.539 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:45:11.842 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:11.978 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:11 smithi049 ceph-mon[31177]: pgmap v580: 97 pgs: 97 active+clean; 8.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 34 op/s 2024-09-21T06:45:11.979 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:11 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:45:11.979 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:11 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:11.979 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:11 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:45:11.979 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:11 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:45:11.979 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:11 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:11.979 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:11 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:11 smithi098 ceph-mon[34704]: pgmap v580: 97 pgs: 97 active+clean; 8.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 34 op/s 2024-09-21T06:45:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:11 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:45:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:11 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:11 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:45:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:11 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:45:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:11 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:12.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:11 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:11 smithi079 ceph-mon[34346]: pgmap v580: 97 pgs: 97 active+clean; 8.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 84 KiB/s wr, 34 op/s 2024-09-21T06:45:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:11 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:45:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:11 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:12.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:11 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:45:12.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:11 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:45:12.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:11 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:12.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:11 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:12.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.316+0000 7f61be1e4640 1 -- 172.21.15.49:0/362769943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8108d10 msgr2=0x7f61b810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.316+0000 7f61be1e4640 1 --2- 172.21.15.49:0/362769943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8108d10 0x7f61b810f540 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009900 tx=0x7f61b002a410 comp rx=0 tx=0).stop 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.316+0000 7f61be1e4640 1 -- 172.21.15.49:0/362769943 shutdown_connections 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.316+0000 7f61be1e4640 1 --2- 172.21.15.49:0/362769943 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8108d10 0x7f61b810f540 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.316+0000 7f61be1e4640 1 --2- 172.21.15.49:0/362769943 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b81083c0 0x7f61b81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.316+0000 7f61be1e4640 1 --2- 172.21.15.49:0/362769943 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b8102ad0 0x7f61b8102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.316+0000 7f61be1e4640 1 -- 172.21.15.49:0/362769943 >> 172.21.15.49:0/362769943 conn(0x7f61b80796d0 msgr2=0x7f61b8079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.316+0000 7f61be1e4640 1 -- 172.21.15.49:0/362769943 shutdown_connections 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.316+0000 7f61be1e4640 1 -- 172.21.15.49:0/362769943 wait complete. 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.317+0000 7f61be1e4640 1 Processor -- start 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.317+0000 7f61be1e4640 1 -- start start 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.317+0000 7f61be1e4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8102ad0 0x7f61b819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.317+0000 7f61be1e4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b81083c0 0x7f61b819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.317+0000 7f61be1e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b8108d10 0x7f61b819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61be1e4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61b81129d0 con 0x7f61b8102ad0 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61be1e4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61b8112850 con 0x7f61b81083c0 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61be1e4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61b8112b50 con 0x7f61b8108d10 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8102ad0 0x7f61b819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8102ad0 0x7f61b819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33800/0 (socket says 172.21.15.49:33800) 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b77fe640 1 -- 172.21.15.49:0/2950538564 learned_addr learned my addr 172.21.15.49:0/2950538564 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b7fff640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b8108d10 0x7f61b819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b81083c0 0x7f61b819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b77fe640 1 -- 172.21.15.49:0/2950538564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b8108d10 msgr2=0x7f61b819bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b77fe640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b8108d10 0x7f61b819bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b77fe640 1 -- 172.21.15.49:0/2950538564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b81083c0 msgr2=0x7f61b819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b77fe640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b81083c0 0x7f61b819b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b77fe640 1 -- 172.21.15.49:0/2950538564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b81a6540 con 0x7f61b8102ad0 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b77fe640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8102ad0 0x7f61b819b280 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f61a800eab0 tx=0x7f61a800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b4ff9640 1 -- 172.21.15.49:0/2950538564 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a800ce40 con 0x7f61b8102ad0 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61be1e4640 1 -- 172.21.15.49:0/2950538564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b81a6830 con 0x7f61b8102ad0 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b4ff9640 1 -- 172.21.15.49:0/2950538564 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a8011920 con 0x7f61b8102ad0 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.318+0000 7f61b4ff9640 1 -- 172.21.15.49:0/2950538564 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a8010a30 con 0x7f61b8102ad0 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.319+0000 7f61be1e4640 1 -- 172.21.15.49:0/2950538564 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b81a6dc0 con 0x7f61b8102ad0 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.321+0000 7f61c4758740 1 Processor -- start 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.321+0000 7f61c4758740 1 -- start start 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.321+0000 7f61b4ff9640 1 -- 172.21.15.49:0/2950538564 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f61a8010bd0 con 0x7f61b8102ad0 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.321+0000 7f61c4758740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2de270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.321+0000 7f61c4758740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 0x55c21e2de7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.321+0000 7f61c4758740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 0x55c21e2decf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.321+0000 7f61c4758740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c21e254e50 con 0x55c21df37070 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.321+0000 7f61c4758740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c21e244280 con 0x55c21df0e1b0 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.321+0000 7f61c4758740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c21e248090 con 0x55c21df16390 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2de270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2de270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33816/0 (socket says 172.21.15.49:33816) 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b7fff640 1 -- 172.21.15.49:0/3141042112 learned_addr learned my addr 172.21.15.49:0/3141042112 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b77fe640 1 --2- 172.21.15.49:0/3141042112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 0x55c21e2de7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/3141042112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 0x55c21e2decf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b7fff640 1 -- 172.21.15.49:0/3141042112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 msgr2=0x55c21e2decf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b7fff640 1 --2- 172.21.15.49:0/3141042112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 0x55c21e2decf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b7fff640 1 -- 172.21.15.49:0/3141042112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 msgr2=0x55c21e2de7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b7fff640 1 --2- 172.21.15.49:0/3141042112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 0x55c21e2de7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b7fff640 1 -- 172.21.15.49:0/3141042112 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21dfa2650 con 0x55c21df37070 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b7fff640 1 --2- 172.21.15.49:0/3141042112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2de270 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009900 tx=0x7f61b0032e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308cf4a729f0e25f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61b4ff9640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a40b6680 0x7f61a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61adffb640 1 -- 172.21.15.49:0/3141042112 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0040070 con 0x55c21df37070 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61adffb640 1 -- 172.21.15.49:0/3141042112 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b00316a0 con 0x55c21df37070 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.322+0000 7f61adffb640 1 -- 172.21.15.49:0/3141042112 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b0035040 con 0x55c21df37070 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.323+0000 7f61b77fe640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a40b6680 0x7f61a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.323+0000 7f61b4ff9640 1 -- 172.21.15.49:0/2950538564 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7f61a80e7e00 con 0x7f61b8102ad0 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.323+0000 7f61c4758740 1 -- 172.21.15.49:0/3141042112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 msgr2=0x55c21e2de270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.323+0000 7f61b77fe640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a40b6680 0x7f61a40b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f61a80e5590 tx=0x7f61a8095040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.323+0000 7f61c4758740 1 --2- 172.21.15.49:0/3141042112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2de270 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f61b0009900 tx=0x7f61b0032e70 comp rx=0 tx=0).stop 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.323+0000 7f61c4758740 1 -- 172.21.15.49:0/3141042112 shutdown_connections 2024-09-21T06:45:12.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.323+0000 7f61c4758740 1 --2- 172.21.15.49:0/3141042112 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 0x55c21e2decf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.323+0000 7f61c4758740 1 --2- 172.21.15.49:0/3141042112 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 0x55c21e2de7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.324+0000 7f61c4758740 1 --2- 172.21.15.49:0/3141042112 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2de270 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.324+0000 7f61c4758740 1 -- 172.21.15.49:0/3141042112 >> 172.21.15.49:0/3141042112 conn(0x55c21df2b460 msgr2=0x55c21e2dc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.324+0000 7f61c4758740 1 -- 172.21.15.49:0/3141042112 shutdown_connections 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.324+0000 7f61c4758740 1 -- 172.21.15.49:0/3141042112 wait complete. 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.324+0000 7f61c4758740 1 -- start start 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.324+0000 7f61c4758740 1 Processor -- start 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61c4758740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df0e1b0 0x55c21e2e9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61c4758740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 0x55c21e2e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61c4758740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df37070 0x55c21e2f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61c4758740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c21e0a5700 con 0x55c21df0e1b0 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61c4758740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c21e1df110 con 0x55c21df37070 2024-09-21T06:45:12.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61c4758740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c21e2ec9f0 con 0x55c21df16390 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61c4758740 10 client.0 _ll_register_callbacks cb 0x55c21e1f8990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df0e1b0 0x55c21e2e9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df0e1b0 0x55c21e2e9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33824/0 (socket says 172.21.15.49:33824) 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b7fff640 1 -- 172.21.15.49:0/3815413567 learned_addr learned my addr 172.21.15.49:0/3815413567 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 0x55c21e2e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b7fff640 1 -- 172.21.15.49:0/3815413567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 msgr2=0x55c21e2e9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b7fff640 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 0x55c21e2e9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b7fff640 1 -- 172.21.15.49:0/3815413567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df37070 msgr2=0x55c21e2f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b7fff640 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df37070 0x55c21e2f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b7fff640 1 -- 172.21.15.49:0/3815413567 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21e20cc40 con 0x55c21df0e1b0 2024-09-21T06:45:12.378 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f61b7fff640 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df0e1b0 0x55c21e2e9920 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f61b002a450 tx=0x7f61b00315e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb23b0495bab7a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.325+0000 7f6196ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f6196ffd640 1 -- 172.21.15.49:0/3815413567 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b004b030 con 0x55c21df0e1b0 2024-09-21T06:45:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f6196ffd640 1 -- 172.21.15.49:0/3815413567 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7f61b003c500 con 0x55c21df0e1b0 2024-09-21T06:45:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f61c4758740 1 -- 172.21.15.49:0/3815413567 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61b00316a0 con 0x55c21df0e1b0 2024-09-21T06:45:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f6196ffd640 1 -- 172.21.15.49:0/3815413567 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f61b0035070 con 0x55c21df0e1b0 2024-09-21T06:45:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f61c4758740 10 client.17628 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f61c4758740 1 -- 172.21.15.49:0/3815413567 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c21e2f86a0 con 0x55c21df0e1b0 2024-09-21T06:45:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f6196ffd640 1 -- 172.21.15.49:0/3815413567 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61b00316a0 con 0x55c21df0e1b0 2024-09-21T06:45:12.379 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f6196ffd640 1 -- 172.21.15.49:0/3815413567 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f61b0044a40 con 0x55c21df0e1b0 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f61c4758740 10 client.17628 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f61c4758740 10 client.17628 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f61c4758740 20 client.17628 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f61c4758740 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c21def59f0 0x55c21e2fba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f61c4758740 4 client.17628 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.326+0000 7f61c4758740 1 -- 172.21.15.49:0/3815413567 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c21e256da0 con 0x55c21def59f0 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.327+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c21def59f0 0x55c21e2fba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.327+0000 7f6196ffd640 10 client.17628 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.327+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c21def59f0 0x55c21e2fba00 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e076767e80e4b472 server_cookie=b4b2a06223b748de in_seq=0 out_seq=0 2024-09-21T06:45:12.380 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f6196ffd640 1 -- 172.21.15.49:0/3815413567 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c21e256da0 con 0x55c21def59f0 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f6196ffd640 10 client.17628 handle_command_reply: tid=0 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f61c4758740 1 client.17628 shutdown 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f61c4758740 1 -- 172.21.15.49:0/3815413567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df0e1b0 msgr2=0x55c21e2e9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f61c4758740 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df0e1b0 0x55c21e2e9920 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f61b002a450 tx=0x7f61b00315e0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f61c4758740 1 -- 172.21.15.49:0/3815413567 shutdown_connections 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f61c4758740 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c21def59f0 0x55c21e2fba00 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f61c4758740 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df37070 0x55c21e2f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f61c4758740 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df16390 0x55c21e2e9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f61c4758740 1 --2- 172.21.15.49:0/3815413567 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df0e1b0 0x55c21e2e9920 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.328+0000 7f61c4758740 1 -- 172.21.15.49:0/3815413567 >> 172.21.15.49:0/3815413567 conn(0x55c21df2b460 msgr2=0x55c21e2e1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.329+0000 7f6196ffd640 0 client.17628 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:12.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.329+0000 7f61c4758740 1 -- 172.21.15.49:0/3815413567 shutdown_connections 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.329+0000 7f61c4758740 1 -- 172.21.15.49:0/3815413567 wait complete. 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.329+0000 7f61c4758740 20 client.17628 trim_cache size 0 max 16384 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.346+0000 7f61c4758740 1 Processor -- start 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.346+0000 7f61c4758740 1 -- start start 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61c4758740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 0x55c21e2eb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61c4758740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df16390 0x55c21e2db710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61c4758740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df37070 0x55c21e2dbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61c4758740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61b81b2140 con 0x55c21df16390 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61c4758740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61b81afa10 con 0x55c21df0e1b0 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61c4758740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61b81ad880 con 0x55c21df37070 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df16390 0x55c21e2db710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df16390 0x55c21e2db710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33832/0 (socket says 172.21.15.49:33832) 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b6ffd640 1 -- 172.21.15.49:0/1144763680 learned_addr learned my addr 172.21.15.49:0/1144763680 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:12.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b7fff640 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 0x55c21e2eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b7fff640 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df37070 0x55c21e2dbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b6ffd640 1 -- 172.21.15.49:0/1144763680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df37070 msgr2=0x55c21e2dbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df37070 0x55c21e2dbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b6ffd640 1 -- 172.21.15.49:0/1144763680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 msgr2=0x55c21e2eb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 0x55c21e2eb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b6ffd640 1 -- 172.21.15.49:0/1144763680 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c21def5c20 con 0x55c21df16390 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b7fff640 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df37070 0x55c21e2dbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df16390 0x55c21e2db710 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f61b806b950 tx=0x7f61a0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b6ee3e02cd4f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61ad7fa640 1 -- 172.21.15.49:0/1144763680 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a0023430 con 0x55c21df16390 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.347+0000 7f61ad7fa640 1 -- 172.21.15.49:0/1144763680 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a0023a80 con 0x55c21df16390 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61ad7fa640 1 -- 172.21.15.49:0/1144763680 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a001ca50 con 0x55c21df16390 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61c4758740 1 -- 172.21.15.49:0/1144763680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df16390 msgr2=0x55c21e2db710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61c4758740 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df16390 0x55c21e2db710 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f61b806b950 tx=0x7f61a0011810 comp rx=0 tx=0).stop 2024-09-21T06:45:12.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61c4758740 1 -- 172.21.15.49:0/1144763680 shutdown_connections 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61c4758740 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df37070 0x55c21e2dbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61c4758740 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df16390 0x55c21e2db710 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61c4758740 1 --2- 172.21.15.49:0/1144763680 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df0e1b0 0x55c21e2eb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61c4758740 1 -- 172.21.15.49:0/1144763680 >> 172.21.15.49:0/1144763680 conn(0x55c21df2b460 msgr2=0x55c21e2eae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61c4758740 1 -- 172.21.15.49:0/1144763680 shutdown_connections 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.348+0000 7f61c4758740 1 -- 172.21.15.49:0/1144763680 wait complete. 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61c4758740 1 -- start start 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61c4758740 1 Processor -- start 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61c4758740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df0e1b0 0x55c21e2ff320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61c4758740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df16390 0x55c21e2fc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.384 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61c4758740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2fce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61c4758740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f61b81aded0 con 0x55c21df37070 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61c4758740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f61b81af340 con 0x55c21df16390 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61c4758740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f61b81ae5a0 con 0x55c21df0e1b0 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61c4758740 10 client.0 _ll_register_callbacks cb 0x7f61b0032d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2fce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61b7fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2fce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:33842/0 (socket says 172.21.15.49:33842) 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.349+0000 7f61b7fff640 1 -- 172.21.15.49:0/1090849965 learned_addr learned my addr 172.21.15.49:0/1090849965 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df16390 0x55c21e2fc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61b7fff640 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df0e1b0 0x55c21e2ff320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61b7fff640 1 -- 172.21.15.49:0/1090849965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df0e1b0 msgr2=0x55c21e2ff320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61b7fff640 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df0e1b0 0x55c21e2ff320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.385 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61b7fff640 1 -- 172.21.15.49:0/1090849965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df16390 msgr2=0x55c21e2fc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61b7fff640 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df16390 0x55c21e2fc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61b7fff640 1 -- 172.21.15.49:0/1090849965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c21e2fd5d0 con 0x55c21df37070 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61b7fff640 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2fce40 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f61b0005410 tx=0x7f61b0005470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a496648088fbb9c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f6196ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f6196ffd640 1 -- 172.21.15.49:0/1090849965 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61b005c070 con 0x55c21df37070 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f6196ffd640 1 -- 172.21.15.49:0/1090849965 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8638+0+0 (secure 0 0 0) 0x7f61b0031cd0 con 0x55c21df37070 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61c4758740 1 -- 172.21.15.49:0/1090849965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61a0023a80 con 0x55c21df37070 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f6196ffd640 1 -- 172.21.15.49:0/1090849965 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f61b004b040 con 0x55c21df37070 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61c4758740 10 client.17634 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:12.386 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f61c4758740 1 -- 172.21.15.49:0/1090849965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c21e366150 con 0x55c21df37070 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.350+0000 7f6196ffd640 1 -- 172.21.15.49:0/1090849965 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61a0023a80 con 0x55c21df37070 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f6196ffd640 1 -- 172.21.15.49:0/1090849965 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f61b005f020 con 0x55c21df37070 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f61c4758740 10 client.17634 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f61c4758740 10 client.17634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f61c4758740 20 client.17634 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f61c4758740 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c21decada0 0x55c21e368880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f61c4758740 4 client.17634 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f61c4758740 1 -- 172.21.15.49:0/1090849965 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c21e252850 con 0x55c21decada0 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c21decada0 0x55c21e368880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f6196ffd640 10 client.17634 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:12.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.351+0000 7f61b6ffd640 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c21decada0 0x55c21e368880 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa33b7acca1e3e8 server_cookie=a0a1c222351c35c9 in_seq=0 out_seq=0 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f6196ffd640 1 -- 172.21.15.49:0/1090849965 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4262 (crc 0 0 0) 0x55c21e252850 con 0x55c21decada0 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f6196ffd640 10 client.17634 handle_command_reply: tid=0 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 client.17634 shutdown 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 -- 172.21.15.49:0/1090849965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 msgr2=0x55c21e2fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2fce40 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f61b0005410 tx=0x7f61b0005470 comp rx=0 tx=0).stop 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 -- 172.21.15.49:0/1090849965 shutdown_connections 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c21decada0 0x55c21e368880 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c21df37070 0x55c21e2fce40 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c21df16390 0x55c21e2fc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 --2- 172.21.15.49:0/1090849965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c21df0e1b0 0x55c21e2ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 -- 172.21.15.49:0/1090849965 >> 172.21.15.49:0/1090849965 conn(0x55c21df2b460 msgr2=0x55c21e2eb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f6196ffd640 0 client.17634 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 -- 172.21.15.49:0/1090849965 shutdown_connections 2024-09-21T06:45:12.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 1 -- 172.21.15.49:0/1090849965 wait complete. 2024-09-21T06:45:12.389 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:45:12.389 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:45:12.389 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:45:12.389 INFO:teuthology.orchestra.run.smithi049.stdout: "877238a7-c1a9-416c-8f9e-d40ecea3c71a": { 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "877238a7-c1a9-416c-8f9e-d40ecea3c71a", 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.390 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.391 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.392 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:45:12.395 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.396 INFO:teuthology.orchestra.run.smithi049.stdout: "877238a7-c1a9-416c-8f9e-d40ecea3c71a": { 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:10.755554+0000", 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:12.399 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.352+0000 7f61c4758740 20 client.17634 trim_cache size 0 max 16384 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 -- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a40b6680 msgr2=0x7f61a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a40b6680 0x7f61a40b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f61a80e5590 tx=0x7f61a8095040 comp rx=0 tx=0).stop 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 -- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8102ad0 msgr2=0x7f61b819b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8102ad0 0x7f61b819b280 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f61a800eab0 tx=0x7f61a800ef70 comp rx=0 tx=0).stop 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 -- 172.21.15.49:0/2950538564 shutdown_connections 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f61a40b6680 0x7f61a40b8b90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f61b8108d10 0x7f61b819bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f61b81083c0 0x7f61b819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 --2- 172.21.15.49:0/2950538564 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f61b8102ad0 0x7f61b819b280 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 -- 172.21.15.49:0/2950538564 >> 172.21.15.49:0/2950538564 conn(0x7f61b80796d0 msgr2=0x7f61b8106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 -- 172.21.15.49:0/2950538564 shutdown_connections 2024-09-21T06:45:12.400 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:12.353+0000 7f61be1e4640 1 -- 172.21.15.49:0/2950538564 wait complete. 2024-09-21T06:45:13.023 INFO:tasks.cephfs.filesystem:scrub status for tag:877238a7-c1a9-416c-8f9e-d40ecea3c71a - {'path': '/', 'tag': '877238a7-c1a9-416c-8f9e-d40ecea3c71a', 'options': 'recursive,force'} 2024-09-21T06:45:14.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:13 smithi098 ceph-mon[34704]: pgmap v581: 97 pgs: 97 active+clean; 8.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 85 KiB/s wr, 35 op/s 2024-09-21T06:45:14.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:13 smithi098 ceph-mon[34704]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:45:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:13 smithi079 ceph-mon[34346]: pgmap v581: 97 pgs: 97 active+clean; 8.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 85 KiB/s wr, 35 op/s 2024-09-21T06:45:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:13 smithi079 ceph-mon[34346]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:45:14.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:13 smithi049 ceph-mon[31177]: pgmap v581: 97 pgs: 97 active+clean; 8.7 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 85 KiB/s wr, 35 op/s 2024-09-21T06:45:14.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:13 smithi049 ceph-mon[31177]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:45:16.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:15 smithi098 ceph-mon[34704]: pgmap v583: 97 pgs: 97 active+clean; 8.8 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-09-21T06:45:16.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:15 smithi079 ceph-mon[34346]: pgmap v583: 97 pgs: 97 active+clean; 8.8 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-09-21T06:45:16.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:15 smithi049 ceph-mon[31177]: pgmap v583: 97 pgs: 97 active+clean; 8.8 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-09-21T06:45:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.681+0000 7f405e815640 1 -- 172.21.15.49:0/3628568282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f405810dda0 msgr2=0x7f4058110290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.681+0000 7f405e815640 1 --2- 172.21.15.49:0/3628568282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f405810dda0 0x7f4058110290 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4050009ca0 tx=0x7f405002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.681+0000 7f405e815640 1 -- 172.21.15.49:0/3628568282 shutdown_connections 2024-09-21T06:45:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.681+0000 7f405e815640 1 --2- 172.21.15.49:0/3628568282 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f405810dda0 0x7f4058110290 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.681+0000 7f405e815640 1 --2- 172.21.15.49:0/3628568282 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4058105290 0x7f405810d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.681+0000 7f405e815640 1 --2- 172.21.15.49:0/3628568282 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4058104940 0x7f4058104d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.683 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.681+0000 7f405e815640 1 -- 172.21.15.49:0/3628568282 >> 172.21.15.49:0/3628568282 conn(0x7f40580fe3b0 msgr2=0x7f4058100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.681+0000 7f405e815640 1 -- 172.21.15.49:0/3628568282 shutdown_connections 2024-09-21T06:45:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.681+0000 7f405e815640 1 -- 172.21.15.49:0/3628568282 wait complete. 2024-09-21T06:45:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.682+0000 7f405e815640 1 Processor -- start 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.682+0000 7f405e815640 1 -- start start 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.682+0000 7f405e815640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4058104940 0x7f405819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.682+0000 7f405e815640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4058105290 0x7f405819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.682+0000 7f405e815640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f405810dda0 0x7f405819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.682+0000 7f405e815640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4058113a20 con 0x7f4058105290 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.682+0000 7f405e815640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40581138a0 con 0x7f4058104940 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.682+0000 7f405e815640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4058113ba0 con 0x7f405810dda0 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4058105290 0x7f405819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4058105290 0x7f405819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55018/0 (socket says 172.21.15.49:55018) 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40577fe640 1 -- 172.21.15.49:0/1078297461 learned_addr learned my addr 172.21.15.49:0/1078297461 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f4057fff640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4058104940 0x7f405819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f405cdb2640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f405810dda0 0x7f405819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40577fe640 1 -- 172.21.15.49:0/1078297461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f405810dda0 msgr2=0x7f405819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40577fe640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f405810dda0 0x7f405819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40577fe640 1 -- 172.21.15.49:0/1078297461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4058104940 msgr2=0x7f405819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40577fe640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4058104940 0x7f405819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40577fe640 1 -- 172.21.15.49:0/1078297461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40581a03b0 con 0x7f4058105290 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40577fe640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4058105290 0x7f405819aa20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f404c00d750 tx=0x7f404c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40557fa640 1 -- 172.21.15.49:0/1078297461 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c017070 con 0x7f4058105290 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f405e815640 1 -- 172.21.15.49:0/1078297461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40581a06a0 con 0x7f4058105290 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40557fa640 1 -- 172.21.15.49:0/1078297461 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f404c0054d0 con 0x7f4058105290 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f40557fa640 1 -- 172.21.15.49:0/1078297461 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c004c30 con 0x7f4058105290 2024-09-21T06:45:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.683+0000 7f405e815640 1 -- 172.21.15.49:0/1078297461 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40581a6e30 con 0x7f4058105290 2024-09-21T06:45:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f4065861740 1 Processor -- start 2024-09-21T06:45:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f4065861740 1 -- start start 2024-09-21T06:45:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f40557fa640 1 -- 172.21.15.49:0/1078297461 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f404c004dd0 con 0x7f4058105290 2024-09-21T06:45:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f4065861740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 0x556592c449b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f4065861740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c44ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f4065861740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 0x556592c45430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f4065861740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556592bb96f0 con 0x5565928762f0 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f4065861740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556592ba8b20 con 0x55659289f1b0 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f4065861740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556592bac930 con 0x55659287e4d0 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.686+0000 7f4057fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c44ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f4057fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c44ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55020/0 (socket says 172.21.15.49:55020) 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f4057fff640 1 -- 172.21.15.49:0/1205582757 learned_addr learned my addr 172.21.15.49:0/1205582757 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f405cdb2640 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 0x556592c449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f40577fe640 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 0x556592c45430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f4057fff640 1 -- 172.21.15.49:0/1205582757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 msgr2=0x556592c45430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f4057fff640 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 0x556592c45430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f4057fff640 1 -- 172.21.15.49:0/1205582757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 msgr2=0x556592c449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f4057fff640 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 0x556592c449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f4057fff640 1 -- 172.21.15.49:0/1205582757 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556592b6e530 con 0x5565928762f0 2024-09-21T06:45:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f405cdb2640 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 0x556592c449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f40557fa640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f40400b6680 0x7f40400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f4057fff640 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c44ef0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f404800bd10 tx=0x7f40480107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6bf21128135ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f405cdb2640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f40400b6680 0x7f40400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f403e7fc640 1 -- 172.21.15.49:0/1205582757 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048004030 con 0x5565928762f0 2024-09-21T06:45:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f40557fa640 1 -- 172.21.15.49:0/1078297461 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f404c0e7150 con 0x7f4058105290 2024-09-21T06:45:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f403e7fc640 1 -- 172.21.15.49:0/1205582757 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40480035f0 con 0x5565928762f0 2024-09-21T06:45:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.687+0000 7f403e7fc640 1 -- 172.21.15.49:0/1205582757 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4048011770 con 0x5565928762f0 2024-09-21T06:45:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f4065861740 1 -- 172.21.15.49:0/1205582757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 msgr2=0x556592c44ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f405cdb2640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f40400b6680 0x7f40400b8b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40500094e0 tx=0x7f40500093f0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f4065861740 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c44ef0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f404800bd10 tx=0x7f40480107a0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f4065861740 1 -- 172.21.15.49:0/1205582757 shutdown_connections 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f4065861740 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 0x556592c45430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f4065861740 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c44ef0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f4065861740 1 --2- 172.21.15.49:0/1205582757 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 0x556592c449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f4065861740 1 -- 172.21.15.49:0/1205582757 >> 172.21.15.49:0/1205582757 conn(0x556592893300 msgr2=0x556592c428a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f4065861740 1 -- 172.21.15.49:0/1205582757 shutdown_connections 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.688+0000 7f4065861740 1 -- 172.21.15.49:0/1205582757 wait complete. 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.689+0000 7f4065861740 1 -- start start 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.689+0000 7f4065861740 1 Processor -- start 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.689+0000 7f4065861740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565928762f0 0x556592c50060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.689+0000 7f4065861740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55659287e4d0 0x556592c505a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.689+0000 7f4065861740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 0x556592c5c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.689+0000 7f4065861740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556592ae0ab0 con 0x55659287e4d0 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.689+0000 7f4065861740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556592b4e730 con 0x55659289f1b0 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.689+0000 7f4065861740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556592c53130 con 0x5565928762f0 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.689+0000 7f4065861740 10 client.0 _ll_register_callbacks cb 0x556592ba26b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55659287e4d0 0x556592c505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55659287e4d0 0x556592c505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55024/0 (socket says 172.21.15.49:55024) 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40577fe640 1 -- 172.21.15.49:0/1990992124 learned_addr learned my addr 172.21.15.49:0/1990992124 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f405cdb2640 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 0x556592c5c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f4057fff640 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565928762f0 0x556592c50060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40577fe640 1 -- 172.21.15.49:0/1990992124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565928762f0 msgr2=0x556592c50060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40577fe640 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565928762f0 0x556592c50060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40577fe640 1 -- 172.21.15.49:0/1990992124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 msgr2=0x556592c5c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40577fe640 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 0x556592c5c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40577fe640 1 -- 172.21.15.49:0/1990992124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55659290a790 con 0x55659287e4d0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f4057fff640 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565928762f0 0x556592c50060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40577fe640 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55659287e4d0 0x556592c505a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f404c009610 tx=0x7f404c0a8eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9700d6d51466a17 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40377fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40377fe640 1 -- 172.21.15.49:0/1990992124 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c020070 con 0x55659287e4d0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f40377fe640 1 -- 172.21.15.49:0/1990992124 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f404c0940f0 con 0x55659287e4d0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.690+0000 7f4065861740 1 -- 172.21.15.49:0/1990992124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40480035f0 con 0x55659287e4d0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f40377fe640 1 -- 172.21.15.49:0/1990992124 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f404c0aca60 con 0x55659287e4d0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f4065861740 10 client.17646 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f4065861740 1 -- 172.21.15.49:0/1990992124 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556592983620 con 0x55659287e4d0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f40377fe640 1 -- 172.21.15.49:0/1990992124 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40480035f0 con 0x55659287e4d0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f40377fe640 1 -- 172.21.15.49:0/1990992124 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f404c0a88a0 con 0x55659287e4d0 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f4065861740 10 client.17646 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f4065861740 10 client.17646 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f4065861740 20 client.17646 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f4065861740 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55659285dd80 0x556592c621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f4065861740 4 client.17646 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f4065861740 1 -- 172.21.15.49:0/1990992124 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556592bbb640 con 0x55659285dd80 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.691+0000 7f4057fff640 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55659285dd80 0x556592c621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.692+0000 7f40377fe640 10 client.17646 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.692+0000 7f4057fff640 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55659285dd80 0x556592c621c0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce15dbcd41ced423 server_cookie=9a18ebfbcbf89474 in_seq=0 out_seq=0 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f40377fe640 1 -- 172.21.15.49:0/1990992124 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556592bbb640 con 0x55659285dd80 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f40377fe640 10 client.17646 handle_command_reply: tid=0 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 client.17646 shutdown 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 -- 172.21.15.49:0/1990992124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55659287e4d0 msgr2=0x556592c505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55659287e4d0 0x556592c505a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f404c009610 tx=0x7f404c0a8eb0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 -- 172.21.15.49:0/1990992124 shutdown_connections 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55659285dd80 0x556592c621c0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659289f1b0 0x556592c5c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55659287e4d0 0x556592c505a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f40377fe640 0 client.17646 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 --2- 172.21.15.49:0/1990992124 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5565928762f0 0x556592c50060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 -- 172.21.15.49:0/1990992124 >> 172.21.15.49:0/1990992124 conn(0x556592893300 msgr2=0x556592c459e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 -- 172.21.15.49:0/1990992124 shutdown_connections 2024-09-21T06:45:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 1 -- 172.21.15.49:0/1990992124 wait complete. 2024-09-21T06:45:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.693+0000 7f4065861740 20 client.17646 trim_cache size 0 max 16384 2024-09-21T06:45:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f4065861740 1 Processor -- start 2024-09-21T06:45:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f4065861740 1 -- start start 2024-09-21T06:45:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f4065861740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659285dd80 0x556592c460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f4065861740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c5c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f4065861740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659287e4d0 0x556592c4d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f4065861740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f40581b2190 con 0x5565928762f0 2024-09-21T06:45:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f4065861740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40581afa60 con 0x55659287e4d0 2024-09-21T06:45:16.710 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f4065861740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f40581ad8d0 con 0x55659285dd80 2024-09-21T06:45:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f40577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c5c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f40577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c5c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55030/0 (socket says 172.21.15.49:55030) 2024-09-21T06:45:16.711 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.708+0000 7f40577fe640 1 -- 172.21.15.49:0/1737661344 learned_addr learned my addr 172.21.15.49:0/1737661344 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f405cdb2640 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659287e4d0 0x556592c4d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f4057fff640 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659285dd80 0x556592c460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f40577fe640 1 -- 172.21.15.49:0/1737661344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659285dd80 msgr2=0x556592c460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f40577fe640 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659285dd80 0x556592c460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f40577fe640 1 -- 172.21.15.49:0/1737661344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659287e4d0 msgr2=0x556592c4d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f40577fe640 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659287e4d0 0x556592c4d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f40577fe640 1 -- 172.21.15.49:0/1737661344 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556592c4e570 con 0x5565928762f0 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f4057fff640 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659285dd80 0x556592c460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f40577fe640 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c5c350 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f404c009f40 tx=0x7f404c0a8f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ca05a0e34967b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f403dffb640 1 -- 172.21.15.49:0/1737661344 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c020070 con 0x5565928762f0 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f403dffb640 1 -- 172.21.15.49:0/1737661344 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f404c0ad650 con 0x5565928762f0 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.709+0000 7f403dffb640 1 -- 172.21.15.49:0/1737661344 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c098040 con 0x5565928762f0 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 -- 172.21.15.49:0/1737661344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 msgr2=0x556592c5c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c5c350 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f404c009f40 tx=0x7f404c0a8f20 comp rx=0 tx=0).stop 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 -- 172.21.15.49:0/1737661344 shutdown_connections 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659287e4d0 0x556592c4d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c5c350 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 --2- 172.21.15.49:0/1737661344 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659285dd80 0x556592c460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 -- 172.21.15.49:0/1737661344 >> 172.21.15.49:0/1737661344 conn(0x556592893300 msgr2=0x556592c459e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 -- 172.21.15.49:0/1737661344 shutdown_connections 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 -- 172.21.15.49:0/1737661344 wait complete. 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.710+0000 7f4065861740 1 -- start start 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f4065861740 1 Processor -- start 2024-09-21T06:45:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f4065861740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659285dd80 0x556592c55e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f4065861740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c56460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f4065861740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 0x556592cc3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f4065861740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f40581adf20 con 0x5565928762f0 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f4065861740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f40581af390 con 0x55659285dd80 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f4065861740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f40581ae5f0 con 0x55659287e4d0 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f4065861740 10 client.0 _ll_register_callbacks cb 0x7f404c00d6a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c56460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40577fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c56460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:55046/0 (socket says 172.21.15.49:55046) 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40577fe640 1 -- 172.21.15.49:0/306921040 learned_addr learned my addr 172.21.15.49:0/306921040 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f4057fff640 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659285dd80 0x556592c55e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f405cdb2640 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 0x556592cc3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40577fe640 1 -- 172.21.15.49:0/306921040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 msgr2=0x556592cc3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40577fe640 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 0x556592cc3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.717 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40577fe640 1 -- 172.21.15.49:0/306921040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659285dd80 msgr2=0x556592c55e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40577fe640 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659285dd80 0x556592c55e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40577fe640 1 -- 172.21.15.49:0/306921040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556592cc4200 con 0x5565928762f0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f405cdb2640 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 0x556592cc3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40577fe640 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c56460 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f404c0e4e50 tx=0x7f404c0a93f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4711a686935245e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.711+0000 7f40377fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f40377fe640 1 -- 172.21.15.49:0/306921040 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c020070 con 0x5565928762f0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f40377fe640 1 -- 172.21.15.49:0/306921040 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f404c05c1b0 con 0x5565928762f0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f4065861740 1 -- 172.21.15.49:0/306921040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f404c0ad650 con 0x5565928762f0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f40377fe640 1 -- 172.21.15.49:0/306921040 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f404c098040 con 0x5565928762f0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f4065861740 10 client.17652 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f4065861740 1 -- 172.21.15.49:0/306921040 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556592ccc690 con 0x5565928762f0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f40377fe640 1 -- 172.21.15.49:0/306921040 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f404c0ad650 con 0x5565928762f0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f40377fe640 1 -- 172.21.15.49:0/306921040 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f404c0abc20 con 0x5565928762f0 2024-09-21T06:45:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f4065861740 10 client.17652 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f4065861740 10 client.17652 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f4065861740 20 client.17652 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f4065861740 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55659289f1b0 0x556592cced10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f4065861740 4 client.17652 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:45:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.712+0000 7f4065861740 1 -- 172.21.15.49:0/306921040 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556592bb70f0 con 0x55659289f1b0 2024-09-21T06:45:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.713+0000 7f4057fff640 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55659289f1b0 0x556592cced10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.713+0000 7f4057fff640 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55659289f1b0 0x556592cced10 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a5061685d165701 server_cookie=15c4064b99e2cc4d in_seq=0 out_seq=0 2024-09-21T06:45:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.713+0000 7f40377fe640 10 client.17652 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f40377fe640 1 -- 172.21.15.49:0/306921040 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556592bb70f0 con 0x55659289f1b0 2024-09-21T06:45:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f40377fe640 10 client.17652 handle_command_reply: tid=0 2024-09-21T06:45:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 client.17652 shutdown 2024-09-21T06:45:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 -- 172.21.15.49:0/306921040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 msgr2=0x556592c56460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c56460 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f404c0e4e50 tx=0x7f404c0a93f0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 -- 172.21.15.49:0/306921040 shutdown_connections 2024-09-21T06:45:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55659289f1b0 0x556592cced10 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.723 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55659287e4d0 0x556592cc3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5565928762f0 0x556592c56460 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f40377fe640 0 client.17652 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 --2- 172.21.15.49:0/306921040 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55659285dd80 0x556592c55e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 -- 172.21.15.49:0/306921040 >> 172.21.15.49:0/306921040 conn(0x556592893300 msgr2=0x556592c40ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 -- 172.21.15.49:0/306921040 shutdown_connections 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 1 -- 172.21.15.49:0/306921040 wait complete. 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.721+0000 7f4065861740 20 client.17652 trim_cache size 0 max 16384 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:45:16.724 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:45:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 -- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f40400b6680 msgr2=0x7f40400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f40400b6680 0x7f40400b8b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f40500094e0 tx=0x7f40500093f0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 -- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4058105290 msgr2=0x7f405819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4058105290 0x7f405819aa20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f404c00d750 tx=0x7f404c00dc10 comp rx=0 tx=0).stop 2024-09-21T06:45:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 -- 172.21.15.49:0/1078297461 shutdown_connections 2024-09-21T06:45:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f40400b6680 0x7f40400b8b90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f405810dda0 0x7f405819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4058105290 0x7f405819aa20 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 --2- 172.21.15.49:0/1078297461 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4058104940 0x7f405819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 -- 172.21.15.49:0/1078297461 >> 172.21.15.49:0/1078297461 conn(0x7f40580fe3b0 msgr2=0x7f4058107820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 -- 172.21.15.49:0/1078297461 shutdown_connections 2024-09-21T06:45:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:16.722+0000 7f405e815640 1 -- 172.21.15.49:0/1078297461 wait complete. 2024-09-21T06:45:18.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:17 smithi098 ceph-mon[34704]: pgmap v584: 97 pgs: 97 active+clean; 8.8 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:45:18.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:17 smithi079 ceph-mon[34346]: pgmap v584: 97 pgs: 97 active+clean; 8.8 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:45:18.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:17 smithi049 ceph-mon[31177]: pgmap v584: 97 pgs: 97 active+clean; 8.8 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:45:19.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:18 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:45:19.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:18 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:45:19.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:18 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:45:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:19 smithi098 ceph-mon[34704]: pgmap v585: 97 pgs: 97 active+clean; 8.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:45:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:19 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:45:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:19 smithi079 ceph-mon[34346]: pgmap v585: 97 pgs: 97 active+clean; 8.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:45:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:19 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:45:20.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:19 smithi049 ceph-mon[31177]: pgmap v585: 97 pgs: 97 active+clean; 8.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:45:20.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:19 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:45:22.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:21 smithi098 ceph-mon[34704]: pgmap v586: 97 pgs: 97 active+clean; 8.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:45:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:21 smithi079 ceph-mon[34346]: pgmap v586: 97 pgs: 97 active+clean; 8.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:45:22.157 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:21 smithi049 ceph-mon[31177]: pgmap v586: 97 pgs: 97 active+clean; 8.9 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:45:24.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:23 smithi098 ceph-mon[34704]: pgmap v587: 97 pgs: 97 active+clean; 9.0 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:45:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:23 smithi079 ceph-mon[34346]: pgmap v587: 97 pgs: 97 active+clean; 9.0 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:45:24.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:23 smithi049 ceph-mon[31177]: pgmap v587: 97 pgs: 97 active+clean; 9.0 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:45:26.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:25 smithi098 ceph-mon[34704]: pgmap v588: 97 pgs: 97 active+clean; 9.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:45:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:25 smithi079 ceph-mon[34346]: pgmap v588: 97 pgs: 97 active+clean; 9.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:45:26.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:25 smithi049 ceph-mon[31177]: pgmap v588: 97 pgs: 97 active+clean; 9.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:45:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:27 smithi079 ceph-mon[34346]: pgmap v589: 97 pgs: 97 active+clean; 9.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:45:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:27 smithi049 ceph-mon[31177]: pgmap v589: 97 pgs: 97 active+clean; 9.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:45:28.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:27 smithi098 ceph-mon[34704]: pgmap v589: 97 pgs: 97 active+clean; 9.1 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:45:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.837+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2521538923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 msgr2=0x7f0a7410f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.837+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2521538923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 0x7f0a7410f480 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009ca0 tx=0x7f0a6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.837+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2521538923 shutdown_connections 2024-09-21T06:45:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.837+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2521538923 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 0x7f0a7410f480 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.837+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2521538923 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a74108300 0x7f0a74108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.837+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2521538923 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a741029d0 0x7f0a74102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.837+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2521538923 >> 172.21.15.49:0/2521538923 conn(0x7f0a7407a710 msgr2=0x7f0a7407ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.837+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2521538923 shutdown_connections 2024-09-21T06:45:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.837+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2521538923 wait complete. 2024-09-21T06:45:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.838+0000 7f0a7a3ba640 1 Processor -- start 2024-09-21T06:45:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.838+0000 7f0a7a3ba640 1 -- start start 2024-09-21T06:45:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.838+0000 7f0a7a3ba640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a741029d0 0x7f0a7419b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.838+0000 7f0a7a3ba640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a74108300 0x7f0a7419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.847 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.838+0000 7f0a7a3ba640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 0x7f0a7419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.838+0000 7f0a7a3ba640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74112910 con 0x7f0a74108c50 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.838+0000 7f0a7a3ba640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74112790 con 0x7f0a741029d0 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.838+0000 7f0a7a3ba640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74112a90 con 0x7f0a74108300 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a78957640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 0x7f0a7419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a78957640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 0x7f0a7419bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36962/0 (socket says 172.21.15.49:36962) 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a78957640 1 -- 172.21.15.49:0/2782901525 learned_addr learned my addr 172.21.15.49:0/2782901525 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a73fff640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a741029d0 0x7f0a7419b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a737fe640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a74108300 0x7f0a7419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a78957640 1 -- 172.21.15.49:0/2782901525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a74108300 msgr2=0x7f0a7419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a78957640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a74108300 0x7f0a7419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a78957640 1 -- 172.21.15.49:0/2782901525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a741029d0 msgr2=0x7f0a7419b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a78957640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a741029d0 0x7f0a7419b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.848 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a78957640 1 -- 172.21.15.49:0/2782901525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a741a6510 con 0x7f0a74108c50 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a78957640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 0x7f0a7419bd00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005cc0 tx=0x7f0a6c02f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a717fa640 1 -- 172.21.15.49:0/2782901525 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c003bf0 con 0x7f0a74108c50 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a717fa640 1 -- 172.21.15.49:0/2782901525 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a6c003d90 con 0x7f0a74108c50 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2782901525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a741a67a0 con 0x7f0a74108c50 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.839+0000 7f0a717fa640 1 -- 172.21.15.49:0/2782901525 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c02fbc0 con 0x7f0a74108c50 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.840+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2782901525 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a741a6cf0 con 0x7f0a74108c50 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.842+0000 7f0a81407740 1 Processor -- start 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.842+0000 7f0a717fa640 1 -- 172.21.15.49:0/2782901525 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0a6c02fd60 con 0x7f0a74108c50 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.842+0000 7f0a81407740 1 -- start start 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a81407740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a81407740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e65ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.849 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a81407740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e66430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a81407740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5583f1dda6f0 con 0x5583f1ac01b0 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a81407740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5583f1dc9b20 con 0x5583f1a972f0 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a81407740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5583f1dcd930 con 0x5583f1a9f4d0 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e659b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36974/0 (socket says 172.21.15.49:36974) 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 -- 172.21.15.49:0/2083863475 learned_addr learned my addr 172.21.15.49:0/2083863475 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a73fff640 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e65ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e66430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a717fa640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a5c0b6680 0x7f0a5c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 -- 172.21.15.49:0/2083863475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 msgr2=0x5583f1e66430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e66430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.850 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 -- 172.21.15.49:0/2083863475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 msgr2=0x5583f1e65ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e65ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 -- 172.21.15.49:0/2083863475 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f1d8f530 con 0x5583f1ac01b0 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a73fff640 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e65ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a78957640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a5c0b6680 0x7f0a5c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a737fe640 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e659b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f0a680148a0 tx=0x7f0a6800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc69272e4575f3fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.843+0000 7f0a717fa640 1 -- 172.21.15.49:0/2782901525 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f0a6c108cb0 con 0x7f0a74108c50 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.844+0000 7f0a5a7fc640 1 -- 172.21.15.49:0/2083863475 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68014270 con 0x5583f1ac01b0 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.844+0000 7f0a5a7fc640 1 -- 172.21.15.49:0/2083863475 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a680054d0 con 0x5583f1ac01b0 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.844+0000 7f0a5a7fc640 1 -- 172.21.15.49:0/2083863475 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68004da0 con 0x5583f1ac01b0 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 -- 172.21.15.49:0/2083863475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 msgr2=0x5583f1e659b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a78957640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a5c0b6680 0x7f0a5c0b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c106460 tx=0x7f0a6c0f2040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e659b0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f0a680148a0 tx=0x7f0a6800b420 comp rx=0 tx=0).stop 2024-09-21T06:45:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 -- 172.21.15.49:0/2083863475 shutdown_connections 2024-09-21T06:45:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e66430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e65ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 --2- 172.21.15.49:0/2083863475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e659b0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 -- 172.21.15.49:0/2083863475 >> 172.21.15.49:0/2083863475 conn(0x5583f1ab4300 msgr2=0x5583f1e638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 -- 172.21.15.49:0/2083863475 shutdown_connections 2024-09-21T06:45:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 -- 172.21.15.49:0/2083863475 wait complete. 2024-09-21T06:45:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 -- start start 2024-09-21T06:45:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.845+0000 7f0a81407740 1 Processor -- start 2024-09-21T06:45:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a81407740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e75440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a81407740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a9f4d0 0x5583f1e75980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a81407740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1ac01b0 0x5583f1e81810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a81407740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5583f1d01ab0 con 0x5583f1a9f4d0 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a81407740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5583f1d6f730 con 0x5583f1a972f0 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a81407740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5583f1e784b0 con 0x5583f1ac01b0 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a81407740 10 client.0 _ll_register_callbacks cb 0x5583f1dc36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a73fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a9f4d0 0x5583f1e75980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a73fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a9f4d0 0x5583f1e75980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36988/0 (socket says 172.21.15.49:36988) 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a73fff640 1 -- 172.21.15.49:0/1893615323 learned_addr learned my addr 172.21.15.49:0/1893615323 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a737fe640 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e75440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a737fe640 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1ac01b0 0x5583f1e81810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a73fff640 1 -- 172.21.15.49:0/1893615323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1ac01b0 msgr2=0x5583f1e81810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a73fff640 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1ac01b0 0x5583f1e81810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a73fff640 1 -- 172.21.15.49:0/1893615323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 msgr2=0x5583f1e75440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.857 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a73fff640 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e75440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a73fff640 1 -- 172.21.15.49:0/1893615323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f1b2b790 con 0x5583f1a9f4d0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a737fe640 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1ac01b0 0x5583f1e81810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a73fff640 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a9f4d0 0x5583f1e75980 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400bad0 tx=0x7f0a6400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db6a5a0a58d4d817 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.846+0000 7f0a537fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a537fe640 1 -- 172.21.15.49:0/1893615323 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a64005020 con 0x5583f1a9f4d0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a537fe640 1 -- 172.21.15.49:0/1893615323 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f0a640051c0 con 0x5583f1a9f4d0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a81407740 1 -- 172.21.15.49:0/1893615323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a680054d0 con 0x5583f1a9f4d0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a537fe640 1 -- 172.21.15.49:0/1893615323 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a640053c0 con 0x5583f1a9f4d0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a81407740 10 client.17664 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a81407740 1 -- 172.21.15.49:0/1893615323 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5583f1ba4620 con 0x5583f1a9f4d0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a537fe640 1 -- 172.21.15.49:0/1893615323 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a680054d0 con 0x5583f1a9f4d0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a537fe640 1 -- 172.21.15.49:0/1893615323 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0a6401b600 con 0x5583f1a9f4d0 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a81407740 10 client.17664 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a81407740 10 client.17664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:29.858 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a81407740 20 client.17664 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a81407740 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5583f1a7ed80 0x5583f1e87560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a81407740 4 client.17664 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.847+0000 7f0a81407740 1 -- 172.21.15.49:0/1893615323 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583f1ddc640 con 0x5583f1a7ed80 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.848+0000 7f0a737fe640 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5583f1a7ed80 0x5583f1e87560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.848+0000 7f0a737fe640 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5583f1a7ed80 0x5583f1e87560 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0056d8868a1e8d3 server_cookie=f82aa6c30fadce0f in_seq=0 out_seq=0 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.848+0000 7f0a537fe640 10 client.17664 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a537fe640 1 -- 172.21.15.49:0/1893615323 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583f1ddc640 con 0x5583f1a7ed80 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a537fe640 10 client.17664 handle_command_reply: tid=0 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 client.17664 shutdown 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 -- 172.21.15.49:0/1893615323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a9f4d0 msgr2=0x5583f1e75980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a9f4d0 0x5583f1e75980 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f0a6400bad0 tx=0x7f0a6400bf90 comp rx=0 tx=0).stop 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 -- 172.21.15.49:0/1893615323 shutdown_connections 2024-09-21T06:45:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5583f1a7ed80 0x5583f1e87560 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1ac01b0 0x5583f1e81810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a9f4d0 0x5583f1e75980 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a537fe640 0 client.17664 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 --2- 172.21.15.49:0/1893615323 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e75440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 -- 172.21.15.49:0/1893615323 >> 172.21.15.49:0/1893615323 conn(0x5583f1ab4300 msgr2=0x5583f1e673a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 -- 172.21.15.49:0/1893615323 shutdown_connections 2024-09-21T06:45:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 1 -- 172.21.15.49:0/1893615323 wait complete. 2024-09-21T06:45:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.849+0000 7f0a81407740 20 client.17664 trim_cache size 0 max 16384 2024-09-21T06:45:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.864+0000 7f0a81407740 1 Processor -- start 2024-09-21T06:45:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.864+0000 7f0a81407740 1 -- start start 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.864+0000 7f0a81407740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e75920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.864+0000 7f0a81407740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e70ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.864+0000 7f0a81407740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e81710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.864+0000 7f0a81407740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0a741aff70 con 0x5583f1ac01b0 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.864+0000 7f0a81407740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0a741ad840 con 0x5583f1a972f0 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.864+0000 7f0a81407740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a741ab6b0 con 0x5583f1a9f4d0 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e81710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e81710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36994/0 (socket says 172.21.15.49:36994) 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a737fe640 1 -- 172.21.15.49:0/1535955438 learned_addr learned my addr 172.21.15.49:0/1535955438 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a73fff640 1 --2- 172.21.15.49:0/1535955438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e70ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a737fe640 1 -- 172.21.15.49:0/1535955438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 msgr2=0x5583f1e70ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a737fe640 1 --2- 172.21.15.49:0/1535955438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e70ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a737fe640 1 -- 172.21.15.49:0/1535955438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 msgr2=0x5583f1e75920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a737fe640 1 --2- 172.21.15.49:0/1535955438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e75920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a737fe640 1 -- 172.21.15.49:0/1535955438 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f1e5ef50 con 0x5583f1ac01b0 2024-09-21T06:45:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a73fff640 1 --2- 172.21.15.49:0/1535955438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e70ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a737fe640 1 --2- 172.21.15.49:0/1535955438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e81710 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f0a68005fd0 tx=0x7f0a68014470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6569519a35c67c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a59ffb640 1 -- 172.21.15.49:0/1535955438 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a68004810 con 0x5583f1ac01b0 2024-09-21T06:45:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a59ffb640 1 -- 172.21.15.49:0/1535955438 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a680140b0 con 0x5583f1ac01b0 2024-09-21T06:45:29.871 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.865+0000 7f0a59ffb640 1 -- 172.21.15.49:0/1535955438 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800fe20 con 0x5583f1ac01b0 2024-09-21T06:45:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 -- 172.21.15.49:0/1535955438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 msgr2=0x5583f1e81710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 --2- 172.21.15.49:0/1535955438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e81710 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f0a68005fd0 tx=0x7f0a68014470 comp rx=0 tx=0).stop 2024-09-21T06:45:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 -- 172.21.15.49:0/1535955438 shutdown_connections 2024-09-21T06:45:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 --2- 172.21.15.49:0/1535955438 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1ac01b0 0x5583f1e81710 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 --2- 172.21.15.49:0/1535955438 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e70ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 --2- 172.21.15.49:0/1535955438 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1a972f0 0x5583f1e75920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 -- 172.21.15.49:0/1535955438 >> 172.21.15.49:0/1535955438 conn(0x5583f1ab4300 msgr2=0x5583f1e73ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 -- 172.21.15.49:0/1535955438 shutdown_connections 2024-09-21T06:45:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 -- 172.21.15.49:0/1535955438 wait complete. 2024-09-21T06:45:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.866+0000 7f0a81407740 1 -- start start 2024-09-21T06:45:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a81407740 1 Processor -- start 2024-09-21T06:45:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a81407740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a972f0 0x5583f1e79b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a81407740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e7a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a81407740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1ac01b0 0x5583f1ef0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a81407740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f0a741abd00 con 0x5583f1a972f0 2024-09-21T06:45:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a81407740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0a741ad170 con 0x5583f1ac01b0 2024-09-21T06:45:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a81407740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0a741ac3d0 con 0x5583f1a9f4d0 2024-09-21T06:45:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a81407740 10 client.0 _ll_register_callbacks cb 0x7f0a64004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a972f0 0x5583f1e79b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a972f0 0x5583f1e79b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36998/0 (socket says 172.21.15.49:36998) 2024-09-21T06:45:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a737fe640 1 -- 172.21.15.49:0/2217742953 learned_addr learned my addr 172.21.15.49:0/2217742953 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a73fff640 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e7a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a737fe640 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1ac01b0 0x5583f1ef0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a737fe640 1 -- 172.21.15.49:0/2217742953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 msgr2=0x5583f1e7a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a737fe640 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e7a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a737fe640 1 -- 172.21.15.49:0/2217742953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1ac01b0 msgr2=0x5583f1ef0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a737fe640 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1ac01b0 0x5583f1ef0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.867+0000 7f0a737fe640 1 -- 172.21.15.49:0/2217742953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f1e67ee0 con 0x5583f1a972f0 2024-09-21T06:45:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a737fe640 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a972f0 0x5583f1e79b70 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f0a68016010 tx=0x7f0a6800fd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f113dc7ad994346 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a537fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a537fe640 1 -- 172.21.15.49:0/2217742953 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6800f6d0 con 0x5583f1a972f0 2024-09-21T06:45:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a81407740 1 -- 172.21.15.49:0/2217742953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a680140b0 con 0x5583f1a972f0 2024-09-21T06:45:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a537fe640 1 -- 172.21.15.49:0/2217742953 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f0a6800f870 con 0x5583f1a972f0 2024-09-21T06:45:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a537fe640 1 -- 172.21.15.49:0/2217742953 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a6800fa70 con 0x5583f1a972f0 2024-09-21T06:45:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a81407740 10 client.17670 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a81407740 1 -- 172.21.15.49:0/2217742953 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5583f1e667f0 con 0x5583f1a972f0 2024-09-21T06:45:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a537fe640 1 -- 172.21.15.49:0/2217742953 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a680140b0 con 0x5583f1a972f0 2024-09-21T06:45:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a537fe640 1 -- 172.21.15.49:0/2217742953 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0a68036430 con 0x5583f1a972f0 2024-09-21T06:45:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a81407740 10 client.17670 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a81407740 10 client.17670 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a81407740 20 client.17670 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a81407740 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5583f1a541c0 0x5583f1ef4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a81407740 4 client.17670 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:45:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.868+0000 7f0a81407740 1 -- 172.21.15.49:0/2217742953 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5583f1dd80f0 con 0x5583f1a541c0 2024-09-21T06:45:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.869+0000 7f0a73fff640 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5583f1a541c0 0x5583f1ef4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.869+0000 7f0a537fe640 10 client.17670 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.869+0000 7f0a73fff640 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5583f1a541c0 0x5583f1ef4690 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=887df077e679912 server_cookie=a90daf1f5e947834 in_seq=0 out_seq=0 2024-09-21T06:45:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a537fe640 1 -- 172.21.15.49:0/2217742953 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5583f1dd80f0 con 0x5583f1a541c0 2024-09-21T06:45:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a537fe640 10 client.17670 handle_command_reply: tid=0 2024-09-21T06:45:29.882 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 client.17670 shutdown 2024-09-21T06:45:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 -- 172.21.15.49:0/2217742953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a972f0 msgr2=0x5583f1e79b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a972f0 0x5583f1e79b70 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f0a68016010 tx=0x7f0a6800fd00 comp rx=0 tx=0).stop 2024-09-21T06:45:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 -- 172.21.15.49:0/2217742953 shutdown_connections 2024-09-21T06:45:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5583f1a541c0 0x5583f1ef4690 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5583f1ac01b0 0x5583f1ef0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5583f1a9f4d0 0x5583f1e7a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 --2- 172.21.15.49:0/2217742953 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5583f1a972f0 0x5583f1e79b70 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a537fe640 0 client.17670 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:29.883 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 -- 172.21.15.49:0/2217742953 >> 172.21.15.49:0/2217742953 conn(0x5583f1ab4300 msgr2=0x5583f1e669e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 -- 172.21.15.49:0/2217742953 shutdown_connections 2024-09-21T06:45:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 1 -- 172.21.15.49:0/2217742953 wait complete. 2024-09-21T06:45:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.877+0000 7f0a81407740 20 client.17670 trim_cache size 0 max 16384 2024-09-21T06:45:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:45:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:45:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:45:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:45:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a5c0b6680 msgr2=0x7f0a5c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a5c0b6680 0x7f0a5c0b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c106460 tx=0x7f0a6c0f2040 comp rx=0 tx=0).stop 2024-09-21T06:45:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 msgr2=0x7f0a7419bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 0x7f0a7419bd00 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c005cc0 tx=0x7f0a6c02f380 comp rx=0 tx=0).stop 2024-09-21T06:45:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2782901525 shutdown_connections 2024-09-21T06:45:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f0a5c0b6680 0x7f0a5c0b8b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0a74108c50 0x7f0a7419bd00 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0a74108300 0x7f0a7419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 --2- 172.21.15.49:0/2782901525 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0a741029d0 0x7f0a7419b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2782901525 >> 172.21.15.49:0/2782901525 conn(0x7f0a7407a710 msgr2=0x7f0a74105200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2782901525 shutdown_connections 2024-09-21T06:45:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:29.878+0000 7f0a7a3ba640 1 -- 172.21.15.49:0/2782901525 wait complete. 2024-09-21T06:45:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:29 smithi079 ceph-mon[34346]: pgmap v590: 97 pgs: 97 active+clean; 9.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:30.098 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:29 smithi098 ceph-mon[34704]: pgmap v590: 97 pgs: 97 active+clean; 9.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:30.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:29 smithi049 ceph-mon[31177]: pgmap v590: 97 pgs: 97 active+clean; 9.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:31 smithi079 ceph-mon[34346]: pgmap v591: 97 pgs: 97 active+clean; 9.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-09-21T06:45:32.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:31 smithi049 ceph-mon[31177]: pgmap v591: 97 pgs: 97 active+clean; 9.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-09-21T06:45:32.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:31 smithi098 ceph-mon[34704]: pgmap v591: 97 pgs: 97 active+clean; 9.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 10 op/s 2024-09-21T06:45:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:33 smithi079 ceph-mon[34346]: pgmap v592: 97 pgs: 97 active+clean; 9.2 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:45:34.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:33 smithi049 ceph-mon[31177]: pgmap v592: 97 pgs: 97 active+clean; 9.2 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:45:34.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:33 smithi098 ceph-mon[34704]: pgmap v592: 97 pgs: 97 active+clean; 9.2 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:45:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:35 smithi079 ceph-mon[34346]: pgmap v593: 97 pgs: 97 active+clean; 9.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:36.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:35 smithi049 ceph-mon[31177]: pgmap v593: 97 pgs: 97 active+clean; 9.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:36.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:35 smithi098 ceph-mon[34704]: pgmap v593: 97 pgs: 97 active+clean; 9.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:38.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:37 smithi079 ceph-mon[34346]: pgmap v594: 97 pgs: 97 active+clean; 9.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:45:38.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:37 smithi049 ceph-mon[31177]: pgmap v594: 97 pgs: 97 active+clean; 9.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:45:38.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:37 smithi098 ceph-mon[34704]: pgmap v594: 97 pgs: 97 active+clean; 9.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:45:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:39 smithi079 ceph-mon[34346]: pgmap v595: 97 pgs: 97 active+clean; 9.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:40.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:39 smithi049 ceph-mon[31177]: pgmap v595: 97 pgs: 97 active+clean; 9.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:40.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:39 smithi098 ceph-mon[34704]: pgmap v595: 97 pgs: 97 active+clean; 9.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:41 smithi079 ceph-mon[34346]: pgmap v596: 97 pgs: 97 active+clean; 9.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-21T06:45:42.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:41 smithi049 ceph-mon[31177]: pgmap v596: 97 pgs: 97 active+clean; 9.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-21T06:45:42.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:41 smithi098 ceph-mon[34704]: pgmap v596: 97 pgs: 97 active+clean; 9.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-21T06:45:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.992+0000 7fd7bd68b640 1 -- 172.21.15.49:0/136188568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109da0 msgr2=0x7fd7b81105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.992+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/136188568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109da0 0x7fd7b81105d0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009ca0 tx=0x7fd7b002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.992+0000 7fd7bd68b640 1 -- 172.21.15.49:0/136188568 shutdown_connections 2024-09-21T06:45:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.992+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/136188568 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109da0 0x7fd7b81105d0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.992+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/136188568 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7b8109450 0x7fd7b8109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.992+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/136188568 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7b8103b20 0x7fd7b8103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.992+0000 7fd7bd68b640 1 -- 172.21.15.49:0/136188568 >> 172.21.15.49:0/136188568 conn(0x7fd7b80ff560 msgr2=0x7fd7b81019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.993+0000 7fd7bd68b640 1 -- 172.21.15.49:0/136188568 shutdown_connections 2024-09-21T06:45:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.993+0000 7fd7bd68b640 1 -- 172.21.15.49:0/136188568 wait complete. 2024-09-21T06:45:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.993+0000 7fd7bd68b640 1 Processor -- start 2024-09-21T06:45:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.993+0000 7fd7bd68b640 1 -- start start 2024-09-21T06:45:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7bd68b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7b8103b20 0x7fd7b819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7bd68b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109450 0x7fd7b819aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7bd68b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7b8109da0 0x7fd7b819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7bd68b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b8113a60 con 0x7fd7b8109450 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7bd68b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81138e0 con 0x7fd7b8109da0 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7bd68b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b8113be0 con 0x7fd7b8103b20 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109450 0x7fd7b819aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109450 0x7fd7b819aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49694/0 (socket says 172.21.15.49:49694) 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b67fc640 1 -- 172.21.15.49:0/626441488 learned_addr learned my addr 172.21.15.49:0/626441488 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b77fe640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7b8109da0 0x7fd7b819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7b8103b20 0x7fd7b819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b67fc640 1 -- 172.21.15.49:0/626441488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7b8103b20 msgr2=0x7fd7b819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7b8103b20 0x7fd7b819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b67fc640 1 -- 172.21.15.49:0/626441488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7b8109da0 msgr2=0x7fd7b819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7b8109da0 0x7fd7b819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b67fc640 1 -- 172.21.15.49:0/626441488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b81a03d0 con 0x7fd7b8109450 2024-09-21T06:45:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7b8103b20 0x7fd7b819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.994+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109450 0x7fd7b819aa40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00e9c0 tx=0x7fd7ac00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.995+0000 7fd79ffff640 1 -- 172.21.15.49:0/626441488 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac00ccc0 con 0x7fd7b8109450 2024-09-21T06:45:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.995+0000 7fd79ffff640 1 -- 172.21.15.49:0/626441488 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7ac0054d0 con 0x7fd7b8109450 2024-09-21T06:45:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.995+0000 7fd7bd68b640 1 -- 172.21.15.49:0/626441488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b81a06c0 con 0x7fd7b8109450 2024-09-21T06:45:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.995+0000 7fd79ffff640 1 -- 172.21.15.49:0/626441488 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac010430 con 0x7fd7b8109450 2024-09-21T06:45:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.995+0000 7fd7bd68b640 1 -- 172.21.15.49:0/626441488 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b81a6e50 con 0x7fd7b8109450 2024-09-21T06:45:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.997+0000 7fd7c45f9740 1 Processor -- start 2024-09-21T06:45:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.997+0000 7fd7c45f9740 1 -- start start 2024-09-21T06:45:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5362f1b0 0x562b539d49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5360e4d0 0x562b539d5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562b539496f0 con 0x562b5360e4d0 2024-09-21T06:45:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b53938b20 con 0x562b536062f0 2024-09-21T06:45:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562b5393c930 con 0x562b5362f1b0 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd79ffff640 1 -- 172.21.15.49:0/626441488 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd7ac005020 con 0x7fd7b8109450 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5360e4d0 0x562b539d5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b67fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5360e4d0 0x562b539d5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49698/0 (socket says 172.21.15.49:49698) 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b6ffd640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539d4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:34770/0 (socket says 172.21.15.49:34770) 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b67fc640 1 -- 172.21.15.49:0/1340609072 learned_addr learned my addr 172.21.15.49:0/1340609072 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b77fe640 1 --2- 172.21.15.49:0/1340609072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5362f1b0 0x562b539d49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/1340609072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5362f1b0 msgr2=0x562b539d49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/1340609072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5362f1b0 0x562b539d49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/1340609072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5360e4d0 msgr2=0x562b539d5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/1340609072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5360e4d0 0x562b539d5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.998+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/1340609072 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b538fe530 con 0x562b536062f0 2024-09-21T06:45:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.999+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/1340609072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539d4ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009c60 tx=0x7fd7a80117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=830afe24813c7603 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.999+0000 7fd79ffff640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7a00b6700 0x7fd7a00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.999+0000 7fd79d7fa640 1 -- 172.21.15.49:0/1340609072 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8012450 con 0x562b536062f0 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.999+0000 7fd79d7fa640 1 -- 172.21.15.49:0/1340609072 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7a8012aa0 con 0x562b536062f0 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.999+0000 7fd79d7fa640 1 -- 172.21.15.49:0/1340609072 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a800fa10 con 0x562b536062f0 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.999+0000 7fd7b77fe640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7a00b6700 0x7fd7a00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:42.999+0000 7fd79ffff640 1 -- 172.21.15.49:0/626441488 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7fd7ac0e7ae0 con 0x7fd7b8109450 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7b77fe640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7a00b6700 0x7fd7a00b8c10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd7b002f500 tx=0x7fd7b002f310 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 -- 172.21.15.49:0/1340609072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 msgr2=0x562b539d4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/1340609072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539d4ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009c60 tx=0x7fd7a80117b0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 -- 172.21.15.49:0/1340609072 shutdown_connections 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/1340609072 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5360e4d0 0x562b539d5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/1340609072 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539d4ef0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/1340609072 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5362f1b0 0x562b539d49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 -- 172.21.15.49:0/1340609072 >> 172.21.15.49:0/1340609072 conn(0x562b53623300 msgr2=0x562b539d28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 -- 172.21.15.49:0/1340609072 shutdown_connections 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 -- 172.21.15.49:0/1340609072 wait complete. 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 -- start start 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.000+0000 7fd7c45f9740 1 Processor -- start 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539e0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 0x562b539ec450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562b53870ab0 con 0x562b536062f0 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562b538de730 con 0x562b5362f1b0 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562b539e3130 con 0x562b5360e4d0 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7c45f9740 10 client.0 _ll_register_callbacks cb 0x562b539326b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539e00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49702/0 (socket says 172.21.15.49:49702) 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/2641600906 learned_addr learned my addr 172.21.15.49:0/2641600906 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b77fe640 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 0x562b539ec450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/2641600906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 msgr2=0x562b539e0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539e0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/2641600906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 msgr2=0x562b539ec450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 0x562b539ec450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.001+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/2641600906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b5369a790 con 0x562b536062f0 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539e00c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005860 tx=0x7fd7a800f440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea60b50f3cd7f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd79aff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd79aff5640 1 -- 172.21.15.49:0/2641600906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8028020 con 0x562b536062f0 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd79aff5640 1 -- 172.21.15.49:0/2641600906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7fd7a8005040 con 0x562b536062f0 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2641600906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7a8012aa0 con 0x562b536062f0 2024-09-21T06:45:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd79aff5640 1 -- 172.21.15.49:0/2641600906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd7a8033050 con 0x562b536062f0 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd7c45f9740 10 client.17682 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2641600906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562b53713620 con 0x562b536062f0 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd79aff5640 1 -- 172.21.15.49:0/2641600906 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7a8012aa0 con 0x562b536062f0 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd79aff5640 1 -- 172.21.15.49:0/2641600906 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd7a800fd20 con 0x562b536062f0 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd7c45f9740 10 client.17682 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd7c45f9740 10 client.17682 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.002+0000 7fd7c45f9740 20 client.17682 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.003+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562b535edd80 0x562b539f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.003+0000 7fd7c45f9740 4 client.17682 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.003+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2641600906 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b5394b640 con 0x562b535edd80 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.003+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562b535edd80 0x562b539f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.003+0000 7fd79aff5640 10 client.17682 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.003+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562b535edd80 0x562b539f20a0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee8fb486feef0add server_cookie=6f01bf297b55389b in_seq=0 out_seq=0 2024-09-21T06:45:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd79aff5640 1 -- 172.21.15.49:0/2641600906 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b5394b640 con 0x562b535edd80 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd79aff5640 10 client.17682 handle_command_reply: tid=0 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 client.17682 shutdown 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2641600906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 msgr2=0x562b539e00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539e00c0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005860 tx=0x7fd7a800f440 comp rx=0 tx=0).stop 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2641600906 shutdown_connections 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562b535edd80 0x562b539f20a0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 0x562b539ec450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2641600906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539e00c0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd79aff5640 0 client.17682 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2641600906 >> 172.21.15.49:0/2641600906 conn(0x562b53623300 msgr2=0x562b539d59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2641600906 shutdown_connections 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2641600906 wait complete. 2024-09-21T06:45:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.004+0000 7fd7c45f9740 20 client.17682 trim_cache size 0 max 16384 2024-09-21T06:45:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.019+0000 7fd7c45f9740 1 Processor -- start 2024-09-21T06:45:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.019+0000 7fd7c45f9740 1 -- start start 2024-09-21T06:45:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539db7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539d60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5362f1b0 0x562b539ec3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81b2160 con 0x562b5362f1b0 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81afa30 con 0x562b536062f0 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81ad8a0 con 0x562b5360e4d0 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5362f1b0 0x562b539ec3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b77fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5362f1b0 0x562b539ec3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49718/0 (socket says 172.21.15.49:49718) 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b77fe640 1 -- 172.21.15.49:0/2804039520 learned_addr learned my addr 172.21.15.49:0/2804039520 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539d60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539db7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b77fe640 1 -- 172.21.15.49:0/2804039520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 msgr2=0x562b539d60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b77fe640 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539d60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b77fe640 1 -- 172.21.15.49:0/2804039520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 msgr2=0x562b539db7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b77fe640 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539db7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b77fe640 1 -- 172.21.15.49:0/2804039520 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b539e1380 con 0x562b5362f1b0 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539db7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd7b77fe640 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5362f1b0 0x562b539ec3c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0035000 tx=0x7fd7b0044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351016f7926803c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd79cff9640 1 -- 172.21.15.49:0/2804039520 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0003970 con 0x562b5362f1b0 2024-09-21T06:45:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd79cff9640 1 -- 172.21.15.49:0/2804039520 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7b0036050 con 0x562b5362f1b0 2024-09-21T06:45:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.020+0000 7fd79cff9640 1 -- 172.21.15.49:0/2804039520 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b002f8c0 con 0x562b5362f1b0 2024-09-21T06:45:43.024 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.021+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2804039520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5362f1b0 msgr2=0x562b539ec3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.021+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5362f1b0 0x562b539ec3c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0035000 tx=0x7fd7b0044000 comp rx=0 tx=0).stop 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.021+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2804039520 shutdown_connections 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.021+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b5362f1b0 0x562b539ec3c0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.021+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539d60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.021+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2804039520 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b536062f0 0x562b539db7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.021+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2804039520 >> 172.21.15.49:0/2804039520 conn(0x562b53623300 msgr2=0x562b539d59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.021+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2804039520 shutdown_connections 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.021+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2804039520 wait complete. 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7c45f9740 1 -- start start 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7c45f9740 1 Processor -- start 2024-09-21T06:45:43.028 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539f2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7c45f9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 0x562b53a5a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81adef0 con 0x562b536062f0 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81af360 con 0x562b5362f1b0 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7c45f9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b81ae5c0 con 0x562b5360e4d0 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7c45f9740 10 client.0 _ll_register_callbacks cb 0x7fd7ac0eb500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49722/0 (socket says 172.21.15.49:49722) 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/2960804018 learned_addr learned my addr 172.21.15.49:0/2960804018 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b77fe640 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 0x562b53a5a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/2960804018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 msgr2=0x562b539f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/2960804018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 msgr2=0x562b53a5a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 0x562b53a5a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.022+0000 7fd7b6ffd640 1 -- 172.21.15.49:0/2960804018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b53a5ad50 con 0x562b536062f0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd7b6ffd640 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539f2510 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005940 tx=0x7fd7a8004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a89ebeebf9e7ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd79aff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd79aff5640 1 -- 172.21.15.49:0/2960804018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a803c060 con 0x562b536062f0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd79aff5640 1 -- 172.21.15.49:0/2960804018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7fd7a8004040 con 0x562b536062f0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2960804018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7b0036050 con 0x562b536062f0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd79aff5640 1 -- 172.21.15.49:0/2960804018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd7a8028070 con 0x562b536062f0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd7c45f9740 10 client.17688 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2960804018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562b53a5be80 con 0x562b536062f0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd79aff5640 1 -- 172.21.15.49:0/2960804018 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7b0036050 con 0x562b536062f0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd79aff5640 1 -- 172.21.15.49:0/2960804018 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd7a80050f0 con 0x562b536062f0 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd7c45f9740 10 client.17688 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd7c45f9740 10 client.17688 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.023+0000 7fd7c45f9740 20 client.17688 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.024+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562b535c31c0 0x562b53a5e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.024+0000 7fd7c45f9740 4 client.17688 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:45:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.024+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2960804018 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b539470f0 con 0x562b535c31c0 2024-09-21T06:45:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.024+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562b535c31c0 0x562b53a5e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.024+0000 7fd7b67fc640 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562b535c31c0 0x562b53a5e500 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=969000ea361aa945 server_cookie=14136133b859d6e in_seq=0 out_seq=0 2024-09-21T06:45:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.024+0000 7fd79aff5640 10 client.17688 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd79aff5640 1 -- 172.21.15.49:0/2960804018 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b539470f0 con 0x562b535c31c0 2024-09-21T06:45:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd79aff5640 10 client.17688 handle_command_reply: tid=0 2024-09-21T06:45:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 client.17688 shutdown 2024-09-21T06:45:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2960804018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 msgr2=0x562b539f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539f2510 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8005940 tx=0x7fd7a8004c00 comp rx=0 tx=0).stop 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2960804018 shutdown_connections 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562b535c31c0 0x562b53a5e500 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562b5362f1b0 0x562b53a5a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd79aff5640 0 client.17688 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562b5360e4d0 0x562b539f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 --2- 172.21.15.49:0/2960804018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562b536062f0 0x562b539f2510 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2960804018 >> 172.21.15.49:0/2960804018 conn(0x562b53623300 msgr2=0x562b539d6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2960804018 shutdown_connections 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.032+0000 7fd7c45f9740 1 -- 172.21.15.49:0/2960804018 wait complete. 2024-09-21T06:45:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7c45f9740 20 client.17688 trim_cache size 0 max 16384 2024-09-21T06:45:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:45:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:45:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:45:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:45:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 -- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7a00b6700 msgr2=0x7fd7a00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.036 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7a00b6700 0x7fd7a00b8c10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd7b002f500 tx=0x7fd7b002f310 comp rx=0 tx=0).stop 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 -- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109450 msgr2=0x7fd7b819aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109450 0x7fd7b819aa40 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac00e9c0 tx=0x7fd7ac00ee80 comp rx=0 tx=0).stop 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 -- 172.21.15.49:0/626441488 shutdown_connections 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd7a00b6700 0x7fd7a00b8c10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd7b8109da0 0x7fd7b819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd7b8109450 0x7fd7b819aa40 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 --2- 172.21.15.49:0/626441488 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd7b8103b20 0x7fd7b819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 -- 172.21.15.49:0/626441488 >> 172.21.15.49:0/626441488 conn(0x7fd7b80ff560 msgr2=0x7fd7b8108aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 -- 172.21.15.49:0/626441488 shutdown_connections 2024-09-21T06:45:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:43.033+0000 7fd7bd68b640 1 -- 172.21.15.49:0/626441488 wait complete. 2024-09-21T06:45:43.285 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.781+0000 7f9db672e640 1 -- 172.21.15.49:0/1704693485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 msgr2=0x7f9db0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.781+0000 7f9db672e640 1 --2- 172.21.15.49:0/1704693485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 0x7f9db0102ef0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009900 tx=0x7f9da002a410 comp rx=0 tx=0).stop 2024-09-21T06:45:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.781+0000 7f9db672e640 1 -- 172.21.15.49:0/1704693485 shutdown_connections 2024-09-21T06:45:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.781+0000 7f9db672e640 1 --2- 172.21.15.49:0/1704693485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9db0108d20 0x7f9db010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.781+0000 7f9db672e640 1 --2- 172.21.15.49:0/1704693485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9db01083d0 0x7f9db01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.781+0000 7f9db672e640 1 --2- 172.21.15.49:0/1704693485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 0x7f9db0102ef0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.781+0000 7f9db672e640 1 -- 172.21.15.49:0/1704693485 >> 172.21.15.49:0/1704693485 conn(0x7f9db0079760 msgr2=0x7f9db0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.781+0000 7f9db672e640 1 -- 172.21.15.49:0/1704693485 shutdown_connections 2024-09-21T06:45:43.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.781+0000 7f9db672e640 1 -- 172.21.15.49:0/1704693485 wait complete. 2024-09-21T06:45:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9db672e640 1 Processor -- start 2024-09-21T06:45:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9db672e640 1 -- start start 2024-09-21T06:45:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9db672e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 0x7f9db019b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9db672e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9db01083d0 0x7f9db019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9db672e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9db0108d20 0x7f9db019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9db672e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0112990 con 0x7f9db0102ae0 2024-09-21T06:45:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9db672e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0112810 con 0x7f9db0108d20 2024-09-21T06:45:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9db672e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9db0112b10 con 0x7f9db01083d0 2024-09-21T06:45:43.785 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9daffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 0x7f9db019b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9daffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 0x7f9db019b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49738/0 (socket says 172.21.15.49:49738) 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.782+0000 7f9daffff640 1 -- 172.21.15.49:0/379570194 learned_addr learned my addr 172.21.15.49:0/379570194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9db0108d20 0x7f9db019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9da7fff640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9db01083d0 0x7f9db019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9daffff640 1 -- 172.21.15.49:0/379570194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9db01083d0 msgr2=0x7f9db019b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9daffff640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9db01083d0 0x7f9db019b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9daffff640 1 -- 172.21.15.49:0/379570194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9db0108d20 msgr2=0x7f9db019bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9daffff640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9db0108d20 0x7f9db019bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9daffff640 1 -- 172.21.15.49:0/379570194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db01a65a0 con 0x7f9db0102ae0 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9db0108d20 0x7f9db019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9daffff640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 0x7f9db019b2e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9da0005940 tx=0x7f9da00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9dadffb640 1 -- 172.21.15.49:0/379570194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da003f030 con 0x7f9db0102ae0 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9db672e640 1 -- 172.21.15.49:0/379570194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db01a6830 con 0x7f9db0102ae0 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9dadffb640 1 -- 172.21.15.49:0/379570194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da0003cb0 con 0x7f9db0102ae0 2024-09-21T06:45:43.786 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9dadffb640 1 -- 172.21.15.49:0/379570194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0035070 con 0x7f9db0102ae0 2024-09-21T06:45:43.787 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.783+0000 7f9db672e640 1 -- 172.21.15.49:0/379570194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db01a6d10 con 0x7f9db0102ae0 2024-09-21T06:45:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.786+0000 7f9dbcca2740 1 Processor -- start 2024-09-21T06:45:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.786+0000 7f9dbcca2740 1 -- start start 2024-09-21T06:45:43.789 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.786+0000 7f9dadffb640 1 -- 172.21.15.49:0/379570194 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9da0042030 con 0x7f9db0102ae0 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad29270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad29cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55962ac9fe50 con 0x55962a982070 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55962ac8f280 con 0x55962a9591b0 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55962ac93090 con 0x55962a961390 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9db4ccb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad29270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9db4ccb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad29270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49752/0 (socket says 172.21.15.49:49752) 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3983087246 learned_addr learned my addr 172.21.15.49:0/3983087246 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:43.790 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9da7fff640 1 --2- 172.21.15.49:0/3983087246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad29cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9daffff640 1 --2- 172.21.15.49:0/3983087246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3983087246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 msgr2=0x55962ad29cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3983087246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad29cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3983087246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 msgr2=0x55962ad297b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3983087246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad297b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3983087246 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55962a9ed650 con 0x55962a982070 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.787+0000 7f9dadffb640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d9c0b6680 0x7f9d9c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.788+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3983087246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad29270 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009f30 tx=0x7f9da8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cf168f8e6aaf5a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.788+0000 7f9daffff640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d9c0b6680 0x7f9d9c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.788+0000 7f9dadffb640 1 -- 172.21.15.49:0/379570194 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f9da01080d0 con 0x7f9db0102ae0 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.788+0000 7f9da67fc640 1 -- 172.21.15.49:0/3983087246 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8016070 con 0x55962a982070 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.788+0000 7f9da67fc640 1 -- 172.21.15.49:0/3983087246 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da801bb10 con 0x55962a982070 2024-09-21T06:45:43.791 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.788+0000 7f9da67fc640 1 -- 172.21.15.49:0/3983087246 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8012c10 con 0x55962a982070 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3983087246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 msgr2=0x55962ad29270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3983087246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad29270 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009f30 tx=0x7f9da8010800 comp rx=0 tx=0).stop 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9daffff640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d9c0b6680 0x7f9d9c0b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9da0105880 tx=0x7f9da00045a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3983087246 shutdown_connections 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3983087246 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad29cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3983087246 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3983087246 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad29270 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3983087246 >> 172.21.15.49:0/3983087246 conn(0x55962a976460 msgr2=0x55962ad27160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3983087246 shutdown_connections 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3983087246 wait complete. 2024-09-21T06:45:43.796 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.789+0000 7f9dbcca2740 1 -- start start 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9dbcca2740 1 Processor -- start 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad348e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad34e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad40d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55962aaf0700 con 0x55962a982070 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55962ac2a110 con 0x55962a9591b0 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55962ad37a50 con 0x55962a961390 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9dbcca2740 10 client.0 _ll_register_callbacks cb 0x55962ac43990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9db4ccb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad40d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9db4ccb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad40d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49768/0 (socket says 172.21.15.49:49768) 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9db4ccb640 1 -- 172.21.15.49:0/1765953726 learned_addr learned my addr 172.21.15.49:0/1765953726 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.790+0000 7f9da7fff640 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad34e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.797 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9db4ccb640 1 -- 172.21.15.49:0/1765953726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 msgr2=0x55962ad34e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad34e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9db4ccb640 1 -- 172.21.15.49:0/1765953726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 msgr2=0x55962ad348e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad348e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9db4ccb640 1 -- 172.21.15.49:0/1765953726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55962ac57c40 con 0x55962a982070 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad40d40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f9da801cf80 tx=0x7f9da80127f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757c12c173783130 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9d8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/1765953726 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8016030 con 0x55962a982070 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/1765953726 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f9da8004c50 con 0x55962a982070 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9dbcca2740 1 -- 172.21.15.49:0/1765953726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da801bb10 con 0x55962a982070 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/1765953726 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9da8012990 con 0x55962a982070 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9dbcca2740 10 client.17700 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9dbcca2740 1 -- 172.21.15.49:0/1765953726 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55962ad43720 con 0x55962a982070 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.791+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/1765953726 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da801bb10 con 0x55962a982070 2024-09-21T06:45:43.798 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.792+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/1765953726 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9da800f040 con 0x55962a982070 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.792+0000 7f9dbcca2740 10 client.17700 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.792+0000 7f9dbcca2740 10 client.17700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.792+0000 7f9dbcca2740 20 client.17700 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.792+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55962a9409f0 0x55962ad46a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.792+0000 7f9dbcca2740 4 client.17700 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.792+0000 7f9dbcca2740 1 -- 172.21.15.49:0/1765953726 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55962aca1da0 con 0x55962a9409f0 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.792+0000 7f9da7fff640 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55962a9409f0 0x55962ad46a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.793+0000 7f9da7fff640 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55962a9409f0 0x55962ad46a80 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df0b5bc7c9435517 server_cookie=997f25fe6f34a00f in_seq=0 out_seq=0 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.793+0000 7f9d8f7fe640 10 client.17700 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.793+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/1765953726 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55962aca1da0 con 0x55962a9409f0 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.793+0000 7f9d8f7fe640 10 client.17700 handle_command_reply: tid=0 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.793+0000 7f9dbcca2740 1 client.17700 shutdown 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 -- 172.21.15.49:0/1765953726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 msgr2=0x55962ad40d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.799 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad40d40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f9da801cf80 tx=0x7f9da80127f0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 -- 172.21.15.49:0/1765953726 shutdown_connections 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55962a9409f0 0x55962ad46a80 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a982070 0x55962ad40d40 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9d8f7fe640 0 client.17700 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad34e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/1765953726 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad348e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 -- 172.21.15.49:0/1765953726 >> 172.21.15.49:0/1765953726 conn(0x55962a976460 msgr2=0x55962ad2c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 -- 172.21.15.49:0/1765953726 shutdown_connections 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 1 -- 172.21.15.49:0/1765953726 wait complete. 2024-09-21T06:45:43.800 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.794+0000 7f9dbcca2740 20 client.17700 trim_cache size 0 max 16384 2024-09-21T06:45:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.811+0000 7f9dbcca2740 1 Processor -- start 2024-09-21T06:45:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.811+0000 7f9dbcca2740 1 -- start start 2024-09-21T06:45:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9409f0 0x55962ad2a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a9591b0 0x55962ad40c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a961390 0x55962ad31ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01b21b0 con 0x55962a961390 2024-09-21T06:45:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01afa80 con 0x55962a9409f0 2024-09-21T06:45:43.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01ad8f0 con 0x55962a9591b0 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9db4ccb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a961390 0x55962ad31ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9db4ccb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a961390 0x55962ad31ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49782/0 (socket says 172.21.15.49:49782) 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3397571455 learned_addr learned my addr 172.21.15.49:0/3397571455 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3397571455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9409f0 0x55962ad2a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9da7fff640 1 --2- 172.21.15.49:0/3397571455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a9591b0 0x55962ad40c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3397571455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a9591b0 msgr2=0x55962ad40c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3397571455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a9591b0 0x55962ad40c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3397571455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9409f0 msgr2=0x55962ad2a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3397571455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9409f0 0x55962ad2a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.812+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3397571455 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55962ad21410 con 0x55962a961390 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3397571455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a961390 0x55962ad31ad0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005fd0 tx=0x7f9da8010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ccdd58447da09d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9da5ffb640 1 -- 172.21.15.49:0/3397571455 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8016040 con 0x55962a961390 2024-09-21T06:45:43.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9da5ffb640 1 -- 172.21.15.49:0/3397571455 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da8012450 con 0x55962a961390 2024-09-21T06:45:43.816 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9da5ffb640 1 -- 172.21.15.49:0/3397571455 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da801b7a0 con 0x55962a961390 2024-09-21T06:45:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3397571455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a961390 msgr2=0x55962ad31ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3397571455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a961390 0x55962ad31ad0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005fd0 tx=0x7f9da8010800 comp rx=0 tx=0).stop 2024-09-21T06:45:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3397571455 shutdown_connections 2024-09-21T06:45:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3397571455 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a961390 0x55962ad31ad0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3397571455 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a9591b0 0x55962ad40c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3397571455 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9409f0 0x55962ad2a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.813+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3397571455 >> 172.21.15.49:0/3397571455 conn(0x55962a976460 msgr2=0x55962ad2a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.814+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3397571455 shutdown_connections 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.814+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3397571455 wait complete. 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.814+0000 7f9dbcca2740 1 -- start start 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.814+0000 7f9dbcca2740 1 Processor -- start 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.814+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a9409f0 0x55962ad38e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.814+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad39390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9dbcca2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad398d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01adf40 con 0x55962a9409f0 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01af3b0 con 0x55962a9591b0 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9dbcca2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9db01ae610 con 0x55962a961390 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9dbcca2740 10 client.0 _ll_register_callbacks cb 0x7f9da8009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a9409f0 0x55962ad38e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.820 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a9409f0 0x55962ad38e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49798/0 (socket says 172.21.15.49:49798) 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3488081018 learned_addr learned my addr 172.21.15.49:0/3488081018 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9da7fff640 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad39390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3488081018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 msgr2=0x55962ad398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad398d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3488081018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 msgr2=0x55962ad39390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad39390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 -- 172.21.15.49:0/3488081018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55962adb0450 con 0x55962a9409f0 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9db4ccb640 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a9409f0 0x55962ad38e50 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x55962ad3dbf0 tx=0x7f9da8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccc3f3e3768574b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9d8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/3488081018 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da8016030 con 0x55962a9409f0 2024-09-21T06:45:43.821 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/3488081018 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f9da8029dd0 con 0x55962a9409f0 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.815+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3488081018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da8012450 con 0x55962a9409f0 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/3488081018 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9da8012b30 con 0x55962a9409f0 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9dbcca2740 10 client.17706 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3488081018 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55962adb16c0 con 0x55962a9409f0 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/3488081018 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da8012450 con 0x55962a9409f0 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/3488081018 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9da80334b0 con 0x55962a9409f0 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9dbcca2740 10 client.17706 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9dbcca2740 10 client.17706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9dbcca2740 20 client.17706 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:43.822 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55962a982070 0x55962adb3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9dbcca2740 4 client.17706 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3488081018 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55962ac9d850 con 0x55962a982070 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.816+0000 7f9da7fff640 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55962a982070 0x55962adb3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9d8f7fe640 10 client.17706 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9da7fff640 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55962a982070 0x55962adb3c70 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f75d3f8e38a2016 server_cookie=29ba2f42d6015ed2 in_seq=0 out_seq=0 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9d8f7fe640 1 -- 172.21.15.49:0/3488081018 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x55962ac9d850 con 0x55962a982070 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9d8f7fe640 10 client.17706 handle_command_reply: tid=0 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9dbcca2740 1 client.17706 shutdown 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3488081018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a9409f0 msgr2=0x55962ad38e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a9409f0 0x55962ad38e50 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x55962ad3dbf0 tx=0x7f9da8005bd0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3488081018 shutdown_connections 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55962a982070 0x55962adb3c70 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55962a961390 0x55962ad398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55962a9591b0 0x55962ad39390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9dbcca2740 1 --2- 172.21.15.49:0/3488081018 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55962a9409f0 0x55962ad38e50 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3488081018 >> 172.21.15.49:0/3488081018 conn(0x55962a976460 msgr2=0x55962ad34e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.817+0000 7f9d8f7fe640 0 client.17706 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:43.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3488081018 shutdown_connections 2024-09-21T06:45:43.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9dbcca2740 1 -- 172.21.15.49:0/3488081018 wait complete. 2024-09-21T06:45:43.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9dbcca2740 20 client.17706 trim_cache size 0 max 16384 2024-09-21T06:45:43.824 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:45:43.824 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.826 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.827 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.828 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:45:43.829 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "877238a7-c1a9-416c-8f9e-d40ecea3c71a": { 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:10.755554+0000", 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.831 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:43.833 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:45:43.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 -- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d9c0b6680 msgr2=0x7f9d9c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d9c0b6680 0x7f9d9c0b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9da0105880 tx=0x7f9da00045a0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 -- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 msgr2=0x7f9db019b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:43.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 0x7f9db019b2e0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f9da0005940 tx=0x7f9da00042f0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 -- 172.21.15.49:0/379570194 shutdown_connections 2024-09-21T06:45:43.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d9c0b6680 0x7f9d9c0b8b90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9db0108d20 0x7f9db019bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9db01083d0 0x7f9db019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 --2- 172.21.15.49:0/379570194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9db0102ae0 0x7f9db019b2e0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:43.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 -- 172.21.15.49:0/379570194 >> 172.21.15.49:0/379570194 conn(0x7f9db0079760 msgr2=0x7f9db01015e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:43.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 -- 172.21.15.49:0/379570194 shutdown_connections 2024-09-21T06:45:43.835 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:43.818+0000 7f9db672e640 1 -- 172.21.15.49:0/379570194 wait complete. 2024-09-21T06:45:43.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:43 smithi049 ceph-mon[31177]: pgmap v597: 97 pgs: 97 active+clean; 9.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:45:44.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:43 smithi098 ceph-mon[34704]: pgmap v597: 97 pgs: 97 active+clean; 9.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:45:44.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:43 smithi079 ceph-mon[34346]: pgmap v597: 97 pgs: 97 active+clean; 9.4 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:45:44.598 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:45:44.598 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:45:44.900 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 -- 172.21.15.49:0/1803897177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0103b60 msgr2=0x7f90e0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 --2- 172.21.15.49:0/1803897177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0103b60 0x7f90e0103f70 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009900 tx=0x7f90d002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 -- 172.21.15.49:0/1803897177 shutdown_connections 2024-09-21T06:45:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 --2- 172.21.15.49:0/1803897177 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90e0109df0 0x7f90e0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 --2- 172.21.15.49:0/1803897177 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90e01094a0 0x7f90e01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 --2- 172.21.15.49:0/1803897177 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0103b60 0x7f90e0103f70 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.396 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 -- 172.21.15.49:0/1803897177 >> 172.21.15.49:0/1803897177 conn(0x7f90e007b850 msgr2=0x7f90e007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 -- 172.21.15.49:0/1803897177 shutdown_connections 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 -- 172.21.15.49:0/1803897177 wait complete. 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 Processor -- start 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.388+0000 7f90e6908640 1 -- start start 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e6908640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90e0103b60 0x7f90e019c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e6908640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90e01094a0 0x7f90e019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e6908640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0109df0 0x7f90e01a1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e6908640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0113ab0 con 0x7f90e0109df0 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e6908640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0113930 con 0x7f90e0103b60 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e6908640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f90e0113c30 con 0x7f90e01094a0 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e4ea5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0109df0 0x7f90e01a1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e4ea5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0109df0 0x7f90e01a1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:49804/0 (socket says 172.21.15.49:49804) 2024-09-21T06:45:45.397 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e4ea5640 1 -- 172.21.15.49:0/2362584099 learned_addr learned my addr 172.21.15.49:0/2362584099 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90dffff640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90e0103b60 0x7f90e019c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90df7fe640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90e01094a0 0x7f90e019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e4ea5640 1 -- 172.21.15.49:0/2362584099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90e01094a0 msgr2=0x7f90e019cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e4ea5640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90e01094a0 0x7f90e019cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e4ea5640 1 -- 172.21.15.49:0/2362584099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90e0103b60 msgr2=0x7f90e019c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e4ea5640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90e0103b60 0x7f90e019c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.389+0000 7f90e4ea5640 1 -- 172.21.15.49:0/2362584099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e01a2550 con 0x7f90e0109df0 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.390+0000 7f90e4ea5640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0109df0 0x7f90e01a1ee0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f90d800cce0 tx=0x7f90d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.390+0000 7f90dd7fa640 1 -- 172.21.15.49:0/2362584099 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d800f450 con 0x7f90e0109df0 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.390+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e01a2840 con 0x7f90e0109df0 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.390+0000 7f90dd7fa640 1 -- 172.21.15.49:0/2362584099 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90d800faa0 con 0x7f90e0109df0 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.390+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e01a9060 con 0x7f90e0109df0 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.390+0000 7f90dd7fa640 1 -- 172.21.15.49:0/2362584099 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8018b70 con 0x7f90e0109df0 2024-09-21T06:45:45.398 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.391+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e0103f70 con 0x7f90e0109df0 2024-09-21T06:45:45.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.392+0000 7f90dd7fa640 1 -- 172.21.15.49:0/2362584099 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f90d8018d10 con 0x7f90e0109df0 2024-09-21T06:45:45.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.393+0000 7f90dd7fa640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f90c80b66b0 0x7f90c80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.393+0000 7f90dffff640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f90c80b66b0 0x7f90c80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.393+0000 7f90dd7fa640 1 -- 172.21.15.49:0/2362584099 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f90d80e7bd0 con 0x7f90e0109df0 2024-09-21T06:45:45.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.394+0000 7f90dffff640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f90c80b66b0 0x7f90c80b8bc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f90d0031440 tx=0x7f90d0005e80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.399 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.397+0000 7f90dd7fa640 1 -- 172.21.15.49:0/2362584099 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90d8014030 con 0x7f90e0109df0 2024-09-21T06:45:45.628 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.626+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90e019d7d0 con 0x7f90e0109df0 2024-09-21T06:45:45.629 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.627+0000 7f90dd7fa640 1 -- 172.21.15.49:0/2362584099 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f90e019d7d0 con 0x7f90e0109df0 2024-09-21T06:45:45.629 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:45:45.629 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:45:45.630 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:45:45.631 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f90c80b66b0 msgr2=0x7f90c80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f90c80b66b0 0x7f90c80b8bc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f90d0031440 tx=0x7f90d0005e80 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0109df0 msgr2=0x7f90e01a1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0109df0 0x7f90e01a1ee0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f90d800cce0 tx=0x7f90d800a620 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 shutdown_connections 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f90c80b66b0 0x7f90c80b8bc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f90e0109df0 0x7f90e01a1ee0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f90e01094a0 0x7f90e019cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 --2- 172.21.15.49:0/2362584099 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f90e0103b60 0x7f90e019c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 >> 172.21.15.49:0/2362584099 conn(0x7f90e007b850 msgr2=0x7f90e0107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 shutdown_connections 2024-09-21T06:45:45.632 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:45.630+0000 7f90e6908640 1 -- 172.21.15.49:0/2362584099 wait complete. 2024-09-21T06:45:45.950 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:45 smithi049 ceph-mon[31177]: pgmap v598: 97 pgs: 97 active+clean; 9.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-21T06:45:45.950 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:45 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2362584099' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:46.278 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:45:46.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:45 smithi098 ceph-mon[34704]: pgmap v598: 97 pgs: 97 active+clean; 9.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-21T06:45:46.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:45 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2362584099' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:46.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:45 smithi079 ceph-mon[34346]: pgmap v598: 97 pgs: 97 active+clean; 9.5 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-21T06:45:46.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:45 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2362584099' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:46.536 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.021+0000 7faacc15d640 1 -- 172.21.15.49:0/2514806107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac410de50 msgr2=0x7faac41102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.021+0000 7faacc15d640 1 --2- 172.21.15.49:0/2514806107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac410de50 0x7faac41102f0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7faabc009ca0 tx=0x7faabc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.021+0000 7faacc15d640 1 -- 172.21.15.49:0/2514806107 shutdown_connections 2024-09-21T06:45:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.021+0000 7faacc15d640 1 --2- 172.21.15.49:0/2514806107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac410de50 0x7faac41102f0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.021+0000 7faacc15d640 1 --2- 172.21.15.49:0/2514806107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac41052d0 0x7faac410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.021+0000 7faacc15d640 1 --2- 172.21.15.49:0/2514806107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac41048a0 0x7faac4104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.021+0000 7faacc15d640 1 -- 172.21.15.49:0/2514806107 >> 172.21.15.49:0/2514806107 conn(0x7faac4079730 msgr2=0x7faac4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.021+0000 7faacc15d640 1 -- 172.21.15.49:0/2514806107 shutdown_connections 2024-09-21T06:45:47.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.021+0000 7faacc15d640 1 -- 172.21.15.49:0/2514806107 wait complete. 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faacc15d640 1 Processor -- start 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faacc15d640 1 -- start start 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faacc15d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac41048a0 0x7faac419a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faacc15d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac41052d0 0x7faac419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faacc15d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac410de50 0x7faac419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faacc15d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faac4113ae0 con 0x7faac41048a0 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faacc15d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faac4113960 con 0x7faac41052d0 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faacc15d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faac4113c60 con 0x7faac410de50 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faac9ef9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac41048a0 0x7faac419a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faac9ef9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac41048a0 0x7faac419a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46252/0 (socket says 172.21.15.49:46252) 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.022+0000 7faac9ef9640 1 -- 172.21.15.49:0/2489572855 learned_addr learned my addr 172.21.15.49:0/2489572855 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faaca6fa640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac410de50 0x7faac419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faac96f8640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac41052d0 0x7faac419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faac9ef9640 1 -- 172.21.15.49:0/2489572855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac410de50 msgr2=0x7faac419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faac9ef9640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac410de50 0x7faac419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faac9ef9640 1 -- 172.21.15.49:0/2489572855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac41052d0 msgr2=0x7faac419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faac9ef9640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac41052d0 0x7faac419aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faac9ef9640 1 -- 172.21.15.49:0/2489572855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac41a0440 con 0x7faac41048a0 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faaca6fa640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac410de50 0x7faac419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faac9ef9640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac41048a0 0x7faac419a4d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7faac000d950 tx=0x7faac000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faabaffd640 1 -- 172.21.15.49:0/2489572855 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0017070 con 0x7faac41048a0 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faacc15d640 1 -- 172.21.15.49:0/2489572855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac41a0730 con 0x7faac41048a0 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faabaffd640 1 -- 172.21.15.49:0/2489572855 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faac0009c30 con 0x7faac41048a0 2024-09-21T06:45:47.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faabaffd640 1 -- 172.21.15.49:0/2489572855 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac000f620 con 0x7faac41048a0 2024-09-21T06:45:47.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.023+0000 7faacc15d640 1 -- 172.21.15.49:0/2489572855 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac41a6e90 con 0x7faac41048a0 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faad26d1740 1 Processor -- start 2024-09-21T06:45:47.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faad26d1740 1 -- start start 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faabaffd640 1 -- 172.21.15.49:0/2489572855 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7faac001a070 con 0x7faac41048a0 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faad26d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d7f070 0x558975126290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faad26d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x5589751267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faad26d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x558975126d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faad26d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55897509cea0 con 0x558974d561b0 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faad26d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55897508c2d0 con 0x558974d5e390 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faad26d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5589750900e0 con 0x558974d7f070 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faac9ef9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x5589751267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faac9ef9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x5589751267d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46258/0 (socket says 172.21.15.49:46258) 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.026+0000 7faac9ef9640 1 -- 172.21.15.49:0/868534171 learned_addr learned my addr 172.21.15.49:0/868534171 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faaca6fa640 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d7f070 0x558975126290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faac96f8640 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x558975126d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faac9ef9640 1 -- 172.21.15.49:0/868534171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d7f070 msgr2=0x558975126290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faac9ef9640 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d7f070 0x558975126290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faac9ef9640 1 -- 172.21.15.49:0/868534171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 msgr2=0x558975126d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faac9ef9640 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x558975126d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faac9ef9640 1 -- 172.21.15.49:0/868534171 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558974dea650 con 0x558974d561b0 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faac96f8640 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x558975126d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faac9ef9640 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x5589751267d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7faac00e4910 tx=0x7faac00efa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ef86814711812a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faabaffd640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faab00b6680 0x7faab00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faaca6fa640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faab00b6680 0x7faab00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faaaffff640 1 -- 172.21.15.49:0/868534171 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac00fb070 con 0x558974d561b0 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faabaffd640 1 -- 172.21.15.49:0/2489572855 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7faac00e72a0 con 0x7faac41048a0 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faaaffff640 1 -- 172.21.15.49:0/868534171 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faac00acbb0 con 0x558974d561b0 2024-09-21T06:45:47.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.027+0000 7faaaffff640 1 -- 172.21.15.49:0/868534171 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac00ace70 con 0x558974d561b0 2024-09-21T06:45:47.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.028+0000 7faad26d1740 1 -- 172.21.15.49:0/868534171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 msgr2=0x5589751267d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.028+0000 7faaca6fa640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faab00b6680 0x7faab00b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faabc004af0 tx=0x7faabc005d80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.028+0000 7faad26d1740 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x5589751267d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7faac00e4910 tx=0x7faac00efa10 comp rx=0 tx=0).stop 2024-09-21T06:45:47.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.028+0000 7faad26d1740 1 -- 172.21.15.49:0/868534171 shutdown_connections 2024-09-21T06:45:47.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.029+0000 7faad26d1740 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x558975126d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.035 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.029+0000 7faad26d1740 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x5589751267d0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.029+0000 7faad26d1740 1 --2- 172.21.15.49:0/868534171 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d7f070 0x558975126290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.029+0000 7faad26d1740 1 -- 172.21.15.49:0/868534171 >> 172.21.15.49:0/868534171 conn(0x558974d73460 msgr2=0x558975124180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.029+0000 7faad26d1740 1 -- 172.21.15.49:0/868534171 shutdown_connections 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.029+0000 7faad26d1740 1 -- 172.21.15.49:0/868534171 wait complete. 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.029+0000 7faad26d1740 1 -- start start 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.029+0000 7faad26d1740 1 Processor -- start 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faad26d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975131950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faad26d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d5e390 0x558975131e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faad26d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d7f070 0x55897513dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faad26d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x558974eed700 con 0x558974d561b0 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faad26d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x558975027160 con 0x558974d7f070 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faad26d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x558975134a70 con 0x558974d5e390 2024-09-21T06:45:47.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faad26d1740 10 client.0 _ll_register_callbacks cb 0x5589750409e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac9ef9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975131950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac9ef9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975131950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46270/0 (socket says 172.21.15.49:46270) 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac9ef9640 1 -- 172.21.15.49:0/773621896 learned_addr learned my addr 172.21.15.49:0/773621896 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac96f8640 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d5e390 0x558975131e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faaca6fa640 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d7f070 0x55897513dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac9ef9640 1 -- 172.21.15.49:0/773621896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d5e390 msgr2=0x558975131e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac9ef9640 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d5e390 0x558975131e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac9ef9640 1 -- 172.21.15.49:0/773621896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d7f070 msgr2=0x55897513dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac9ef9640 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d7f070 0x55897513dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac9ef9640 1 -- 172.21.15.49:0/773621896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558975054c90 con 0x558974d561b0 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faaca6fa640 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d7f070 0x55897513dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faac9ef9640 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975131950 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7faac00f9040 tx=0x7faac000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789993d0f30a715d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faaad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.030+0000 7faaad7fa640 1 -- 172.21.15.49:0/773621896 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac0021070 con 0x558974d561b0 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faaad7fa640 1 -- 172.21.15.49:0/773621896 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7faac00e4c20 con 0x558974d561b0 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faad26d1740 1 -- 172.21.15.49:0/773621896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faac00acbb0 con 0x558974d561b0 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faaad7fa640 1 -- 172.21.15.49:0/773621896 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faac00ac810 con 0x558974d561b0 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faad26d1740 10 client.17724 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faad26d1740 1 -- 172.21.15.49:0/773621896 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x558975140780 con 0x558974d561b0 2024-09-21T06:45:47.038 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faaad7fa640 1 -- 172.21.15.49:0/773621896 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faac00acbb0 con 0x558974d561b0 2024-09-21T06:45:47.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faaad7fa640 1 -- 172.21.15.49:0/773621896 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7faac00b6630 con 0x558974d561b0 2024-09-21T06:45:47.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faad26d1740 10 client.17724 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:47.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faad26d1740 10 client.17724 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:45:47.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faad26d1740 20 client.17724 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:47.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faad26d1740 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x558974d3d9f0 0x558975143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faad26d1740 4 client.17724 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:47.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.031+0000 7faad26d1740 1 -- 172.21.15.49:0/773621896 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55897509edf0 con 0x558974d3d9f0 2024-09-21T06:45:47.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.032+0000 7faac96f8640 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x558974d3d9f0 0x558975143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.039 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.032+0000 7faaad7fa640 10 client.17724 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.032+0000 7faac96f8640 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x558974d3d9f0 0x558975143ae0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3178d29d20e1109 server_cookie=2581bfc33ca2e123 in_seq=0 out_seq=0 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faaad7fa640 1 -- 172.21.15.49:0/773621896 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55897509edf0 con 0x558974d3d9f0 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faaad7fa640 10 client.17724 handle_command_reply: tid=0 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 client.17724 shutdown 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 -- 172.21.15.49:0/773621896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 msgr2=0x558975131950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975131950 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7faac00f9040 tx=0x7faac000bf60 comp rx=0 tx=0).stop 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 -- 172.21.15.49:0/773621896 shutdown_connections 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x558974d3d9f0 0x558975143ae0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faaad7fa640 0 client.17724 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:45:47.040 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d7f070 0x55897513dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d5e390 0x558975131e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 --2- 172.21.15.49:0/773621896 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975131950 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 -- 172.21.15.49:0/773621896 >> 172.21.15.49:0/773621896 conn(0x558974d73460 msgr2=0x558975129420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 -- 172.21.15.49:0/773621896 shutdown_connections 2024-09-21T06:45:47.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 1 -- 172.21.15.49:0/773621896 wait complete. 2024-09-21T06:45:47.041 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.033+0000 7faad26d1740 20 client.17724 trim_cache size 0 max 16384 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.046+0000 7faad26d1740 1 Processor -- start 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.046+0000 7faad26d1740 1 -- start start 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faad26d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 0x558975129aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faad26d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x55897512eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faad26d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x55897512f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faad26d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faac41b22d0 con 0x558974d561b0 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faad26d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faac41afba0 con 0x558974d5e390 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faad26d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faac41ada10 con 0x558974d3d9f0 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac96f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x55897512eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.049 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac96f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x55897512eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46284/0 (socket says 172.21.15.49:46284) 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac96f8640 1 -- 172.21.15.49:0/2493965753 learned_addr learned my addr 172.21.15.49:0/2493965753 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac9ef9640 1 --2- 172.21.15.49:0/2493965753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 0x558975129aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac96f8640 1 -- 172.21.15.49:0/2493965753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 msgr2=0x558975129aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac96f8640 1 --2- 172.21.15.49:0/2493965753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 0x558975129aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac96f8640 1 -- 172.21.15.49:0/2493965753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 msgr2=0x55897512f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac96f8640 1 --2- 172.21.15.49:0/2493965753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x55897512f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac96f8640 1 -- 172.21.15.49:0/2493965753 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558975132c10 con 0x558974d561b0 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac9ef9640 1 --2- 172.21.15.49:0/2493965753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 0x558975129aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faac96f8640 1 --2- 172.21.15.49:0/2493965753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x55897512eb40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7faab4000c00 tx=0x7faab4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ea3603395a3054 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.047+0000 7faaaf7fe640 1 -- 172.21.15.49:0/2493965753 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab401f070 con 0x558974d561b0 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faaaf7fe640 1 -- 172.21.15.49:0/2493965753 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faab4014da0 con 0x558974d561b0 2024-09-21T06:45:47.050 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faaaf7fe640 1 -- 172.21.15.49:0/2493965753 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4022cf0 con 0x558974d561b0 2024-09-21T06:45:47.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faad26d1740 1 -- 172.21.15.49:0/2493965753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 msgr2=0x55897512eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faad26d1740 1 --2- 172.21.15.49:0/2493965753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x55897512eb40 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7faab4000c00 tx=0x7faab4008040 comp rx=0 tx=0).stop 2024-09-21T06:45:47.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faad26d1740 1 -- 172.21.15.49:0/2493965753 shutdown_connections 2024-09-21T06:45:47.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faad26d1740 1 --2- 172.21.15.49:0/2493965753 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x55897512f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faad26d1740 1 --2- 172.21.15.49:0/2493965753 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x55897512eb40 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faad26d1740 1 --2- 172.21.15.49:0/2493965753 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 0x558975129aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.054 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faad26d1740 1 -- 172.21.15.49:0/2493965753 >> 172.21.15.49:0/2493965753 conn(0x558974d73460 msgr2=0x558975129390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faad26d1740 1 -- 172.21.15.49:0/2493965753 shutdown_connections 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.048+0000 7faad26d1740 1 -- 172.21.15.49:0/2493965753 wait complete. 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faad26d1740 1 -- start start 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faad26d1740 1 Processor -- start 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faad26d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 0x558975144f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faad26d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975145490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faad26d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x5589751ad260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faad26d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7faac41ae060 con 0x558974d561b0 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faad26d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7faac41af4d0 con 0x558974d5e390 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faad26d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7faac41ae730 con 0x558974d3d9f0 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faad26d1740 10 client.0 _ll_register_callbacks cb 0x7faac00f9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faac96f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faac96f8640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975145490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46298/0 (socket says 172.21.15.49:46298) 2024-09-21T06:45:47.055 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.049+0000 7faac96f8640 1 -- 172.21.15.49:0/2206077980 learned_addr learned my addr 172.21.15.49:0/2206077980 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faaca6fa640 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x5589751ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faac9ef9640 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 0x558975144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faac96f8640 1 -- 172.21.15.49:0/2206077980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 msgr2=0x558975144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faac96f8640 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 0x558975144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faac96f8640 1 -- 172.21.15.49:0/2206077980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 msgr2=0x5589751ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faac96f8640 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x5589751ad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faac96f8640 1 -- 172.21.15.49:0/2206077980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589751ad7a0 con 0x558974d561b0 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faac96f8640 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975145490 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7faab4014ba0 tx=0x7faab4014bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1907eb0c49cfc16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faaad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faaad7fa640 1 -- 172.21.15.49:0/2206077980 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4028070 con 0x558974d561b0 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faaad7fa640 1 -- 172.21.15.49:0/2206077980 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7faab4022d80 con 0x558974d561b0 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faad26d1740 1 -- 172.21.15.49:0/2206077980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faab4014da0 con 0x558974d561b0 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.050+0000 7faaad7fa640 1 -- 172.21.15.49:0/2206077980 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7faab401f040 con 0x558974d561b0 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faad26d1740 10 client.17730 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:47.056 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faad26d1740 1 -- 172.21.15.49:0/2206077980 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5589751ae860 con 0x558974d561b0 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faaad7fa640 1 -- 172.21.15.49:0/2206077980 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faab4014da0 con 0x558974d561b0 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faaad7fa640 1 -- 172.21.15.49:0/2206077980 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7faab40244e0 con 0x558974d561b0 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faad26d1740 10 client.17730 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faad26d1740 10 client.17730 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faad26d1740 20 client.17730 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faad26d1740 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x558974d7f070 0x5589751b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faad26d1740 4 client.17730 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faad26d1740 1 -- 172.21.15.49:0/2206077980 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55897509a8a0 con 0x558974d7f070 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.051+0000 7faac9ef9640 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x558974d7f070 0x5589751b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faaad7fa640 10 client.17730 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faac9ef9640 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x558974d7f070 0x5589751b0f10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=333aa5e5d1d95e55 server_cookie=29465f1bf1037fbb in_seq=0 out_seq=0 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faaad7fa640 1 -- 172.21.15.49:0/2206077980 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55897509a8a0 con 0x558974d7f070 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faaad7fa640 10 client.17730 handle_command_reply: tid=0 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 client.17730 shutdown 2024-09-21T06:45:47.057 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 -- 172.21.15.49:0/2206077980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 msgr2=0x558975145490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975145490 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7faab4014ba0 tx=0x7faab4014bd0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 -- 172.21.15.49:0/2206077980 shutdown_connections 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x558974d7f070 0x5589751b0f10 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558974d5e390 0x5589751ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x558974d561b0 0x558975145490 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 --2- 172.21.15.49:0/2206077980 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x558974d3d9f0 0x558975144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faaad7fa640 0 client.17730 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 -- 172.21.15.49:0/2206077980 >> 172.21.15.49:0/2206077980 conn(0x558974d73460 msgr2=0x5589751272c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 -- 172.21.15.49:0/2206077980 shutdown_connections 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.052+0000 7faad26d1740 1 -- 172.21.15.49:0/2206077980 wait complete. 2024-09-21T06:45:47.058 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faad26d1740 20 client.17730 trim_cache size 0 max 16384 2024-09-21T06:45:47.059 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:45:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 -- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faab00b6680 msgr2=0x7faab00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faab00b6680 0x7faab00b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faabc004af0 tx=0x7faabc005d80 comp rx=0 tx=0).stop 2024-09-21T06:45:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 -- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac41048a0 msgr2=0x7faac419a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac41048a0 0x7faac419a4d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7faac000d950 tx=0x7faac000de10 comp rx=0 tx=0).stop 2024-09-21T06:45:47.059 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 -- 172.21.15.49:0/2489572855 shutdown_connections 2024-09-21T06:45:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7faab00b6680 0x7faab00b8b90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7faac410de50 0x7faac419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7faac41052d0 0x7faac419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 --2- 172.21.15.49:0/2489572855 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7faac41048a0 0x7faac419a4d0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 -- 172.21.15.49:0/2489572855 >> 172.21.15.49:0/2489572855 conn(0x7faac4079730 msgr2=0x7faac4106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 -- 172.21.15.49:0/2489572855 shutdown_connections 2024-09-21T06:45:47.060 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:47.053+0000 7faacc15d640 1 -- 172.21.15.49:0/2489572855 wait complete. 2024-09-21T06:45:47.697 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:45:47.955 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:47.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:47 smithi049 ceph-mon[31177]: pgmap v599: 97 pgs: 97 active+clean; 9.5 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:45:48.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:47 smithi098 ceph-mon[34704]: pgmap v599: 97 pgs: 97 active+clean; 9.5 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:45:48.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:47 smithi079 ceph-mon[34346]: pgmap v599: 97 pgs: 97 active+clean; 9.5 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:45:48.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.496+0000 7fd5999c2640 1 -- 172.21.15.49:0/443339681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd594102a60 msgr2=0x7fd594102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.496+0000 7fd5999c2640 1 --2- 172.21.15.49:0/443339681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd594102a60 0x7fd594102e70 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009900 tx=0x7fd58c02a410 comp rx=0 tx=0).stop 2024-09-21T06:45:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.496+0000 7fd5999c2640 1 -- 172.21.15.49:0/443339681 shutdown_connections 2024-09-21T06:45:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.496+0000 7fd5999c2640 1 --2- 172.21.15.49:0/443339681 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd594108cf0 0x7fd59410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.496+0000 7fd5999c2640 1 --2- 172.21.15.49:0/443339681 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd5941083a0 0x7fd5941087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.496+0000 7fd5999c2640 1 --2- 172.21.15.49:0/443339681 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd594102a60 0x7fd594102e70 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.496+0000 7fd5999c2640 1 -- 172.21.15.49:0/443339681 >> 172.21.15.49:0/443339681 conn(0x7fd594079730 msgr2=0x7fd594079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.496+0000 7fd5999c2640 1 -- 172.21.15.49:0/443339681 shutdown_connections 2024-09-21T06:45:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.496+0000 7fd5999c2640 1 -- 172.21.15.49:0/443339681 wait complete. 2024-09-21T06:45:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5999c2640 1 Processor -- start 2024-09-21T06:45:48.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5999c2640 1 -- start start 2024-09-21T06:45:48.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5999c2640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd594102a60 0x7fd59419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5999c2640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5941083a0 0x7fd59419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5999c2640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd594108cf0 0x7fd5941a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5999c2640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd594113a80 con 0x7fd5941083a0 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5999c2640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd594113900 con 0x7fd594108cf0 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5999c2640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd594113c00 con 0x7fd594102a60 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5927fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5941083a0 0x7fd59419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5927fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5941083a0 0x7fd59419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46320/0 (socket says 172.21.15.49:46320) 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.497+0000 7fd5927fc640 1 -- 172.21.15.49:0/3658024400 learned_addr learned my addr 172.21.15.49:0/3658024400 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd592ffd640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd594102a60 0x7fd59419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5937fe640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd594108cf0 0x7fd5941a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5927fc640 1 -- 172.21.15.49:0/3658024400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd594102a60 msgr2=0x7fd59419c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5927fc640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd594102a60 0x7fd59419c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.501 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5927fc640 1 -- 172.21.15.49:0/3658024400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd594108cf0 msgr2=0x7fd5941a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5927fc640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd594108cf0 0x7fd5941a1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5927fc640 1 -- 172.21.15.49:0/3658024400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5941a25e0 con 0x7fd5941083a0 2024-09-21T06:45:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd592ffd640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd594102a60 0x7fd59419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5927fc640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5941083a0 0x7fd59419cc10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c970 tx=0x7fd57c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5989c0640 1 -- 172.21.15.49:0/3658024400 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c007bb0 con 0x7fd5941083a0 2024-09-21T06:45:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5999c2640 1 -- 172.21.15.49:0/3658024400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5941a28d0 con 0x7fd5941083a0 2024-09-21T06:45:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5989c0640 1 -- 172.21.15.49:0/3658024400 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd57c007d50 con 0x7fd5941083a0 2024-09-21T06:45:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5989c0640 1 -- 172.21.15.49:0/3658024400 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c018730 con 0x7fd5941083a0 2024-09-21T06:45:48.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.498+0000 7fd5999c2640 1 -- 172.21.15.49:0/3658024400 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5941a9030 con 0x7fd5941083a0 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.501+0000 7fd5989c0640 1 -- 172.21.15.49:0/3658024400 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd57c00f990 con 0x7fd5941083a0 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.501+0000 7fd59ff36740 1 Processor -- start 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.501+0000 7fd59ff36740 1 -- start start 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.501+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7ee06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.501+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7ee0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.501+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 0x5643a7ee1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.501+0000 7fd59ff36740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5643a7e56ea0 con 0x5643a7b39070 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.501+0000 7fd59ff36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5643a7e462d0 con 0x5643a7b101b0 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.501+0000 7fd59ff36740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5643a7e4a0e0 con 0x5643a7b18390 2024-09-21T06:45:48.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7ee06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7ee06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46336/0 (socket says 172.21.15.49:46336) 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 -- 172.21.15.49:0/1479606413 learned_addr learned my addr 172.21.15.49:0/1479606413 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5927fc640 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 0x5643a7ee1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd592ffd640 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7ee0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5989c0640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd5800b6680 0x7fd5800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 -- 172.21.15.49:0/1479606413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 msgr2=0x5643a7ee1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 0x5643a7ee1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 -- 172.21.15.49:0/1479606413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 msgr2=0x5643a7ee0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7ee0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 -- 172.21.15.49:0/1479606413 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a7ba4650 con 0x5643a7b39070 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd592ffd640 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7ee0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5989c0640 1 -- 172.21.15.49:0/3658024400 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7fd57c0e7810 con 0x7fd5941083a0 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7ee06a0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd584010370 tx=0x7fd584010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8a9c1d8bf5e346 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.505 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd5937fe640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd5800b6680 0x7fd5800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.502+0000 7fd589ffb640 1 -- 172.21.15.49:0/1479606413 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584022070 con 0x5643a7b39070 2024-09-21T06:45:48.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd589ffb640 1 -- 172.21.15.49:0/1479606413 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd584012c10 con 0x5643a7b39070 2024-09-21T06:45:48.506 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd589ffb640 1 -- 172.21.15.49:0/1479606413 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584016070 con 0x5643a7b39070 2024-09-21T06:45:48.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd59ff36740 1 -- 172.21.15.49:0/1479606413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 msgr2=0x5643a7ee06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.508 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd5937fe640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd5800b6680 0x7fd5800b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd58401f000 tx=0x7fd584011c70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd59ff36740 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7ee06a0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd584010370 tx=0x7fd584010830 comp rx=0 tx=0).stop 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd59ff36740 1 -- 172.21.15.49:0/1479606413 shutdown_connections 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd59ff36740 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 0x5643a7ee1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd59ff36740 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7ee0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd59ff36740 1 --2- 172.21.15.49:0/1479606413 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7ee06a0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.503+0000 7fd59ff36740 1 -- 172.21.15.49:0/1479606413 >> 172.21.15.49:0/1479606413 conn(0x5643a7b2d460 msgr2=0x5643a7ede590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.504+0000 7fd59ff36740 1 -- 172.21.15.49:0/1479606413 shutdown_connections 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.504+0000 7fd59ff36740 1 -- 172.21.15.49:0/1479606413 wait complete. 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.504+0000 7fd59ff36740 1 -- start start 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.504+0000 7fd59ff36740 1 Processor -- start 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.504+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7eebdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eec300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b39070 0x5643a7eec880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.509 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd59ff36740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5643a7ca7700 con 0x5643a7b18390 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd59ff36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5643a7de1160 con 0x5643a7b101b0 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd59ff36740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5643a7eeee80 con 0x5643a7b39070 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd59ff36740 10 client.0 _ll_register_callbacks cb 0x5643a7dfa9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5927fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eec300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5927fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eec300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46346/0 (socket says 172.21.15.49:46346) 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5927fc640 1 -- 172.21.15.49:0/3470880120 learned_addr learned my addr 172.21.15.49:0/3470880120 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd592ffd640 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7eebdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5937fe640 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b39070 0x5643a7eec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5927fc640 1 -- 172.21.15.49:0/3470880120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b39070 msgr2=0x5643a7eec880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5927fc640 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b39070 0x5643a7eec880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5927fc640 1 -- 172.21.15.49:0/3470880120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 msgr2=0x5643a7eebdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5927fc640 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7eebdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5927fc640 1 -- 172.21.15.49:0/3470880120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a7e0ec90 con 0x5643a7b18390 2024-09-21T06:45:48.510 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd5927fc640 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eec300 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c940 tx=0x7fd57c0acc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee866df2bd22a666 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd572ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd572ffd640 1 -- 172.21.15.49:0/3470880120 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0ad3e0 con 0x5643a7b18390 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd572ffd640 1 -- 172.21.15.49:0/3470880120 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7fd57c0ac2e0 con 0x5643a7b18390 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.505+0000 7fd59ff36740 1 -- 172.21.15.49:0/3470880120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd584012c10 con 0x5643a7b18390 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd572ffd640 1 -- 172.21.15.49:0/3470880120 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd57c0acd80 con 0x5643a7b18390 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd59ff36740 10 client.17742 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd59ff36740 1 -- 172.21.15.49:0/3470880120 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5643a7efab20 con 0x5643a7b18390 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd572ffd640 1 -- 172.21.15.49:0/3470880120 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd584012c10 con 0x5643a7b18390 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd572ffd640 1 -- 172.21.15.49:0/3470880120 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd57c020030 con 0x5643a7b18390 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd59ff36740 10 client.17742 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd59ff36740 10 client.17742 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd59ff36740 20 client.17742 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd59ff36740 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5643a7af79f0 0x5643a7efded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd59ff36740 4 client.17742 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:48.511 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd59ff36740 1 -- 172.21.15.49:0/3470880120 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643a7e58df0 con 0x5643a7af79f0 2024-09-21T06:45:48.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.506+0000 7fd592ffd640 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5643a7af79f0 0x5643a7efded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.507+0000 7fd572ffd640 10 client.17742 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:45:48.512 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.507+0000 7fd592ffd640 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5643a7af79f0 0x5643a7efded0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1427afaca25e63b0 server_cookie=80c4a7ebdac85c33 in_seq=0 out_seq=0 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd572ffd640 1 -- 172.21.15.49:0/3470880120 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5643a7e58df0 con 0x5643a7af79f0 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd572ffd640 10 client.17742 handle_command_reply: tid=0 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 client.17742 shutdown 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 -- 172.21.15.49:0/3470880120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 msgr2=0x5643a7eec300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eec300 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c940 tx=0x7fd57c0acc40 comp rx=0 tx=0).stop 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 -- 172.21.15.49:0/3470880120 shutdown_connections 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5643a7af79f0 0x5643a7efded0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b39070 0x5643a7eec880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eec300 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 --2- 172.21.15.49:0/3470880120 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7eebdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd572ffd640 0 client.17742 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 -- 172.21.15.49:0/3470880120 >> 172.21.15.49:0/3470880120 conn(0x5643a7b2d460 msgr2=0x5643a7ee3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.513 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 -- 172.21.15.49:0/3470880120 shutdown_connections 2024-09-21T06:45:48.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 1 -- 172.21.15.49:0/3470880120 wait complete. 2024-09-21T06:45:48.514 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.508+0000 7fd59ff36740 20 client.17742 trim_cache size 0 max 16384 2024-09-21T06:45:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.521+0000 7fd59ff36740 1 Processor -- start 2024-09-21T06:45:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.521+0000 7fd59ff36740 1 -- start start 2024-09-21T06:45:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b101b0 0x5643a7ee21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eeb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b39070 0x5643a7eedca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd59ff36740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd5941b4270 con 0x5643a7b18390 2024-09-21T06:45:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd59ff36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd5941b1b40 con 0x5643a7b39070 2024-09-21T06:45:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd59ff36740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd5941af9b0 con 0x5643a7b101b0 2024-09-21T06:45:48.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5927fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eeb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5927fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eeb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46360/0 (socket says 172.21.15.49:46360) 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5927fc640 1 -- 172.21.15.49:0/2803908692 learned_addr learned my addr 172.21.15.49:0/2803908692 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd592ffd640 1 --2- 172.21.15.49:0/2803908692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b101b0 0x5643a7ee21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5937fe640 1 --2- 172.21.15.49:0/2803908692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b39070 0x5643a7eedca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5927fc640 1 -- 172.21.15.49:0/2803908692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b101b0 msgr2=0x5643a7ee21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5927fc640 1 --2- 172.21.15.49:0/2803908692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b101b0 0x5643a7ee21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5927fc640 1 -- 172.21.15.49:0/2803908692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b39070 msgr2=0x5643a7eedca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5927fc640 1 --2- 172.21.15.49:0/2803908692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b39070 0x5643a7eedca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5927fc640 1 -- 172.21.15.49:0/2803908692 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a7eed080 con 0x5643a7b18390 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.522+0000 7fd5927fc640 1 --2- 172.21.15.49:0/2803908692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eeb2d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd57c004770 tx=0x7fd57c0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab547c7bc24e485 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd5897fa640 1 -- 172.21.15.49:0/2803908692 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0acf60 con 0x5643a7b18390 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd5897fa640 1 -- 172.21.15.49:0/2803908692 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd57c0ad120 con 0x5643a7b18390 2024-09-21T06:45:48.525 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd5897fa640 1 -- 172.21.15.49:0/2803908692 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0b20f0 con 0x5643a7b18390 2024-09-21T06:45:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd59ff36740 1 -- 172.21.15.49:0/2803908692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 msgr2=0x5643a7eeb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd59ff36740 1 --2- 172.21.15.49:0/2803908692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eeb2d0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd57c004770 tx=0x7fd57c0076c0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd59ff36740 1 -- 172.21.15.49:0/2803908692 shutdown_connections 2024-09-21T06:45:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd59ff36740 1 --2- 172.21.15.49:0/2803908692 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b39070 0x5643a7eedca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd59ff36740 1 --2- 172.21.15.49:0/2803908692 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b18390 0x5643a7eeb2d0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.528 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd59ff36740 1 --2- 172.21.15.49:0/2803908692 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b101b0 0x5643a7ee21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd59ff36740 1 -- 172.21.15.49:0/2803908692 >> 172.21.15.49:0/2803908692 conn(0x5643a7b2d460 msgr2=0x5643a7ef7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd59ff36740 1 -- 172.21.15.49:0/2803908692 shutdown_connections 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.523+0000 7fd59ff36740 1 -- 172.21.15.49:0/2803908692 wait complete. 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.524+0000 7fd59ff36740 1 -- start start 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.524+0000 7fd59ff36740 1 Processor -- start 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.524+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7ef2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.524+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 0x5643a7ef2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.524+0000 7fd59ff36740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7f61870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.524+0000 7fd59ff36740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd5941b0000 con 0x5643a7b39070 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.524+0000 7fd59ff36740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd5941b1470 con 0x5643a7b101b0 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.524+0000 7fd59ff36740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd5941b06d0 con 0x5643a7b18390 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.524+0000 7fd59ff36740 10 client.0 _ll_register_callbacks cb 0x7fd57c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7f61870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5937fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7f61870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46366/0 (socket says 172.21.15.49:46366) 2024-09-21T06:45:48.529 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5937fe640 1 -- 172.21.15.49:0/622844030 learned_addr learned my addr 172.21.15.49:0/622844030 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd592ffd640 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7ef2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5927fc640 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 0x5643a7ef2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5937fe640 1 -- 172.21.15.49:0/622844030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 msgr2=0x5643a7ef2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5937fe640 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 0x5643a7ef2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5937fe640 1 -- 172.21.15.49:0/622844030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 msgr2=0x5643a7ef2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5937fe640 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7ef2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5937fe640 1 -- 172.21.15.49:0/622844030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a7f61ee0 con 0x5643a7b39070 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5927fc640 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 0x5643a7ef2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd5937fe640 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7f61870 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd584020040 tx=0x7fd584016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673761ae2cfff86a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd572ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd572ffd640 1 -- 172.21.15.49:0/622844030 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584022040 con 0x5643a7b39070 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd572ffd640 1 -- 172.21.15.49:0/622844030 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7fd584012950 con 0x5643a7b39070 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.525+0000 7fd59ff36740 1 -- 172.21.15.49:0/622844030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd57c0ad120 con 0x5643a7b39070 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd572ffd640 1 -- 172.21.15.49:0/622844030 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd584041050 con 0x5643a7b39070 2024-09-21T06:45:48.530 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd59ff36740 10 client.17748 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd59ff36740 1 -- 172.21.15.49:0/622844030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5643a7f69200 con 0x5643a7b39070 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd572ffd640 1 -- 172.21.15.49:0/622844030 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd57c0ad120 con 0x5643a7b39070 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd572ffd640 1 -- 172.21.15.49:0/622844030 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fd58400f040 con 0x5643a7b39070 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd59ff36740 10 client.17748 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd59ff36740 10 client.17748 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd59ff36740 20 client.17748 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd59ff36740 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5643a7accda0 0x5643a7f6b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd59ff36740 4 client.17748 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd59ff36740 1 -- 172.21.15.49:0/622844030 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643a7e548a0 con 0x5643a7accda0 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.526+0000 7fd592ffd640 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5643a7accda0 0x5643a7f6b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd592ffd640 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5643a7accda0 0x5643a7f6b840 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=35fd1d402122ef2d server_cookie=d4ac328f17a934f9 in_seq=0 out_seq=0 2024-09-21T06:45:48.531 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd572ffd640 10 client.17748 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:45:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd572ffd640 1 -- 172.21.15.49:0/622844030 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643a7e548a0 con 0x5643a7accda0 2024-09-21T06:45:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd572ffd640 10 client.17748 handle_command_reply: tid=0 2024-09-21T06:45:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 client.17748 shutdown 2024-09-21T06:45:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 -- 172.21.15.49:0/622844030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 msgr2=0x5643a7f61870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7f61870 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd584020040 tx=0x7fd584016000 comp rx=0 tx=0).stop 2024-09-21T06:45:48.532 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 -- 172.21.15.49:0/622844030 shutdown_connections 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x5643a7accda0 0x5643a7f6b840 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5643a7b39070 0x5643a7f61870 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd572ffd640 0 client.17748 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5643a7b18390 0x5643a7ef2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 --2- 172.21.15.49:0/622844030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5643a7b101b0 0x5643a7ef2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 -- 172.21.15.49:0/622844030 >> 172.21.15.49:0/622844030 conn(0x5643a7b2d460 msgr2=0x5643a7ef7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.527+0000 7fd59ff36740 1 -- 172.21.15.49:0/622844030 shutdown_connections 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd59ff36740 1 -- 172.21.15.49:0/622844030 wait complete. 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd59ff36740 20 client.17748 trim_cache size 0 max 16384 2024-09-21T06:45:48.533 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:45:48.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 -- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd5800b6680 msgr2=0x7fd5800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd5800b6680 0x7fd5800b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd58401f000 tx=0x7fd584011c70 comp rx=0 tx=0).stop 2024-09-21T06:45:48.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 -- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5941083a0 msgr2=0x7fd59419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:48.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5941083a0 0x7fd59419cc10 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00c970 tx=0x7fd57c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:45:48.534 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 -- 172.21.15.49:0/3658024400 shutdown_connections 2024-09-21T06:45:48.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd5800b6680 0x7fd5800b8b90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd594108cf0 0x7fd5941a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd5941083a0 0x7fd59419cc10 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 --2- 172.21.15.49:0/3658024400 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd594102a60 0x7fd59419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:48.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.528+0000 7fd5999c2640 1 -- 172.21.15.49:0/3658024400 >> 172.21.15.49:0/3658024400 conn(0x7fd594079730 msgr2=0x7fd594101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:48.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.529+0000 7fd5999c2640 1 -- 172.21.15.49:0/3658024400 shutdown_connections 2024-09-21T06:45:48.535 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:48.529+0000 7fd5999c2640 1 -- 172.21.15.49:0/3658024400 wait complete. 2024-09-21T06:45:49.222 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:45:49.481 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:49.878 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:49 smithi049 ceph-mon[31177]: pgmap v600: 97 pgs: 97 active+clean; 9.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-21T06:45:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.970+0000 7f5033968640 1 -- 172.21.15.49:0/3483411677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c1049e0 msgr2=0x7f502c104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.972 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.970+0000 7f5033968640 1 --2- 172.21.15.49:0/3483411677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c1049e0 0x7f502c104df0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f5028009ca0 tx=0x7f502802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.970+0000 7f5033968640 1 -- 172.21.15.49:0/3483411677 shutdown_connections 2024-09-21T06:45:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.970+0000 7f5033968640 1 --2- 172.21.15.49:0/3483411677 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f502c10de40 0x7f502c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.970+0000 7f5033968640 1 --2- 172.21.15.49:0/3483411677 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c105330 0x7f502c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.970+0000 7f5033968640 1 --2- 172.21.15.49:0/3483411677 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c1049e0 0x7f502c104df0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.970+0000 7f5033968640 1 -- 172.21.15.49:0/3483411677 >> 172.21.15.49:0/3483411677 conn(0x7f502c079750 msgr2=0x7f502c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.970+0000 7f5033968640 1 -- 172.21.15.49:0/3483411677 shutdown_connections 2024-09-21T06:45:49.973 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.971+0000 7f5033968640 1 -- 172.21.15.49:0/3483411677 wait complete. 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.971+0000 7f5033968640 1 Processor -- start 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.971+0000 7f5033968640 1 -- start start 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5033968640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f502c1049e0 0x7f502c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5033968640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c105330 0x7f502c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5033968640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c10de40 0x7f502c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5033968640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f502c113aa0 con 0x7f502c10de40 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5033968640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f502c113920 con 0x7f502c105330 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5033968640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f502c113c20 con 0x7f502c1049e0 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031f05640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c10de40 0x7f502c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.975 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031f05640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c10de40 0x7f502c19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46380/0 (socket says 172.21.15.49:46380) 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031f05640 1 -- 172.21.15.49:0/485046706 learned_addr learned my addr 172.21.15.49:0/485046706 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5030f03640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c105330 0x7f502c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031704640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f502c1049e0 0x7f502c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031f05640 1 -- 172.21.15.49:0/485046706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f502c1049e0 msgr2=0x7f502c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031f05640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f502c1049e0 0x7f502c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031f05640 1 -- 172.21.15.49:0/485046706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c105330 msgr2=0x7f502c19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031f05640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c105330 0x7f502c19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031f05640 1 -- 172.21.15.49:0/485046706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c1a03e0 con 0x7f502c10de40 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.972+0000 7f5031704640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f502c1049e0 0x7f502c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.973+0000 7f5031f05640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c10de40 0x7f502c19fd70 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f502400d750 tx=0x7f502400db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.973+0000 7f501e7fc640 1 -- 172.21.15.49:0/485046706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024017070 con 0x7f502c10de40 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.973+0000 7f501e7fc640 1 -- 172.21.15.49:0/485046706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50240097c0 con 0x7f502c10de40 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.973+0000 7f5033968640 1 -- 172.21.15.49:0/485046706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c1a06d0 con 0x7f502c10de40 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.973+0000 7f501e7fc640 1 -- 172.21.15.49:0/485046706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024004ba0 con 0x7f502c10de40 2024-09-21T06:45:49.976 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.973+0000 7f5033968640 1 -- 172.21.15.49:0/485046706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c1a6ef0 con 0x7f502c10de40 2024-09-21T06:45:49.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.976+0000 7f5039edc740 1 Processor -- start 2024-09-21T06:45:49.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.976+0000 7f501e7fc640 1 -- 172.21.15.49:0/485046706 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5024009c90 con 0x7f502c10de40 2024-09-21T06:45:49.977 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.976+0000 7f5039edc740 1 -- start start 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.976+0000 7f5039edc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 0x55f5014d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.976+0000 7f5039edc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.976+0000 7f5039edc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501108390 0x55f5014d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.976+0000 7f5039edc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f501446ea0 con 0x55f5011001b0 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.976+0000 7f5039edc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f5014362d0 con 0x55f501108390 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.976+0000 7f5039edc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f50143a0e0 con 0x55f501129070 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5031704640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5031704640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46382/0 (socket says 172.21.15.49:46382) 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5031704640 1 -- 172.21.15.49:0/2479793350 learned_addr learned my addr 172.21.15.49:0/2479793350 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5030f03640 1 --2- 172.21.15.49:0/2479793350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 0x55f5014d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5030f03640 1 --2- 172.21.15.49:0/2479793350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501108390 0x55f5014d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5031704640 1 -- 172.21.15.49:0/2479793350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 msgr2=0x55f5014d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5031704640 1 --2- 172.21.15.49:0/2479793350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 0x55f5014d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5031704640 1 -- 172.21.15.49:0/2479793350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501108390 msgr2=0x55f5014d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5031704640 1 --2- 172.21.15.49:0/2479793350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501108390 0x55f5014d0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5031704640 1 -- 172.21.15.49:0/2479793350 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f501194650 con 0x55f5011001b0 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f501e7fc640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f50180b66b0 0x7f50180b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5030f03640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f50180b66b0 0x7f50180b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f5031704640 1 --2- 172.21.15.49:0/2479793350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014d0800 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5028000f80 tx=0x7f5028009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b2accefc148ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.977+0000 7f501e7fc640 1 -- 172.21.15.49:0/485046706 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f50240e7140 con 0x7f502c10de40 2024-09-21T06:45:49.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.978+0000 7f50177fe640 1 -- 172.21.15.49:0/2479793350 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028031cf0 con 0x55f5011001b0 2024-09-21T06:45:49.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.978+0000 7f50177fe640 1 -- 172.21.15.49:0/2479793350 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5028036070 con 0x55f5011001b0 2024-09-21T06:45:49.982 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.978+0000 7f50177fe640 1 -- 172.21.15.49:0/2479793350 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50280042a0 con 0x55f5011001b0 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 -- 172.21.15.49:0/2479793350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 msgr2=0x55f5014d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 --2- 172.21.15.49:0/2479793350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014d0800 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5028000f80 tx=0x7f5028009880 comp rx=0 tx=0).stop 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5030f03640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f50180b66b0 0x7f50180b8bc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f502c1023f0 tx=0x7f502000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 -- 172.21.15.49:0/2479793350 shutdown_connections 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 --2- 172.21.15.49:0/2479793350 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501108390 0x55f5014d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 --2- 172.21.15.49:0/2479793350 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014d0800 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 --2- 172.21.15.49:0/2479793350 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 0x55f5014d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 -- 172.21.15.49:0/2479793350 >> 172.21.15.49:0/2479793350 conn(0x55f50111d460 msgr2=0x55f5014ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 -- 172.21.15.49:0/2479793350 shutdown_connections 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 -- 172.21.15.49:0/2479793350 wait complete. 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 -- start start 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.979+0000 7f5039edc740 1 Processor -- start 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5039edc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014db8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5039edc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 0x55f5014dbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5039edc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501129070 0x55f5014dc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5039edc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f501297700 con 0x55f5011001b0 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5039edc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f5013d1160 con 0x55f501129070 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5039edc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f5014e2e50 con 0x55f501108390 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031704640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014db8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031704640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014db8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46392/0 (socket says 172.21.15.49:46392) 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031704640 1 -- 172.21.15.49:0/1391134706 learned_addr learned my addr 172.21.15.49:0/1391134706 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5030f03640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 0x55f5014dbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5039edc740 10 client.0 _ll_register_callbacks cb 0x55f5013ea9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031f05640 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501129070 0x55f5014dc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031704640 1 -- 172.21.15.49:0/1391134706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 msgr2=0x55f5014dbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031704640 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 0x55f5014dbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031704640 1 -- 172.21.15.49:0/1391134706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501129070 msgr2=0x55f5014dc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031704640 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501129070 0x55f5014dc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031704640 1 -- 172.21.15.49:0/1391134706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5013fec90 con 0x55f5011001b0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5031704640 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014db8e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f502802b080 tx=0x7f502802f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b96f65139ba0b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.980+0000 7f5014ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5014ff9640 1 -- 172.21.15.49:0/1391134706 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5028049040 con 0x55f5011001b0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5039edc740 1 -- 172.21.15.49:0/1391134706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5028036070 con 0x55f5011001b0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5014ff9640 1 -- 172.21.15.49:0/1391134706 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f5028031af0 con 0x55f5011001b0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5014ff9640 1 -- 172.21.15.49:0/1391134706 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f502805a050 con 0x55f5011001b0 2024-09-21T06:45:49.988 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5039edc740 10 client.17760 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5039edc740 1 -- 172.21.15.49:0/1391134706 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f5014eea70 con 0x55f5011001b0 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5014ff9640 1 -- 172.21.15.49:0/1391134706 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5028036070 con 0x55f5011001b0 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5014ff9640 1 -- 172.21.15.49:0/1391134706 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f502804c070 con 0x55f5011001b0 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5039edc740 10 client.17760 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5039edc740 10 client.17760 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5039edc740 20 client.17760 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5039edc740 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f5010e79f0 0x55f5014f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5039edc740 4 client.17760 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.981+0000 7f5039edc740 1 -- 172.21.15.49:0/1391134706 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f501448df0 con 0x55f5010e79f0 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.982+0000 7f5030f03640 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f5010e79f0 0x55f5014f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.982+0000 7f5030f03640 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f5010e79f0 0x55f5014f1dd0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa19ff31191deb7d server_cookie=987bdef6f6e9405a in_seq=0 out_seq=0 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.982+0000 7f5014ff9640 10 client.17760 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5014ff9640 1 -- 172.21.15.49:0/1391134706 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f501448df0 con 0x55f5010e79f0 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5014ff9640 10 client.17760 handle_command_reply: tid=0 2024-09-21T06:45:49.989 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5039edc740 1 client.17760 shutdown 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5039edc740 1 -- 172.21.15.49:0/1391134706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 msgr2=0x55f5014db8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5039edc740 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014db8e0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f502802b080 tx=0x7f502802f310 comp rx=0 tx=0).stop 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5039edc740 1 -- 172.21.15.49:0/1391134706 shutdown_connections 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5039edc740 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f5010e79f0 0x55f5014f1dd0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5039edc740 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f501129070 0x55f5014dc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5039edc740 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 0x55f5014dbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5039edc740 1 --2- 172.21.15.49:0/1391134706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f5011001b0 0x55f5014db8e0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5039edc740 1 -- 172.21.15.49:0/1391134706 >> 172.21.15.49:0/1391134706 conn(0x55f50111d460 msgr2=0x55f5014d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.983+0000 7f5014ff9640 0 client.17760 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.984+0000 7f5039edc740 1 -- 172.21.15.49:0/1391134706 shutdown_connections 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.984+0000 7f5039edc740 1 -- 172.21.15.49:0/1391134706 wait complete. 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.984+0000 7f5039edc740 20 client.17760 trim_cache size 0 max 16384 2024-09-21T06:45:49.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.997+0000 7f5039edc740 1 Processor -- start 2024-09-21T06:45:49.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.997+0000 7f5039edc740 1 -- start start 2024-09-21T06:45:50.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5039edc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 0x55f5014d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5039edc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 0x55f5014dd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.000 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5039edc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501129070 0x55f5014eb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5039edc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1aff00 con 0x55f501129070 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5039edc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1ad7d0 con 0x55f5011001b0 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5039edc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1ab640 con 0x55f501108390 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031f05640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501129070 0x55f5014eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031f05640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501129070 0x55f5014eb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46406/0 (socket says 172.21.15.49:46406) 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031f05640 1 -- 172.21.15.49:0/1398104188 learned_addr learned my addr 172.21.15.49:0/1398104188 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5030f03640 1 --2- 172.21.15.49:0/1398104188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 0x55f5014dd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031704640 1 --2- 172.21.15.49:0/1398104188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 0x55f5014d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031f05640 1 -- 172.21.15.49:0/1398104188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 msgr2=0x55f5014dd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031f05640 1 --2- 172.21.15.49:0/1398104188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 0x55f5014dd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031f05640 1 -- 172.21.15.49:0/1398104188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 msgr2=0x55f5014d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:50.001 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031f05640 1 --2- 172.21.15.49:0/1398104188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 0x55f5014d1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031f05640 1 -- 172.21.15.49:0/1398104188 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5014d10e0 con 0x55f501129070 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.998+0000 7f5031f05640 1 --2- 172.21.15.49:0/1398104188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501129070 0x55f5014eb770 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f50240a9510 tx=0x7f50240acb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddf8d5927f41914 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5016ffd640 1 -- 172.21.15.49:0/1398104188 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5024020040 con 0x55f501129070 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5016ffd640 1 -- 172.21.15.49:0/1398104188 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50240b6960 con 0x55f501129070 2024-09-21T06:45:50.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5016ffd640 1 -- 172.21.15.49:0/1398104188 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50240ac1a0 con 0x55f501129070 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5039edc740 1 -- 172.21.15.49:0/1398104188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501129070 msgr2=0x55f5014eb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5039edc740 1 --2- 172.21.15.49:0/1398104188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501129070 0x55f5014eb770 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f50240a9510 tx=0x7f50240acb60 comp rx=0 tx=0).stop 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5039edc740 1 -- 172.21.15.49:0/1398104188 shutdown_connections 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5039edc740 1 --2- 172.21.15.49:0/1398104188 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501129070 0x55f5014eb770 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5039edc740 1 --2- 172.21.15.49:0/1398104188 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501108390 0x55f5014dd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5039edc740 1 --2- 172.21.15.49:0/1398104188 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 0x55f5014d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:49.999+0000 7f5039edc740 1 -- 172.21.15.49:0/1398104188 >> 172.21.15.49:0/1398104188 conn(0x55f50111d460 msgr2=0x55f5014eb060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 -- 172.21.15.49:0/1398104188 shutdown_connections 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 -- 172.21.15.49:0/1398104188 wait complete. 2024-09-21T06:45:50.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 -- start start 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 Processor -- start 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 0x55f5015548e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501108390 0x55f501554ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 0x55f5014e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1abc90 con 0x55f501108390 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1ad100 con 0x55f5011001b0 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.000+0000 7f5039edc740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f502c1ac360 con 0x55f501129070 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5039edc740 10 client.0 _ll_register_callbacks cb 0x7f502000add0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5030f03640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501108390 0x55f501554ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5030f03640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501108390 0x55f501554ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46418/0 (socket says 172.21.15.49:46418) 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5030f03640 1 -- 172.21.15.49:0/1364763250 learned_addr learned my addr 172.21.15.49:0/1364763250 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5031f05640 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 0x55f5014e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5031704640 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 0x55f5015548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5030f03640 1 -- 172.21.15.49:0/1364763250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 msgr2=0x55f5014e38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5030f03640 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 0x55f5014e38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5030f03640 1 -- 172.21.15.49:0/1364763250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 msgr2=0x55f5015548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5030f03640 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 0x55f5015548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5030f03640 1 -- 172.21.15.49:0/1364763250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5014e4040 con 0x55f501108390 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5030f03640 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501108390 0x55f501554ea0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f502c06b910 tx=0x7f50200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849c4af74f8c63f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5014ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5014ff9640 1 -- 172.21.15.49:0/1364763250 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502001ec20 con 0x55f501108390 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5014ff9640 1 -- 172.21.15.49:0/1364763250 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f502001edc0 con 0x55f501108390 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.001+0000 7f5039edc740 1 -- 172.21.15.49:0/1364763250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50240b6960 con 0x55f501108390 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5014ff9640 1 -- 172.21.15.49:0/1364763250 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f502003f050 con 0x55f501108390 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5039edc740 10 client.17766 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5039edc740 1 -- 172.21.15.49:0/1364763250 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f50155c120 con 0x55f501108390 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5014ff9640 1 -- 172.21.15.49:0/1364763250 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50240b6960 con 0x55f501108390 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5014ff9640 1 -- 172.21.15.49:0/1364763250 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5020030070 con 0x55f501108390 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5039edc740 10 client.17766 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5039edc740 10 client.17766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5039edc740 20 client.17766 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5039edc740 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f5010bcda0 0x55f50155e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5039edc740 4 client.17766 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5039edc740 1 -- 172.21.15.49:0/1364763250 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f5014448a0 con 0x55f5010bcda0 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.002+0000 7f5031704640 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f5010bcda0 0x55f50155e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5014ff9640 10 client.17766 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5031704640 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f5010bcda0 0x55f50155e940 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c38b62fcdd5c4c server_cookie=47bd531a9e43b0f in_seq=0 out_seq=0 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5014ff9640 1 -- 172.21.15.49:0/1364763250 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f5014448a0 con 0x55f5010bcda0 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5014ff9640 10 client.17766 handle_command_reply: tid=0 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5039edc740 1 client.17766 shutdown 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5039edc740 1 -- 172.21.15.49:0/1364763250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501108390 msgr2=0x55f501554ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5039edc740 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501108390 0x55f501554ea0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f502c06b910 tx=0x7f50200046c0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5039edc740 1 -- 172.21.15.49:0/1364763250 shutdown_connections 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5039edc740 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f5010bcda0 0x55f50155e940 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5039edc740 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f501129070 0x55f5014e38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5039edc740 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f501108390 0x55f501554ea0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5039edc740 1 --2- 172.21.15.49:0/1364763250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f5011001b0 0x55f5015548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5039edc740 1 -- 172.21.15.49:0/1364763250 >> 172.21.15.49:0/1364763250 conn(0x55f50111d460 msgr2=0x55f5014dd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.003+0000 7f5014ff9640 0 client.17766 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5039edc740 1 -- 172.21.15.49:0/1364763250 shutdown_connections 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5039edc740 1 -- 172.21.15.49:0/1364763250 wait complete. 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5039edc740 20 client.17766 trim_cache size 0 max 16384 2024-09-21T06:45:50.010 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:45:50.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 -- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f50180b66b0 msgr2=0x7f50180b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f50180b66b0 0x7f50180b8bc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f502c1023f0 tx=0x7f502000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 -- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c10de40 msgr2=0x7f502c19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c10de40 0x7f502c19fd70 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f502400d750 tx=0x7f502400db50 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 -- 172.21.15.49:0/485046706 shutdown_connections 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f50180b66b0 0x7f50180b8bc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f502c10de40 0x7f502c19fd70 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f502c105330 0x7f502c19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 --2- 172.21.15.49:0/485046706 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f502c1049e0 0x7f502c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 -- 172.21.15.49:0/485046706 >> 172.21.15.49:0/485046706 conn(0x7f502c079750 msgr2=0x7f502c100870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.004+0000 7f5033968640 1 -- 172.21.15.49:0/485046706 shutdown_connections 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:50.005+0000 7f5033968640 1 -- 172.21.15.49:0/485046706 wait complete. 2024-09-21T06:45:50.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:49 smithi098 ceph-mon[34704]: pgmap v600: 97 pgs: 97 active+clean; 9.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-21T06:45:50.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:49 smithi079 ceph-mon[34346]: pgmap v600: 97 pgs: 97 active+clean; 9.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-21T06:45:51.807 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:45:51.807 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:45:52.079 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:52.201 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:51 smithi049 ceph-mon[31177]: pgmap v601: 97 pgs: 97 active+clean; 9.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-21T06:45:52.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:51 smithi098 ceph-mon[34704]: pgmap v601: 97 pgs: 97 active+clean; 9.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-21T06:45:52.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:51 smithi079 ceph-mon[34346]: pgmap v601: 97 pgs: 97 active+clean; 9.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-21T06:45:52.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 -- 172.21.15.49:0/3619895922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 msgr2=0x7f1fbc1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 --2- 172.21.15.49:0/3619895922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 0x7f1fbc1087e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009900 tx=0x7f1fac02a410 comp rx=0 tx=0).stop 2024-09-21T06:45:52.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 -- 172.21.15.49:0/3619895922 shutdown_connections 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 --2- 172.21.15.49:0/3619895922 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc108d20 0x7f1fbc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 --2- 172.21.15.49:0/3619895922 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 0x7f1fbc1087e0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 --2- 172.21.15.49:0/3619895922 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fbc102ae0 0x7f1fbc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 -- 172.21.15.49:0/3619895922 >> 172.21.15.49:0/3619895922 conn(0x7f1fbc079760 msgr2=0x7f1fbc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 -- 172.21.15.49:0/3619895922 shutdown_connections 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 -- 172.21.15.49:0/3619895922 wait complete. 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.565+0000 7f1fc1575640 1 Processor -- start 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fc1575640 1 -- start start 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fc1575640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc102ae0 0x7f1fbc19b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fc1575640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 0x7f1fbc19b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fc1575640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fbc108d20 0x7f1fbc19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fc1575640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc1129d0 con 0x7f1fbc1083d0 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fc1575640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc112850 con 0x7f1fbc102ae0 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fc1575640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc112b50 con 0x7f1fbc108d20 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fba7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 0x7f1fbc19b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fba7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 0x7f1fbc19b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46446/0 (socket says 172.21.15.49:46446) 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fba7fc640 1 -- 172.21.15.49:0/1931111030 learned_addr learned my addr 172.21.15.49:0/1931111030 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc102ae0 0x7f1fbc19b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fbb7fe640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fbc108d20 0x7f1fbc19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fba7fc640 1 -- 172.21.15.49:0/1931111030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fbc108d20 msgr2=0x7f1fbc19bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fbc108d20 0x7f1fbc19bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fba7fc640 1 -- 172.21.15.49:0/1931111030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc102ae0 msgr2=0x7f1fbc19b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc102ae0 0x7f1fbc19b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.566+0000 7f1fba7fc640 1 -- 172.21.15.49:0/1931111030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc1a64e0 con 0x7f1fbc1083d0 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.567+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 0x7f1fbc19b820 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1fac031a90 tx=0x7f1fac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.567+0000 7f1fb3fff640 1 -- 172.21.15.49:0/1931111030 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac03f030 con 0x7f1fbc1083d0 2024-09-21T06:45:52.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.567+0000 7f1fc1575640 1 -- 172.21.15.49:0/1931111030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc1a6770 con 0x7f1fbc1083d0 2024-09-21T06:45:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.567+0000 7f1fb3fff640 1 -- 172.21.15.49:0/1931111030 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fac004490 con 0x7f1fbc1083d0 2024-09-21T06:45:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.567+0000 7f1fc1575640 1 -- 172.21.15.49:0/1931111030 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc1a6d20 con 0x7f1fbc1083d0 2024-09-21T06:45:52.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.567+0000 7f1fb3fff640 1 -- 172.21.15.49:0/1931111030 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac035070 con 0x7f1fbc1083d0 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fc7ae9740 1 Processor -- start 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fc7ae9740 1 -- start start 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fb3fff640 1 -- 172.21.15.49:0/1931111030 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f1fac042030 con 0x7f1fbc1083d0 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac73b350 0x5587acae2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acae2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5587aca58e60 con 0x5587ac71a670 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5587aca48290 con 0x5587ac73b350 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5587aca4c0a0 con 0x5587ac712490 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.570+0000 7f1fba7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fba7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46460/0 (socket says 172.21.15.49:46460) 2024-09-21T06:45:52.576 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fba7fc640 1 -- 172.21.15.49:0/272705351 learned_addr learned my addr 172.21.15.49:0/272705351 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fbb7fe640 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac73b350 0x5587acae2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acae2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fba7fc640 1 -- 172.21.15.49:0/272705351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 msgr2=0x5587acae2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acae2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fba7fc640 1 -- 172.21.15.49:0/272705351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac73b350 msgr2=0x5587acae2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac73b350 0x5587acae2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fba7fc640 1 -- 172.21.15.49:0/272705351 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587ac7a6930 con 0x5587ac71a670 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acae2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fb3fff640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1fa80b66b0 0x7f1fa80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae2eb0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f1fac104f90 tx=0x7f1fac10dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248b6cce68fb8654 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fbb7fe640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1fa80b66b0 0x7f1fa80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fb3fff640 1 -- 172.21.15.49:0/1931111030 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f1fac107920 con 0x7f1fbc1083d0 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.571+0000 7f1fb17fa640 1 -- 172.21.15.49:0/272705351 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0c9d70 con 0x5587ac71a670 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.572+0000 7f1fb17fa640 1 -- 172.21.15.49:0/272705351 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fac0cd230 con 0x5587ac71a670 2024-09-21T06:45:52.577 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.572+0000 7f1fb17fa640 1 -- 172.21.15.49:0/272705351 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0cce90 con 0x5587ac71a670 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.572+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/272705351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 msgr2=0x5587acae2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.572+0000 7f1fbb7fe640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1fa80b66b0 0x7f1fa80b8bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4007f80 tx=0x7f1fb4007520 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.572+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae2eb0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f1fac104f90 tx=0x7f1fac10dc50 comp rx=0 tx=0).stop 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.573+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/272705351 shutdown_connections 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.573+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae2eb0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.573+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acae2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.573+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/272705351 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac73b350 0x5587acae2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.573+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/272705351 >> 172.21.15.49:0/272705351 conn(0x5587ac72f740 msgr2=0x5587acae0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.573+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/272705351 shutdown_connections 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.573+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/272705351 wait complete. 2024-09-21T06:45:52.578 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.573+0000 7f1fc7ae9740 1 -- start start 2024-09-21T06:45:52.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.573+0000 7f1fc7ae9740 1 Processor -- start 2024-09-21T06:45:52.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac712490 0x5587acaee050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac71a670 0x5587acaee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac73b350 0x5587acaf9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5587ac8a9890 con 0x5587ac712490 2024-09-21T06:45:52.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5587ac9e2d40 con 0x5587ac71a670 2024-09-21T06:45:52.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5587acaf09d0 con 0x5587ac73b350 2024-09-21T06:45:52.579 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac712490 0x5587acaee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fc7ae9740 10 client.0 _ll_register_callbacks cb 0x5587aca46c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:52.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac712490 0x5587acaee050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46466/0 (socket says 172.21.15.49:46466) 2024-09-21T06:45:52.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbaffd640 1 -- 172.21.15.49:0/326661398 learned_addr learned my addr 172.21.15.49:0/326661398 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:52.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbb7fe640 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac73b350 0x5587acaf9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.580 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac71a670 0x5587acaee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbaffd640 1 -- 172.21.15.49:0/326661398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac73b350 msgr2=0x5587acaf9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:52.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac73b350 0x5587acaf9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbaffd640 1 -- 172.21.15.49:0/326661398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac71a670 msgr2=0x5587acaee5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac71a670 0x5587acaee5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbaffd640 1 -- 172.21.15.49:0/326661398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587acafa270 con 0x5587ac712490 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac712490 0x5587acaee050 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009ec0 tx=0x7f1fa4011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb84f4c27dd9fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fa27fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.574+0000 7f1fa27fc640 1 -- 172.21.15.49:0/326661398 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4019070 con 0x5587ac712490 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fa27fc640 1 -- 172.21.15.49:0/326661398 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f1fa4015660 con 0x5587ac712490 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/326661398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fac0cd230 con 0x5587ac712490 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fa27fc640 1 -- 172.21.15.49:0/326661398 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1fa4025050 con 0x5587ac712490 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fc7ae9740 10 client.17778 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/326661398 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5587acafcc00 con 0x5587ac712490 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fa27fc640 1 -- 172.21.15.49:0/326661398 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fac0cd230 con 0x5587ac712490 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fa27fc640 1 -- 172.21.15.49:0/326661398 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1fa4014a10 con 0x5587ac712490 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fc7ae9740 10 client.17778 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:52.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fc7ae9740 10 client.17778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fc7ae9740 20 client.17778 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5587ac6f9cd0 0x5587acb00170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fc7ae9740 4 client.17778 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.575+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/326661398 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587aca5adb0 con 0x5587ac6f9cd0 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.576+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5587ac6f9cd0 0x5587acb00170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.576+0000 7f1fa27fc640 10 client.17778 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.576+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5587ac6f9cd0 0x5587acb00170 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=806fbc80cdc48dee server_cookie=aa569e5b10151338 in_seq=0 out_seq=0 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fa27fc640 1 -- 172.21.15.49:0/326661398 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5587aca5adb0 con 0x5587ac6f9cd0 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fa27fc640 10 client.17778 handle_command_reply: tid=0 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fc7ae9740 1 client.17778 shutdown 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/326661398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac712490 msgr2=0x5587acaee050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac712490 0x5587acaee050 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009ec0 tx=0x7f1fa4011630 comp rx=0 tx=0).stop 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/326661398 shutdown_connections 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5587ac6f9cd0 0x5587acb00170 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac73b350 0x5587acaf9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac71a670 0x5587acaee5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fa27fc640 0 client.17778 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/326661398 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac712490 0x5587acaee050 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.577+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/326661398 >> 172.21.15.49:0/326661398 conn(0x5587ac72f740 msgr2=0x5587acae55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.578+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/326661398 shutdown_connections 2024-09-21T06:45:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.578+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/326661398 wait complete. 2024-09-21T06:45:52.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.578+0000 7f1fc7ae9740 20 client.17778 trim_cache size 0 max 16384 2024-09-21T06:45:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.595+0000 7f1fc7ae9740 1 Processor -- start 2024-09-21T06:45:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.595+0000 7f1fc7ae9740 1 -- start start 2024-09-21T06:45:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 0x5587acae7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acaf9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc1b2060 con 0x5587ac71a670 2024-09-21T06:45:52.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc1af930 con 0x5587ac72f740 2024-09-21T06:45:52.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc1ad7a0 con 0x5587ac712490 2024-09-21T06:45:52.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.608 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbb7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46482/0 (socket says 172.21.15.49:46482) 2024-09-21T06:45:52.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbb7fe640 1 -- 172.21.15.49:0/4118489055 learned_addr learned my addr 172.21.15.49:0/4118489055 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:52.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 0x5587acae7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acaf9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbb7fe640 1 -- 172.21.15.49:0/4118489055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 msgr2=0x5587acaf9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:52.609 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbb7fe640 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acaf9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbb7fe640 1 -- 172.21.15.49:0/4118489055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 msgr2=0x5587acae7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbb7fe640 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 0x5587acae7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbb7fe640 1 -- 172.21.15.49:0/4118489055 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587acaec350 con 0x5587ac71a670 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acaf9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 0x5587acae7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.596+0000 7f1fbb7fe640 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae3b70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1fb401d900 tx=0x7f1fb4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90412a290b95571 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fb0ff9640 1 -- 172.21.15.49:0/4118489055 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4003970 con 0x5587ac71a670 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fb0ff9640 1 -- 172.21.15.49:0/4118489055 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fb400f9a0 con 0x5587ac71a670 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fb0ff9640 1 -- 172.21.15.49:0/4118489055 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4004590 con 0x5587ac71a670 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/4118489055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 msgr2=0x5587acae3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae3b70 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f1fb401d900 tx=0x7f1fb4018000 comp rx=0 tx=0).stop 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/4118489055 shutdown_connections 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acae3b70 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.610 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acaf9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/4118489055 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 0x5587acae7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.597+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/4118489055 >> 172.21.15.49:0/4118489055 conn(0x5587acae0360 msgr2=0x5587acae3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/4118489055 shutdown_connections 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/4118489055 wait complete. 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 -- start start 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 Processor -- start 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acaf6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acaf2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 0x5587acaf2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc1addf0 con 0x5587ac71a670 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc1af260 con 0x5587ac72f740 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc1ae4c0 con 0x5587ac712490 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.598+0000 7f1fc7ae9740 10 client.0 _ll_register_callbacks cb 0x7f1fa40093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fba7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acaf2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.611 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fba7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acaf2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46494/0 (socket says 172.21.15.49:46494) 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fba7fc640 1 -- 172.21.15.49:0/151946642 learned_addr learned my addr 172.21.15.49:0/151946642 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acaf6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fbb7fe640 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 0x5587acaf2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fba7fc640 1 -- 172.21.15.49:0/151946642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 msgr2=0x5587acaf6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acaf6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fba7fc640 1 -- 172.21.15.49:0/151946642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 msgr2=0x5587acaf2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 0x5587acaf2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fba7fc640 1 -- 172.21.15.49:0/151946642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587acaf34c0 con 0x5587ac71a670 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fba7fc640 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acaf2810 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f1fac006010 tx=0x7f1fac005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350b011f76c22b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fa27fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fa27fc640 1 -- 172.21.15.49:0/151946642 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac049040 con 0x5587ac71a670 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fa27fc640 1 -- 172.21.15.49:0/151946642 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f1fac1052a0 con 0x5587ac71a670 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/151946642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1fb400f9a0 con 0x5587ac71a670 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fa27fc640 1 -- 172.21.15.49:0/151946642 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1fac0cd070 con 0x5587ac71a670 2024-09-21T06:45:52.612 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fc7ae9740 10 client.17784 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.599+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/151946642 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5587acb6bae0 con 0x5587ac71a670 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.600+0000 7f1fa27fc640 1 -- 172.21.15.49:0/151946642 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fac0f4070 con 0x5587ac71a670 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.600+0000 7f1fa27fc640 1 -- 172.21.15.49:0/151946642 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1fac04c060 con 0x5587ac71a670 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.600+0000 7f1fc7ae9740 10 client.17784 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.600+0000 7f1fc7ae9740 10 client.17784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.600+0000 7f1fc7ae9740 20 client.17784 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.600+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5587ac73b350 0x5587acb6e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.600+0000 7f1fc7ae9740 4 client.17784 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.600+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/151946642 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5587aca56860 con 0x5587ac73b350 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.600+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5587ac73b350 0x5587acb6e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.601+0000 7f1fbaffd640 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5587ac73b350 0x5587acb6e020 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7e28a3614385f6b server_cookie=ac7277256c115f6b in_seq=0 out_seq=0 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.601+0000 7f1fa27fc640 10 client.17784 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.602+0000 7f1fa27fc640 1 -- 172.21.15.49:0/151946642 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5587aca56860 con 0x5587ac73b350 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.602+0000 7f1fa27fc640 10 client.17784 handle_command_reply: tid=0 2024-09-21T06:45:52.613 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.602+0000 7f1fc7ae9740 1 client.17784 shutdown 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/151946642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 msgr2=0x5587acaf2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acaf2810 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f1fac006010 tx=0x7f1fac005de0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/151946642 shutdown_connections 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5587ac73b350 0x5587acb6e020 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5587ac72f740 0x5587acaf2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fa27fc640 0 client.17784 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5587ac71a670 0x5587acaf2810 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 --2- 172.21.15.49:0/151946642 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5587ac712490 0x5587acaf6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/151946642 >> 172.21.15.49:0/151946642 conn(0x5587acae0360 msgr2=0x5587acaef2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/151946642 shutdown_connections 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 1 -- 172.21.15.49:0/151946642 wait complete. 2024-09-21T06:45:52.614 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc7ae9740 20 client.17784 trim_cache size 0 max 16384 2024-09-21T06:45:52.615 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:45:52.615 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:45:52.615 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "f56024cf-a906-4d93-89e9-d1f90cea5480", 2024-09-21T06:45:52.615 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:45:52.615 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:45:52.615 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc1575640 1 -- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1fa80b66b0 msgr2=0x7f1fa80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc1575640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1fa80b66b0 0x7f1fa80b8bc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4007f80 tx=0x7f1fb4007520 comp rx=0 tx=0).stop 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc1575640 1 -- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 msgr2=0x7f1fbc19b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.603+0000 7f1fc1575640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 0x7f1fbc19b820 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f1fac031a90 tx=0x7f1fac004270 comp rx=0 tx=0).stop 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.604+0000 7f1fc1575640 1 -- 172.21.15.49:0/1931111030 shutdown_connections 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.604+0000 7f1fc1575640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1fa80b66b0 0x7f1fa80b8bc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.604+0000 7f1fc1575640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1fbc108d20 0x7f1fbc19bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.604+0000 7f1fc1575640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1fbc1083d0 0x7f1fbc19b820 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.604+0000 7f1fc1575640 1 --2- 172.21.15.49:0/1931111030 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1fbc102ae0 0x7f1fbc19b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.604+0000 7f1fc1575640 1 -- 172.21.15.49:0/1931111030 >> 172.21.15.49:0/1931111030 conn(0x7f1fbc079760 msgr2=0x7f1fbc105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.604+0000 7f1fc1575640 1 -- 172.21.15.49:0/1931111030 shutdown_connections 2024-09-21T06:45:52.616 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:52.604+0000 7f1fc1575640 1 -- 172.21.15.49:0/1931111030 wait complete. 2024-09-21T06:45:53.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:52 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:45:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:52 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:52 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:45:53.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:52 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:53.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:52 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:45:53.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:52 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:53.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:52 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:45:53.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:52 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:52 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:45:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:52 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:52 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:45:53.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:52 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:53.363 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:45:53.620 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:53.995 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:53 smithi049 ceph-mon[31177]: pgmap v602: 97 pgs: 97 active+clean; 9.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:45:53.995 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:53 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:45:53.995 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:53 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.087+0000 7f7752c76640 1 -- 172.21.15.49:0/1025483423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c102fa0 msgr2=0x7f774c10fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.087+0000 7f7752c76640 1 --2- 172.21.15.49:0/1025483423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c102fa0 0x7f774c10fcc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f7734009900 tx=0x7f773402a480 comp rx=0 tx=0).stop 2024-09-21T06:45:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.087+0000 7f7752c76640 1 -- 172.21.15.49:0/1025483423 shutdown_connections 2024-09-21T06:45:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.087+0000 7f7752c76640 1 --2- 172.21.15.49:0/1025483423 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f774c110200 0x7f774c112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.087+0000 7f7752c76640 1 --2- 172.21.15.49:0/1025483423 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c102fa0 0x7f774c10fcc0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.087+0000 7f7752c76640 1 --2- 172.21.15.49:0/1025483423 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f774c102650 0x7f774c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.087+0000 7f7752c76640 1 -- 172.21.15.49:0/1025483423 >> 172.21.15.49:0/1025483423 conn(0x7f774c079730 msgr2=0x7f774c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:54.089 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.087+0000 7f7752c76640 1 -- 172.21.15.49:0/1025483423 shutdown_connections 2024-09-21T06:45:54.090 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.087+0000 7f7752c76640 1 -- 172.21.15.49:0/1025483423 wait complete. 2024-09-21T06:45:54.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.088+0000 7f7752c76640 1 Processor -- start 2024-09-21T06:45:54.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.088+0000 7f7752c76640 1 -- start start 2024-09-21T06:45:54.091 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.088+0000 7f7752c76640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f774c102650 0x7f774c19c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.088+0000 7f7752c76640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f774c102fa0 0x7f774c19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.088+0000 7f7752c76640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c110200 0x7f774c1a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.088+0000 7f7752c76640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f774c115c70 con 0x7f774c110200 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.088+0000 7f7752c76640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f774c115af0 con 0x7f774c102650 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.088+0000 7f7752c76640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f774c115df0 con 0x7f774c102fa0 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7751213640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c110200 0x7f774c1a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7751213640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c110200 0x7f774c1a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46514/0 (socket says 172.21.15.49:46514) 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7751213640 1 -- 172.21.15.49:0/3667791722 learned_addr learned my addr 172.21.15.49:0/3667791722 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7750a12640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f774c102650 0x7f774c19c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f774bfff640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f774c102fa0 0x7f774c19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7751213640 1 -- 172.21.15.49:0/3667791722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f774c102fa0 msgr2=0x7f774c19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7751213640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f774c102fa0 0x7f774c19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7751213640 1 -- 172.21.15.49:0/3667791722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f774c102650 msgr2=0x7f774c19c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7751213640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f774c102650 0x7f774c19c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.092 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7751213640 1 -- 172.21.15.49:0/3667791722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774c1a2590 con 0x7f774c110200 2024-09-21T06:45:54.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7751213640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c110200 0x7f774c1a1e60 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f773c00eaa0 tx=0x7f773c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:54.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7749ffb640 1 -- 172.21.15.49:0/3667791722 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c00cdb0 con 0x7f774c110200 2024-09-21T06:45:54.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7749ffb640 1 -- 172.21.15.49:0/3667791722 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f773c005020 con 0x7f774c110200 2024-09-21T06:45:54.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7752c76640 1 -- 172.21.15.49:0/3667791722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f774c1a2880 con 0x7f774c110200 2024-09-21T06:45:54.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.089+0000 7f7749ffb640 1 -- 172.21.15.49:0/3667791722 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0116d0 con 0x7f774c110200 2024-09-21T06:45:54.093 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.090+0000 7f7752c76640 1 -- 172.21.15.49:0/3667791722 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f774c1a8fe0 con 0x7f774c110200 2024-09-21T06:45:54.094 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.093+0000 7f77591ea740 1 Processor -- start 2024-09-21T06:45:54.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.093+0000 7f7749ffb640 1 -- 172.21.15.49:0/3667791722 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f773c0051d0 con 0x7f774c110200 2024-09-21T06:45:54.095 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.093+0000 7f77591ea740 1 -- start start 2024-09-21T06:45:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.093+0000 7f77591ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c036c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.093+0000 7f77591ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c036cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.093+0000 7f77591ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 0x5615c036d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.093+0000 7f77591ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5615c02e2e50 con 0x5615bff9c1b0 2024-09-21T06:45:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.093+0000 7f77591ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615c02d2280 con 0x5615bffc5070 2024-09-21T06:45:54.096 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.093+0000 7f77591ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5615c02d6090 con 0x5615bffa4390 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7750a12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c036cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7750a12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c036cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46516/0 (socket says 172.21.15.49:46516) 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7750a12640 1 -- 172.21.15.49:0/3543009961 learned_addr learned my addr 172.21.15.49:0/3543009961 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f774bfff640 1 --2- 172.21.15.49:0/3543009961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c036c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f774bfff640 1 --2- 172.21.15.49:0/3543009961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 0x5615c036d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7750a12640 1 -- 172.21.15.49:0/3543009961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 msgr2=0x5615c036d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7750a12640 1 --2- 172.21.15.49:0/3543009961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 0x5615c036d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7750a12640 1 -- 172.21.15.49:0/3543009961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 msgr2=0x5615c036c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7750a12640 1 --2- 172.21.15.49:0/3543009961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c036c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7749ffb640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77380b6700 0x7f77380b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7750a12640 1 -- 172.21.15.49:0/3543009961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615c0030650 con 0x5615bff9c1b0 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7751213640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77380b6700 0x7f77380b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7749ffb640 1 -- 172.21.15.49:0/3667791722 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f773c0e7890 con 0x7f774c110200 2024-09-21T06:45:54.097 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.094+0000 7f7750a12640 1 --2- 172.21.15.49:0/3543009961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c036cb90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f774400bd10 tx=0x7f77440107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732933d55f70fa96 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.095+0000 7f7742ffd640 1 -- 172.21.15.49:0/3543009961 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744004030 con 0x5615bff9c1b0 2024-09-21T06:45:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.095+0000 7f7742ffd640 1 -- 172.21.15.49:0/3543009961 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77440035f0 con 0x5615bff9c1b0 2024-09-21T06:45:54.098 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.095+0000 7f7742ffd640 1 -- 172.21.15.49:0/3543009961 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744011640 con 0x5615bff9c1b0 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.095+0000 7f77591ea740 1 -- 172.21.15.49:0/3543009961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 msgr2=0x5615c036cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.095+0000 7f7751213640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77380b6700 0x7f77380b8c10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f773c0e5040 tx=0x7f773c079240 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.095+0000 7f77591ea740 1 --2- 172.21.15.49:0/3543009961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c036cb90 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f774400bd10 tx=0x7f77440107a0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.096+0000 7f77591ea740 1 -- 172.21.15.49:0/3543009961 shutdown_connections 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.096+0000 7f77591ea740 1 --2- 172.21.15.49:0/3543009961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 0x5615c036d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.096+0000 7f77591ea740 1 --2- 172.21.15.49:0/3543009961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c036cb90 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.096+0000 7f77591ea740 1 --2- 172.21.15.49:0/3543009961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c036c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.096+0000 7f77591ea740 1 -- 172.21.15.49:0/3543009961 >> 172.21.15.49:0/3543009961 conn(0x5615bffb9460 msgr2=0x5615c036a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.096+0000 7f77591ea740 1 -- 172.21.15.49:0/3543009961 shutdown_connections 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.096+0000 7f77591ea740 1 -- 172.21.15.49:0/3543009961 wait complete. 2024-09-21T06:45:54.102 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.096+0000 7f77591ea740 1 -- start start 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.096+0000 7f77591ea740 1 Processor -- start 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f77591ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c0377d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f77591ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 0x5615c03782a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f77591ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c0384150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f77591ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5615c0133700 con 0x5615bff9c1b0 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f77591ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x5615c026d110 con 0x5615bffc5070 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f77591ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x5615c037ae30 con 0x5615bffa4390 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f77591ea740 10 client.0 _ll_register_callbacks cb 0x5615c0286990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c0377d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c0377d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46528/0 (socket says 172.21.15.49:46528) 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 -- 172.21.15.49:0/116722710 learned_addr learned my addr 172.21.15.49:0/116722710 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f7750a12640 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 0x5615c03782a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c0384150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.103 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 -- 172.21.15.49:0/116722710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 msgr2=0x5615c03782a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 0x5615c03782a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 -- 172.21.15.49:0/116722710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 msgr2=0x5615c0384150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c0384150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 -- 172.21.15.49:0/116722710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615c029ac40 con 0x5615bff9c1b0 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f774bfff640 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c0377d60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7734005940 tx=0x7f7734005eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6699636a2670dbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.097+0000 7f772bfff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f772bfff640 1 -- 172.21.15.49:0/116722710 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734035040 con 0x5615bff9c1b0 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f772bfff640 1 -- 172.21.15.49:0/116722710 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f77340037f0 con 0x5615bff9c1b0 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f77591ea740 1 -- 172.21.15.49:0/116722710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77440035f0 con 0x5615bff9c1b0 2024-09-21T06:45:54.104 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f772bfff640 1 -- 172.21.15.49:0/116722710 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f77340039f0 con 0x5615bff9c1b0 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f77591ea740 10 client.17796 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f77591ea740 1 -- 172.21.15.49:0/116722710 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5615c0386b70 con 0x5615bff9c1b0 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f772bfff640 1 -- 172.21.15.49:0/116722710 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77440035f0 con 0x5615bff9c1b0 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f772bfff640 1 -- 172.21.15.49:0/116722710 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f773403a040 con 0x5615bff9c1b0 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f77591ea740 10 client.17796 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f77591ea740 10 client.17796 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f77591ea740 20 client.17796 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f77591ea740 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5615bff839f0 0x5615c038a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f77591ea740 4 client.17796 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.098+0000 7f77591ea740 1 -- 172.21.15.49:0/116722710 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615c02e4da0 con 0x5615bff839f0 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.099+0000 7f7750a12640 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5615bff839f0 0x5615c038a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.099+0000 7f7750a12640 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5615bff839f0 0x5615c038a060 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b419c7d440b846db server_cookie=560eb20f655ec5da in_seq=0 out_seq=0 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.099+0000 7f772bfff640 10 client.17796 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:54.105 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f772bfff640 1 -- 172.21.15.49:0/116722710 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615c02e4da0 con 0x5615bff839f0 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f772bfff640 10 client.17796 handle_command_reply: tid=0 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 client.17796 shutdown 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 -- 172.21.15.49:0/116722710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 msgr2=0x5615c0377d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c0377d60 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f7734005940 tx=0x7f7734005eb0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 -- 172.21.15.49:0/116722710 shutdown_connections 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5615bff839f0 0x5615c038a060 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c0384150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bffa4390 0x5615c03782a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 --2- 172.21.15.49:0/116722710 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bff9c1b0 0x5615c0377d60 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f772bfff640 0 client.17796 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 -- 172.21.15.49:0/116722710 >> 172.21.15.49:0/116722710 conn(0x5615bffb9460 msgr2=0x5615c036f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 -- 172.21.15.49:0/116722710 shutdown_connections 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 1 -- 172.21.15.49:0/116722710 wait complete. 2024-09-21T06:45:54.106 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.100+0000 7f77591ea740 20 client.17796 trim_cache size 0 max 16384 2024-09-21T06:45:54.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f77591ea740 1 Processor -- start 2024-09-21T06:45:54.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f77591ea740 1 -- start start 2024-09-21T06:45:54.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f77591ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 0x5615c0378220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f77591ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffa4390 0x5615c036f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f77591ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffc5070 0x5615c036fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.120 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f77591ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f774c1b4330 con 0x5615bffc5070 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f77591ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f774c1b1c00 con 0x5615bffa4390 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f77591ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f774c1afa70 con 0x5615bff9c1b0 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f774bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffc5070 0x5615c036fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f774bfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffc5070 0x5615c036fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46534/0 (socket says 172.21.15.49:46534) 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f774bfff640 1 -- 172.21.15.49:0/1257070114 learned_addr learned my addr 172.21.15.49:0/1257070114 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.118+0000 7f774bfff640 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 0x5615c0378220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f7750a12640 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffa4390 0x5615c036f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f774bfff640 1 -- 172.21.15.49:0/1257070114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 msgr2=0x5615c0378220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f774bfff640 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 0x5615c0378220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f774bfff640 1 -- 172.21.15.49:0/1257070114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffa4390 msgr2=0x5615c036f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f774bfff640 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffa4390 0x5615c036f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f774bfff640 1 -- 172.21.15.49:0/1257070114 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615c037a340 con 0x5615bffc5070 2024-09-21T06:45:54.121 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f7750a12640 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffa4390 0x5615c036f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:54.122 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f774bfff640 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffc5070 0x5615c036fc90 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7734009900 tx=0x7f773402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f447e67ce7be63d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:54.124 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f77427fc640 1 -- 172.21.15.49:0/1257070114 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734056040 con 0x5615bffc5070 2024-09-21T06:45:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f77427fc640 1 -- 172.21.15.49:0/1257070114 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7734057040 con 0x5615bffc5070 2024-09-21T06:45:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.119+0000 7f77427fc640 1 -- 172.21.15.49:0/1257070114 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7734035040 con 0x5615bffc5070 2024-09-21T06:45:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 -- 172.21.15.49:0/1257070114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffc5070 msgr2=0x5615c036fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffc5070 0x5615c036fc90 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7734009900 tx=0x7f773402a480 comp rx=0 tx=0).stop 2024-09-21T06:45:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 -- 172.21.15.49:0/1257070114 shutdown_connections 2024-09-21T06:45:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffc5070 0x5615c036fc90 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffa4390 0x5615c036f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 --2- 172.21.15.49:0/1257070114 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 0x5615c0378220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.125 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 -- 172.21.15.49:0/1257070114 >> 172.21.15.49:0/1257070114 conn(0x5615bffb9460 msgr2=0x5615c0377b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 -- 172.21.15.49:0/1257070114 shutdown_connections 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 -- 172.21.15.49:0/1257070114 wait complete. 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.120+0000 7f77591ea740 1 -- start start 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f77591ea740 1 Processor -- start 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f77591ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 0x5615c037c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f77591ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffa4390 0x5615c037c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f77591ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c037cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f77591ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f774c1b00c0 con 0x5615bffa4390 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f77591ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f774c1b1530 con 0x5615bffc5070 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f77591ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f774c1b0790 con 0x5615bff9c1b0 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f77591ea740 10 client.0 _ll_register_callbacks cb 0x7f7734009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f7750a12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffa4390 0x5615c037c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f7750a12640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffa4390 0x5615c037c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46536/0 (socket says 172.21.15.49:46536) 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f7750a12640 1 -- 172.21.15.49:0/2574958758 learned_addr learned my addr 172.21.15.49:0/2574958758 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:54.126 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f774bfff640 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c037cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.121+0000 7f774bfff640 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 0x5615c037c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f7750a12640 1 -- 172.21.15.49:0/2574958758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 msgr2=0x5615c037c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f7750a12640 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 0x5615c037c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f7750a12640 1 -- 172.21.15.49:0/2574958758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 msgr2=0x5615c037cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f7750a12640 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c037cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f7750a12640 1 -- 172.21.15.49:0/2574958758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615c03f3c70 con 0x5615bffa4390 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f774bfff640 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c037cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f7750a12640 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffa4390 0x5615c037c810 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f7744010ca0 tx=0x7f77440058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd4c6e4d7495e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f772bfff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f772bfff640 1 -- 172.21.15.49:0/2574958758 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744005450 con 0x5615bffa4390 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f772bfff640 1 -- 172.21.15.49:0/2574958758 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f77440055f0 con 0x5615bffa4390 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f77591ea740 1 -- 172.21.15.49:0/2574958758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7734057040 con 0x5615bffa4390 2024-09-21T06:45:54.127 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f772bfff640 1 -- 172.21.15.49:0/2574958758 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f77440035f0 con 0x5615bffa4390 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f77591ea740 10 client.17802 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.122+0000 7f77591ea740 1 -- 172.21.15.49:0/2574958758 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5615c03f4ea0 con 0x5615bffa4390 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.123+0000 7f772bfff640 1 -- 172.21.15.49:0/2574958758 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7734057040 con 0x5615bffa4390 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.123+0000 7f772bfff640 1 -- 172.21.15.49:0/2574958758 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7744011730 con 0x5615bffa4390 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.123+0000 7f77591ea740 10 client.17802 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.123+0000 7f77591ea740 10 client.17802 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.123+0000 7f77591ea740 20 client.17802 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.123+0000 7f77591ea740 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5615bff58da0 0x5615c03f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.123+0000 7f77591ea740 4 client.17802 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.123+0000 7f77591ea740 1 -- 172.21.15.49:0/2574958758 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5615c02e0850 con 0x5615bff58da0 2024-09-21T06:45:54.128 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.123+0000 7f774bfff640 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5615bff58da0 0x5615c03f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:54.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f772bfff640 10 client.17802 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:54.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f774bfff640 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5615bff58da0 0x5615c03f73a0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62f3ff4a762c98c8 server_cookie=6da1b597f0acfea3 in_seq=0 out_seq=0 2024-09-21T06:45:54.129 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f772bfff640 1 -- 172.21.15.49:0/2574958758 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4546 (crc 0 0 0) 0x5615c02e0850 con 0x5615bff58da0 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f772bfff640 10 client.17802 handle_command_reply: tid=0 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 client.17802 shutdown 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 -- 172.21.15.49:0/2574958758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffa4390 msgr2=0x5615c037c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffa4390 0x5615c037c810 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f7744010ca0 tx=0x7f77440058d0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 -- 172.21.15.49:0/2574958758 shutdown_connections 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5615bff58da0 0x5615c03f73a0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5615bffc5070 0x5615c037cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f772bfff640 0 client.17802 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5615bffa4390 0x5615c037c810 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 --2- 172.21.15.49:0/2574958758 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5615bff9c1b0 0x5615c037c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 -- 172.21.15.49:0/2574958758 >> 172.21.15.49:0/2574958758 conn(0x5615bffb9460 msgr2=0x5615c03761a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 -- 172.21.15.49:0/2574958758 shutdown_connections 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.124+0000 7f77591ea740 1 -- 172.21.15.49:0/2574958758 wait complete. 2024-09-21T06:45:54.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f77591ea740 20 client.17802 trim_cache size 0 max 16384 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: "f56024cf-a906-4d93-89e9-d1f90cea5480": { 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "f56024cf-a906-4d93-89e9-d1f90cea5480", 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: "f56024cf-a906-4d93-89e9-d1f90cea5480": { 2024-09-21T06:45:54.131 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:52.601552+0000", 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.132 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.135 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:45:54.136 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "877238a7-c1a9-416c-8f9e-d40ecea3c71a": { 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:10.755554+0000", 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:45:54.137 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.138 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:45:54.139 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:54.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:45:54.140 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:45:54.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 -- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77380b6700 msgr2=0x7f77380b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77380b6700 0x7f77380b8c10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f773c0e5040 tx=0x7f773c079240 comp rx=0 tx=0).stop 2024-09-21T06:45:54.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 -- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c110200 msgr2=0x7f774c1a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:54.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c110200 0x7f774c1a1e60 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f773c00eaa0 tx=0x7f773c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:45:54.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 -- 172.21.15.49:0/3667791722 shutdown_connections 2024-09-21T06:45:54.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f77380b6700 0x7f77380b8c10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f774c110200 0x7f774c1a1e60 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f774c102fa0 0x7f774c19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 --2- 172.21.15.49:0/3667791722 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f774c102650 0x7f774c19c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 -- 172.21.15.49:0/3667791722 >> 172.21.15.49:0/3667791722 conn(0x7f774c079730 msgr2=0x7f774c108cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 -- 172.21.15.49:0/3667791722 shutdown_connections 2024-09-21T06:45:54.141 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:45:54.125+0000 7f7752c76640 1 -- 172.21.15.49:0/3667791722 wait complete. 2024-09-21T06:45:54.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:53 smithi098 ceph-mon[34704]: pgmap v602: 97 pgs: 97 active+clean; 9.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:45:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:53 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:45:54.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:53 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:53 smithi079 ceph-mon[34346]: pgmap v602: 97 pgs: 97 active+clean; 9.6 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-09-21T06:45:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:53 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:45:54.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:53 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:54.880 INFO:tasks.cephfs.filesystem:scrub status for tag:f56024cf-a906-4d93-89e9-d1f90cea5480 - {'path': '/', 'tag': 'f56024cf-a906-4d93-89e9-d1f90cea5480', 'options': 'recursive,force'} 2024-09-21T06:45:55.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:54 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:45:55.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:54 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:45:55.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:54 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:45:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.144+0000 7f7f295e4640 1 -- 172.21.15.49:0/4008964227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24109d60 msgr2=0x7f7f24110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.146 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.144+0000 7f7f295e4640 1 --2- 172.21.15.49:0/4008964227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24109d60 0x7f7f24110590 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009900 tx=0x7f7f1c02a410 comp rx=0 tx=0).stop 2024-09-21T06:45:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.144+0000 7f7f295e4640 1 -- 172.21.15.49:0/4008964227 shutdown_connections 2024-09-21T06:45:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.144+0000 7f7f295e4640 1 --2- 172.21.15.49:0/4008964227 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24109d60 0x7f7f24110590 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.144+0000 7f7f295e4640 1 --2- 172.21.15.49:0/4008964227 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f24109410 0x7f7f24109820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.144+0000 7f7f295e4640 1 --2- 172.21.15.49:0/4008964227 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24103ae0 0x7f7f24103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.144+0000 7f7f295e4640 1 -- 172.21.15.49:0/4008964227 >> 172.21.15.49:0/4008964227 conn(0x7f7f240ff540 msgr2=0x7f7f24101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.145+0000 7f7f295e4640 1 -- 172.21.15.49:0/4008964227 shutdown_connections 2024-09-21T06:45:56.147 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.145+0000 7f7f295e4640 1 -- 172.21.15.49:0/4008964227 wait complete. 2024-09-21T06:45:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.145+0000 7f7f295e4640 1 Processor -- start 2024-09-21T06:45:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f295e4640 1 -- start start 2024-09-21T06:45:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f295e4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24103ae0 0x7f7f2419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f295e4640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f24109410 0x7f7f2419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f295e4640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24109d60 0x7f7f2419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.149 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f295e4640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f24113a70 con 0x7f7f24103ae0 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f295e4640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241138f0 con 0x7f7f24109d60 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f295e4640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f24113bf0 con 0x7f7f24109410 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f22ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24103ae0 0x7f7f2419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f22ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24103ae0 0x7f7f2419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46560/0 (socket says 172.21.15.49:46560) 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f22ffd640 1 -- 172.21.15.49:0/1242806043 learned_addr learned my addr 172.21.15.49:0/1242806043 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f227fc640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f24109410 0x7f7f2419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24109d60 0x7f7f2419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f22ffd640 1 -- 172.21.15.49:0/1242806043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f24109410 msgr2=0x7f7f2419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f22ffd640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f24109410 0x7f7f2419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f22ffd640 1 -- 172.21.15.49:0/1242806043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24109d60 msgr2=0x7f7f2419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f22ffd640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24109d60 0x7f7f2419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f22ffd640 1 -- 172.21.15.49:0/1242806043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f241a03e0 con 0x7f7f24103ae0 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.146+0000 7f7f227fc640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f24109410 0x7f7f2419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.147+0000 7f7f22ffd640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24103ae0 0x7f7f2419a4b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400eab0 tx=0x7f7f1400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:56.150 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.147+0000 7f7f1bfff640 1 -- 172.21.15.49:0/1242806043 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400ce40 con 0x7f7f24103ae0 2024-09-21T06:45:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.147+0000 7f7f295e4640 1 -- 172.21.15.49:0/1242806043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f241a06d0 con 0x7f7f24103ae0 2024-09-21T06:45:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.147+0000 7f7f1bfff640 1 -- 172.21.15.49:0/1242806043 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f14011920 con 0x7f7f24103ae0 2024-09-21T06:45:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.147+0000 7f7f1bfff640 1 -- 172.21.15.49:0/1242806043 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14010a30 con 0x7f7f24103ae0 2024-09-21T06:45:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.147+0000 7f7f295e4640 1 -- 172.21.15.49:0/1242806043 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f241a6e60 con 0x7f7f24103ae0 2024-09-21T06:45:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.150+0000 7f7f30634740 1 Processor -- start 2024-09-21T06:45:56.151 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.150+0000 7f7f30634740 1 -- start start 2024-09-21T06:45:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f30634740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f30634740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935982f0 0x555a93966ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f30634740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 0x555a93967430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f30634740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555a938db6f0 con 0x555a935982f0 2024-09-21T06:45:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f30634740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a938cab20 con 0x555a935a04d0 2024-09-21T06:45:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f30634740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555a938ce930 con 0x555a935c11b0 2024-09-21T06:45:56.154 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f237fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f237fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939669b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:40388/0 (socket says 172.21.15.49:40388) 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f237fe640 1 -- 172.21.15.49:0/1361799426 learned_addr learned my addr 172.21.15.49:0/1361799426 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f1bfff640 1 -- 172.21.15.49:0/1242806043 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f7f14010bd0 con 0x7f7f24103ae0 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f227fc640 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 0x555a93967430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f22ffd640 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935982f0 0x555a93966ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f237fe640 1 -- 172.21.15.49:0/1361799426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 msgr2=0x555a93967430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 0x555a93967430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f237fe640 1 -- 172.21.15.49:0/1361799426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935982f0 msgr2=0x555a93966ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935982f0 0x555a93966ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f237fe640 1 -- 172.21.15.49:0/1361799426 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a93890530 con 0x555a935c11b0 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.151+0000 7f7f22ffd640 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935982f0 0x555a93966ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:56.155 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.152+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939669b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009900 tx=0x7f7f1c0040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66718f5b3930b2a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:56.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.152+0000 7f7f197fa640 1 -- 172.21.15.49:0/1361799426 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c03f070 con 0x555a935c11b0 2024-09-21T06:45:56.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.152+0000 7f7f197fa640 1 -- 172.21.15.49:0/1361799426 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f1c0044c0 con 0x555a935c11b0 2024-09-21T06:45:56.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.152+0000 7f7f197fa640 1 -- 172.21.15.49:0/1361799426 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c035070 con 0x555a935c11b0 2024-09-21T06:45:56.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.152+0000 7f7f1bfff640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7f100b6680 0x7f7f100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.152+0000 7f7f22ffd640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7f100b6680 0x7f7f100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.156 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f1bfff640 1 -- 172.21.15.49:0/1242806043 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f7f140e7ed0 con 0x7f7f24103ae0 2024-09-21T06:45:56.160 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 -- 172.21.15.49:0/1361799426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 msgr2=0x555a939669b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939669b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009900 tx=0x7f7f1c0040d0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 -- 172.21.15.49:0/1361799426 shutdown_connections 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 0x555a93967430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935982f0 0x555a93966ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 --2- 172.21.15.49:0/1361799426 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939669b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 -- 172.21.15.49:0/1361799426 >> 172.21.15.49:0/1361799426 conn(0x555a935b5300 msgr2=0x555a939648a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 -- 172.21.15.49:0/1361799426 shutdown_connections 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f22ffd640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7f100b6680 0x7f7f100b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7f140e5680 tx=0x7f7f14095040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 -- 172.21.15.49:0/1361799426 wait complete. 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.153+0000 7f7f30634740 1 -- start start 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f30634740 1 Processor -- start 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f30634740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935982f0 0x555a93972070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f30634740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 0x555a939725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f30634740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935c11b0 0x555a9397e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.161 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f30634740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555a93802ab0 con 0x555a935c11b0 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f30634740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a93870730 con 0x555a935a04d0 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f30634740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555a939750d0 con 0x555a935982f0 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f30634740 10 client.0 _ll_register_callbacks cb 0x555a938c46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f237fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935c11b0 0x555a9397e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f237fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935c11b0 0x555a9397e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46570/0 (socket says 172.21.15.49:46570) 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f237fe640 1 -- 172.21.15.49:0/1152190830 learned_addr learned my addr 172.21.15.49:0/1152190830 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935982f0 0x555a93972070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f227fc640 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 0x555a939725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f237fe640 1 -- 172.21.15.49:0/1152190830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935982f0 msgr2=0x555a93972070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935982f0 0x555a93972070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f237fe640 1 -- 172.21.15.49:0/1152190830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 msgr2=0x555a939725b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 0x555a939725b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.162 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.154+0000 7f7f237fe640 1 -- 172.21.15.49:0/1152190830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a9362c790 con 0x555a935c11b0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935c11b0 0x555a9397e3f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c004c30 tx=0x7f7f1c004b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d621db1d39063e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f0a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/1152190830 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c035070 con 0x555a935c11b0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/1152190830 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f7f1c005350 con 0x555a935c11b0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f30634740 1 -- 172.21.15.49:0/1152190830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555a938dd640 con 0x555a935c11b0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/1152190830 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7f1c058050 con 0x555a935c11b0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f30634740 10 client.17811 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f30634740 1 -- 172.21.15.49:0/1152190830 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a936a5620 con 0x555a935c11b0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/1152190830 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555a938dd640 con 0x555a935c11b0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/1152190830 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7f1c0314a0 con 0x555a935c11b0 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f30634740 10 client.17811 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.155+0000 7f7f30634740 10 client.17811 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:56.163 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.156+0000 7f7f30634740 20 client.17811 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.156+0000 7f7f30634740 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a9357fd80 0x555a93983f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.156+0000 7f7f30634740 4 client.17811 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.156+0000 7f7f30634740 1 -- 172.21.15.49:0/1152190830 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a938d90f0 con 0x555a9357fd80 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.156+0000 7f7f227fc640 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a9357fd80 0x555a93983f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.156+0000 7f7f0a7fc640 10 client.17811 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.156+0000 7f7f227fc640 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a9357fd80 0x555a93983f00 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7692d1a8e7bbd7b9 server_cookie=a85ed762b3a463de in_seq=0 out_seq=0 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/1152190830 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a938d90f0 con 0x555a9357fd80 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f0a7fc640 10 client.17811 handle_command_reply: tid=0 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 client.17811 shutdown 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 -- 172.21.15.49:0/1152190830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935c11b0 msgr2=0x555a9397e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935c11b0 0x555a9397e3f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c004c30 tx=0x7f7f1c004b30 comp rx=0 tx=0).stop 2024-09-21T06:45:56.164 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 -- 172.21.15.49:0/1152190830 shutdown_connections 2024-09-21T06:45:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a9357fd80 0x555a93983f00 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935c11b0 0x555a9397e3f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935a04d0 0x555a939725b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 --2- 172.21.15.49:0/1152190830 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935982f0 0x555a93972070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f0a7fc640 0 client.17811 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 -- 172.21.15.49:0/1152190830 >> 172.21.15.49:0/1152190830 conn(0x555a935b5300 msgr2=0x555a939679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 -- 172.21.15.49:0/1152190830 shutdown_connections 2024-09-21T06:45:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.157+0000 7f7f30634740 1 -- 172.21.15.49:0/1152190830 wait complete. 2024-09-21T06:45:56.165 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.158+0000 7f7f30634740 20 client.17811 trim_cache size 0 max 16384 2024-09-21T06:45:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.172+0000 7f7f30634740 1 Processor -- start 2024-09-21T06:45:56.174 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.172+0000 7f7f30634740 1 -- start start 2024-09-21T06:45:56.175 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f30634740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 0x555a939680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.175 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f30634740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a9397e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f30634740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a9396f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f30634740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241b2140 con 0x555a935a04d0 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f30634740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241afa10 con 0x555a935982f0 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f30634740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241ad880 con 0x555a935c11b0 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a9397e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a9397e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46586/0 (socket says 172.21.15.49:46586) 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f227fc640 1 -- 172.21.15.49:0/1763303371 learned_addr learned my addr 172.21.15.49:0/1763303371 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 0x555a939680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a9396f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f227fc640 1 -- 172.21.15.49:0/1763303371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 msgr2=0x555a9396f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:56.176 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f227fc640 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a9396f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f227fc640 1 -- 172.21.15.49:0/1763303371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 msgr2=0x555a939680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f227fc640 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 0x555a939680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f227fc640 1 -- 172.21.15.49:0/1763303371 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a93968cb0 con 0x555a935a04d0 2024-09-21T06:45:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f237fe640 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 0x555a939680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.173+0000 7f7f227fc640 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a9397e360 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x555a93975130 tx=0x7f7f0c0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f3b50638149e19a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.174+0000 7f7f18ff9640 1 -- 172.21.15.49:0/1763303371 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c005220 con 0x555a935a04d0 2024-09-21T06:45:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.174+0000 7f7f18ff9640 1 -- 172.21.15.49:0/1763303371 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f0c004c50 con 0x555a935a04d0 2024-09-21T06:45:56.177 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.174+0000 7f7f18ff9640 1 -- 172.21.15.49:0/1763303371 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c01e8b0 con 0x555a935a04d0 2024-09-21T06:45:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.174+0000 7f7f30634740 1 -- 172.21.15.49:0/1763303371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 msgr2=0x555a9397e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.180 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.174+0000 7f7f30634740 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a9397e360 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x555a93975130 tx=0x7f7f0c0128e0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.174+0000 7f7f30634740 1 -- 172.21.15.49:0/1763303371 shutdown_connections 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.174+0000 7f7f30634740 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a9396f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.174+0000 7f7f30634740 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a9397e360 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 --2- 172.21.15.49:0/1763303371 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 0x555a939680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 -- 172.21.15.49:0/1763303371 >> 172.21.15.49:0/1763303371 conn(0x555a935b5300 msgr2=0x555a939679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 -- 172.21.15.49:0/1763303371 shutdown_connections 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 -- 172.21.15.49:0/1763303371 wait complete. 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 -- start start 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 Processor -- start 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 0x555a93986200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a93986740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241aded0 con 0x555a935a04d0 2024-09-21T06:45:56.181 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241af340 con 0x555a935982f0 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7f241ae5a0 con 0x555a935c11b0 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f30634740 10 client.0 _ll_register_callbacks cb 0x7f7f1c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.175+0000 7f7f227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a93986740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f227fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a93986740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46602/0 (socket says 172.21.15.49:46602) 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f227fc640 1 -- 172.21.15.49:0/490687098 learned_addr learned my addr 172.21.15.49:0/490687098 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f237fe640 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f237fe640 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 0x555a93986200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f227fc640 1 -- 172.21.15.49:0/490687098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 msgr2=0x555a939f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f227fc640 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f227fc640 1 -- 172.21.15.49:0/490687098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 msgr2=0x555a93986200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f227fc640 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 0x555a93986200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f227fc640 1 -- 172.21.15.49:0/490687098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a93986fc0 con 0x555a935a04d0 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f227fc640 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a93986740 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009cb0 tx=0x7f7f0c004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8c9a2ac989a3e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:56.182 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f0a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/490687098 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c032060 con 0x555a935a04d0 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/490687098 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8594+0+0 (secure 0 0 0) 0x7f7f0c004a40 con 0x555a935a04d0 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f30634740 1 -- 172.21.15.49:0/490687098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f0c004c50 con 0x555a935a04d0 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/490687098 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7f0c004fd0 con 0x555a935a04d0 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f30634740 10 client.17817 fetch_fsmap learned FSMap version 27 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.176+0000 7f7f30634740 1 -- 172.21.15.49:0/490687098 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a939f1f60 con 0x555a935a04d0 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.177+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/490687098 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f0c004c50 con 0x555a935a04d0 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.177+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/490687098 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7f0c024400 con 0x555a935a04d0 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.177+0000 7f7f30634740 10 client.17817 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.177+0000 7f7f30634740 10 client.17817 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.177+0000 7f7f30634740 20 client.17817 populate_metadata read hostname 'smithi049' 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.177+0000 7f7f30634740 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a935551c0 0x555a939f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:56.183 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.177+0000 7f7f30634740 4 client.17817 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:45:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.177+0000 7f7f30634740 1 -- 172.21.15.49:0/490687098 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555a938d6520 con 0x555a935551c0 2024-09-21T06:45:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.177+0000 7f7f237fe640 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a935551c0 0x555a939f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.178+0000 7f7f0a7fc640 10 client.17817 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:56.184 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.178+0000 7f7f237fe640 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a935551c0 0x555a939f45c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a213c126f5920e4 server_cookie=1a9bb0645c44c77f in_seq=0 out_seq=0 2024-09-21T06:45:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f0a7fc640 1 -- 172.21.15.49:0/490687098 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555a938d6520 con 0x555a935551c0 2024-09-21T06:45:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f0a7fc640 10 client.17817 handle_command_reply: tid=0 2024-09-21T06:45:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 client.17817 shutdown 2024-09-21T06:45:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 -- 172.21.15.49:0/490687098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 msgr2=0x555a93986740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a93986740 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009cb0 tx=0x7f7f0c004f60 comp rx=0 tx=0).stop 2024-09-21T06:45:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 -- 172.21.15.49:0/490687098 shutdown_connections 2024-09-21T06:45:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x555a935551c0 0x555a939f45c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.187 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a935c11b0 0x555a939f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a935a04d0 0x555a93986740 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 --2- 172.21.15.49:0/490687098 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a935982f0 0x555a93986200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f0a7fc640 0 client.17817 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 -- 172.21.15.49:0/490687098 >> 172.21.15.49:0/490687098 conn(0x555a935b5300 msgr2=0x555a93964880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 -- 172.21.15.49:0/490687098 shutdown_connections 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 1 -- 172.21.15.49:0/490687098 wait complete. 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.185+0000 7f7f30634740 20 client.17817 trim_cache size 0 max 16384 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:45:56.188 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:45:56.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 -- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7f100b6680 msgr2=0x7f7f100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7f100b6680 0x7f7f100b8b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7f140e5680 tx=0x7f7f14095040 comp rx=0 tx=0).stop 2024-09-21T06:45:56.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 -- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24103ae0 msgr2=0x7f7f2419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:56.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24103ae0 0x7f7f2419a4b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400eab0 tx=0x7f7f1400ef70 comp rx=0 tx=0).stop 2024-09-21T06:45:56.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 -- 172.21.15.49:0/1242806043 shutdown_connections 2024-09-21T06:45:56.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7f100b6680 0x7f7f100b8b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7f24109d60 0x7f7f2419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.189 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7f24109410 0x7f7f2419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 --2- 172.21.15.49:0/1242806043 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7f24103ae0 0x7f7f2419a4b0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:56.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 -- 172.21.15.49:0/1242806043 >> 172.21.15.49:0/1242806043 conn(0x7f7f240ff540 msgr2=0x7f7f24108a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:56.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 -- 172.21.15.49:0/1242806043 shutdown_connections 2024-09-21T06:45:56.190 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:45:56.186+0000 7f7f295e4640 1 -- 172.21.15.49:0/1242806043 wait complete. 2024-09-21T06:45:56.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:55 smithi049 ceph-mon[31177]: pgmap v603: 97 pgs: 97 active+clean; 9.8 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:56.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:45:56.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:45:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:45:56.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:55 smithi098 ceph-mon[34704]: pgmap v603: 97 pgs: 97 active+clean; 9.8 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:45:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:45:56.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:45:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:55 smithi079 ceph-mon[34346]: pgmap v603: 97 pgs: 97 active+clean; 9.8 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:45:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:45:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:45:56.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:45:58.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:57 smithi049 ceph-mon[31177]: pgmap v604: 97 pgs: 97 active+clean; 9.8 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:45:58.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:57 smithi098 ceph-mon[34704]: pgmap v604: 97 pgs: 97 active+clean; 9.8 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:45:58.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:57 smithi079 ceph-mon[34346]: pgmap v604: 97 pgs: 97 active+clean; 9.8 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:45:59.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:58 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:45:59.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:58 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:45:59.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:58 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:46:00.197 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:59 smithi098 ceph-mon[34704]: pgmap v605: 97 pgs: 97 active+clean; 9.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-21T06:46:00.197 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:45:59 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:46:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:59 smithi049 ceph-mon[31177]: pgmap v605: 97 pgs: 97 active+clean; 9.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-21T06:46:00.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:45:59 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:46:00.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:59 smithi079 ceph-mon[34346]: pgmap v605: 97 pgs: 97 active+clean; 9.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-09-21T06:46:00.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:45:59 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:46:02.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:01 smithi049 ceph-mon[31177]: pgmap v606: 97 pgs: 97 active+clean; 9.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T06:46:02.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:01 smithi098 ceph-mon[34704]: pgmap v606: 97 pgs: 97 active+clean; 9.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T06:46:02.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:01 smithi079 ceph-mon[34346]: pgmap v606: 97 pgs: 97 active+clean; 9.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T06:46:04.121 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:03 smithi079 ceph-mon[34346]: pgmap v607: 97 pgs: 97 active+clean; 9.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-09-21T06:46:04.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:03 smithi049 ceph-mon[31177]: pgmap v607: 97 pgs: 97 active+clean; 9.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-09-21T06:46:04.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:03 smithi098 ceph-mon[34704]: pgmap v607: 97 pgs: 97 active+clean; 9.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 15 op/s 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:437/600: open fd = 3 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:438/600: open fd = 3 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:439/600: open fd = 3 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.701 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:440/600: open fd = 3 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:441/600: open fd = 3 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:442/600: open fd = 3 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.702 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:443/600: open fd = 3 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:444/600: open fd = 3 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:445/600: open fd = 3 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:446/600: open fd = 3 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.703 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:447/600: open fd = 3 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:448/600: open fd = 3 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:449/600: open fd = 3 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.704 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:450/600: open fd = 3 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:451/600: open fd = 3 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:452/600: open fd = 3 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:453/600: open fd = 3 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.705 INFO:tasks.workunit.client.0.smithi049.stdout:454/600: open fd = 3 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:455/600: open fd = 3 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:456/600: open fd = 3 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:457/600: open fd = 3 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.706 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:458/600: open fd = 3 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:459/600: open fd = 3 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:460/600: open fd = 3 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:461/600: open fd = 3 2024-09-21T06:46:04.707 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:462/600: open fd = 3 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:463/600: open fd = 3 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:464/600: open fd = 3 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:465/600: open fd = 3 2024-09-21T06:46:04.708 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:466/600: open fd = 3 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:467/600: open fd = 3 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:468/600: open fd = 3 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.709 INFO:tasks.workunit.client.0.smithi049.stdout:469/600: open fd = 3 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:470/600: open fd = 3 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:471/600: open fd = 3 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:472/600: open fd = 3 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.710 INFO:tasks.workunit.client.0.smithi049.stdout:473/600: open fd = 3 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:474/600: open fd = 3 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:475/600: open fd = 3 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:476/600: open fd = 3 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.711 INFO:tasks.workunit.client.0.smithi049.stdout:477/600: open fd = 3 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:478/600: open fd = 3 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:479/600: open fd = 3 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:480/600: open fd = 3 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.712 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:481/600: open fd = 3 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:482/600: open fd = 3 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:483/600: open fd = 3 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:484/600: open fd = 3 2024-09-21T06:46:04.713 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:485/600: open fd = 3 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:486/600: open fd = 3 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:487/600: open fd = 3 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.714 INFO:tasks.workunit.client.0.smithi049.stdout:488/600: open fd = 3 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:489/600: open fd = 3 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:490/600: open fd = 3 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:491/600: open fd = 3 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.715 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:492/600: open fd = 3 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:493/600: open fd = 3 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:494/600: open fd = 3 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:495/600: open fd = 3 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.716 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:496/600: open fd = 3 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:497/600: open fd = 3 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:498/600: open fd = 3 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:46:04.717 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:46:06.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:05 smithi049 ceph-mon[31177]: pgmap v608: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 82 KiB/s wr, 33 op/s 2024-09-21T06:46:06.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:05 smithi098 ceph-mon[34704]: pgmap v608: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 82 KiB/s wr, 33 op/s 2024-09-21T06:46:06.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:05 smithi079 ceph-mon[34346]: pgmap v608: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 82 KiB/s wr, 33 op/s 2024-09-21T06:46:08.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:07 smithi049 ceph-mon[31177]: pgmap v609: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 73 KiB/s wr, 30 op/s 2024-09-21T06:46:08.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:07 smithi098 ceph-mon[34704]: pgmap v609: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 73 KiB/s wr, 30 op/s 2024-09-21T06:46:08.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:07 smithi079 ceph-mon[34346]: pgmap v609: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 73 KiB/s wr, 30 op/s 2024-09-21T06:46:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.301+0000 7f430397b640 1 -- 172.21.15.49:0/1077894466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc113e00 msgr2=0x7f42fc114210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.301+0000 7f430397b640 1 --2- 172.21.15.49:0/1077894466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc113e00 0x7f42fc114210 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009900 tx=0x7f42f802a410 comp rx=0 tx=0).stop 2024-09-21T06:46:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.301+0000 7f430397b640 1 -- 172.21.15.49:0/1077894466 shutdown_connections 2024-09-21T06:46:09.303 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.301+0000 7f430397b640 1 --2- 172.21.15.49:0/1077894466 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42fc114750 0x7f42fc11af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.301+0000 7f430397b640 1 --2- 172.21.15.49:0/1077894466 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc113e00 0x7f42fc114210 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.301+0000 7f430397b640 1 --2- 172.21.15.49:0/1077894466 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42fc10e4d0 0x7f42fc10e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.301+0000 7f430397b640 1 -- 172.21.15.49:0/1077894466 >> 172.21.15.49:0/1077894466 conn(0x7f42fc06e850 msgr2=0x7f42fc10c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.301+0000 7f430397b640 1 -- 172.21.15.49:0/1077894466 shutdown_connections 2024-09-21T06:46:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.301+0000 7f430397b640 1 -- 172.21.15.49:0/1077894466 wait complete. 2024-09-21T06:46:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f430397b640 1 Processor -- start 2024-09-21T06:46:09.304 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f430397b640 1 -- start start 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f430397b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42fc113e00 0x7f42fc1a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f430397b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42fc114750 0x7f42fc1a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f430397b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc1aa280 0x7f42fc1aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f430397b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc11e430 con 0x7f42fc1aa280 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f430397b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc11e2b0 con 0x7f42fc114750 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f430397b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc11e5b0 con 0x7f42fc113e00 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f4301f18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc1aa280 0x7f42fc1aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f4301f18640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc1aa280 0x7f42fc1aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58332/0 (socket says 172.21.15.49:58332) 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f4301f18640 1 -- 172.21.15.49:0/1590300457 learned_addr learned my addr 172.21.15.49:0/1590300457 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f4300f16640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42fc114750 0x7f42fc1a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.302+0000 7f4301717640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42fc113e00 0x7f42fc1a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f4301f18640 1 -- 172.21.15.49:0/1590300457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42fc113e00 msgr2=0x7f42fc1a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f4301f18640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42fc113e00 0x7f42fc1a4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f4301f18640 1 -- 172.21.15.49:0/1590300457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42fc114750 msgr2=0x7f42fc1a4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f4301f18640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42fc114750 0x7f42fc1a4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f4301f18640 1 -- 172.21.15.49:0/1590300457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc1aad90 con 0x7f42fc1aa280 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f4300f16640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42fc114750 0x7f42fc1a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f4301f18640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc1aa280 0x7f42fc1aa690 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f42f000e970 tx=0x7f42f000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f42ee7fc640 1 -- 172.21.15.49:0/1590300457 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f000ccc0 con 0x7f42fc1aa280 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f42ee7fc640 1 -- 172.21.15.49:0/1590300457 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42f000ce60 con 0x7f42fc1aa280 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f430397b640 1 -- 172.21.15.49:0/1590300457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42fc1ab080 con 0x7f42fc1aa280 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f42ee7fc640 1 -- 172.21.15.49:0/1590300457 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0010430 con 0x7f42fc1aa280 2024-09-21T06:46:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.303+0000 7f430397b640 1 -- 172.21.15.49:0/1590300457 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42fc1b1700 con 0x7f42fc1aa280 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.306+0000 7f430a9c5740 1 Processor -- start 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.306+0000 7f42ee7fc640 1 -- 172.21.15.49:0/1590300457 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f42f0004ff0 con 0x7f42fc1aa280 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.306+0000 7f430a9c5740 1 -- start start 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 0x55b5d9b8f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b8fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 0x55b5d9b90430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f430a9c5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b5d9b046f0 con 0x55b5d97c12f0 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f430a9c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b5d9af3b20 con 0x55b5d97ea1b0 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f430a9c5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b5d9af7930 con 0x55b5d97c94d0 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4301717640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b8fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4301717640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b8fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58348/0 (socket says 172.21.15.49:58348) 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4301717640 1 -- 172.21.15.49:0/819102867 learned_addr learned my addr 172.21.15.49:0/819102867 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4300f16640 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 0x55b5d9b8f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4300f16640 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 0x55b5d9b90430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4301717640 1 -- 172.21.15.49:0/819102867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 msgr2=0x55b5d9b90430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4301717640 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 0x55b5d9b90430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4301717640 1 -- 172.21.15.49:0/819102867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 msgr2=0x55b5d9b8f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4301717640 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 0x55b5d9b8f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4301717640 1 -- 172.21.15.49:0/819102867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5d9ab9530 con 0x55b5d97c12f0 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f4300f16640 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 0x55b5d9b90430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.307+0000 7f42ee7fc640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42e80b6680 0x7f42e80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.308+0000 7f4301717640 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b8fef0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f42f4010480 tx=0x7f42f4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e12d18c72ad3144 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.308+0000 7f4300f16640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42e80b6680 0x7f42e80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.308+0000 7f42ee7fc640 1 -- 172.21.15.49:0/1590300457 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8638+0+0 (secure 0 0 0) 0x7f42f00e7c30 con 0x7f42fc1aa280 2024-09-21T06:46:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.308+0000 7f42e77fe640 1 -- 172.21.15.49:0/819102867 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4003b70 con 0x55b5d97c12f0 2024-09-21T06:46:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.308+0000 7f42e77fe640 1 -- 172.21.15.49:0/819102867 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42f4003d10 con 0x55b5d97c12f0 2024-09-21T06:46:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.308+0000 7f42e77fe640 1 -- 172.21.15.49:0/819102867 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4011b40 con 0x55b5d97c12f0 2024-09-21T06:46:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 -- 172.21.15.49:0/819102867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 msgr2=0x55b5d9b8fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f4300f16640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42e80b6680 0x7f42e80b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f42f802aa00 tx=0x7f42f8041040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b8fef0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f42f4010480 tx=0x7f42f4009f90 comp rx=0 tx=0).stop 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 -- 172.21.15.49:0/819102867 shutdown_connections 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 0x55b5d9b90430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b8fef0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 --2- 172.21.15.49:0/819102867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 0x55b5d9b8f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 -- 172.21.15.49:0/819102867 >> 172.21.15.49:0/819102867 conn(0x55b5d97de300 msgr2=0x55b5d9b8d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 -- 172.21.15.49:0/819102867 shutdown_connections 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 -- 172.21.15.49:0/819102867 wait complete. 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 -- start start 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.309+0000 7f430a9c5740 1 Processor -- start 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c12f0 0x55b5d9b9b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c94d0 0x55b5d9b9b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 0x55b5d9ba74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f430a9c5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55b5d9a2bab0 con 0x55b5d97c94d0 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f430a9c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55b5d9a99730 con 0x55b5d97c12f0 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f430a9c5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55b5d9b9e130 con 0x55b5d97ea1b0 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f430a9c5740 10 client.0 _ll_register_callbacks cb 0x55b5d9aed6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f4300f16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c94d0 0x55b5d9b9b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f4300f16640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c94d0 0x55b5d9b9b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58352/0 (socket says 172.21.15.49:58352) 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f4300f16640 1 -- 172.21.15.49:0/2308996396 learned_addr learned my addr 172.21.15.49:0/2308996396 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f4301717640 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c12f0 0x55b5d9b9b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f4301f18640 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 0x55b5d9ba74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f4300f16640 1 -- 172.21.15.49:0/2308996396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 msgr2=0x55b5d9ba74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f4300f16640 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 0x55b5d9ba74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f4300f16640 1 -- 172.21.15.49:0/2308996396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c12f0 msgr2=0x55b5d9b9b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.310+0000 7f4300f16640 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c12f0 0x55b5d9b9b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f4300f16640 1 -- 172.21.15.49:0/2308996396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5d9855790 con 0x55b5d97c94d0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f4301f18640 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 0x55b5d9ba74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f4300f16640 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c94d0 0x55b5d9b9b560 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f42f8005ab0 tx=0x7f42f802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65a0d542adc8e1b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f42e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f42e4ff9640 1 -- 172.21.15.49:0/2308996396 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f8051070 con 0x55b5d97c94d0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f42e4ff9640 1 -- 172.21.15.49:0/2308996396 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8638+0+0 (secure 0 0 0) 0x7f42f8031970 con 0x55b5d97c94d0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f430a9c5740 1 -- 172.21.15.49:0/2308996396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42f4003d10 con 0x55b5d97c94d0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f42e4ff9640 1 -- 172.21.15.49:0/2308996396 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f42f805d050 con 0x55b5d97c94d0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f430a9c5740 10 client.17829 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f430a9c5740 1 -- 172.21.15.49:0/2308996396 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b5d98ce620 con 0x55b5d97c94d0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.311+0000 7f42e4ff9640 1 -- 172.21.15.49:0/2308996396 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42f4003d10 con 0x55b5d97c94d0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f42e4ff9640 1 -- 172.21.15.49:0/2308996396 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f42f803dc00 con 0x55b5d97c94d0 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f430a9c5740 10 client.17829 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f430a9c5740 10 client.17829 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f430a9c5740 20 client.17829 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f430a9c5740 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b5d97a8d80 0x55b5d9bad290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f430a9c5740 4 client.17829 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f430a9c5740 1 -- 172.21.15.49:0/2308996396 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5d9b06640 con 0x55b5d97a8d80 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f4301717640 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b5d97a8d80 0x55b5d9bad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f4301717640 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b5d97a8d80 0x55b5d9bad290 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7324c6eb1a6d7f48 server_cookie=b4ca5467cbb064b3 in_seq=0 out_seq=0 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.312+0000 7f42e4ff9640 10 client.17829 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.313+0000 7f42e4ff9640 1 -- 172.21.15.49:0/2308996396 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b5d9b06640 con 0x55b5d97a8d80 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.313+0000 7f42e4ff9640 10 client.17829 handle_command_reply: tid=0 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.313+0000 7f430a9c5740 1 client.17829 shutdown 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.313+0000 7f430a9c5740 1 -- 172.21.15.49:0/2308996396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c94d0 msgr2=0x55b5d9b9b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.313+0000 7f430a9c5740 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c94d0 0x55b5d9b9b560 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f42f8005ab0 tx=0x7f42f802a410 comp rx=0 tx=0).stop 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f430a9c5740 1 -- 172.21.15.49:0/2308996396 shutdown_connections 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f430a9c5740 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b5d97a8d80 0x55b5d9bad290 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f430a9c5740 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 0x55b5d9ba74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f430a9c5740 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c94d0 0x55b5d9b9b560 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f42e4ff9640 0 client.17829 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f430a9c5740 1 --2- 172.21.15.49:0/2308996396 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c12f0 0x55b5d9b9b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f430a9c5740 1 -- 172.21.15.49:0/2308996396 >> 172.21.15.49:0/2308996396 conn(0x55b5d97de300 msgr2=0x55b5d9b909e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f430a9c5740 1 -- 172.21.15.49:0/2308996396 shutdown_connections 2024-09-21T06:46:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f430a9c5740 1 -- 172.21.15.49:0/2308996396 wait complete. 2024-09-21T06:46:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.314+0000 7f430a9c5740 20 client.17829 trim_cache size 0 max 16384 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.329+0000 7f430a9c5740 1 Processor -- start 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.329+0000 7f430a9c5740 1 -- start start 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b910f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c94d0 0x55b5d9ba73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 0x55b5d9b981f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f430a9c5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1bca60 con 0x55b5d97c12f0 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f430a9c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1ba330 con 0x55b5d97c94d0 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f430a9c5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1b81a0 con 0x55b5d97ea1b0 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4301717640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b910f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4301717640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b910f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58354/0 (socket says 172.21.15.49:58354) 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4301717640 1 -- 172.21.15.49:0/1921937045 learned_addr learned my addr 172.21.15.49:0/1921937045 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4300f16640 1 --2- 172.21.15.49:0/1921937045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c94d0 0x55b5d9ba73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.332 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4301f18640 1 --2- 172.21.15.49:0/1921937045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 0x55b5d9b981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4301717640 1 -- 172.21.15.49:0/1921937045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 msgr2=0x55b5d9b981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4301717640 1 --2- 172.21.15.49:0/1921937045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 0x55b5d9b981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4301717640 1 -- 172.21.15.49:0/1921937045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c94d0 msgr2=0x55b5d9ba73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4301717640 1 --2- 172.21.15.49:0/1921937045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c94d0 0x55b5d9ba73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.333 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.330+0000 7f4301717640 1 -- 172.21.15.49:0/1921937045 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5d9b907e0 con 0x55b5d97c12f0 2024-09-21T06:46:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.331+0000 7f4301717640 1 --2- 172.21.15.49:0/1921937045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b910f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f42f4011670 tx=0x7f42f4009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2e8de91813822fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.331+0000 7f42e6ffd640 1 -- 172.21.15.49:0/1921937045 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f402a070 con 0x55b5d97c12f0 2024-09-21T06:46:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.331+0000 7f42e6ffd640 1 -- 172.21.15.49:0/1921937045 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42f4003dd0 con 0x55b5d97c12f0 2024-09-21T06:46:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.331+0000 7f42e6ffd640 1 -- 172.21.15.49:0/1921937045 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4005510 con 0x55b5d97c12f0 2024-09-21T06:46:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.332+0000 7f430a9c5740 1 -- 172.21.15.49:0/1921937045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 msgr2=0x55b5d9b910f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.332+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1921937045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b910f0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f42f4011670 tx=0x7f42f4009500 comp rx=0 tx=0).stop 2024-09-21T06:46:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.332+0000 7f430a9c5740 1 -- 172.21.15.49:0/1921937045 shutdown_connections 2024-09-21T06:46:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.332+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1921937045 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97ea1b0 0x55b5d9b981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.332+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1921937045 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97c94d0 0x55b5d9ba73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.332+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1921937045 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9b910f0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.332+0000 7f430a9c5740 1 -- 172.21.15.49:0/1921937045 >> 172.21.15.49:0/1921937045 conn(0x55b5d97de300 msgr2=0x55b5d9b909e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.332+0000 7f430a9c5740 1 -- 172.21.15.49:0/1921937045 shutdown_connections 2024-09-21T06:46:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.332+0000 7f430a9c5740 1 -- 172.21.15.49:0/1921937045 wait complete. 2024-09-21T06:46:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f430a9c5740 1 -- start start 2024-09-21T06:46:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f430a9c5740 1 Processor -- start 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9ba0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 0x55b5d9ba1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f430a9c5740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 0x55b5d9c0ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f430a9c5740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1b87f0 con 0x55b5d97c12f0 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f430a9c5740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1b9c60 con 0x55b5d97ea1b0 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f430a9c5740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1b8ec0 con 0x55b5d97c94d0 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f430a9c5740 10 client.0 _ll_register_callbacks cb 0x7f42f8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f4301717640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9ba0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f4301f18640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 0x55b5d9c0ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f4301717640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9ba0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58366/0 (socket says 172.21.15.49:58366) 2024-09-21T06:46:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f4301717640 1 -- 172.21.15.49:0/1175361961 learned_addr learned my addr 172.21.15.49:0/1175361961 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.333+0000 7f4300f16640 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 0x55b5d9ba1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f4301717640 1 -- 172.21.15.49:0/1175361961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 msgr2=0x55b5d9ba1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f4301717640 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 0x55b5d9ba1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f4301717640 1 -- 172.21.15.49:0/1175361961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 msgr2=0x55b5d9c0ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f4301717640 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 0x55b5d9c0ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f4301717640 1 -- 172.21.15.49:0/1175361961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5d9c0f2f0 con 0x55b5d97c12f0 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f4301f18640 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 0x55b5d9c0ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f4301717640 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9ba0e80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009290 tx=0x7f42f40099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebae6f4d636498ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f42e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f42e4ff9640 1 -- 172.21.15.49:0/1175361961 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4034060 con 0x55b5d97c12f0 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f42e4ff9640 1 -- 172.21.15.49:0/1175361961 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8638+0+0 (secure 0 0 0) 0x7f42f40116a0 con 0x55b5d97c12f0 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f430a9c5740 1 -- 172.21.15.49:0/1175361961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42f4003dd0 con 0x55b5d97c12f0 2024-09-21T06:46:09.339 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f42e4ff9640 1 -- 172.21.15.49:0/1175361961 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f42f402a040 con 0x55b5d97c12f0 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f430a9c5740 10 client.17835 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.334+0000 7f430a9c5740 1 -- 172.21.15.49:0/1175361961 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b5d9c177b0 con 0x55b5d97c12f0 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f42e4ff9640 1 -- 172.21.15.49:0/1175361961 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42f4003dd0 con 0x55b5d97c12f0 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f42e4ff9640 1 -- 172.21.15.49:0/1175361961 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f42f4005730 con 0x55b5d97c12f0 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f430a9c5740 10 client.17835 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f430a9c5740 10 client.17835 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f430a9c5740 20 client.17835 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b5d977e1c0 0x55b5d9c19d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f430a9c5740 4 client.17835 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f430a9c5740 1 -- 172.21.15.49:0/1175361961 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5d9b020f0 con 0x55b5d977e1c0 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f4300f16640 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b5d977e1c0 0x55b5d9c19d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f42e4ff9640 10 client.17835 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:09.340 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.335+0000 7f4300f16640 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b5d977e1c0 0x55b5d9c19d60 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac003253d1dd8e7 server_cookie=aa15c8524fd0995b in_seq=0 out_seq=0 2024-09-21T06:46:09.345 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.343+0000 7f42e4ff9640 1 -- 172.21.15.49:0/1175361961 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5d9b020f0 con 0x55b5d977e1c0 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.343+0000 7f42e4ff9640 10 client.17835 handle_command_reply: tid=0 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.343+0000 7f430a9c5740 1 client.17835 shutdown 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.343+0000 7f430a9c5740 1 -- 172.21.15.49:0/1175361961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 msgr2=0x55b5d9ba0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.343+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9ba0e80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009290 tx=0x7f42f40099b0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430a9c5740 1 -- 172.21.15.49:0/1175361961 shutdown_connections 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55b5d977e1c0 0x55b5d9c19d60 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55b5d97ea1b0 0x55b5d9c0ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55b5d97c94d0 0x55b5d9ba1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f42e4ff9640 0 client.17835 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430a9c5740 1 --2- 172.21.15.49:0/1175361961 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55b5d97c12f0 0x55b5d9ba0e80 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430a9c5740 1 -- 172.21.15.49:0/1175361961 >> 172.21.15.49:0/1175361961 conn(0x55b5d97de300 msgr2=0x55b5d9b8bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:09.346 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430a9c5740 1 -- 172.21.15.49:0/1175361961 shutdown_connections 2024-09-21T06:46:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430a9c5740 1 -- 172.21.15.49:0/1175361961 wait complete. 2024-09-21T06:46:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430a9c5740 20 client.17835 trim_cache size 0 max 16384 2024-09-21T06:46:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:46:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:46:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:46:09.347 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:46:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430397b640 1 -- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42e80b6680 msgr2=0x7f42e80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430397b640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42e80b6680 0x7f42e80b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f42f802aa00 tx=0x7f42f8041040 comp rx=0 tx=0).stop 2024-09-21T06:46:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430397b640 1 -- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc1aa280 msgr2=0x7f42fc1aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430397b640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc1aa280 0x7f42fc1aa690 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f42f000e970 tx=0x7f42f000ed70 comp rx=0 tx=0).stop 2024-09-21T06:46:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430397b640 1 -- 172.21.15.49:0/1590300457 shutdown_connections 2024-09-21T06:46:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430397b640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42e80b6680 0x7f42e80b8b90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.348 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430397b640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42fc1aa280 0x7f42fc1aa690 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430397b640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42fc114750 0x7f42fc1a4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.344+0000 7f430397b640 1 --2- 172.21.15.49:0/1590300457 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42fc113e00 0x7f42fc1a4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.345+0000 7f430397b640 1 -- 172.21.15.49:0/1590300457 >> 172.21.15.49:0/1590300457 conn(0x7f42fc10e4d0 msgr2=0x7f42fc111c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.345+0000 7f430397b640 1 -- 172.21.15.49:0/1590300457 shutdown_connections 2024-09-21T06:46:09.349 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:09.345+0000 7f430397b640 1 -- 172.21.15.49:0/1590300457 wait complete. 2024-09-21T06:46:10.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:09 smithi049 ceph-mon[31177]: pgmap v610: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 32 op/s 2024-09-21T06:46:10.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:09 smithi049 ceph-mon[31177]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:46:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:09 smithi098 ceph-mon[34704]: pgmap v610: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 32 op/s 2024-09-21T06:46:10.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:09 smithi098 ceph-mon[34704]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:46:10.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:09 smithi079 ceph-mon[34346]: pgmap v610: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 78 KiB/s wr, 32 op/s 2024-09-21T06:46:10.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:09 smithi079 ceph-mon[34346]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:46:12.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:11 smithi049 ceph-mon[31177]: pgmap v612: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 81 KiB/s wr, 32 op/s 2024-09-21T06:46:12.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:11 smithi098 ceph-mon[34704]: pgmap v612: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 81 KiB/s wr, 32 op/s 2024-09-21T06:46:12.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:11 smithi079 ceph-mon[34346]: pgmap v612: 97 pgs: 97 active+clean; 10 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 81 KiB/s wr, 32 op/s 2024-09-21T06:46:14.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:13 smithi049 ceph-mon[31177]: pgmap v613: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 33 op/s 2024-09-21T06:46:14.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:13 smithi098 ceph-mon[34704]: pgmap v613: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 33 op/s 2024-09-21T06:46:14.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:13 smithi079 ceph-mon[34346]: pgmap v613: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 83 KiB/s wr, 33 op/s 2024-09-21T06:46:16.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:15 smithi049 ceph-mon[31177]: pgmap v614: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:46:16.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:15 smithi098 ceph-mon[34704]: pgmap v614: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:46:16.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:15 smithi079 ceph-mon[34346]: pgmap v614: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:46:18.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:17 smithi049 ceph-mon[31177]: pgmap v615: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:46:18.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:17 smithi098 ceph-mon[34704]: pgmap v615: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:46:18.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:17 smithi079 ceph-mon[34346]: pgmap v615: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:46:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:19 smithi049 ceph-mon[31177]: pgmap v616: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:46:19.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:19 smithi049 ceph-mon[31177]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:46:20.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:19 smithi098 ceph-mon[34704]: pgmap v616: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:46:20.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:19 smithi098 ceph-mon[34704]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:46:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:19 smithi079 ceph-mon[34346]: pgmap v616: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:46:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:19 smithi079 ceph-mon[34346]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:46:21.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:21 smithi049 ceph-mon[31177]: pgmap v618: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:46:22.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:21 smithi098 ceph-mon[34704]: pgmap v618: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:46:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:21 smithi079 ceph-mon[34346]: pgmap v618: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:46:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.458+0000 7f6079920640 1 -- 172.21.15.49:0/2638227634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 msgr2=0x7f6074104d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.458+0000 7f6079920640 1 --2- 172.21.15.49:0/2638227634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 0x7f6074104d30 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6064009900 tx=0x7f606402a410 comp rx=0 tx=0).stop 2024-09-21T06:46:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.459+0000 7f6079920640 1 -- 172.21.15.49:0/2638227634 shutdown_connections 2024-09-21T06:46:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.459+0000 7f6079920640 1 --2- 172.21.15.49:0/2638227634 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f607410dd80 0x7f6074110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.459+0000 7f6079920640 1 --2- 172.21.15.49:0/2638227634 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6074105270 0x7f607410d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.459+0000 7f6079920640 1 --2- 172.21.15.49:0/2638227634 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 0x7f6074104d30 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.459+0000 7f6079920640 1 -- 172.21.15.49:0/2638227634 >> 172.21.15.49:0/2638227634 conn(0x7f607407a710 msgr2=0x7f607407ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.459+0000 7f6079920640 1 -- 172.21.15.49:0/2638227634 shutdown_connections 2024-09-21T06:46:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.459+0000 7f6079920640 1 -- 172.21.15.49:0/2638227634 wait complete. 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.459+0000 7f6079920640 1 Processor -- start 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6079920640 1 -- start start 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6079920640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 0x7f607419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6079920640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6074105270 0x7f607419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6079920640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f607410dd80 0x7f607419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6079920640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f60741139e0 con 0x7f6074104920 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6079920640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6074113860 con 0x7f6074105270 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6079920640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6074113b60 con 0x7f607410dd80 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6072ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 0x7f607419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6072ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 0x7f607419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38076/0 (socket says 172.21.15.49:38076) 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6072ffd640 1 -- 172.21.15.49:0/2978233232 learned_addr learned my addr 172.21.15.49:0/2978233232 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f60727fc640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6074105270 0x7f607419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f60737fe640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f607410dd80 0x7f607419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6072ffd640 1 -- 172.21.15.49:0/2978233232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f607410dd80 msgr2=0x7f607419fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6072ffd640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f607410dd80 0x7f607419fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6072ffd640 1 -- 172.21.15.49:0/2978233232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6074105270 msgr2=0x7f607419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6072ffd640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6074105270 0x7f607419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.460+0000 7f6072ffd640 1 -- 172.21.15.49:0/2978233232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60741a0410 con 0x7f6074104920 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.461+0000 7f6072ffd640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 0x7f607419a4e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6064032fd0 tx=0x7f6064004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.461+0000 7f607891e640 1 -- 172.21.15.49:0/2978233232 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606403f030 con 0x7f6074104920 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.461+0000 7f6079920640 1 -- 172.21.15.49:0/2978233232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60741a06a0 con 0x7f6074104920 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.461+0000 7f607891e640 1 -- 172.21.15.49:0/2978233232 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6064004490 con 0x7f6074104920 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.461+0000 7f607891e640 1 -- 172.21.15.49:0/2978233232 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6064035070 con 0x7f6074104920 2024-09-21T06:46:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.461+0000 7f6079920640 1 -- 172.21.15.49:0/2978233232 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60741a6e90 con 0x7f6074104920 2024-09-21T06:46:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.463+0000 7f608088b740 1 Processor -- start 2024-09-21T06:46:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f608088b740 1 -- start start 2024-09-21T06:46:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f607891e640 1 -- 172.21.15.49:0/2978233232 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6064042030 con 0x7f6074104920 2024-09-21T06:46:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f608088b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0ecd11b0 0x562a0f0769b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f608088b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0eca82f0 0x562a0f076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f608088b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f077430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f608088b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562a0efeb6f0 con 0x562a0ecb04d0 2024-09-21T06:46:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f608088b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562a0efdab20 con 0x562a0eca82f0 2024-09-21T06:46:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f608088b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a0efde930 con 0x562a0ecd11b0 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f60727fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f077430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f60727fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f077430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38078/0 (socket says 172.21.15.49:38078) 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f60727fc640 1 -- 172.21.15.49:0/510552382 learned_addr learned my addr 172.21.15.49:0/510552382 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f6072ffd640 1 --2- 172.21.15.49:0/510552382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0eca82f0 0x562a0f076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f60737fe640 1 --2- 172.21.15.49:0/510552382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0ecd11b0 0x562a0f0769b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f60727fc640 1 -- 172.21.15.49:0/510552382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0ecd11b0 msgr2=0x562a0f0769b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f60727fc640 1 --2- 172.21.15.49:0/510552382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0ecd11b0 0x562a0f0769b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f60727fc640 1 -- 172.21.15.49:0/510552382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0eca82f0 msgr2=0x562a0f076ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f60727fc640 1 --2- 172.21.15.49:0/510552382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0eca82f0 0x562a0f076ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.464+0000 7f60727fc640 1 -- 172.21.15.49:0/510552382 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a0efa0530 con 0x562a0ecb04d0 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.465+0000 7f607891e640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f605c0b6680 0x7f605c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.465+0000 7f60727fc640 1 --2- 172.21.15.49:0/510552382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f077430 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f606800bc60 tx=0x7f60680107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539b66a1b071ab8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.465+0000 7f60737fe640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f605c0b6680 0x7f605c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.465+0000 7f6059ffb640 1 -- 172.21.15.49:0/510552382 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606801c680 con 0x562a0ecb04d0 2024-09-21T06:46:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.465+0000 7f607891e640 1 -- 172.21.15.49:0/2978233232 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f6064107cf0 con 0x7f6074104920 2024-09-21T06:46:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.465+0000 7f6059ffb640 1 -- 172.21.15.49:0/510552382 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f606800be10 con 0x562a0ecb04d0 2024-09-21T06:46:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.465+0000 7f6059ffb640 1 -- 172.21.15.49:0/510552382 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068011aa0 con 0x562a0ecb04d0 2024-09-21T06:46:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 -- 172.21.15.49:0/510552382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 msgr2=0x562a0f077430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 --2- 172.21.15.49:0/510552382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f077430 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f606800bc60 tx=0x7f60680107a0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f60737fe640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f605c0b6680 0x7f605c0b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f606c005fd0 tx=0x7f606c009760 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 -- 172.21.15.49:0/510552382 shutdown_connections 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 --2- 172.21.15.49:0/510552382 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f077430 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 --2- 172.21.15.49:0/510552382 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0eca82f0 0x562a0f076ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 --2- 172.21.15.49:0/510552382 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0ecd11b0 0x562a0f0769b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 -- 172.21.15.49:0/510552382 >> 172.21.15.49:0/510552382 conn(0x562a0ecc5300 msgr2=0x562a0f0748a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 -- 172.21.15.49:0/510552382 shutdown_connections 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 -- 172.21.15.49:0/510552382 wait complete. 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.466+0000 7f608088b740 1 -- start start 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f608088b740 1 Processor -- start 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f608088b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f0864b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f608088b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f0869f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f608088b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 0x562a0f092840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f608088b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562a0ef12ab0 con 0x562a0ecb04d0 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f608088b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562a0ef80730 con 0x562a0ecd11b0 2024-09-21T06:46:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f608088b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562a0f089510 con 0x562a0eca82f0 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f608088b740 10 client.0 _ll_register_callbacks cb 0x562a0efd46b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f60727fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f0869f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f60727fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f0869f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38094/0 (socket says 172.21.15.49:38094) 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f60727fc640 1 -- 172.21.15.49:0/1213155926 learned_addr learned my addr 172.21.15.49:0/1213155926 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f6072ffd640 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f0864b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f60737fe640 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 0x562a0f092840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f60727fc640 1 -- 172.21.15.49:0/1213155926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 msgr2=0x562a0f0864b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f60727fc640 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f0864b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f60727fc640 1 -- 172.21.15.49:0/1213155926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 msgr2=0x562a0f092840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f60727fc640 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 0x562a0f092840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f60727fc640 1 -- 172.21.15.49:0/1213155926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a0ed3c790 con 0x562a0ecb04d0 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f60737fe640 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 0x562a0f092840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.467+0000 7f6072ffd640 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f0864b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f60727fc640 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f0869f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f6068011010 tx=0x7f6068005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cf1938f5c6df60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f6052ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f6052ffd640 1 -- 172.21.15.49:0/1213155926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606802a060 con 0x562a0ecb04d0 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f608088b740 1 -- 172.21.15.49:0/1213155926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f606800be10 con 0x562a0ecb04d0 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f6052ffd640 1 -- 172.21.15.49:0/1213155926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f6068011a20 con 0x562a0ecb04d0 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f6052ffd640 1 -- 172.21.15.49:0/1213155926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6068011c20 con 0x562a0ecb04d0 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f608088b740 10 client.17847 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f608088b740 1 -- 172.21.15.49:0/1213155926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562a0edb5620 con 0x562a0ecb04d0 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.468+0000 7f6052ffd640 1 -- 172.21.15.49:0/1213155926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f606800be10 con 0x562a0ecb04d0 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f6052ffd640 1 -- 172.21.15.49:0/1213155926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6068024030 con 0x562a0ecb04d0 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f608088b740 10 client.17847 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f608088b740 10 client.17847 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f608088b740 20 client.17847 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f608088b740 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a0ec8fd80 0x562a0f0984b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f608088b740 4 client.17847 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f608088b740 1 -- 172.21.15.49:0/1213155926 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a0efed640 con 0x562a0ec8fd80 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f6072ffd640 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a0ec8fd80 0x562a0f0984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f6052ffd640 10 client.17847 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.469+0000 7f6072ffd640 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a0ec8fd80 0x562a0f0984b0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0bf1b584240aec server_cookie=bc58d843685bdc66 in_seq=0 out_seq=0 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.470+0000 7f6052ffd640 1 -- 172.21.15.49:0/1213155926 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562a0efed640 con 0x562a0ec8fd80 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.470+0000 7f6052ffd640 10 client.17847 handle_command_reply: tid=0 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.470+0000 7f608088b740 1 client.17847 shutdown 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.470+0000 7f608088b740 1 -- 172.21.15.49:0/1213155926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 msgr2=0x562a0f0869f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.470+0000 7f608088b740 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f0869f0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f6068011010 tx=0x7f6068005270 comp rx=0 tx=0).stop 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f608088b740 1 -- 172.21.15.49:0/1213155926 shutdown_connections 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f608088b740 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a0ec8fd80 0x562a0f0984b0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f608088b740 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 0x562a0f092840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f608088b740 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f0869f0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f608088b740 1 --2- 172.21.15.49:0/1213155926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f0864b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f6052ffd640 0 client.17847 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f608088b740 1 -- 172.21.15.49:0/1213155926 >> 172.21.15.49:0/1213155926 conn(0x562a0ecc5300 msgr2=0x562a0f079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f608088b740 1 -- 172.21.15.49:0/1213155926 shutdown_connections 2024-09-21T06:46:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f608088b740 1 -- 172.21.15.49:0/1213155926 wait complete. 2024-09-21T06:46:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.471+0000 7f608088b740 20 client.17847 trim_cache size 0 max 16384 2024-09-21T06:46:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.485+0000 7f608088b740 1 Processor -- start 2024-09-21T06:46:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f608088b740 1 -- start start 2024-09-21T06:46:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f608088b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f079ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.488 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f608088b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecb04d0 0x562a0f07a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f608088b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecd11b0 0x562a0f083680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f608088b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f60741aff80 con 0x562a0ecd11b0 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f608088b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60741ad850 con 0x562a0ecb04d0 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f608088b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f60741ab6c0 con 0x562a0eca82f0 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f60737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecd11b0 0x562a0f083680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f60737fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecd11b0 0x562a0f083680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38102/0 (socket says 172.21.15.49:38102) 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f60737fe640 1 -- 172.21.15.49:0/2533359668 learned_addr learned my addr 172.21.15.49:0/2533359668 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f6072ffd640 1 --2- 172.21.15.49:0/2533359668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f079ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f60727fc640 1 --2- 172.21.15.49:0/2533359668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecb04d0 0x562a0f07a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f60737fe640 1 -- 172.21.15.49:0/2533359668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 msgr2=0x562a0f079ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f60737fe640 1 --2- 172.21.15.49:0/2533359668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f079ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f60737fe640 1 -- 172.21.15.49:0/2533359668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecb04d0 msgr2=0x562a0f07a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:22.489 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f60737fe640 1 --2- 172.21.15.49:0/2533359668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecb04d0 0x562a0f07a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.486+0000 7f60737fe640 1 -- 172.21.15.49:0/2533359668 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a0f07aa30 con 0x562a0ecd11b0 2024-09-21T06:46:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.487+0000 7f60737fe640 1 --2- 172.21.15.49:0/2533359668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecd11b0 0x562a0f083680 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f606c010840 tx=0x7f606c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba9d2abe5e547bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.487+0000 7f60597fa640 1 -- 172.21.15.49:0/2533359668 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c02a070 con 0x562a0ecd11b0 2024-09-21T06:46:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.487+0000 7f60597fa640 1 -- 172.21.15.49:0/2533359668 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f606c003e20 con 0x562a0ecd11b0 2024-09-21T06:46:22.490 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.487+0000 7f60597fa640 1 -- 172.21.15.49:0/2533359668 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606c004290 con 0x562a0ecd11b0 2024-09-21T06:46:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.487+0000 7f608088b740 1 -- 172.21.15.49:0/2533359668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecd11b0 msgr2=0x562a0f083680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.487+0000 7f608088b740 1 --2- 172.21.15.49:0/2533359668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecd11b0 0x562a0f083680 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f606c010840 tx=0x7f606c015000 comp rx=0 tx=0).stop 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.487+0000 7f608088b740 1 -- 172.21.15.49:0/2533359668 shutdown_connections 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.487+0000 7f608088b740 1 --2- 172.21.15.49:0/2533359668 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecd11b0 0x562a0f083680 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 --2- 172.21.15.49:0/2533359668 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecb04d0 0x562a0f07a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 --2- 172.21.15.49:0/2533359668 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f079ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 -- 172.21.15.49:0/2533359668 >> 172.21.15.49:0/2533359668 conn(0x562a0ecc5300 msgr2=0x562a0f084d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 -- 172.21.15.49:0/2533359668 shutdown_connections 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 -- 172.21.15.49:0/2533359668 wait complete. 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 -- start start 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 Processor -- start 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f08ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f08a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 0x562a0f08a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f60741abd10 con 0x562a0ecb04d0 2024-09-21T06:46:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.488+0000 7f608088b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f60741ad180 con 0x562a0ecd11b0 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f608088b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f60741ac3e0 con 0x562a0eca82f0 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f608088b740 10 client.0 _ll_register_callbacks cb 0x7f606410b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60727fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f08a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60727fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f08a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38110/0 (socket says 172.21.15.49:38110) 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60727fc640 1 -- 172.21.15.49:0/3858657054 learned_addr learned my addr 172.21.15.49:0/3858657054 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f6072ffd640 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f08ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60737fe640 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 0x562a0f08a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60727fc640 1 -- 172.21.15.49:0/3858657054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 msgr2=0x562a0f08ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60727fc640 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f08ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60727fc640 1 -- 172.21.15.49:0/3858657054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 msgr2=0x562a0f08a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60727fc640 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 0x562a0f08a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.495 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60727fc640 1 -- 172.21.15.49:0/3858657054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a0f08ab90 con 0x562a0ecb04d0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f60727fc640 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f08a110 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6068011010 tx=0x7f606800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2461b16a8260f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f6052ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f6052ffd640 1 -- 172.21.15.49:0/3858657054 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f606802a040 con 0x562a0ecb04d0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f6052ffd640 1 -- 172.21.15.49:0/3858657054 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f606801cbb0 con 0x562a0ecb04d0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.489+0000 7f608088b740 1 -- 172.21.15.49:0/3858657054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f606c003e20 con 0x562a0ecb04d0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f6052ffd640 1 -- 172.21.15.49:0/3858657054 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f606801cdb0 con 0x562a0ecb04d0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f608088b740 10 client.17853 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f608088b740 1 -- 172.21.15.49:0/3858657054 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562a0f1028e0 con 0x562a0ecb04d0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f6052ffd640 1 -- 172.21.15.49:0/3858657054 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f606c003e20 con 0x562a0ecb04d0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f6052ffd640 1 -- 172.21.15.49:0/3858657054 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6068034020 con 0x562a0ecb04d0 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f608088b740 10 client.17853 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f608088b740 10 client.17853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:22.496 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f608088b740 20 client.17853 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f608088b740 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a0ec651c0 0x562a0f105040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f608088b740 4 client.17853 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:46:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f608088b740 1 -- 172.21.15.49:0/3858657054 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a0efe90f0 con 0x562a0ec651c0 2024-09-21T06:46:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.490+0000 7f6072ffd640 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a0ec651c0 0x562a0f105040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.491+0000 7f6072ffd640 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a0ec651c0 0x562a0f105040 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d15c969ae5de68a server_cookie=520cc62b411ae5d6 in_seq=0 out_seq=0 2024-09-21T06:46:22.497 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.491+0000 7f6052ffd640 10 client.17853 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f6052ffd640 1 -- 172.21.15.49:0/3858657054 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a0efe90f0 con 0x562a0ec651c0 2024-09-21T06:46:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f6052ffd640 10 client.17853 handle_command_reply: tid=0 2024-09-21T06:46:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f608088b740 1 client.17853 shutdown 2024-09-21T06:46:22.500 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f608088b740 1 -- 172.21.15.49:0/3858657054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 msgr2=0x562a0f08a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f608088b740 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f08a110 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6068011010 tx=0x7f606800b390 comp rx=0 tx=0).stop 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f608088b740 1 -- 172.21.15.49:0/3858657054 shutdown_connections 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f608088b740 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562a0ec651c0 0x562a0f105040 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f608088b740 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562a0ecd11b0 0x562a0f08a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f608088b740 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562a0ecb04d0 0x562a0f08a110 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f608088b740 1 --2- 172.21.15.49:0/3858657054 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562a0eca82f0 0x562a0f08ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.498+0000 7f6052ffd640 0 client.17853 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f608088b740 1 -- 172.21.15.49:0/3858657054 >> 172.21.15.49:0/3858657054 conn(0x562a0ecc5300 msgr2=0x562a0f079ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f608088b740 1 -- 172.21.15.49:0/3858657054 shutdown_connections 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f608088b740 1 -- 172.21.15.49:0/3858657054 wait complete. 2024-09-21T06:46:22.501 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f608088b740 20 client.17853 trim_cache size 0 max 16384 2024-09-21T06:46:22.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:46:22.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:46:22.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:46:22.502 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 -- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f605c0b6680 msgr2=0x7f605c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f605c0b6680 0x7f605c0b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f606c005fd0 tx=0x7f606c009760 comp rx=0 tx=0).stop 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 -- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 msgr2=0x7f607419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 0x7f607419a4e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6064032fd0 tx=0x7f6064004270 comp rx=0 tx=0).stop 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 -- 172.21.15.49:0/2978233232 shutdown_connections 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f605c0b6680 0x7f605c0b8b90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f607410dd80 0x7f607419fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6074105270 0x7f607419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 --2- 172.21.15.49:0/2978233232 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6074104920 0x7f607419a4e0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 -- 172.21.15.49:0/2978233232 >> 172.21.15.49:0/2978233232 conn(0x7f607407a710 msgr2=0x7f6074100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 -- 172.21.15.49:0/2978233232 shutdown_connections 2024-09-21T06:46:22.503 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:22.499+0000 7f6079920640 1 -- 172.21.15.49:0/2978233232 wait complete. 2024-09-21T06:46:23.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:23 smithi049 ceph-mon[31177]: pgmap v619: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:46:24.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:23 smithi098 ceph-mon[34704]: pgmap v619: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:46:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:23 smithi079 ceph-mon[34346]: pgmap v619: 97 pgs: 97 active+clean; 10 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 KiB/s wr, 11 op/s 2024-09-21T06:46:24.881 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:46:25.156 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:25.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.690+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/2526696373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d74102a60 msgr2=0x7f5d74102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.690+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/2526696373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d74102a60 0x7f5d74102e70 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009900 tx=0x7f5d7002a410 comp rx=0 tx=0).stop 2024-09-21T06:46:25.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.690+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/2526696373 shutdown_connections 2024-09-21T06:46:25.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.690+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/2526696373 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d74108cf0 0x7f5d7410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.690+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/2526696373 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d741083a0 0x7f5d741087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.703 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.690+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/2526696373 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d74102a60 0x7f5d74102e70 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.690+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/2526696373 >> 172.21.15.49:0/2526696373 conn(0x7f5d74079730 msgr2=0x7f5d74079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.690+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/2526696373 shutdown_connections 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.690+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/2526696373 wait complete. 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d7c7d1640 1 Processor -- start 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d7c7d1640 1 -- start start 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d7c7d1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d74102a60 0x7f5d7419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d7c7d1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d741083a0 0x7f5d7419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d7c7d1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d74108cf0 0x7f5d7419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d7c7d1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74112960 con 0x7f5d741083a0 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d7c7d1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d741127e0 con 0x7f5d74102a60 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d7c7d1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74112ae0 con 0x7f5d74108cf0 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d79d6c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d741083a0 0x7f5d7419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.704 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d79d6c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d741083a0 0x7f5d7419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38126/0 (socket says 172.21.15.49:38126) 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d79d6c640 1 -- 172.21.15.49:0/1595303084 learned_addr learned my addr 172.21.15.49:0/1595303084 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.691+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d74102a60 0x7f5d7419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d74108cf0 0x7f5d7419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d79d6c640 1 -- 172.21.15.49:0/1595303084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d74108cf0 msgr2=0x7f5d7419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d74108cf0 0x7f5d7419bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d79d6c640 1 -- 172.21.15.49:0/1595303084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d74102a60 msgr2=0x7f5d7419b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d74102a60 0x7f5d7419b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d79d6c640 1 -- 172.21.15.49:0/1595303084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d741a6530 con 0x7f5d741083a0 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d741083a0 0x7f5d7419b7b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400d770 tx=0x7f5d6400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d6b7fe640 1 -- 172.21.15.49:0/1595303084 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64017070 con 0x7f5d741083a0 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/1595303084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d741a6820 con 0x7f5d741083a0 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d6b7fe640 1 -- 172.21.15.49:0/1595303084 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d64009c30 con 0x7f5d741083a0 2024-09-21T06:46:25.705 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d6b7fe640 1 -- 172.21.15.49:0/1595303084 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400f620 con 0x7f5d741083a0 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.692+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/1595303084 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d741a6d60 con 0x7f5d741083a0 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d82d45740 1 Processor -- start 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d82d45740 1 -- start start 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea6c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea6c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 0x55621ea6ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d82d45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55621e9e2e50 con 0x55621e6c5070 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d82d45740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55621e9d2280 con 0x55621e69c1b0 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d82d45740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55621e9d6090 con 0x55621e6a4390 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d6b7fe640 1 -- 172.21.15.49:0/1595303084 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5d6401a070 con 0x7f5d741083a0 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d7ad6e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea6c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d7ad6e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea6c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38138/0 (socket says 172.21.15.49:38138) 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.695+0000 7f5d7ad6e640 1 -- 172.21.15.49:0/3389502145 learned_addr learned my addr 172.21.15.49:0/3389502145 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:25.706 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea6c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 0x55621ea6ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d7ad6e640 1 -- 172.21.15.49:0/3389502145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 msgr2=0x55621ea6ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 0x55621ea6ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d7ad6e640 1 -- 172.21.15.49:0/3389502145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 msgr2=0x55621ea6c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea6c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d7ad6e640 1 -- 172.21.15.49:0/3389502145 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621e730650 con 0x55621e6c5070 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea6c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea6c270 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c008df0 tx=0x7f5d6c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ec8c0a580da7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.696+0000 7f5d68ff9640 1 -- 172.21.15.49:0/3389502145 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c014070 con 0x55621e6c5070 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.697+0000 7f5d68ff9640 1 -- 172.21.15.49:0/3389502145 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d6c003b70 con 0x55621e6c5070 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.697+0000 7f5d68ff9640 1 -- 172.21.15.49:0/3389502145 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c010720 con 0x55621e6c5070 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.697+0000 7f5d6b7fe640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d600b6680 0x7f5d600b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.697+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d600b6680 0x7f5d600b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.707 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.697+0000 7f5d6b7fe640 1 -- 172.21.15.49:0/1595303084 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f5d640e7340 con 0x7f5d741083a0 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 -- 172.21.15.49:0/3389502145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 msgr2=0x55621ea6c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea6c270 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c008df0 tx=0x7f5d6c00e720 comp rx=0 tx=0).stop 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d600b6680 0x7f5d600b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d70000c00 tx=0x7f5d70009640 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 -- 172.21.15.49:0/3389502145 shutdown_connections 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 0x55621ea6ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea6c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 --2- 172.21.15.49:0/3389502145 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea6c270 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 -- 172.21.15.49:0/3389502145 >> 172.21.15.49:0/3389502145 conn(0x55621e6b9460 msgr2=0x55621ea6a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 -- 172.21.15.49:0/3389502145 shutdown_connections 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 -- 172.21.15.49:0/3389502145 wait complete. 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.698+0000 7f5d82d45740 1 -- start start 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d82d45740 1 Processor -- start 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e69c1b0 0x55621ea7bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.708 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6a4390 0x55621ea7c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6c5070 0x55621ea7c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d82d45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55621e833700 con 0x55621e6a4390 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d82d45740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55621e96d110 con 0x55621e6c5070 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d82d45740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55621ea7ed80 con 0x55621e69c1b0 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d82d45740 10 client.0 _ll_register_callbacks cb 0x55621e986990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d79d6c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6a4390 0x55621ea7c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d79d6c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6a4390 0x55621ea7c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38154/0 (socket says 172.21.15.49:38154) 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d7a56d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e69c1b0 0x55621ea7bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d79d6c640 1 -- 172.21.15.49:0/1366010638 learned_addr learned my addr 172.21.15.49:0/1366010638 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.699+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6c5070 0x55621ea7c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.700+0000 7f5d79d6c640 1 -- 172.21.15.49:0/1366010638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e69c1b0 msgr2=0x55621ea7bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.700+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e69c1b0 0x55621ea7bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.700+0000 7f5d79d6c640 1 -- 172.21.15.49:0/1366010638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6c5070 msgr2=0x55621ea7c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.700+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6c5070 0x55621ea7c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.709 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.700+0000 7f5d79d6c640 1 -- 172.21.15.49:0/1366010638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621e99ac40 con 0x55621e6a4390 2024-09-21T06:46:25.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.700+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6c5070 0x55621ea7c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:25.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.700+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e69c1b0 0x55621ea7bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:25.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.700+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6a4390 0x55621ea7c1d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5d640aa3b0 tx=0x7f5d64005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27517ad48f68ea8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.710 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.700+0000 7f5d5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:25.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.702+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1366010638 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d64021070 con 0x55621e6a4390 2024-09-21T06:46:25.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.702+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1366010638 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f5d640a8c90 con 0x55621e6a4390 2024-09-21T06:46:25.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.702+0000 7f5d82d45740 1 -- 172.21.15.49:0/1366010638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d6c003b70 con 0x55621e6a4390 2024-09-21T06:46:25.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1366010638 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d640a8fe0 con 0x55621e6a4390 2024-09-21T06:46:25.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d82d45740 10 client.17865 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:25.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d82d45740 1 -- 172.21.15.49:0/1366010638 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55621ea8aa70 con 0x55621e6a4390 2024-09-21T06:46:25.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1366010638 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d6c003b70 con 0x55621e6a4390 2024-09-21T06:46:25.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1366010638 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5d640abe10 con 0x55621e6a4390 2024-09-21T06:46:25.712 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d82d45740 10 client.17865 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d82d45740 10 client.17865 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d82d45740 20 client.17865 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55621e6839f0 0x55621ea8df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d82d45740 4 client.17865 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.703+0000 7f5d82d45740 1 -- 172.21.15.49:0/1366010638 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55621e9e4da0 con 0x55621e6839f0 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.704+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55621e6839f0 0x55621ea8df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.704+0000 7f5d5dffb640 10 client.17865 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.704+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55621e6839f0 0x55621ea8df90 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c373739c138b9811 server_cookie=da80603cda5e7940 in_seq=0 out_seq=0 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1366010638 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55621e9e4da0 con 0x55621e6839f0 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d5dffb640 10 client.17865 handle_command_reply: tid=0 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 client.17865 shutdown 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 -- 172.21.15.49:0/1366010638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6a4390 msgr2=0x55621ea7c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6a4390 0x55621ea7c1d0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5d640aa3b0 tx=0x7f5d64005810 comp rx=0 tx=0).stop 2024-09-21T06:46:25.713 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 -- 172.21.15.49:0/1366010638 shutdown_connections 2024-09-21T06:46:25.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55621e6839f0 0x55621ea8df90 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6c5070 0x55621ea7c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6a4390 0x55621ea7c1d0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1366010638 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e69c1b0 0x55621ea7bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d5dffb640 0 client.17865 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:25.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 -- 172.21.15.49:0/1366010638 >> 172.21.15.49:0/1366010638 conn(0x55621e6b9460 msgr2=0x55621ea6f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 -- 172.21.15.49:0/1366010638 shutdown_connections 2024-09-21T06:46:25.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 1 -- 172.21.15.49:0/1366010638 wait complete. 2024-09-21T06:46:25.714 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.705+0000 7f5d82d45740 20 client.17865 trim_cache size 0 max 16384 2024-09-21T06:46:25.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.723+0000 7f5d82d45740 1 Processor -- start 2024-09-21T06:46:25.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.723+0000 7f5d82d45740 1 -- start start 2024-09-21T06:46:25.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.723+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea77440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.723+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 0x55621ea7d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.723+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea78e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.723+0000 7f5d82d45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d741afff0 con 0x55621e6c5070 2024-09-21T06:46:25.725 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.723+0000 7f5d82d45740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d741ad8c0 con 0x55621e69c1b0 2024-09-21T06:46:25.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.723+0000 7f5d82d45740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d741ab750 con 0x55621e6a4390 2024-09-21T06:46:25.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7ad6e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea78e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7ad6e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea78e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38162/0 (socket says 172.21.15.49:38162) 2024-09-21T06:46:25.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7ad6e640 1 -- 172.21.15.49:0/1533734902 learned_addr learned my addr 172.21.15.49:0/1533734902 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:25.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 0x55621ea7d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea77440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.726 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7ad6e640 1 -- 172.21.15.49:0/1533734902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 msgr2=0x55621ea7d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 0x55621ea7d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7ad6e640 1 -- 172.21.15.49:0/1533734902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 msgr2=0x55621ea77440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea77440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7ad6e640 1 -- 172.21.15.49:0/1533734902 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621ea87fe0 con 0x55621e6c5070 2024-09-21T06:46:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea77440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea78e80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c017000 tx=0x7f5d6c008a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613e8db71e9e9d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.724+0000 7f5d5ffff640 1 -- 172.21.15.49:0/1533734902 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c014070 con 0x55621e6c5070 2024-09-21T06:46:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.725+0000 7f5d5ffff640 1 -- 172.21.15.49:0/1533734902 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d6c003e20 con 0x55621e6c5070 2024-09-21T06:46:25.727 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.725+0000 7f5d5ffff640 1 -- 172.21.15.49:0/1533734902 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0047b0 con 0x55621e6c5070 2024-09-21T06:46:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 -- 172.21.15.49:0/1533734902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 msgr2=0x55621ea78e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea78e80 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c017000 tx=0x7f5d6c008a60 comp rx=0 tx=0).stop 2024-09-21T06:46:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 -- 172.21.15.49:0/1533734902 shutdown_connections 2024-09-21T06:46:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e6c5070 0x55621ea78e80 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6a4390 0x55621ea7d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1533734902 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e69c1b0 0x55621ea77440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.729 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 -- 172.21.15.49:0/1533734902 >> 172.21.15.49:0/1533734902 conn(0x55621e6b9460 msgr2=0x55621ea7d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 -- 172.21.15.49:0/1533734902 shutdown_connections 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 -- 172.21.15.49:0/1533734902 wait complete. 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 -- start start 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.726+0000 7f5d82d45740 1 Processor -- start 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e69c1b0 0x55621ea84570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6a4390 0x55621ea7fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d82d45740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6c5070 0x55621ea7ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d82d45740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5d741abda0 con 0x55621e69c1b0 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d82d45740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5d741ad1f0 con 0x55621e6a4390 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d82d45740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5d741ac450 con 0x55621e6c5070 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d82d45740 10 client.0 _ll_register_callbacks cb 0x7f5d640eaf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d7a56d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e69c1b0 0x55621ea84570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d7a56d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e69c1b0 0x55621ea84570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:38176/0 (socket says 172.21.15.49:38176) 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d7a56d640 1 -- 172.21.15.49:0/1069963237 learned_addr learned my addr 172.21.15.49:0/1069963237 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:25.730 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d7ad6e640 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6c5070 0x55621ea7ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6a4390 0x55621ea7fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d7a56d640 1 -- 172.21.15.49:0/1069963237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6c5070 msgr2=0x55621ea7ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6c5070 0x55621ea7ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d7a56d640 1 -- 172.21.15.49:0/1069963237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6a4390 msgr2=0x55621ea7fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6a4390 0x55621ea7fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.727+0000 7f5d7a56d640 1 -- 172.21.15.49:0/1069963237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621ea804a0 con 0x55621e69c1b0 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d7a56d640 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e69c1b0 0x55621ea84570 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009900 tx=0x7f5d70009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551b03dd6ccb162 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1069963237 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70035040 con 0x55621e69c1b0 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1069963237 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f5d70005450 con 0x55621e69c1b0 2024-09-21T06:46:25.731 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d82d45740 1 -- 172.21.15.49:0/1069963237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d6c003e20 con 0x55621e69c1b0 2024-09-21T06:46:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1069963237 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5d70005650 con 0x55621e69c1b0 2024-09-21T06:46:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d82d45740 10 client.17871 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d82d45740 1 -- 172.21.15.49:0/1069963237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55621eaf8680 con 0x55621e69c1b0 2024-09-21T06:46:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1069963237 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d6c003e20 con 0x55621e69c1b0 2024-09-21T06:46:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1069963237 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5d70003a30 con 0x55621e69c1b0 2024-09-21T06:46:25.733 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d82d45740 10 client.17871 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d82d45740 10 client.17871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d82d45740 20 client.17871 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.728+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55621e658da0 0x55621eafaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.729+0000 7f5d82d45740 4 client.17871 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.729+0000 7f5d82d45740 1 -- 172.21.15.49:0/1069963237 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55621e9e0850 con 0x55621e658da0 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.729+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55621e658da0 0x55621eafaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.729+0000 7f5d79d6c640 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55621e658da0 0x55621eafaef0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c3e4a18a9edabdb server_cookie=230b210d5321dc00 in_seq=0 out_seq=0 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.729+0000 7f5d5dffb640 10 client.17871 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d5dffb640 1 -- 172.21.15.49:0/1069963237 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x55621e9e0850 con 0x55621e658da0 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d5dffb640 10 client.17871 handle_command_reply: tid=0 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 client.17871 shutdown 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 -- 172.21.15.49:0/1069963237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e69c1b0 msgr2=0x55621ea84570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e69c1b0 0x55621ea84570 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009900 tx=0x7f5d70009260 comp rx=0 tx=0).stop 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 -- 172.21.15.49:0/1069963237 shutdown_connections 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55621e658da0 0x55621eafaef0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55621e6c5070 0x55621ea7ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55621e6a4390 0x55621ea7fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 --2- 172.21.15.49:0/1069963237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55621e69c1b0 0x55621ea84570 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d5dffb640 0 client.17871 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 -- 172.21.15.49:0/1069963237 >> 172.21.15.49:0/1069963237 conn(0x55621e6b9460 msgr2=0x55621ea7d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 -- 172.21.15.49:0/1069963237 shutdown_connections 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 1 -- 172.21.15.49:0/1069963237 wait complete. 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.730+0000 7f5d82d45740 20 client.17871 trim_cache size 0 max 16384 2024-09-21T06:46:25.735 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "f56024cf-a906-4d93-89e9-d1f90cea5480": { 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:52.601552+0000", 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:46:25.736 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.737 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.738 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.739 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.740 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "877238a7-c1a9-416c-8f9e-d40ecea3c71a": { 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:10.755554+0000", 2024-09-21T06:46:25.741 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:46:25.742 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.743 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:46:25.744 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:46:25.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d600b6680 msgr2=0x7f5d600b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d600b6680 0x7f5d600b8b90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d70000c00 tx=0x7f5d70009640 comp rx=0 tx=0).stop 2024-09-21T06:46:25.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d741083a0 msgr2=0x7f5d7419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d741083a0 0x7f5d7419b7b0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400d770 tx=0x7f5d6400dc30 comp rx=0 tx=0).stop 2024-09-21T06:46:25.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/1595303084 shutdown_connections 2024-09-21T06:46:25.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5d600b6680 0x7f5d600b8b90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5d74108cf0 0x7f5d7419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5d741083a0 0x7f5d7419b7b0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 --2- 172.21.15.49:0/1595303084 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5d74102a60 0x7f5d7419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/1595303084 >> 172.21.15.49:0/1595303084 conn(0x7f5d74079730 msgr2=0x7f5d741014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/1595303084 shutdown_connections 2024-09-21T06:46:25.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:25.731+0000 7f5d7c7d1640 1 -- 172.21.15.49:0/1595303084 wait complete. 2024-09-21T06:46:25.886 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:25 smithi049 ceph-mon[31177]: pgmap v620: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-21T06:46:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:25 smithi098 ceph-mon[34704]: pgmap v620: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-21T06:46:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:25 smithi079 ceph-mon[34346]: pgmap v620: 97 pgs: 97 active+clean; 10 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 KiB/s wr, 11 op/s 2024-09-21T06:46:26.493 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:46:26.494 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:46:26.757 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:27.204 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.202+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3757357603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4010de10 msgr2=0x7f4f40110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.202+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3757357603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4010de10 0x7f4f40110300 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f4f38009ca0 tx=0x7f4f3802a8e0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.202+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3757357603 shutdown_connections 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.202+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3757357603 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f4010de10 0x7f4f40110300 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.202+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3757357603 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f40105300 0x7f4f4010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.202+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3757357603 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f401049b0 0x7f4f40104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.202+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3757357603 >> 172.21.15.49:0/3757357603 conn(0x7f4f40079730 msgr2=0x7f4f40079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.202+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3757357603 shutdown_connections 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.202+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3757357603 wait complete. 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.203+0000 7f4f47dbc640 1 Processor -- start 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.203+0000 7f4f47dbc640 1 -- start start 2024-09-21T06:46:27.205 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.203+0000 7f4f47dbc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f401049b0 0x7f4f4019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:27.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.203+0000 7f4f47dbc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f40105300 0x7f4f4019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:27.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.203+0000 7f4f47dbc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4010de10 0x7f4f4019fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:27.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.203+0000 7f4f47dbc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4f40113b70 con 0x7f4f40105300 2024-09-21T06:46:27.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.203+0000 7f4f47dbc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4f401139f0 con 0x7f4f401049b0 2024-09-21T06:46:27.206 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.203+0000 7f4f47dbc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4f40113cf0 con 0x7f4f4010de10 2024-09-21T06:46:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.203+0000 7f4f45357640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f40105300 0x7f4f4019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f45357640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f40105300 0x7f4f4019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57844/0 (socket says 172.21.15.49:57844) 2024-09-21T06:46:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f45357640 1 -- 172.21.15.49:0/3518218673 learned_addr learned my addr 172.21.15.49:0/3518218673 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f45b58640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f401049b0 0x7f4f4019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f46359640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4010de10 0x7f4f4019fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f45357640 1 -- 172.21.15.49:0/3518218673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4010de10 msgr2=0x7f4f4019fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f45357640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4010de10 0x7f4f4019fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f45357640 1 -- 172.21.15.49:0/3518218673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f401049b0 msgr2=0x7f4f4019a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f45357640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f401049b0 0x7f4f4019a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f45357640 1 -- 172.21.15.49:0/3518218673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f401a05d0 con 0x7f4f40105300 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f45357640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f40105300 0x7f4f4019ac00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4f30006fd0 tx=0x7f4f3000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f36ffd640 1 -- 172.21.15.49:0/3518218673 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f30015020 con 0x7f4f40105300 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f36ffd640 1 -- 172.21.15.49:0/3518218673 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f30011ce0 con 0x7f4f40105300 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f36ffd640 1 -- 172.21.15.49:0/3518218673 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f30010d90 con 0x7f4f40105300 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f401a08c0 con 0x7f4f40105300 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.204+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f401a7020 con 0x7f4f40105300 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.206+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f40104e40 con 0x7f4f40105300 2024-09-21T06:46:27.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.207+0000 7f4f36ffd640 1 -- 172.21.15.49:0/3518218673 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f4f30018020 con 0x7f4f40105300 2024-09-21T06:46:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.208+0000 7f4f36ffd640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4f2c0b6700 0x7f4f2c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:27.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.208+0000 7f4f45b58640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4f2c0b6700 0x7f4f2c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.208+0000 7f4f36ffd640 1 -- 172.21.15.49:0/3518218673 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f4f300e7400 con 0x7f4f40105300 2024-09-21T06:46:27.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.208+0000 7f4f45b58640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4f2c0b6700 0x7f4f2c0b8c10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4f4006bc60 tx=0x7f4f3c009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:27.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.211+0000 7f4f36ffd640 1 -- 172.21.15.49:0/3518218673 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f3001f020 con 0x7f4f40105300 2024-09-21T06:46:27.438 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.437+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f4019b790 con 0x7f4f40105300 2024-09-21T06:46:27.439 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.437+0000 7f4f36ffd640 1 -- 172.21.15.49:0/3518218673 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f4f4019b790 con 0x7f4f40105300 2024-09-21T06:46:27.439 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:46:27.439 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:46:27.439 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:46:27.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4f2c0b6700 msgr2=0x7f4f2c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4f2c0b6700 0x7f4f2c0b8c10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4f4006bc60 tx=0x7f4f3c009110 comp rx=0 tx=0).stop 2024-09-21T06:46:27.441 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f40105300 msgr2=0x7f4f4019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f40105300 0x7f4f4019ac00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4f30006fd0 tx=0x7f4f3000b820 comp rx=0 tx=0).stop 2024-09-21T06:46:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 shutdown_connections 2024-09-21T06:46:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f4f2c0b6700 0x7f4f2c0b8c10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4f4010de10 0x7f4f4019fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f4f40105300 0x7f4f4019ac00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 --2- 172.21.15.49:0/3518218673 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f4f401049b0 0x7f4f4019a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 >> 172.21.15.49:0/3518218673 conn(0x7f4f40079730 msgr2=0x7f4f400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 shutdown_connections 2024-09-21T06:46:27.442 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:27.440+0000 7f4f47dbc640 1 -- 172.21.15.49:0/3518218673 wait complete. 2024-09-21T06:46:27.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:27 smithi049 ceph-mon[31177]: pgmap v621: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T06:46:27.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:27 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3518218673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:28.046 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:46:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:27 smithi098 ceph-mon[34704]: pgmap v621: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T06:46:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:27 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3518218673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:27 smithi079 ceph-mon[34346]: pgmap v621: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T06:46:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:27 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3518218673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:28.310 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:28.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.743+0000 7f265b895640 1 -- 172.21.15.49:0/662937206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 msgr2=0x7f2654075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.743+0000 7f265b895640 1 --2- 172.21.15.49:0/662937206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 0x7f2654075b40 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f2650009900 tx=0x7f265002a410 comp rx=0 tx=0).stop 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.743+0000 7f265b895640 1 -- 172.21.15.49:0/662937206 shutdown_connections 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.743+0000 7f265b895640 1 --2- 172.21.15.49:0/662937206 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2654110140 0x7f2654112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.743+0000 7f265b895640 1 --2- 172.21.15.49:0/662937206 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654076080 0x7f265410fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.743+0000 7f265b895640 1 --2- 172.21.15.49:0/662937206 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 0x7f2654075b40 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.743+0000 7f265b895640 1 -- 172.21.15.49:0/662937206 >> 172.21.15.49:0/662937206 conn(0x7f265407b850 msgr2=0x7f265407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.744+0000 7f265b895640 1 -- 172.21.15.49:0/662937206 shutdown_connections 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.744+0000 7f265b895640 1 -- 172.21.15.49:0/662937206 wait complete. 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.744+0000 7f265b895640 1 Processor -- start 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.744+0000 7f265b895640 1 -- start start 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f265b895640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 0x7f265419c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f265b895640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2654076080 0x7f265419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f265b895640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654110140 0x7f26541a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f265b895640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2654115d20 con 0x7f2654075730 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f265b895640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2654115ba0 con 0x7f2654076080 2024-09-21T06:46:28.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f265b895640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2654115ea0 con 0x7f2654110140 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659631640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 0x7f265419c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659631640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 0x7f265419c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57868/0 (socket says 172.21.15.49:57868) 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659631640 1 -- 172.21.15.49:0/1767479061 learned_addr learned my addr 172.21.15.49:0/1767479061 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2658e30640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2654076080 0x7f265419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659e32640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654110140 0x7f26541a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659631640 1 -- 172.21.15.49:0/1767479061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654110140 msgr2=0x7f26541a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659631640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654110140 0x7f26541a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659631640 1 -- 172.21.15.49:0/1767479061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2654076080 msgr2=0x7f265419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659631640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2654076080 0x7f265419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659631640 1 -- 172.21.15.49:0/1767479061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26541a2700 con 0x7f2654075730 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2658e30640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2654076080 0x7f265419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f2659631640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 0x7f265419c790 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f2650005940 tx=0x7f26500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f264a7fc640 1 -- 172.21.15.49:0/1767479061 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265003f030 con 0x7f2654075730 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f265b895640 1 -- 172.21.15.49:0/1767479061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26541a2990 con 0x7f2654075730 2024-09-21T06:46:28.764 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f264a7fc640 1 -- 172.21.15.49:0/1767479061 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2650003cb0 con 0x7f2654075730 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.745+0000 7f264a7fc640 1 -- 172.21.15.49:0/1767479061 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650035070 con 0x7f2654075730 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.746+0000 7f265b895640 1 -- 172.21.15.49:0/1767479061 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26541a9150 con 0x7f2654075730 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.748+0000 7f2661e09740 1 Processor -- start 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.748+0000 7f2661e09740 1 -- start start 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f264a7fc640 1 -- 172.21.15.49:0/1767479061 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2650042030 con 0x7f2654075730 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2661e09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b50a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2661e09740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b13a1b0 0x55d67b50abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2661e09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b50b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2661e09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d67b480ea0 con 0x55d67b142390 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2661e09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d67b4702d0 con 0x55d67b163070 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2661e09740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d67b4740e0 con 0x55d67b13a1b0 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2658e30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b50b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2658e30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b50b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57882/0 (socket says 172.21.15.49:57882) 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2658e30640 1 -- 172.21.15.49:0/2622308079 learned_addr learned my addr 172.21.15.49:0/2622308079 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2659631640 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b13a1b0 0x55d67b50abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.765 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2659e32640 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b50a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2658e30640 1 -- 172.21.15.49:0/2622308079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b13a1b0 msgr2=0x55d67b50abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2658e30640 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b13a1b0 0x55d67b50abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2658e30640 1 -- 172.21.15.49:0/2622308079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 msgr2=0x55d67b50a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2658e30640 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b50a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2658e30640 1 -- 172.21.15.49:0/2622308079 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d67b1ce650 con 0x55d67b142390 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.749+0000 7f2659e32640 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b50a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.750+0000 7f2658e30640 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b50b120 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f264400bcd0 tx=0x7f264400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d9e875f0f251b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.750+0000 7f264a7fc640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f26400b6680 0x7f26400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.750+0000 7f263f7fe640 1 -- 172.21.15.49:0/2622308079 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644015070 con 0x55d67b142390 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.750+0000 7f263f7fe640 1 -- 172.21.15.49:0/2622308079 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f264401a910 con 0x55d67b142390 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.750+0000 7f263f7fe640 1 -- 172.21.15.49:0/2622308079 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26440118c0 con 0x55d67b142390 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.750+0000 7f2659e32640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f26400b6680 0x7f26400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.750+0000 7f264a7fc640 1 -- 172.21.15.49:0/1767479061 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f2650108020 con 0x7f2654075730 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 -- 172.21.15.49:0/2622308079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 msgr2=0x55d67b50b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b50b120 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f264400bcd0 tx=0x7f264400f730 comp rx=0 tx=0).stop 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2659e32640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f26400b6680 0x7f26400b8b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f264c00a5f0 tx=0x7f264c00d040 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 -- 172.21.15.49:0/2622308079 shutdown_connections 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b50b120 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b13a1b0 0x55d67b50abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 --2- 172.21.15.49:0/2622308079 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b50a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 -- 172.21.15.49:0/2622308079 >> 172.21.15.49:0/2622308079 conn(0x55d67b157460 msgr2=0x55d67b508590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 -- 172.21.15.49:0/2622308079 shutdown_connections 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 -- 172.21.15.49:0/2622308079 wait complete. 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.751+0000 7f2661e09740 1 -- start start 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2661e09740 1 Processor -- start 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2661e09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 0x55d67b515d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2661e09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b516290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2661e09740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 0x55d67b522170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2661e09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55d67b2d1700 con 0x55d67b142390 2024-09-21T06:46:28.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2661e09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55d67b40b160 con 0x55d67b13a1b0 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2661e09740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55d67b518e80 con 0x55d67b163070 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2661e09740 10 client.0 _ll_register_callbacks cb 0x55d67b4249e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2658e30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b516290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2658e30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b516290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57892/0 (socket says 172.21.15.49:57892) 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2658e30640 1 -- 172.21.15.49:0/3421701263 learned_addr learned my addr 172.21.15.49:0/3421701263 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2659e32640 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 0x55d67b522170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.752+0000 7f2659631640 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 0x55d67b515d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f2658e30640 1 -- 172.21.15.49:0/3421701263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 msgr2=0x55d67b522170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f2658e30640 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 0x55d67b522170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f2658e30640 1 -- 172.21.15.49:0/3421701263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 msgr2=0x55d67b515d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f2658e30640 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 0x55d67b515d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f2658e30640 1 -- 172.21.15.49:0/3421701263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d67b438c90 con 0x55d67b142390 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f2658e30640 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b516290 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f2644011520 tx=0x7f264401a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6fa92f65dd05bc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f263cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f263cff9640 1 -- 172.21.15.49:0/3421701263 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644028060 con 0x55d67b142390 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f263cff9640 1 -- 172.21.15.49:0/3421701263 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f264401acd0 con 0x55d67b142390 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f2661e09740 1 -- 172.21.15.49:0/3421701263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f264401a910 con 0x55d67b142390 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f263cff9640 1 -- 172.21.15.49:0/3421701263 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2644015070 con 0x55d67b142390 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f2661e09740 10 client.17889 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f2661e09740 1 -- 172.21.15.49:0/3421701263 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d67b524b90 con 0x55d67b142390 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.753+0000 7f263cff9640 1 -- 172.21.15.49:0/3421701263 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f264401a910 con 0x55d67b142390 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f263cff9640 1 -- 172.21.15.49:0/3421701263 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f2644004990 con 0x55d67b142390 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f2661e09740 10 client.17889 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f2661e09740 10 client.17889 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f2661e09740 20 client.17889 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f2661e09740 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d67b1219f0 0x55d67b527ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f2661e09740 4 client.17889 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f2661e09740 1 -- 172.21.15.49:0/3421701263 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d67b482df0 con 0x55d67b1219f0 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f2659631640 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d67b1219f0 0x55d67b527ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f2659631640 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d67b1219f0 0x55d67b527ef0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff849c6f38661ef7 server_cookie=81791d3f66fc018f in_seq=0 out_seq=0 2024-09-21T06:46:28.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.754+0000 7f263cff9640 10 client.17889 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.755+0000 7f263cff9640 1 -- 172.21.15.49:0/3421701263 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d67b482df0 con 0x55d67b1219f0 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.755+0000 7f263cff9640 10 client.17889 handle_command_reply: tid=0 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.755+0000 7f2661e09740 1 client.17889 shutdown 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.755+0000 7f2661e09740 1 -- 172.21.15.49:0/3421701263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 msgr2=0x55d67b516290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.755+0000 7f2661e09740 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b516290 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f2644011520 tx=0x7f264401a690 comp rx=0 tx=0).stop 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f2661e09740 1 -- 172.21.15.49:0/3421701263 shutdown_connections 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f2661e09740 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d67b1219f0 0x55d67b527ef0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f2661e09740 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 0x55d67b522170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f2661e09740 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b516290 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f2661e09740 1 --2- 172.21.15.49:0/3421701263 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 0x55d67b515d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f2661e09740 1 -- 172.21.15.49:0/3421701263 >> 172.21.15.49:0/3421701263 conn(0x55d67b157460 msgr2=0x55d67b50d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.770 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f263cff9640 0 client.17889 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f2661e09740 1 -- 172.21.15.49:0/3421701263 shutdown_connections 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f2661e09740 1 -- 172.21.15.49:0/3421701263 wait complete. 2024-09-21T06:46:28.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.756+0000 7f2661e09740 20 client.17889 trim_cache size 0 max 16384 2024-09-21T06:46:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.769+0000 7f2661e09740 1 Processor -- start 2024-09-21T06:46:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.769+0000 7f2661e09740 1 -- start start 2024-09-21T06:46:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2661e09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b13a1b0 0x55d67b517980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2661e09740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b142390 0x55d67b507bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2661e09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b508100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2661e09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f26541b4350 con 0x55d67b13a1b0 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2661e09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f26541b1c20 con 0x55d67b163070 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2661e09740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f26541afa90 con 0x55d67b142390 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659631640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b13a1b0 0x55d67b517980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659631640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b13a1b0 0x55d67b517980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57898/0 (socket says 172.21.15.49:57898) 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659631640 1 -- 172.21.15.49:0/878040810 learned_addr learned my addr 172.21.15.49:0/878040810 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2658e30640 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b142390 0x55d67b507bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659e32640 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b508100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659631640 1 -- 172.21.15.49:0/878040810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b142390 msgr2=0x55d67b507bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659631640 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b142390 0x55d67b507bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659631640 1 -- 172.21.15.49:0/878040810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 msgr2=0x55d67b508100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659631640 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b508100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659631640 1 -- 172.21.15.49:0/878040810 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d67b121c20 con 0x55d67b13a1b0 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659e32640 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b508100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:28.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f2659631640 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b13a1b0 0x55d67b517980 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f26500ca3f0 tx=0x7f265002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb868e910fdc3675 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f263effd640 1 -- 172.21.15.49:0/878040810 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2650049040 con 0x55d67b13a1b0 2024-09-21T06:46:28.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.770+0000 7f263effd640 1 -- 172.21.15.49:0/878040810 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26500cd930 con 0x55d67b13a1b0 2024-09-21T06:46:28.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f263effd640 1 -- 172.21.15.49:0/878040810 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265010bd20 con 0x55d67b13a1b0 2024-09-21T06:46:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f2661e09740 1 -- 172.21.15.49:0/878040810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b13a1b0 msgr2=0x55d67b517980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.777 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f2661e09740 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b13a1b0 0x55d67b517980 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f26500ca3f0 tx=0x7f265002a410 comp rx=0 tx=0).stop 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f2661e09740 1 -- 172.21.15.49:0/878040810 shutdown_connections 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f2661e09740 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b163070 0x55d67b508100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f2661e09740 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b142390 0x55d67b507bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f2661e09740 1 --2- 172.21.15.49:0/878040810 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b13a1b0 0x55d67b517980 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f2661e09740 1 -- 172.21.15.49:0/878040810 >> 172.21.15.49:0/878040810 conn(0x55d67b157460 msgr2=0x55d67b517270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f2661e09740 1 -- 172.21.15.49:0/878040810 shutdown_connections 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.771+0000 7f2661e09740 1 -- 172.21.15.49:0/878040810 wait complete. 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.772+0000 7f2661e09740 1 -- start start 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.772+0000 7f2661e09740 1 Processor -- start 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.772+0000 7f2661e09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 0x55d67b52b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.772+0000 7f2661e09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b528cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.772+0000 7f2661e09740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 0x55d67b529300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.778 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.772+0000 7f2661e09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f26541b00e0 con 0x55d67b142390 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.772+0000 7f2661e09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f26541b1550 con 0x55d67b13a1b0 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.772+0000 7f2661e09740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f26541b07b0 con 0x55d67b163070 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.772+0000 7f2661e09740 10 client.0 _ll_register_callbacks cb 0x7f265010ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2658e30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b528cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2658e30640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b528cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57908/0 (socket says 172.21.15.49:57908) 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2659e32640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 0x55d67b529300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2658e30640 1 -- 172.21.15.49:0/778272432 learned_addr learned my addr 172.21.15.49:0/778272432 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2659631640 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 0x55d67b52b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2658e30640 1 -- 172.21.15.49:0/778272432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 msgr2=0x55d67b529300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2658e30640 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 0x55d67b529300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2658e30640 1 -- 172.21.15.49:0/778272432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 msgr2=0x55d67b52b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2658e30640 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 0x55d67b52b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2658e30640 1 -- 172.21.15.49:0/778272432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d67b529a70 con 0x55d67b142390 2024-09-21T06:46:28.779 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2659e32640 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 0x55d67b529300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2659631640 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 0x55d67b52b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2658e30640 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b528cb0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f264402d040 tx=0x7f264400b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db15ddd704da965d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f263cff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f263cff9640 1 -- 172.21.15.49:0/778272432 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2644038060 con 0x55d67b142390 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f2661e09740 1 -- 172.21.15.49:0/778272432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26500cd930 con 0x55d67b142390 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.773+0000 7f263cff9640 1 -- 172.21.15.49:0/778272432 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f2644011550 con 0x55d67b142390 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f263cff9640 1 -- 172.21.15.49:0/778272432 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2644028040 con 0x55d67b142390 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f2661e09740 10 client.17895 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f2661e09740 1 -- 172.21.15.49:0/778272432 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d67b5925f0 con 0x55d67b142390 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f263cff9640 1 -- 172.21.15.49:0/778272432 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26500cd930 con 0x55d67b142390 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f263cff9640 1 -- 172.21.15.49:0/778272432 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f26440047a0 con 0x55d67b142390 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f2661e09740 10 client.17895 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f2661e09740 10 client.17895 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:46:28.780 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f2661e09740 20 client.17895 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f2661e09740 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d67b0f6da0 0x55d67b594d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f2661e09740 4 client.17895 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f2661e09740 1 -- 172.21.15.49:0/778272432 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d67b47e8a0 con 0x55d67b0f6da0 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.774+0000 7f2659631640 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d67b0f6da0 0x55d67b594d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f263cff9640 10 client.17895 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2659631640 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d67b0f6da0 0x55d67b594d60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b70ffad317fb42f5 server_cookie=1bb09b4e60866e3f in_seq=0 out_seq=0 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f263cff9640 1 -- 172.21.15.49:0/778272432 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d67b47e8a0 con 0x55d67b0f6da0 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f263cff9640 10 client.17895 handle_command_reply: tid=0 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2661e09740 1 client.17895 shutdown 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2661e09740 1 -- 172.21.15.49:0/778272432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 msgr2=0x55d67b528cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2661e09740 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b528cb0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f264402d040 tx=0x7f264400b9f0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2661e09740 1 -- 172.21.15.49:0/778272432 shutdown_connections 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2661e09740 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x55d67b0f6da0 0x55d67b594d60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2661e09740 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55d67b163070 0x55d67b529300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.781 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2661e09740 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55d67b142390 0x55d67b528cb0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2661e09740 1 --2- 172.21.15.49:0/778272432 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55d67b13a1b0 0x55d67b52b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f2661e09740 1 -- 172.21.15.49:0/778272432 >> 172.21.15.49:0/778272432 conn(0x55d67b157460 msgr2=0x55d67b517010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.775+0000 7f263cff9640 0 client.17895 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:46:28.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f2661e09740 1 -- 172.21.15.49:0/778272432 shutdown_connections 2024-09-21T06:46:28.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f2661e09740 1 -- 172.21.15.49:0/778272432 wait complete. 2024-09-21T06:46:28.782 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f2661e09740 20 client.17895 trim_cache size 0 max 16384 2024-09-21T06:46:28.782 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:46:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 -- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f26400b6680 msgr2=0x7f26400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f26400b6680 0x7f26400b8b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f264c00a5f0 tx=0x7f264c00d040 comp rx=0 tx=0).stop 2024-09-21T06:46:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 -- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 msgr2=0x7f265419c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 0x7f265419c790 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f2650005940 tx=0x7f26500042f0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 -- 172.21.15.49:0/1767479061 shutdown_connections 2024-09-21T06:46:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f26400b6680 0x7f26400b8b90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2654110140 0x7f26541a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.783 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2654076080 0x7f265419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 --2- 172.21.15.49:0/1767479061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2654075730 0x7f265419c790 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.776+0000 7f265b895640 1 -- 172.21.15.49:0/1767479061 >> 172.21.15.49:0/1767479061 conn(0x7f265407b850 msgr2=0x7f2654109ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.777+0000 7f265b895640 1 -- 172.21.15.49:0/1767479061 shutdown_connections 2024-09-21T06:46:28.784 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:28.777+0000 7f265b895640 1 -- 172.21.15.49:0/1767479061 wait complete. 2024-09-21T06:46:29.495 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:46:29.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:29 smithi049 ceph-mon[31177]: pgmap v622: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-21T06:46:29.755 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:30.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:29 smithi098 ceph-mon[34704]: pgmap v622: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-21T06:46:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:29 smithi079 ceph-mon[34346]: pgmap v622: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 30 KiB/s wr, 13 op/s 2024-09-21T06:46:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.205+0000 7f5f8d03d640 1 -- 172.21.15.49:0/3868607794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108d70 msgr2=0x7f5f8810f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.205+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/3868607794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108d70 0x7f5f8810f5a0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009ca0 tx=0x7f5f8002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.206+0000 7f5f8d03d640 1 -- 172.21.15.49:0/3868607794 shutdown_connections 2024-09-21T06:46:30.207 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.206+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/3868607794 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108d70 0x7f5f8810f5a0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.206+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/3868607794 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f88108420 0x7f5f88108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.206+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/3868607794 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f88102ae0 0x7f5f88102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.206+0000 7f5f8d03d640 1 -- 172.21.15.49:0/3868607794 >> 172.21.15.49:0/3868607794 conn(0x7f5f88079770 msgr2=0x7f5f88079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.206+0000 7f5f8d03d640 1 -- 172.21.15.49:0/3868607794 shutdown_connections 2024-09-21T06:46:30.208 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.206+0000 7f5f8d03d640 1 -- 172.21.15.49:0/3868607794 wait complete. 2024-09-21T06:46:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8d03d640 1 Processor -- start 2024-09-21T06:46:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8d03d640 1 -- start start 2024-09-21T06:46:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8d03d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f88102ae0 0x7f5f8819a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8d03d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108420 0x7f5f8819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8d03d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f88108d70 0x7f5f8819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.209 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8d03d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88112a30 con 0x7f5f88108420 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8d03d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881128b0 con 0x7f5f88108d70 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8d03d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88112bb0 con 0x7f5f88102ae0 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108420 0x7f5f8819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108420 0x7f5f8819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57930/0 (socket says 172.21.15.49:57930) 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8659c640 1 -- 172.21.15.49:0/114057626 learned_addr learned my addr 172.21.15.49:0/114057626 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f88102ae0 0x7f5f8819a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.207+0000 7f5f8759e640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f88108d70 0x7f5f8819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f8659c640 1 -- 172.21.15.49:0/114057626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f88102ae0 msgr2=0x7f5f8819a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f8659c640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f88102ae0 0x7f5f8819a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f8659c640 1 -- 172.21.15.49:0/114057626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f88108d70 msgr2=0x7f5f8819fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f8659c640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f88108d70 0x7f5f8819fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f8659c640 1 -- 172.21.15.49:0/114057626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f881a0360 con 0x7f5f88108420 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f8759e640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f88108d70 0x7f5f8819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:30.210 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f8659c640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108420 0x7f5f8819aa50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00e9f0 tx=0x7f5f7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f6ffff640 1 -- 172.21.15.49:0/114057626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00ccc0 con 0x7f5f88108420 2024-09-21T06:46:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f8d03d640 1 -- 172.21.15.49:0/114057626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f881a0650 con 0x7f5f88108420 2024-09-21T06:46:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f6ffff640 1 -- 172.21.15.49:0/114057626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f7c0108e0 con 0x7f5f88108420 2024-09-21T06:46:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f6ffff640 1 -- 172.21.15.49:0/114057626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c018880 con 0x7f5f88108420 2024-09-21T06:46:30.211 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.208+0000 7f5f8d03d640 1 -- 172.21.15.49:0/114057626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f881a6e70 con 0x7f5f88108420 2024-09-21T06:46:30.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f935b1740 1 Processor -- start 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f935b1740 1 -- start start 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f6ffff640 1 -- 172.21.15.49:0/114057626 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5f7c010430 con 0x7f5f88108420 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 0x55fac54fa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac54fabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac54fb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f935b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fac5470ea0 con 0x55fac5132390 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f935b1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fac54602d0 con 0x55fac5153070 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f935b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fac54640e0 con 0x55fac512a1b0 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.211+0000 7f5f8659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac54fb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac54fb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57942/0 (socket says 172.21.15.49:57942) 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8659c640 1 -- 172.21.15.49:0/2549589390 learned_addr learned my addr 172.21.15.49:0/2549589390 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8759e640 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 0x55fac54fa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac54fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.214 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8659c640 1 -- 172.21.15.49:0/2549589390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 msgr2=0x55fac54fabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8659c640 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac54fabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8659c640 1 -- 172.21.15.49:0/2549589390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 msgr2=0x55fac54fa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8659c640 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 0x55fac54fa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8659c640 1 -- 172.21.15.49:0/2549589390 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac51be650 con 0x55fac5132390 2024-09-21T06:46:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac54fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8659c640 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac54fb120 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0e51f0 tx=0x7f5f7c0f06c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b6518b7a71c71a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f6ffff640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5f700b66b0 0x7f5f700b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f8759e640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5f700b66b0 0x7f5f700b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.212+0000 7f5f6d7fa640 1 -- 172.21.15.49:0/2549589390 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0f7070 con 0x55fac5132390 2024-09-21T06:46:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.213+0000 7f5f6ffff640 1 -- 172.21.15.49:0/114057626 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f5f7c0e7b80 con 0x7f5f88108420 2024-09-21T06:46:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.213+0000 7f5f6d7fa640 1 -- 172.21.15.49:0/2549589390 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f7c010720 con 0x55fac5132390 2024-09-21T06:46:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.213+0000 7f5f6d7fa640 1 -- 172.21.15.49:0/2549589390 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0ad750 con 0x55fac5132390 2024-09-21T06:46:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 -- 172.21.15.49:0/2549589390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 msgr2=0x55fac54fb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac54fb120 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0e51f0 tx=0x7f5f7c0f06c0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f8759e640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5f700b66b0 0x7f5f700b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5f80005cc0 tx=0x7f5f80005c30 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 -- 172.21.15.49:0/2549589390 shutdown_connections 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac54fb120 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac54fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2549589390 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 0x55fac54fa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 -- 172.21.15.49:0/2549589390 >> 172.21.15.49:0/2549589390 conn(0x55fac5147460 msgr2=0x55fac54f8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 -- 172.21.15.49:0/2549589390 shutdown_connections 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 -- 172.21.15.49:0/2549589390 wait complete. 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 -- start start 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.214+0000 7f5f935b1740 1 Processor -- start 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac5505d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac5506240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 0x55fac55121a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f935b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55fac52c1700 con 0x55fac5132390 2024-09-21T06:46:30.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f935b1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55fac53fb160 con 0x55fac5153070 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f935b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55fac5508e80 con 0x55fac512a1b0 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f935b1740 10 client.0 _ll_register_callbacks cb 0x55fac54149e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac5506240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac5506240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57952/0 (socket says 172.21.15.49:57952) 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8659c640 1 -- 172.21.15.49:0/2678719553 learned_addr learned my addr 172.21.15.49:0/2678719553 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac5505d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8759e640 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 0x55fac55121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8659c640 1 -- 172.21.15.49:0/2678719553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 msgr2=0x55fac5505d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8659c640 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac5505d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8659c640 1 -- 172.21.15.49:0/2678719553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 msgr2=0x55fac55121a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8659c640 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 0x55fac55121a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8659c640 1 -- 172.21.15.49:0/2678719553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac5428c90 con 0x55fac5132390 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac5505d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f8659c640 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac5506240 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c000c00 tx=0x7f5f7c0a9920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f8747be96d75fb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.220 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.215+0000 7f5f6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f6aff5640 1 -- 172.21.15.49:0/2678719553 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c0f7030 con 0x55fac5132390 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f6aff5640 1 -- 172.21.15.49:0/2678719553 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f5f7c010a90 con 0x55fac5132390 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f935b1740 1 -- 172.21.15.49:0/2678719553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fac5472df0 con 0x55fac5132390 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f6aff5640 1 -- 172.21.15.49:0/2678719553 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5f7c0b0e60 con 0x55fac5132390 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f935b1740 10 client.17907 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f935b1740 1 -- 172.21.15.49:0/2678719553 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fac5514b60 con 0x55fac5132390 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f6aff5640 1 -- 172.21.15.49:0/2678719553 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fac5472df0 con 0x55fac5132390 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f6aff5640 1 -- 172.21.15.49:0/2678719553 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5f7c0f1040 con 0x55fac5132390 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f935b1740 10 client.17907 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f935b1740 10 client.17907 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f935b1740 20 client.17907 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55fac51119f0 0x55fac5517ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f935b1740 4 client.17907 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.216+0000 7f5f935b1740 1 -- 172.21.15.49:0/2678719553 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fac546e8a0 con 0x55fac51119f0 2024-09-21T06:46:30.221 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.217+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55fac51119f0 0x55fac5517ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.217+0000 7f5f6aff5640 10 client.17907 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.217+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55fac51119f0 0x55fac5517ec0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b87384f2ee6f91a2 server_cookie=8070a2c043d99aca in_seq=0 out_seq=0 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f6aff5640 1 -- 172.21.15.49:0/2678719553 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fac546e8a0 con 0x55fac51119f0 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f6aff5640 10 client.17907 handle_command_reply: tid=0 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 client.17907 shutdown 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 -- 172.21.15.49:0/2678719553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 msgr2=0x55fac5506240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac5506240 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c000c00 tx=0x7f5f7c0a9920 comp rx=0 tx=0).stop 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 -- 172.21.15.49:0/2678719553 shutdown_connections 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55fac51119f0 0x55fac5517ec0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5153070 0x55fac55121a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5132390 0x55fac5506240 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 --2- 172.21.15.49:0/2678719553 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac5505d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 -- 172.21.15.49:0/2678719553 >> 172.21.15.49:0/2678719553 conn(0x55fac5147460 msgr2=0x55fac54fb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f6aff5640 0 client.17907 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 -- 172.21.15.49:0/2678719553 shutdown_connections 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 1 -- 172.21.15.49:0/2678719553 wait complete. 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.218+0000 7f5f935b1740 20 client.17907 trim_cache size 0 max 16384 2024-09-21T06:46:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.231+0000 7f5f935b1740 1 Processor -- start 2024-09-21T06:46:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.231+0000 7f5f935b1740 1 -- start start 2024-09-21T06:46:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac512a1b0 0x55fac54fc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5507930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac5153070 0x55fac54f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f935b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881b2160 con 0x55fac512a1b0 2024-09-21T06:46:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f935b1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881afa30 con 0x55fac5132390 2024-09-21T06:46:30.234 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f935b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881ad8a0 con 0x55fac5153070 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f86d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac512a1b0 0x55fac54fc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f86d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac512a1b0 0x55fac54fc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57954/0 (socket says 172.21.15.49:57954) 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f86d9d640 1 -- 172.21.15.49:0/722039573 learned_addr learned my addr 172.21.15.49:0/722039573 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f8659c640 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5507930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f8759e640 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac5153070 0x55fac54f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f86d9d640 1 -- 172.21.15.49:0/722039573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac5153070 msgr2=0x55fac54f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac5153070 0x55fac54f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f86d9d640 1 -- 172.21.15.49:0/722039573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 msgr2=0x55fac5507930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5507930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f86d9d640 1 -- 172.21.15.49:0/722039573 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fac54fcf30 con 0x55fac512a1b0 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f8659c640 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5507930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f8759e640 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac5153070 0x55fac54f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.232+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac512a1b0 0x55fac54fc090 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5f780136c0 tx=0x7f5f78013b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4769a175b265e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f6cff9640 1 -- 172.21.15.49:0/722039573 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78021040 con 0x55fac512a1b0 2024-09-21T06:46:30.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f6cff9640 1 -- 172.21.15.49:0/722039573 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f78013e30 con 0x55fac512a1b0 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f6cff9640 1 -- 172.21.15.49:0/722039573 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f78004a70 con 0x55fac512a1b0 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f935b1740 1 -- 172.21.15.49:0/722039573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac512a1b0 msgr2=0x55fac54fc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f935b1740 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac512a1b0 0x55fac54fc090 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f5f780136c0 tx=0x7f5f78013b80 comp rx=0 tx=0).stop 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f935b1740 1 -- 172.21.15.49:0/722039573 shutdown_connections 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f935b1740 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac5153070 0x55fac54f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f935b1740 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5507930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f935b1740 1 --2- 172.21.15.49:0/722039573 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac512a1b0 0x55fac54fc090 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f935b1740 1 -- 172.21.15.49:0/722039573 >> 172.21.15.49:0/722039573 conn(0x55fac5147460 msgr2=0x55fac5507220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f935b1740 1 -- 172.21.15.49:0/722039573 shutdown_connections 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.233+0000 7f5f935b1740 1 -- 172.21.15.49:0/722039573 wait complete. 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f935b1740 1 -- start start 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f935b1740 1 Processor -- start 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac5518040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5518580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f935b1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5153070 0x55fac5518ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f935b1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881adef0 con 0x55fac5153070 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f935b1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881af360 con 0x55fac5132390 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f935b1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5f881ae5c0 con 0x55fac512a1b0 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f935b1740 10 client.0 _ll_register_callbacks cb 0x7f5f7c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f8759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5153070 0x55fac5518ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.234+0000 7f5f8759e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5153070 0x55fac5518ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57970/0 (socket says 172.21.15.49:57970) 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f8759e640 1 -- 172.21.15.49:0/886629136 learned_addr learned my addr 172.21.15.49:0/886629136 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f8659c640 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5518580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac5518040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f8759e640 1 -- 172.21.15.49:0/886629136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 msgr2=0x55fac5518040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f8759e640 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac5518040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f8759e640 1 -- 172.21.15.49:0/886629136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 msgr2=0x55fac5518580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f8759e640 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5518580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f8759e640 1 -- 172.21.15.49:0/886629136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fac5580790 con 0x55fac5153070 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f8659c640 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5518580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f8759e640 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5153070 0x55fac5518ac0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009ca0 tx=0x7f5f8002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9337d2d09f060452 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f6aff5640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f6aff5640 1 -- 172.21.15.49:0/886629136 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80058060 con 0x55fac5153070 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f6aff5640 1 -- 172.21.15.49:0/886629136 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f5f80004040 con 0x55fac5153070 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.235+0000 7f5f935b1740 1 -- 172.21.15.49:0/886629136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f78013e30 con 0x55fac5153070 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f6aff5640 1 -- 172.21.15.49:0/886629136 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5f80004240 con 0x55fac5153070 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f935b1740 10 client.17913 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f935b1740 1 -- 172.21.15.49:0/886629136 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fac5581920 con 0x55fac5153070 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f6aff5640 1 -- 172.21.15.49:0/886629136 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f78013e30 con 0x55fac5153070 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f6aff5640 1 -- 172.21.15.49:0/886629136 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f5f80052070 con 0x55fac5153070 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f935b1740 10 client.17913 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f935b1740 10 client.17913 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f935b1740 20 client.17913 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f935b1740 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55fac50e6da0 0x55fac5584140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f935b1740 4 client.17913 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f935b1740 1 -- 172.21.15.49:0/886629136 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fac546bcd0 con 0x55fac50e6da0 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.236+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55fac50e6da0 0x55fac5584140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f86d9d640 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55fac50e6da0 0x55fac5584140 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b86ddd91882dbac server_cookie=17a29a4409f1bd8d in_seq=0 out_seq=0 2024-09-21T06:46:30.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f6aff5640 10 client.17913 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:46:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f6aff5640 1 -- 172.21.15.49:0/886629136 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fac546bcd0 con 0x55fac50e6da0 2024-09-21T06:46:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f6aff5640 10 client.17913 handle_command_reply: tid=0 2024-09-21T06:46:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 client.17913 shutdown 2024-09-21T06:46:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 -- 172.21.15.49:0/886629136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5153070 msgr2=0x55fac5518ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5153070 0x55fac5518ac0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009ca0 tx=0x7f5f8002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 -- 172.21.15.49:0/886629136 shutdown_connections 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x55fac50e6da0 0x55fac5584140 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55fac5153070 0x55fac5518ac0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55fac5132390 0x55fac5518580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 --2- 172.21.15.49:0/886629136 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55fac512a1b0 0x55fac5518040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 -- 172.21.15.49:0/886629136 >> 172.21.15.49:0/886629136 conn(0x55fac5147460 msgr2=0x55fac5507a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f6aff5640 0 client.17913 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 -- 172.21.15.49:0/886629136 shutdown_connections 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.237+0000 7f5f935b1740 1 -- 172.21.15.49:0/886629136 wait complete. 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f935b1740 20 client.17913 trim_cache size 0 max 16384 2024-09-21T06:46:30.243 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 -- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5f700b66b0 msgr2=0x7f5f700b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5f700b66b0 0x7f5f700b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5f80005cc0 tx=0x7f5f80005c30 comp rx=0 tx=0).stop 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 -- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108420 msgr2=0x7f5f8819aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108420 0x7f5f8819aa50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00e9f0 tx=0x7f5f7c00edf0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 -- 172.21.15.49:0/114057626 shutdown_connections 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5f700b66b0 0x7f5f700b8bc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5f88108d70 0x7f5f8819fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5f88108420 0x7f5f8819aa50 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 --2- 172.21.15.49:0/114057626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5f88102ae0 0x7f5f8819a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.244 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 -- 172.21.15.49:0/114057626 >> 172.21.15.49:0/114057626 conn(0x7f5f88079770 msgr2=0x7f5f88101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 -- 172.21.15.49:0/114057626 shutdown_connections 2024-09-21T06:46:30.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:30.238+0000 7f5f8d03d640 1 -- 172.21.15.49:0/114057626 wait complete. 2024-09-21T06:46:30.913 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:46:31.171 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.647+0000 7fcb10e34640 1 -- 172.21.15.49:0/1398020179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 msgr2=0x7fcb0c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.647+0000 7fcb10e34640 1 --2- 172.21.15.49:0/1398020179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 0x7fcb0c10d8d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009900 tx=0x7fcaf402a410 comp rx=0 tx=0).stop 2024-09-21T06:46:31.649 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.647+0000 7fcb10e34640 1 -- 172.21.15.49:0/1398020179 shutdown_connections 2024-09-21T06:46:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.647+0000 7fcb10e34640 1 --2- 172.21.15.49:0/1398020179 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb0c10de10 0x7fcb0c1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.647+0000 7fcb10e34640 1 --2- 172.21.15.49:0/1398020179 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 0x7fcb0c10d8d0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.647+0000 7fcb10e34640 1 --2- 172.21.15.49:0/1398020179 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c104860 0x7fcb0c104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.647+0000 7fcb10e34640 1 -- 172.21.15.49:0/1398020179 >> 172.21.15.49:0/1398020179 conn(0x7fcb0c079730 msgr2=0x7fcb0c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.647+0000 7fcb10e34640 1 -- 172.21.15.49:0/1398020179 shutdown_connections 2024-09-21T06:46:31.650 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.647+0000 7fcb10e34640 1 -- 172.21.15.49:0/1398020179 wait complete. 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.648+0000 7fcb10e34640 1 Processor -- start 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.648+0000 7fcb10e34640 1 -- start start 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb10e34640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb0c104860 0x7fcb0c102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb10e34640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 0x7fcb0c102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb10e34640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c10de10 0x7fcb0c1031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb10e34640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c113a20 con 0x7fcb0c105290 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb10e34640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1138a0 con 0x7fcb0c10de10 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb10e34640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c113ba0 con 0x7fcb0c104860 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb09d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 0x7fcb0c102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb09d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 0x7fcb0c102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57996/0 (socket says 172.21.15.49:57996) 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb09d9b640 1 -- 172.21.15.49:0/3171392002 learned_addr learned my addr 172.21.15.49:0/3171392002 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:31.652 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb0c104860 0x7fcb0c102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c10de10 0x7fcb0c1031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb09d9b640 1 -- 172.21.15.49:0/3171392002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb0c104860 msgr2=0x7fcb0c102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb0c104860 0x7fcb0c102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb09d9b640 1 -- 172.21.15.49:0/3171392002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c10de10 msgr2=0x7fcb0c1031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c10de10 0x7fcb0c1031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb09d9b640 1 -- 172.21.15.49:0/3171392002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb0c1a86a0 con 0x7fcb0c105290 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.649+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 0x7fcb0c102cb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fcaf402a930 tx=0x7fcaf4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.650+0000 7fcb037fe640 1 -- 172.21.15.49:0/3171392002 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf403f030 con 0x7fcb0c105290 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.650+0000 7fcb10e34640 1 -- 172.21.15.49:0/3171392002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb0c1a8930 con 0x7fcb0c105290 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.650+0000 7fcb037fe640 1 -- 172.21.15.49:0/3171392002 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcaf4003aa0 con 0x7fcb0c105290 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.650+0000 7fcb037fe640 1 -- 172.21.15.49:0/3171392002 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4035070 con 0x7fcb0c105290 2024-09-21T06:46:31.653 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.650+0000 7fcb10e34640 1 -- 172.21.15.49:0/3171392002 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb0c1a8e60 con 0x7fcb0c105290 2024-09-21T06:46:31.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.652+0000 7fcb037fe640 1 -- 172.21.15.49:0/3171392002 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fcaf4042030 con 0x7fcb0c105290 2024-09-21T06:46:31.654 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb173a8740 1 Processor -- start 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb173a8740 1 -- start start 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb173a8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb63aea0 con 0x55f0bb31d070 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb173a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb62a2d0 con 0x55f0bb2fc390 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb173a8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb62e0e0 con 0x55f0bb2f41b0 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb0ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb0ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58006/0 (socket says 172.21.15.49:58006) 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/4283575973 learned_addr learned my addr 172.21.15.49:0/4283575973 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb037fe640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcaf80b6680 0x7fcaf80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.656 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.653+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/4283575973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 msgr2=0x55f0bb6c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/4283575973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 msgr2=0x55f0bb6c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/4283575973 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bb388650 con 0x55f0bb31d070 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb037fe640 1 -- 172.21.15.49:0/3171392002 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7fcaf41078f0 con 0x7fcb0c105290 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcaf80b6680 0x7fcaf80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c42c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0103f0 tx=0x7fcafc0108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d45062f6853e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb00ff9640 1 -- 172.21.15.49:0/4283575973 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc01c900 con 0x55f0bb31d070 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb00ff9640 1 -- 172.21.15.49:0/4283575973 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcafc0113e0 con 0x55f0bb31d070 2024-09-21T06:46:31.657 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.654+0000 7fcb00ff9640 1 -- 172.21.15.49:0/4283575973 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc01b5d0 con 0x55f0bb31d070 2024-09-21T06:46:31.660 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb173a8740 1 -- 172.21.15.49:0/4283575973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 msgr2=0x55f0bb6c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c42c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0103f0 tx=0x7fcafc0108b0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcaf80b6680 0x7fcaf80b8b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcafc020000 tx=0x7fcafc01d000 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb173a8740 1 -- 172.21.15.49:0/4283575973 shutdown_connections 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4283575973 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c42c0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb173a8740 1 -- 172.21.15.49:0/4283575973 >> 172.21.15.49:0/4283575973 conn(0x55f0bb311460 msgr2=0x55f0bb6c21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb173a8740 1 -- 172.21.15.49:0/4283575973 shutdown_connections 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.655+0000 7fcb173a8740 1 -- 172.21.15.49:0/4283575973 wait complete. 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb173a8740 1 -- start start 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb173a8740 1 Processor -- start 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.661 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb2fc390 0x55f0bb6cfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb31d070 0x55f0bb6dbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb173a8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb48b700 con 0x55f0bb2fc390 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb173a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb5c5160 con 0x55f0bb2f41b0 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb173a8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55f0bb6d2aa0 con 0x55f0bb31d070 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb173a8740 10 client.0 _ll_register_callbacks cb 0x55f0bb5de9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb09d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb2fc390 0x55f0bb6cfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb09d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb2fc390 0x55f0bb6cfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58014/0 (socket says 172.21.15.49:58014) 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.656+0000 7fcb09d9b640 1 -- 172.21.15.49:0/4206387861 learned_addr learned my addr 172.21.15.49:0/4206387861 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb31d070 0x55f0bb6dbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb09d9b640 1 -- 172.21.15.49:0/4206387861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb31d070 msgr2=0x55f0bb6dbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb31d070 0x55f0bb6dbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb09d9b640 1 -- 172.21.15.49:0/4206387861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 msgr2=0x55f0bb6cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:31.662 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb09d9b640 1 -- 172.21.15.49:0/4206387861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0bb5f2c90 con 0x55f0bb2fc390 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb2fc390 0x55f0bb6cfec0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fcaf41055f0 tx=0x7fcaf4096210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c95f3d0df1cbbfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcaf1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/4206387861 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf4049040 con 0x55f0bb2fc390 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/4206387861 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7fcaf40d6c80 con 0x55f0bb2fc390 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb173a8740 1 -- 172.21.15.49:0/4206387861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcafc0113e0 con 0x55f0bb2fc390 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/4206387861 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcaf40cd040 con 0x55f0bb2fc390 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb173a8740 10 client.17925 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.657+0000 7fcb173a8740 1 -- 172.21.15.49:0/4206387861 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f0bb6de6f0 con 0x55f0bb2fc390 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.658+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/4206387861 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcafc0113e0 con 0x55f0bb2fc390 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.658+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/4206387861 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcaf404c060 con 0x55f0bb2fc390 2024-09-21T06:46:31.663 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.658+0000 7fcb173a8740 10 client.17925 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.658+0000 7fcb173a8740 10 client.17925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.658+0000 7fcb173a8740 20 client.17925 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.658+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f0bb2db9f0 0x55f0bb6e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.658+0000 7fcb173a8740 4 client.17925 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.658+0000 7fcb173a8740 1 -- 172.21.15.49:0/4206387861 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0bb63cdf0 con 0x55f0bb2db9f0 2024-09-21T06:46:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.658+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f0bb2db9f0 0x55f0bb6e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.659+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f0bb2db9f0 0x55f0bb6e1bf0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77dd01813da97721 server_cookie=2a210ee3182d2521 in_seq=0 out_seq=0 2024-09-21T06:46:31.664 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.659+0000 7fcaf1ffb640 10 client.17925 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.659+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/4206387861 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0bb63cdf0 con 0x55f0bb2db9f0 2024-09-21T06:46:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.659+0000 7fcaf1ffb640 10 client.17925 handle_command_reply: tid=0 2024-09-21T06:46:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.659+0000 7fcb173a8740 1 client.17925 shutdown 2024-09-21T06:46:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 -- 172.21.15.49:0/4206387861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb2fc390 msgr2=0x55f0bb6cfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.665 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb2fc390 0x55f0bb6cfec0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fcaf41055f0 tx=0x7fcaf4096210 comp rx=0 tx=0).stop 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 -- 172.21.15.49:0/4206387861 shutdown_connections 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f0bb2db9f0 0x55f0bb6e1bf0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb31d070 0x55f0bb6dbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb2fc390 0x55f0bb6cfec0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 --2- 172.21.15.49:0/4206387861 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 -- 172.21.15.49:0/4206387861 >> 172.21.15.49:0/4206387861 conn(0x55f0bb311460 msgr2=0x55f0bb6c74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcaf1ffb640 0 client.17925 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 -- 172.21.15.49:0/4206387861 shutdown_connections 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 1 -- 172.21.15.49:0/4206387861 wait complete. 2024-09-21T06:46:31.666 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.660+0000 7fcb173a8740 20 client.17925 trim_cache size 0 max 16384 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.673+0000 7fcb173a8740 1 Processor -- start 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.673+0000 7fcb173a8740 1 -- start start 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.673+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.673+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6d15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.673+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.673+0000 7fcb173a8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1b4250 con 0x55f0bb31d070 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.673+0000 7fcb173a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1b1b20 con 0x55f0bb2fc390 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.673+0000 7fcb173a8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1af990 con 0x55f0bb2f41b0 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58020/0 (socket says 172.21.15.49:58020) 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/2272004874 learned_addr learned my addr 172.21.15.49:0/2272004874 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.676 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6d15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/2272004874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 msgr2=0x55f0bb6ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/2272004874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 msgr2=0x55f0bb6d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6d15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/2272004874 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bb6c2b20 con 0x55f0bb31d070 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c1760 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fcafc010db0 tx=0x7fcafc011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf64efe5fa1df0f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcaf3fff640 1 -- 172.21.15.49:0/2272004874 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc009b90 con 0x55f0bb31d070 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcaf3fff640 1 -- 172.21.15.49:0/2272004874 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcafc034070 con 0x55f0bb31d070 2024-09-21T06:46:31.677 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.674+0000 7fcaf3fff640 1 -- 172.21.15.49:0/2272004874 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc01bac0 con 0x55f0bb31d070 2024-09-21T06:46:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.675+0000 7fcb173a8740 1 -- 172.21.15.49:0/2272004874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 msgr2=0x55f0bb6c1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.675+0000 7fcb173a8740 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c1760 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fcafc010db0 tx=0x7fcafc011dc0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.675+0000 7fcb173a8740 1 -- 172.21.15.49:0/2272004874 shutdown_connections 2024-09-21T06:46:31.682 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.675+0000 7fcb173a8740 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6c1760 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.675+0000 7fcb173a8740 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2fc390 0x55f0bb6d15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.675+0000 7fcb173a8740 1 --2- 172.21.15.49:0/2272004874 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.675+0000 7fcb173a8740 1 -- 172.21.15.49:0/2272004874 >> 172.21.15.49:0/2272004874 conn(0x55f0bb311460 msgr2=0x55f0bb6d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.675+0000 7fcb173a8740 1 -- 172.21.15.49:0/2272004874 shutdown_connections 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.675+0000 7fcb173a8740 1 -- 172.21.15.49:0/2272004874 wait complete. 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb173a8740 1 -- start start 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb173a8740 1 Processor -- start 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6d8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2fc390 0x55f0bb6d3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb173a8740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb173a8740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1affe0 con 0x55f0bb31d070 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb173a8740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1b1450 con 0x55f0bb2f41b0 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb173a8740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0c1b06b0 con 0x55f0bb2fc390 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb173a8740 10 client.0 _ll_register_callbacks cb 0x7fcaf4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:31.683 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb0ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb0ad9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6d3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58034/0 (socket says 172.21.15.49:58034) 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/1246914714 learned_addr learned my addr 172.21.15.49:0/1246914714 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb09d9b640 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2fc390 0x55f0bb6d3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6d8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/1246914714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2fc390 msgr2=0x55f0bb6d3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2fc390 0x55f0bb6d3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/1246914714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 msgr2=0x55f0bb6d8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.676+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6d8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcb0ad9d640 1 -- 172.21.15.49:0/1246914714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0bb6d4550 con 0x55f0bb31d070 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcb0ad9d640 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6d3e60 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0103f0 tx=0x7fcafc01b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0eccd06b161503b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.684 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcaf1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/1246914714 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc01ca10 con 0x55f0bb31d070 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/1246914714 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7fcafc01cbb0 con 0x55f0bb31d070 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcb173a8740 1 -- 172.21.15.49:0/1246914714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcafc034070 con 0x55f0bb31d070 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/1246914714 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcafc049050 con 0x55f0bb31d070 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcb173a8740 10 client.17931 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcb173a8740 1 -- 172.21.15.49:0/1246914714 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f0bb74c420 con 0x55f0bb31d070 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.677+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/1246914714 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcafc034070 con 0x55f0bb31d070 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/1246914714 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fcafc00f040 con 0x55f0bb31d070 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcb173a8740 10 client.17931 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcb173a8740 10 client.17931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcb173a8740 20 client.17931 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:31.685 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcb173a8740 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f0bb2b0da0 0x55f0bb74e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcb173a8740 4 client.17931 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcb173a8740 1 -- 172.21.15.49:0/1246914714 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f0bb6388a0 con 0x55f0bb2b0da0 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f0bb2b0da0 0x55f0bb74e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcb0a59c640 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f0bb2b0da0 0x55f0bb74e950 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618934e567bc673 server_cookie=b0d80e912deb2b80 in_seq=0 out_seq=0 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.678+0000 7fcaf1ffb640 10 client.17931 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcaf1ffb640 1 -- 172.21.15.49:0/1246914714 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f0bb6388a0 con 0x55f0bb2b0da0 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcaf1ffb640 10 client.17931 handle_command_reply: tid=0 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 client.17931 shutdown 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 -- 172.21.15.49:0/1246914714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 msgr2=0x55f0bb6d3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6d3e60 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0103f0 tx=0x7fcafc01b3d0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 -- 172.21.15.49:0/1246914714 shutdown_connections 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55f0bb2b0da0 0x55f0bb74e950 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55f0bb31d070 0x55f0bb6d3e60 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.686 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55f0bb2fc390 0x55f0bb6d3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcaf1ffb640 0 client.17931 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 --2- 172.21.15.49:0/1246914714 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55f0bb2f41b0 0x55f0bb6d8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 -- 172.21.15.49:0/1246914714 >> 172.21.15.49:0/1246914714 conn(0x55f0bb311460 msgr2=0x55f0bb6d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 -- 172.21.15.49:0/1246914714 shutdown_connections 2024-09-21T06:46:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 1 -- 172.21.15.49:0/1246914714 wait complete. 2024-09-21T06:46:31.687 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb173a8740 20 client.17931 trim_cache size 0 max 16384 2024-09-21T06:46:31.687 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb10e34640 1 -- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcaf80b6680 msgr2=0x7fcaf80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb10e34640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcaf80b6680 0x7fcaf80b8b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fcafc020000 tx=0x7fcafc01d000 comp rx=0 tx=0).stop 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb10e34640 1 -- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 msgr2=0x7fcb0c102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.679+0000 7fcb10e34640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 0x7fcb0c102cb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fcaf402a930 tx=0x7fcaf4004270 comp rx=0 tx=0).stop 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.680+0000 7fcb10e34640 1 -- 172.21.15.49:0/3171392002 shutdown_connections 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.680+0000 7fcb10e34640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcaf80b6680 0x7fcaf80b8b90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.680+0000 7fcb10e34640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcb0c10de10 0x7fcb0c1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.680+0000 7fcb10e34640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcb0c105290 0x7fcb0c102cb0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.680+0000 7fcb10e34640 1 --2- 172.21.15.49:0/3171392002 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcb0c104860 0x7fcb0c102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.680+0000 7fcb10e34640 1 -- 172.21.15.49:0/3171392002 >> 172.21.15.49:0/3171392002 conn(0x7fcb0c079730 msgr2=0x7fcb0c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.688 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.680+0000 7fcb10e34640 1 -- 172.21.15.49:0/3171392002 shutdown_connections 2024-09-21T06:46:31.689 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:31.680+0000 7fcb10e34640 1 -- 172.21.15.49:0/3171392002 wait complete. 2024-09-21T06:46:31.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:31 smithi049 ceph-mon[31177]: pgmap v623: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 11 op/s 2024-09-21T06:46:32.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:31 smithi098 ceph-mon[34704]: pgmap v623: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 11 op/s 2024-09-21T06:46:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:31 smithi079 ceph-mon[34346]: pgmap v623: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 11 op/s 2024-09-21T06:46:33.532 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:46:33.532 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:33.919 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:33 smithi049 ceph-mon[31177]: pgmap v624: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:46:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:33 smithi098 ceph-mon[34704]: pgmap v624: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:46:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:33 smithi079 ceph-mon[34346]: pgmap v624: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.232+0000 7f42b9dc0640 1 -- 172.21.15.49:0/1518865817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b4105330 msgr2=0x7f42b410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.232+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/1518865817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b4105330 0x7f42b410d880 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009900 tx=0x7f42a802a410 comp rx=0 tx=0).stop 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.232+0000 7f42b9dc0640 1 -- 172.21.15.49:0/1518865817 shutdown_connections 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.232+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/1518865817 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42b410de40 0x7f42b4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.232+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/1518865817 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b4105330 0x7f42b410d880 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.232+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/1518865817 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b41049e0 0x7f42b4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.232+0000 7f42b9dc0640 1 -- 172.21.15.49:0/1518865817 >> 172.21.15.49:0/1518865817 conn(0x7f42b4079750 msgr2=0x7f42b4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.232+0000 7f42b9dc0640 1 -- 172.21.15.49:0/1518865817 shutdown_connections 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.232+0000 7f42b9dc0640 1 -- 172.21.15.49:0/1518865817 wait complete. 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.233+0000 7f42b9dc0640 1 Processor -- start 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.233+0000 7f42b9dc0640 1 -- start start 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.233+0000 7f42b9dc0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b41049e0 0x7f42b419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.233+0000 7f42b9dc0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42b4105330 0x7f42b419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.233+0000 7f42b9dc0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b410de40 0x7f42b419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.233+0000 7f42b9dc0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4113aa0 con 0x7f42b410de40 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.233+0000 7f42b9dc0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4113920 con 0x7f42b41049e0 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.233+0000 7f42b9dc0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42b4113c20 con 0x7f42b4105330 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b410de40 0x7f42b419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b37fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b41049e0 0x7f42b419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b3fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b410de40 0x7f42b419fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58050/0 (socket says 172.21.15.49:58050) 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b3fff640 1 -- 172.21.15.49:0/2999805491 learned_addr learned my addr 172.21.15.49:0/2999805491 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42b4105330 0x7f42b419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b3fff640 1 -- 172.21.15.49:0/2999805491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42b4105330 msgr2=0x7f42b419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b3fff640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42b4105330 0x7f42b419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b3fff640 1 -- 172.21.15.49:0/2999805491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b41049e0 msgr2=0x7f42b419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b3fff640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b41049e0 0x7f42b419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b3fff640 1 -- 172.21.15.49:0/2999805491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b41a0360 con 0x7f42b410de40 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42b4105330 0x7f42b419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b3fff640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b410de40 0x7f42b419fcf0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00cce0 tx=0x7f42ac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b0ff9640 1 -- 172.21.15.49:0/2999805491 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00f450 con 0x7f42b410de40 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b9dc0640 1 -- 172.21.15.49:0/2999805491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42b41a0650 con 0x7f42b410de40 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b0ff9640 1 -- 172.21.15.49:0/2999805491 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42ac00faa0 con 0x7f42b410de40 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.234+0000 7f42b0ff9640 1 -- 172.21.15.49:0/2999805491 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ac018b70 con 0x7f42b410de40 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.235+0000 7f42b9dc0640 1 -- 172.21.15.49:0/2999805491 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42b41a6e70 con 0x7f42b410de40 2024-09-21T06:46:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.237+0000 7f42c0334740 1 Processor -- start 2024-09-21T06:46:34.240 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.237+0000 7f42b0ff9640 1 -- 172.21.15.49:0/2999805491 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f42ac018d10 con 0x7f42b410de40 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.237+0000 7f42c0334740 1 -- start start 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42c0334740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aeb5350 0x55675b25c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42c0334740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 0x55675b25c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42c0334740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 0x55675b25ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42c0334740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55675b1d2e60 con 0x55675aeb5350 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42c0334740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55675b1c2290 con 0x55675ae94670 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42c0334740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55675b1c60a0 con 0x55675ae8c490 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aeb5350 0x55675b25c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aeb5350 0x55675b25c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58054/0 (socket says 172.21.15.49:58054) 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b2ffd640 1 -- 172.21.15.49:0/1877736154 learned_addr learned my addr 172.21.15.49:0/1877736154 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b37fe640 1 --2- 172.21.15.49:0/1877736154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 0x55675b25c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/1877736154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 0x55675b25ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b0ff9640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f429c0b6730 0x7f429c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b2ffd640 1 -- 172.21.15.49:0/1877736154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 msgr2=0x55675b25c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/1877736154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 0x55675b25c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b2ffd640 1 -- 172.21.15.49:0/1877736154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 msgr2=0x55675b25ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/1877736154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 0x55675b25ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.238+0000 7f42b2ffd640 1 -- 172.21.15.49:0/1877736154 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675af20930 con 0x55675aeb5350 2024-09-21T06:46:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.239+0000 7f42b3fff640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f429c0b6730 0x7f429c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.239+0000 7f42b0ff9640 1 -- 172.21.15.49:0/2999805491 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f42ac0e7b60 con 0x7f42b410de40 2024-09-21T06:46:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.239+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/1877736154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aeb5350 0x55675b25c430 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f42a8031440 tx=0x7f42a80058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb975166a88c748 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.239+0000 7f4299ffb640 1 -- 172.21.15.49:0/1877736154 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8035050 con 0x55675aeb5350 2024-09-21T06:46:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.239+0000 7f4299ffb640 1 -- 172.21.15.49:0/1877736154 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42a8031780 con 0x55675aeb5350 2024-09-21T06:46:34.242 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.239+0000 7f4299ffb640 1 -- 172.21.15.49:0/1877736154 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a80046c0 con 0x55675aeb5350 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 -- 172.21.15.49:0/1877736154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aeb5350 msgr2=0x55675b25c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42b3fff640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f429c0b6730 0x7f429c0b8c40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0e5860 tx=0x7f42ac076480 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 --2- 172.21.15.49:0/1877736154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aeb5350 0x55675b25c430 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f42a8031440 tx=0x7f42a80058b0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 -- 172.21.15.49:0/1877736154 shutdown_connections 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 --2- 172.21.15.49:0/1877736154 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 0x55675b25ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 --2- 172.21.15.49:0/1877736154 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 0x55675b25c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 --2- 172.21.15.49:0/1877736154 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aeb5350 0x55675b25c430 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 -- 172.21.15.49:0/1877736154 >> 172.21.15.49:0/1877736154 conn(0x55675aea9740 msgr2=0x55675b25a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 -- 172.21.15.49:0/1877736154 shutdown_connections 2024-09-21T06:46:34.245 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 -- 172.21.15.49:0/1877736154 wait complete. 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.240+0000 7f42c0334740 1 -- start start 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42c0334740 1 Processor -- start 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42c0334740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae8c490 0x55675b26c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42c0334740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae94670 0x55675b26c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42c0334740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675aeb5350 0x55675b278270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42c0334740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55675b023890 con 0x55675ae8c490 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42c0334740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55675b15cd40 con 0x55675aeb5350 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42c0334740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55675b26ef10 con 0x55675ae94670 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42c0334740 10 client.0 _ll_register_callbacks cb 0x55675b1c0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae8c490 0x55675b26c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae8c490 0x55675b26c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58064/0 (socket says 172.21.15.49:58064) 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2424985548 learned_addr learned my addr 172.21.15.49:0/2424985548 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b37fe640 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae94670 0x55675b26c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2424985548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae94670 msgr2=0x55675b26c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:34.246 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae94670 0x55675b26c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2424985548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675aeb5350 msgr2=0x55675b278270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675aeb5350 0x55675b278270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2424985548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675b278860 con 0x55675ae8c490 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.241+0000 7f42b37fe640 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae94670 0x55675b26c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.242+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae8c490 0x55675b26c440 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009660 tx=0x7f42a8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d296858fe88d73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.242+0000 7f4292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.242+0000 7f4292ffd640 1 -- 172.21.15.49:0/2424985548 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8035040 con 0x55675ae8c490 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.242+0000 7f4292ffd640 1 -- 172.21.15.49:0/2424985548 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f42a8003800 con 0x55675ae8c490 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.242+0000 7f42c0334740 1 -- 172.21.15.49:0/2424985548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42a8031780 con 0x55675ae8c490 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.242+0000 7f4292ffd640 1 -- 172.21.15.49:0/2424985548 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f42a8056050 con 0x55675ae8c490 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.242+0000 7f42c0334740 10 client.17943 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.242+0000 7f42c0334740 1 -- 172.21.15.49:0/2424985548 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55675b27b170 con 0x55675ae8c490 2024-09-21T06:46:34.247 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.242+0000 7f4292ffd640 1 -- 172.21.15.49:0/2424985548 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42a8031780 con 0x55675ae8c490 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f4292ffd640 1 -- 172.21.15.49:0/2424985548 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f42a803a850 con 0x55675ae8c490 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f42c0334740 10 client.17943 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f42c0334740 10 client.17943 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f42c0334740 20 client.17943 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f42c0334740 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55675ae73cd0 0x55675b27e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f42c0334740 4 client.17943 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f42c0334740 1 -- 172.21.15.49:0/2424985548 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55675b1d4db0 con 0x55675ae73cd0 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f42b37fe640 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55675ae73cd0 0x55675b27e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f4292ffd640 10 client.17943 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:34.248 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.243+0000 7f42b37fe640 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55675ae73cd0 0x55675b27e4d0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5dcda06d56c06e2 server_cookie=231346ef80dfb702 in_seq=0 out_seq=0 2024-09-21T06:46:34.249 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.244+0000 7f4292ffd640 1 -- 172.21.15.49:0/2424985548 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55675b1d4db0 con 0x55675ae73cd0 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.244+0000 7f4292ffd640 10 client.17943 handle_command_reply: tid=0 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.244+0000 7f42c0334740 1 client.17943 shutdown 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.244+0000 7f42c0334740 1 -- 172.21.15.49:0/2424985548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae8c490 msgr2=0x55675b26c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.244+0000 7f42c0334740 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae8c490 0x55675b26c440 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f42a8009660 tx=0x7f42a8005a20 comp rx=0 tx=0).stop 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f42c0334740 1 -- 172.21.15.49:0/2424985548 shutdown_connections 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f42c0334740 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55675ae73cd0 0x55675b27e4d0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f42c0334740 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675aeb5350 0x55675b278270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f42c0334740 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae94670 0x55675b26c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f42c0334740 1 --2- 172.21.15.49:0/2424985548 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae8c490 0x55675b26c440 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f42c0334740 1 -- 172.21.15.49:0/2424985548 >> 172.21.15.49:0/2424985548 conn(0x55675aea9740 msgr2=0x55675b258850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f4292ffd640 0 client.17943 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f42c0334740 1 -- 172.21.15.49:0/2424985548 shutdown_connections 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f42c0334740 1 -- 172.21.15.49:0/2424985548 wait complete. 2024-09-21T06:46:34.250 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.245+0000 7f42c0334740 20 client.17943 trim_cache size 0 max 16384 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.262+0000 7f42c0334740 1 Processor -- start 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.262+0000 7f42c0334740 1 -- start start 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42c0334740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675aea9740 0x55675b25de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42c0334740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae8c490 0x55675b26b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42c0334740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae94670 0x55675b269430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42c0334740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41afc50 con 0x55675ae94670 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42c0334740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41ad520 con 0x55675ae8c490 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42c0334740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41ab390 con 0x55675aea9740 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae94670 0x55675b269430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae94670 0x55675b269430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58080/0 (socket says 172.21.15.49:58080) 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2106164746 learned_addr learned my addr 172.21.15.49:0/2106164746 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:34.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b37fe640 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae8c490 0x55675b26b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675aea9740 0x55675b25de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2106164746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675aea9740 msgr2=0x55675b25de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675aea9740 0x55675b25de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2106164746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae8c490 msgr2=0x55675b26b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae8c490 0x55675b26b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2106164746 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55675b25f260 con 0x55675ae94670 2024-09-21T06:46:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b37fe640 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae8c490 0x55675b26b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:34.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.263+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae94670 0x55675b269430 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f42a803aca0 tx=0x7f42a80054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d744f9ee89ab8c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42997fa640 1 -- 172.21.15.49:0/2106164746 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8060070 con 0x55675ae94670 2024-09-21T06:46:34.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42997fa640 1 -- 172.21.15.49:0/2106164746 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42a804d070 con 0x55675ae94670 2024-09-21T06:46:34.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42997fa640 1 -- 172.21.15.49:0/2106164746 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8035040 con 0x55675ae94670 2024-09-21T06:46:34.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42c0334740 1 -- 172.21.15.49:0/2106164746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae94670 msgr2=0x55675b269430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42c0334740 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae94670 0x55675b269430 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f42a803aca0 tx=0x7f42a80054a0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42c0334740 1 -- 172.21.15.49:0/2106164746 shutdown_connections 2024-09-21T06:46:34.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42c0334740 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675ae94670 0x55675b269430 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42c0334740 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae8c490 0x55675b26b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42c0334740 1 --2- 172.21.15.49:0/2106164746 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675aea9740 0x55675b25de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42c0334740 1 -- 172.21.15.49:0/2106164746 >> 172.21.15.49:0/2106164746 conn(0x55675b25ea90 msgr2=0x55675b258ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42c0334740 1 -- 172.21.15.49:0/2106164746 shutdown_connections 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.264+0000 7f42c0334740 1 -- 172.21.15.49:0/2106164746 wait complete. 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42c0334740 1 -- start start 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42c0334740 1 Processor -- start 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42c0334740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 0x55675b27f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42c0334740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 0x55675b27ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42c0334740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aea9740 0x55675b2e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42c0334740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41ab9e0 con 0x55675aea9740 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42c0334740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41ace50 con 0x55675ae94670 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42c0334740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42b41ac0b0 con 0x55675ae8c490 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42c0334740 10 client.0 _ll_register_callbacks cb 0x7f42a400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.265+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aea9740 0x55675b2e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aea9740 0x55675b2e7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58094/0 (socket says 172.21.15.49:58094) 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2497674857 learned_addr learned my addr 172.21.15.49:0/2497674857 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 0x55675b27f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b37fe640 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 0x55675b27ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2497674857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 msgr2=0x55675b27f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 0x55675b27f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2497674857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 msgr2=0x55675b27ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 0x55675b27ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b2ffd640 1 -- 172.21.15.49:0/2497674857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55675b2e8190 con 0x55675aea9740 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42b2ffd640 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aea9740 0x55675b2e7c50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f42a803ad40 tx=0x7f42a8031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3da44c8ee4e26e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f4292ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f4292ffd640 1 -- 172.21.15.49:0/2497674857 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a8060040 con 0x55675aea9740 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f4292ffd640 1 -- 172.21.15.49:0/2497674857 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f42a8003c10 con 0x55675aea9740 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.266+0000 7f42c0334740 1 -- 172.21.15.49:0/2497674857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42a804d070 con 0x55675aea9740 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f4292ffd640 1 -- 172.21.15.49:0/2497674857 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f42a8035040 con 0x55675aea9740 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f42c0334740 10 client.17949 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:34.271 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f42c0334740 1 -- 172.21.15.49:0/2497674857 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55675b2e92c0 con 0x55675aea9740 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f4292ffd640 1 -- 172.21.15.49:0/2497674857 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42a804d070 con 0x55675aea9740 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f4292ffd640 1 -- 172.21.15.49:0/2497674857 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f42a803d780 con 0x55675aea9740 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f42c0334740 10 client.17949 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f42c0334740 10 client.17949 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f42c0334740 20 client.17949 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f42c0334740 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55675aeb5350 0x55675b2eb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f42c0334740 4 client.17949 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f42c0334740 1 -- 172.21.15.49:0/2497674857 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55675b1d0860 con 0x55675aeb5350 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.267+0000 7f42b37fe640 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55675aeb5350 0x55675b2eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.268+0000 7f42b37fe640 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55675aeb5350 0x55675b2eb900 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=415454f509db376e server_cookie=a0384ef620b166a5 in_seq=0 out_seq=0 2024-09-21T06:46:34.272 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.268+0000 7f4292ffd640 10 client.17949 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:34.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.269+0000 7f4292ffd640 1 -- 172.21.15.49:0/2497674857 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55675b1d0860 con 0x55675aeb5350 2024-09-21T06:46:34.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.269+0000 7f4292ffd640 10 client.17949 handle_command_reply: tid=0 2024-09-21T06:46:34.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.269+0000 7f42c0334740 1 client.17949 shutdown 2024-09-21T06:46:34.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 -- 172.21.15.49:0/2497674857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aea9740 msgr2=0x55675b2e7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aea9740 0x55675b2e7c50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f42a803ad40 tx=0x7f42a8031400 comp rx=0 tx=0).stop 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 -- 172.21.15.49:0/2497674857 shutdown_connections 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55675aeb5350 0x55675b2eb900 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55675aea9740 0x55675b2e7c50 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55675ae94670 0x55675b27ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f4292ffd640 0 client.17949 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 --2- 172.21.15.49:0/2497674857 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55675ae8c490 0x55675b27f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 -- 172.21.15.49:0/2497674857 >> 172.21.15.49:0/2497674857 conn(0x55675b25ea90 msgr2=0x55675b25dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 -- 172.21.15.49:0/2497674857 shutdown_connections 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 1 -- 172.21.15.49:0/2497674857 wait complete. 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.270+0000 7f42c0334740 20 client.17949 trim_cache size 0 max 16384 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:46:34.274 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:46:34.275 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "33526aec-feb7-4620-9880-2a7dd5991954", 2024-09-21T06:46:34.275 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:46:34.275 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:46:34.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 -- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f429c0b6730 msgr2=0x7f429c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f429c0b6730 0x7f429c0b8c40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0e5860 tx=0x7f42ac076480 comp rx=0 tx=0).stop 2024-09-21T06:46:34.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 -- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b410de40 msgr2=0x7f42b419fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b410de40 0x7f42b419fcf0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00cce0 tx=0x7f42ac00a620 comp rx=0 tx=0).stop 2024-09-21T06:46:34.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 -- 172.21.15.49:0/2999805491 shutdown_connections 2024-09-21T06:46:34.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f429c0b6730 0x7f429c0b8c40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42b410de40 0x7f42b419fcf0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f42b4105330 0x7f42b419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 --2- 172.21.15.49:0/2999805491 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42b41049e0 0x7f42b419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 -- 172.21.15.49:0/2999805491 >> 172.21.15.49:0/2999805491 conn(0x7f42b4079750 msgr2=0x7f42b4100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 -- 172.21.15.49:0/2999805491 shutdown_connections 2024-09-21T06:46:34.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:34.271+0000 7f42b9dc0640 1 -- 172.21.15.49:0/2999805491 wait complete. 2024-09-21T06:46:34.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:34 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:46:34.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:34 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:46:34.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:34 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:46:34.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:34 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:46:34.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:34 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:46:34.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:34 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:46:34.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:34 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:46:34.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:34 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:46:35.013 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:46:35.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:34 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:46:35.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:34 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:46:35.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:34 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:46:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:34 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:46:35.269 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.599+0000 7fe236a7e640 1 -- 172.21.15.49:0/475997819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 msgr2=0x7fe2301106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.599+0000 7fe236a7e640 1 --2- 172.21.15.49:0/475997819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 0x7fe2301106e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe228009ca0 tx=0x7fe22802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.599+0000 7fe236a7e640 1 -- 172.21.15.49:0/475997819 shutdown_connections 2024-09-21T06:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.599+0000 7fe236a7e640 1 --2- 172.21.15.49:0/475997819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 0x7fe2301106e0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.599+0000 7fe236a7e640 1 --2- 172.21.15.49:0/475997819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe230109540 0x7fe230109950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.599+0000 7fe236a7e640 1 --2- 172.21.15.49:0/475997819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe230102020 0x7fe230102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.599+0000 7fe236a7e640 1 -- 172.21.15.49:0/475997819 >> 172.21.15.49:0/475997819 conn(0x7fe230079e50 msgr2=0x7fe23007a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.600+0000 7fe236a7e640 1 -- 172.21.15.49:0/475997819 shutdown_connections 2024-09-21T06:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.600+0000 7fe236a7e640 1 -- 172.21.15.49:0/475997819 wait complete. 2024-09-21T06:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.600+0000 7fe236a7e640 1 Processor -- start 2024-09-21T06:46:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.600+0000 7fe236a7e640 1 -- start start 2024-09-21T06:46:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe236a7e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe230102020 0x7fe23019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe236a7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe230109540 0x7fe23019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe236a7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 0x7fe23019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe236a7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe230113b20 con 0x7fe230109e90 2024-09-21T06:46:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe236a7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301139a0 con 0x7fe230109540 2024-09-21T06:46:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe236a7e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe230113ca0 con 0x7fe230102020 2024-09-21T06:46:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23501b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 0x7fe23019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23501b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 0x7fe23019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58102/0 (socket says 172.21.15.49:58102) 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23501b640 1 -- 172.21.15.49:0/4033870790 learned_addr learned my addr 172.21.15.49:0/4033870790 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe22ffff640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe230109540 0x7fe23019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23481a640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe230102020 0x7fe23019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23501b640 1 -- 172.21.15.49:0/4033870790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe230102020 msgr2=0x7fe23019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23501b640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe230102020 0x7fe23019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23501b640 1 -- 172.21.15.49:0/4033870790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe230109540 msgr2=0x7fe23019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23501b640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe230109540 0x7fe23019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23501b640 1 -- 172.21.15.49:0/4033870790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2301a03d0 con 0x7fe230109e90 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe22ffff640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe230109540 0x7fe23019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.601+0000 7fe23501b640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 0x7fe23019fcd0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe2280098d0 tx=0x7fe2280317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.602+0000 7fe22dffb640 1 -- 172.21.15.49:0/4033870790 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228003b70 con 0x7fe230109e90 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.602+0000 7fe22dffb640 1 -- 172.21.15.49:0/4033870790 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe228003d10 con 0x7fe230109e90 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.602+0000 7fe236a7e640 1 -- 172.21.15.49:0/4033870790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2301a0660 con 0x7fe230109e90 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.602+0000 7fe22dffb640 1 -- 172.21.15.49:0/4033870790 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22802fa20 con 0x7fe230109e90 2024-09-21T06:46:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.602+0000 7fe236a7e640 1 -- 172.21.15.49:0/4033870790 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2301a6e50 con 0x7fe230109e90 2024-09-21T06:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.604+0000 7fe23d9ea740 1 Processor -- start 2024-09-21T06:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.604+0000 7fe22dffb640 1 -- 172.21.15.49:0/4033870790 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fe22802fc40 con 0x7fe230109e90 2024-09-21T06:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe23d9ea740 1 -- start start 2024-09-21T06:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3316d1b0 0x556a335129b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a331442f0 0x556a33512ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 0x556a33513430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a334876f0 con 0x556a3316d1b0 2024-09-21T06:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556a33476b20 con 0x556a331442f0 2024-09-21T06:46:35.608 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556a3347a930 con 0x556a3314c4d0 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3316d1b0 0x556a335129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3316d1b0 0x556a335129b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58114/0 (socket says 172.21.15.49:58114) 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe22ffff640 1 -- 172.21.15.49:0/1392432041 learned_addr learned my addr 172.21.15.49:0/1392432041 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe23481a640 1 --2- 172.21.15.49:0/1392432041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a331442f0 0x556a33512ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.605+0000 7fe22ffff640 1 --2- 172.21.15.49:0/1392432041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 0x556a33513430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe22dffb640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe2200b6680 0x7fe2200b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe22ffff640 1 -- 172.21.15.49:0/1392432041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 msgr2=0x556a33513430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe22ffff640 1 --2- 172.21.15.49:0/1392432041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 0x556a33513430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe22ffff640 1 -- 172.21.15.49:0/1392432041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a331442f0 msgr2=0x556a33512ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe22ffff640 1 --2- 172.21.15.49:0/1392432041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a331442f0 0x556a33512ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe23501b640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe2200b6680 0x7fe2200b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe22ffff640 1 -- 172.21.15.49:0/1392432041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3343c530 con 0x556a3316d1b0 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe22dffb640 1 -- 172.21.15.49:0/4033870790 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7fe2281089e0 con 0x7fe230109e90 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe22ffff640 1 --2- 172.21.15.49:0/1392432041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3316d1b0 0x556a335129b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe230075930 tx=0x7fe21c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ddc4c14dcb431c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.609 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe21affd640 1 -- 172.21.15.49:0/1392432041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c004020 con 0x556a3316d1b0 2024-09-21T06:46:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe23501b640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe2200b6680 0x7fe2200b8b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe228106190 tx=0x7fe22809bbd0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe21affd640 1 -- 172.21.15.49:0/1392432041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21c00ed80 con 0x556a3316d1b0 2024-09-21T06:46:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.606+0000 7fe21affd640 1 -- 172.21.15.49:0/1392432041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c005440 con 0x556a3316d1b0 2024-09-21T06:46:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.607+0000 7fe23d9ea740 1 -- 172.21.15.49:0/1392432041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3316d1b0 msgr2=0x556a335129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.607+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/1392432041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3316d1b0 0x556a335129b0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe230075930 tx=0x7fe21c00bbb0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.607+0000 7fe23d9ea740 1 -- 172.21.15.49:0/1392432041 shutdown_connections 2024-09-21T06:46:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.607+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/1392432041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 0x556a33513430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.614 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.607+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/1392432041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a331442f0 0x556a33512ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.607+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/1392432041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3316d1b0 0x556a335129b0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.607+0000 7fe23d9ea740 1 -- 172.21.15.49:0/1392432041 >> 172.21.15.49:0/1392432041 conn(0x556a33161300 msgr2=0x556a335108a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.607+0000 7fe23d9ea740 1 -- 172.21.15.49:0/1392432041 shutdown_connections 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.607+0000 7fe23d9ea740 1 -- 172.21.15.49:0/1392432041 wait complete. 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23d9ea740 1 -- start start 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23d9ea740 1 Processor -- start 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 0x556a3351e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a3351e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3316d1b0 0x556a3352a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x556a333aeab0 con 0x556a3314c4d0 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x556a3341c730 con 0x556a3316d1b0 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x556a335210d0 con 0x556a331442f0 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23d9ea740 10 client.0 _ll_register_callbacks cb 0x556a334706b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:35.615 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23481a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a3351e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23481a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a3351e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58130/0 (socket says 172.21.15.49:58130) 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.608+0000 7fe23481a640 1 -- 172.21.15.49:0/898591987 learned_addr learned my addr 172.21.15.49:0/898591987 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe22ffff640 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 0x556a3351e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe22ffff640 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3316d1b0 0x556a3352a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe23481a640 1 -- 172.21.15.49:0/898591987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 msgr2=0x556a3351e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe23481a640 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 0x556a3351e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe23481a640 1 -- 172.21.15.49:0/898591987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3316d1b0 msgr2=0x556a3352a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe23481a640 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3316d1b0 0x556a3352a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe23481a640 1 -- 172.21.15.49:0/898591987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a331d8790 con 0x556a3314c4d0 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe22ffff640 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3316d1b0 0x556a3352a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe23481a640 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a3351e590 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe224012720 tx=0x7fe224012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94c5f6ba4ebab13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe20ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:35.616 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe20ffff640 1 -- 172.21.15.49:0/898591987 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224004050 con 0x556a3314c4d0 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe20ffff640 1 -- 172.21.15.49:0/898591987 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7fe2240041f0 con 0x556a3314c4d0 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe23d9ea740 1 -- 172.21.15.49:0/898591987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c00ed80 con 0x556a3314c4d0 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe20ffff640 1 -- 172.21.15.49:0/898591987 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe2240043f0 con 0x556a3314c4d0 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe23d9ea740 10 client.17961 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.609+0000 7fe23d9ea740 1 -- 172.21.15.49:0/898591987 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a33251620 con 0x556a3314c4d0 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.610+0000 7fe20ffff640 1 -- 172.21.15.49:0/898591987 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21c00ed80 con 0x556a3314c4d0 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.610+0000 7fe20ffff640 1 -- 172.21.15.49:0/898591987 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe224003b50 con 0x556a3314c4d0 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.610+0000 7fe23d9ea740 10 client.17961 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.610+0000 7fe23d9ea740 10 client.17961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.610+0000 7fe23d9ea740 20 client.17961 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.610+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556a3312bd80 0x556a33530270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.610+0000 7fe23d9ea740 4 client.17961 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.610+0000 7fe23d9ea740 1 -- 172.21.15.49:0/898591987 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a33489640 con 0x556a3312bd80 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.610+0000 7fe22ffff640 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556a3312bd80 0x556a33530270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.611+0000 7fe20ffff640 10 client.17961 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:35.617 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.611+0000 7fe22ffff640 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556a3312bd80 0x556a33530270 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41d12e4b11290cca server_cookie=52910e001819674a in_seq=0 out_seq=0 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe20ffff640 1 -- 172.21.15.49:0/898591987 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556a33489640 con 0x556a3312bd80 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe20ffff640 10 client.17961 handle_command_reply: tid=0 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 client.17961 shutdown 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 -- 172.21.15.49:0/898591987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 msgr2=0x556a3351e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a3351e590 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe224012720 tx=0x7fe224012be0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 -- 172.21.15.49:0/898591987 shutdown_connections 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556a3312bd80 0x556a33530270 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3316d1b0 0x556a3352a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a3351e590 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe20ffff640 0 client.17961 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/898591987 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 0x556a3351e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 -- 172.21.15.49:0/898591987 >> 172.21.15.49:0/898591987 conn(0x556a33161300 msgr2=0x556a335139e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 -- 172.21.15.49:0/898591987 shutdown_connections 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 1 -- 172.21.15.49:0/898591987 wait complete. 2024-09-21T06:46:35.618 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.612+0000 7fe23d9ea740 20 client.17961 trim_cache size 0 max 16384 2024-09-21T06:46:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23d9ea740 1 Processor -- start 2024-09-21T06:46:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23d9ea740 1 -- start start 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 0x556a335140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a331442f0 0x556a3352a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 0x556a3351b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301b20b0 con 0x556a331442f0 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301af980 con 0x556a3312bd80 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301ad7f0 con 0x556a3314c4d0 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23481a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a331442f0 0x556a3352a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23481a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a331442f0 0x556a3352a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58138/0 (socket says 172.21.15.49:58138) 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23481a640 1 -- 172.21.15.49:0/3274762835 learned_addr learned my addr 172.21.15.49:0/3274762835 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe22ffff640 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 0x556a335140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe22ffff640 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 0x556a3351b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23481a640 1 -- 172.21.15.49:0/3274762835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 msgr2=0x556a3351b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23481a640 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 0x556a3351b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23481a640 1 -- 172.21.15.49:0/3274762835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 msgr2=0x556a335140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23481a640 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 0x556a335140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe23481a640 1 -- 172.21.15.49:0/3274762835 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3351f310 con 0x556a331442f0 2024-09-21T06:46:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.627+0000 7fe22ffff640 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 0x556a335140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.628+0000 7fe23481a640 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a331442f0 0x556a3352a350 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fe224003f70 tx=0x7fe2240108b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa304637e5e5aff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.628+0000 7fe21a7fc640 1 -- 172.21.15.49:0/3274762835 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224028040 con 0x556a331442f0 2024-09-21T06:46:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.628+0000 7fe21a7fc640 1 -- 172.21.15.49:0/3274762835 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe224004000 con 0x556a331442f0 2024-09-21T06:46:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.628+0000 7fe21a7fc640 1 -- 172.21.15.49:0/3274762835 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2240052d0 con 0x556a331442f0 2024-09-21T06:46:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3274762835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a331442f0 msgr2=0x556a3352a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a331442f0 0x556a3352a350 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fe224003f70 tx=0x7fe2240108b0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3274762835 shutdown_connections 2024-09-21T06:46:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a3314c4d0 0x556a3351b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a331442f0 0x556a3352a350 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3274762835 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 0x556a335140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3274762835 >> 172.21.15.49:0/3274762835 conn(0x556a33161300 msgr2=0x556a335139e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3274762835 shutdown_connections 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3274762835 wait complete. 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 -- start start 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.629+0000 7fe23d9ea740 1 Processor -- start 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 0x556a33523580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 0x556a33523ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe23d9ea740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a33524000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301ade40 con 0x556a3314c4d0 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301af2b0 con 0x556a3312bd80 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe23d9ea740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe2301ae510 con 0x556a331442f0 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe23d9ea740 10 client.0 _ll_register_callbacks cb 0x7fe224009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a33524000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe22ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a33524000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58152/0 (socket says 172.21.15.49:58152) 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe22ffff640 1 -- 172.21.15.49:0/3547480626 learned_addr learned my addr 172.21.15.49:0/3547480626 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe22ffff640 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 0x556a33523580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe23481a640 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 0x556a33523ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe22ffff640 1 -- 172.21.15.49:0/3547480626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 msgr2=0x556a33523ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe22ffff640 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 0x556a33523ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe22ffff640 1 -- 172.21.15.49:0/3547480626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 msgr2=0x556a33523580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe22ffff640 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 0x556a33523580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe22ffff640 1 -- 172.21.15.49:0/3547480626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a33598e00 con 0x556a3314c4d0 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.630+0000 7fe23481a640 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 0x556a33523ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe22ffff640 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a33524000 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fe21c012790 tx=0x7fe21c022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0bd7a908ca822f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe20ffff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe20ffff640 1 -- 172.21.15.49:0/3547480626 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00eae0 con 0x556a3314c4d0 2024-09-21T06:46:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe20ffff640 1 -- 172.21.15.49:0/3547480626 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7fe21c00ec80 con 0x556a3314c4d0 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3547480626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe224004000 con 0x556a3314c4d0 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe20ffff640 1 -- 172.21.15.49:0/3547480626 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe21c03a050 con 0x556a3314c4d0 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe23d9ea740 10 client.17967 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3547480626 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x556a3359a090 con 0x556a3314c4d0 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe20ffff640 1 -- 172.21.15.49:0/3547480626 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe224004000 con 0x556a3314c4d0 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe20ffff640 1 -- 172.21.15.49:0/3547480626 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe21c01c070 con 0x556a3314c4d0 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe23d9ea740 10 client.17967 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe23d9ea740 10 client.17967 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe23d9ea740 20 client.17967 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556a3316d1b0 0x556a3359c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe23d9ea740 4 client.17967 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.631+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3547480626 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556a334850f0 con 0x556a3316d1b0 2024-09-21T06:46:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.632+0000 7fe23481a640 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556a3316d1b0 0x556a3359c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.632+0000 7fe20ffff640 10 client.17967 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.632+0000 7fe23481a640 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556a3316d1b0 0x556a3359c680 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eede31b33facbde5 server_cookie=810bac57c692e7b4 in_seq=0 out_seq=0 2024-09-21T06:46:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe20ffff640 1 -- 172.21.15.49:0/3547480626 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556a334850f0 con 0x556a3316d1b0 2024-09-21T06:46:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe20ffff640 10 client.17967 handle_command_reply: tid=0 2024-09-21T06:46:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe23d9ea740 1 client.17967 shutdown 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3547480626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 msgr2=0x556a33524000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a33524000 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fe21c012790 tx=0x7fe21c022040 comp rx=0 tx=0).stop 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3547480626 shutdown_connections 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x556a3316d1b0 0x556a3359c680 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x556a3314c4d0 0x556a33524000 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x556a331442f0 0x556a33523ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe20ffff640 0 client.17967 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe23d9ea740 1 --2- 172.21.15.49:0/3547480626 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x556a3312bd80 0x556a33523580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.640+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3547480626 >> 172.21.15.49:0/3547480626 conn(0x556a33161300 msgr2=0x556a33510880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3547480626 shutdown_connections 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe23d9ea740 1 -- 172.21.15.49:0/3547480626 wait complete. 2024-09-21T06:46:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe23d9ea740 20 client.17967 trim_cache size 0 max 16384 2024-09-21T06:46:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:46:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:46:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:46:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:46:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 -- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe2200b6680 msgr2=0x7fe2200b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe2200b6680 0x7fe2200b8b90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe228106190 tx=0x7fe22809bbd0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 -- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 msgr2=0x7fe23019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 0x7fe23019fcd0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe2280098d0 tx=0x7fe2280317b0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 -- 172.21.15.49:0/4033870790 shutdown_connections 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe2200b6680 0x7fe2200b8b90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe230109e90 0x7fe23019fcd0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe230109540 0x7fe23019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 --2- 172.21.15.49:0/4033870790 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe230102020 0x7fe23019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.641+0000 7fe236a7e640 1 -- 172.21.15.49:0/4033870790 >> 172.21.15.49:0/4033870790 conn(0x7fe230079e50 msgr2=0x7fe2301064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.642+0000 7fe236a7e640 1 -- 172.21.15.49:0/4033870790 shutdown_connections 2024-09-21T06:46:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:35.642+0000 7fe236a7e640 1 -- 172.21.15.49:0/4033870790 wait complete. 2024-09-21T06:46:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.695+0000 7f814c9f5640 1 -- 172.21.15.49:0/3626923353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 msgr2=0x7f8148102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.695+0000 7f814c9f5640 1 --2- 172.21.15.49:0/3626923353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 0x7f8148102e70 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f8138009900 tx=0x7f813802a410 comp rx=0 tx=0).stop 2024-09-21T06:46:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.695+0000 7f814c9f5640 1 -- 172.21.15.49:0/3626923353 shutdown_connections 2024-09-21T06:46:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.695+0000 7f814c9f5640 1 --2- 172.21.15.49:0/3626923353 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8148108cf0 0x7f814810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.695+0000 7f814c9f5640 1 --2- 172.21.15.49:0/3626923353 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81481083a0 0x7f81481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.749 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.695+0000 7f814c9f5640 1 --2- 172.21.15.49:0/3626923353 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 0x7f8148102e70 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.695+0000 7f814c9f5640 1 -- 172.21.15.49:0/3626923353 >> 172.21.15.49:0/3626923353 conn(0x7f8148079730 msgr2=0x7f8148079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.695+0000 7f814c9f5640 1 -- 172.21.15.49:0/3626923353 shutdown_connections 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.695+0000 7f814c9f5640 1 -- 172.21.15.49:0/3626923353 wait complete. 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.696+0000 7f814c9f5640 1 Processor -- start 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.696+0000 7f814c9f5640 1 -- start start 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.696+0000 7f814c9f5640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 0x7f814819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.696+0000 7f814c9f5640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81481083a0 0x7f814819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814c9f5640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8148108cf0 0x7f814819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814c9f5640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8148113a80 con 0x7f8148102a60 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814c9f5640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8148113900 con 0x7f8148108cf0 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814c9f5640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8148113c00 con 0x7f81481083a0 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 0x7f814819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814659c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 0x7f814819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58164/0 (socket says 172.21.15.49:58164) 2024-09-21T06:46:35.750 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814659c640 1 -- 172.21.15.49:0/925604062 learned_addr learned my addr 172.21.15.49:0/925604062 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f8145d9b640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81481083a0 0x7f814819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f8146d9d640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8148108cf0 0x7f814819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814659c640 1 -- 172.21.15.49:0/925604062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81481083a0 msgr2=0x7f814819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814659c640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81481083a0 0x7f814819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814659c640 1 -- 172.21.15.49:0/925604062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8148108cf0 msgr2=0x7f814819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814659c640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8148108cf0 0x7f814819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814659c640 1 -- 172.21.15.49:0/925604062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81481a03a0 con 0x7f8148102a60 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f8146d9d640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8148108cf0 0x7f814819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814659c640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 0x7f814819a430 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f8138005940 tx=0x7f8138004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f813f7fe640 1 -- 172.21.15.49:0/925604062 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813803f030 con 0x7f8148102a60 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f813f7fe640 1 -- 172.21.15.49:0/925604062 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8138003aa0 con 0x7f8148102a60 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814c9f5640 1 -- 172.21.15.49:0/925604062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81481a0630 con 0x7f8148102a60 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f813f7fe640 1 -- 172.21.15.49:0/925604062 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8138035070 con 0x7f8148102a60 2024-09-21T06:46:35.751 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.697+0000 7f814c9f5640 1 -- 172.21.15.49:0/925604062 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81481a6df0 con 0x7f8148102a60 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.700+0000 7f8152f69740 1 Processor -- start 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8152f69740 1 -- start start 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f813f7fe640 1 -- 172.21.15.49:0/925604062 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8138042030 con 0x7f8148102a60 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8152f69740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9d9070 0x55bfccd80650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8152f69740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 0x55bfccd80b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8152f69740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b8390 0x55bfccd810d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8152f69740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bfcccf6e50 con 0x55bfcc9d9070 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8152f69740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bfccce6280 con 0x55bfcc9b8390 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8152f69740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bfcccea090 con 0x55bfcc9b01b0 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8146d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9d9070 0x55bfccd80650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8146d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9d9070 0x55bfccd80650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58166/0 (socket says 172.21.15.49:58166) 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8146d9d640 1 -- 172.21.15.49:0/770881965 learned_addr learned my addr 172.21.15.49:0/770881965 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f814659c640 1 --2- 172.21.15.49:0/770881965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 0x55bfccd80b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8145d9b640 1 --2- 172.21.15.49:0/770881965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b8390 0x55bfccd810d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8146d9d640 1 -- 172.21.15.49:0/770881965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 msgr2=0x55bfccd80b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8146d9d640 1 --2- 172.21.15.49:0/770881965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 0x55bfccd80b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8146d9d640 1 -- 172.21.15.49:0/770881965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b8390 msgr2=0x55bfccd810d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8146d9d640 1 --2- 172.21.15.49:0/770881965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b8390 0x55bfccd810d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.701+0000 7f8146d9d640 1 -- 172.21.15.49:0/770881965 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfcca44650 con 0x55bfcc9d9070 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.702+0000 7f8146d9d640 1 --2- 172.21.15.49:0/770881965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9d9070 0x55bfccd80650 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f8140009f90 tx=0x7f814000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425e1207d26c5757 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.702+0000 7f813f7fe640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f81340b6680 0x7f81340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.702+0000 7f814659c640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f81340b6680 0x7f81340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.702+0000 7f813cff9640 1 -- 172.21.15.49:0/770881965 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140003b70 con 0x55bfcc9d9070 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.702+0000 7f813cff9640 1 -- 172.21.15.49:0/770881965 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8140003d10 con 0x55bfcc9d9070 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.702+0000 7f813cff9640 1 -- 172.21.15.49:0/770881965 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140011900 con 0x55bfcc9d9070 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.702+0000 7f813f7fe640 1 -- 172.21.15.49:0/925604062 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f8138107f30 con 0x7f8148102a60 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f8152f69740 1 -- 172.21.15.49:0/770881965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9d9070 msgr2=0x55bfccd80650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f8152f69740 1 --2- 172.21.15.49:0/770881965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9d9070 0x55bfccd80650 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f8140009f90 tx=0x7f814000f7f0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f814659c640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f81340b6680 0x7f81340b8b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f81381056e0 tx=0x7f813810ba80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.753 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f8152f69740 1 -- 172.21.15.49:0/770881965 shutdown_connections 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f8152f69740 1 --2- 172.21.15.49:0/770881965 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b8390 0x55bfccd810d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f8152f69740 1 --2- 172.21.15.49:0/770881965 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 0x55bfccd80b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f8152f69740 1 --2- 172.21.15.49:0/770881965 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9d9070 0x55bfccd80650 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f8152f69740 1 -- 172.21.15.49:0/770881965 >> 172.21.15.49:0/770881965 conn(0x55bfcc9cd460 msgr2=0x55bfccd7e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f8152f69740 1 -- 172.21.15.49:0/770881965 shutdown_connections 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.703+0000 7f8152f69740 1 -- 172.21.15.49:0/770881965 wait complete. 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8152f69740 1 -- start start 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8152f69740 1 Processor -- start 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8152f69740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8152f69740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b8390 0x55bfccd8c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8152f69740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9d9070 0x55bfccd98120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8152f69740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55bfccb47700 con 0x55bfcc9b8390 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8152f69740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55bfccc81110 con 0x55bfcc9d9070 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8152f69740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55bfccd8ee30 con 0x55bfcc9b01b0 2024-09-21T06:46:35.754 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8152f69740 10 client.0 _ll_register_callbacks cb 0x55bfccc9a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8145d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b8390 0x55bfccd8c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8145d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b8390 0x55bfccd8c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58170/0 (socket says 172.21.15.49:58170) 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8145d9b640 1 -- 172.21.15.49:0/9735395 learned_addr learned my addr 172.21.15.49:0/9735395 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8146d9d640 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8146d9d640 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9d9070 0x55bfccd98120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8145d9b640 1 -- 172.21.15.49:0/9735395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 msgr2=0x55bfccd8bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8145d9b640 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8145d9b640 1 -- 172.21.15.49:0/9735395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9d9070 msgr2=0x55bfccd98120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8145d9b640 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9d9070 0x55bfccd98120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.704+0000 7f8145d9b640 1 -- 172.21.15.49:0/9735395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfcccaec40 con 0x55bfcc9b8390 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8145d9b640 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b8390 0x55bfccd8c210 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f813000beb0 tx=0x7f8130012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec02bff52109a00b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f812dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f812dffb640 1 -- 172.21.15.49:0/9735395 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130004230 con 0x55bfcc9b8390 2024-09-21T06:46:35.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f812dffb640 1 -- 172.21.15.49:0/9735395 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f81300043d0 con 0x55bfcc9b8390 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8152f69740 1 -- 172.21.15.49:0/9735395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8140003d10 con 0x55bfcc9b8390 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f812dffb640 1 -- 172.21.15.49:0/9735395 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f81300035f0 con 0x55bfcc9b8390 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8152f69740 10 client.17979 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8152f69740 1 -- 172.21.15.49:0/9735395 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bfccd9ab60 con 0x55bfcc9b8390 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f812dffb640 1 -- 172.21.15.49:0/9735395 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8140003d10 con 0x55bfcc9b8390 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f812dffb640 1 -- 172.21.15.49:0/9735395 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f8130010b30 con 0x55bfcc9b8390 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8152f69740 10 client.17979 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8152f69740 10 client.17979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8152f69740 20 client.17979 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8152f69740 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bfcc9979f0 0x55bfccd9e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8152f69740 4 client.17979 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.705+0000 7f8152f69740 1 -- 172.21.15.49:0/9735395 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfcccf8da0 con 0x55bfcc9979f0 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.706+0000 7f8146d9d640 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bfcc9979f0 0x55bfccd9e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.706+0000 7f812dffb640 10 client.17979 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:35.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.706+0000 7f8146d9d640 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bfcc9979f0 0x55bfccd9e0b0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba5513cfe5bdf672 server_cookie=ce4de639ff579edf in_seq=0 out_seq=0 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.707+0000 7f812dffb640 1 -- 172.21.15.49:0/9735395 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bfcccf8da0 con 0x55bfcc9979f0 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.707+0000 7f812dffb640 10 client.17979 handle_command_reply: tid=0 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.707+0000 7f8152f69740 1 client.17979 shutdown 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 -- 172.21.15.49:0/9735395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b8390 msgr2=0x55bfccd8c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b8390 0x55bfccd8c210 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f813000beb0 tx=0x7f8130012820 comp rx=0 tx=0).stop 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 -- 172.21.15.49:0/9735395 shutdown_connections 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bfcc9979f0 0x55bfccd9e0b0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9d9070 0x55bfccd98120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f812dffb640 0 client.17979 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b8390 0x55bfccd8c210 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 --2- 172.21.15.49:0/9735395 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 -- 172.21.15.49:0/9735395 >> 172.21.15.49:0/9735395 conn(0x55bfcc9cd460 msgr2=0x55bfccd83830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 -- 172.21.15.49:0/9735395 shutdown_connections 2024-09-21T06:46:35.757 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 1 -- 172.21.15.49:0/9735395 wait complete. 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.708+0000 7f8152f69740 20 client.17979 trim_cache size 0 max 16384 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.727+0000 7f8152f69740 1 Processor -- start 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8152f69740 1 -- start start 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8152f69740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9979f0 0x55bfccd82040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8152f69740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8152f69740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 0x55bfccd98020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8152f69740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f81481b2130 con 0x55bfcc9b01b0 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8152f69740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81481afa00 con 0x55bfcc9979f0 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8152f69740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f81481ad870 con 0x55bfcc9b8390 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8145d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8145d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58176/0 (socket says 172.21.15.49:58176) 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8145d9b640 1 -- 172.21.15.49:0/1068683016 learned_addr learned my addr 172.21.15.49:0/1068683016 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8146d9d640 1 --2- 172.21.15.49:0/1068683016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 0x55bfccd98020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.758 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8146d9d640 1 --2- 172.21.15.49:0/1068683016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9979f0 0x55bfccd82040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8145d9b640 1 -- 172.21.15.49:0/1068683016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 msgr2=0x55bfccd98020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8145d9b640 1 --2- 172.21.15.49:0/1068683016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 0x55bfccd98020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8145d9b640 1 -- 172.21.15.49:0/1068683016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9979f0 msgr2=0x55bfccd82040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8145d9b640 1 --2- 172.21.15.49:0/1068683016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9979f0 0x55bfccd82040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8145d9b640 1 -- 172.21.15.49:0/1068683016 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfccd82940 con 0x55bfcc9b01b0 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.728+0000 7f8145d9b640 1 --2- 172.21.15.49:0/1068683016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8d900 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f813001b850 tx=0x7f813001b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532d8a36d8e574d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.729+0000 7f812ffff640 1 -- 172.21.15.49:0/1068683016 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130027040 con 0x55bfcc9b01b0 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.729+0000 7f812ffff640 1 -- 172.21.15.49:0/1068683016 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81300054d0 con 0x55bfcc9b01b0 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.729+0000 7f812ffff640 1 -- 172.21.15.49:0/1068683016 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130010aa0 con 0x55bfcc9b01b0 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 -- 172.21.15.49:0/1068683016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b01b0 msgr2=0x55bfccd8d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 --2- 172.21.15.49:0/1068683016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8d900 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f813001b850 tx=0x7f813001b880 comp rx=0 tx=0).stop 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 -- 172.21.15.49:0/1068683016 shutdown_connections 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 --2- 172.21.15.49:0/1068683016 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 0x55bfccd98020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 --2- 172.21.15.49:0/1068683016 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9b01b0 0x55bfccd8d900 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.759 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 --2- 172.21.15.49:0/1068683016 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9979f0 0x55bfccd82040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 -- 172.21.15.49:0/1068683016 >> 172.21.15.49:0/1068683016 conn(0x55bfcc9cd460 msgr2=0x55bfccd8d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 -- 172.21.15.49:0/1068683016 shutdown_connections 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 -- 172.21.15.49:0/1068683016 wait complete. 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 -- start start 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 Processor -- start 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9979f0 0x55bfccd90320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b01b0 0x55bfccd90860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 0x55bfcce07a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f81481adec0 con 0x55bfcc9979f0 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f81481af330 con 0x55bfcc9b01b0 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.730+0000 7f8152f69740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f81481ae590 con 0x55bfcc9b8390 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8152f69740 10 client.0 _ll_register_callbacks cb 0x7f813000b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9979f0 0x55bfccd90320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.760 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9979f0 0x55bfccd90320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:58186/0 (socket says 172.21.15.49:58186) 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 -- 172.21.15.49:0/1666345666 learned_addr learned my addr 172.21.15.49:0/1666345666 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8145d9b640 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b01b0 0x55bfccd90860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 0x55bfcce07a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 -- 172.21.15.49:0/1666345666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 msgr2=0x55bfcce07a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 0x55bfcce07a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 -- 172.21.15.49:0/1666345666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b01b0 msgr2=0x55bfccd90860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b01b0 0x55bfccd90860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 -- 172.21.15.49:0/1666345666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfccd91070 con 0x55bfcc9979f0 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8146d9d640 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9979f0 0x55bfccd90320 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8140009f60 tx=0x7f813000ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45250dfbf31cd80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f812dffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f812dffb640 1 -- 172.21.15.49:0/1666345666 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8140024040 con 0x55bfcc9979f0 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f8152f69740 1 -- 172.21.15.49:0/1666345666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81300054d0 con 0x55bfcc9979f0 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.731+0000 7f812dffb640 1 -- 172.21.15.49:0/1666345666 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f8140012b30 con 0x55bfcc9979f0 2024-09-21T06:46:35.761 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f812dffb640 1 -- 172.21.15.49:0/1666345666 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8140012d30 con 0x55bfcc9979f0 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f8152f69740 10 client.17985 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f8152f69740 1 -- 172.21.15.49:0/1666345666 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55bfcce08f80 con 0x55bfcc9979f0 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f812dffb640 1 -- 172.21.15.49:0/1666345666 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81300054d0 con 0x55bfcc9979f0 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f812dffb640 1 -- 172.21.15.49:0/1666345666 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f814002a040 con 0x55bfcc9979f0 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f8152f69740 10 client.17985 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f8152f69740 10 client.17985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f8152f69740 20 client.17985 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f8152f69740 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bfcc9d9070 0x55bfcce0b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f8152f69740 4 client.17985 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f8152f69740 1 -- 172.21.15.49:0/1666345666 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bfcccf4850 con 0x55bfcc9d9070 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.732+0000 7f8145d9b640 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bfcc9d9070 0x55bfcce0b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.733+0000 7f812dffb640 10 client.17985 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.733+0000 7f8145d9b640 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bfcc9d9070 0x55bfcce0b450 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ed4f11040ea3615 server_cookie=89a5f608b6e1d0b1 in_seq=0 out_seq=0 2024-09-21T06:46:35.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.733+0000 7f812dffb640 1 -- 172.21.15.49:0/1666345666 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x55bfcccf4850 con 0x55bfcc9d9070 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.733+0000 7f812dffb640 10 client.17985 handle_command_reply: tid=0 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.733+0000 7f8152f69740 1 client.17985 shutdown 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.733+0000 7f8152f69740 1 -- 172.21.15.49:0/1666345666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9979f0 msgr2=0x55bfccd90320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.733+0000 7f8152f69740 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9979f0 0x55bfccd90320 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8140009f60 tx=0x7f813000ba60 comp rx=0 tx=0).stop 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.733+0000 7f8152f69740 1 -- 172.21.15.49:0/1666345666 shutdown_connections 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f8152f69740 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55bfcc9d9070 0x55bfcce0b450 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f8152f69740 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55bfcc9b8390 0x55bfcce07a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f8152f69740 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55bfcc9b01b0 0x55bfccd90860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f812dffb640 0 client.17985 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f8152f69740 1 --2- 172.21.15.49:0/1666345666 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55bfcc9979f0 0x55bfccd90320 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f8152f69740 1 -- 172.21.15.49:0/1666345666 >> 172.21.15.49:0/1666345666 conn(0x55bfcc9cd460 msgr2=0x55bfccd81e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "33526aec-feb7-4620-9880-2a7dd5991954": { 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "33526aec-feb7-4620-9880-2a7dd5991954", 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "f56024cf-a906-4d93-89e9-d1f90cea5480": { 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:52.601552+0000", 2024-09-21T06:46:35.764 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.765 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.767 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.768 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.769 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "33526aec-feb7-4620-9880-2a7dd5991954": { 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:46:34.268554+0000", 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "877238a7-c1a9-416c-8f9e-d40ecea3c71a": { 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:10.755554+0000", 2024-09-21T06:46:35.770 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:46:35.771 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:46:35.772 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:46:35.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f8152f69740 1 -- 172.21.15.49:0/1666345666 shutdown_connections 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f8152f69740 1 -- 172.21.15.49:0/1666345666 wait complete. 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f8152f69740 20 client.17985 trim_cache size 0 max 16384 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 -- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f81340b6680 msgr2=0x7f81340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f81340b6680 0x7f81340b8b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f81381056e0 tx=0x7f813810ba80 comp rx=0 tx=0).stop 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 -- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 msgr2=0x7f814819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 0x7f814819a430 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f8138005940 tx=0x7f8138004270 comp rx=0 tx=0).stop 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 -- 172.21.15.49:0/925604062 shutdown_connections 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f81340b6680 0x7f81340b8b90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8148108cf0 0x7f814819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f81481083a0 0x7f814819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 --2- 172.21.15.49:0/925604062 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8148102a60 0x7f814819a430 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 -- 172.21.15.49:0/925604062 >> 172.21.15.49:0/925604062 conn(0x7f8148079730 msgr2=0x7f8148101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 -- 172.21.15.49:0/925604062 shutdown_connections 2024-09-21T06:46:35.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:46:35.734+0000 7f814c9f5640 1 -- 172.21.15.49:0/925604062 wait complete. 2024-09-21T06:46:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:35 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:46:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:35 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:46:35.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:35 smithi049 ceph-mon[31177]: pgmap v625: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:46:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:35 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:46:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:35 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:46:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:35 smithi098 ceph-mon[34704]: pgmap v625: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:46:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:35 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:46:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:35 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:46:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:35 smithi079 ceph-mon[34346]: pgmap v625: 97 pgs: 97 active+clean; 11 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 KiB/s wr, 14 op/s 2024-09-21T06:46:36.605 INFO:tasks.cephfs.filesystem:scrub status for tag:33526aec-feb7-4620-9880-2a7dd5991954 - {'path': '/', 'tag': '33526aec-feb7-4620-9880-2a7dd5991954', 'options': 'recursive,force'} 2024-09-21T06:46:37.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:37 smithi049 ceph-mon[31177]: pgmap v626: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-21T06:46:38.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:37 smithi098 ceph-mon[34704]: pgmap v626: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-21T06:46:38.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:37 smithi079 ceph-mon[34346]: pgmap v626: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-21T06:46:40.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:39 smithi098 ceph-mon[34704]: pgmap v627: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-21T06:46:40.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:39 smithi079 ceph-mon[34346]: pgmap v627: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-21T06:46:40.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:39 smithi049 ceph-mon[31177]: pgmap v627: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-09-21T06:46:42.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:41 smithi049 ceph-mon[31177]: pgmap v628: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T06:46:42.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:41 smithi098 ceph-mon[34704]: pgmap v628: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T06:46:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:41 smithi079 ceph-mon[34346]: pgmap v628: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-09-21T06:46:44.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:43 smithi098 ceph-mon[34704]: pgmap v629: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:46:44.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:43 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:46:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:43 smithi079 ceph-mon[34346]: pgmap v629: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:46:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:43 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:46:44.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:43 smithi049 ceph-mon[31177]: pgmap v629: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:46:44.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:43 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:46:45.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:44 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:46:45.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:44 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:46:45.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:44 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:46:46.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:45 smithi098 ceph-mon[34704]: pgmap v630: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 15 op/s 2024-09-21T06:46:46.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:45 smithi079 ceph-mon[34346]: pgmap v630: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 15 op/s 2024-09-21T06:46:46.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:45 smithi049 ceph-mon[31177]: pgmap v630: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 37 KiB/s wr, 15 op/s 2024-09-21T06:46:48.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:47 smithi098 ceph-mon[34704]: pgmap v631: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:46:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:47 smithi079 ceph-mon[34346]: pgmap v631: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:46:48.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:47 smithi049 ceph-mon[31177]: pgmap v631: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 14 op/s 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.755+0000 7f091f769640 1 -- 172.21.15.49:0/560879577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091810dd70 msgr2=0x7f0918110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.755+0000 7f091f769640 1 --2- 172.21.15.49:0/560879577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091810dd70 0x7f0918110260 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f0910009ca0 tx=0x7f091002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.755+0000 7f091f769640 1 -- 172.21.15.49:0/560879577 shutdown_connections 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.755+0000 7f091f769640 1 --2- 172.21.15.49:0/560879577 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f091810dd70 0x7f0918110260 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.755+0000 7f091f769640 1 --2- 172.21.15.49:0/560879577 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0918105260 0x7f091810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.755+0000 7f091f769640 1 --2- 172.21.15.49:0/560879577 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f0918104910 0x7f0918104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.755+0000 7f091f769640 1 -- 172.21.15.49:0/560879577 >> 172.21.15.49:0/560879577 conn(0x7f09180fe3c0 msgr2=0x7f0918100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.756+0000 7f091f769640 1 -- 172.21.15.49:0/560879577 shutdown_connections 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.756+0000 7f091f769640 1 -- 172.21.15.49:0/560879577 wait complete. 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.756+0000 7f091f769640 1 Processor -- start 2024-09-21T06:46:48.758 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.756+0000 7f091f769640 1 -- start start 2024-09-21T06:46:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091f769640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0918104910 0x7f091819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.760 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091f769640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918105260 0x7f091819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091f769640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091810dd70 0x7f091819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091f769640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09181139f0 con 0x7f0918105260 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091f769640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f0918113870 con 0x7f091810dd70 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091f769640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f0918113b70 con 0x7f0918104910 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091cd04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918105260 0x7f091819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091cd04640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918105260 0x7f091819a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43444/0 (socket says 172.21.15.49:43444) 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091cd04640 1 -- 172.21.15.49:0/4156767546 learned_addr learned my addr 172.21.15.49:0/4156767546 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091dd06640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091810dd70 0x7f091819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091d505640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0918104910 0x7f091819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091cd04640 1 -- 172.21.15.49:0/4156767546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0918104910 msgr2=0x7f091819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091cd04640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0918104910 0x7f091819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091cd04640 1 -- 172.21.15.49:0/4156767546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091810dd70 msgr2=0x7f091819fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091cd04640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091810dd70 0x7f091819fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.761 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091cd04640 1 -- 172.21.15.49:0/4156767546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09181a02e0 con 0x7f0918105260 2024-09-21T06:46:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.757+0000 7f091cd04640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918105260 0x7f091819a950 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f090800d750 tx=0x7f090800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.758+0000 7f090e7fc640 1 -- 172.21.15.49:0/4156767546 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908017070 con 0x7f0918105260 2024-09-21T06:46:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.758+0000 7f091f769640 1 -- 172.21.15.49:0/4156767546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09181a05d0 con 0x7f0918105260 2024-09-21T06:46:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.758+0000 7f090e7fc640 1 -- 172.21.15.49:0/4156767546 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09080054d0 con 0x7f0918105260 2024-09-21T06:46:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.758+0000 7f090e7fc640 1 -- 172.21.15.49:0/4156767546 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0908004c30 con 0x7f0918105260 2024-09-21T06:46:48.762 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.758+0000 7f091f769640 1 -- 172.21.15.49:0/4156767546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09181a6d60 con 0x7f0918105260 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.760+0000 7f09266d6740 1 Processor -- start 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f09266d6740 1 -- start start 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f090e7fc640 1 -- 172.21.15.49:0/4156767546 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f0908004dd0 con 0x7f0918105260 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f09266d6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a306329b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f09266d6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a30632ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f09266d6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a30633430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f09266d6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560a305a76f0 con 0x560a3028d1b0 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f09266d6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a30596b20 con 0x560a302642f0 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f09266d6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a3059a930 con 0x560a3026c4d0 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091dd06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a306329b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091dd06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a306329b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43450/0 (socket says 172.21.15.49:43450) 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091dd06640 1 -- 172.21.15.49:0/56795050 learned_addr learned my addr 172.21.15.49:0/56795050 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091cd04640 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a30633430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091d505640 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a30632ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091dd06640 1 -- 172.21.15.49:0/56795050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 msgr2=0x560a30633430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091dd06640 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a30633430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091dd06640 1 -- 172.21.15.49:0/56795050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 msgr2=0x560a30632ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091dd06640 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a30632ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091dd06640 1 -- 172.21.15.49:0/56795050 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a3055c530 con 0x560a3028d1b0 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.761+0000 7f091d505640 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a30632ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.762+0000 7f090e7fc640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09040b6680 0x7f09040b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.762+0000 7f091dd06640 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a306329b0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f09100098b0 tx=0x7f09100098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2e168ceedd5e6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.762+0000 7f091d505640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09040b6680 0x7f09040b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.762+0000 7f090e7fc640 1 -- 172.21.15.49:0/4156767546 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f09080e70d0 con 0x7f0918105260 2024-09-21T06:46:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.762+0000 7f09037fe640 1 -- 172.21.15.49:0/56795050 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910031cf0 con 0x560a3028d1b0 2024-09-21T06:46:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.762+0000 7f09037fe640 1 -- 172.21.15.49:0/56795050 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0910036030 con 0x560a3028d1b0 2024-09-21T06:46:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.762+0000 7f09037fe640 1 -- 172.21.15.49:0/56795050 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09100042a0 con 0x560a3028d1b0 2024-09-21T06:46:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 -- 172.21.15.49:0/56795050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 msgr2=0x560a306329b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.767 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f091d505640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09040b6680 0x7f09040b8b90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x560a30631630 tx=0x7f091400b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a306329b0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f09100098b0 tx=0x7f09100098e0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 -- 172.21.15.49:0/56795050 shutdown_connections 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a30633430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a30632ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 --2- 172.21.15.49:0/56795050 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a306329b0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 -- 172.21.15.49:0/56795050 >> 172.21.15.49:0/56795050 conn(0x560a30281300 msgr2=0x560a306308a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 -- 172.21.15.49:0/56795050 shutdown_connections 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 -- 172.21.15.49:0/56795050 wait complete. 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 -- start start 2024-09-21T06:46:48.768 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.763+0000 7f09266d6740 1 Processor -- start 2024-09-21T06:46:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f09266d6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a3063e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f09266d6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a3063e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.772 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f09266d6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a3064a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f09266d6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560a304ceab0 con 0x560a3028d1b0 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f09266d6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560a3053c730 con 0x560a302642f0 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f09266d6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560a30640f50 con 0x560a3026c4d0 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f09266d6740 10 client.0 _ll_register_callbacks cb 0x560a305906b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f091dd06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a3064a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f091dd06640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a3064a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43460/0 (socket says 172.21.15.49:43460) 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f091dd06640 1 -- 172.21.15.49:0/2064186926 learned_addr learned my addr 172.21.15.49:0/2064186926 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f091cd04640 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a3063e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.764+0000 7f091d505640 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a3063e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f091dd06640 1 -- 172.21.15.49:0/2064186926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 msgr2=0x560a3063e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f091dd06640 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a3063e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f091dd06640 1 -- 172.21.15.49:0/2064186926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 msgr2=0x560a3063e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f091dd06640 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a3063e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.773 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f091dd06640 1 -- 172.21.15.49:0/2064186926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a302f8790 con 0x560a3028d1b0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f091d505640 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a3063e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f091dd06640 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a3064a2a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0910005d50 tx=0x7f0910031780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca718f56a138891 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f0900ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f0900ff9640 1 -- 172.21.15.49:0/2064186926 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091004a040 con 0x560a3028d1b0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f0900ff9640 1 -- 172.21.15.49:0/2064186926 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f091002f860 con 0x560a3028d1b0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f09266d6740 1 -- 172.21.15.49:0/2064186926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0910036030 con 0x560a3028d1b0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f0900ff9640 1 -- 172.21.15.49:0/2064186926 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f091005e050 con 0x560a3028d1b0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f09266d6740 10 client.17997 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.765+0000 7f09266d6740 1 -- 172.21.15.49:0/2064186926 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560a30371620 con 0x560a3028d1b0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.766+0000 7f0900ff9640 1 -- 172.21.15.49:0/2064186926 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0910036030 con 0x560a3028d1b0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.766+0000 7f0900ff9640 1 -- 172.21.15.49:0/2064186926 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f091004d030 con 0x560a3028d1b0 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.766+0000 7f09266d6740 10 client.17997 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.766+0000 7f09266d6740 10 client.17997 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:48.774 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.766+0000 7f09266d6740 20 client.17997 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.766+0000 7f09266d6740 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a3024bd80 0x560a3064fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.766+0000 7f09266d6740 4 client.17997 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.766+0000 7f09266d6740 1 -- 172.21.15.49:0/2064186926 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a305a9640 con 0x560a3024bd80 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.766+0000 7f091d505640 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a3024bd80 0x560a3064fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.767+0000 7f091d505640 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a3024bd80 0x560a3064fe10 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f139a5783a5a0642 server_cookie=f9939dd42e732f11 in_seq=0 out_seq=0 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.767+0000 7f0900ff9640 10 client.17997 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.767+0000 7f0900ff9640 1 -- 172.21.15.49:0/2064186926 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560a305a9640 con 0x560a3024bd80 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.767+0000 7f0900ff9640 10 client.17997 handle_command_reply: tid=0 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.767+0000 7f09266d6740 1 client.17997 shutdown 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.767+0000 7f09266d6740 1 -- 172.21.15.49:0/2064186926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 msgr2=0x560a3064a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.767+0000 7f09266d6740 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a3064a2a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f0910005d50 tx=0x7f0910031780 comp rx=0 tx=0).stop 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f09266d6740 1 -- 172.21.15.49:0/2064186926 shutdown_connections 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f09266d6740 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a3024bd80 0x560a3064fe10 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f09266d6740 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a3028d1b0 0x560a3064a2a0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.775 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f0900ff9640 0 client.17997 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f09266d6740 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a3063e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f09266d6740 1 --2- 172.21.15.49:0/2064186926 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a302642f0 0x560a3063e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f09266d6740 1 -- 172.21.15.49:0/2064186926 >> 172.21.15.49:0/2064186926 conn(0x560a30281300 msgr2=0x560a306339e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f09266d6740 1 -- 172.21.15.49:0/2064186926 shutdown_connections 2024-09-21T06:46:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f09266d6740 1 -- 172.21.15.49:0/2064186926 wait complete. 2024-09-21T06:46:48.776 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.768+0000 7f09266d6740 20 client.17997 trim_cache size 0 max 16384 2024-09-21T06:46:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f09266d6740 1 Processor -- start 2024-09-21T06:46:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f09266d6740 1 -- start start 2024-09-21T06:46:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f09266d6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a306340f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f09266d6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a3064a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f09266d6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 0x560a3063b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f09266d6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09181b1fc0 con 0x560a302642f0 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f09266d6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f09181af890 con 0x560a3028d1b0 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f09266d6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f09181ad700 con 0x560a3026c4d0 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f091d505640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a306340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f091d505640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a306340f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43462/0 (socket says 172.21.15.49:43462) 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f091d505640 1 -- 172.21.15.49:0/1530148038 learned_addr learned my addr 172.21.15.49:0/1530148038 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f091dd06640 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 0x560a3063b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f091d505640 1 -- 172.21.15.49:0/1530148038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 msgr2=0x560a3064a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f091cd04640 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a3064a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f091d505640 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a3064a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f091d505640 1 -- 172.21.15.49:0/1530148038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 msgr2=0x560a3063b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.783+0000 7f091d505640 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 0x560a3063b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.784+0000 7f091d505640 1 -- 172.21.15.49:0/1530148038 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a30650140 con 0x560a302642f0 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.784+0000 7f091cd04640 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a3064a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.784+0000 7f091dd06640 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 0x560a3063b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.784+0000 7f091d505640 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a306340f0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x560a30650380 tx=0x7f0914015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14b6e8d59632074 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.784+0000 7f0902ffd640 1 -- 172.21.15.49:0/1530148038 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914005020 con 0x560a302642f0 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.784+0000 7f0902ffd640 1 -- 172.21.15.49:0/1530148038 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0914005b90 con 0x560a302642f0 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.784+0000 7f0902ffd640 1 -- 172.21.15.49:0/1530148038 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914028690 con 0x560a302642f0 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 -- 172.21.15.49:0/1530148038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 msgr2=0x560a306340f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a306340f0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x560a30650380 tx=0x7f0914015000 comp rx=0 tx=0).stop 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 -- 172.21.15.49:0/1530148038 shutdown_connections 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 0x560a3063b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a3064a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 --2- 172.21.15.49:0/1530148038 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a306340f0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 -- 172.21.15.49:0/1530148038 >> 172.21.15.49:0/1530148038 conn(0x560a30281300 msgr2=0x560a306339e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 -- 172.21.15.49:0/1530148038 shutdown_connections 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 -- 172.21.15.49:0/1530148038 wait complete. 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 -- start start 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.785+0000 7f09266d6740 1 Processor -- start 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f09266d6740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a30643c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f09266d6740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a306441d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f09266d6740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 0x560a306b2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f09266d6740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f09181add50 con 0x560a302642f0 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f09266d6740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f09181af1c0 con 0x560a3028d1b0 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f09266d6740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f09181ae420 con 0x560a3026c4d0 2024-09-21T06:46:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f09266d6740 10 client.0 _ll_register_callbacks cb 0x7f0910009800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091d505640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a30643c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091d505640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a30643c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:43464/0 (socket says 172.21.15.49:43464) 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091d505640 1 -- 172.21.15.49:0/3609089873 learned_addr learned my addr 172.21.15.49:0/3609089873 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091cd04640 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a306441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091dd06640 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 0x560a306b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091d505640 1 -- 172.21.15.49:0/3609089873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 msgr2=0x560a306441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091d505640 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a306441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091d505640 1 -- 172.21.15.49:0/3609089873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 msgr2=0x560a306b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091d505640 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 0x560a306b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091d505640 1 -- 172.21.15.49:0/3609089873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a306b2c90 con 0x560a302642f0 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f091d505640 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a30643c30 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f0914004750 tx=0x7f0914004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7514769750c59d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.786+0000 7f0900ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f0900ff9640 1 -- 172.21.15.49:0/3609089873 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0914020040 con 0x560a302642f0 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f0900ff9640 1 -- 172.21.15.49:0/3609089873 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f0914005030 con 0x560a302642f0 2024-09-21T06:46:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f09266d6740 1 -- 172.21.15.49:0/3609089873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0914005b90 con 0x560a302642f0 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f0900ff9640 1 -- 172.21.15.49:0/3609089873 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0914005230 con 0x560a302642f0 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f09266d6740 10 client.18003 fetch_fsmap learned FSMap version 27 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f09266d6740 1 -- 172.21.15.49:0/3609089873 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x560a306b9f90 con 0x560a302642f0 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f0900ff9640 1 -- 172.21.15.49:0/3609089873 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0914005b90 con 0x560a302642f0 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f0900ff9640 1 -- 172.21.15.49:0/3609089873 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f0914019040 con 0x560a302642f0 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f09266d6740 10 client.18003 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f09266d6740 10 client.18003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f09266d6740 20 client.18003 populate_metadata read hostname 'smithi049' 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f09266d6740 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a302211c0 0x560a306bc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f09266d6740 4 client.18003 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.787+0000 7f09266d6740 1 -- 172.21.15.49:0/3609089873 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a305a50f0 con 0x560a302211c0 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.788+0000 7f091cd04640 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a302211c0 0x560a306bc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.788+0000 7f0900ff9640 10 client.18003 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.788+0000 7f091cd04640 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a302211c0 0x560a306bc770 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb30cfa716618a1f server_cookie=8f9a1e3b60078e8b in_seq=0 out_seq=0 2024-09-21T06:46:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f0900ff9640 1 -- 172.21.15.49:0/3609089873 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560a305a50f0 con 0x560a302211c0 2024-09-21T06:46:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f0900ff9640 10 client.18003 handle_command_reply: tid=0 2024-09-21T06:46:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 client.18003 shutdown 2024-09-21T06:46:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 -- 172.21.15.49:0/3609089873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 msgr2=0x560a30643c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a30643c30 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f0914004750 tx=0x7f0914004780 comp rx=0 tx=0).stop 2024-09-21T06:46:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 -- 172.21.15.49:0/3609089873 shutdown_connections 2024-09-21T06:46:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x560a302211c0 0x560a306bc770 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a3028d1b0 0x560a306b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x560a3026c4d0 0x560a306441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 --2- 172.21.15.49:0/3609089873 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x560a302642f0 0x560a30643c30 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 -- 172.21.15.49:0/3609089873 >> 172.21.15.49:0/3609089873 conn(0x560a30281300 msgr2=0x560a30630880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f0900ff9640 0 client.18003 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 -- 172.21.15.49:0/3609089873 shutdown_connections 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 1 -- 172.21.15.49:0/3609089873 wait complete. 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.796+0000 7f09266d6740 20 client.18003 trim_cache size 0 max 16384 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:46:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:46:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 -- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09040b6680 msgr2=0x7f09040b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09040b6680 0x7f09040b8b90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x560a30631630 tx=0x7f091400b390 comp rx=0 tx=0).stop 2024-09-21T06:46:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 -- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918105260 msgr2=0x7f091819a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918105260 0x7f091819a950 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f090800d750 tx=0x7f090800dc10 comp rx=0 tx=0).stop 2024-09-21T06:46:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 -- 172.21.15.49:0/4156767546 shutdown_connections 2024-09-21T06:46:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f09040b6680 0x7f09040b8b90 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f091810dd70 0x7f091819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f0918105260 0x7f091819a950 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 --2- 172.21.15.49:0/4156767546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f0918104910 0x7f091819a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 -- 172.21.15.49:0/4156767546 >> 172.21.15.49:0/4156767546 conn(0x7f09180fe3c0 msgr2=0x7f0918100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 -- 172.21.15.49:0/4156767546 shutdown_connections 2024-09-21T06:46:48.805 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:46:48.797+0000 7f091f769640 1 -- 172.21.15.49:0/4156767546 wait complete. 2024-09-21T06:46:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:49 smithi098 ceph-mon[34704]: pgmap v632: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-21T06:46:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:49 smithi079 ceph-mon[34346]: pgmap v632: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-21T06:46:50.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:49 smithi049 ceph-mon[31177]: pgmap v632: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-21T06:46:52.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:51 smithi098 ceph-mon[34704]: pgmap v633: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 9 op/s 2024-09-21T06:46:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:51 smithi079 ceph-mon[34346]: pgmap v633: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 9 op/s 2024-09-21T06:46:52.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:51 smithi049 ceph-mon[31177]: pgmap v633: 97 pgs: 97 active+clean; 11 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 20 KiB/s wr, 9 op/s 2024-09-21T06:46:54.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:53 smithi098 ceph-mon[34704]: pgmap v634: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:46:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:53 smithi079 ceph-mon[34346]: pgmap v634: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:46:54.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:53 smithi049 ceph-mon[31177]: pgmap v634: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-09-21T06:46:56.011 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:55 smithi079 ceph-mon[34346]: pgmap v635: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-21T06:46:56.011 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:55 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:46:56.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:55 smithi098 ceph-mon[34704]: pgmap v635: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-21T06:46:56.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:55 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:46:56.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:55 smithi049 ceph-mon[31177]: pgmap v635: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-21T06:46:56.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:55 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: pgmap v636: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:46:57.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: pgmap v636: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:46:58.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:46:58.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:46:58.047 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: pgmap v636: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-09-21T06:46:58.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:58.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:46:58.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:46:58.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:46:59.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:46:59 smithi049 ceph-mon[31177]: pgmap v637: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-21T06:47:00.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:46:59 smithi098 ceph-mon[34704]: pgmap v637: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-21T06:47:00.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:46:59 smithi079 ceph-mon[34346]: pgmap v637: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 14 op/s 2024-09-21T06:47:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.910+0000 7f7658562640 1 -- 172.21.15.49:0/2190295663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650105270 msgr2=0x7f765010d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.910+0000 7f7658562640 1 --2- 172.21.15.49:0/2190295663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650105270 0x7f765010d7b0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f7644009900 tx=0x7f764402a410 comp rx=0 tx=0).stop 2024-09-21T06:47:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.910+0000 7f7658562640 1 -- 172.21.15.49:0/2190295663 shutdown_connections 2024-09-21T06:47:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.910+0000 7f7658562640 1 --2- 172.21.15.49:0/2190295663 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f765010dd80 0x7f7650110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.910+0000 7f7658562640 1 --2- 172.21.15.49:0/2190295663 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650105270 0x7f765010d7b0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.910+0000 7f7658562640 1 --2- 172.21.15.49:0/2190295663 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7650104920 0x7f7650104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.915 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.910+0000 7f7658562640 1 -- 172.21.15.49:0/2190295663 >> 172.21.15.49:0/2190295663 conn(0x7f765007a710 msgr2=0x7f765007ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.910+0000 7f7658562640 1 -- 172.21.15.49:0/2190295663 shutdown_connections 2024-09-21T06:47:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.910+0000 7f7658562640 1 -- 172.21.15.49:0/2190295663 wait complete. 2024-09-21T06:47:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.911+0000 7f7658562640 1 Processor -- start 2024-09-21T06:47:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.911+0000 7f7658562640 1 -- start start 2024-09-21T06:47:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.911+0000 7f7658562640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650104920 0x7f765019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f7658562640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7650105270 0x7f765019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f7658562640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f765010dd80 0x7f765019fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f7658562640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76501139e0 con 0x7f7650104920 2024-09-21T06:47:01.916 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f7658562640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7650113860 con 0x7f765010dd80 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f7658562640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7650113b60 con 0x7f7650105270 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f76562fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650104920 0x7f765019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f76562fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650104920 0x7f765019a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42268/0 (socket says 172.21.15.49:42268) 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f76562fe640 1 -- 172.21.15.49:0/3409013683 learned_addr learned my addr 172.21.15.49:0/3409013683 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f7655afd640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7650105270 0x7f765019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f7656aff640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f765010dd80 0x7f765019fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f76562fe640 1 -- 172.21.15.49:0/3409013683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7650105270 msgr2=0x7f765019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f76562fe640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7650105270 0x7f765019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f76562fe640 1 -- 172.21.15.49:0/3409013683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f765010dd80 msgr2=0x7f765019fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f76562fe640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f765010dd80 0x7f765019fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f76562fe640 1 -- 172.21.15.49:0/3409013683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76501a0350 con 0x7f7650104920 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f76562fe640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650104920 0x7f765019a420 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f764000ea80 tx=0x7f764000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f764f7fe640 1 -- 172.21.15.49:0/3409013683 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764000ce40 con 0x7f7650104920 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f764f7fe640 1 -- 172.21.15.49:0/3409013683 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7640011920 con 0x7f7650104920 2024-09-21T06:47:01.917 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f764f7fe640 1 -- 172.21.15.49:0/3409013683 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764001aaa0 con 0x7f7650104920 2024-09-21T06:47:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.912+0000 7f7658562640 1 -- 172.21.15.49:0/3409013683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76501a0640 con 0x7f7650104920 2024-09-21T06:47:01.918 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.913+0000 7f7658562640 1 -- 172.21.15.49:0/3409013683 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76501a6dd0 con 0x7f7650104920 2024-09-21T06:47:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.915+0000 7f765f4d1740 1 Processor -- start 2024-09-21T06:47:01.923 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f765f4d1740 1 -- start start 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f764f7fe640 1 -- 172.21.15.49:0/3409013683 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f764001ac40 con 0x7f7650104920 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a811b0 0x55c3a9e269b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e26ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a604d0 0x55c3a9e27430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f765f4d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c3a9d9b6f0 con 0x55c3a9a582f0 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f765f4d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c3a9d8ab20 con 0x55c3a9a811b0 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f765f4d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c3a9d8e930 con 0x55c3a9a604d0 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f76562fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e26ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f76562fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e26ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42280/0 (socket says 172.21.15.49:42280) 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f76562fe640 1 -- 172.21.15.49:0/878478546 learned_addr learned my addr 172.21.15.49:0/878478546 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:01.924 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f7655afd640 1 --2- 172.21.15.49:0/878478546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a604d0 0x55c3a9e27430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.916+0000 7f7656aff640 1 --2- 172.21.15.49:0/878478546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a811b0 0x55c3a9e269b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f76562fe640 1 -- 172.21.15.49:0/878478546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a604d0 msgr2=0x55c3a9e27430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f76562fe640 1 --2- 172.21.15.49:0/878478546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a604d0 0x55c3a9e27430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f76562fe640 1 -- 172.21.15.49:0/878478546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a811b0 msgr2=0x55c3a9e269b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f76562fe640 1 --2- 172.21.15.49:0/878478546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a811b0 0x55c3a9e269b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f76562fe640 1 -- 172.21.15.49:0/878478546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a9d50530 con 0x55c3a9a582f0 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f76562fe640 1 --2- 172.21.15.49:0/878478546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e26ef0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f76400e5300 tx=0x7f76400f07d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8d765c9877ea01 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f764f7fe640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76380b6680 0x7f76380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f7656aff640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76380b6680 0x7f76380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f764cbfe640 1 -- 172.21.15.49:0/878478546 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76400aa0e0 con 0x55c3a9a582f0 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f764f7fe640 1 -- 172.21.15.49:0/3409013683 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f76400e7c90 con 0x7f7650104920 2024-09-21T06:47:01.925 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f764cbfe640 1 -- 172.21.15.49:0/878478546 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76400ad5a0 con 0x55c3a9a582f0 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.917+0000 7f764cbfe640 1 -- 172.21.15.49:0/878478546 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76400b5420 con 0x55c3a9a582f0 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.918+0000 7f765f4d1740 1 -- 172.21.15.49:0/878478546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 msgr2=0x55c3a9e26ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.918+0000 7f7656aff640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76380b6680 0x7f76380b8b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7648009cf0 tx=0x7f7648005f90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.918+0000 7f765f4d1740 1 --2- 172.21.15.49:0/878478546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e26ef0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f76400e5300 tx=0x7f76400f07d0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.918+0000 7f765f4d1740 1 -- 172.21.15.49:0/878478546 shutdown_connections 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.918+0000 7f765f4d1740 1 --2- 172.21.15.49:0/878478546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a604d0 0x55c3a9e27430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.918+0000 7f765f4d1740 1 --2- 172.21.15.49:0/878478546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e26ef0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.918+0000 7f765f4d1740 1 --2- 172.21.15.49:0/878478546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a811b0 0x55c3a9e269b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.918+0000 7f765f4d1740 1 -- 172.21.15.49:0/878478546 >> 172.21.15.49:0/878478546 conn(0x55c3a9a75300 msgr2=0x55c3a9e248a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.926 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.918+0000 7f765f4d1740 1 -- 172.21.15.49:0/878478546 shutdown_connections 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 1 -- 172.21.15.49:0/878478546 wait complete. 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 1 -- start start 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 1 Processor -- start 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e32020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e32560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 0x55c3a9e3e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55c3a9cc2ab0 con 0x55c3a9a582f0 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55c3a9d30730 con 0x55c3a9a604d0 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55c3a9e35130 con 0x55c3a9a811b0 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f765f4d1740 10 client.0 _ll_register_callbacks cb 0x55c3a9d846b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:01.927 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.919+0000 7f76562fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e32020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f76562fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e32020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42296/0 (socket says 172.21.15.49:42296) 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f76562fe640 1 -- 172.21.15.49:0/3178481481 learned_addr learned my addr 172.21.15.49:0/3178481481 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f7655afd640 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e32560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f7656aff640 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 0x55c3a9e3e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f76562fe640 1 -- 172.21.15.49:0/3178481481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 msgr2=0x55c3a9e3e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f76562fe640 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 0x55c3a9e3e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f76562fe640 1 -- 172.21.15.49:0/3178481481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 msgr2=0x55c3a9e32560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f76562fe640 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e32560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f76562fe640 1 -- 172.21.15.49:0/3178481481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a9aec790 con 0x55c3a9a582f0 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f7656aff640 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 0x55c3a9e3e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f76562fe640 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e32020 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f76400e5990 tx=0x7f7640004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2af2fc52c32bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f7635ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:01.928 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f7635ffb640 1 -- 172.21.15.49:0/3178481481 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76400b5690 con 0x55c3a9a582f0 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f7635ffb640 1 -- 172.21.15.49:0/3178481481 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f76400a9d00 con 0x55c3a9a582f0 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f765f4d1740 1 -- 172.21.15.49:0/3178481481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76400ad5a0 con 0x55c3a9a582f0 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f7635ffb640 1 -- 172.21.15.49:0/3178481481 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f76400ac5a0 con 0x55c3a9a582f0 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f765f4d1740 10 client.18015 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.920+0000 7f765f4d1740 1 -- 172.21.15.49:0/3178481481 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c3a9b65620 con 0x55c3a9a582f0 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.921+0000 7f7635ffb640 1 -- 172.21.15.49:0/3178481481 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76400ad5a0 con 0x55c3a9a582f0 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.921+0000 7f7635ffb640 1 -- 172.21.15.49:0/3178481481 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f76400f7070 con 0x55c3a9a582f0 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.921+0000 7f765f4d1740 10 client.18015 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.921+0000 7f765f4d1740 10 client.18015 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.921+0000 7f765f4d1740 20 client.18015 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.921+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c3a9a3fd80 0x55c3a9e43fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.921+0000 7f765f4d1740 4 client.18015 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.921+0000 7f765f4d1740 1 -- 172.21.15.49:0/3178481481 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3a9d9d640 con 0x55c3a9a3fd80 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.921+0000 7f7655afd640 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c3a9a3fd80 0x55c3a9e43fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.929 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.922+0000 7f7635ffb640 10 client.18015 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:01.930 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.922+0000 7f7655afd640 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c3a9a3fd80 0x55c3a9e43fc0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c18cab14efeb76 server_cookie=f1809e51a03541ea in_seq=0 out_seq=0 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.922+0000 7f7635ffb640 1 -- 172.21.15.49:0/3178481481 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c3a9d9d640 con 0x55c3a9a3fd80 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.922+0000 7f7635ffb640 10 client.18015 handle_command_reply: tid=0 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.922+0000 7f765f4d1740 1 client.18015 shutdown 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 -- 172.21.15.49:0/3178481481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 msgr2=0x55c3a9e32020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e32020 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f76400e5990 tx=0x7f7640004ab0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 -- 172.21.15.49:0/3178481481 shutdown_connections 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c3a9a3fd80 0x55c3a9e43fc0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 0x55c3a9e3e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e32560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f7635ffb640 0 client.18015 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3178481481 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e32020 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.931 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 -- 172.21.15.49:0/3178481481 >> 172.21.15.49:0/3178481481 conn(0x55c3a9a75300 msgr2=0x55c3a9e279e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 -- 172.21.15.49:0/3178481481 shutdown_connections 2024-09-21T06:47:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 1 -- 172.21.15.49:0/3178481481 wait complete. 2024-09-21T06:47:01.932 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.923+0000 7f765f4d1740 20 client.18015 trim_cache size 0 max 16384 2024-09-21T06:47:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f765f4d1740 1 Processor -- start 2024-09-21T06:47:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f765f4d1740 1 -- start start 2024-09-21T06:47:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a582f0 0x55c3a9e283a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.940 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e33c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a811b0 0x55c3a9e2e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f765f4d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76501b21c0 con 0x55c3a9a811b0 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f765f4d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76501afa90 con 0x55c3a9a604d0 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f765f4d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f76501ad900 con 0x55c3a9a582f0 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f7656aff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a811b0 0x55c3a9e2e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f7656aff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a811b0 0x55c3a9e2e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42302/0 (socket says 172.21.15.49:42302) 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f7656aff640 1 -- 172.21.15.49:0/494550107 learned_addr learned my addr 172.21.15.49:0/494550107 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f76562fe640 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a582f0 0x55c3a9e283a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f7655afd640 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e33c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f7656aff640 1 -- 172.21.15.49:0/494550107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a582f0 msgr2=0x55c3a9e283a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f7656aff640 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a582f0 0x55c3a9e283a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f7656aff640 1 -- 172.21.15.49:0/494550107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 msgr2=0x55c3a9e33c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:01.941 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f7656aff640 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e33c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f7656aff640 1 -- 172.21.15.49:0/494550107 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3a9e34600 con 0x55c3a9a811b0 2024-09-21T06:47:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.938+0000 7f76562fe640 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a582f0 0x55c3a9e283a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.939+0000 7f7656aff640 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a811b0 0x55c3a9e2e1e0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f7648009710 tx=0x7f7648017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b49623a307da51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.939+0000 7f7637fff640 1 -- 172.21.15.49:0/494550107 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648004350 con 0x55c3a9a811b0 2024-09-21T06:47:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.939+0000 7f7637fff640 1 -- 172.21.15.49:0/494550107 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f764801e8f0 con 0x55c3a9a811b0 2024-09-21T06:47:01.942 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.939+0000 7f7637fff640 1 -- 172.21.15.49:0/494550107 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7648028530 con 0x55c3a9a811b0 2024-09-21T06:47:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 -- 172.21.15.49:0/494550107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a811b0 msgr2=0x55c3a9e2e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a811b0 0x55c3a9e2e1e0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f7648009710 tx=0x7f7648017000 comp rx=0 tx=0).stop 2024-09-21T06:47:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 -- 172.21.15.49:0/494550107 shutdown_connections 2024-09-21T06:47:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a811b0 0x55c3a9e2e1e0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e33c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 --2- 172.21.15.49:0/494550107 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a582f0 0x55c3a9e283a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 -- 172.21.15.49:0/494550107 >> 172.21.15.49:0/494550107 conn(0x55c3a9a75300 msgr2=0x55c3a9e33540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.946 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 -- 172.21.15.49:0/494550107 shutdown_connections 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 -- 172.21.15.49:0/494550107 wait complete. 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 -- start start 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 Processor -- start 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e46be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e471c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 0x55c3a9ea46f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76501adf50 con 0x55c3a9a582f0 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76501af3c0 con 0x55c3a9a604d0 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.940+0000 7f765f4d1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f76501ae620 con 0x55c3a9a811b0 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f765f4d1740 10 client.0 _ll_register_callbacks cb 0x7f76400ebd20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:01.947 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f76562fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e46be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f76562fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e46be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:42314/0 (socket says 172.21.15.49:42314) 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f76562fe640 1 -- 172.21.15.49:0/3071143237 learned_addr learned my addr 172.21.15.49:0/3071143237 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f7656aff640 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 0x55c3a9ea46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f7655afd640 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f76562fe640 1 -- 172.21.15.49:0/3071143237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 msgr2=0x55c3a9ea46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f76562fe640 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 0x55c3a9ea46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f76562fe640 1 -- 172.21.15.49:0/3071143237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 msgr2=0x55c3a9e471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f76562fe640 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f76562fe640 1 -- 172.21.15.49:0/3071143237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3a9ea4d90 con 0x55c3a9a582f0 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f76562fe640 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e46be0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f7640000f80 tx=0x7f76400f07d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929448abc00f679e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f7635ffb640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f7635ffb640 1 -- 172.21.15.49:0/3071143237 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76400ad200 con 0x55c3a9a582f0 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f7635ffb640 1 -- 172.21.15.49:0/3071143237 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8594+0+0 (secure 0 0 0) 0x7f76400eb5b0 con 0x55c3a9a582f0 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f765f4d1740 1 -- 172.21.15.49:0/3071143237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f764801e8f0 con 0x55c3a9a582f0 2024-09-21T06:47:01.948 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f7635ffb640 1 -- 172.21.15.49:0/3071143237 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f76400ad3e0 con 0x55c3a9a582f0 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f765f4d1740 10 client.18021 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.941+0000 7f765f4d1740 1 -- 172.21.15.49:0/3071143237 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55c3a9ea4d90 con 0x55c3a9a582f0 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.942+0000 7f7635ffb640 1 -- 172.21.15.49:0/3071143237 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f764801e8f0 con 0x55c3a9a582f0 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.942+0000 7f7635ffb640 1 -- 172.21.15.49:0/3071143237 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f76400f7050 con 0x55c3a9a582f0 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.942+0000 7f765f4d1740 10 client.18021 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.942+0000 7f765f4d1740 10 client.18021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.942+0000 7f765f4d1740 20 client.18021 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.942+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c3a9a151c0 0x55c3a9eb07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.942+0000 7f765f4d1740 4 client.18021 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.942+0000 7f765f4d1740 1 -- 172.21.15.49:0/3071143237 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3a9d990f0 con 0x55c3a9a151c0 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.942+0000 7f7655afd640 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c3a9a151c0 0x55c3a9eb07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.943+0000 7f7635ffb640 10 client.18021 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:01.949 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:01.943+0000 7f7655afd640 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c3a9a151c0 0x55c3a9eb07d0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=541fed9ea7d42834 server_cookie=e714ae7b61471fb8 in_seq=0 out_seq=0 2024-09-21T06:47:01.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:01 smithi049 ceph-mon[31177]: pgmap v638: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 11 op/s 2024-09-21T06:47:02.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:01 smithi098 ceph-mon[34704]: pgmap v638: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 11 op/s 2024-09-21T06:47:02.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:01 smithi079 ceph-mon[34346]: pgmap v638: 97 pgs: 97 active+clean; 11 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 KiB/s wr, 11 op/s 2024-09-21T06:47:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f7635ffb640 1 -- 172.21.15.49:0/3071143237 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3a9d990f0 con 0x55c3a9a151c0 2024-09-21T06:47:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f7635ffb640 10 client.18021 handle_command_reply: tid=0 2024-09-21T06:47:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 client.18021 shutdown 2024-09-21T06:47:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 -- 172.21.15.49:0/3071143237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 msgr2=0x55c3a9e46be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.570 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e46be0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f7640000f80 tx=0x7f76400f07d0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 -- 172.21.15.49:0/3071143237 shutdown_connections 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55c3a9a151c0 0x55c3a9eb07d0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55c3a9a811b0 0x55c3a9ea46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55c3a9a604d0 0x55c3a9e471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 --2- 172.21.15.49:0/3071143237 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55c3a9a582f0 0x55c3a9e46be0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f7635ffb640 0 client.18021 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 -- 172.21.15.49:0/3071143237 >> 172.21.15.49:0/3071143237 conn(0x55c3a9a75300 msgr2=0x55c3a9e23630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 -- 172.21.15.49:0/3071143237 shutdown_connections 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.568+0000 7f765f4d1740 1 -- 172.21.15.49:0/3071143237 wait complete. 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f765f4d1740 20 client.18021 trim_cache size 0 max 16384 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:47:03.571 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:47:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:47:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:47:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 -- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76380b6680 msgr2=0x7f76380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76380b6680 0x7f76380b8b90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7648009cf0 tx=0x7f7648005f90 comp rx=0 tx=0).stop 2024-09-21T06:47:03.572 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 -- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650104920 msgr2=0x7f765019a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650104920 0x7f765019a420 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f764000ea80 tx=0x7f764000ef40 comp rx=0 tx=0).stop 2024-09-21T06:47:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 -- 172.21.15.49:0/3409013683 shutdown_connections 2024-09-21T06:47:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76380b6680 0x7f76380b8b90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f765010dd80 0x7f765019fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7650105270 0x7f765019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 --2- 172.21.15.49:0/3409013683 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7650104920 0x7f765019a420 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.569+0000 7f7658562640 1 -- 172.21.15.49:0/3409013683 >> 172.21.15.49:0/3409013683 conn(0x7f765007a710 msgr2=0x7f7650107870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.570+0000 7f7658562640 1 -- 172.21.15.49:0/3409013683 shutdown_connections 2024-09-21T06:47:03.573 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:03.570+0000 7f7658562640 1 -- 172.21.15.49:0/3409013683 wait complete. 2024-09-21T06:47:03.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:03 smithi049 ceph-mon[31177]: pgmap v639: 97 pgs: 97 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:47:04.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:03 smithi098 ceph-mon[34704]: pgmap v639: 97 pgs: 97 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:47:04.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:03 smithi079 ceph-mon[34346]: pgmap v639: 97 pgs: 97 active+clean; 11 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-09-21T06:47:04.970 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:04 smithi079 ceph-mon[34346]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:47:04.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:04 smithi049 ceph-mon[31177]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:47:05.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:04 smithi098 ceph-mon[34704]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:47:05.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:05 smithi049 ceph-mon[31177]: pgmap v641: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 32 op/s 2024-09-21T06:47:06.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:05 smithi098 ceph-mon[34704]: pgmap v641: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 32 op/s 2024-09-21T06:47:06.070 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:05 smithi079 ceph-mon[34346]: pgmap v641: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 82 KiB/s wr, 32 op/s 2024-09-21T06:47:06.606 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:47:06.880 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:07.198 INFO:tasks.workunit.client.0.smithi049.stdout:499/600: open fd = 3 2024-09-21T06:47:07.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.198 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.198 INFO:tasks.workunit.client.0.smithi049.stdout:500/600: open fd = 3 2024-09-21T06:47:07.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.198 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.198 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:501/600: open fd = 3 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:502/600: open fd = 3 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:503/600: open fd = 3 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.199 INFO:tasks.workunit.client.0.smithi049.stdout:504/600: open fd = 3 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:505/600: open fd = 3 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:506/600: open fd = 3 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:507/600: open fd = 3 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.200 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:508/600: open fd = 3 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:509/600: open fd = 3 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:510/600: open fd = 3 2024-09-21T06:47:07.201 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:511/600: open fd = 3 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:512/600: open fd = 3 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:513/600: open fd = 3 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.202 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:514/600: open fd = 3 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:515/600: open fd = 3 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:516/600: open fd = 3 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.203 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:517/600: open fd = 3 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:518/600: open fd = 3 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:519/600: open fd = 3 2024-09-21T06:47:07.204 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:520/600: open fd = 3 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:521/600: open fd = 3 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:522/600: open fd = 3 2024-09-21T06:47:07.205 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:523/600: open fd = 3 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:524/600: open fd = 3 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:525/600: open fd = 3 2024-09-21T06:47:07.206 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:526/600: open fd = 3 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:527/600: open fd = 3 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:528/600: open fd = 3 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.207 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:529/600: open fd = 3 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:530/600: open fd = 3 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:531/600: open fd = 3 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.208 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:532/600: open fd = 3 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:533/600: open fd = 3 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:534/600: open fd = 3 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.209 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:535/600: open fd = 3 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:536/600: open fd = 3 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:537/600: open fd = 3 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.210 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:538/600: open fd = 3 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:539/600: open fd = 3 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:540/600: open fd = 3 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.211 INFO:tasks.workunit.client.0.smithi049.stdout:541/600: open fd = 3 2024-09-21T06:47:07.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.212 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.212 INFO:tasks.workunit.client.0.smithi049.stdout:542/600: open fd = 3 2024-09-21T06:47:07.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.212 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.212 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.213 INFO:tasks.workunit.client.0.smithi049.stdout:543/600: open fd = 3 2024-09-21T06:47:07.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.213 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.213 INFO:tasks.workunit.client.0.smithi049.stdout:544/600: open fd = 3 2024-09-21T06:47:07.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.213 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:545/600: open fd = 3 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:546/600: open fd = 3 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:547/600: open fd = 3 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.214 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:548/600: open fd = 3 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:549/600: open fd = 3 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:550/600: open fd = 3 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.215 INFO:tasks.workunit.client.0.smithi049.stdout:551/600: open fd = 3 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:552/600: open fd = 3 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:553/600: open fd = 3 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:554/600: open fd = 3 2024-09-21T06:47:07.216 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:555/600: open fd = 3 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:556/600: open fd = 3 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:557/600: open fd = 3 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.217 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:558/600: open fd = 3 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:559/600: open fd = 3 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:560/600: open fd = 3 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:07.218 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.347+0000 7f290ad65640 1 -- 172.21.15.49:0/523762766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2904102a60 msgr2=0x7f2904102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.347+0000 7f290ad65640 1 --2- 172.21.15.49:0/523762766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2904102a60 0x7f2904102e70 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f28ec009900 tx=0x7f28ec02a410 comp rx=0 tx=0).stop 2024-09-21T06:47:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.347+0000 7f290ad65640 1 -- 172.21.15.49:0/523762766 shutdown_connections 2024-09-21T06:47:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.347+0000 7f290ad65640 1 --2- 172.21.15.49:0/523762766 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2904108cf0 0x7f290410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.347+0000 7f290ad65640 1 --2- 172.21.15.49:0/523762766 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f29041083a0 0x7f29041087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.361 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.347+0000 7f290ad65640 1 --2- 172.21.15.49:0/523762766 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f2904102a60 0x7f2904102e70 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.347+0000 7f290ad65640 1 -- 172.21.15.49:0/523762766 >> 172.21.15.49:0/523762766 conn(0x7f2904079730 msgr2=0x7f2904079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.347+0000 7f290ad65640 1 -- 172.21.15.49:0/523762766 shutdown_connections 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.347+0000 7f290ad65640 1 -- 172.21.15.49:0/523762766 wait complete. 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.348+0000 7f290ad65640 1 Processor -- start 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.348+0000 7f290ad65640 1 -- start start 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.348+0000 7f290ad65640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2904102a60 0x7f290419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f290ad65640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29041083a0 0x7f290419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f290ad65640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2904108cf0 0x7f290419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f290ad65640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f2904113a80 con 0x7f29041083a0 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f290ad65640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f2904113900 con 0x7f2904108cf0 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f290ad65640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f2904113c00 con 0x7f2904102a60 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2903fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29041083a0 0x7f290419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.362 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2903fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29041083a0 0x7f290419aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56984/0 (socket says 172.21.15.49:56984) 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2903fff640 1 -- 172.21.15.49:0/2720567775 learned_addr learned my addr 172.21.15.49:0/2720567775 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2909302640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2904108cf0 0x7f290419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2908b01640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2904102a60 0x7f290419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2903fff640 1 -- 172.21.15.49:0/2720567775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2904102a60 msgr2=0x7f290419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2903fff640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2904102a60 0x7f290419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2903fff640 1 -- 172.21.15.49:0/2720567775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2904108cf0 msgr2=0x7f290419fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2903fff640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2904108cf0 0x7f290419fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2903fff640 1 -- 172.21.15.49:0/2720567775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29041a0480 con 0x7f29041083a0 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2908b01640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2904102a60 0x7f290419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2903fff640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29041083a0 0x7f290419aab0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f28f400e9c0 tx=0x7f28f400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2901ffb640 1 -- 172.21.15.49:0/2720567775 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f400cd80 con 0x7f29041083a0 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.349+0000 7f2901ffb640 1 -- 172.21.15.49:0/2720567775 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28f40054d0 con 0x7f29041083a0 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.350+0000 7f2901ffb640 1 -- 172.21.15.49:0/2720567775 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f4010430 con 0x7f29041083a0 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.350+0000 7f290ad65640 1 -- 172.21.15.49:0/2720567775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29041a0770 con 0x7f29041083a0 2024-09-21T06:47:07.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.350+0000 7f290ad65640 1 -- 172.21.15.49:0/2720567775 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29041a6ed0 con 0x7f29041083a0 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.352+0000 7f29112d9740 1 Processor -- start 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f2901ffb640 1 -- 172.21.15.49:0/2720567775 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f28f4004fd0 con 0x7f29041083a0 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f29112d9740 1 -- start start 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f29112d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 0x56272712a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f29112d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d5a1b0 0x56272712a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f29112d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272712acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f29112d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x5627270a0e50 con 0x562726d62390 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f29112d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562727090280 con 0x562726d5a1b0 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f29112d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562727094090 con 0x562726d83070 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f2903fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272712acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.364 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f2909302640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 0x56272712a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f2908b01640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d5a1b0 0x56272712a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f2903fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272712acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56992/0 (socket says 172.21.15.49:56992) 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.353+0000 7f2903fff640 1 -- 172.21.15.49:0/2842560691 learned_addr learned my addr 172.21.15.49:0/2842560691 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2903fff640 1 -- 172.21.15.49:0/2842560691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 msgr2=0x56272712a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2903fff640 1 --2- 172.21.15.49:0/2842560691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 0x56272712a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2903fff640 1 -- 172.21.15.49:0/2842560691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d5a1b0 msgr2=0x56272712a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2903fff640 1 --2- 172.21.15.49:0/2842560691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d5a1b0 0x56272712a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2903fff640 1 -- 172.21.15.49:0/2842560691 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562726dee650 con 0x562726d62390 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2908b01640 1 --2- 172.21.15.49:0/2842560691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d5a1b0 0x56272712a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2903fff640 1 --2- 172.21.15.49:0/2842560691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272712acc0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f28f40e5250 tx=0x7f28f40ebd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdd5778b9bfff61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2901ffb640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28f00b6700 0x7f28f00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f28faffd640 1 -- 172.21.15.49:0/2842560691 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40aa030 con 0x562726d62390 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2909302640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28f00b6700 0x7f28f00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f28faffd640 1 -- 172.21.15.49:0/2842560691 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28f4081390 con 0x562726d62390 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f28faffd640 1 -- 172.21.15.49:0/2842560691 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40ad150 con 0x562726d62390 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.354+0000 7f2901ffb640 1 -- 172.21.15.49:0/2720567775 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8638+0+0 (secure 0 0 0) 0x7f28f40e7c00 con 0x7f29041083a0 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f29112d9740 1 -- 172.21.15.49:0/2842560691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 msgr2=0x56272712acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f29112d9740 1 --2- 172.21.15.49:0/2842560691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272712acc0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f28f40e5250 tx=0x7f28f40ebd40 comp rx=0 tx=0).stop 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f2909302640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28f00b6700 0x7f28f00b8c10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f28fc005fd0 tx=0x7f28fc009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f29112d9740 1 -- 172.21.15.49:0/2842560691 shutdown_connections 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f29112d9740 1 --2- 172.21.15.49:0/2842560691 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272712acc0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f29112d9740 1 --2- 172.21.15.49:0/2842560691 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d5a1b0 0x56272712a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f29112d9740 1 --2- 172.21.15.49:0/2842560691 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 0x56272712a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f29112d9740 1 -- 172.21.15.49:0/2842560691 >> 172.21.15.49:0/2842560691 conn(0x562726d77460 msgr2=0x562727128130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f29112d9740 1 -- 172.21.15.49:0/2842560691 shutdown_connections 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.355+0000 7f29112d9740 1 -- 172.21.15.49:0/2842560691 wait complete. 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.356+0000 7f29112d9740 1 -- start start 2024-09-21T06:47:07.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.356+0000 7f29112d9740 1 Processor -- start 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f29112d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d5a1b0 0x5627271358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f29112d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727135df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f29112d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 0x562727146120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f29112d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562726ef1700 con 0x562726d5a1b0 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f29112d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x56272702b110 con 0x562726d62390 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f29112d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x56272713ce30 con 0x562726d83070 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2908b01640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d5a1b0 0x5627271358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2908b01640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d5a1b0 0x5627271358b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56994/0 (socket says 172.21.15.49:56994) 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2908b01640 1 -- 172.21.15.49:0/961882529 learned_addr learned my addr 172.21.15.49:0/961882529 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f29112d9740 10 client.0 _ll_register_callbacks cb 0x562727044990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2903fff640 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727135df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2909302640 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 0x562727146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2908b01640 1 -- 172.21.15.49:0/961882529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 msgr2=0x562727146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2908b01640 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 0x562727146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2908b01640 1 -- 172.21.15.49:0/961882529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 msgr2=0x562727135df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2908b01640 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727135df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2908b01640 1 -- 172.21.15.49:0/961882529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562727058c40 con 0x562726d5a1b0 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.357+0000 7f2903fff640 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727135df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f2908b01640 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d5a1b0 0x5627271358b0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f28ec02a930 tx=0x7f28ec0316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93b5b4c6ae45b66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f28e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f28e3fff640 1 -- 172.21.15.49:0/961882529 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec035040 con 0x562726d5a1b0 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f28e3fff640 1 -- 172.21.15.49:0/961882529 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8638+0+0 (secure 0 0 0) 0x7f28ec004040 con 0x562726d5a1b0 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f29112d9740 1 -- 172.21.15.49:0/961882529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28f4081390 con 0x562726d5a1b0 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f28e3fff640 1 -- 172.21.15.49:0/961882529 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28ec004240 con 0x562726d5a1b0 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f29112d9740 10 client.18033 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f29112d9740 1 -- 172.21.15.49:0/961882529 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562727148ae0 con 0x562726d5a1b0 2024-09-21T06:47:07.368 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f28e3fff640 1 -- 172.21.15.49:0/961882529 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28f4081390 con 0x562726d5a1b0 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.358+0000 7f28e3fff640 1 -- 172.21.15.49:0/961882529 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f28ec004950 con 0x562726d5a1b0 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.359+0000 7f29112d9740 10 client.18033 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.359+0000 7f29112d9740 10 client.18033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.359+0000 7f29112d9740 20 client.18033 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.359+0000 7f29112d9740 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562726d419f0 0x56272714c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.359+0000 7f29112d9740 4 client.18033 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.359+0000 7f29112d9740 1 -- 172.21.15.49:0/961882529 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627270a2da0 con 0x562726d419f0 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.359+0000 7f2903fff640 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562726d419f0 0x56272714c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.359+0000 7f2903fff640 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562726d419f0 0x56272714c030 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3af726c9044ad0e2 server_cookie=24f3b6aa64ec7457 in_seq=0 out_seq=0 2024-09-21T06:47:07.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.359+0000 7f28e3fff640 10 client.18033 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f28e3fff640 1 -- 172.21.15.49:0/961882529 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5627270a2da0 con 0x562726d419f0 2024-09-21T06:47:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f28e3fff640 10 client.18033 handle_command_reply: tid=0 2024-09-21T06:47:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f29112d9740 1 client.18033 shutdown 2024-09-21T06:47:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f29112d9740 1 -- 172.21.15.49:0/961882529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d5a1b0 msgr2=0x5627271358b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f29112d9740 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d5a1b0 0x5627271358b0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f28ec02a930 tx=0x7f28ec0316d0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f29112d9740 1 -- 172.21.15.49:0/961882529 shutdown_connections 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f29112d9740 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562726d419f0 0x56272714c030 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f29112d9740 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d83070 0x562727146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f29112d9740 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727135df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f29112d9740 1 --2- 172.21.15.49:0/961882529 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d5a1b0 0x5627271358b0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f29112d9740 1 -- 172.21.15.49:0/961882529 >> 172.21.15.49:0/961882529 conn(0x562726d77460 msgr2=0x56272712b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.360+0000 7f28e3fff640 0 client.18033 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.361+0000 7f29112d9740 1 -- 172.21.15.49:0/961882529 shutdown_connections 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.361+0000 7f29112d9740 1 -- 172.21.15.49:0/961882529 wait complete. 2024-09-21T06:47:07.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.361+0000 7f29112d9740 20 client.18033 trim_cache size 0 max 16384 2024-09-21T06:47:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.378+0000 7f29112d9740 1 Processor -- start 2024-09-21T06:47:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.378+0000 7f29112d9740 1 -- start start 2024-09-21T06:47:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f29112d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 0x56272712b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f29112d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f29112d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d83070 0x562727132aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.381 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f29112d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f29041b00f0 con 0x562726d83070 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f29112d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29041ad9c0 con 0x562726d62390 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f29112d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f29041ab830 con 0x562726d5a1b0 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2909302640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d83070 0x562727132aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2909302640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d83070 0x562727132aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56998/0 (socket says 172.21.15.49:56998) 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2909302640 1 -- 172.21.15.49:0/1060335778 learned_addr learned my addr 172.21.15.49:0/1060335778 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2903fff640 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2908b01640 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 0x56272712b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2909302640 1 -- 172.21.15.49:0/1060335778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 msgr2=0x56272712b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2909302640 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 0x56272712b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2909302640 1 -- 172.21.15.49:0/1060335778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 msgr2=0x562727146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:07.382 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2909302640 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2909302640 1 -- 172.21.15.49:0/1060335778 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56272712c800 con 0x562726d83070 2024-09-21T06:47:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2908b01640 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 0x56272712b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2903fff640 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.379+0000 7f2909302640 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d83070 0x562727132aa0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f28fc003f70 tx=0x7f28fc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885bdeb7ed88e09a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.380+0000 7f28fa7fc640 1 -- 172.21.15.49:0/1060335778 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc004b20 con 0x562726d83070 2024-09-21T06:47:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.380+0000 7f28fa7fc640 1 -- 172.21.15.49:0/1060335778 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28fc004cc0 con 0x562726d83070 2024-09-21T06:47:07.383 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.380+0000 7f28fa7fc640 1 -- 172.21.15.49:0/1060335778 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc005420 con 0x562726d83070 2024-09-21T06:47:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 -- 172.21.15.49:0/1060335778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d83070 msgr2=0x562727132aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d83070 0x562727132aa0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f28fc003f70 tx=0x7f28fc01a000 comp rx=0 tx=0).stop 2024-09-21T06:47:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 -- 172.21.15.49:0/1060335778 shutdown_connections 2024-09-21T06:47:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d83070 0x562727132aa0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d62390 0x562727146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 --2- 172.21.15.49:0/1060335778 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 0x56272712b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.387 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 -- 172.21.15.49:0/1060335778 >> 172.21.15.49:0/1060335778 conn(0x562726d77460 msgr2=0x56272712b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 -- 172.21.15.49:0/1060335778 shutdown_connections 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 -- 172.21.15.49:0/1060335778 wait complete. 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 -- start start 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.381+0000 7f29112d9740 1 Processor -- start 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f29112d9740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 0x56272713e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f29112d9740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272713e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f29112d9740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d83070 0x56272713ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f29112d9740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f29041abe80 con 0x562726d62390 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f29112d9740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f29041ad2f0 con 0x562726d83070 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f29112d9740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f29041ac550 con 0x562726d5a1b0 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f29112d9740 10 client.0 _ll_register_callbacks cb 0x7f28f4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2903fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272713e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.388 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2903fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272713e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57010/0 (socket says 172.21.15.49:57010) 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2903fff640 1 -- 172.21.15.49:0/3515386270 learned_addr learned my addr 172.21.15.49:0/3515386270 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2909302640 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d83070 0x56272713ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2908b01640 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 0x56272713e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2903fff640 1 -- 172.21.15.49:0/3515386270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 msgr2=0x56272713e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2903fff640 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 0x56272713e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2903fff640 1 -- 172.21.15.49:0/3515386270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d83070 msgr2=0x56272713ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2903fff640 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d83070 0x56272713ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.382+0000 7f2903fff640 1 -- 172.21.15.49:0/3515386270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627271b5bf0 con 0x562726d62390 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.383+0000 7f2903fff640 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272713e7c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f28f40ad4f0 tx=0x7f28f40ebbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49a51e00c850760 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.383+0000 7f28e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.383+0000 7f28e3fff640 1 -- 172.21.15.49:0/3515386270 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f40ad330 con 0x562726d62390 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.383+0000 7f28e3fff640 1 -- 172.21.15.49:0/3515386270 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8638+0+0 (secure 0 0 0) 0x7f28f40b2070 con 0x562726d62390 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.383+0000 7f29112d9740 1 -- 172.21.15.49:0/3515386270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28fc004cc0 con 0x562726d62390 2024-09-21T06:47:07.389 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.383+0000 7f28e3fff640 1 -- 172.21.15.49:0/3515386270 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f28f40ad520 con 0x562726d62390 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.383+0000 7f29112d9740 10 client.18039 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.383+0000 7f29112d9740 1 -- 172.21.15.49:0/3515386270 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5627271b6e60 con 0x562726d62390 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.383+0000 7f28e3fff640 1 -- 172.21.15.49:0/3515386270 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28fc004cc0 con 0x562726d62390 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f28e3fff640 1 -- 172.21.15.49:0/3515386270 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f28f4098020 con 0x562726d62390 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f29112d9740 10 client.18039 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f29112d9740 10 client.18039 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f29112d9740 20 client.18039 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f29112d9740 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562726d16da0 0x5627271b9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f29112d9740 4 client.18039 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f29112d9740 1 -- 172.21.15.49:0/3515386270 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56272709e850 con 0x562726d16da0 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f2908b01640 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562726d16da0 0x5627271b9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f28e3fff640 10 client.18039 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:07.390 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.384+0000 7f2908b01640 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562726d16da0 0x5627271b9150 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4705887c5c733df server_cookie=e1798a41dee534d9 in_seq=0 out_seq=0 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f28e3fff640 1 -- 172.21.15.49:0/3515386270 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x56272709e850 con 0x562726d16da0 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f28e3fff640 10 client.18039 handle_command_reply: tid=0 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 client.18039 shutdown 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 -- 172.21.15.49:0/3515386270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 msgr2=0x56272713e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272713e7c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f28f40ad4f0 tx=0x7f28f40ebbb0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 -- 172.21.15.49:0/3515386270 shutdown_connections 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562726d16da0 0x5627271b9150 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562726d83070 0x56272713ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562726d62390 0x56272713e7c0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 --2- 172.21.15.49:0/3515386270 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562726d5a1b0 0x56272713e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f28e3fff640 0 client.18039 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 -- 172.21.15.49:0/3515386270 >> 172.21.15.49:0/3515386270 conn(0x562726d77460 msgr2=0x562727136b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.391 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 -- 172.21.15.49:0/3515386270 shutdown_connections 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 1 -- 172.21.15.49:0/3515386270 wait complete. 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.385+0000 7f29112d9740 20 client.18039 trim_cache size 0 max 16384 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stdout: "f56024cf-a906-4d93-89e9-d1f90cea5480": { 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:52.601552+0000", 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.392 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:47:07.393 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.395 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.396 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:47:07.397 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "33526aec-feb7-4620-9880-2a7dd5991954": { 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:46:34.268554+0000", 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.398 INFO:teuthology.orchestra.run.smithi049.stdout: "877238a7-c1a9-416c-8f9e-d40ecea3c71a": { 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:10.755554+0000", 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.399 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.400 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:07.401 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:47:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 -- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28f00b6700 msgr2=0x7f28f00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28f00b6700 0x7f28f00b8c10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f28fc005fd0 tx=0x7f28fc009500 comp rx=0 tx=0).stop 2024-09-21T06:47:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 -- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29041083a0 msgr2=0x7f290419aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29041083a0 0x7f290419aab0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f28f400e9c0 tx=0x7f28f400ee80 comp rx=0 tx=0).stop 2024-09-21T06:47:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 -- 172.21.15.49:0/2720567775 shutdown_connections 2024-09-21T06:47:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f28f00b6700 0x7f28f00b8c10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f2904108cf0 0x7f290419fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.402 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f29041083a0 0x7f290419aab0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 --2- 172.21.15.49:0/2720567775 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f2904102a60 0x7f290419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 -- 172.21.15.49:0/2720567775 >> 172.21.15.49:0/2720567775 conn(0x7f2904079730 msgr2=0x7f29041014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 -- 172.21.15.49:0/2720567775 shutdown_connections 2024-09-21T06:47:07.403 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:07.386+0000 7f290ad65640 1 -- 172.21.15.49:0/2720567775 wait complete. 2024-09-21T06:47:07.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:07 smithi049 ceph-mon[31177]: pgmap v642: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 33 op/s 2024-09-21T06:47:08.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:07 smithi098 ceph-mon[34704]: pgmap v642: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 33 op/s 2024-09-21T06:47:08.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:07 smithi079 ceph-mon[34346]: pgmap v642: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 33 op/s 2024-09-21T06:47:08.173 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:47:08.174 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:47:08.437 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:08.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.892+0000 7f1685fbe640 1 -- 172.21.15.49:0/837158544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 msgr2=0x7f168010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.892+0000 7f1685fbe640 1 --2- 172.21.15.49:0/837158544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 0x7f168010f520 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f1678009ca0 tx=0x7f167802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.894 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.892+0000 7f1685fbe640 1 -- 172.21.15.49:0/837158544 shutdown_connections 2024-09-21T06:47:08.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.892+0000 7f1685fbe640 1 --2- 172.21.15.49:0/837158544 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 0x7f168010f520 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.892+0000 7f1685fbe640 1 --2- 172.21.15.49:0/837158544 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16801083a0 0x7f16801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.892+0000 7f1685fbe640 1 --2- 172.21.15.49:0/837158544 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680102a60 0x7f1680102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.892+0000 7f1685fbe640 1 -- 172.21.15.49:0/837158544 >> 172.21.15.49:0/837158544 conn(0x7f1680079730 msgr2=0x7f1680079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:08.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.892+0000 7f1685fbe640 1 -- 172.21.15.49:0/837158544 shutdown_connections 2024-09-21T06:47:08.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.892+0000 7f1685fbe640 1 -- 172.21.15.49:0/837158544 wait complete. 2024-09-21T06:47:08.895 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.893+0000 7f1685fbe640 1 Processor -- start 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.893+0000 7f1685fbe640 1 -- start start 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.893+0000 7f1685fbe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680102a60 0x7f168019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.893+0000 7f1685fbe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16801083a0 0x7f168019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.893+0000 7f1685fbe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 0x7f168019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f1685fbe640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1680113a80 con 0x7f1680108cf0 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f1685fbe640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1680113900 con 0x7f1680102a60 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f1685fbe640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1680113c00 con 0x7f16801083a0 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 0x7f168019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 0x7f168019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57028/0 (socket says 172.21.15.49:57028) 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167ffff640 1 -- 172.21.15.49:0/1694301013 learned_addr learned my addr 172.21.15.49:0/1694301013 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:08.897 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680102a60 0x7f168019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167effd640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16801083a0 0x7f168019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167ffff640 1 -- 172.21.15.49:0/1694301013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16801083a0 msgr2=0x7f168019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167ffff640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16801083a0 0x7f168019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167ffff640 1 -- 172.21.15.49:0/1694301013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680102a60 msgr2=0x7f168019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167ffff640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680102a60 0x7f168019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167ffff640 1 -- 172.21.15.49:0/1694301013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16801a0460 con 0x7f1680108cf0 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167f7fe640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680102a60 0x7f168019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167ffff640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 0x7f168019fd30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1678005cc0 tx=0x7f167802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.894+0000 7f167cff9640 1 -- 172.21.15.49:0/1694301013 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678003bf0 con 0x7f1680108cf0 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.895+0000 7f167cff9640 1 -- 172.21.15.49:0/1694301013 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1678003d90 con 0x7f1680108cf0 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.895+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16801a06f0 con 0x7f1680108cf0 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.895+0000 7f167cff9640 1 -- 172.21.15.49:0/1694301013 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167802fbc0 con 0x7f1680108cf0 2024-09-21T06:47:08.898 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.895+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16801a6eb0 con 0x7f1680108cf0 2024-09-21T06:47:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.896+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1680102e70 con 0x7f1680108cf0 2024-09-21T06:47:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.897+0000 7f167cff9640 1 -- 172.21.15.49:0/1694301013 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f167802fd60 con 0x7f1680108cf0 2024-09-21T06:47:08.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.898+0000 7f167cff9640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16680b6680 0x7f16680b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:08.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.898+0000 7f167f7fe640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16680b6680 0x7f16680b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:08.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.898+0000 7f167cff9640 1 -- 172.21.15.49:0/1694301013 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f1678108a40 con 0x7f1680108cf0 2024-09-21T06:47:08.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.899+0000 7f167f7fe640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16680b6680 0x7f16680b8b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f167000bfd0 tx=0x7f167000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:08.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:08.903+0000 7f167cff9640 1 -- 172.21.15.49:0/1694301013 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16780cef40 con 0x7f1680108cf0 2024-09-21T06:47:09.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.129+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f168010aae0 con 0x7f1680108cf0 2024-09-21T06:47:09.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.130+0000 7f167cff9640 1 -- 172.21.15.49:0/1694301013 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f16780098b0 con 0x7f1680108cf0 2024-09-21T06:47:09.132 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:47:09.132 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:47:09.132 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:47:09.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16680b6680 msgr2=0x7f16680b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:09.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16680b6680 0x7f16680b8b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f167000bfd0 tx=0x7f167000b390 comp rx=0 tx=0).stop 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 msgr2=0x7f168019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 0x7f168019fd30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f1678005cc0 tx=0x7f167802f380 comp rx=0 tx=0).stop 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 shutdown_connections 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f16680b6680 0x7f16680b8b90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1680108cf0 0x7f168019fd30 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f16801083a0 0x7f168019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 --2- 172.21.15.49:0/1694301013 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1680102a60 0x7f168019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 >> 172.21.15.49:0/1694301013 conn(0x7f1680079730 msgr2=0x7f1680105300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 shutdown_connections 2024-09-21T06:47:09.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:09.133+0000 7f1685fbe640 1 -- 172.21.15.49:0/1694301013 wait complete. 2024-09-21T06:47:09.735 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:47:09.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:09 smithi049 ceph-mon[31177]: pgmap v643: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 87 KiB/s wr, 35 op/s 2024-09-21T06:47:09.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:09 smithi049 ceph-mon[31177]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:47:09.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:09 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1694301013' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:47:09.996 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:10.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:09 smithi098 ceph-mon[34704]: pgmap v643: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 87 KiB/s wr, 35 op/s 2024-09-21T06:47:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:09 smithi098 ceph-mon[34704]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:47:10.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:09 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1694301013' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:47:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:09 smithi079 ceph-mon[34346]: pgmap v643: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 87 KiB/s wr, 35 op/s 2024-09-21T06:47:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:09 smithi079 ceph-mon[34346]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:47:10.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:09 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1694301013' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:47:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.442+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/3037881695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 msgr2=0x7fe7c810d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.442+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/3037881695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 0x7fe7c810d850 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8009900 tx=0x7fe7b802a410 comp rx=0 tx=0).stop 2024-09-21T06:47:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.442+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/3037881695 shutdown_connections 2024-09-21T06:47:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.442+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/3037881695 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c810de10 0x7fe7c8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.442+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/3037881695 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 0x7fe7c810d850 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.446 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.442+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/3037881695 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7c81049b0 0x7fe7c8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.442+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/3037881695 >> 172.21.15.49:0/3037881695 conn(0x7fe7c8079730 msgr2=0x7fe7c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.442+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/3037881695 shutdown_connections 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.442+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/3037881695 wait complete. 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cf7e0640 1 Processor -- start 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cf7e0640 1 -- start start 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cf7e0640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7c81049b0 0x7fe7c81026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cf7e0640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 0x7fe7c8102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cf7e0640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c810de10 0x7fe7c8103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cf7e0640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c8113a70 con 0x7fe7c8105300 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cf7e0640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c81138f0 con 0x7fe7c810de10 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cf7e0640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c8113bf0 con 0x7fe7c81049b0 2024-09-21T06:47:10.447 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7ccd7b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 0x7fe7c8102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7ccd7b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 0x7fe7c8102c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57048/0 (socket says 172.21.15.49:57048) 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7ccd7b640 1 -- 172.21.15.49:0/4023535672 learned_addr learned my addr 172.21.15.49:0/4023535672 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7c81049b0 0x7fe7c81026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c810de10 0x7fe7c8103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7ccd7b640 1 -- 172.21.15.49:0/4023535672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7c81049b0 msgr2=0x7fe7c81026f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7ccd7b640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7c81049b0 0x7fe7c81026f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7ccd7b640 1 -- 172.21.15.49:0/4023535672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c810de10 msgr2=0x7fe7c8103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7ccd7b640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c810de10 0x7fe7c8103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.443+0000 7fe7ccd7b640 1 -- 172.21.15.49:0/4023535672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7c81a8740 con 0x7fe7c8105300 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.444+0000 7fe7ccd7b640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 0x7fe7c8102c30 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe7b802a930 tx=0x7fe7b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.444+0000 7fe7be7fc640 1 -- 172.21.15.49:0/4023535672 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b803f030 con 0x7fe7c8105300 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.444+0000 7fe7be7fc640 1 -- 172.21.15.49:0/4023535672 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7b8003aa0 con 0x7fe7c8105300 2024-09-21T06:47:10.448 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.444+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/4023535672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7c81a89d0 con 0x7fe7c8105300 2024-09-21T06:47:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.444+0000 7fe7be7fc640 1 -- 172.21.15.49:0/4023535672 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8035070 con 0x7fe7c8105300 2024-09-21T06:47:10.449 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.444+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/4023535672 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7c81a8eb0 con 0x7fe7c8105300 2024-09-21T06:47:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.447+0000 7fe7d5d54740 1 Processor -- start 2024-09-21T06:47:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.447+0000 7fe7d5d54740 1 -- start start 2024-09-21T06:47:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.447+0000 7fe7be7fc640 1 -- 172.21.15.49:0/4023535672 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fe7b8042030 con 0x7fe7c8105300 2024-09-21T06:47:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.447+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f7746a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.447+0000 7fe7cdd7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f7746a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7cdd7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f7746a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57062/0 (socket says 172.21.15.49:57062) 2024-09-21T06:47:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f774be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f775120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.451 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7cdd7d640 1 -- 172.21.15.49:0/4036654705 learned_addr learned my addr 172.21.15.49:0/4036654705 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4036654705 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563d7f6eaea0 con 0x563d7f3cd070 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4036654705 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563d7f6da2d0 con 0x563d7f3ac390 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4036654705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563d7f6de0e0 con 0x563d7f3a41b0 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f774be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7ccd7b640 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f775120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7be7fc640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7b40b6680 0x7fe7b40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7cd57c640 1 -- 172.21.15.49:0/4036654705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 msgr2=0x563d7f775120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f775120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7cd57c640 1 -- 172.21.15.49:0/4036654705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 msgr2=0x563d7f7746a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f7746a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7cd57c640 1 -- 172.21.15.49:0/4036654705 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7f438650 con 0x563d7f3a41b0 2024-09-21T06:47:10.452 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.448+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f7746a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:10.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.449+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7b40b6680 0x7fe7b40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.449+0000 7fe7be7fc640 1 -- 172.21.15.49:0/4023535672 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fe7b8107b10 con 0x7fe7c8105300 2024-09-21T06:47:10.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.449+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f774be0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8104140 tx=0x7fe7c400ab20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70d3c8917cdc2a89 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:10.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.449+0000 7fe7b37fe640 1 -- 172.21.15.49:0/4036654705 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4004030 con 0x563d7f3a41b0 2024-09-21T06:47:10.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.449+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7b40b6680 0x7fe7b40b8b90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0005c40 tx=0x7fe7c0004a40 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:10.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.449+0000 7fe7b37fe640 1 -- 172.21.15.49:0/4036654705 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7c400cd10 con 0x563d7f3a41b0 2024-09-21T06:47:10.453 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.449+0000 7fe7b37fe640 1 -- 172.21.15.49:0/4036654705 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4003b60 con 0x563d7f3a41b0 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.450+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4036654705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 msgr2=0x563d7f774be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.450+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f774be0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8104140 tx=0x7fe7c400ab20 comp rx=0 tx=0).stop 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.450+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4036654705 shutdown_connections 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.450+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f775120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.450+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f774be0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.450+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4036654705 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f7746a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.450+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4036654705 >> 172.21.15.49:0/4036654705 conn(0x563d7f3c1460 msgr2=0x563d7f772590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.450+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4036654705 shutdown_connections 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.450+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4036654705 wait complete. 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7d5d54740 1 -- start start 2024-09-21T06:47:10.457 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7d5d54740 1 Processor -- start 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3a41b0 0x563d7f77fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3ac390 0x563d7f780230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3cd070 0x563d7f780770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7d5d54740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563d7f53b700 con 0x563d7f3a41b0 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7d5d54740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563d7f675160 con 0x563d7f3cd070 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7d5d54740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563d7f782e80 con 0x563d7f3ac390 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7d5d54740 10 client.0 _ll_register_callbacks cb 0x563d7f68e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7cd57c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3a41b0 0x563d7f77fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7cd57c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3a41b0 0x563d7f77fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57064/0 (socket says 172.21.15.49:57064) 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7cd57c640 1 -- 172.21.15.49:0/4164401410 learned_addr learned my addr 172.21.15.49:0/4164401410 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7ccd7b640 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3ac390 0x563d7f780230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.451+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3cd070 0x563d7f780770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7cd57c640 1 -- 172.21.15.49:0/4164401410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3ac390 msgr2=0x563d7f780230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:10.458 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3ac390 0x563d7f780230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7cd57c640 1 -- 172.21.15.49:0/4164401410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3cd070 msgr2=0x563d7f780770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3cd070 0x563d7f780770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7cd57c640 1 -- 172.21.15.49:0/4164401410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7f6a2c90 con 0x563d7f3a41b0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3a41b0 0x563d7f77fcf0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4020040 tx=0x7fe7c400cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6f1a413e8fe7dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4164401410 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c402c020 con 0x563d7f3a41b0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4164401410 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fe7c4028670 con 0x563d7f3a41b0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4164401410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7c400cd10 con 0x563d7f3a41b0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4164401410 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe7c4037050 con 0x563d7f3a41b0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7d5d54740 10 client.18057 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.452+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4164401410 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d7f78eb00 con 0x563d7f3a41b0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.453+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4164401410 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7c400cd10 con 0x563d7f3a41b0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.453+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4164401410 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe7c401e820 con 0x563d7f3a41b0 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.453+0000 7fe7d5d54740 10 client.18057 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:10.459 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.453+0000 7fe7d5d54740 10 client.18057 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.453+0000 7fe7d5d54740 20 client.18057 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.453+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x563d7f38b9f0 0x563d7f791f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.453+0000 7fe7d5d54740 4 client.18057 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.453+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4164401410 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563d7f6ecdf0 con 0x563d7f38b9f0 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.453+0000 7fe7ccd7b640 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x563d7f38b9f0 0x563d7f791f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.454+0000 7fe7ccd7b640 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x563d7f38b9f0 0x563d7f791f70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=13bd8ceab3e752d5 server_cookie=9b71ea4fb9d7161e in_seq=0 out_seq=0 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.454+0000 7fe7b0ff9640 10 client.18057 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.454+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4164401410 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563d7f6ecdf0 con 0x563d7f38b9f0 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.454+0000 7fe7b0ff9640 10 client.18057 handle_command_reply: tid=0 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 client.18057 shutdown 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4164401410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3a41b0 msgr2=0x563d7f77fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3a41b0 0x563d7f77fcf0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4020040 tx=0x7fe7c400cec0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4164401410 shutdown_connections 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x563d7f38b9f0 0x563d7f791f70 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.460 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3cd070 0x563d7f780770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3ac390 0x563d7f780230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4164401410 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3a41b0 0x563d7f77fcf0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7b0ff9640 0 client.18057 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:47:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4164401410 >> 172.21.15.49:0/4164401410 conn(0x563d7f3c1460 msgr2=0x563d7f777880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4164401410 shutdown_connections 2024-09-21T06:47:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4164401410 wait complete. 2024-09-21T06:47:10.461 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.455+0000 7fe7d5d54740 20 client.18057 trim_cache size 0 max 16384 2024-09-21T06:47:10.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.468+0000 7fe7d5d54740 1 Processor -- start 2024-09-21T06:47:10.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.468+0000 7fe7d5d54740 1 -- start start 2024-09-21T06:47:10.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f7761a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f781bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.471 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f78b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7d5d54740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c81aff20 con 0x563d7f3cd070 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7d5d54740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c81ad7f0 con 0x563d7f3ac390 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7d5d54740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c81ab660 con 0x563d7f3a41b0 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cdd7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f78b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cdd7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f78b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57080/0 (socket says 172.21.15.49:57080) 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cdd7d640 1 -- 172.21.15.49:0/3905029019 learned_addr learned my addr 172.21.15.49:0/3905029019 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/3905029019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f7761a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7ccd7b640 1 --2- 172.21.15.49:0/3905029019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f781bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cdd7d640 1 -- 172.21.15.49:0/3905029019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 msgr2=0x563d7f7761a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/3905029019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f7761a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.472 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cdd7d640 1 -- 172.21.15.49:0/3905029019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 msgr2=0x563d7f781bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:10.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/3905029019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f781bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cdd7d640 1 -- 172.21.15.49:0/3905029019 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563d7f780fb0 con 0x563d7f3cd070 2024-09-21T06:47:10.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/3905029019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f78b7a0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000f8a0 tx=0x7fe7c0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c63eaf7f639acb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:10.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.469+0000 7fe7b2ffd640 1 -- 172.21.15.49:0/3905029019 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0012bc0 con 0x563d7f3cd070 2024-09-21T06:47:10.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7b2ffd640 1 -- 172.21.15.49:0/3905029019 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7c0017070 con 0x563d7f3cd070 2024-09-21T06:47:10.473 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7b2ffd640 1 -- 172.21.15.49:0/3905029019 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00113e0 con 0x563d7f3cd070 2024-09-21T06:47:10.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7d5d54740 1 -- 172.21.15.49:0/3905029019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 msgr2=0x563d7f78b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:10.476 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/3905029019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f78b7a0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fe7c000f8a0 tx=0x7fe7c0015000 comp rx=0 tx=0).stop 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7d5d54740 1 -- 172.21.15.49:0/3905029019 shutdown_connections 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/3905029019 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f78b7a0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/3905029019 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f781bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/3905029019 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f7761a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7d5d54740 1 -- 172.21.15.49:0/3905029019 >> 172.21.15.49:0/3905029019 conn(0x563d7f3c1460 msgr2=0x563d7f78b090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7d5d54740 1 -- 172.21.15.49:0/3905029019 shutdown_connections 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.470+0000 7fe7d5d54740 1 -- 172.21.15.49:0/3905029019 wait complete. 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.471+0000 7fe7d5d54740 1 -- start start 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.471+0000 7fe7d5d54740 1 Processor -- start 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.471+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f788670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.477 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.471+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f783b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.471+0000 7fe7d5d54740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f784060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.471+0000 7fe7d5d54740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c81abcb0 con 0x563d7f3cd070 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.471+0000 7fe7d5d54740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c81ad120 con 0x563d7f3ac390 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.471+0000 7fe7d5d54740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe7c81ac380 con 0x563d7f3a41b0 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7d5d54740 10 client.0 _ll_register_callbacks cb 0x7fe7c0009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cdd7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f784060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cdd7d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f784060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57096/0 (socket says 172.21.15.49:57096) 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cdd7d640 1 -- 172.21.15.49:0/4171932538 learned_addr learned my addr 172.21.15.49:0/4171932538 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7ccd7b640 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f783b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f788670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cdd7d640 1 -- 172.21.15.49:0/4171932538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 msgr2=0x563d7f788670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f788670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cdd7d640 1 -- 172.21.15.49:0/4171932538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 msgr2=0x563d7f783b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f783b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cdd7d640 1 -- 172.21.15.49:0/4171932538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563d7f7845a0 con 0x563d7f3cd070 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7cdd7d640 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f784060 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0005bf0 tx=0x7fe7c00095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f68323a05e6e75 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4171932538 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0037060 con 0x563d7f3cd070 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4171932538 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fe7c001f420 con 0x563d7f3cd070 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.472+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4171932538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7c0017070 con 0x563d7f3cd070 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4171932538 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe7c001f620 con 0x563d7f3cd070 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7d5d54740 10 client.18063 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4171932538 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563d7f7fc430 con 0x563d7f3cd070 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4171932538 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7c0017070 con 0x563d7f3cd070 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4171932538 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fe7c000f040 con 0x563d7f3cd070 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7d5d54740 10 client.18063 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7d5d54740 10 client.18063 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:47:10.479 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7d5d54740 20 client.18063 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x563d7f360da0 0x563d7f7feae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7d5d54740 4 client.18063 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4171932538 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563d7f6e88a0 con 0x563d7f360da0 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.473+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x563d7f360da0 0x563d7f7feae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7b0ff9640 10 client.18063 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7cd57c640 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x563d7f360da0 0x563d7f7feae0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b9e4416a0976f282 server_cookie=5424b94a1d6fca4c in_seq=0 out_seq=0 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7b0ff9640 1 -- 172.21.15.49:0/4171932538 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563d7f6e88a0 con 0x563d7f360da0 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7b0ff9640 10 client.18063 handle_command_reply: tid=0 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 client.18063 shutdown 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4171932538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 msgr2=0x563d7f784060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f784060 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0005bf0 tx=0x7fe7c00095e0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4171932538 shutdown_connections 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x563d7f360da0 0x563d7f7feae0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.480 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563d7f3cd070 0x563d7f784060 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563d7f3ac390 0x563d7f783b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 --2- 172.21.15.49:0/4171932538 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563d7f3a41b0 0x563d7f788670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4171932538 >> 172.21.15.49:0/4171932538 conn(0x563d7f3c1460 msgr2=0x563d7f781910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:10.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7b0ff9640 0 client.18063 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:47:10.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.474+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4171932538 shutdown_connections 2024-09-21T06:47:10.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7d5d54740 1 -- 172.21.15.49:0/4171932538 wait complete. 2024-09-21T06:47:10.481 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7d5d54740 20 client.18063 trim_cache size 0 max 16384 2024-09-21T06:47:10.481 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7b40b6680 msgr2=0x7fe7b40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7b40b6680 0x7fe7b40b8b90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0005c40 tx=0x7fe7c0004a40 comp rx=0 tx=0).stop 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 msgr2=0x7fe7c8102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 0x7fe7c8102c30 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe7b802a930 tx=0x7fe7b8004270 comp rx=0 tx=0).stop 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/4023535672 shutdown_connections 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe7b40b6680 0x7fe7b40b8b90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe7c810de10 0x7fe7c8103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe7c8105300 0x7fe7c8102c30 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 --2- 172.21.15.49:0/4023535672 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe7c81049b0 0x7fe7c81026f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:10.482 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/4023535672 >> 172.21.15.49:0/4023535672 conn(0x7fe7c8079730 msgr2=0x7fe7c8100820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:10.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/4023535672 shutdown_connections 2024-09-21T06:47:10.483 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:10.475+0000 7fe7cf7e0640 1 -- 172.21.15.49:0/4023535672 wait complete. 2024-09-21T06:47:11.169 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:47:11.429 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:11.804 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:11 smithi049 ceph-mon[31177]: pgmap v645: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-21T06:47:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.893+0000 7f1ad9895640 1 -- 172.21.15.49:0/3843760613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 msgr2=0x7f1ad4102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.893+0000 7f1ad9895640 1 --2- 172.21.15.49:0/3843760613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 0x7f1ad4102eb0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009900 tx=0x7f1ac402a410 comp rx=0 tx=0).stop 2024-09-21T06:47:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.893+0000 7f1ad9895640 1 -- 172.21.15.49:0/3843760613 shutdown_connections 2024-09-21T06:47:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.893+0000 7f1ad9895640 1 --2- 172.21.15.49:0/3843760613 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ad4108d30 0x7f1ad410f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.893+0000 7f1ad9895640 1 --2- 172.21.15.49:0/3843760613 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad41083e0 0x7f1ad41087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.893+0000 7f1ad9895640 1 --2- 172.21.15.49:0/3843760613 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 0x7f1ad4102eb0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.893+0000 7f1ad9895640 1 -- 172.21.15.49:0/3843760613 >> 172.21.15.49:0/3843760613 conn(0x7f1ad4079750 msgr2=0x7f1ad4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.893+0000 7f1ad9895640 1 -- 172.21.15.49:0/3843760613 shutdown_connections 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.893+0000 7f1ad9895640 1 -- 172.21.15.49:0/3843760613 wait complete. 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.894+0000 7f1ad9895640 1 Processor -- start 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.894+0000 7f1ad9895640 1 -- start start 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.894+0000 7f1ad9895640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 0x7f1ad419b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.894+0000 7f1ad9895640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ad41083e0 0x7f1ad419b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.894+0000 7f1ad9895640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4108d30 0x7f1ad419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.894+0000 7f1ad9895640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4112a40 con 0x7f1ad4102aa0 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.894+0000 7f1ad9895640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41128c0 con 0x7f1ad4108d30 2024-09-21T06:47:11.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.894+0000 7f1ad9895640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad4112bc0 con 0x7f1ad41083e0 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 0x7f1ad419b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 0x7f1ad419b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57114/0 (socket says 172.21.15.49:57114) 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad2ffd640 1 -- 172.21.15.49:0/2870666522 learned_addr learned my addr 172.21.15.49:0/2870666522 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4108d30 0x7f1ad419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1aca7fc640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ad41083e0 0x7f1ad419b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad2ffd640 1 -- 172.21.15.49:0/2870666522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ad41083e0 msgr2=0x7f1ad419b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ad41083e0 0x7f1ad419b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad2ffd640 1 -- 172.21.15.49:0/2870666522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4108d30 msgr2=0x7f1ad419bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4108d30 0x7f1ad419bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad2ffd640 1 -- 172.21.15.49:0/2870666522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad41a6510 con 0x7f1ad4102aa0 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1aca7fc640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ad41083e0 0x7f1ad419b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 0x7f1ad419b290 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4005ab0 tx=0x7f1ac4003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad8893640 1 -- 172.21.15.49:0/2870666522 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac403f070 con 0x7f1ad4102aa0 2024-09-21T06:47:11.903 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad8893640 1 -- 172.21.15.49:0/2870666522 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ac4031d60 con 0x7f1ad4102aa0 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad9895640 1 -- 172.21.15.49:0/2870666522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad41a67a0 con 0x7f1ad4102aa0 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad8893640 1 -- 172.21.15.49:0/2870666522 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4035030 con 0x7f1ad4102aa0 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.895+0000 7f1ad9895640 1 -- 172.21.15.49:0/2870666522 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad41a6c80 con 0x7f1ad4102aa0 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1adfe09740 1 Processor -- start 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1adfe09740 1 -- start start 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1ad8893640 1 -- 172.21.15.49:0/2870666522 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f1ac4042070 con 0x7f1ad4102aa0 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eed3070 0x555a6f27a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f27a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f27ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1adfe09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555a6f1f0ea0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1adfe09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a6f1e02d0 con 0x555a6eeb2390 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1adfe09740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555a6f1e40e0 con 0x555a6eed3070 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1ad2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f27a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.904 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1ad2ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f27a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57124/0 (socket says 172.21.15.49:57124) 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.898+0000 7f1ad2ffd640 1 -- 172.21.15.49:0/2836821819 learned_addr learned my addr 172.21.15.49:0/2836821819 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/2836821819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eed3070 0x555a6f27a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1aca7fc640 1 --2- 172.21.15.49:0/2836821819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f27ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ad2ffd640 1 -- 172.21.15.49:0/2836821819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eed3070 msgr2=0x555a6f27a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/2836821819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eed3070 0x555a6f27a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ad2ffd640 1 -- 172.21.15.49:0/2836821819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 msgr2=0x555a6f27ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/2836821819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f27ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ad2ffd640 1 -- 172.21.15.49:0/2836821819 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6ef3e650 con 0x555a6eeaa1b0 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/2836821819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f27a800 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f1ac41053f0 tx=0x7f1ac410e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3902f13b7c4beb7a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ad8893640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1ac00b6680 0x7f1ac00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1ac00b6680 0x7f1ac00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.899+0000 7f1ac9ffb640 1 -- 172.21.15.49:0/2836821819 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40ca1d0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.900+0000 7f1ad8893640 1 -- 172.21.15.49:0/2870666522 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f1ac4107d80 con 0x7f1ad4102aa0 2024-09-21T06:47:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.900+0000 7f1ac9ffb640 1 -- 172.21.15.49:0/2836821819 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ac40cd690 con 0x555a6eeaa1b0 2024-09-21T06:47:11.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.900+0000 7f1ac9ffb640 1 -- 172.21.15.49:0/2836821819 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40cc690 con 0x555a6eeaa1b0 2024-09-21T06:47:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.900+0000 7f1adfe09740 1 -- 172.21.15.49:0/2836821819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 msgr2=0x555a6f27a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.900+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1ac00b6680 0x7f1ac00b8b90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1ad406cc20 tx=0x7f1acc009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.900+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2836821819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f27a800 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f1ac41053f0 tx=0x7f1ac410e470 comp rx=0 tx=0).stop 2024-09-21T06:47:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.901+0000 7f1adfe09740 1 -- 172.21.15.49:0/2836821819 shutdown_connections 2024-09-21T06:47:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.901+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2836821819 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f27ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.901+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2836821819 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f27a800 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.901+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2836821819 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eed3070 0x555a6f27a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.901+0000 7f1adfe09740 1 -- 172.21.15.49:0/2836821819 >> 172.21.15.49:0/2836821819 conn(0x555a6eec7460 msgr2=0x555a6f2781b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.901+0000 7f1adfe09740 1 -- 172.21.15.49:0/2836821819 shutdown_connections 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.901+0000 7f1adfe09740 1 -- 172.21.15.49:0/2836821819 wait complete. 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.901+0000 7f1adfe09740 1 -- start start 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.901+0000 7f1adfe09740 1 Processor -- start 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeaa1b0 0x555a6f289d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eeb2390 0x555a6f28a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eed3070 0x555a6f28a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1adfe09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x555a6f041700 con 0x555a6eed3070 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1adfe09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x555a6f17b160 con 0x555a6eeaa1b0 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1adfe09740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x555a6f28cbc0 con 0x555a6eeb2390 2024-09-21T06:47:11.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1adfe09740 10 client.0 _ll_register_callbacks cb 0x555a6f1949e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eed3070 0x555a6f28a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad37fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eed3070 0x555a6f28a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57126/0 (socket says 172.21.15.49:57126) 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1aca7fc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eeb2390 0x555a6f28a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad37fe640 1 -- 172.21.15.49:0/2194219978 learned_addr learned my addr 172.21.15.49:0/2194219978 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeaa1b0 0x555a6f289d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad37fe640 1 -- 172.21.15.49:0/2194219978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eeb2390 msgr2=0x555a6f28a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eeb2390 0x555a6f28a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad37fe640 1 -- 172.21.15.49:0/2194219978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeaa1b0 msgr2=0x555a6f289d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeaa1b0 0x555a6f289d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad37fe640 1 -- 172.21.15.49:0/2194219978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a6f1a8c90 con 0x555a6eed3070 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eed3070 0x555a6f28a780 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009b00 tx=0x7f1acc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ea4e169bb16451 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.902+0000 7f1ab2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/2194219978 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1acc003b70 con 0x555a6eed3070 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/2194219978 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f1acc003d10 con 0x555a6eed3070 2024-09-21T06:47:11.911 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1adfe09740 1 -- 172.21.15.49:0/2194219978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ac40cd690 con 0x555a6eed3070 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/2194219978 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1acc004020 con 0x555a6eed3070 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1adfe09740 10 client.18075 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1adfe09740 1 -- 172.21.15.49:0/2194219978 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a6f2987f0 con 0x555a6eed3070 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/2194219978 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ac40cd690 con 0x555a6eed3070 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/2194219978 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1acc00f040 con 0x555a6eed3070 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1adfe09740 10 client.18075 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1adfe09740 10 client.18075 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1adfe09740 20 client.18075 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555a6ee919f0 0x555a6f29bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1adfe09740 4 client.18075 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.903+0000 7f1adfe09740 1 -- 172.21.15.49:0/2194219978 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a6f1f2df0 con 0x555a6ee919f0 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.904+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555a6ee919f0 0x555a6f29bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.912 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.904+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555a6ee919f0 0x555a6f29bd20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dda0ae97c9cdb3c3 server_cookie=514e28247f23a20c in_seq=0 out_seq=0 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.904+0000 7f1ab2ffd640 10 client.18075 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/2194219978 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a6f1f2df0 con 0x555a6ee919f0 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1ab2ffd640 10 client.18075 handle_command_reply: tid=0 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 client.18075 shutdown 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 -- 172.21.15.49:0/2194219978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eed3070 msgr2=0x555a6f28a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eed3070 0x555a6f28a780 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009b00 tx=0x7f1acc004a40 comp rx=0 tx=0).stop 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 -- 172.21.15.49:0/2194219978 shutdown_connections 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555a6ee919f0 0x555a6f29bd20 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eed3070 0x555a6f28a780 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6eeb2390 0x555a6f28a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1ab2ffd640 0 client.18075 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 --2- 172.21.15.49:0/2194219978 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeaa1b0 0x555a6f289d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 -- 172.21.15.49:0/2194219978 >> 172.21.15.49:0/2194219978 conn(0x555a6eec7460 msgr2=0x555a6f276750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:11.913 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 -- 172.21.15.49:0/2194219978 shutdown_connections 2024-09-21T06:47:11.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 1 -- 172.21.15.49:0/2194219978 wait complete. 2024-09-21T06:47:11.914 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.905+0000 7f1adfe09740 20 client.18075 trim_cache size 0 max 16384 2024-09-21T06:47:11.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1adfe09740 1 Processor -- start 2024-09-21T06:47:11.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1adfe09740 1 -- start start 2024-09-21T06:47:11.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 0x555a6f287100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f287640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f277b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1adfe09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41aff30 con 0x555a6eeaa1b0 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1adfe09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41ad800 con 0x555a6eeb2390 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1adfe09740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41ab670 con 0x555a6ee919f0 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1aca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f287640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1aca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f287640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57134/0 (socket says 172.21.15.49:57134) 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1aca7fc640 1 -- 172.21.15.49:0/3567139913 learned_addr learned my addr 172.21.15.49:0/3567139913 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f277b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 0x555a6f287100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1aca7fc640 1 -- 172.21.15.49:0/3567139913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 msgr2=0x555a6f287100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:11.922 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1aca7fc640 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 0x555a6f287100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1aca7fc640 1 -- 172.21.15.49:0/3567139913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 msgr2=0x555a6f277b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1aca7fc640 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f277b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1aca7fc640 1 -- 172.21.15.49:0/3567139913 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6f27cbd0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f277b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.919+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 0x555a6f287100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.920+0000 7f1aca7fc640 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f287640 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f1abc008da0 tx=0x7f1abc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c932d96eadf9c44f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.920+0000 7f1ac97fa640 1 -- 172.21.15.49:0/3567139913 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc004320 con 0x555a6eeaa1b0 2024-09-21T06:47:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.920+0000 7f1ac97fa640 1 -- 172.21.15.49:0/3567139913 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1abc0044c0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.923 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.920+0000 7f1ac97fa640 1 -- 172.21.15.49:0/3567139913 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0035f0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.920+0000 7f1adfe09740 1 -- 172.21.15.49:0/3567139913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 msgr2=0x555a6f287640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f287640 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f1abc008da0 tx=0x7f1abc011810 comp rx=0 tx=0).stop 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 -- 172.21.15.49:0/3567139913 shutdown_connections 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f277b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f287640 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 --2- 172.21.15.49:0/3567139913 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 0x555a6f287100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 -- 172.21.15.49:0/3567139913 >> 172.21.15.49:0/3567139913 conn(0x555a6eec7460 msgr2=0x555a6f288580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 -- 172.21.15.49:0/3567139913 shutdown_connections 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 -- 172.21.15.49:0/3567139913 wait complete. 2024-09-21T06:47:11.927 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 -- start start 2024-09-21T06:47:11.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.921+0000 7f1adfe09740 1 Processor -- start 2024-09-21T06:47:11.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 0x555a6f291e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f292360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1adfe09740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f28cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1adfe09740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41abcc0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.929 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1adfe09740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41ad130 con 0x555a6eeb2390 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1adfe09740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad41ac390 con 0x555a6ee919f0 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1adfe09740 10 client.0 _ll_register_callbacks cb 0x7f1acc009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1aca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f292360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1aca7fc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f292360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57138/0 (socket says 172.21.15.49:57138) 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1aca7fc640 1 -- 172.21.15.49:0/1500346510 learned_addr learned my addr 172.21.15.49:0/1500346510 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1ad37fe640 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f28cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 0x555a6f291e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1aca7fc640 1 -- 172.21.15.49:0/1500346510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 msgr2=0x555a6f291e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1aca7fc640 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 0x555a6f291e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1aca7fc640 1 -- 172.21.15.49:0/1500346510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 msgr2=0x555a6f28cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1aca7fc640 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f28cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1aca7fc640 1 -- 172.21.15.49:0/1500346510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a6f2929d0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1aca7fc640 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f292360 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009000 tx=0x7f1abc004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709879c71265c443 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:11.930 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.922+0000 7f1ab2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/1500346510 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc005230 con 0x555a6eeaa1b0 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/1500346510 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f1abc017040 con 0x555a6eeaa1b0 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1adfe09740 1 -- 172.21.15.49:0/1500346510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555a6f1ee8a0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/1500346510 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1abc0053d0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1adfe09740 10 client.18081 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1adfe09740 1 -- 172.21.15.49:0/1500346510 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x555a6f306a40 con 0x555a6eeaa1b0 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/1500346510 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555a6f1ee8a0 con 0x555a6eeaa1b0 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/1500346510 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f1abc01b470 con 0x555a6eeaa1b0 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1adfe09740 10 client.18081 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1adfe09740 10 client.18081 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1adfe09740 20 client.18081 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1adfe09740 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555a6eed3070 0x555a6f309180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1adfe09740 4 client.18081 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:47:11.931 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.923+0000 7f1adfe09740 1 -- 172.21.15.49:0/1500346510 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555a6f1ebcd0 con 0x555a6eed3070 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.924+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555a6eed3070 0x555a6f309180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.924+0000 7f1ab2ffd640 10 client.18081 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.924+0000 7f1ad2ffd640 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555a6eed3070 0x555a6f309180 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec370905f18a722b server_cookie=f2eb04747b3dc65 in_seq=0 out_seq=0 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.924+0000 7f1ab2ffd640 1 -- 172.21.15.49:0/1500346510 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555a6f1ebcd0 con 0x555a6eed3070 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.924+0000 7f1ab2ffd640 10 client.18081 handle_command_reply: tid=0 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.924+0000 7f1adfe09740 1 client.18081 shutdown 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 -- 172.21.15.49:0/1500346510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 msgr2=0x555a6f292360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f292360 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009000 tx=0x7f1abc004920 comp rx=0 tx=0).stop 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 -- 172.21.15.49:0/1500346510 shutdown_connections 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x555a6eed3070 0x555a6f309180 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x555a6eeb2390 0x555a6f28cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x555a6eeaa1b0 0x555a6f292360 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1ab2ffd640 0 client.18081 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 --2- 172.21.15.49:0/1500346510 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x555a6ee919f0 0x555a6f291e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 -- 172.21.15.49:0/1500346510 >> 172.21.15.49:0/1500346510 conn(0x555a6eec7460 msgr2=0x555a6f277ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:11.932 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 -- 172.21.15.49:0/1500346510 shutdown_connections 2024-09-21T06:47:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 1 -- 172.21.15.49:0/1500346510 wait complete. 2024-09-21T06:47:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1adfe09740 20 client.18081 trim_cache size 0 max 16384 2024-09-21T06:47:11.933 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:47:11.933 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1ad9895640 1 -- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1ac00b6680 msgr2=0x7f1ac00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1ad9895640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1ac00b6680 0x7f1ac00b8b90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1ad406cc20 tx=0x7f1acc009600 comp rx=0 tx=0).stop 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1ad9895640 1 -- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 msgr2=0x7f1ad419b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1ad9895640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 0x7f1ad419b290 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4005ab0 tx=0x7f1ac4003cd0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1ad9895640 1 -- 172.21.15.49:0/2870666522 shutdown_connections 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1ad9895640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f1ac00b6680 0x7f1ac00b8b90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1ad9895640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1ad4108d30 0x7f1ad419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.925+0000 7f1ad9895640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1ad41083e0 0x7f1ad419b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.926+0000 7f1ad9895640 1 --2- 172.21.15.49:0/2870666522 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f1ad4102aa0 0x7f1ad419b290 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.926+0000 7f1ad9895640 1 -- 172.21.15.49:0/2870666522 >> 172.21.15.49:0/2870666522 conn(0x7f1ad4079750 msgr2=0x7f1ad4106430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.926+0000 7f1ad9895640 1 -- 172.21.15.49:0/2870666522 shutdown_connections 2024-09-21T06:47:11.934 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:11.926+0000 7f1ad9895640 1 -- 172.21.15.49:0/2870666522 wait complete. 2024-09-21T06:47:12.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:11 smithi098 ceph-mon[34704]: pgmap v645: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-21T06:47:12.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:11 smithi079 ceph-mon[34346]: pgmap v645: 97 pgs: 97 active+clean; 12 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 104 KiB/s wr, 40 op/s 2024-09-21T06:47:12.626 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:47:12.885 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:13.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.336+0000 7fc58a22d640 1 -- 172.21.15.49:0/1846101468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5841083a0 msgr2=0x7fc5841087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:13.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.336+0000 7fc58a22d640 1 --2- 172.21.15.49:0/1846101468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5841083a0 0x7fc5841087b0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fc578009900 tx=0x7fc57802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.336+0000 7fc58a22d640 1 -- 172.21.15.49:0/1846101468 shutdown_connections 2024-09-21T06:47:13.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.336+0000 7fc58a22d640 1 --2- 172.21.15.49:0/1846101468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc584108cf0 0x7fc58410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.336+0000 7fc58a22d640 1 --2- 172.21.15.49:0/1846101468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc5841083a0 0x7fc5841087b0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.336+0000 7fc58a22d640 1 --2- 172.21.15.49:0/1846101468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc584102a60 0x7fc584102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.336+0000 7fc58a22d640 1 -- 172.21.15.49:0/1846101468 >> 172.21.15.49:0/1846101468 conn(0x7fc584079730 msgr2=0x7fc584079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:13.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.336+0000 7fc58a22d640 1 -- 172.21.15.49:0/1846101468 shutdown_connections 2024-09-21T06:47:13.339 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.336+0000 7fc58a22d640 1 -- 172.21.15.49:0/1846101468 wait complete. 2024-09-21T06:47:13.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc58a22d640 1 Processor -- start 2024-09-21T06:47:13.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc58a22d640 1 -- start start 2024-09-21T06:47:13.341 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc58a22d640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc584102a60 0x7fc58419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc58a22d640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5841083a0 0x7fc58419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc58a22d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc584108cf0 0x7fc58419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc583fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc584108cf0 0x7fc58419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc58a22d640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc584113a80 con 0x7fc584108cf0 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc58a22d640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc584113900 con 0x7fc5841083a0 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc58a22d640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc584113c00 con 0x7fc584102a60 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc583fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc584108cf0 0x7fc58419fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57160/0 (socket says 172.21.15.49:57160) 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc583fff640 1 -- 172.21.15.49:0/4245168446 learned_addr learned my addr 172.21.15.49:0/4245168446 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc5837fe640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc584102a60 0x7fc58419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.337+0000 7fc582ffd640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5841083a0 0x7fc58419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc583fff640 1 -- 172.21.15.49:0/4245168446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc584102a60 msgr2=0x7fc58419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc583fff640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc584102a60 0x7fc58419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc583fff640 1 -- 172.21.15.49:0/4245168446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5841083a0 msgr2=0x7fc58419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:13.342 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc583fff640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5841083a0 0x7fc58419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc583fff640 1 -- 172.21.15.49:0/4245168446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5841a02e0 con 0x7fc584108cf0 2024-09-21T06:47:13.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc583fff640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc584108cf0 0x7fc58419fc70 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00cce0 tx=0x7fc57c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:13.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc580ff9640 1 -- 172.21.15.49:0/4245168446 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00f450 con 0x7fc584108cf0 2024-09-21T06:47:13.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc58a22d640 1 -- 172.21.15.49:0/4245168446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5841a05d0 con 0x7fc584108cf0 2024-09-21T06:47:13.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc580ff9640 1 -- 172.21.15.49:0/4245168446 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc57c00faa0 con 0x7fc584108cf0 2024-09-21T06:47:13.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc58a22d640 1 -- 172.21.15.49:0/4245168446 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5841a6df0 con 0x7fc584108cf0 2024-09-21T06:47:13.343 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.338+0000 7fc580ff9640 1 -- 172.21.15.49:0/4245168446 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c018a80 con 0x7fc584108cf0 2024-09-21T06:47:13.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.341+0000 7fc5907a1740 1 Processor -- start 2024-09-21T06:47:13.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.341+0000 7fc580ff9640 1 -- 172.21.15.49:0/4245168446 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fc57c018c20 con 0x7fc584108cf0 2024-09-21T06:47:13.344 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.341+0000 7fc5907a1740 1 -- start start 2024-09-21T06:47:13.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b6d070 0x564e03f142c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.345 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f14800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 0x564e03f14d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5907a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564e03e8aea0 con 0x564e03b441b0 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5907a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564e03e7a2d0 con 0x564e03b6d070 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5907a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e03e7e0e0 con 0x564e03b4c390 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f14800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f14800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57174/0 (socket says 172.21.15.49:57174) 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5837fe640 1 -- 172.21.15.49:0/2243803971 learned_addr learned my addr 172.21.15.49:0/2243803971 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc582ffd640 1 --2- 172.21.15.49:0/2243803971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 0x564e03f14d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc582ffd640 1 --2- 172.21.15.49:0/2243803971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b6d070 0x564e03f142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc580ff9640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc56c0b66b0 0x7fc56c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5837fe640 1 -- 172.21.15.49:0/2243803971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 msgr2=0x564e03f14d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5837fe640 1 --2- 172.21.15.49:0/2243803971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 0x564e03f14d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.346 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5837fe640 1 -- 172.21.15.49:0/2243803971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b6d070 msgr2=0x564e03f142c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:13.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5837fe640 1 --2- 172.21.15.49:0/2243803971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b6d070 0x564e03f142c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc5837fe640 1 -- 172.21.15.49:0/2243803971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e03bd8650 con 0x564e03b441b0 2024-09-21T06:47:13.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc583fff640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc56c0b66b0 0x7fc56c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.342+0000 7fc580ff9640 1 -- 172.21.15.49:0/4245168446 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fc57c0e7b50 con 0x7fc584108cf0 2024-09-21T06:47:13.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.343+0000 7fc5837fe640 1 --2- 172.21.15.49:0/2243803971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f14800 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc57400ad00 tx=0x7fc57400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43747ea61cb95ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:13.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.343+0000 7fc569ffb640 1 -- 172.21.15.49:0/2243803971 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57401d070 con 0x564e03b441b0 2024-09-21T06:47:13.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.343+0000 7fc569ffb640 1 -- 172.21.15.49:0/2243803971 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc574018af0 con 0x564e03b441b0 2024-09-21T06:47:13.347 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.343+0000 7fc569ffb640 1 -- 172.21.15.49:0/2243803971 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc574010ab0 con 0x564e03b441b0 2024-09-21T06:47:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 -- 172.21.15.49:0/2243803971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 msgr2=0x564e03f14800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc583fff640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc56c0b66b0 0x7fc56c0b8bc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0a9f20 tx=0x7fc57c0aa080 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2243803971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f14800 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fc57400ad00 tx=0x7fc57400f790 comp rx=0 tx=0).stop 2024-09-21T06:47:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 -- 172.21.15.49:0/2243803971 shutdown_connections 2024-09-21T06:47:13.350 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2243803971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 0x564e03f14d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2243803971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f14800 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2243803971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b6d070 0x564e03f142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 -- 172.21.15.49:0/2243803971 >> 172.21.15.49:0/2243803971 conn(0x564e03b61460 msgr2=0x564e03f121b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 -- 172.21.15.49:0/2243803971 shutdown_connections 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 -- 172.21.15.49:0/2243803971 wait complete. 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 -- start start 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.344+0000 7fc5907a1740 1 Processor -- start 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b441b0 0x564e03f1f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b4c390 0x564e03f1fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b6d070 0x564e03f2bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5907a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x564e03cdb700 con 0x564e03b4c390 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5907a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x564e03e15160 con 0x564e03b441b0 2024-09-21T06:47:13.351 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5907a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x564e03f22aa0 con 0x564e03b6d070 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5907a1740 10 client.0 _ll_register_callbacks cb 0x564e03e2e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b4c390 0x564e03f1fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5837fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b4c390 0x564e03f1fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57178/0 (socket says 172.21.15.49:57178) 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5837fe640 1 -- 172.21.15.49:0/296978635 learned_addr learned my addr 172.21.15.49:0/296978635 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc582ffd640 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b6d070 0x564e03f2bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc582ffd640 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b441b0 0x564e03f1f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5837fe640 1 -- 172.21.15.49:0/296978635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b6d070 msgr2=0x564e03f2bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5837fe640 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b6d070 0x564e03f2bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5837fe640 1 -- 172.21.15.49:0/296978635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b441b0 msgr2=0x564e03f1f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5837fe640 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b441b0 0x564e03f1f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5837fe640 1 -- 172.21.15.49:0/296978635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e03e42c90 con 0x564e03b4c390 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc582ffd640 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b441b0 0x564e03f1f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.345+0000 7fc5837fe640 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b4c390 0x564e03f1fef0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fc574010690 tx=0x7fc574018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438bbf3d89430c29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:13.352 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc562ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc562ffd640 1 -- 172.21.15.49:0/296978635 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57401d040 con 0x564e03b4c390 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc562ffd640 1 -- 172.21.15.49:0/296978635 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fc574005040 con 0x564e03b4c390 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc5907a1740 1 -- 172.21.15.49:0/296978635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc574018af0 con 0x564e03b4c390 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc562ffd640 1 -- 172.21.15.49:0/296978635 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc574031050 con 0x564e03b4c390 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc5907a1740 10 client.18093 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc5907a1740 1 -- 172.21.15.49:0/296978635 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e03f2e780 con 0x564e03b4c390 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc562ffd640 1 -- 172.21.15.49:0/296978635 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc574018af0 con 0x564e03b4c390 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc562ffd640 1 -- 172.21.15.49:0/296978635 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc574020030 con 0x564e03b4c390 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc5907a1740 10 client.18093 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc5907a1740 10 client.18093 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.346+0000 7fc5907a1740 20 client.18093 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.347+0000 7fc5907a1740 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564e03b2b9f0 0x564e03f31b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.347+0000 7fc5907a1740 4 client.18093 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:13.353 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.347+0000 7fc5907a1740 1 -- 172.21.15.49:0/296978635 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e03e8cdf0 con 0x564e03b2b9f0 2024-09-21T06:47:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.347+0000 7fc582ffd640 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564e03b2b9f0 0x564e03f31b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.347+0000 7fc582ffd640 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564e03b2b9f0 0x564e03f31b90 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1357c85982e60bdd server_cookie=ec0d9e1bb3db8ab7 in_seq=0 out_seq=0 2024-09-21T06:47:13.354 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.347+0000 7fc562ffd640 10 client.18093 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc562ffd640 1 -- 172.21.15.49:0/296978635 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564e03e8cdf0 con 0x564e03b2b9f0 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc562ffd640 10 client.18093 handle_command_reply: tid=0 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc5907a1740 1 client.18093 shutdown 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc5907a1740 1 -- 172.21.15.49:0/296978635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b4c390 msgr2=0x564e03f1fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc5907a1740 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b4c390 0x564e03f1fef0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fc574010690 tx=0x7fc574018670 comp rx=0 tx=0).stop 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc5907a1740 1 -- 172.21.15.49:0/296978635 shutdown_connections 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc5907a1740 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564e03b2b9f0 0x564e03f31b90 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc5907a1740 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b6d070 0x564e03f2bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc5907a1740 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b4c390 0x564e03f1fef0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.355 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc5907a1740 1 --2- 172.21.15.49:0/296978635 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b441b0 0x564e03f1f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc5907a1740 1 -- 172.21.15.49:0/296978635 >> 172.21.15.49:0/296978635 conn(0x564e03b61460 msgr2=0x564e03f17470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.348+0000 7fc562ffd640 0 client.18093 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.349+0000 7fc5907a1740 1 -- 172.21.15.49:0/296978635 shutdown_connections 2024-09-21T06:47:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.349+0000 7fc5907a1740 1 -- 172.21.15.49:0/296978635 wait complete. 2024-09-21T06:47:13.356 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.349+0000 7fc5907a1740 20 client.18093 trim_cache size 0 max 16384 2024-09-21T06:47:13.365 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc5907a1740 1 Processor -- start 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc5907a1740 1 -- start start 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b441b0 0x564e03f1fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b4c390 0x564e03f2bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b6d070 0x564e03f11b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc5907a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841b2070 con 0x564e03b6d070 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc5907a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841af940 con 0x564e03b4c390 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc5907a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841ad7b0 con 0x564e03b441b0 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b6d070 0x564e03f11b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b6d070 0x564e03f11b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57190/0 (socket says 172.21.15.49:57190) 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc582ffd640 1 -- 172.21.15.49:0/28803906 learned_addr learned my addr 172.21.15.49:0/28803906 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:13.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc5837fe640 1 --2- 172.21.15.49:0/28803906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b4c390 0x564e03f2bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.362+0000 7fc582ffd640 1 --2- 172.21.15.49:0/28803906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b441b0 0x564e03f1fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.363+0000 7fc582ffd640 1 -- 172.21.15.49:0/28803906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b441b0 msgr2=0x564e03f1fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.363+0000 7fc582ffd640 1 --2- 172.21.15.49:0/28803906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b441b0 0x564e03f1fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.363+0000 7fc582ffd640 1 -- 172.21.15.49:0/28803906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b4c390 msgr2=0x564e03f2bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.363+0000 7fc582ffd640 1 --2- 172.21.15.49:0/28803906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b4c390 0x564e03f2bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.363+0000 7fc582ffd640 1 -- 172.21.15.49:0/28803906 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e03f1deb0 con 0x564e03b6d070 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.363+0000 7fc582ffd640 1 --2- 172.21.15.49:0/28803906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b6d070 0x564e03f11b10 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fc57802a430 tx=0x7fc578031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43b6a41408fa59f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.363+0000 7fc5697fa640 1 -- 172.21.15.49:0/28803906 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578035040 con 0x564e03b6d070 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.363+0000 7fc5697fa640 1 -- 172.21.15.49:0/28803906 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc57804e040 con 0x564e03b6d070 2024-09-21T06:47:13.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.363+0000 7fc5697fa640 1 -- 172.21.15.49:0/28803906 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578032040 con 0x564e03b6d070 2024-09-21T06:47:13.369 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 -- 172.21.15.49:0/28803906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b6d070 msgr2=0x564e03f11b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 --2- 172.21.15.49:0/28803906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b6d070 0x564e03f11b10 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fc57802a430 tx=0x7fc578031400 comp rx=0 tx=0).stop 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 -- 172.21.15.49:0/28803906 shutdown_connections 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 --2- 172.21.15.49:0/28803906 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b6d070 0x564e03f11b10 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 --2- 172.21.15.49:0/28803906 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b4c390 0x564e03f2bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 --2- 172.21.15.49:0/28803906 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b441b0 0x564e03f1fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 -- 172.21.15.49:0/28803906 >> 172.21.15.49:0/28803906 conn(0x564e03b61460 msgr2=0x564e03f1f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 -- 172.21.15.49:0/28803906 shutdown_connections 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 -- 172.21.15.49:0/28803906 wait complete. 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.364+0000 7fc5907a1740 1 -- start start 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc5907a1740 1 Processor -- start 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 0x564e03f32b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.370 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc5907a1740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b6d070 0x564e03f33220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc5907a1740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841ade00 con 0x564e03b441b0 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc5907a1740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841af270 con 0x564e03b6d070 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc5907a1740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fc5841ae4d0 con 0x564e03b4c390 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc5907a1740 10 client.0 _ll_register_callbacks cb 0x7fc57401b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc582ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f355e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57196/0 (socket says 172.21.15.49:57196) 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc582ffd640 1 -- 172.21.15.49:0/2448074490 learned_addr learned my addr 172.21.15.49:0/2448074490 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc5837fe640 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 0x564e03f32b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc582ffd640 1 -- 172.21.15.49:0/2448074490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 msgr2=0x564e03f32b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc582ffd640 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 0x564e03f32b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc582ffd640 1 -- 172.21.15.49:0/2448074490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b6d070 msgr2=0x564e03f33220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:13.371 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc582ffd640 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b6d070 0x564e03f33220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.365+0000 7fc582ffd640 1 -- 172.21.15.49:0/2448074490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e03f9b310 con 0x564e03b441b0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc582ffd640 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f355e0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fc578009230 tx=0x7fc578031e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a6cdcf2b8d9cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc562ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc562ffd640 1 -- 172.21.15.49:0/2448074490 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578035040 con 0x564e03b441b0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc562ffd640 1 -- 172.21.15.49:0/2448074490 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fc578004230 con 0x564e03b441b0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc5907a1740 1 -- 172.21.15.49:0/2448074490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc57804e040 con 0x564e03b441b0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc562ffd640 1 -- 172.21.15.49:0/2448074490 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc578063050 con 0x564e03b441b0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc5907a1740 10 client.18099 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc5907a1740 1 -- 172.21.15.49:0/2448074490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x564e03f9c490 con 0x564e03b441b0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc562ffd640 1 -- 172.21.15.49:0/2448074490 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc57804e040 con 0x564e03b441b0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.366+0000 7fc562ffd640 1 -- 172.21.15.49:0/2448074490 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7fc578032090 con 0x564e03b441b0 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc5907a1740 10 client.18099 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc5907a1740 10 client.18099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc5907a1740 20 client.18099 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:13.372 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564e03b00da0 0x564e03f9eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:13.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc5907a1740 4 client.18099 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:47:13.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc5907a1740 1 -- 172.21.15.49:0/2448074490 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e03e888a0 con 0x564e03b00da0 2024-09-21T06:47:13.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc5837fe640 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564e03b00da0 0x564e03f9eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:13.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc562ffd640 10 client.18099 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:13.373 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc5837fe640 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564e03b00da0 0x564e03f9eac0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21d86eda094a3f08 server_cookie=d9bd26c6bb887a5c in_seq=0 out_seq=0 2024-09-21T06:47:13.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc562ffd640 1 -- 172.21.15.49:0/2448074490 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e03e888a0 con 0x564e03b00da0 2024-09-21T06:47:13.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc562ffd640 10 client.18099 handle_command_reply: tid=0 2024-09-21T06:47:13.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.367+0000 7fc5907a1740 1 client.18099 shutdown 2024-09-21T06:47:13.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 -- 172.21.15.49:0/2448074490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 msgr2=0x564e03f355e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:13.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f355e0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fc578009230 tx=0x7fc578031e80 comp rx=0 tx=0).stop 2024-09-21T06:47:13.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 -- 172.21.15.49:0/2448074490 shutdown_connections 2024-09-21T06:47:13.374 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x564e03b00da0 0x564e03f9eac0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x564e03b6d070 0x564e03f33220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc562ffd640 0 client.18099 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:13.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x564e03b4c390 0x564e03f32b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 --2- 172.21.15.49:0/2448074490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x564e03b441b0 0x564e03f355e0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 -- 172.21.15.49:0/2448074490 >> 172.21.15.49:0/2448074490 conn(0x564e03b61460 msgr2=0x564e03f11ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:13.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 -- 172.21.15.49:0/2448074490 shutdown_connections 2024-09-21T06:47:13.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 1 -- 172.21.15.49:0/2448074490 wait complete. 2024-09-21T06:47:13.375 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.368+0000 7fc5907a1740 20 client.18099 trim_cache size 0 max 16384 2024-09-21T06:47:13.375 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:47:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 -- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc56c0b66b0 msgr2=0x7fc56c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc56c0b66b0 0x7fc56c0b8bc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0a9f20 tx=0x7fc57c0aa080 comp rx=0 tx=0).stop 2024-09-21T06:47:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 -- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc584108cf0 msgr2=0x7fc58419fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc584108cf0 0x7fc58419fc70 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00cce0 tx=0x7fc57c00a620 comp rx=0 tx=0).stop 2024-09-21T06:47:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 -- 172.21.15.49:0/4245168446 shutdown_connections 2024-09-21T06:47:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fc56c0b66b0 0x7fc56c0b8bc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fc584108cf0 0x7fc58419fc70 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fc5841083a0 0x7fc58419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.376 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 --2- 172.21.15.49:0/4245168446 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fc584102a60 0x7fc58419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 -- 172.21.15.49:0/4245168446 >> 172.21.15.49:0/4245168446 conn(0x7fc584079730 msgr2=0x7fc5841052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 -- 172.21.15.49:0/4245168446 shutdown_connections 2024-09-21T06:47:13.377 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:13.369+0000 7fc58a22d640 1 -- 172.21.15.49:0/4245168446 wait complete. 2024-09-21T06:47:13.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:13 smithi049 ceph-mon[31177]: pgmap v646: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:47:14.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:13 smithi098 ceph-mon[34704]: pgmap v646: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:47:14.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:13 smithi079 ceph-mon[34346]: pgmap v646: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-09-21T06:47:15.035 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:47:15.036 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:47:15.306 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:15.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.728+0000 7f3d2de6c640 1 -- 172.21.15.49:0/3620894096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 msgr2=0x7f3d2810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:15.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.728+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/3620894096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 0x7f3d2810f520 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009ca0 tx=0x7f3d2002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.728+0000 7f3d2de6c640 1 -- 172.21.15.49:0/3620894096 shutdown_connections 2024-09-21T06:47:15.734 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.728+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/3620894096 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 0x7f3d2810f520 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.728+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/3620894096 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d281083a0 0x7f3d281087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.728+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/3620894096 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d28102a60 0x7f3d28102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.728+0000 7f3d2de6c640 1 -- 172.21.15.49:0/3620894096 >> 172.21.15.49:0/3620894096 conn(0x7f3d28079730 msgr2=0x7f3d28079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.728+0000 7f3d2de6c640 1 -- 172.21.15.49:0/3620894096 shutdown_connections 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.728+0000 7f3d2de6c640 1 -- 172.21.15.49:0/3620894096 wait complete. 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.729+0000 7f3d2de6c640 1 Processor -- start 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.729+0000 7f3d2de6c640 1 -- start start 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.729+0000 7f3d2de6c640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d28102a60 0x7f3d2819a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.729+0000 7f3d2de6c640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d281083a0 0x7f3d2819a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.729+0000 7f3d2de6c640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 0x7f3d2819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.729+0000 7f3d2de6c640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281129b0 con 0x7f3d28108cf0 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.729+0000 7f3d2de6c640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28112830 con 0x7f3d281083a0 2024-09-21T06:47:15.735 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.729+0000 7f3d2de6c640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d28112b30 con 0x7f3d28102a60 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 0x7f3d2819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 0x7f3d2819fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57216/0 (socket says 172.21.15.49:57216) 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d27fff640 1 -- 172.21.15.49:0/1616918440 learned_addr learned my addr 172.21.15.49:0/1616918440 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d277fe640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d28102a60 0x7f3d2819a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d281083a0 0x7f3d2819a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d27fff640 1 -- 172.21.15.49:0/1616918440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d28102a60 msgr2=0x7f3d2819a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d27fff640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d28102a60 0x7f3d2819a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d27fff640 1 -- 172.21.15.49:0/1616918440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d281083a0 msgr2=0x7f3d2819a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d27fff640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d281083a0 0x7f3d2819a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d27fff640 1 -- 172.21.15.49:0/1616918440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d281a0360 con 0x7f3d28108cf0 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d277fe640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d28102a60 0x7f3d2819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d27fff640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 0x7f3d2819fc30 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009430 tx=0x7f3d200319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:15.736 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d24ff9640 1 -- 172.21.15.49:0/1616918440 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d20003c30 con 0x7f3d28108cf0 2024-09-21T06:47:15.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d24ff9640 1 -- 172.21.15.49:0/1616918440 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d20003dd0 con 0x7f3d28108cf0 2024-09-21T06:47:15.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d2de6c640 1 -- 172.21.15.49:0/1616918440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d281a05f0 con 0x7f3d28108cf0 2024-09-21T06:47:15.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.730+0000 7f3d24ff9640 1 -- 172.21.15.49:0/1616918440 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d2002faa0 con 0x7f3d28108cf0 2024-09-21T06:47:15.737 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.731+0000 7f3d2de6c640 1 -- 172.21.15.49:0/1616918440 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281a6db0 con 0x7f3d28108cf0 2024-09-21T06:47:15.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.733+0000 7f3d343e0740 1 Processor -- start 2024-09-21T06:47:15.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.733+0000 7f3d24ff9640 1 -- 172.21.15.49:0/1616918440 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f3d2002fca0 con 0x7f3d28108cf0 2024-09-21T06:47:15.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.733+0000 7f3d343e0740 1 -- start start 2024-09-21T06:47:15.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9322350 0x562ad96c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.741 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d343e0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562ad963fe60 con 0x562ad9301670 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d343e0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ad962f290 con 0x562ad9322350 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d343e0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ad96330a0 con 0x562ad92f9490 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d26ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d26ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57232/0 (socket says 172.21.15.49:57232) 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d26ffd640 1 -- 172.21.15.49:0/1750451659 learned_addr learned my addr 172.21.15.49:0/1750451659 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/1750451659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9322350 0x562ad96c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d277fe640 1 --2- 172.21.15.49:0/1750451659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d26ffd640 1 -- 172.21.15.49:0/1750451659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 msgr2=0x562ad96c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/1750451659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d26ffd640 1 -- 172.21.15.49:0/1750451659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9322350 msgr2=0x562ad96c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/1750451659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9322350 0x562ad96c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.742 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d26ffd640 1 -- 172.21.15.49:0/1750451659 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad938d930 con 0x562ad9301670 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.734+0000 7f3d24ff9640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3d140b6700 0x7f3d140b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.735+0000 7f3d277fe640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3d140b6700 0x7f3d140b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.735+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/1750451659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96c9eb0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3d10014980 tx=0x7f3d1000c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7528166f6148a21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.735+0000 7f3d24ff9640 1 -- 172.21.15.49:0/1616918440 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f3d20108c70 con 0x7f3d28108cf0 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.735+0000 7f3d1dffb640 1 -- 172.21.15.49:0/1750451659 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d100142d0 con 0x562ad9301670 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.735+0000 7f3d1dffb640 1 -- 172.21.15.49:0/1750451659 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d100054d0 con 0x562ad9301670 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.735+0000 7f3d1dffb640 1 -- 172.21.15.49:0/1750451659 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10004e40 con 0x562ad9301670 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 -- 172.21.15.49:0/1750451659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 msgr2=0x562ad96c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d277fe640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3d140b6700 0x7f3d140b8c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x562ad96c80b0 tx=0x7f3d1800b5a0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1750451659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96c9eb0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f3d10014980 tx=0x7f3d1000c4b0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 -- 172.21.15.49:0/1750451659 shutdown_connections 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1750451659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96c9eb0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.743 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1750451659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1750451659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9322350 0x562ad96c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 -- 172.21.15.49:0/1750451659 >> 172.21.15.49:0/1750451659 conn(0x562ad9316740 msgr2=0x562ad96c7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 -- 172.21.15.49:0/1750451659 shutdown_connections 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 -- 172.21.15.49:0/1750451659 wait complete. 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 -- start start 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.736+0000 7f3d343e0740 1 Processor -- start 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96d5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96e0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d343e0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x562ad9490890 con 0x562ad9322350 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d343e0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x562ad95c9d40 con 0x562ad9301670 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d343e0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x562ad96d7c10 con 0x562ad92f9490 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d343e0740 10 client.0 _ll_register_callbacks cb 0x562ad962dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96e0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96e0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57234/0 (socket says 172.21.15.49:57234) 2024-09-21T06:47:15.744 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d27fff640 1 -- 172.21.15.49:0/4214772204 learned_addr learned my addr 172.21.15.49:0/4214772204 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d277fe640 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96d5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d27fff640 1 -- 172.21.15.49:0/4214772204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 msgr2=0x562ad96d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d27fff640 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96d5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d27fff640 1 -- 172.21.15.49:0/4214772204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 msgr2=0x562ad96d55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d27fff640 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d27fff640 1 -- 172.21.15.49:0/4214772204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad96e1570 con 0x562ad9322350 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d277fe640 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96d5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.737+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d27fff640 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96e0f30 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ce9a0 tx=0x7f3d200ce910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c611f6bd7277a6f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d06ffd640 1 -- 172.21.15.49:0/4214772204 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d201067a0 con 0x562ad9322350 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d06ffd640 1 -- 172.21.15.49:0/4214772204 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f3d200305c0 con 0x562ad9322350 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d343e0740 1 -- 172.21.15.49:0/4214772204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d100054d0 con 0x562ad9322350 2024-09-21T06:47:15.745 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d06ffd640 1 -- 172.21.15.49:0/4214772204 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d200cf110 con 0x562ad9322350 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d343e0740 10 client.18111 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d343e0740 1 -- 172.21.15.49:0/4214772204 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562ad96e3ea0 con 0x562ad9322350 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d06ffd640 1 -- 172.21.15.49:0/4214772204 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d100054d0 con 0x562ad9322350 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.738+0000 7f3d06ffd640 1 -- 172.21.15.49:0/4214772204 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3d200d7fa0 con 0x562ad9322350 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.739+0000 7f3d343e0740 10 client.18111 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.739+0000 7f3d343e0740 10 client.18111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.739+0000 7f3d343e0740 20 client.18111 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.739+0000 7f3d343e0740 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ad92e0cd0 0x562ad96e7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.739+0000 7f3d343e0740 4 client.18111 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.739+0000 7f3d343e0740 1 -- 172.21.15.49:0/4214772204 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ad9641db0 con 0x562ad92e0cd0 2024-09-21T06:47:15.746 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.739+0000 7f3d277fe640 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ad92e0cd0 0x562ad96e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.739+0000 7f3d06ffd640 10 client.18111 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.739+0000 7f3d277fe640 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ad92e0cd0 0x562ad96e7290 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664865909ce7fe6e server_cookie=87c14276a2e2308c in_seq=0 out_seq=0 2024-09-21T06:47:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d06ffd640 1 -- 172.21.15.49:0/4214772204 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ad9641db0 con 0x562ad92e0cd0 2024-09-21T06:47:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d06ffd640 10 client.18111 handle_command_reply: tid=0 2024-09-21T06:47:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d343e0740 1 client.18111 shutdown 2024-09-21T06:47:15.747 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d343e0740 1 -- 172.21.15.49:0/4214772204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 msgr2=0x562ad96e0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d343e0740 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96e0f30 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ce9a0 tx=0x7f3d200ce910 comp rx=0 tx=0).stop 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d343e0740 1 -- 172.21.15.49:0/4214772204 shutdown_connections 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d343e0740 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ad92e0cd0 0x562ad96e7290 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d343e0740 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96e0f30 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d343e0740 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d343e0740 1 --2- 172.21.15.49:0/4214772204 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96d5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d343e0740 1 -- 172.21.15.49:0/4214772204 >> 172.21.15.49:0/4214772204 conn(0x562ad9316740 msgr2=0x562ad96cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.740+0000 7f3d06ffd640 0 client.18111 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.741+0000 7f3d343e0740 1 -- 172.21.15.49:0/4214772204 shutdown_connections 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.741+0000 7f3d343e0740 1 -- 172.21.15.49:0/4214772204 wait complete. 2024-09-21T06:47:15.748 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.741+0000 7f3d343e0740 20 client.18111 trim_cache size 0 max 16384 2024-09-21T06:47:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.758+0000 7f3d343e0740 1 Processor -- start 2024-09-21T06:47:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.758+0000 7f3d343e0740 1 -- start start 2024-09-21T06:47:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.758+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96e0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.758+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.758+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96d3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.758+0000 7f3d343e0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281b20e0 con 0x562ad9322350 2024-09-21T06:47:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.758+0000 7f3d343e0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281af9b0 con 0x562ad9301670 2024-09-21T06:47:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.758+0000 7f3d343e0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281ad820 con 0x562ad92f9490 2024-09-21T06:47:15.762 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96d3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d27fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96d3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57242/0 (socket says 172.21.15.49:57242) 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d27fff640 1 -- 172.21.15.49:0/2585846131 learned_addr learned my addr 172.21.15.49:0/2585846131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d277fe640 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96e0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d27fff640 1 -- 172.21.15.49:0/2585846131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 msgr2=0x562ad96e0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d27fff640 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96e0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d27fff640 1 -- 172.21.15.49:0/2585846131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 msgr2=0x562ad96d36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d27fff640 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d27fff640 1 -- 172.21.15.49:0/2585846131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad96c7600 con 0x562ad9322350 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d27fff640 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96d3c10 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ce820 tx=0x7f3d2002f480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a8e0728fb35f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d1d7fa640 1 -- 172.21.15.49:0/2585846131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d201067a0 con 0x562ad9322350 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d1d7fa640 1 -- 172.21.15.49:0/2585846131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d20036030 con 0x562ad9322350 2024-09-21T06:47:15.763 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.759+0000 7f3d1d7fa640 1 -- 172.21.15.49:0/2585846131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d200ce180 con 0x562ad9322350 2024-09-21T06:47:15.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 -- 172.21.15.49:0/2585846131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 msgr2=0x562ad96d3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:15.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96d3c10 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ce820 tx=0x7f3d2002f480 comp rx=0 tx=0).stop 2024-09-21T06:47:15.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 -- 172.21.15.49:0/2585846131 shutdown_connections 2024-09-21T06:47:15.766 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9322350 0x562ad96d3c10 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad9301670 0x562ad96d36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 --2- 172.21.15.49:0/2585846131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad92f9490 0x562ad96e0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 -- 172.21.15.49:0/2585846131 >> 172.21.15.49:0/2585846131 conn(0x562ad9316740 msgr2=0x562ad96cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 -- 172.21.15.49:0/2585846131 shutdown_connections 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 -- 172.21.15.49:0/2585846131 wait complete. 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.760+0000 7f3d343e0740 1 -- start start 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d343e0740 1 Processor -- start 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad92f9490 0x562ad96d9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96d9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d343e0740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad9322350 0x562ad97550b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d343e0740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281ade70 con 0x562ad9301670 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d343e0740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281af2e0 con 0x562ad92f9490 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d343e0740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3d281ae540 con 0x562ad9322350 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d343e0740 10 client.0 _ll_register_callbacks cb 0x7f3d20009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:15.767 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d26ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96d9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d26ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96d9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:57252/0 (socket says 172.21.15.49:57252) 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d26ffd640 1 -- 172.21.15.49:0/1871209756 learned_addr learned my addr 172.21.15.49:0/1871209756 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d277fe640 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad92f9490 0x562ad96d9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.761+0000 7f3d27fff640 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad9322350 0x562ad97550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d26ffd640 1 -- 172.21.15.49:0/1871209756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad9322350 msgr2=0x562ad97550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad9322350 0x562ad97550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d26ffd640 1 -- 172.21.15.49:0/1871209756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad92f9490 msgr2=0x562ad96d9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad92f9490 0x562ad96d9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d26ffd640 1 -- 172.21.15.49:0/1871209756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad96e1370 con 0x562ad9301670 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d26ffd640 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96d9660 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3d10014950 tx=0x7f3d1000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a31ee873f7eb69a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d06ffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d06ffd640 1 -- 172.21.15.49:0/1871209756 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10005460 con 0x562ad9301670 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d06ffd640 1 -- 172.21.15.49:0/1871209756 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f3d1000f730 con 0x562ad9301670 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d343e0740 1 -- 172.21.15.49:0/1871209756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d20036030 con 0x562ad9301670 2024-09-21T06:47:15.768 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d06ffd640 1 -- 172.21.15.49:0/1871209756 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3d10031050 con 0x562ad9301670 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d343e0740 10 client.18117 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d343e0740 1 -- 172.21.15.49:0/1871209756 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x562ad9756370 con 0x562ad9301670 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.762+0000 7f3d06ffd640 1 -- 172.21.15.49:0/1871209756 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d20036030 con 0x562ad9301670 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d06ffd640 1 -- 172.21.15.49:0/1871209756 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f3d1002a060 con 0x562ad9301670 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d343e0740 10 client.18117 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d343e0740 10 client.18117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d343e0740 20 client.18117 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ad92b6080 0x562ad97589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d343e0740 4 client.18117 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d343e0740 1 -- 172.21.15.49:0/1871209756 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562ad963d860 con 0x562ad92b6080 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d277fe640 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ad92b6080 0x562ad97589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d277fe640 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ad92b6080 0x562ad97589c0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ae5d94364a0c271 server_cookie=974510e0919c291a in_seq=0 out_seq=0 2024-09-21T06:47:15.769 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.763+0000 7f3d06ffd640 10 client.18117 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d06ffd640 1 -- 172.21.15.49:0/1871209756 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562ad963d860 con 0x562ad92b6080 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d06ffd640 10 client.18117 handle_command_reply: tid=0 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 client.18117 shutdown 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 -- 172.21.15.49:0/1871209756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 msgr2=0x562ad96d9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96d9660 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3d10014950 tx=0x7f3d1000cc40 comp rx=0 tx=0).stop 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 -- 172.21.15.49:0/1871209756 shutdown_connections 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x562ad92b6080 0x562ad97589c0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x562ad9322350 0x562ad97550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x562ad9301670 0x562ad96d9660 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 --2- 172.21.15.49:0/1871209756 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x562ad92f9490 0x562ad96d9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 -- 172.21.15.49:0/1871209756 >> 172.21.15.49:0/1871209756 conn(0x562ad9316740 msgr2=0x562ad96ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d06ffd640 0 client.18117 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:15.771 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.765+0000 7f3d343e0740 1 -- 172.21.15.49:0/1871209756 shutdown_connections 2024-09-21T06:47:15.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d343e0740 1 -- 172.21.15.49:0/1871209756 wait complete. 2024-09-21T06:47:15.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d343e0740 20 client.18117 trim_cache size 0 max 16384 2024-09-21T06:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "return_code": 0, 2024-09-21T06:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_tag": "063e59ef-7948-4f30-829f-32599b2043ac", 2024-09-21T06:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": "asynchronous" 2024-09-21T06:47:15.772 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 -- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3d140b6700 msgr2=0x7f3d140b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3d140b6700 0x7f3d140b8c10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x562ad96c80b0 tx=0x7f3d1800b5a0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 -- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 msgr2=0x7f3d2819fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 0x7f3d2819fc30 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009430 tx=0x7f3d200319f0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 -- 172.21.15.49:0/1616918440 shutdown_connections 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3d140b6700 0x7f3d140b8c10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3d28108cf0 0x7f3d2819fc30 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3d281083a0 0x7f3d2819a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 --2- 172.21.15.49:0/1616918440 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3d28102a60 0x7f3d2819a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 -- 172.21.15.49:0/1616918440 >> 172.21.15.49:0/1616918440 conn(0x7f3d28079730 msgr2=0x7f3d28101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:15.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 -- 172.21.15.49:0/1616918440 shutdown_connections 2024-09-21T06:47:15.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:15.766+0000 7f3d2de6c640 1 -- 172.21.15.49:0/1616918440 wait complete. 2024-09-21T06:47:15.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:15 smithi049 ceph-mon[31177]: pgmap v647: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-21T06:47:16.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:15 smithi098 ceph-mon[34704]: pgmap v647: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-21T06:47:16.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:15 smithi079 ceph-mon[34346]: pgmap v647: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-21T06:47:16.459 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:47:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.678+0000 7f76f4630640 1 -- 172.21.15.49:0/1460221792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1029c0 msgr2=0x7f76ec102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.678+0000 7f76f4630640 1 --2- 172.21.15.49:0/1460221792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1029c0 0x7f76ec102dd0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009900 tx=0x7f76e802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.678+0000 7f76f4630640 1 -- 172.21.15.49:0/1460221792 shutdown_connections 2024-09-21T06:47:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.678+0000 7f76f4630640 1 --2- 172.21.15.49:0/1460221792 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec108c40 0x7f76ec10f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.678+0000 7f76f4630640 1 --2- 172.21.15.49:0/1460221792 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec1082f0 0x7f76ec108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.681 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.678+0000 7f76f4630640 1 --2- 172.21.15.49:0/1460221792 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1029c0 0x7f76ec102dd0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.678+0000 7f76f4630640 1 -- 172.21.15.49:0/1460221792 >> 172.21.15.49:0/1460221792 conn(0x7f76ec0fe3c0 msgr2=0x7f76ec100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.678+0000 7f76f4630640 1 -- 172.21.15.49:0/1460221792 shutdown_connections 2024-09-21T06:47:16.682 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.678+0000 7f76f4630640 1 -- 172.21.15.49:0/1460221792 wait complete. 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.679+0000 7f76f4630640 1 Processor -- start 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.679+0000 7f76f4630640 1 -- start start 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.679+0000 7f76f4630640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1029c0 0x7f76ec19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.679+0000 7f76f4630640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1082f0 0x7f76ec19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.679+0000 7f76f4630640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec108c40 0x7f76ec19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.679+0000 7f76f4630640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec112950 con 0x7f76ec1082f0 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.679+0000 7f76f4630640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec1127d0 con 0x7f76ec108c40 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.679+0000 7f76f4630640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec112ad0 con 0x7f76ec1029c0 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.679+0000 7f76f1bcb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1082f0 0x7f76ec19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f1bcb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1082f0 0x7f76ec19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45890/0 (socket says 172.21.15.49:45890) 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f1bcb640 1 -- 172.21.15.49:0/711099566 learned_addr learned my addr 172.21.15.49:0/711099566 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:16.684 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f2bcd640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec108c40 0x7f76ec19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f23cc640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1029c0 0x7f76ec19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f1bcb640 1 -- 172.21.15.49:0/711099566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1029c0 msgr2=0x7f76ec19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1029c0 0x7f76ec19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f1bcb640 1 -- 172.21.15.49:0/711099566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec108c40 msgr2=0x7f76ec19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec108c40 0x7f76ec19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f1bcb640 1 -- 172.21.15.49:0/711099566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76ec1a03d0 con 0x7f76ec1082f0 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f23cc640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1029c0 0x7f76ec19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f2bcd640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec108c40 0x7f76ec19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1082f0 0x7f76ec19aa40 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00c970 tx=0x7f76dc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76e37fe640 1 -- 172.21.15.49:0/711099566 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc007bb0 con 0x7f76ec1082f0 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76e37fe640 1 -- 172.21.15.49:0/711099566 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76dc007d50 con 0x7f76ec1082f0 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f4630640 1 -- 172.21.15.49:0/711099566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76ec1a06c0 con 0x7f76ec1082f0 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76e37fe640 1 -- 172.21.15.49:0/711099566 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00f450 con 0x7f76ec1082f0 2024-09-21T06:47:16.685 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.680+0000 7f76f4630640 1 -- 172.21.15.49:0/711099566 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76ec1a6e50 con 0x7f76ec1082f0 2024-09-21T06:47:16.686 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.683+0000 7f76e37fe640 1 -- 172.21.15.49:0/711099566 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f76dc004eb0 con 0x7f76ec1082f0 2024-09-21T06:47:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.684+0000 7f76fb67f740 1 Processor -- start 2024-09-21T06:47:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.684+0000 7f76e37fe640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76d80b6700 0x7f76d80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76e37fe640 1 -- 172.21.15.49:0/711099566 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f76dc0e74f0 con 0x7f76ec1082f0 2024-09-21T06:47:16.687 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76f2bcd640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76d80b6700 0x7f76d80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.688 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76fb67f740 1 -- start start 2024-09-21T06:47:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae3614f2f0 0x55ae3651def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae361574d0 0x55ae3651e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76fb67f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ae364926f0 con 0x55ae361781b0 2024-09-21T06:47:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76fb67f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ae36481b20 con 0x55ae3614f2f0 2024-09-21T06:47:16.689 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76fb67f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ae36485930 con 0x55ae361574d0 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.685+0000 7f76f23cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f2bcd640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76d80b6700 0x7f76d80b8c10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f76e4005fd0 tx=0x7f76e4009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f23cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45900/0 (socket says 172.21.15.49:45900) 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f23cc640 1 -- 172.21.15.49:0/3773027546 learned_addr learned my addr 172.21.15.49:0/3773027546 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/3773027546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae3614f2f0 0x55ae3651def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f2bcd640 1 --2- 172.21.15.49:0/3773027546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae361574d0 0x55ae3651e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f23cc640 1 -- 172.21.15.49:0/3773027546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae361574d0 msgr2=0x55ae3651e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f23cc640 1 --2- 172.21.15.49:0/3773027546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae361574d0 0x55ae3651e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f23cc640 1 -- 172.21.15.49:0/3773027546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae3614f2f0 msgr2=0x55ae3651def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f23cc640 1 --2- 172.21.15.49:0/3773027546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae3614f2f0 0x55ae3651def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f23cc640 1 -- 172.21.15.49:0/3773027546 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae36447530 con 0x55ae361781b0 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76f23cc640 1 --2- 172.21.15.49:0/3773027546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651d9b0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009230 tx=0x7f76e80042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b6dc7697adaef0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:16.690 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76e0bfe640 1 -- 172.21.15.49:0/3773027546 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8035030 con 0x55ae361781b0 2024-09-21T06:47:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76e0bfe640 1 -- 172.21.15.49:0/3773027546 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76e80044d0 con 0x55ae361781b0 2024-09-21T06:47:16.691 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.686+0000 7f76e0bfe640 1 -- 172.21.15.49:0/3773027546 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e80037f0 con 0x55ae361781b0 2024-09-21T06:47:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 -- 172.21.15.49:0/3773027546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 msgr2=0x55ae3651d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:16.695 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 --2- 172.21.15.49:0/3773027546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651d9b0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009230 tx=0x7f76e80042e0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 -- 172.21.15.49:0/3773027546 shutdown_connections 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 --2- 172.21.15.49:0/3773027546 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae361574d0 0x55ae3651e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 --2- 172.21.15.49:0/3773027546 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae3614f2f0 0x55ae3651def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 --2- 172.21.15.49:0/3773027546 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651d9b0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 -- 172.21.15.49:0/3773027546 >> 172.21.15.49:0/3773027546 conn(0x55ae3616c300 msgr2=0x55ae3651b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 -- 172.21.15.49:0/3773027546 shutdown_connections 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 -- 172.21.15.49:0/3773027546 wait complete. 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 -- start start 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.688+0000 7f76fb67f740 1 Processor -- start 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae36529040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 0x55ae36529580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae365353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76fb67f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55ae363b9ab0 con 0x55ae361781b0 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76f2bcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae365353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.696 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76f2bcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae365353f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45914/0 (socket says 172.21.15.49:45914) 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76f23cc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae36529040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76f2bcd640 1 -- 172.21.15.49:0/980069439 learned_addr learned my addr 172.21.15.49:0/980069439 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55ae36427730 con 0x55ae361574d0 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55ae3652c0d0 con 0x55ae3614f2f0 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 0x55ae36529580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.689+0000 7f76fb67f740 10 client.0 _ll_register_callbacks cb 0x55ae3647b6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76f23cc640 1 -- 172.21.15.49:0/980069439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 msgr2=0x55ae36529580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76f23cc640 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 0x55ae36529580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76f23cc640 1 -- 172.21.15.49:0/980069439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 msgr2=0x55ae365353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76f23cc640 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae365353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76f23cc640 1 -- 172.21.15.49:0/980069439 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae361e3790 con 0x55ae3614f2f0 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76f2bcd640 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae365353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76e80044d0 con 0x55ae3614f2f0 2024-09-21T06:47:16.697 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76f23cc640 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae36529040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006010 tx=0x7f76e8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f59c0389d4f2db3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76d5ffb640 10 client.27331 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76d5ffb640 1 -- 172.21.15.49:0/980069439 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8051060 con 0x55ae3614f2f0 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76d5ffb640 1 -- 172.21.15.49:0/980069439 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f76e80053e0 con 0x55ae3614f2f0 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76d5ffb640 1 -- 172.21.15.49:0/980069439 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f76e8035050 con 0x55ae3614f2f0 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76fb67f740 10 client.27331 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.690+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({fsmap=27}) -- 0x55ae3625c620 con 0x55ae3614f2f0 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.691+0000 7f76d5ffb640 1 -- 172.21.15.49:0/980069439 <== mon.1 v2:172.21.15.98:3300/0 4 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f76e80314a0 con 0x55ae3614f2f0 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.691+0000 7f76fb67f740 10 client.27331 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.691+0000 7f76fb67f740 10 client.27331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.691+0000 7f76fb67f740 20 client.27331 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.691+0000 7f76fb67f740 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ae36136d80 0x55ae3653ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.691+0000 7f76fb67f740 4 client.27331 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.691+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae36494640 con 0x55ae36136d80 2024-09-21T06:47:16.698 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.691+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ae36136d80 0x55ae3653ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.692+0000 7f76d5ffb640 10 client.27331 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.692+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ae36136d80 0x55ae3653ae80 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35fcacde67808e7e server_cookie=262d5ef240b3f269 in_seq=0 out_seq=0 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.692+0000 7f76d5ffb640 1 -- 172.21.15.49:0/980069439 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae36494640 con 0x55ae36136d80 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.692+0000 7f76d5ffb640 10 client.27331 handle_command_reply: tid=0 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.692+0000 7f76fb67f740 1 client.27331 shutdown 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 msgr2=0x55ae36529040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae36529040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006010 tx=0x7f76e8009260 comp rx=0 tx=0).stop 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 shutdown_connections 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ae36136d80 0x55ae3653ae80 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae365353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 0x55ae36529580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 --2- 172.21.15.49:0/980069439 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae36529040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 >> 172.21.15.49:0/980069439 conn(0x55ae3616c300 msgr2=0x55ae3651e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:16.699 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76d5ffb640 0 client.27331 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 shutdown_connections 2024-09-21T06:47:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 1 -- 172.21.15.49:0/980069439 wait complete. 2024-09-21T06:47:16.700 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.693+0000 7f76fb67f740 20 client.27331 trim_cache size 0 max 16384 2024-09-21T06:47:16.713 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.710+0000 7f76fb67f740 1 Processor -- start 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.710+0000 7f76fb67f740 1 -- start start 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3651f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 0x55ae3652b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76fb67f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec1b20e0 con 0x55ae361781b0 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76fb67f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec1af9b0 con 0x55ae361574d0 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76fb67f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec1ad820 con 0x55ae3614f2f0 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f2bcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f2bcd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45920/0 (socket says 172.21.15.49:45920) 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f2bcd640 1 -- 172.21.15.49:0/2066490224 learned_addr learned my addr 172.21.15.49:0/2066490224 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f23cc640 1 --2- 172.21.15.49:0/2066490224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3651f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.714 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/2066490224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 0x55ae3652b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f23cc640 1 -- 172.21.15.49:0/2066490224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 msgr2=0x55ae3652b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f23cc640 1 --2- 172.21.15.49:0/2066490224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 0x55ae3652b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f23cc640 1 -- 172.21.15.49:0/2066490224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 msgr2=0x55ae3651a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:16.715 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f23cc640 1 --2- 172.21.15.49:0/2066490224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.711+0000 7f76f23cc640 1 -- 172.21.15.49:0/2066490224 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae36516f50 con 0x55ae3614f2f0 2024-09-21T06:47:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.712+0000 7f76f23cc640 1 --2- 172.21.15.49:0/2066490224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3651f3a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76e802a910 tx=0x7f76e8048000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3097d4953daca8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.712+0000 7f76d7fff640 1 -- 172.21.15.49:0/2066490224 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e80319a0 con 0x55ae3614f2f0 2024-09-21T06:47:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.712+0000 7f76d7fff640 1 -- 172.21.15.49:0/2066490224 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76e80044d0 con 0x55ae3614f2f0 2024-09-21T06:47:16.716 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.712+0000 7f76d7fff640 1 -- 172.21.15.49:0/2066490224 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e804dc20 con 0x55ae3614f2f0 2024-09-21T06:47:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.713+0000 7f76fb67f740 1 -- 172.21.15.49:0/2066490224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 msgr2=0x55ae3651f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.713+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2066490224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3651f3a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76e802a910 tx=0x7f76e8048000 comp rx=0 tx=0).stop 2024-09-21T06:47:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.713+0000 7f76fb67f740 1 -- 172.21.15.49:0/2066490224 shutdown_connections 2024-09-21T06:47:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.713+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2066490224 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361781b0 0x55ae3651a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.713+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2066490224 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361574d0 0x55ae3652b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.718 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.713+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2066490224 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3651f3a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.713+0000 7f76fb67f740 1 -- 172.21.15.49:0/2066490224 >> 172.21.15.49:0/2066490224 conn(0x55ae3616c300 msgr2=0x55ae36519ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.713+0000 7f76fb67f740 1 -- 172.21.15.49:0/2066490224 shutdown_connections 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.713+0000 7f76fb67f740 1 -- 172.21.15.49:0/2066490224 wait complete. 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76fb67f740 1 -- start start 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76fb67f740 1 Processor -- start 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3653d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361574d0 0x55ae3653d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76fb67f740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361781b0 0x55ae365a3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76fb67f740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec1ade70 con 0x55ae361574d0 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76fb67f740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec1af2e0 con 0x55ae361781b0 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76fb67f740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f76ec1ae540 con 0x55ae3614f2f0 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76fb67f740 10 client.0 _ll_register_callbacks cb 0x7f76dc00a4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76f1bcb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361574d0 0x55ae3653d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.719 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76f23cc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3653d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76f1bcb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361574d0 0x55ae3653d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45934/0 (socket says 172.21.15.49:45934) 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.714+0000 7f76f1bcb640 1 -- 172.21.15.49:0/2687769969 learned_addr learned my addr 172.21.15.49:0/2687769969 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.715+0000 7f76f2bcd640 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361781b0 0x55ae365a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.715+0000 7f76f23cc640 1 -- 172.21.15.49:0/2687769969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361781b0 msgr2=0x55ae365a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.715+0000 7f76f23cc640 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361781b0 0x55ae365a3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.715+0000 7f76f23cc640 1 -- 172.21.15.49:0/2687769969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361574d0 msgr2=0x55ae3653d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.715+0000 7f76f23cc640 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361574d0 0x55ae3653d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.715+0000 7f76f23cc640 1 -- 172.21.15.49:0/2687769969 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae3653df90 con 0x55ae3614f2f0 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.715+0000 7f76f2bcd640 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361781b0 0x55ae365a3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.715+0000 7f76f23cc640 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3653d1b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76e802a9e0 tx=0x7f76e80042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7bbae0e86557b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:16.720 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.715+0000 7f76d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.98:3300/0 2024-09-21T06:47:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.717+0000 7f76d5ffb640 1 -- 172.21.15.49:0/2687769969 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76e8063060 con 0x55ae3614f2f0 2024-09-21T06:47:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.717+0000 7f76d5ffb640 1 -- 172.21.15.49:0/2687769969 <== mon.1 v2:172.21.15.98:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f76e80055e0 con 0x55ae3614f2f0 2024-09-21T06:47:16.721 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.717+0000 7f76fb67f740 1 -- 172.21.15.49:0/2687769969 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76e80044d0 con 0x55ae3614f2f0 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.721+0000 7f76d5ffb640 1 -- 172.21.15.49:0/2687769969 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f76e8051040 con 0x55ae3614f2f0 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76fb67f740 10 client.27337 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76fb67f740 1 -- 172.21.15.49:0/2687769969 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55ae365a4ba0 con 0x55ae3614f2f0 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76d5ffb640 1 -- 172.21.15.49:0/2687769969 <== mon.1 v2:172.21.15.98:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76e80044d0 con 0x55ae3614f2f0 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76d5ffb640 1 -- 172.21.15.49:0/2687769969 <== mon.1 v2:172.21.15.98:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f76e803b430 con 0x55ae3614f2f0 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76fb67f740 10 client.27337 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76fb67f740 10 client.27337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76fb67f740 20 client.27337 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ae3610c1c0 0x55ae365a6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76fb67f740 4 client.27337 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76fb67f740 1 -- 172.21.15.49:0/2687769969 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae364900f0 con 0x55ae3610c1c0 2024-09-21T06:47:16.725 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.722+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ae3610c1c0 0x55ae365a6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.723+0000 7f76d5ffb640 10 client.27337 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:16.726 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.723+0000 7f76f1bcb640 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ae3610c1c0 0x55ae365a6f20 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56b11cc130eab3f5 server_cookie=34ce8f9b7732ceea in_seq=0 out_seq=0 2024-09-21T06:47:16.731 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76d5ffb640 1 -- 172.21.15.49:0/2687769969 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae364900f0 con 0x55ae3610c1c0 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76d5ffb640 10 client.27337 handle_command_reply: tid=0 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 client.27337 shutdown 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 -- 172.21.15.49:0/2687769969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 msgr2=0x55ae3653d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3653d1b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f76e802a9e0 tx=0x7f76e80042e0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 -- 172.21.15.49:0/2687769969 shutdown_connections 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55ae3610c1c0 0x55ae365a6f20 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55ae361781b0 0x55ae365a3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76d5ffb640 0 client.27337 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55ae361574d0 0x55ae3653d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.734 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 --2- 172.21.15.49:0/2687769969 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55ae3614f2f0 0x55ae3653d1b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 -- 172.21.15.49:0/2687769969 >> 172.21.15.49:0/2687769969 conn(0x55ae3616c300 msgr2=0x55ae3651a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 -- 172.21.15.49:0/2687769969 shutdown_connections 2024-09-21T06:47:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 1 -- 172.21.15.49:0/2687769969 wait complete. 2024-09-21T06:47:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.731+0000 7f76fb67f740 20 client.27337 trim_cache size 0 max 16384 2024-09-21T06:47:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:47:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:47:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:47:16.735 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:47:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 -- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76d80b6700 msgr2=0x7f76d80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76d80b6700 0x7f76d80b8c10 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f76e4005fd0 tx=0x7f76e4009500 comp rx=0 tx=0).stop 2024-09-21T06:47:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 -- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1082f0 msgr2=0x7f76ec19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:16.736 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1082f0 0x7f76ec19aa40 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00c970 tx=0x7f76dc00ce30 comp rx=0 tx=0).stop 2024-09-21T06:47:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 -- 172.21.15.49:0/711099566 shutdown_connections 2024-09-21T06:47:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f76d80b6700 0x7f76d80b8c10 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f76ec108c40 0x7f76ec19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f76ec1082f0 0x7f76ec19aa40 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 --2- 172.21.15.49:0/711099566 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f76ec1029c0 0x7f76ec19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 -- 172.21.15.49:0/711099566 >> 172.21.15.49:0/711099566 conn(0x7f76ec0fe3c0 msgr2=0x7f76ec06b170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 -- 172.21.15.49:0/711099566 shutdown_connections 2024-09-21T06:47:16.737 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:16.732+0000 7f76f4630640 1 -- 172.21.15.49:0/711099566 wait complete. 2024-09-21T06:47:16.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:16 smithi049 ceph-mon[31177]: scrub queued for path: / 2024-09-21T06:47:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:16 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:47:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:16 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:47:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:16 smithi049 ceph-mon[31177]: scrub summary: active paths [/] 2024-09-21T06:47:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:16 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:47:16.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:16 smithi049 ceph-mon[31177]: scrub summary: idle+waiting paths [/] 2024-09-21T06:47:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:16 smithi098 ceph-mon[34704]: scrub queued for path: / 2024-09-21T06:47:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:16 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:47:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:16 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:47:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:16 smithi098 ceph-mon[34704]: scrub summary: active paths [/] 2024-09-21T06:47:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:16 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:47:17.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:16 smithi098 ceph-mon[34704]: scrub summary: idle+waiting paths [/] 2024-09-21T06:47:17.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:16 smithi079 ceph-mon[34346]: scrub queued for path: / 2024-09-21T06:47:17.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:16 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:47:17.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:16 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:47:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:16 smithi079 ceph-mon[34346]: scrub summary: active paths [/] 2024-09-21T06:47:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:16 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:47:17.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:16 smithi079 ceph-mon[34346]: scrub summary: idle+waiting paths [/] 2024-09-21T06:47:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.259+0000 7f7ae7917640 1 -- 172.21.15.49:0/2716798659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae01083a0 msgr2=0x7f7ae01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.259+0000 7f7ae7917640 1 --2- 172.21.15.49:0/2716798659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae01083a0 0x7f7ae01087b0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009900 tx=0x7f7ad002a410 comp rx=0 tx=0).stop 2024-09-21T06:47:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.259+0000 7f7ae7917640 1 -- 172.21.15.49:0/2716798659 shutdown_connections 2024-09-21T06:47:17.262 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.259+0000 7f7ae7917640 1 --2- 172.21.15.49:0/2716798659 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ae0108cf0 0x7f7ae010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.259+0000 7f7ae7917640 1 --2- 172.21.15.49:0/2716798659 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae01083a0 0x7f7ae01087b0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.259+0000 7f7ae7917640 1 --2- 172.21.15.49:0/2716798659 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ae0102a60 0x7f7ae0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.259+0000 7f7ae7917640 1 -- 172.21.15.49:0/2716798659 >> 172.21.15.49:0/2716798659 conn(0x7f7ae0079730 msgr2=0x7f7ae0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.259+0000 7f7ae7917640 1 -- 172.21.15.49:0/2716798659 shutdown_connections 2024-09-21T06:47:17.263 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.259+0000 7f7ae7917640 1 -- 172.21.15.49:0/2716798659 wait complete. 2024-09-21T06:47:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.260+0000 7f7ae7917640 1 Processor -- start 2024-09-21T06:47:17.264 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.260+0000 7f7ae7917640 1 -- start start 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae7917640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0102a60 0x7f7ae019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae7917640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ae01083a0 0x7f7ae019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae7917640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ae0108cf0 0x7f7ae019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae7917640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0112960 con 0x7f7ae0102a60 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae7917640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01127e0 con 0x7f7ae0108cf0 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae7917640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0112ae0 con 0x7f7ae01083a0 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae56b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0102a60 0x7f7ae019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae56b3640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0102a60 0x7f7ae019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45958/0 (socket says 172.21.15.49:45958) 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae56b3640 1 -- 172.21.15.49:0/1634386812 learned_addr learned my addr 172.21.15.49:0/1634386812 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ae0108cf0 0x7f7ae019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ae01083a0 0x7f7ae019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae56b3640 1 -- 172.21.15.49:0/1634386812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ae01083a0 msgr2=0x7f7ae019ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae56b3640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ae01083a0 0x7f7ae019ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae56b3640 1 -- 172.21.15.49:0/1634386812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ae0108cf0 msgr2=0x7f7ae019fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:17.265 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae56b3640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ae0108cf0 0x7f7ae019fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae56b3640 1 -- 172.21.15.49:0/1634386812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae01a0540 con 0x7f7ae0102a60 2024-09-21T06:47:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.261+0000 7f7ae56b3640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0102a60 0x7f7ae019a5e0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00d950 tx=0x7f7adc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.262+0000 7f7ad67fc640 1 -- 172.21.15.49:0/1634386812 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc017070 con 0x7f7ae0102a60 2024-09-21T06:47:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.262+0000 7f7ad67fc640 1 -- 172.21.15.49:0/1634386812 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7adc009c30 con 0x7f7ae0102a60 2024-09-21T06:47:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.262+0000 7f7ad67fc640 1 -- 172.21.15.49:0/1634386812 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7adc00f620 con 0x7f7ae0102a60 2024-09-21T06:47:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.262+0000 7f7ae7917640 1 -- 172.21.15.49:0/1634386812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae01a0830 con 0x7f7ae0102a60 2024-09-21T06:47:17.266 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.262+0000 7f7ae7917640 1 -- 172.21.15.49:0/1634386812 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae01a6f90 con 0x7f7ae0102a60 2024-09-21T06:47:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7aede8b740 1 Processor -- start 2024-09-21T06:47:17.268 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7aede8b740 1 -- start start 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7ad67fc640 1 -- 172.21.15.49:0/1634386812 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f7adc010460 con 0x7f7ae0102a60 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f24270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f247b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 0x563ca4f24cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7aede8b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563ca4e9ae50 con 0x563ca4b7d070 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7aede8b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563ca4e8a280 con 0x563ca4b5c390 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7aede8b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563ca4e8e090 con 0x563ca4b541b0 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7ae5eb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f24270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7ae5eb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f24270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45972/0 (socket says 172.21.15.49:45972) 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/139262485 learned_addr learned my addr 172.21.15.49:0/139262485 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7ae56b3640 1 --2- 172.21.15.49:0/139262485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f247b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.265+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/139262485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 0x563ca4f24cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.269 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/139262485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 msgr2=0x563ca4f247b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/139262485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f247b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/139262485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 msgr2=0x563ca4f24cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/139262485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 0x563ca4f24cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/139262485 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca4be8650 con 0x563ca4b7d070 2024-09-21T06:47:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/139262485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f24270 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800ae40 tx=0x7f7ad800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2f7dbe0713fa21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7acb7fe640 1 -- 172.21.15.49:0/139262485 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8004d20 con 0x563ca4b7d070 2024-09-21T06:47:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7ad67fc640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7acc0b6680 0x7f7acc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.270 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7acb7fe640 1 -- 172.21.15.49:0/139262485 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad8010af0 con 0x563ca4b7d070 2024-09-21T06:47:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7acb7fe640 1 -- 172.21.15.49:0/139262485 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8005610 con 0x563ca4b7d070 2024-09-21T06:47:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7ae56b3640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7acc0b6680 0x7f7acc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.266+0000 7f7ad67fc640 1 -- 172.21.15.49:0/1634386812 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f7adc0e7330 con 0x7f7ae0102a60 2024-09-21T06:47:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7aede8b740 1 -- 172.21.15.49:0/139262485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 msgr2=0x563ca4f24270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7ae56b3640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7acc0b6680 0x7f7acc0b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0e4ae0 tx=0x7f7adc0eae80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:17.273 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7aede8b740 1 --2- 172.21.15.49:0/139262485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f24270 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800ae40 tx=0x7f7ad800f790 comp rx=0 tx=0).stop 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7aede8b740 1 -- 172.21.15.49:0/139262485 shutdown_connections 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7aede8b740 1 --2- 172.21.15.49:0/139262485 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 0x563ca4f24cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7aede8b740 1 --2- 172.21.15.49:0/139262485 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f247b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7aede8b740 1 --2- 172.21.15.49:0/139262485 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f24270 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7aede8b740 1 -- 172.21.15.49:0/139262485 >> 172.21.15.49:0/139262485 conn(0x563ca4b71460 msgr2=0x563ca4f22160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7aede8b740 1 -- 172.21.15.49:0/139262485 shutdown_connections 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.267+0000 7f7aede8b740 1 -- 172.21.15.49:0/139262485 wait complete. 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.268+0000 7f7aede8b740 1 -- start start 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.268+0000 7f7aede8b740 1 Processor -- start 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.268+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f33c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.268+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 0x563ca4f341d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.268+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f34730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.268+0000 7f7aede8b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x563ca4ceb700 con 0x563ca4b7d070 2024-09-21T06:47:17.274 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.268+0000 7f7aede8b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x563ca4e25110 con 0x563ca4b5c390 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.268+0000 7f7aede8b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x563ca4f36d80 con 0x563ca4b541b0 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.268+0000 7f7aede8b740 10 client.0 _ll_register_callbacks cb 0x563ca4e3e990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae5eb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f34730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae5eb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f34730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45988/0 (socket says 172.21.15.49:45988) 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/2726512833 learned_addr learned my addr 172.21.15.49:0/2726512833 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 0x563ca4f341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f33c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae4eb2640 1 -- 172.21.15.49:0/2726512833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 msgr2=0x563ca4f33c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f33c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae4eb2640 1 -- 172.21.15.49:0/2726512833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 msgr2=0x563ca4f34730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f34730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae4eb2640 1 -- 172.21.15.49:0/2726512833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca4e52c40 con 0x563ca4b5c390 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 0x563ca4f341d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006010 tx=0x7f7ad00316d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7511f9f20a4dde6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:17.275 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.269+0000 7f7ac8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.79:3300/0 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/2726512833 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0035040 con 0x563ca4b5c390 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/2726512833 <== mon.2 v2:172.21.15.79:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f7ad0004040 con 0x563ca4b5c390 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7aede8b740 1 -- 172.21.15.49:0/2726512833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad8010af0 con 0x563ca4b5c390 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/2726512833 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7ad0004240 con 0x563ca4b5c390 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7aede8b740 10 client.27356 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7aede8b740 1 -- 172.21.15.49:0/2726512833 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563ca4f42a40 con 0x563ca4b5c390 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/2726512833 <== mon.2 v2:172.21.15.79:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad8010af0 con 0x563ca4b5c390 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/2726512833 <== mon.2 v2:172.21.15.79:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7ad0004870 con 0x563ca4b5c390 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7aede8b740 10 client.27356 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7aede8b740 10 client.27356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7aede8b740 20 client.27356 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563ca4b3b9f0 0x563ca4f45fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7aede8b740 4 client.27356 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.270+0000 7f7aede8b740 1 -- 172.21.15.49:0/2726512833 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ca4e9cda0 con 0x563ca4b3b9f0 2024-09-21T06:47:17.276 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.271+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563ca4b3b9f0 0x563ca4f45fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.277 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.271+0000 7f7ac8ff9640 10 client.27356 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.271+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563ca4b3b9f0 0x563ca4f45fa0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbbf02a7839548b0 server_cookie=8c5b13fa2d8f0fc7 in_seq=0 out_seq=0 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/2726512833 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563ca4e9cda0 con 0x563ca4b3b9f0 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7ac8ff9640 10 client.27356 handle_command_reply: tid=0 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 client.27356 shutdown 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 -- 172.21.15.49:0/2726512833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 msgr2=0x563ca4f341d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 0x563ca4f341d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006010 tx=0x7f7ad00316d0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 -- 172.21.15.49:0/2726512833 shutdown_connections 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563ca4b3b9f0 0x563ca4f45fa0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b7d070 0x563ca4f34730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b5c390 0x563ca4f341d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7ac8ff9640 0 client.27356 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:17.278 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2726512833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f33c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 -- 172.21.15.49:0/2726512833 >> 172.21.15.49:0/2726512833 conn(0x563ca4b71460 msgr2=0x563ca4f27400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:17.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 -- 172.21.15.49:0/2726512833 shutdown_connections 2024-09-21T06:47:17.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.272+0000 7f7aede8b740 1 -- 172.21.15.49:0/2726512833 wait complete. 2024-09-21T06:47:17.279 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.273+0000 7f7aede8b740 20 client.27356 trim_cache size 0 max 16384 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.290+0000 7f7aede8b740 1 Processor -- start 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.290+0000 7f7aede8b740 1 -- start start 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.290+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b3b9f0 0x563ca4f2f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.290+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f331a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.290+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b5c390 0x563ca4f358c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.290+0000 7f7aede8b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01affe0 con 0x563ca4b5c390 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.290+0000 7f7aede8b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01ad8b0 con 0x563ca4b3b9f0 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.290+0000 7f7aede8b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01ab720 con 0x563ca4b541b0 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b5c390 0x563ca4f358c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b5c390 0x563ca4f358c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46000/0 (socket says 172.21.15.49:46000) 2024-09-21T06:47:17.294 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/2031084622 learned_addr learned my addr 172.21.15.49:0/2031084622 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/2031084622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b3b9f0 0x563ca4f2f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/2031084622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/2031084622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 msgr2=0x563ca4f331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/2031084622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f331a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/2031084622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b3b9f0 msgr2=0x563ca4f2f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/2031084622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b3b9f0 0x563ca4f2f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/2031084622 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ca4f3ffb0 con 0x563ca4b5c390 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/2031084622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b5c390 0x563ca4f358c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005a90 tx=0x7f7ad8011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a0f76a2d241bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7acaffd640 1 -- 172.21.15.49:0/2031084622 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80054e0 con 0x563ca4b5c390 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7acaffd640 1 -- 172.21.15.49:0/2031084622 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad8005680 con 0x563ca4b5c390 2024-09-21T06:47:17.295 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.291+0000 7f7acaffd640 1 -- 172.21.15.49:0/2031084622 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8004c60 con 0x563ca4b5c390 2024-09-21T06:47:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.292+0000 7f7aede8b740 1 -- 172.21.15.49:0/2031084622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b5c390 msgr2=0x563ca4f358c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.292+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2031084622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b5c390 0x563ca4f358c0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005a90 tx=0x7f7ad8011f90 comp rx=0 tx=0).stop 2024-09-21T06:47:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.292+0000 7f7aede8b740 1 -- 172.21.15.49:0/2031084622 shutdown_connections 2024-09-21T06:47:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.292+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2031084622 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b5c390 0x563ca4f358c0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.298 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.292+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2031084622 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b541b0 0x563ca4f331a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.292+0000 7f7aede8b740 1 --2- 172.21.15.49:0/2031084622 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b3b9f0 0x563ca4f2f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.292+0000 7f7aede8b740 1 -- 172.21.15.49:0/2031084622 >> 172.21.15.49:0/2031084622 conn(0x563ca4b71460 msgr2=0x563ca4f351b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.292+0000 7f7aede8b740 1 -- 172.21.15.49:0/2031084622 shutdown_connections 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.292+0000 7f7aede8b740 1 -- 172.21.15.49:0/2031084622 wait complete. 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7aede8b740 1 -- start start 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7aede8b740 1 Processor -- start 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b3b9f0 0x563ca4f3c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b541b0 0x563ca4f37b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7aede8b740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b5c390 0x563ca4f38050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7aede8b740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01abd70 con 0x563ca4b3b9f0 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7aede8b740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01ad1e0 con 0x563ca4b541b0 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7aede8b740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae01ac440 con 0x563ca4b5c390 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7aede8b740 10 client.0 _ll_register_callbacks cb 0x7f7ad0005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:17.299 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7ae5eb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b3b9f0 0x563ca4f3c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7ae5eb4640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b3b9f0 0x563ca4f3c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:46010/0 (socket says 172.21.15.49:46010) 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.293+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/4176579328 learned_addr learned my addr 172.21.15.49:0/4176579328 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b5c390 0x563ca4f38050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b541b0 0x563ca4f37b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/4176579328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b5c390 msgr2=0x563ca4f38050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b5c390 0x563ca4f38050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/4176579328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b541b0 msgr2=0x563ca4f37b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b541b0 0x563ca4f37b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ae5eb4640 1 -- 172.21.15.49:0/4176579328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ca4f38640 con 0x563ca4b3b9f0 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b541b0 0x563ca4f37b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ae5eb4640 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b3b9f0 0x563ca4f3c660 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005ba0 tx=0x7f7ad800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac0b5a318aaff1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ac8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/4176579328 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80106c0 con 0x563ca4b3b9f0 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/4176579328 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f7ad8010860 con 0x563ca4b3b9f0 2024-09-21T06:47:17.300 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7aede8b740 1 -- 172.21.15.49:0/4176579328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad8005680 con 0x563ca4b3b9f0 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/4176579328 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7ad8048050 con 0x563ca4b3b9f0 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7aede8b740 10 client.18153 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.294+0000 7f7aede8b740 1 -- 172.21.15.49:0/4176579328 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x563ca4fb0710 con 0x563ca4b3b9f0 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.295+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/4176579328 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ad8005680 con 0x563ca4b3b9f0 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.295+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/4176579328 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f7ad80274e0 con 0x563ca4b3b9f0 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.295+0000 7f7aede8b740 10 client.18153 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.295+0000 7f7aede8b740 10 client.18153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.295+0000 7f7aede8b740 20 client.18153 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.295+0000 7f7aede8b740 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563ca4b7d070 0x563ca4fb2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.295+0000 7f7aede8b740 4 client.18153 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.295+0000 7f7aede8b740 1 -- 172.21.15.49:0/4176579328 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ca4e98850 con 0x563ca4b7d070 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.295+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563ca4b7d070 0x563ca4fb2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7ac8ff9640 10 client.18153 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:17.301 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7ae4eb2640 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563ca4b7d070 0x563ca4fb2ca0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69dcdcdf1edfaa4b server_cookie=aee67a99ff5eff1c in_seq=0 out_seq=0 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7ac8ff9640 1 -- 172.21.15.49:0/4176579328 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5114 (crc 0 0 0) 0x563ca4e98850 con 0x563ca4b7d070 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7ac8ff9640 10 client.18153 handle_command_reply: tid=0 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7aede8b740 1 client.18153 shutdown 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7aede8b740 1 -- 172.21.15.49:0/4176579328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b3b9f0 msgr2=0x563ca4f3c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7aede8b740 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b3b9f0 0x563ca4f3c660 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8005ba0 tx=0x7f7ad800a5c0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7aede8b740 1 -- 172.21.15.49:0/4176579328 shutdown_connections 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7aede8b740 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x563ca4b7d070 0x563ca4fb2ca0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7aede8b740 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x563ca4b5c390 0x563ca4f38050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7aede8b740 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x563ca4b541b0 0x563ca4f37b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7aede8b740 1 --2- 172.21.15.49:0/4176579328 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x563ca4b3b9f0 0x563ca4f3c660 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7aede8b740 1 -- 172.21.15.49:0/4176579328 >> 172.21.15.49:0/4176579328 conn(0x563ca4b71460 msgr2=0x563ca4f252a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.296+0000 7f7ac8ff9640 0 client.18153 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:17.303 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7aede8b740 1 -- 172.21.15.49:0/4176579328 shutdown_connections 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7aede8b740 1 -- 172.21.15.49:0/4176579328 wait complete. 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7aede8b740 20 client.18153 trim_cache size 0 max 16384 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": { 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stdout: "063e59ef-7948-4f30-829f-32599b2043ac": { 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stdout: "tag": "063e59ef-7948-4f30-829f-32599b2043ac", 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stdout: "options": "recursive,force" 2024-09-21T06:47:17.304 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "063e59ef-7948-4f30-829f-32599b2043ac": { 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:47:15.764561+0000", 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "f56024cf-a906-4d93-89e9-d1f90cea5480": { 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:52.601552+0000", 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.305 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:47:17.306 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:47:17.307 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.308 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.310 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "33526aec-feb7-4620-9880-2a7dd5991954": { 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:46:34.268554+0000", 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "877238a7-c1a9-416c-8f9e-d40ecea3c71a": { 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:10.755554+0000", 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.311 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.312 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:17.313 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:17.314 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:17.314 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:17.314 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:47:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 -- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7acc0b6680 msgr2=0x7f7acc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7acc0b6680 0x7f7acc0b8b90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0e4ae0 tx=0x7f7adc0eae80 comp rx=0 tx=0).stop 2024-09-21T06:47:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 -- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0102a60 msgr2=0x7f7ae019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:17.314 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0102a60 0x7f7ae019a5e0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7adc00d950 tx=0x7f7adc00de10 comp rx=0 tx=0).stop 2024-09-21T06:47:17.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 -- 172.21.15.49:0/1634386812 shutdown_connections 2024-09-21T06:47:17.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f7acc0b6680 0x7f7acc0b8b90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f7ae0108cf0 0x7f7ae019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f7ae01083a0 0x7f7ae019ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 --2- 172.21.15.49:0/1634386812 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f7ae0102a60 0x7f7ae019a5e0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:17.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 -- 172.21.15.49:0/1634386812 >> 172.21.15.49:0/1634386812 conn(0x7f7ae0079730 msgr2=0x7f7ae0106730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:17.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 -- 172.21.15.49:0/1634386812 shutdown_connections 2024-09-21T06:47:17.315 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:17.297+0000 7f7ae7917640 1 -- 172.21.15.49:0/1634386812 wait complete. 2024-09-21T06:47:17.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:17 smithi049 ceph-mon[31177]: pgmap v648: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-09-21T06:47:18.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:17 smithi098 ceph-mon[34704]: pgmap v648: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-09-21T06:47:18.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:17 smithi079 ceph-mon[34346]: pgmap v648: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 14 op/s 2024-09-21T06:47:18.136 INFO:tasks.cephfs.filesystem:scrub status for tag:063e59ef-7948-4f30-829f-32599b2043ac - {'path': '/', 'tag': '063e59ef-7948-4f30-829f-32599b2043ac', 'options': 'recursive,force'} 2024-09-21T06:47:20.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:19 smithi098 ceph-mon[34704]: pgmap v649: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-21T06:47:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:19 smithi079 ceph-mon[34346]: pgmap v649: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-21T06:47:20.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:19 smithi049 ceph-mon[31177]: pgmap v649: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-09-21T06:47:22.025 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:21 smithi049 ceph-mon[31177]: pgmap v650: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 12 op/s 2024-09-21T06:47:22.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:21 smithi098 ceph-mon[34704]: pgmap v650: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 12 op/s 2024-09-21T06:47:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:21 smithi079 ceph-mon[34346]: pgmap v650: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 KiB/s wr, 12 op/s 2024-09-21T06:47:24.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:23 smithi098 ceph-mon[34704]: pgmap v651: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:47:24.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:23 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:47:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:23 smithi079 ceph-mon[34346]: pgmap v651: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:47:24.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:23 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:47:24.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:23 smithi049 ceph-mon[31177]: pgmap v651: 97 pgs: 97 active+clean; 12 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:47:24.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:23 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:47:25.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:24 smithi098 ceph-mon[34704]: scrub summary: idle 2024-09-21T06:47:25.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:24 smithi079 ceph-mon[34346]: scrub summary: idle 2024-09-21T06:47:25.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:24 smithi049 ceph-mon[31177]: scrub summary: idle 2024-09-21T06:47:26.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:25 smithi098 ceph-mon[34704]: pgmap v652: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-21T06:47:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:25 smithi079 ceph-mon[34346]: pgmap v652: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-21T06:47:26.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:25 smithi049 ceph-mon[31177]: pgmap v652: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-21T06:47:28.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:27 smithi098 ceph-mon[34704]: pgmap v653: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:47:28.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:27 smithi079 ceph-mon[34346]: pgmap v653: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:47:28.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:27 smithi049 ceph-mon[31177]: pgmap v653: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 14 op/s 2024-09-21T06:47:29.851 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.849+0000 7f9db210b640 1 -- 172.21.15.49:0/2952038995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 msgr2=0x7f9dac108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.849+0000 7f9db210b640 1 --2- 172.21.15.49:0/2952038995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 0x7f9dac108710 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f9da0009900 tx=0x7f9da002a410 comp rx=0 tx=0).stop 2024-09-21T06:47:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.849+0000 7f9db210b640 1 -- 172.21.15.49:0/2952038995 shutdown_connections 2024-09-21T06:47:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.849+0000 7f9db210b640 1 --2- 172.21.15.49:0/2952038995 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dac108c50 0x7f9dac10f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.849+0000 7f9db210b640 1 --2- 172.21.15.49:0/2952038995 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 0x7f9dac108710 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.849+0000 7f9db210b640 1 --2- 172.21.15.49:0/2952038995 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dac1029d0 0x7f9dac102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.849+0000 7f9db210b640 1 -- 172.21.15.49:0/2952038995 >> 172.21.15.49:0/2952038995 conn(0x7f9dac07a710 msgr2=0x7f9dac07ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.849+0000 7f9db210b640 1 -- 172.21.15.49:0/2952038995 shutdown_connections 2024-09-21T06:47:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.849+0000 7f9db210b640 1 -- 172.21.15.49:0/2952038995 wait complete. 2024-09-21T06:47:29.852 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.850+0000 7f9db210b640 1 Processor -- start 2024-09-21T06:47:29.853 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.850+0000 7f9db210b640 1 -- start start 2024-09-21T06:47:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9db210b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dac1029d0 0x7f9dac19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9db210b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 0x7f9dac19aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.854 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9db210b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dac108c50 0x7f9dac19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9db210b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac112910 con 0x7f9dac108300 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9db210b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac112790 con 0x7f9dac1029d0 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9db210b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac112a90 con 0x7f9dac108c50 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9daaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 0x7f9dac19aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9daaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 0x7f9dac19aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45014/0 (socket says 172.21.15.49:45014) 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9daaffd640 1 -- 172.21.15.49:0/3088224162 learned_addr learned my addr 172.21.15.49:0/3088224162 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dac1029d0 0x7f9dac19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9dabfff640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dac108c50 0x7f9dac19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9daaffd640 1 -- 172.21.15.49:0/3088224162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dac108c50 msgr2=0x7f9dac19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9daaffd640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dac108c50 0x7f9dac19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9daaffd640 1 -- 172.21.15.49:0/3088224162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dac1029d0 msgr2=0x7f9dac19a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9daaffd640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dac1029d0 0x7f9dac19a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9daaffd640 1 -- 172.21.15.49:0/3088224162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dac1a0430 con 0x7f9dac108300 2024-09-21T06:47:29.855 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.851+0000 7f9daaffd640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 0x7f9dac19aaa0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f9da0032fd0 tx=0x7f9da0031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.852+0000 7f9da8ff9640 1 -- 172.21.15.49:0/3088224162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da003f030 con 0x7f9dac108300 2024-09-21T06:47:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.852+0000 7f9db210b640 1 -- 172.21.15.49:0/3088224162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dac1a06c0 con 0x7f9dac108300 2024-09-21T06:47:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.852+0000 7f9da8ff9640 1 -- 172.21.15.49:0/3088224162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da0004490 con 0x7f9dac108300 2024-09-21T06:47:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.852+0000 7f9da8ff9640 1 -- 172.21.15.49:0/3088224162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0035070 con 0x7f9dac108300 2024-09-21T06:47:29.856 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.852+0000 7f9db210b640 1 -- 172.21.15.49:0/3088224162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dac1a6eb0 con 0x7f9dac108300 2024-09-21T06:47:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.854+0000 7f9db9075740 1 Processor -- start 2024-09-21T06:47:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.854+0000 7f9da8ff9640 1 -- 172.21.15.49:0/3088224162 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f9da0042030 con 0x7f9dac108300 2024-09-21T06:47:29.859 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.854+0000 7f9db9075740 1 -- start start 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9db9075740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 0x55837b1bb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9db9075740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9db9075740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837adf54d0 0x55837b1bc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9db9075740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55837b1306f0 con 0x55837aded2f0 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9db9075740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55837b11fb20 con 0x55837ae161b0 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9db9075740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55837b123930 con 0x55837adf54d0 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dab7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dab7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1bbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45020/0 (socket says 172.21.15.49:45020) 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dab7fe640 1 -- 172.21.15.49:0/2073015624 learned_addr learned my addr 172.21.15.49:0/2073015624 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dabfff640 1 --2- 172.21.15.49:0/2073015624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 0x55837b1bb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9daaffd640 1 --2- 172.21.15.49:0/2073015624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837adf54d0 0x55837b1bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dab7fe640 1 -- 172.21.15.49:0/2073015624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837adf54d0 msgr2=0x55837b1bc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/2073015624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837adf54d0 0x55837b1bc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.860 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dab7fe640 1 -- 172.21.15.49:0/2073015624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 msgr2=0x55837b1bb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/2073015624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 0x55837b1bb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dab7fe640 1 -- 172.21.15.49:0/2073015624 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837b0e5530 con 0x55837aded2f0 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9da8ff9640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d940b6680 0x7f9d940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.855+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/2073015624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1bbef0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009cf0 tx=0x7f9d9c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de184b80a1f419 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.856+0000 7f9dabfff640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d940b6680 0x7f9d940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.856+0000 7f9da8ff9640 1 -- 172.21.15.49:0/3088224162 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f9da0107b30 con 0x7f9dac108300 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.856+0000 7f9d91ffb640 1 -- 172.21.15.49:0/2073015624 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c004230 con 0x55837aded2f0 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.856+0000 7f9d91ffb640 1 -- 172.21.15.49:0/2073015624 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d9c0043d0 con 0x55837aded2f0 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.856+0000 7f9d91ffb640 1 -- 172.21.15.49:0/2073015624 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c019880 con 0x55837aded2f0 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 -- 172.21.15.49:0/2073015624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 msgr2=0x55837b1bbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9dabfff640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d940b6680 0x7f9d940b8b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9da4005fd0 tx=0x7f9da4009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 --2- 172.21.15.49:0/2073015624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1bbef0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009cf0 tx=0x7f9d9c011810 comp rx=0 tx=0).stop 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 -- 172.21.15.49:0/2073015624 shutdown_connections 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 --2- 172.21.15.49:0/2073015624 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837adf54d0 0x55837b1bc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.861 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 --2- 172.21.15.49:0/2073015624 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1bbef0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 --2- 172.21.15.49:0/2073015624 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 0x55837b1bb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 -- 172.21.15.49:0/2073015624 >> 172.21.15.49:0/2073015624 conn(0x55837ae0a300 msgr2=0x55837b1b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 -- 172.21.15.49:0/2073015624 shutdown_connections 2024-09-21T06:47:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 -- 172.21.15.49:0/2073015624 wait complete. 2024-09-21T06:47:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 -- start start 2024-09-21T06:47:29.862 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.857+0000 7f9db9075740 1 Processor -- start 2024-09-21T06:47:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9db9075740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 0x55837b1c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9db9075740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9db9075740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837ae161b0 0x55837b1c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9db9075740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55837b057ab0 con 0x55837ae161b0 2024-09-21T06:47:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9db9075740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55837b0c5730 con 0x55837adf54d0 2024-09-21T06:47:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9db9075740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55837b1ca130 con 0x55837aded2f0 2024-09-21T06:47:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9db9075740 10 client.0 _ll_register_callbacks cb 0x55837b1196b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:29.866 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9dabfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837ae161b0 0x55837b1c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9dabfff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837ae161b0 0x55837b1c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45026/0 (socket says 172.21.15.49:45026) 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9dabfff640 1 -- 172.21.15.49:0/1681633784 learned_addr learned my addr 172.21.15.49:0/1681633784 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9daaffd640 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 0x55837b1c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9dabfff640 1 -- 172.21.15.49:0/1681633784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 msgr2=0x55837b1c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9dabfff640 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 0x55837b1c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9dabfff640 1 -- 172.21.15.49:0/1681633784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 msgr2=0x55837b1c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9dabfff640 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9dabfff640 1 -- 172.21.15.49:0/1681633784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837ae81790 con 0x55837ae161b0 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.858+0000 7f9daaffd640 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9dabfff640 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837ae161b0 0x55837b1c79c0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009ee0 tx=0x7f9da4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ea0399297df7a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9d8affd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9d8affd640 1 -- 172.21.15.49:0/1681633784 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da4011990 con 0x55837ae161b0 2024-09-21T06:47:29.867 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9d8affd640 1 -- 172.21.15.49:0/1681633784 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f9da4017030 con 0x55837ae161b0 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9db9075740 1 -- 172.21.15.49:0/1681633784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d9c0043d0 con 0x55837ae161b0 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9d8affd640 1 -- 172.21.15.49:0/1681633784 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9da4011b30 con 0x55837ae161b0 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9db9075740 10 client.18165 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9db9075740 1 -- 172.21.15.49:0/1681633784 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55837aefa620 con 0x55837ae161b0 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9d8affd640 1 -- 172.21.15.49:0/1681633784 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d9c0043d0 con 0x55837ae161b0 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.859+0000 7f9d8affd640 1 -- 172.21.15.49:0/1681633784 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9da4028420 con 0x55837ae161b0 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.860+0000 7f9db9075740 10 client.18165 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.860+0000 7f9db9075740 10 client.18165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.860+0000 7f9db9075740 20 client.18165 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.860+0000 7f9db9075740 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55837add4d80 0x55837b1d92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.860+0000 7f9db9075740 4 client.18165 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.860+0000 7f9db9075740 1 -- 172.21.15.49:0/1681633784 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55837b132640 con 0x55837add4d80 2024-09-21T06:47:29.868 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.860+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55837add4d80 0x55837b1d92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.860+0000 7f9d8affd640 10 client.18165 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.860+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55837add4d80 0x55837b1d92d0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba24cff1a50fbe15 server_cookie=46d9ed947f92f9b3 in_seq=0 out_seq=0 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9d8affd640 1 -- 172.21.15.49:0/1681633784 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55837b132640 con 0x55837add4d80 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9d8affd640 10 client.18165 handle_command_reply: tid=0 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 client.18165 shutdown 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 -- 172.21.15.49:0/1681633784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837ae161b0 msgr2=0x55837b1c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837ae161b0 0x55837b1c79c0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f9da4009ee0 tx=0x7f9da4004ab0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 -- 172.21.15.49:0/1681633784 shutdown_connections 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55837add4d80 0x55837b1d92d0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837ae161b0 0x55837b1c79c0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.869 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 --2- 172.21.15.49:0/1681633784 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 0x55837b1c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 -- 172.21.15.49:0/1681633784 >> 172.21.15.49:0/1681633784 conn(0x55837ae0a300 msgr2=0x55837b1bc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9d8affd640 0 client.18165 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.861+0000 7f9db9075740 1 -- 172.21.15.49:0/1681633784 shutdown_connections 2024-09-21T06:47:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.862+0000 7f9db9075740 1 -- 172.21.15.49:0/1681633784 wait complete. 2024-09-21T06:47:29.870 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.862+0000 7f9db9075740 20 client.18165 trim_cache size 0 max 16384 2024-09-21T06:47:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.876+0000 7f9db9075740 1 Processor -- start 2024-09-21T06:47:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.876+0000 7f9db9075740 1 -- start start 2024-09-21T06:47:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9db9075740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 0x55837b1b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9db9075740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837adf54d0 0x55837b1c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9db9075740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 0x55837b1c4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9db9075740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1b2120 con 0x55837adf54d0 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9db9075740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1af9f0 con 0x55837ae161b0 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9db9075740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1ad860 con 0x55837aded2f0 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9daaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837adf54d0 0x55837b1c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9daaffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837adf54d0 0x55837b1c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45038/0 (socket says 172.21.15.49:45038) 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9daaffd640 1 -- 172.21.15.49:0/3393481339 learned_addr learned my addr 172.21.15.49:0/3393481339 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9dabfff640 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 0x55837b1c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 0x55837b1b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9daaffd640 1 -- 172.21.15.49:0/3393481339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 msgr2=0x55837b1b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9daaffd640 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 0x55837b1b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9daaffd640 1 -- 172.21.15.49:0/3393481339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 msgr2=0x55837b1c4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9daaffd640 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 0x55837b1c4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9daaffd640 1 -- 172.21.15.49:0/3393481339 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837b1bdcb0 con 0x55837adf54d0 2024-09-21T06:47:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9dabfff640 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 0x55837b1c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9daaffd640 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837adf54d0 0x55837b1c8b70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f9da0031440 tx=0x7f9da003b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b0b415873cbe3e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.877+0000 7f9d917fa640 1 -- 172.21.15.49:0/3393481339 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0049040 con 0x55837adf54d0 2024-09-21T06:47:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9d917fa640 1 -- 172.21.15.49:0/3393481339 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da00cd440 con 0x55837adf54d0 2024-09-21T06:47:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9d917fa640 1 -- 172.21.15.49:0/3393481339 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da00d7350 con 0x55837adf54d0 2024-09-21T06:47:29.884 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9db9075740 1 -- 172.21.15.49:0/3393481339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837adf54d0 msgr2=0x55837b1c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9db9075740 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837adf54d0 0x55837b1c8b70 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f9da0031440 tx=0x7f9da003b560 comp rx=0 tx=0).stop 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9db9075740 1 -- 172.21.15.49:0/3393481339 shutdown_connections 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9db9075740 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837ae161b0 0x55837b1c4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9db9075740 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837adf54d0 0x55837b1c8b70 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9db9075740 1 --2- 172.21.15.49:0/3393481339 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837aded2f0 0x55837b1b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9db9075740 1 -- 172.21.15.49:0/3393481339 >> 172.21.15.49:0/3393481339 conn(0x55837ae0a300 msgr2=0x55837b1c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9db9075740 1 -- 172.21.15.49:0/3393481339 shutdown_connections 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.878+0000 7f9db9075740 1 -- 172.21.15.49:0/3393481339 wait complete. 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9db9075740 1 -- start start 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9db9075740 1 Processor -- start 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9db9075740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9db9075740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9db9075740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837ae161b0 0x55837b1cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.885 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9db9075740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1adeb0 con 0x55837aded2f0 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9db9075740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1af320 con 0x55837adf54d0 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9db9075740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1ae580 con 0x55837ae161b0 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9db9075740 10 client.0 _ll_register_callbacks cb 0x7f9da4009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9dab7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9dab7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:45040/0 (socket says 172.21.15.49:45040) 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.879+0000 7f9dab7fe640 1 -- 172.21.15.49:0/2542294102 learned_addr learned my addr 172.21.15.49:0/2542294102 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9daaffd640 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9dabfff640 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837ae161b0 0x55837b1cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9dab7fe640 1 -- 172.21.15.49:0/2542294102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837ae161b0 msgr2=0x55837b1cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837ae161b0 0x55837b1cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9dab7fe640 1 -- 172.21.15.49:0/2542294102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 msgr2=0x55837b1ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1ccea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.886 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9dab7fe640 1 -- 172.21.15.49:0/2542294102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837b1cd950 con 0x55837aded2f0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9daaffd640 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9dab7fe640 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1cf9e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009c40 tx=0x7f9d9c009980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65ff98bd4738ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9d8affd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9d8affd640 1 -- 172.21.15.49:0/2542294102 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c005450 con 0x55837aded2f0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9d8affd640 1 -- 172.21.15.49:0/2542294102 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f9d9c0055f0 con 0x55837aded2f0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9db9075740 1 -- 172.21.15.49:0/2542294102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9da00cd440 con 0x55837aded2f0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9d8affd640 1 -- 172.21.15.49:0/2542294102 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f9d9c039050 con 0x55837aded2f0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9db9075740 10 client.18171 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9db9075740 1 -- 172.21.15.49:0/2542294102 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55837b243a10 con 0x55837aded2f0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.880+0000 7f9d8affd640 1 -- 172.21.15.49:0/2542294102 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9da00cd440 con 0x55837aded2f0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9d8affd640 1 -- 172.21.15.49:0/2542294102 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f9d9c019860 con 0x55837aded2f0 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9db9075740 10 client.18171 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9db9075740 10 client.18171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9db9075740 20 client.18171 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9db9075740 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55837adaa1c0 0x55837b246000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9db9075740 4 client.18171 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:47:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9db9075740 1 -- 172.21.15.49:0/2542294102 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55837b12e0f0 con 0x55837adaa1c0 2024-09-21T06:47:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9daaffd640 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55837adaa1c0 0x55837b246000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9daaffd640 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55837adaa1c0 0x55837b246000 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc05cbfd111321f5 server_cookie=b67a1ffcbdae7e80 in_seq=0 out_seq=0 2024-09-21T06:47:29.888 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.881+0000 7f9d8affd640 10 client.18171 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9d8affd640 1 -- 172.21.15.49:0/2542294102 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55837b12e0f0 con 0x55837adaa1c0 2024-09-21T06:47:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9d8affd640 10 client.18171 handle_command_reply: tid=0 2024-09-21T06:47:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 client.18171 shutdown 2024-09-21T06:47:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 -- 172.21.15.49:0/2542294102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 msgr2=0x55837b1cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.891 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1cf9e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009c40 tx=0x7f9d9c009980 comp rx=0 tx=0).stop 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 -- 172.21.15.49:0/2542294102 shutdown_connections 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55837adaa1c0 0x55837b246000 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55837ae161b0 0x55837b1cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55837adf54d0 0x55837b1ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 --2- 172.21.15.49:0/2542294102 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55837aded2f0 0x55837b1cf9e0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9d8affd640 0 client.18171 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 -- 172.21.15.49:0/2542294102 >> 172.21.15.49:0/2542294102 conn(0x55837ae0a300 msgr2=0x55837b1b8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 -- 172.21.15.49:0/2542294102 shutdown_connections 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.889+0000 7f9db9075740 1 -- 172.21.15.49:0/2542294102 wait complete. 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db9075740 20 client.18171 trim_cache size 0 max 16384 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:47:29.892 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:47:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:47:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:47:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 -- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d940b6680 msgr2=0x7f9d940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d940b6680 0x7f9d940b8b90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9da4005fd0 tx=0x7f9da4009500 comp rx=0 tx=0).stop 2024-09-21T06:47:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 -- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 msgr2=0x7f9dac19aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:29.893 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 0x7f9dac19aaa0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f9da0032fd0 tx=0x7f9da0031a20 comp rx=0 tx=0).stop 2024-09-21T06:47:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 -- 172.21.15.49:0/3088224162 shutdown_connections 2024-09-21T06:47:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f9d940b6680 0x7f9d940b8b90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9dac108c50 0x7f9dac19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9dac108300 0x7f9dac19aaa0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 --2- 172.21.15.49:0/3088224162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9dac1029d0 0x7f9dac19a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 -- 172.21.15.49:0/3088224162 >> 172.21.15.49:0/3088224162 conn(0x7f9dac07a710 msgr2=0x7f9dac06be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 -- 172.21.15.49:0/3088224162 shutdown_connections 2024-09-21T06:47:29.894 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:29.890+0000 7f9db210b640 1 -- 172.21.15.49:0/3088224162 wait complete. 2024-09-21T06:47:30.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:29 smithi098 ceph-mon[34704]: pgmap v654: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-21T06:47:30.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:29 smithi079 ceph-mon[34346]: pgmap v654: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-21T06:47:30.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:29 smithi049 ceph-mon[31177]: pgmap v654: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 KiB/s wr, 15 op/s 2024-09-21T06:47:32.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:31 smithi098 ceph-mon[34704]: pgmap v655: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-09-21T06:47:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:31 smithi079 ceph-mon[34346]: pgmap v655: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-09-21T06:47:32.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:31 smithi049 ceph-mon[31177]: pgmap v655: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 KiB/s wr, 10 op/s 2024-09-21T06:47:34.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:33 smithi098 ceph-mon[34704]: pgmap v656: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-21T06:47:34.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:33 smithi079 ceph-mon[34346]: pgmap v656: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-21T06:47:34.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:33 smithi049 ceph-mon[31177]: pgmap v656: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-21T06:47:36.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:35 smithi098 ceph-mon[34704]: pgmap v657: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-09-21T06:47:36.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:35 smithi079 ceph-mon[34346]: pgmap v657: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-09-21T06:47:36.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:35 smithi049 ceph-mon[31177]: pgmap v657: 97 pgs: 97 active+clean; 12 MiB data, 418 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-09-21T06:47:38.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:37 smithi098 ceph-mon[34704]: pgmap v658: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-21T06:47:38.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:37 smithi079 ceph-mon[34346]: pgmap v658: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-21T06:47:38.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:37 smithi049 ceph-mon[31177]: pgmap v658: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-09-21T06:47:40.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:39 smithi098 ceph-mon[34704]: pgmap v659: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-09-21T06:47:40.075 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:39 smithi079 ceph-mon[34346]: pgmap v659: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-09-21T06:47:40.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:39 smithi049 ceph-mon[31177]: pgmap v659: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 38 KiB/s wr, 14 op/s 2024-09-21T06:47:42.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:41 smithi098 ceph-mon[34704]: pgmap v660: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T06:47:42.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:41 smithi079 ceph-mon[34346]: pgmap v660: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T06:47:42.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:41 smithi049 ceph-mon[31177]: pgmap v660: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T06:47:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.002+0000 7f6df5ace640 1 -- 172.21.15.49:0/3576965541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109450 msgr2=0x7f6df0109860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.002+0000 7f6df5ace640 1 --2- 172.21.15.49:0/3576965541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109450 0x7f6df0109860 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009900 tx=0x7f6de402a410 comp rx=0 tx=0).stop 2024-09-21T06:47:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.002+0000 7f6df5ace640 1 -- 172.21.15.49:0/3576965541 shutdown_connections 2024-09-21T06:47:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.002+0000 7f6df5ace640 1 --2- 172.21.15.49:0/3576965541 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6df0109da0 0x7f6df01105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.002+0000 7f6df5ace640 1 --2- 172.21.15.49:0/3576965541 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109450 0x7f6df0109860 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.002+0000 7f6df5ace640 1 --2- 172.21.15.49:0/3576965541 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df0103b20 0x7f6df0103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.002+0000 7f6df5ace640 1 -- 172.21.15.49:0/3576965541 >> 172.21.15.49:0/3576965541 conn(0x7f6df00ff560 msgr2=0x7f6df01019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.002+0000 7f6df5ace640 1 -- 172.21.15.49:0/3576965541 shutdown_connections 2024-09-21T06:47:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.002+0000 7f6df5ace640 1 -- 172.21.15.49:0/3576965541 wait complete. 2024-09-21T06:47:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6df5ace640 1 Processor -- start 2024-09-21T06:47:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6df5ace640 1 -- start start 2024-09-21T06:47:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6df5ace640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6df0103b20 0x7f6df019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6df5ace640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df0109450 0x7f6df019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6df5ace640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109da0 0x7f6df019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6df5ace640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6df0113a60 con 0x7f6df0109da0 2024-09-21T06:47:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6df5ace640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6df01138e0 con 0x7f6df0109450 2024-09-21T06:47:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6df5ace640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6df0113be0 con 0x7f6df0103b20 2024-09-21T06:47:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6deffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109da0 0x7f6df019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6deffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109da0 0x7f6df019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56246/0 (socket says 172.21.15.49:56246) 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.003+0000 7f6deffff640 1 -- 172.21.15.49:0/1190144900 learned_addr learned my addr 172.21.15.49:0/1190144900 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6deeffd640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df0109450 0x7f6df019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6def7fe640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6df0103b20 0x7f6df019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6deffff640 1 -- 172.21.15.49:0/1190144900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6df0103b20 msgr2=0x7f6df019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6deffff640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6df0103b20 0x7f6df019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6deffff640 1 -- 172.21.15.49:0/1190144900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df0109450 msgr2=0x7f6df019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6deffff640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df0109450 0x7f6df019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6deffff640 1 -- 172.21.15.49:0/1190144900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df01a0340 con 0x7f6df0109da0 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6def7fe640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6df0103b20 0x7f6df019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6deffff640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109da0 0x7f6df019fcd0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c970 tx=0x7f6de800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6decff9640 1 -- 172.21.15.49:0/1190144900 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8007bb0 con 0x7f6df0109da0 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6decff9640 1 -- 172.21.15.49:0/1190144900 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6de8007d50 con 0x7f6df0109da0 2024-09-21T06:47:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6df5ace640 1 -- 172.21.15.49:0/1190144900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df01a0630 con 0x7f6df0109da0 2024-09-21T06:47:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6decff9640 1 -- 172.21.15.49:0/1190144900 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de8018770 con 0x7f6df0109da0 2024-09-21T06:47:43.009 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.004+0000 7f6df5ace640 1 -- 172.21.15.49:0/1190144900 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df01a0b00 con 0x7f6df0109da0 2024-09-21T06:47:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.007+0000 7f6dfca37740 1 Processor -- start 2024-09-21T06:47:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.007+0000 7f6decff9640 1 -- 172.21.15.49:0/1190144900 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6de800f450 con 0x7f6df0109da0 2024-09-21T06:47:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.007+0000 7f6dfca37740 1 -- start start 2024-09-21T06:47:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 0x55dfa3a849b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a84ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a85430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.012 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6dfca37740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dfa39f96f0 con 0x55dfa36be4d0 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6dfca37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dfa39e8b20 con 0x55dfa36df1b0 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6dfca37740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55dfa39ec930 con 0x55dfa36b62f0 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6deeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a85430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6def7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a84ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6def7fe640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a84ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.98:3300/0 says I am v2:172.21.15.49:39528/0 (socket says 172.21.15.49:39528) 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6def7fe640 1 -- 172.21.15.49:0/3013509483 learned_addr learned my addr 172.21.15.49:0/3013509483 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6deeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a85430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56252/0 (socket says 172.21.15.49:56252) 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6deeffd640 1 --2- 172.21.15.49:0/3013509483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 0x55dfa3a849b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6def7fe640 1 -- 172.21.15.49:0/3013509483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 msgr2=0x55dfa3a849b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6def7fe640 1 --2- 172.21.15.49:0/3013509483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 0x55dfa3a849b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6decff9640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dd80b6680 0x7f6dd80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6def7fe640 1 -- 172.21.15.49:0/3013509483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 msgr2=0x55dfa3a85430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6def7fe640 1 --2- 172.21.15.49:0/3013509483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a85430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6def7fe640 1 -- 172.21.15.49:0/3013509483 --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa39ae530 con 0x55dfa36b62f0 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.008+0000 7f6deeffd640 1 --2- 172.21.15.49:0/3013509483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a85430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.009+0000 7f6deffff640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dd80b6680 0x7f6dd80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.009+0000 7f6decff9640 1 -- 172.21.15.49:0/1190144900 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f6de80e7910 con 0x7f6df0109da0 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.009+0000 7f6def7fe640 1 --2- 172.21.15.49:0/3013509483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a84ef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009f50 tx=0x7f6de000f7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23d3c3f7b882cce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.009+0000 7f6dd5ffb640 1 -- 172.21.15.49:0/3013509483 <== mon.1 v2:172.21.15.98:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de0003b70 con 0x55dfa36b62f0 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.009+0000 7f6dd5ffb640 1 -- 172.21.15.49:0/3013509483 <== mon.1 v2:172.21.15.98:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6de0003d10 con 0x55dfa36b62f0 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.009+0000 7f6dd5ffb640 1 -- 172.21.15.49:0/3013509483 <== mon.1 v2:172.21.15.98:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de0011880 con 0x55dfa36b62f0 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 -- 172.21.15.49:0/3013509483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 msgr2=0x55dfa3a84ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3013509483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a84ef0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009f50 tx=0x7f6de000f7f0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6deffff640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dd80b6680 0x7f6dd80b8b90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6de80e50c0 tx=0x7f6de8013f70 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 -- 172.21.15.49:0/3013509483 shutdown_connections 2024-09-21T06:47:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3013509483 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a85430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3013509483 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a84ef0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3013509483 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 0x55dfa3a849b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 -- 172.21.15.49:0/3013509483 >> 172.21.15.49:0/3013509483 conn(0x55dfa36d3300 msgr2=0x55dfa3a828a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 -- 172.21.15.49:0/3013509483 shutdown_connections 2024-09-21T06:47:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 -- 172.21.15.49:0/3013509483 wait complete. 2024-09-21T06:47:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.010+0000 7f6dfca37740 1 -- start start 2024-09-21T06:47:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6dfca37740 1 Processor -- start 2024-09-21T06:47:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a90070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a905b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 0x55dfa3a9c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6dfca37740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x55dfa3920ab0 con 0x55dfa36be4d0 2024-09-21T06:47:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6dfca37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x55dfa398e730 con 0x55dfa36df1b0 2024-09-21T06:47:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6dfca37740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x55dfa3a93130 con 0x55dfa36b62f0 2024-09-21T06:47:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6dfca37740 10 client.0 _ll_register_callbacks cb 0x55dfa39e26b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6def7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a905b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6def7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a905b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56266/0 (socket says 172.21.15.49:56266) 2024-09-21T06:47:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6def7fe640 1 -- 172.21.15.49:0/3233945389 learned_addr learned my addr 172.21.15.49:0/3233945389 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6deeffd640 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a90070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6deeffd640 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 0x55dfa3a9c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6def7fe640 1 -- 172.21.15.49:0/3233945389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 msgr2=0x55dfa3a90070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6def7fe640 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a90070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6def7fe640 1 -- 172.21.15.49:0/3233945389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 msgr2=0x55dfa3a9c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6def7fe640 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 0x55dfa3a9c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.011+0000 7f6def7fe640 1 -- 172.21.15.49:0/3233945389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfa374a790 con 0x55dfa36be4d0 2024-09-21T06:47:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6def7fe640 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a905b0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f6de0000f80 tx=0x7f6de0009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2315d9d45643fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dceffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dceffd640 1 -- 172.21.15.49:0/3233945389 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de0029060 con 0x55dfa36be4d0 2024-09-21T06:47:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dceffd640 1 -- 172.21.15.49:0/3233945389 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f6de00040c0 con 0x55dfa36be4d0 2024-09-21T06:47:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dfca37740 1 -- 172.21.15.49:0/3233945389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6de0003d10 con 0x55dfa36be4d0 2024-09-21T06:47:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dceffd640 1 -- 172.21.15.49:0/3233945389 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6de00042c0 con 0x55dfa36be4d0 2024-09-21T06:47:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dfca37740 10 client.18183 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dfca37740 1 -- 172.21.15.49:0/3233945389 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dfa37c3620 con 0x55dfa36be4d0 2024-09-21T06:47:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dceffd640 1 -- 172.21.15.49:0/3233945389 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6de0003d10 con 0x55dfa36be4d0 2024-09-21T06:47:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dceffd640 1 -- 172.21.15.49:0/3233945389 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6de0024470 con 0x55dfa36be4d0 2024-09-21T06:47:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dfca37740 10 client.18183 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dfca37740 10 client.18183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dfca37740 20 client.18183 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dfa369dd80 0x55dfa3aa20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dfca37740 4 client.18183 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.012+0000 7f6dfca37740 1 -- 172.21.15.49:0/3233945389 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfa39fb640 con 0x55dfa369dd80 2024-09-21T06:47:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.013+0000 7f6deeffd640 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dfa369dd80 0x55dfa3aa20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.013+0000 7f6dceffd640 10 client.18183 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.013+0000 7f6deeffd640 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dfa369dd80 0x55dfa3aa20b0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15bba4a54dacca server_cookie=859e3dd9996681f9 in_seq=0 out_seq=0 2024-09-21T06:47:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dceffd640 1 -- 172.21.15.49:0/3233945389 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dfa39fb640 con 0x55dfa369dd80 2024-09-21T06:47:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dceffd640 10 client.18183 handle_command_reply: tid=0 2024-09-21T06:47:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 client.18183 shutdown 2024-09-21T06:47:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 -- 172.21.15.49:0/3233945389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 msgr2=0x55dfa3a905b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a905b0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f6de0000f80 tx=0x7f6de0009c60 comp rx=0 tx=0).stop 2024-09-21T06:47:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 -- 172.21.15.49:0/3233945389 shutdown_connections 2024-09-21T06:47:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dfa369dd80 0x55dfa3aa20b0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36df1b0 0x55dfa3a9c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a905b0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3233945389 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36b62f0 0x55dfa3a90070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dceffd640 0 client.18183 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 -- 172.21.15.49:0/3233945389 >> 172.21.15.49:0/3233945389 conn(0x55dfa36d3300 msgr2=0x55dfa3a859e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 -- 172.21.15.49:0/3233945389 shutdown_connections 2024-09-21T06:47:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.014+0000 7f6dfca37740 1 -- 172.21.15.49:0/3233945389 wait complete. 2024-09-21T06:47:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.015+0000 7f6dfca37740 20 client.18183 trim_cache size 0 max 16384 2024-09-21T06:47:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.029+0000 7f6dfca37740 1 Processor -- start 2024-09-21T06:47:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.029+0000 7f6dfca37740 1 -- start start 2024-09-21T06:47:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36b62f0 0x55dfa3a863a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36be4d0 0x55dfa3a90550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 0x55dfa3a91ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6dfca37740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6df01b2110 con 0x55dfa36b62f0 2024-09-21T06:47:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6dfca37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6df01af9e0 con 0x55dfa36be4d0 2024-09-21T06:47:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6dfca37740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6df01ad850 con 0x55dfa36df1b0 2024-09-21T06:47:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6deeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36b62f0 0x55dfa3a863a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6deeffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36b62f0 0x55dfa3a863a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56272/0 (socket says 172.21.15.49:56272) 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6deeffd640 1 -- 172.21.15.49:0/3809246162 learned_addr learned my addr 172.21.15.49:0/3809246162 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6deeffd640 1 -- 172.21.15.49:0/3809246162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 msgr2=0x55dfa3a91ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6deeffd640 1 --2- 172.21.15.49:0/3809246162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 0x55dfa3a91ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6def7fe640 1 --2- 172.21.15.49:0/3809246162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36be4d0 0x55dfa3a90550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6deeffd640 1 -- 172.21.15.49:0/3809246162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36be4d0 msgr2=0x55dfa3a90550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6deeffd640 1 --2- 172.21.15.49:0/3809246162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36be4d0 0x55dfa3a90550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6deeffd640 1 -- 172.21.15.49:0/3809246162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfa3a877c0 con 0x55dfa36b62f0 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6deeffd640 1 --2- 172.21.15.49:0/3809246162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36b62f0 0x55dfa3a863a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009230 tx=0x7f6de4031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a7dd1bbeac4978 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.030+0000 7f6dd57fa640 1 -- 172.21.15.49:0/3809246162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4035040 con 0x55dfa36b62f0 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dd57fa640 1 -- 172.21.15.49:0/3809246162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6de4004360 con 0x55dfa36b62f0 2024-09-21T06:47:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dd57fa640 1 -- 172.21.15.49:0/3809246162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de4003ad0 con 0x55dfa36b62f0 2024-09-21T06:47:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dfca37740 1 -- 172.21.15.49:0/3809246162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36b62f0 msgr2=0x55dfa3a863a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3809246162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36b62f0 0x55dfa3a863a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f6de4009230 tx=0x7f6de4031400 comp rx=0 tx=0).stop 2024-09-21T06:47:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dfca37740 1 -- 172.21.15.49:0/3809246162 shutdown_connections 2024-09-21T06:47:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3809246162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 0x55dfa3a91ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3809246162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36be4d0 0x55dfa3a90550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.037 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dfca37740 1 --2- 172.21.15.49:0/3809246162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36b62f0 0x55dfa3a863a0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dfca37740 1 -- 172.21.15.49:0/3809246162 >> 172.21.15.49:0/3809246162 conn(0x55dfa36d3300 msgr2=0x55dfa3a91590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dfca37740 1 -- 172.21.15.49:0/3809246162 shutdown_connections 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.031+0000 7f6dfca37740 1 -- 172.21.15.49:0/3809246162 wait complete. 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6dfca37740 1 -- start start 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6dfca37740 1 Processor -- start 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36b62f0 0x55dfa3a95de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a96380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6dfca37740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 0x55dfa3b04920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6dfca37740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6df01adea0 con 0x55dfa36be4d0 2024-09-21T06:47:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6dfca37740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6df01af310 con 0x55dfa36b62f0 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6dfca37740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6df01ae570 con 0x55dfa36df1b0 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6dfca37740 10 client.0 _ll_register_callbacks cb 0x7f6de4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6def7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a96380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6def7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a96380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:56286/0 (socket says 172.21.15.49:56286) 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6def7fe640 1 -- 172.21.15.49:0/1102434696 learned_addr learned my addr 172.21.15.49:0/1102434696 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.032+0000 7f6deeffd640 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36b62f0 0x55dfa3a95de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6deeffd640 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 0x55dfa3b04920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6def7fe640 1 -- 172.21.15.49:0/1102434696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 msgr2=0x55dfa3b04920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6def7fe640 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 0x55dfa3b04920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6def7fe640 1 -- 172.21.15.49:0/1102434696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36b62f0 msgr2=0x55dfa3a95de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6def7fe640 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36b62f0 0x55dfa3a95de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6def7fe640 1 -- 172.21.15.49:0/1102434696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfa3b04f90 con 0x55dfa36be4d0 2024-09-21T06:47:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6deeffd640 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 0x55dfa3b04920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6def7fe640 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a96380 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f6de0024870 tx=0x7f6de00096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889dc0ad373490af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6dceffd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6dceffd640 1 -- 172.21.15.49:0/1102434696 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de0029040 con 0x55dfa36be4d0 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6dceffd640 1 -- 172.21.15.49:0/1102434696 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f6de0009d70 con 0x55dfa36be4d0 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6dfca37740 1 -- 172.21.15.49:0/1102434696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6de4004360 con 0x55dfa36be4d0 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6dceffd640 1 -- 172.21.15.49:0/1102434696 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6de0009790 con 0x55dfa36be4d0 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6dfca37740 10 client.18189 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6dfca37740 1 -- 172.21.15.49:0/1102434696 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55dfa3b0c3b0 con 0x55dfa36be4d0 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.033+0000 7f6dceffd640 1 -- 172.21.15.49:0/1102434696 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6de4004360 con 0x55dfa36be4d0 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6dceffd640 1 -- 172.21.15.49:0/1102434696 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f6de0003c70 con 0x55dfa36be4d0 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6dfca37740 10 client.18189 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6dfca37740 10 client.18189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6dfca37740 20 client.18189 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6dfca37740 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dfa36731c0 0x55dfa3b0eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6dfca37740 4 client.18189 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:47:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6dfca37740 1 -- 172.21.15.49:0/1102434696 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dfa39f70f0 con 0x55dfa36731c0 2024-09-21T06:47:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6deeffd640 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dfa36731c0 0x55dfa3b0eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6dceffd640 10 client.18189 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.034+0000 7f6deeffd640 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dfa36731c0 0x55dfa3b0eb60 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd29439b6b898062 server_cookie=8b115c3715372717 in_seq=0 out_seq=0 2024-09-21T06:47:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dceffd640 1 -- 172.21.15.49:0/1102434696 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfa39f70f0 con 0x55dfa36731c0 2024-09-21T06:47:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dceffd640 10 client.18189 handle_command_reply: tid=0 2024-09-21T06:47:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 client.18189 shutdown 2024-09-21T06:47:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 -- 172.21.15.49:0/1102434696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 msgr2=0x55dfa3a96380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a96380 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f6de0024870 tx=0x7f6de00096b0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 -- 172.21.15.49:0/1102434696 shutdown_connections 2024-09-21T06:47:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55dfa36731c0 0x55dfa3b0eb60 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55dfa36df1b0 0x55dfa3b04920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55dfa36be4d0 0x55dfa3a96380 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dceffd640 0 client.18189 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 --2- 172.21.15.49:0/1102434696 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x55dfa36b62f0 0x55dfa3a95de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 -- 172.21.15.49:0/1102434696 >> 172.21.15.49:0/1102434696 conn(0x55dfa36d3300 msgr2=0x55dfa3a86170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 -- 172.21.15.49:0/1102434696 shutdown_connections 2024-09-21T06:47:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 1 -- 172.21.15.49:0/1102434696 wait complete. 2024-09-21T06:47:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.042+0000 7f6dfca37740 20 client.18189 trim_cache size 0 max 16384 2024-09-21T06:47:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:{ 2024-09-21T06:47:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "message": "", 2024-09-21T06:47:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout: "return_code": 0 2024-09-21T06:47:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stdout:} 2024-09-21T06:47:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 -- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dd80b6680 msgr2=0x7f6dd80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dd80b6680 0x7f6dd80b8b90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6de80e50c0 tx=0x7f6de8013f70 comp rx=0 tx=0).stop 2024-09-21T06:47:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 -- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109da0 msgr2=0x7f6df019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109da0 0x7f6df019fcd0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c970 tx=0x7f6de800ce30 comp rx=0 tx=0).stop 2024-09-21T06:47:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 -- 172.21.15.49:0/1190144900 shutdown_connections 2024-09-21T06:47:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6dd80b6680 0x7f6dd80b8b90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6df0109da0 0x7f6df019fcd0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6df0109450 0x7f6df019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 --2- 172.21.15.49:0/1190144900 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6df0103b20 0x7f6df019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 -- 172.21.15.49:0/1190144900 >> 172.21.15.49:0/1190144900 conn(0x7f6df00ff560 msgr2=0x7f6df0101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 -- 172.21.15.49:0/1190144900 shutdown_connections 2024-09-21T06:47:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi049.front.sepia.ceph.com.smithi049.stderr:2024-09-21T06:47:43.043+0000 7f6df5ace640 1 -- 172.21.15.49:0/1190144900 wait complete. 2024-09-21T06:47:44.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:43 smithi098 ceph-mon[34704]: pgmap v661: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:47:44.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:43 smithi079 ceph-mon[34346]: pgmap v661: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:47:44.223 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:43 smithi049 ceph-mon[31177]: pgmap v661: 97 pgs: 97 active+clean; 12 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-09-21T06:47:46.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:45 smithi098 ceph-mon[34704]: pgmap v662: 97 pgs: 97 active+clean; 13 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T06:47:46.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:45 smithi079 ceph-mon[34346]: pgmap v662: 97 pgs: 97 active+clean; 13 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T06:47:46.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:45 smithi049 ceph-mon[31177]: pgmap v662: 97 pgs: 97 active+clean; 13 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 13 op/s 2024-09-21T06:47:47.490 INFO:tasks.workunit.client.0.smithi049.stdout:561/600: open fd = 3 2024-09-21T06:47:47.490 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.490 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.490 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:562/600: open fd = 3 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:563/600: open fd = 3 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:564/600: open fd = 3 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:565/600: open fd = 3 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.491 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:566/600: open fd = 3 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:567/600: open fd = 3 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:568/600: open fd = 3 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.492 INFO:tasks.workunit.client.0.smithi049.stdout:569/600: open fd = 3 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:570/600: open fd = 3 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:571/600: open fd = 3 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:572/600: open fd = 3 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.493 INFO:tasks.workunit.client.0.smithi049.stdout:573/600: open fd = 3 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:574/600: open fd = 3 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:575/600: open fd = 3 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:576/600: open fd = 3 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.494 INFO:tasks.workunit.client.0.smithi049.stdout:577/600: open fd = 3 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:578/600: open fd = 3 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:579/600: open fd = 3 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:580/600: open fd = 3 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.495 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:581/600: open fd = 3 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:582/600: open fd = 3 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:583/600: open fd = 3 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:584/600: open fd = 3 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.496 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:585/600: open fd = 3 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:586/600: open fd = 3 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:587/600: open fd = 3 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.497 INFO:tasks.workunit.client.0.smithi049.stdout:588/600: open fd = 3 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:589/600: open fd = 3 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:590/600: open fd = 3 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:591/600: open fd = 3 2024-09-21T06:47:47.498 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:592/600: open fd = 3 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:593/600: open fd = 3 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:594/600: open fd = 3 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:595/600: open fd = 3 2024-09-21T06:47:47.499 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:596/600: open fd = 3 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:597/600: open fd = 3 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:598/600: open fd = 3 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.500 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.501 INFO:tasks.workunit.client.0.smithi049.stdout:599/600: open fd = 3 2024-09-21T06:47:47.501 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.501 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.501 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.501 INFO:tasks.workunit.client.0.smithi049.stdout:600/600: open fd = 3 2024-09-21T06:47:47.501 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.501 INFO:tasks.workunit.client.0.smithi049.stdout:write ret = 32 2024-09-21T06:47:47.501 INFO:tasks.workunit.client.0.smithi049.stdout:pread ret = 64 2024-09-21T06:47:47.502 INFO:tasks.workunit.client.0.smithi049.stderr:+ echo OK 2024-09-21T06:47:47.502 INFO:tasks.workunit.client.0.smithi049.stdout:OK 2024-09-21T06:47:47.503 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T06:47:47.503 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T06:47:47.549 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-09-21T06:47:47.549 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T06:47:47.858 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:47 smithi049 ceph-mon[31177]: pgmap v663: 97 pgs: 97 active+clean; 13 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T06:47:47.860 DEBUG:teuthology.parallel:result is None 2024-09-21T06:47:47.860 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:47:47.903 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:47:47.903 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T06:47:47.930 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:47:47.951 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T06:47:48.000 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T06:47:48.001 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:47:48.001 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:47:48.001 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T06:47:48.028 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T06:47:48.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:47 smithi098 ceph-mon[34704]: pgmap v663: 97 pgs: 97 active+clean; 13 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T06:47:48.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:47 smithi079 ceph-mon[34346]: pgmap v663: 97 pgs: 97 active+clean; 13 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 27 KiB/s wr, 11 op/s 2024-09-21T06:47:48.096 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T06:47:48.137 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:47:48.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.251+0000 7f943f98b640 1 -- 172.21.15.49:0/2658729242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9438104910 msgr2=0x7f9438104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.251+0000 7f943f98b640 1 --2- 172.21.15.49:0/2658729242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9438104910 0x7f9438104d20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f9434009900 tx=0x7f943402a410 comp rx=0 tx=0).stop 2024-09-21T06:47:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.251+0000 7f943f98b640 1 -- 172.21.15.49:0/2658729242 shutdown_connections 2024-09-21T06:47:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.251+0000 7f943f98b640 1 --2- 172.21.15.49:0/2658729242 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f943810dd70 0x7f9438110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.251+0000 7f943f98b640 1 --2- 172.21.15.49:0/2658729242 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9438105260 0x7f943810d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.251+0000 7f943f98b640 1 --2- 172.21.15.49:0/2658729242 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9438104910 0x7f9438104d20 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.251+0000 7f943f98b640 1 -- 172.21.15.49:0/2658729242 >> 172.21.15.49:0/2658729242 conn(0x7f94380fe3c0 msgr2=0x7f9438100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.251+0000 7f943f98b640 1 -- 172.21.15.49:0/2658729242 shutdown_connections 2024-09-21T06:47:48.255 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.251+0000 7f943f98b640 1 -- 172.21.15.49:0/2658729242 wait complete. 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943f98b640 1 Processor -- start 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943f98b640 1 -- start start 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943f98b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9438104910 0x7f9438102640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943f98b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9438105260 0x7f9438102b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943f98b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943810dd70 0x7f94381030c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943f98b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f94381139f0 con 0x7f943810dd70 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943f98b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9438113870 con 0x7f9438105260 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943f98b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9438113b70 con 0x7f9438104910 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943df28640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943810dd70 0x7f94381030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943df28640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943810dd70 0x7f94381030c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36056/0 (socket says 172.21.15.49:36056) 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943df28640 1 -- 172.21.15.49:0/518680041 learned_addr learned my addr 172.21.15.49:0/518680041 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943cf26640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9438105260 0x7f9438102b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.256 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943d727640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9438104910 0x7f9438102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943df28640 1 -- 172.21.15.49:0/518680041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9438104910 msgr2=0x7f9438102640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943df28640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9438104910 0x7f9438102640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943df28640 1 -- 172.21.15.49:0/518680041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9438105260 msgr2=0x7f9438102b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943df28640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9438105260 0x7f9438102b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.252+0000 7f943df28640 1 -- 172.21.15.49:0/518680041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94381a8700 con 0x7f943810dd70 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.253+0000 7f943df28640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943810dd70 0x7f94381030c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f943000eaa0 tx=0x7f943000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.253+0000 7f942e7fc640 1 -- 172.21.15.49:0/518680041 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f943000cdb0 con 0x7f943810dd70 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.253+0000 7f942e7fc640 1 -- 172.21.15.49:0/518680041 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9430005020 con 0x7f943810dd70 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.253+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94381a89f0 con 0x7f943810dd70 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.253+0000 7f942e7fc640 1 -- 172.21.15.49:0/518680041 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94300116d0 con 0x7f943810dd70 2024-09-21T06:47:48.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.253+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94381a8ef0 con 0x7f943810dd70 2024-09-21T06:47:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.254+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9438104d20 con 0x7f943810dd70 2024-09-21T06:47:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.255+0000 7f942e7fc640 1 -- 172.21.15.49:0/518680041 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f94300051d0 con 0x7f943810dd70 2024-09-21T06:47:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.256+0000 7f942e7fc640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f94240b66b0 0x7f94240b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.256+0000 7f943d727640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f94240b66b0 0x7f94240b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.256+0000 7f942e7fc640 1 -- 172.21.15.49:0/518680041 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f94300e7c80 con 0x7f943810dd70 2024-09-21T06:47:48.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.257+0000 7f943d727640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f94240b66b0 0x7f94240b8bc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9434000c00 tx=0x7f9434031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.261 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.260+0000 7f942e7fc640 1 -- 172.21.15.49:0/518680041 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9430016030 con 0x7f943810dd70 2024-09-21T06:47:48.400 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:48.478 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.476+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f9438107f70 con 0x7f94240b66b0 2024-09-21T06:47:48.486 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.484+0000 7f942e7fc640 1 -- 172.21.15.49:0/518680041 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f9438107f70 con 0x7f94240b66b0 2024-09-21T06:47:48.486 INFO:teuthology.orchestra.run.smithi049.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T06:36:35", "first": "2024-09-21T06:37:00", "last": "2024-09-21T06:47:00", "last_pruned": "2024-09-21T06:47:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-09-21T06:47:48.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f94240b66b0 msgr2=0x7f94240b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f94240b66b0 0x7f94240b8bc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9434000c00 tx=0x7f9434031400 comp rx=0 tx=0).stop 2024-09-21T06:47:48.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943810dd70 msgr2=0x7f94381030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.488 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943810dd70 0x7f94381030c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f943000eaa0 tx=0x7f943000ef60 comp rx=0 tx=0).stop 2024-09-21T06:47:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 shutdown_connections 2024-09-21T06:47:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f94240b66b0 0x7f94240b8bc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f943810dd70 0x7f94381030c0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9438105260 0x7f9438102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 --2- 172.21.15.49:0/518680041 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9438104910 0x7f9438102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 >> 172.21.15.49:0/518680041 conn(0x7f94380fe3c0 msgr2=0x7f9438107860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 shutdown_connections 2024-09-21T06:47:48.489 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.487+0000 7f943f98b640 1 -- 172.21.15.49:0/518680041 wait complete. 2024-09-21T06:47:48.500 DEBUG:teuthology.orchestra.run.smithi049:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T06:47:48.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.615+0000 7ffb484cc640 1 -- 172.21.15.49:0/2359417689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40102a00 msgr2=0x7ffb40102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.615+0000 7ffb484cc640 1 --2- 172.21.15.49:0/2359417689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40102a00 0x7ffb40102e10 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009900 tx=0x7ffb3002a410 comp rx=0 tx=0).stop 2024-09-21T06:47:48.617 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.616+0000 7ffb484cc640 1 -- 172.21.15.49:0/2359417689 shutdown_connections 2024-09-21T06:47:48.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.616+0000 7ffb484cc640 1 --2- 172.21.15.49:0/2359417689 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb40108c80 0x7ffb4010f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.616+0000 7ffb484cc640 1 --2- 172.21.15.49:0/2359417689 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb40108330 0x7ffb40108740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.616+0000 7ffb484cc640 1 --2- 172.21.15.49:0/2359417689 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40102a00 0x7ffb40102e10 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.616+0000 7ffb484cc640 1 -- 172.21.15.49:0/2359417689 >> 172.21.15.49:0/2359417689 conn(0x7ffb4007a710 msgr2=0x7ffb4007ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.616+0000 7ffb484cc640 1 -- 172.21.15.49:0/2359417689 shutdown_connections 2024-09-21T06:47:48.618 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.616+0000 7ffb484cc640 1 -- 172.21.15.49:0/2359417689 wait complete. 2024-09-21T06:47:48.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.616+0000 7ffb484cc640 1 Processor -- start 2024-09-21T06:47:48.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.616+0000 7ffb484cc640 1 -- start start 2024-09-21T06:47:48.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb484cc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb40102a00 0x7ffb4019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb484cc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb40108330 0x7ffb4019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb484cc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40108c80 0x7ffb4019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb484cc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7ffb40113a60 con 0x7ffb40108c80 2024-09-21T06:47:48.620 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb484cc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7ffb401138e0 con 0x7ffb40108330 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb484cc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7ffb40113be0 con 0x7ffb40102a00 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46a69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40108c80 0x7ffb4019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46a69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40108c80 0x7ffb4019fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36076/0 (socket says 172.21.15.49:36076) 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46a69640 1 -- 172.21.15.49:0/3293064131 learned_addr learned my addr 172.21.15.49:0/3293064131 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46268640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb40102a00 0x7ffb4019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb45a67640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb40108330 0x7ffb4019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46a69640 1 -- 172.21.15.49:0/3293064131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb40102a00 msgr2=0x7ffb4019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46a69640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb40102a00 0x7ffb4019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46a69640 1 -- 172.21.15.49:0/3293064131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb40108330 msgr2=0x7ffb4019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46a69640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb40108330 0x7ffb4019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46a69640 1 -- 172.21.15.49:0/3293064131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb401a0390 con 0x7ffb40108c80 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb45a67640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb40108330 0x7ffb4019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb46a69640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40108c80 0x7ffb4019fc90 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800eb10 tx=0x7ffb3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/3293064131 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38004b20 con 0x7ffb40108c80 2024-09-21T06:47:48.621 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb401a0680 con 0x7ffb40108c80 2024-09-21T06:47:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.617+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/3293064131 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb38004cc0 con 0x7ffb40108c80 2024-09-21T06:47:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.618+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/3293064131 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb38010690 con 0x7ffb40108c80 2024-09-21T06:47:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.618+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb401a6e10 con 0x7ffb40108c80 2024-09-21T06:47:48.622 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.618+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb40102e10 con 0x7ffb40108c80 2024-09-21T06:47:48.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.620+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/3293064131 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7ffb38005000 con 0x7ffb40108c80 2024-09-21T06:47:48.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.621+0000 7ffb3f7fe640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb280b6680 0x7ffb280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.621+0000 7ffb46268640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb280b6680 0x7ffb280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.621+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/3293064131 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7ffb380e7fa0 con 0x7ffb40108c80 2024-09-21T06:47:48.623 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.621+0000 7ffb46268640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb280b6680 0x7ffb280b8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffb30031440 tx=0x7ffb30009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.625 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.624+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/3293064131 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb38056710 con 0x7ffb40108c80 2024-09-21T06:47:48.845 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.843+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 --> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7ffb40063800 con 0x7ffb280b6680 2024-09-21T06:47:48.853 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.851+0000 7ffb3f7fe640 1 -- 172.21.15.49:0/3293064131 <== mgr.14226 v2:172.21.15.49:6800/202634858 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7ffb40063800 con 0x7ffb280b6680 2024-09-21T06:47:48.853 INFO:teuthology.orchestra.run.smithi049.stdout:/ 1m 6m3h 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb280b6680 msgr2=0x7ffb280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb280b6680 0x7ffb280b8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ffb30031440 tx=0x7ffb30009560 comp rx=0 tx=0).stop 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40108c80 msgr2=0x7ffb4019fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40108c80 0x7ffb4019fc90 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ffb3800eb10 tx=0x7ffb3800c2d0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 shutdown_connections 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7ffb280b6680 0x7ffb280b8b90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7ffb40108c80 0x7ffb4019fc90 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7ffb40108330 0x7ffb4019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 --2- 172.21.15.49:0/3293064131 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7ffb40102a00 0x7ffb4019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 >> 172.21.15.49:0/3293064131 conn(0x7ffb4007a710 msgr2=0x7ffb401063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 shutdown_connections 2024-09-21T06:47:48.856 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.854+0000 7ffb484cc640 1 -- 172.21.15.49:0/3293064131 wait complete. 2024-09-21T06:47:48.868 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T06:47:48.878 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.867+0000 7f92f3a10640 1 -- 172.21.15.49:0/3437089788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec1052b0 msgr2=0x7f92ec10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.867+0000 7f92f3a10640 1 --2- 172.21.15.49:0/3437089788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec1052b0 0x7f92ec10d8f0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f92dc009900 tx=0x7f92dc02a410 comp rx=0 tx=0).stop 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.867+0000 7f92f3a10640 1 -- 172.21.15.49:0/3437089788 shutdown_connections 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.867+0000 7f92f3a10640 1 --2- 172.21.15.49:0/3437089788 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92ec10de30 0x7f92ec110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.867+0000 7f92f3a10640 1 --2- 172.21.15.49:0/3437089788 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec1052b0 0x7f92ec10d8f0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.867+0000 7f92f3a10640 1 --2- 172.21.15.49:0/3437089788 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ec104880 0x7f92ec104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.867+0000 7f92f3a10640 1 -- 172.21.15.49:0/3437089788 >> 172.21.15.49:0/3437089788 conn(0x7f92ec079730 msgr2=0x7f92ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.867+0000 7f92f3a10640 1 -- 172.21.15.49:0/3437089788 shutdown_connections 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.867+0000 7f92f3a10640 1 -- 172.21.15.49:0/3437089788 wait complete. 2024-09-21T06:47:48.880 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f3a10640 1 Processor -- start 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f3a10640 1 -- start start 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f3a10640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92ec104880 0x7f92ec19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f3a10640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ec1052b0 0x7f92ec19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f3a10640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec10de30 0x7f92ec19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f3a10640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec113a70 con 0x7f92ec10de30 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f3a10640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec1138f0 con 0x7f92ec1052b0 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f3a10640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec113bf0 con 0x7f92ec104880 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f1fad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec10de30 0x7f92ec19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f1fad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec10de30 0x7f92ec19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36098/0 (socket says 172.21.15.49:36098) 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.868+0000 7f92f1fad640 1 -- 172.21.15.49:0/2879600811 learned_addr learned my addr 172.21.15.49:0/2879600811 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f0fab640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ec1052b0 0x7f92ec19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f17ac640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92ec104880 0x7f92ec19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f1fad640 1 -- 172.21.15.49:0/2879600811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92ec104880 msgr2=0x7f92ec19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f1fad640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92ec104880 0x7f92ec19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.881 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f1fad640 1 -- 172.21.15.49:0/2879600811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ec1052b0 msgr2=0x7f92ec19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f1fad640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ec1052b0 0x7f92ec19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f1fad640 1 -- 172.21.15.49:0/2879600811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ec1a03f0 con 0x7f92ec10de30 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f0fab640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ec1052b0 0x7f92ec19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f17ac640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92ec104880 0x7f92ec19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f1fad640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec10de30 0x7f92ec19fcc0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f92e400eaa0 tx=0x7f92e400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92e27fc640 1 -- 172.21.15.49:0/2879600811 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e400cdb0 con 0x7f92ec10de30 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92e27fc640 1 -- 172.21.15.49:0/2879600811 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92e4005020 con 0x7f92ec10de30 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f3a10640 1 -- 172.21.15.49:0/2879600811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ec1a06e0 con 0x7f92ec10de30 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92e27fc640 1 -- 172.21.15.49:0/2879600811 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e40116d0 con 0x7f92ec10de30 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.869+0000 7f92f3a10640 1 -- 172.21.15.49:0/2879600811 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ec1a6e40 con 0x7f92ec10de30 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.872+0000 7f92f9f84740 1 Processor -- start 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92e27fc640 1 -- 172.21.15.49:0/2879600811 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f92e40051d0 con 0x7f92ec10de30 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f9f84740 1 -- start start 2024-09-21T06:47:48.882 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55755590e070 0x557555cb5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 0x557555cb57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558ed390 0x557555cb5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f9f84740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557555c2be50 con 0x5575558ed390 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f9f84740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557555c1b280 con 0x5575558e51b0 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f9f84740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557555c1f090 con 0x55755590e070 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f0fab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558ed390 0x557555cb5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f0fab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558ed390 0x557555cb5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36110/0 (socket says 172.21.15.49:36110) 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f0fab640 1 -- 172.21.15.49:0/4203249800 learned_addr learned my addr 172.21.15.49:0/4203249800 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f17ac640 1 --2- 172.21.15.49:0/4203249800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 0x557555cb57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.873+0000 7f92f0fab640 1 --2- 172.21.15.49:0/4203249800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55755590e070 0x557555cb5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92f17ac640 1 -- 172.21.15.49:0/4203249800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55755590e070 msgr2=0x557555cb5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92f17ac640 1 --2- 172.21.15.49:0/4203249800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55755590e070 0x557555cb5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.883 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92f17ac640 1 -- 172.21.15.49:0/4203249800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558ed390 msgr2=0x557555cb5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92f17ac640 1 --2- 172.21.15.49:0/4203249800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558ed390 0x557555cb5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92f17ac640 1 -- 172.21.15.49:0/4203249800 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557555979650 con 0x5575558e51b0 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92e27fc640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92d80b6680 0x7f92d80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92f0fab640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92d80b6680 0x7f92d80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92f17ac640 1 --2- 172.21.15.49:0/4203249800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 0x557555cb57b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009c30 tx=0x7f92e8010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f81d0a6694c9a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92e27fc640 1 -- 172.21.15.49:0/2879600811 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f92e40e7a20 con 0x7f92ec10de30 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92d77fe640 1 -- 172.21.15.49:0/4203249800 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8005020 con 0x5575558e51b0 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92d77fe640 1 -- 172.21.15.49:0/4203249800 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92e80047a0 con 0x5575558e51b0 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.874+0000 7f92d77fe640 1 -- 172.21.15.49:0/4203249800 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8012670 con 0x5575558e51b0 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f9f84740 1 -- 172.21.15.49:0/4203249800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 msgr2=0x557555cb57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f9f84740 1 --2- 172.21.15.49:0/4203249800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 0x557555cb57b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92e8009c30 tx=0x7f92e8010740 comp rx=0 tx=0).stop 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f0fab640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92d80b6680 0x7f92d80b8b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f92dc032fd0 tx=0x7f92dc031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f9f84740 1 -- 172.21.15.49:0/4203249800 shutdown_connections 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f9f84740 1 --2- 172.21.15.49:0/4203249800 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558ed390 0x557555cb5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.884 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f9f84740 1 --2- 172.21.15.49:0/4203249800 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 0x557555cb57b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f9f84740 1 --2- 172.21.15.49:0/4203249800 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x55755590e070 0x557555cb5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f9f84740 1 -- 172.21.15.49:0/4203249800 >> 172.21.15.49:0/4203249800 conn(0x557555902460 msgr2=0x557555cb3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f9f84740 1 -- 172.21.15.49:0/4203249800 shutdown_connections 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.875+0000 7f92f9f84740 1 -- 172.21.15.49:0/4203249800 wait complete. 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f9f84740 1 -- start start 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f9f84740 1 Processor -- start 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558e51b0 0x557555cc0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 0x557555cc0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55755590e070 0x557555cccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f9f84740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557555a7c700 con 0x55755590e070 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f9f84740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557555bb6110 con 0x5575558ed390 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f9f84740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557555cc3a50 con 0x5575558e51b0 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f9f84740 10 client.0 _ll_register_callbacks cb 0x557555bcf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:48.885 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f1fad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55755590e070 0x557555cccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f1fad640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55755590e070 0x557555cccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36114/0 (socket says 172.21.15.49:36114) 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f1fad640 1 -- 172.21.15.49:0/2278757490 learned_addr learned my addr 172.21.15.49:0/2278757490 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.876+0000 7f92f17ac640 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558e51b0 0x557555cc0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f0fab640 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 0x557555cc0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f1fad640 1 -- 172.21.15.49:0/2278757490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558e51b0 msgr2=0x557555cc0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f1fad640 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558e51b0 0x557555cc0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f1fad640 1 -- 172.21.15.49:0/2278757490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 msgr2=0x557555cc0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f1fad640 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 0x557555cc0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f1fad640 1 -- 172.21.15.49:0/2278757490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557555be3c40 con 0x55755590e070 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f17ac640 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558e51b0 0x557555cc0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f0fab640 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 0x557555cc0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f1fad640 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55755590e070 0x557555cccd70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f92e40e5180 tx=0x7f92e40ad330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e64ea9bad3a6865 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92d4ff9640 1 -- 172.21.15.49:0/2278757490 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e401f070 con 0x55755590e070 2024-09-21T06:47:48.886 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92d4ff9640 1 -- 172.21.15.49:0/2278757490 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f92e40ac4f0 con 0x55755590e070 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f9f84740 1 -- 172.21.15.49:0/2278757490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92e80047a0 con 0x55755590e070 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92d4ff9640 1 -- 172.21.15.49:0/2278757490 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f92e40b2300 con 0x55755590e070 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f9f84740 10 client.18213 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.877+0000 7f92f9f84740 1 -- 172.21.15.49:0/2278757490 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557555ccf7f0 con 0x55755590e070 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.878+0000 7f92d4ff9640 1 -- 172.21.15.49:0/2278757490 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92e80047a0 con 0x55755590e070 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.878+0000 7f92d4ff9640 1 -- 172.21.15.49:0/2278757490 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f92e400f040 con 0x55755590e070 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.878+0000 7f92f9f84740 10 client.18213 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.878+0000 7f92f9f84740 10 client.18213 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.878+0000 7f92f9f84740 20 client.18213 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.878+0000 7f92f9f84740 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5575558cc9f0 0x557555cd2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.878+0000 7f92f9f84740 4 client.18213 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.878+0000 7f92f9f84740 1 -- 172.21.15.49:0/2278757490 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557555c2dda0 con 0x5575558cc9f0 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.878+0000 7f92f17ac640 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5575558cc9f0 0x557555cd2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.879+0000 7f92d4ff9640 10 client.18213 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:48.887 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.879+0000 7f92f17ac640 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5575558cc9f0 0x557555cd2ce0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6016631abb30dff7 server_cookie=d2948f59644fa4dd in_seq=0 out_seq=0 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.879+0000 7f92d4ff9640 1 -- 172.21.15.49:0/2278757490 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557555c2dda0 con 0x5575558cc9f0 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.879+0000 7f92d4ff9640 10 client.18213 handle_command_reply: tid=0 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.879+0000 7f92f9f84740 1 client.18213 shutdown 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.879+0000 7f92f9f84740 1 -- 172.21.15.49:0/2278757490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55755590e070 msgr2=0x557555cccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.879+0000 7f92f9f84740 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55755590e070 0x557555cccd70 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f92e40e5180 tx=0x7f92e40ad330 comp rx=0 tx=0).stop 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92f9f84740 1 -- 172.21.15.49:0/2278757490 shutdown_connections 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92f9f84740 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5575558cc9f0 0x557555cd2ce0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92f9f84740 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x55755590e070 0x557555cccd70 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92f9f84740 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 0x557555cc0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92d4ff9640 0 client.18213 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92f9f84740 1 --2- 172.21.15.49:0/2278757490 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558e51b0 0x557555cc0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92f9f84740 1 -- 172.21.15.49:0/2278757490 >> 172.21.15.49:0/2278757490 conn(0x557555902460 msgr2=0x557555cb8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92f9f84740 1 -- 172.21.15.49:0/2278757490 shutdown_connections 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92f9f84740 1 -- 172.21.15.49:0/2278757490 wait complete. 2024-09-21T06:47:48.889 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.880+0000 7f92f9f84740 20 client.18213 trim_cache size 0 max 16384 2024-09-21T06:47:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.897+0000 7f92f9f84740 1 Processor -- start 2024-09-21T06:47:48.899 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.897+0000 7f92f9f84740 1 -- start start 2024-09-21T06:47:48.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558cc9f0 0x557555cc0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 0x557555cccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558ed390 0x557555cbdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f9f84740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec1b2160 con 0x5575558cc9f0 2024-09-21T06:47:48.900 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f9f84740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec1afa30 con 0x5575558e51b0 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f9f84740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec1ad8a0 con 0x5575558ed390 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f17ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558cc9f0 0x557555cc0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f17ac640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558cc9f0 0x557555cc0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36128/0 (socket says 172.21.15.49:36128) 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f17ac640 1 -- 172.21.15.49:0/1841082191 learned_addr learned my addr 172.21.15.49:0/1841082191 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f0fab640 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 0x557555cccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f1fad640 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558ed390 0x557555cbdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f17ac640 1 -- 172.21.15.49:0/1841082191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558ed390 msgr2=0x557555cbdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f17ac640 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558ed390 0x557555cbdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f17ac640 1 -- 172.21.15.49:0/1841082191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 msgr2=0x557555cccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f17ac640 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 0x557555cccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f17ac640 1 -- 172.21.15.49:0/1841082191 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557555cd3220 con 0x5575558cc9f0 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f1fad640 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558ed390 0x557555cbdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.898+0000 7f92f17ac640 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558cc9f0 0x557555cc0df0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x557555cb3ef0 tx=0x7f92e8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87de55e70c3c60af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.901 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92d6ffd640 1 -- 172.21.15.49:0/1841082191 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8005520 con 0x5575558cc9f0 2024-09-21T06:47:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92d6ffd640 1 -- 172.21.15.49:0/1841082191 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92e8005850 con 0x5575558cc9f0 2024-09-21T06:47:48.902 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92d6ffd640 1 -- 172.21.15.49:0/1841082191 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e80276d0 con 0x5575558cc9f0 2024-09-21T06:47:48.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92f9f84740 1 -- 172.21.15.49:0/1841082191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558cc9f0 msgr2=0x557555cc0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92f9f84740 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558cc9f0 0x557555cc0df0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x557555cb3ef0 tx=0x7f92e8005f90 comp rx=0 tx=0).stop 2024-09-21T06:47:48.905 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92f9f84740 1 -- 172.21.15.49:0/1841082191 shutdown_connections 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92f9f84740 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558ed390 0x557555cbdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92f9f84740 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558e51b0 0x557555cccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92f9f84740 1 --2- 172.21.15.49:0/1841082191 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558cc9f0 0x557555cc0df0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92f9f84740 1 -- 172.21.15.49:0/1841082191 >> 172.21.15.49:0/1841082191 conn(0x557555902460 msgr2=0x557555cc06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.899+0000 7f92f9f84740 1 -- 172.21.15.49:0/1841082191 shutdown_connections 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 1 -- 172.21.15.49:0/1841082191 wait complete. 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 1 -- start start 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 1 Processor -- start 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558cc9f0 0x557555cc4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558e51b0 0x557555cc52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 0x557555cc5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec1adef0 con 0x5575558e51b0 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec1af360 con 0x5575558ed390 2024-09-21T06:47:48.906 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f92ec1ae5c0 con 0x5575558cc9f0 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.900+0000 7f92f9f84740 10 client.0 _ll_register_callbacks cb 0x7f92e40a96c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f0fab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558e51b0 0x557555cc52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f0fab640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558e51b0 0x557555cc52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36130/0 (socket says 172.21.15.49:36130) 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f0fab640 1 -- 172.21.15.49:0/3831138468 learned_addr learned my addr 172.21.15.49:0/3831138468 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f1fad640 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 0x557555cc5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f17ac640 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558cc9f0 0x557555cc4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f0fab640 1 -- 172.21.15.49:0/3831138468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558cc9f0 msgr2=0x557555cc4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f0fab640 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558cc9f0 0x557555cc4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f0fab640 1 -- 172.21.15.49:0/3831138468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 msgr2=0x557555cc5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f0fab640 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 0x557555cc5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f0fab640 1 -- 172.21.15.49:0/3831138468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557555d3c7a0 con 0x5575558e51b0 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f0fab640 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558e51b0 0x557555cc52f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f92dc033000 tx=0x7f92dc02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efbb8407c0c7c8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:48.907 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92d4ff9640 1 -- 172.21.15.49:0/3831138468 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92dc035040 con 0x5575558e51b0 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92d4ff9640 1 -- 172.21.15.49:0/3831138468 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f92dc003c00 con 0x5575558e51b0 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.901+0000 7f92f9f84740 1 -- 172.21.15.49:0/3831138468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92e8005850 con 0x5575558e51b0 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92d4ff9640 1 -- 172.21.15.49:0/3831138468 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f92dc003e00 con 0x5575558e51b0 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92f9f84740 10 client.18219 fetch_fsmap learned FSMap version 27 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92f9f84740 1 -- 172.21.15.49:0/3831138468 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557555d3d9d0 con 0x5575558e51b0 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92d4ff9640 1 -- 172.21.15.49:0/3831138468 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92e8005850 con 0x5575558e51b0 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92d4ff9640 1 -- 172.21.15.49:0/3831138468 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 27) ==== 8346+0+0 (secure 0 0 0) 0x7f92dc052070 con 0x5575558e51b0 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92f9f84740 10 client.18219 fetch_fsmap finished waiting for FSMap version 27 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92f9f84740 10 client.18219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92f9f84740 20 client.18219 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92f9f84740 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55755590e070 0x557555d401f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92f9f84740 4 client.18219 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92f9f84740 1 -- 172.21.15.49:0/3831138468 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557555c29850 con 0x55755590e070 2024-09-21T06:47:48.908 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.902+0000 7f92f17ac640 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55755590e070 0x557555d401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f17ac640 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55755590e070 0x557555d401f0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c21bb9a04c03dfd8 server_cookie=1bec1d63654ac78e in_seq=0 out_seq=0 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92d4ff9640 10 client.18219 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92d4ff9640 1 -- 172.21.15.49:0/3831138468 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x557555c29850 con 0x55755590e070 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92d4ff9640 10 client.18219 handle_command_reply: tid=0 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f9f84740 1 client.18219 shutdown 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f9f84740 1 -- 172.21.15.49:0/3831138468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558e51b0 msgr2=0x557555cc52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f9f84740 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558e51b0 0x557555cc52f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f92dc033000 tx=0x7f92dc02a410 comp rx=0 tx=0).stop 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f9f84740 1 -- 172.21.15.49:0/3831138468 shutdown_connections 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f9f84740 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x55755590e070 0x557555d401f0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f9f84740 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5575558ed390 0x557555cc5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f9f84740 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5575558e51b0 0x557555cc52f0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f9f84740 1 --2- 172.21.15.49:0/3831138468 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5575558cc9f0 0x557555cc4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92f9f84740 1 -- 172.21.15.49:0/3831138468 >> 172.21.15.49:0/3831138468 conn(0x557555902460 msgr2=0x557555cc1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.903+0000 7f92d4ff9640 0 client.18219 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:48.909 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f9f84740 1 -- 172.21.15.49:0/3831138468 shutdown_connections 2024-09-21T06:47:48.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f9f84740 1 -- 172.21.15.49:0/3831138468 wait complete. 2024-09-21T06:47:48.910 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f9f84740 20 client.18219 trim_cache size 0 max 16384 2024-09-21T06:47:48.910 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:47:48.910 INFO:teuthology.orchestra.run.smithi049.stdout: "status": "no active scrubs running", 2024-09-21T06:47:48.910 INFO:teuthology.orchestra.run.smithi049.stdout: "scrubs": {}, 2024-09-21T06:47:48.910 INFO:teuthology.orchestra.run.smithi049.stdout: "scrub_stats": { 2024-09-21T06:47:48.910 INFO:teuthology.orchestra.run.smithi049.stdout: "063e59ef-7948-4f30-829f-32599b2043ac": { 2024-09-21T06:47:48.910 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:47:15.764561+0000", 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "f56024cf-a906-4d93-89e9-d1f90cea5480": { 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:52.601552+0000", 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.911 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "10867b94-0c7e-4ad0-923a-2c9251148d7b": { 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:18.261849+0000", 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "d7811de5-abf3-4713-aa65-d43ca6b1e162": { 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:11.157587+0000", 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.912 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "9055b0bf-8dc8-4645-bf7b-fc2d221f9228": { 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:36:35.722865+0000", 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "d4c33e7c-f05d-45e6-99c8-04167817884e": { 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:42:22.705586+0000", 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.913 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "4bd84fa8-1338-4afa-98e9-00f348e94a4e": { 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:39:34.920591+0000", 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "cf0ebfe6-e72a-4c8c-995d-0b5edba7a4ff": { 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:17.211584+0000", 2024-09-21T06:47:48.914 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "24aa6e4a-e86b-4660-a729-05218ad60cca": { 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:37:29.368584+0000", 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.915 INFO:teuthology.orchestra.run.smithi049.stdout: "762c431b-f378-45a0-941b-80d0b2dfc4da": { 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:40:59.500577+0000", 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "20658a62-3597-419e-8e53-a67d667c8a2e": { 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:44:28.735561+0000", 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.916 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "33526aec-feb7-4620-9880-2a7dd5991954": { 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:46:34.268554+0000", 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "877238a7-c1a9-416c-8f9e-d40ecea3c71a": { 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:45:10.755554+0000", 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.917 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "e4c9e1ad-cb72-4032-a43d-11f4109274df": { 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:41:41.198580+0000", 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "1d017204-bcd9-4d51-9dec-2c0beb771c0f": { 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:38:52.852593+0000", 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.918 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "57389ff9-c679-4ffc-8f1d-b3dd121a6ba2": { 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:04.779575+0000", 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "5909134b-6be3-4b78-b014-cd698f8e6b28": { 2024-09-21T06:47:48.919 INFO:teuthology.orchestra.run.smithi049.stdout: "start_time": "2024-09-21T06:43:46.653570+0000", 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stdout: "path": "/", 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_started": 0, 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_passed": 0, 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_failed": 0, 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stdout: "uninline_skipped": 0 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 -- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92d80b6680 msgr2=0x7f92d80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92d80b6680 0x7f92d80b8b90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f92dc032fd0 tx=0x7f92dc031400 comp rx=0 tx=0).stop 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 -- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec10de30 msgr2=0x7f92ec19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec10de30 0x7f92ec19fcc0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f92e400eaa0 tx=0x7f92e400ef60 comp rx=0 tx=0).stop 2024-09-21T06:47:48.920 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 -- 172.21.15.49:0/2879600811 shutdown_connections 2024-09-21T06:47:48.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f92d80b6680 0x7f92d80b8b90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f92ec10de30 0x7f92ec19fcc0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f92ec1052b0 0x7f92ec19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 --2- 172.21.15.49:0/2879600811 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f92ec104880 0x7f92ec19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:48.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 -- 172.21.15.49:0/2879600811 >> 172.21.15.49:0/2879600811 conn(0x7f92ec079730 msgr2=0x7f92ec1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:48.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 -- 172.21.15.49:0/2879600811 shutdown_connections 2024-09-21T06:47:48.921 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:48.904+0000 7f92f3a10640 1 -- 172.21.15.49:0/2879600811 wait complete. 2024-09-21T06:47:49.746 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:47:49.746 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:47:49.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:49 smithi049 ceph-mon[31177]: pgmap v664: 97 pgs: 97 active+clean; 13 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-21T06:47:49.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:49 smithi049 ceph-mon[31177]: from='client.18195 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:47:49.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:49 smithi049 ceph-mon[31177]: from='client.18201 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:47:50.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:49 smithi098 ceph-mon[34704]: pgmap v664: 97 pgs: 97 active+clean; 13 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-21T06:47:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:49 smithi098 ceph-mon[34704]: from='client.18195 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:47:50.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:49 smithi098 ceph-mon[34704]: from='client.18201 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:47:50.051 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:49 smithi079 ceph-mon[34346]: pgmap v664: 97 pgs: 97 active+clean; 13 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 14 op/s 2024-09-21T06:47:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:49 smithi079 ceph-mon[34346]: from='client.18195 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:47:50.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:49 smithi079 ceph-mon[34346]: from='client.18201 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:47:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.512+0000 7f48e6996640 1 -- 172.21.15.49:0/1888824653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 msgr2=0x7f48e01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:50.515 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.512+0000 7f48e6996640 1 --2- 172.21.15.49:0/1888824653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 0x7f48e01098b0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009900 tx=0x7f48c802a410 comp rx=0 tx=0).stop 2024-09-21T06:47:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.512+0000 7f48e6996640 1 -- 172.21.15.49:0/1888824653 shutdown_connections 2024-09-21T06:47:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.512+0000 7f48e6996640 1 --2- 172.21.15.49:0/1888824653 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48e0109df0 0x7f48e0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.512+0000 7f48e6996640 1 --2- 172.21.15.49:0/1888824653 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 0x7f48e01098b0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.512+0000 7f48e6996640 1 --2- 172.21.15.49:0/1888824653 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48e0103b60 0x7f48e0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.512+0000 7f48e6996640 1 -- 172.21.15.49:0/1888824653 >> 172.21.15.49:0/1888824653 conn(0x7f48e007b850 msgr2=0x7f48e007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.512+0000 7f48e6996640 1 -- 172.21.15.49:0/1888824653 shutdown_connections 2024-09-21T06:47:50.516 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.512+0000 7f48e6996640 1 -- 172.21.15.49:0/1888824653 wait complete. 2024-09-21T06:47:50.518 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.513+0000 7f48e6996640 1 Processor -- start 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.513+0000 7f48e6996640 1 -- start start 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48e6996640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48e0103b60 0x7f48e019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48e6996640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 0x7f48e019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48e6996640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48e0109df0 0x7f48e019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48e6996640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f48e0113ab0 con 0x7f48e01094a0 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48e6996640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f48e0113930 con 0x7f48e0103b60 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48e6996640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f48e0113c30 con 0x7f48e0109df0 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48df7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 0x7f48e019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48df7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 0x7f48e019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36140/0 (socket says 172.21.15.49:36140) 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48df7fe640 1 -- 172.21.15.49:0/4126416302 learned_addr learned my addr 172.21.15.49:0/4126416302 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:50.519 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48dffff640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48e0103b60 0x7f48e019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48e4f33640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48e0109df0 0x7f48e019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48df7fe640 1 -- 172.21.15.49:0/4126416302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48e0109df0 msgr2=0x7f48e019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48df7fe640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48e0109df0 0x7f48e019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48df7fe640 1 -- 172.21.15.49:0/4126416302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48e0103b60 msgr2=0x7f48e019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48df7fe640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48e0103b60 0x7f48e019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.514+0000 7f48df7fe640 1 -- 172.21.15.49:0/4126416302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48e01a0370 con 0x7f48e01094a0 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.515+0000 7f48df7fe640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 0x7f48e019aa60 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f48c802a930 tx=0x7f48c8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.515+0000 7f48dd7fa640 1 -- 172.21.15.49:0/4126416302 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c803f030 con 0x7f48e01094a0 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.515+0000 7f48dd7fa640 1 -- 172.21.15.49:0/4126416302 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48c8003aa0 con 0x7f48e01094a0 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.515+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48e01a0600 con 0x7f48e01094a0 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.515+0000 7f48dd7fa640 1 -- 172.21.15.49:0/4126416302 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8035070 con 0x7f48e01094a0 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.515+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48e01a0ae0 con 0x7f48e01094a0 2024-09-21T06:47:50.520 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.516+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48e0103f70 con 0x7f48e01094a0 2024-09-21T06:47:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.517+0000 7f48dd7fa640 1 -- 172.21.15.49:0/4126416302 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f48c8042030 con 0x7f48e01094a0 2024-09-21T06:47:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.518+0000 7f48dd7fa640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48cc0b66b0 0x7f48cc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:50.521 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.518+0000 7f48dffff640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48cc0b66b0 0x7f48cc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.518+0000 7f48dd7fa640 1 -- 172.21.15.49:0/4126416302 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f48c8108270 con 0x7f48e01094a0 2024-09-21T06:47:50.522 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.519+0000 7f48dffff640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48cc0b66b0 0x7f48cc0b8bc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f48d0005fd0 tx=0x7f48d000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:50.524 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.521+0000 7f48dd7fa640 1 -- 172.21.15.49:0/4126416302 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48c80ce770 con 0x7f48e01094a0 2024-09-21T06:47:50.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.749+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48e019b5f0 con 0x7f48e01094a0 2024-09-21T06:47:50.752 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.750+0000 7f48dd7fa640 1 -- 172.21.15.49:0/4126416302 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11893 (secure 0 0 0) 0x7f48c80d2b50 con 0x7f48e01094a0 2024-09-21T06:47:50.753 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:47:50.753 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":27,"btime":"2024-09-21T06:39:53:880602+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":27,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:39:53.555539+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24686,24685,24676]},"id":1}]} 2024-09-21T06:47:50.753 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 27 2024-09-21T06:47:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.752+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48cc0b66b0 msgr2=0x7f48cc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.752+0000 7f48e6996640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48cc0b66b0 0x7f48cc0b8bc0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f48d0005fd0 tx=0x7f48d000b390 comp rx=0 tx=0).stop 2024-09-21T06:47:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.752+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 msgr2=0x7f48e019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.752+0000 7f48e6996640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 0x7f48e019aa60 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f48c802a930 tx=0x7f48c8004270 comp rx=0 tx=0).stop 2024-09-21T06:47:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.753+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 shutdown_connections 2024-09-21T06:47:50.755 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.753+0000 7f48e6996640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f48cc0b66b0 0x7f48cc0b8bc0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:50.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.753+0000 7f48e6996640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f48e0109df0 0x7f48e019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:50.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.753+0000 7f48e6996640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f48e01094a0 0x7f48e019aa60 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:50.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.753+0000 7f48e6996640 1 --2- 172.21.15.49:0/4126416302 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f48e0103b60 0x7f48e019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:50.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.753+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 >> 172.21.15.49:0/4126416302 conn(0x7f48e007b850 msgr2=0x7f48e0105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:50.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.753+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 shutdown_connections 2024-09-21T06:47:50.756 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:50.753+0000 7f48e6996640 1 -- 172.21.15.49:0/4126416302 wait complete. 2024-09-21T06:47:51.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:50 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4126416302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:47:51.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:50 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4126416302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:47:51.197 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:50 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4126416302' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:47:51.398 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:47:51.657 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:52.028 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:51 smithi049 ceph-mon[31177]: pgmap v665: 97 pgs: 97 active+clean; 13 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-21T06:47:52.029 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:51 smithi049 ceph-mon[31177]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:47:52.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:51 smithi098 ceph-mon[34704]: pgmap v665: 97 pgs: 97 active+clean; 13 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-21T06:47:52.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:51 smithi098 ceph-mon[34704]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:47:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:51 smithi079 ceph-mon[34346]: pgmap v665: 97 pgs: 97 active+clean; 13 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 KiB/s wr, 11 op/s 2024-09-21T06:47:52.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:51 smithi079 ceph-mon[34346]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:47:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.116+0000 7fe58c0dc640 1 -- 172.21.15.49:0/35381183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584108cf0 msgr2=0x7fe58410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.116+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/35381183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584108cf0 0x7fe58410f520 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009ca0 tx=0x7fe57c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.116+0000 7fe58c0dc640 1 -- 172.21.15.49:0/35381183 shutdown_connections 2024-09-21T06:47:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.116+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/35381183 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584108cf0 0x7fe58410f520 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.130 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.116+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/35381183 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe5841083a0 0x7fe5841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.116+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/35381183 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe584102a60 0x7fe584102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.116+0000 7fe58c0dc640 1 -- 172.21.15.49:0/35381183 >> 172.21.15.49:0/35381183 conn(0x7fe584079730 msgr2=0x7fe584079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.116+0000 7fe58c0dc640 1 -- 172.21.15.49:0/35381183 shutdown_connections 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.116+0000 7fe58c0dc640 1 -- 172.21.15.49:0/35381183 wait complete. 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe58c0dc640 1 Processor -- start 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe58c0dc640 1 -- start start 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe58c0dc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584102a60 0x7fe58419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe58c0dc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5841083a0 0x7fe58419abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe58c0dc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe584108cf0 0x7fe58419fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe58c0dc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe584113b40 con 0x7fe584102a60 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe58c0dc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841139c0 con 0x7fe584108cf0 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe58c0dc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe584113cc0 con 0x7fe5841083a0 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe589e78640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584102a60 0x7fe58419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe589e78640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584102a60 0x7fe58419a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36156/0 (socket says 172.21.15.49:36156) 2024-09-21T06:47:52.131 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.117+0000 7fe589e78640 1 -- 172.21.15.49:0/3536313937 learned_addr learned my addr 172.21.15.49:0/3536313937 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe58a679640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe584108cf0 0x7fe58419fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe589677640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5841083a0 0x7fe58419abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe589e78640 1 -- 172.21.15.49:0/3536313937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5841083a0 msgr2=0x7fe58419abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe589e78640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5841083a0 0x7fe58419abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe589e78640 1 -- 172.21.15.49:0/3536313937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe584108cf0 msgr2=0x7fe58419fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe589e78640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe584108cf0 0x7fe58419fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe589e78640 1 -- 172.21.15.49:0/3536313937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5841a05c0 con 0x7fe584102a60 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe58a679640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe584108cf0 0x7fe58419fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe589677640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5841083a0 0x7fe58419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe589e78640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584102a60 0x7fe58419a650 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe58000b4a0 tx=0x7fe58000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe57affd640 1 -- 172.21.15.49:0/3536313937 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580014070 con 0x7fe584102a60 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe58c0dc640 1 -- 172.21.15.49:0/3536313937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5841a08b0 con 0x7fe584102a60 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe57affd640 1 -- 172.21.15.49:0/3536313937 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe580010ac0 con 0x7fe584102a60 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe57affd640 1 -- 172.21.15.49:0/3536313937 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580017c30 con 0x7fe584102a60 2024-09-21T06:47:52.132 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.118+0000 7fe58c0dc640 1 -- 172.21.15.49:0/3536313937 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5841a7010 con 0x7fe584102a60 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe592650740 1 Processor -- start 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe592650740 1 -- start start 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe57affd640 1 -- 172.21.15.49:0/3536313937 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fe580017070 con 0x7fe584102a60 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe592650740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c4b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe592650740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c4bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe592650740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 0x557dd8c4c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe592650740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557dd8bc1ea0 con 0x557dd88a4070 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe592650740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557dd8bb12d0 con 0x557dd887b1b0 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe592650740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557dd8bb50e0 con 0x557dd8883390 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe58a679640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c4b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe58a679640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c4b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36168/0 (socket says 172.21.15.49:36168) 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.121+0000 7fe58a679640 1 -- 172.21.15.49:0/1823163393 learned_addr learned my addr 172.21.15.49:0/1823163393 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe589677640 1 --2- 172.21.15.49:0/1823163393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 0x557dd8c4c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.133 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe589e78640 1 --2- 172.21.15.49:0/1823163393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c4bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe58a679640 1 -- 172.21.15.49:0/1823163393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 msgr2=0x557dd8c4c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe58a679640 1 --2- 172.21.15.49:0/1823163393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 0x557dd8c4c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe58a679640 1 -- 172.21.15.49:0/1823163393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 msgr2=0x557dd8c4bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe58a679640 1 --2- 172.21.15.49:0/1823163393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c4bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe58a679640 1 -- 172.21.15.49:0/1823163393 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dd890f650 con 0x557dd88a4070 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe58a679640 1 --2- 172.21.15.49:0/1823163393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c4b6a0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fe57c02f500 tx=0x7fe57c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b7a8e14a844cd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe56ffff640 1 -- 172.21.15.49:0/1823163393 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c031450 con 0x557dd88a4070 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe56ffff640 1 -- 172.21.15.49:0/1823163393 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c036070 con 0x557dd88a4070 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe56ffff640 1 -- 172.21.15.49:0/1823163393 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0043c0 con 0x557dd88a4070 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.122+0000 7fe57affd640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe5700b6680 0x7fe5700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe589e78640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe5700b6680 0x7fe5700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe57affd640 1 -- 172.21.15.49:0/3536313937 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fe5800e6ae0 con 0x7fe584102a60 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe592650740 1 -- 172.21.15.49:0/1823163393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 msgr2=0x557dd8c4b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:52.134 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe592650740 1 --2- 172.21.15.49:0/1823163393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c4b6a0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fe57c02f500 tx=0x7fe57c009a20 comp rx=0 tx=0).stop 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe589e78640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe5700b6680 0x7fe5700b8b90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe5800e4290 tx=0x7fe58000bf90 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe592650740 1 -- 172.21.15.49:0/1823163393 shutdown_connections 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe592650740 1 --2- 172.21.15.49:0/1823163393 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 0x557dd8c4c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe592650740 1 --2- 172.21.15.49:0/1823163393 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c4bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe592650740 1 --2- 172.21.15.49:0/1823163393 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c4b6a0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe592650740 1 -- 172.21.15.49:0/1823163393 >> 172.21.15.49:0/1823163393 conn(0x557dd8898460 msgr2=0x557dd8c49590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe592650740 1 -- 172.21.15.49:0/1823163393 shutdown_connections 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.123+0000 7fe592650740 1 -- 172.21.15.49:0/1823163393 wait complete. 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe592650740 1 -- start start 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe592650740 1 Processor -- start 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe592650740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c56d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe592650740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 0x557dd8c572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe592650740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c63110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe592650740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x557dd8a12700 con 0x557dd88a4070 2024-09-21T06:47:52.135 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe592650740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x557dd8b4c160 con 0x557dd887b1b0 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe592650740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x557dd8c59e20 con 0x557dd8883390 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe592650740 10 client.0 _ll_register_callbacks cb 0x557dd8b659e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.124+0000 7fe58a679640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c63110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe58a679640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c63110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36182/0 (socket says 172.21.15.49:36182) 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe58a679640 1 -- 172.21.15.49:0/3158399437 learned_addr learned my addr 172.21.15.49:0/3158399437 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe58a679640 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c56d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe589677640 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 0x557dd8c572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe58a679640 1 -- 172.21.15.49:0/3158399437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 msgr2=0x557dd8c572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe58a679640 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 0x557dd8c572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe58a679640 1 -- 172.21.15.49:0/3158399437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 msgr2=0x557dd8c56d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe58a679640 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c56d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe58a679640 1 -- 172.21.15.49:0/3158399437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dd8b79c90 con 0x557dd88a4070 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe589677640 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 0x557dd8c572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe58a679640 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c63110 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009960 tx=0x7fe57c03d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1147545e85b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:52.136 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe56d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe56d7fa640 1 -- 172.21.15.49:0/3158399437 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c057060 con 0x557dd88a4070 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe56d7fa640 1 -- 172.21.15.49:0/3158399437 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fe57c031650 con 0x557dd88a4070 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.125+0000 7fe592650740 1 -- 172.21.15.49:0/3158399437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe57c036070 con 0x557dd88a4070 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe56d7fa640 1 -- 172.21.15.49:0/3158399437 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe57c003c80 con 0x557dd88a4070 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe592650740 10 client.18237 fetch_fsmap learned FSMap version 28 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe592650740 1 -- 172.21.15.49:0/3158399437 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557dd8c65af0 con 0x557dd88a4070 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe56d7fa640 1 -- 172.21.15.49:0/3158399437 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c036070 con 0x557dd88a4070 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe56d7fa640 1 -- 172.21.15.49:0/3158399437 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fe57c04f070 con 0x557dd88a4070 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe592650740 10 client.18237 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe592650740 10 client.18237 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe592650740 20 client.18237 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe592650740 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x557dd88629f0 0x557dd8c68e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe592650740 4 client.18237 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:52.137 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe592650740 1 -- 172.21.15.49:0/3158399437 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dd8bc3df0 con 0x557dd88629f0 2024-09-21T06:47:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.126+0000 7fe589677640 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x557dd88629f0 0x557dd8c68e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.127+0000 7fe56d7fa640 10 client.18237 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:47:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.127+0000 7fe589677640 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x557dd88629f0 0x557dd8c68e50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b8dd4dd02eccfa96 server_cookie=cf7b9db33b71940e in_seq=0 out_seq=0 2024-09-21T06:47:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe56d7fa640 1 -- 172.21.15.49:0/3158399437 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557dd8bc3df0 con 0x557dd88629f0 2024-09-21T06:47:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe56d7fa640 10 client.18237 handle_command_reply: tid=0 2024-09-21T06:47:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 client.18237 shutdown 2024-09-21T06:47:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 -- 172.21.15.49:0/3158399437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 msgr2=0x557dd8c63110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:52.138 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c63110 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009960 tx=0x7fe57c03d040 comp rx=0 tx=0).stop 2024-09-21T06:47:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 -- 172.21.15.49:0/3158399437 shutdown_connections 2024-09-21T06:47:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x557dd88629f0 0x557dd8c68e50 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd88a4070 0x557dd8c63110 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd8883390 0x557dd8c572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 --2- 172.21.15.49:0/3158399437 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c56d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe56d7fa640 0 client.18237 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:47:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 -- 172.21.15.49:0/3158399437 >> 172.21.15.49:0/3158399437 conn(0x557dd8898460 msgr2=0x557dd8c4e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 -- 172.21.15.49:0/3158399437 shutdown_connections 2024-09-21T06:47:52.139 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 1 -- 172.21.15.49:0/3158399437 wait complete. 2024-09-21T06:47:52.140 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.128+0000 7fe592650740 20 client.18237 trim_cache size 0 max 16384 2024-09-21T06:47:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.141+0000 7fe592650740 1 Processor -- start 2024-09-21T06:47:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.141+0000 7fe592650740 1 -- start start 2024-09-21T06:47:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe592650740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c4d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe592650740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd8883390 0x557dd8c58c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe592650740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 0x557dd8c63080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe592650740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841b21b0 con 0x557dd8883390 2024-09-21T06:47:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe592650740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841afa50 con 0x557dd887b1b0 2024-09-21T06:47:52.145 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe592650740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841ad8c0 con 0x557dd88a4070 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe589677640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd8883390 0x557dd8c58c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe589677640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd8883390 0x557dd8c58c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36198/0 (socket says 172.21.15.49:36198) 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe589677640 1 -- 172.21.15.49:0/1366920679 learned_addr learned my addr 172.21.15.49:0/1366920679 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe58a679640 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c4d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe589677640 1 -- 172.21.15.49:0/1366920679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 msgr2=0x557dd8c63080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe58a679640 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 0x557dd8c63080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe589677640 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 0x557dd8c63080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe589677640 1 -- 172.21.15.49:0/1366920679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 msgr2=0x557dd8c4d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe589677640 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c4d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe589677640 1 -- 172.21.15.49:0/1366920679 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dd8c55280 con 0x557dd8883390 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe58a679640 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c4d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.142+0000 7fe589677640 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd8883390 0x557dd8c58c60 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x557dd8bb1400 tx=0x7fe574008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa112611ef8983f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe56f7fe640 1 -- 172.21.15.49:0/1366920679 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574016d70 con 0x557dd8883390 2024-09-21T06:47:52.146 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe56f7fe640 1 -- 172.21.15.49:0/1366920679 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe574020030 con 0x557dd8883390 2024-09-21T06:47:52.147 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe56f7fe640 1 -- 172.21.15.49:0/1366920679 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe574014610 con 0x557dd8883390 2024-09-21T06:47:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe592650740 1 -- 172.21.15.49:0/1366920679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd8883390 msgr2=0x557dd8c58c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe592650740 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd8883390 0x557dd8c58c60 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x557dd8bb1400 tx=0x7fe574008040 comp rx=0 tx=0).stop 2024-09-21T06:47:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe592650740 1 -- 172.21.15.49:0/1366920679 shutdown_connections 2024-09-21T06:47:52.150 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe592650740 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 0x557dd8c63080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe592650740 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd8883390 0x557dd8c58c60 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe592650740 1 --2- 172.21.15.49:0/1366920679 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd887b1b0 0x557dd8c4d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.143+0000 7fe592650740 1 -- 172.21.15.49:0/1366920679 >> 172.21.15.49:0/1366920679 conn(0x557dd8898460 msgr2=0x557dd8c507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.144+0000 7fe592650740 1 -- 172.21.15.49:0/1366920679 shutdown_connections 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.144+0000 7fe592650740 1 -- 172.21.15.49:0/1366920679 wait complete. 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.144+0000 7fe592650740 1 -- start start 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.144+0000 7fe592650740 1 Processor -- start 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.144+0000 7fe592650740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd887b1b0 0x557dd8c69e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.144+0000 7fe592650740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd8883390 0x557dd8c6a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe592650740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 0x557dd8c6a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe592650740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841adf10 con 0x557dd887b1b0 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe592650740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841af380 con 0x557dd8883390 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe592650740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841ae5e0 con 0x557dd88a4070 2024-09-21T06:47:52.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe592650740 10 client.0 _ll_register_callbacks cb 0x7fe57400a150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd887b1b0 0x557dd8c69e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd887b1b0 0x557dd8c69e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36210/0 (socket says 172.21.15.49:36210) 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 -- 172.21.15.49:0/1630348214 learned_addr learned my addr 172.21.15.49:0/1630348214 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe589677640 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd8883390 0x557dd8c6a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 0x557dd8c6a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 -- 172.21.15.49:0/1630348214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 msgr2=0x557dd8c6a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 0x557dd8c6a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 -- 172.21.15.49:0/1630348214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd8883390 msgr2=0x557dd8c6a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd8883390 0x557dd8c6a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 -- 172.21.15.49:0/1630348214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dd8cd69e0 con 0x557dd887b1b0 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe58a679640 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd887b1b0 0x557dd8c69e50 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fe57c05c040 tx=0x7fe57c003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6ffc9b66a534c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe56d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe56d7fa640 1 -- 172.21.15.49:0/1630348214 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c057040 con 0x557dd887b1b0 2024-09-21T06:47:52.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe56d7fa640 1 -- 172.21.15.49:0/1630348214 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fe57c004b40 con 0x557dd887b1b0 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.145+0000 7fe592650740 1 -- 172.21.15.49:0/1630348214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe574020030 con 0x557dd887b1b0 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe56d7fa640 1 -- 172.21.15.49:0/1630348214 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe57c06b050 con 0x557dd887b1b0 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe592650740 10 client.18243 fetch_fsmap learned FSMap version 28 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe592650740 1 -- 172.21.15.49:0/1630348214 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557dd8cd7ba0 con 0x557dd887b1b0 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe56d7fa640 1 -- 172.21.15.49:0/1630348214 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe574020030 con 0x557dd887b1b0 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe56d7fa640 1 -- 172.21.15.49:0/1630348214 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7fe57c04f070 con 0x557dd887b1b0 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe592650740 10 client.18243 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe592650740 10 client.18243 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe592650740 20 client.18243 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe592650740 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x557dd8837da0 0x557dd8cda2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe592650740 4 client.18243 mds_command: new command op to 24676 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe592650740 1 -- 172.21.15.49:0/1630348214 --> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557dd8bbf8a0 con 0x557dd8837da0 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.146+0000 7fe589677640 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x557dd8837da0 0x557dd8cda2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe56d7fa640 10 client.18243 ms_handle_connect on v2:172.21.15.98:6836/883661759 2024-09-21T06:47:52.153 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe589677640 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x557dd8837da0 0x557dd8cda2e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bac2f339beea5aa server_cookie=90ec22c2ba0efa9 in_seq=0 out_seq=0 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe56d7fa640 1 -- 172.21.15.49:0/1630348214 <== mds.2 v2:172.21.15.98:6836/883661759 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557dd8bbf8a0 con 0x557dd8837da0 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe56d7fa640 10 client.18243 handle_command_reply: tid=0 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 client.18243 shutdown 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 -- 172.21.15.49:0/1630348214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd887b1b0 msgr2=0x557dd8c69e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd887b1b0 0x557dd8c69e50 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fe57c05c040 tx=0x7fe57c003f30 comp rx=0 tx=0).stop 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 -- 172.21.15.49:0/1630348214 shutdown_connections 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.98:6836/883661759,v1:172.21.15.98:6837/883661759] conn(0x557dd8837da0 0x557dd8cda2e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x557dd88a4070 0x557dd8c6a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x557dd8883390 0x557dd8c6a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 --2- 172.21.15.49:0/1630348214 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x557dd887b1b0 0x557dd8c69e50 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 -- 172.21.15.49:0/1630348214 >> 172.21.15.49:0/1630348214 conn(0x557dd8898460 msgr2=0x557dd8c589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe56d7fa640 0 client.18243 ms_handle_reset on v2:172.21.15.98:6836/883661759 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.147+0000 7fe592650740 1 -- 172.21.15.49:0/1630348214 shutdown_connections 2024-09-21T06:47:52.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe592650740 1 -- 172.21.15.49:0/1630348214 wait complete. 2024-09-21T06:47:52.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe592650740 20 client.18243 trim_cache size 0 max 16384 2024-09-21T06:47:52.155 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:47:52.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 -- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe5700b6680 msgr2=0x7fe5700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:52.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe5700b6680 0x7fe5700b8b90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe5800e4290 tx=0x7fe58000bf90 comp rx=0 tx=0).stop 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 -- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584102a60 msgr2=0x7fe58419a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584102a60 0x7fe58419a650 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe58000b4a0 tx=0x7fe58000b960 comp rx=0 tx=0).stop 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 -- 172.21.15.49:0/3536313937 shutdown_connections 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fe5700b6680 0x7fe5700b8b90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fe584108cf0 0x7fe58419fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fe5841083a0 0x7fe58419abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 --2- 172.21.15.49:0/3536313937 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fe584102a60 0x7fe58419a650 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 -- 172.21.15.49:0/3536313937 >> 172.21.15.49:0/3536313937 conn(0x7fe584079730 msgr2=0x7fe5841052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 -- 172.21.15.49:0/3536313937 shutdown_connections 2024-09-21T06:47:52.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:52.148+0000 7fe58c0dc640 1 -- 172.21.15.49:0/3536313937 wait complete. 2024-09-21T06:47:52.864 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:47:53.122 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:53.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.554+0000 7f4259ba1640 1 -- 172.21.15.49:0/4114411061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425410dc30 msgr2=0x7f4254110120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:53.557 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.554+0000 7f4259ba1640 1 --2- 172.21.15.49:0/4114411061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425410dc30 0x7f4254110120 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f424c009ca0 tx=0x7f424c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.554+0000 7f4259ba1640 1 -- 172.21.15.49:0/4114411061 shutdown_connections 2024-09-21T06:47:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.554+0000 7f4259ba1640 1 --2- 172.21.15.49:0/4114411061 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f425410dc30 0x7f4254110120 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.554+0000 7f4259ba1640 1 --2- 172.21.15.49:0/4114411061 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4254105120 0x7f425410d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.554+0000 7f4259ba1640 1 --2- 172.21.15.49:0/4114411061 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f42541047d0 0x7f4254104be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.554+0000 7f4259ba1640 1 -- 172.21.15.49:0/4114411061 >> 172.21.15.49:0/4114411061 conn(0x7f42540fe2d0 msgr2=0x7f4254100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.554+0000 7f4259ba1640 1 -- 172.21.15.49:0/4114411061 shutdown_connections 2024-09-21T06:47:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.554+0000 7f4259ba1640 1 -- 172.21.15.49:0/4114411061 wait complete. 2024-09-21T06:47:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4259ba1640 1 Processor -- start 2024-09-21T06:47:53.558 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4259ba1640 1 -- start start 2024-09-21T06:47:53.559 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4259ba1640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541047d0 0x7f425419a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4259ba1640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4254105120 0x7f425419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4259ba1640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425410dc30 0x7f425419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4259ba1640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f4254113890 con 0x7f42541047d0 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4259ba1640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f4254113710 con 0x7f425410dc30 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4259ba1640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f4254113a10 con 0x7f4254105120 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4258b9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541047d0 0x7f425419a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4258b9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541047d0 0x7f425419a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36238/0 (socket says 172.21.15.49:36238) 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.555+0000 7f4258b9f640 1 -- 172.21.15.49:0/167621762 learned_addr learned my addr 172.21.15.49:0/167621762 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4253fff640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4254105120 0x7f425419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f42593a0640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425410dc30 0x7f425419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4258b9f640 1 -- 172.21.15.49:0/167621762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4254105120 msgr2=0x7f425419a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4258b9f640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4254105120 0x7f425419a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.560 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4258b9f640 1 -- 172.21.15.49:0/167621762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425410dc30 msgr2=0x7f425419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4258b9f640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425410dc30 0x7f425419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4258b9f640 1 -- 172.21.15.49:0/167621762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42541a00d0 con 0x7f42541047d0 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f42593a0640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425410dc30 0x7f425419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4253fff640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4254105120 0x7f425419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4258b9f640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541047d0 0x7f425419a220 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f423c00c920 tx=0x7f423c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4251ffb640 1 -- 172.21.15.49:0/167621762 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c007c70 con 0x7f42541047d0 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4251ffb640 1 -- 172.21.15.49:0/167621762 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f423c007e10 con 0x7f42541047d0 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4259ba1640 1 -- 172.21.15.49:0/167621762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42541a03c0 con 0x7f42541047d0 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4251ffb640 1 -- 172.21.15.49:0/167621762 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c018820 con 0x7f42541047d0 2024-09-21T06:47:53.561 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.556+0000 7f4259ba1640 1 -- 172.21.15.49:0/167621762 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42541a6be0 con 0x7f42541047d0 2024-09-21T06:47:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4251ffb640 1 -- 172.21.15.49:0/167621762 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f423c00f450 con 0x7f42541047d0 2024-09-21T06:47:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4261377740 1 Processor -- start 2024-09-21T06:47:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4261377740 1 -- start start 2024-09-21T06:47:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4261377740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a6a070 0x559200e11460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4261377740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a411b0 0x559200e119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4261377740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e11ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.562 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4261377740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559200d87ea0 con 0x559200a49390 2024-09-21T06:47:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4261377740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559200d772d0 con 0x559200a411b0 2024-09-21T06:47:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4261377740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559200d7b0e0 con 0x559200a6a070 2024-09-21T06:47:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.559+0000 7f4253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e11ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e11ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36254/0 (socket says 172.21.15.49:36254) 2024-09-21T06:47:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4253fff640 1 -- 172.21.15.49:0/3225812867 learned_addr learned my addr 172.21.15.49:0/3225812867 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f42593a0640 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a6a070 0x559200e11460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.563 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4258b9f640 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a411b0 0x559200e119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4253fff640 1 -- 172.21.15.49:0/3225812867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a6a070 msgr2=0x559200e11460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:53.565 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4253fff640 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a6a070 0x559200e11460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4251ffb640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42400b66b0 0x7f42400b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4253fff640 1 -- 172.21.15.49:0/3225812867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a411b0 msgr2=0x559200e119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4253fff640 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a411b0 0x559200e119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4253fff640 1 -- 172.21.15.49:0/3225812867 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559200ad5650 con 0x559200a49390 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4258b9f640 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a411b0 0x559200e119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f42593a0640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42400b66b0 0x7f42400b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4253fff640 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e11ee0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4244005fd0 tx=0x7f424400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c695e2929a47d209 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f4251ffb640 1 -- 172.21.15.49:0/167621762 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f423c0e7960 con 0x7f42541047d0 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f424affd640 1 -- 172.21.15.49:0/3225812867 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244016070 con 0x559200a49390 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f424affd640 1 -- 172.21.15.49:0/3225812867 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42440054d0 con 0x559200a49390 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.560+0000 7f424affd640 1 -- 172.21.15.49:0/3225812867 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244011470 con 0x559200a49390 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f4261377740 1 -- 172.21.15.49:0/3225812867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 msgr2=0x559200e11ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:53.566 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f4261377740 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e11ee0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f4244005fd0 tx=0x7f424400e6c0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f42593a0640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42400b66b0 0x7f42400b8bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f424c02f500 tx=0x7f424c005d80 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f4261377740 1 -- 172.21.15.49:0/3225812867 shutdown_connections 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f4261377740 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e11ee0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f4261377740 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a411b0 0x559200e119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f4261377740 1 --2- 172.21.15.49:0/3225812867 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a6a070 0x559200e11460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f4261377740 1 -- 172.21.15.49:0/3225812867 >> 172.21.15.49:0/3225812867 conn(0x559200a5e460 msgr2=0x559200e0f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f4261377740 1 -- 172.21.15.49:0/3225812867 shutdown_connections 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.561+0000 7f4261377740 1 -- 172.21.15.49:0/3225812867 wait complete. 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.562+0000 7f4261377740 1 -- start start 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.562+0000 7f4261377740 1 Processor -- start 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.562+0000 7f4261377740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 0x559200e1ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.562+0000 7f4261377740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e1cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.567 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.562+0000 7f4261377740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a6a070 0x559200e1d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.562+0000 7f4261377740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x559200bd8700 con 0x559200a49390 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.562+0000 7f4261377740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x559200d12160 con 0x559200a6a070 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.562+0000 7f4261377740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x559200e1fc40 con 0x559200a411b0 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.562+0000 7f4261377740 10 client.0 _ll_register_callbacks cb 0x559200d2b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e1cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e1cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36258/0 (socket says 172.21.15.49:36258) 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4253fff640 1 -- 172.21.15.49:0/1429314209 learned_addr learned my addr 172.21.15.49:0/1429314209 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f42593a0640 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a6a070 0x559200e1d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4258b9f640 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 0x559200e1ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4253fff640 1 -- 172.21.15.49:0/1429314209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 msgr2=0x559200e1ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4253fff640 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 0x559200e1ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4253fff640 1 -- 172.21.15.49:0/1429314209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a6a070 msgr2=0x559200e1d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4253fff640 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a6a070 0x559200e1d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4253fff640 1 -- 172.21.15.49:0/1429314209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559200d3fc90 con 0x559200a49390 2024-09-21T06:47:53.568 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4253fff640 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e1cfa0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f4244004b70 tx=0x7f4244009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15167561168ee852 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:53.569 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4233fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:53.570 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4233fff640 1 -- 172.21.15.49:0/1429314209 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244016040 con 0x559200a49390 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4233fff640 1 -- 172.21.15.49:0/1429314209 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f4244004ee0 con 0x559200a49390 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.563+0000 7f4261377740 1 -- 172.21.15.49:0/1429314209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42440054d0 con 0x559200a49390 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4233fff640 1 -- 172.21.15.49:0/1429314209 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42440097e0 con 0x559200a49390 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4261377740 10 client.18255 fetch_fsmap learned FSMap version 28 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4261377740 1 -- 172.21.15.49:0/1429314209 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559200e2b890 con 0x559200a49390 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4233fff640 1 -- 172.21.15.49:0/1429314209 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42440054d0 con 0x559200a49390 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4233fff640 1 -- 172.21.15.49:0/1429314209 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f424400f040 con 0x559200a49390 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4261377740 10 client.18255 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4261377740 10 client.18255 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4261377740 20 client.18255 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4261377740 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559200a289f0 0x559200e2eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4261377740 4 client.18255 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.564+0000 7f4261377740 1 -- 172.21.15.49:0/1429314209 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559200d89df0 con 0x559200a289f0 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.565+0000 7f4258b9f640 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559200a289f0 0x559200e2eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.571 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.565+0000 7f4233fff640 10 client.18255 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.565+0000 7f4258b9f640 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559200a289f0 0x559200e2eca0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=163f9887f97007c9 server_cookie=fb97afd258d55e8e in_seq=0 out_seq=0 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4233fff640 1 -- 172.21.15.49:0/1429314209 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559200d89df0 con 0x559200a289f0 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4233fff640 10 client.18255 handle_command_reply: tid=0 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 client.18255 shutdown 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 -- 172.21.15.49:0/1429314209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 msgr2=0x559200e1cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e1cfa0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f4244004b70 tx=0x7f4244009ed0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 -- 172.21.15.49:0/1429314209 shutdown_connections 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559200a289f0 0x559200e2eca0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4233fff640 0 client.18255 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a6a070 0x559200e1d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a49390 0x559200e1cfa0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 --2- 172.21.15.49:0/1429314209 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 0x559200e1ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 -- 172.21.15.49:0/1429314209 >> 172.21.15.49:0/1429314209 conn(0x559200a5e460 msgr2=0x559200e145f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 -- 172.21.15.49:0/1429314209 shutdown_connections 2024-09-21T06:47:53.572 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 1 -- 172.21.15.49:0/1429314209 wait complete. 2024-09-21T06:47:53.573 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.566+0000 7f4261377740 20 client.18255 trim_cache size 0 max 16384 2024-09-21T06:47:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4261377740 1 Processor -- start 2024-09-21T06:47:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4261377740 1 -- start start 2024-09-21T06:47:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4261377740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a289f0 0x559200e12f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4261377740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a411b0 0x559200e1e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4261377740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 0x559200e285a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4261377740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42541b1e60 con 0x559200a411b0 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4261377740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42541af700 con 0x559200a49390 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4261377740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42541ad570 con 0x559200a289f0 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a411b0 0x559200e1e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4253fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a411b0 0x559200e1e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36274/0 (socket says 172.21.15.49:36274) 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4253fff640 1 -- 172.21.15.49:0/1832514025 learned_addr learned my addr 172.21.15.49:0/1832514025 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4258b9f640 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a289f0 0x559200e12f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4253fff640 1 -- 172.21.15.49:0/1832514025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a289f0 msgr2=0x559200e12f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f42593a0640 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 0x559200e285a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4253fff640 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a289f0 0x559200e12f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4253fff640 1 -- 172.21.15.49:0/1832514025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 msgr2=0x559200e285a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4253fff640 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 0x559200e285a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4253fff640 1 -- 172.21.15.49:0/1832514025 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559200e13750 con 0x559200a411b0 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4258b9f640 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a289f0 0x559200e12f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:53.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.580+0000 7f4253fff640 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a411b0 0x559200e1e940 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f424400ebc0 tx=0x7f4244004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c867c5eb884a16a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:53.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f424a7fc640 1 -- 172.21.15.49:0/1832514025 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244016040 con 0x559200a411b0 2024-09-21T06:47:53.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f424a7fc640 1 -- 172.21.15.49:0/1832514025 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42440035f0 con 0x559200a411b0 2024-09-21T06:47:53.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f424a7fc640 1 -- 172.21.15.49:0/1832514025 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244005240 con 0x559200a411b0 2024-09-21T06:47:53.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f4261377740 1 -- 172.21.15.49:0/1832514025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a411b0 msgr2=0x559200e1e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:53.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f4261377740 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a411b0 0x559200e1e940 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f424400ebc0 tx=0x7f4244004ac0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f4261377740 1 -- 172.21.15.49:0/1832514025 shutdown_connections 2024-09-21T06:47:53.588 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f4261377740 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 0x559200e285a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f4261377740 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a411b0 0x559200e1e940 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f4261377740 1 --2- 172.21.15.49:0/1832514025 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a289f0 0x559200e12f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.581+0000 7f4261377740 1 -- 172.21.15.49:0/1832514025 >> 172.21.15.49:0/1832514025 conn(0x559200a5e460 msgr2=0x559200e27e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 -- 172.21.15.49:0/1832514025 shutdown_connections 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 -- 172.21.15.49:0/1832514025 wait complete. 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 -- start start 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 Processor -- start 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a289f0 0x559200e2ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 0x559200e30440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 0x559200e309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f42541adbc0 con 0x559200a289f0 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f42541af030 con 0x559200a49390 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.582+0000 7f4261377740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f42541ae290 con 0x559200a411b0 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4261377740 10 client.0 _ll_register_callbacks cb 0x7f424c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:53.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4258b9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a289f0 0x559200e2ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4258b9f640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a289f0 0x559200e2ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36290/0 (socket says 172.21.15.49:36290) 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4258b9f640 1 -- 172.21.15.49:0/2190919104 learned_addr learned my addr 172.21.15.49:0/2190919104 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f42593a0640 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 0x559200e309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4253fff640 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 0x559200e30440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4258b9f640 1 -- 172.21.15.49:0/2190919104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 msgr2=0x559200e30440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4258b9f640 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 0x559200e30440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4258b9f640 1 -- 172.21.15.49:0/2190919104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 msgr2=0x559200e309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4258b9f640 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 0x559200e309c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4258b9f640 1 -- 172.21.15.49:0/2190919104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559200e98670 con 0x559200a289f0 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4253fff640 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 0x559200e30440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f42593a0640 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 0x559200e309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4258b9f640 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a289f0 0x559200e2ff00 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f423c0ad6f0 tx=0x7f423c00fe60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa58203b75fb136 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4233fff640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:53.590 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4233fff640 1 -- 172.21.15.49:0/2190919104 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c0a7e60 con 0x559200a289f0 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4233fff640 1 -- 172.21.15.49:0/2190919104 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f423c0a99d0 con 0x559200a289f0 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.583+0000 7f4261377740 1 -- 172.21.15.49:0/2190919104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42440035f0 con 0x559200a289f0 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4233fff640 1 -- 172.21.15.49:0/2190919104 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f423c0b2240 con 0x559200a289f0 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4261377740 10 client.18261 fetch_fsmap learned FSMap version 28 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4261377740 1 -- 172.21.15.49:0/2190919104 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559200e99860 con 0x559200a289f0 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4233fff640 1 -- 172.21.15.49:0/2190919104 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42440035f0 con 0x559200a289f0 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4233fff640 1 -- 172.21.15.49:0/2190919104 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f423c0a90b0 con 0x559200a289f0 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4261377740 10 client.18261 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4261377740 10 client.18261 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4261377740 20 client.18261 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4261377740 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559200a6a070 0x559200e9bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4261377740 4 client.18261 mds_command: new command op to 24685 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4261377740 1 -- 172.21.15.49:0/2190919104 --> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559200d858a0 con 0x559200a6a070 2024-09-21T06:47:53.591 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.584+0000 7f4253fff640 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559200a6a070 0x559200e9bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4233fff640 10 client.18261 ms_handle_connect on v2:172.21.15.98:6838/2833694716 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4253fff640 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559200a6a070 0x559200e9bfb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f4d464d17505caa server_cookie=5f3bf894378b40b6 in_seq=0 out_seq=0 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4233fff640 1 -- 172.21.15.49:0/2190919104 <== mds.1 v2:172.21.15.98:6838/2833694716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559200d858a0 con 0x559200a6a070 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4233fff640 10 client.18261 handle_command_reply: tid=0 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4261377740 1 client.18261 shutdown 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4261377740 1 -- 172.21.15.49:0/2190919104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a289f0 msgr2=0x559200e2ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4261377740 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a289f0 0x559200e2ff00 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f423c0ad6f0 tx=0x7f423c00fe60 comp rx=0 tx=0).stop 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4261377740 1 -- 172.21.15.49:0/2190919104 shutdown_connections 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4261377740 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.98:6838/2833694716,v1:172.21.15.98:6839/2833694716] conn(0x559200a6a070 0x559200e9bfb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4261377740 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559200a49390 0x559200e309c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4261377740 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x559200a411b0 0x559200e30440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4261377740 1 --2- 172.21.15.49:0/2190919104 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x559200a289f0 0x559200e2ff00 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4261377740 1 -- 172.21.15.49:0/2190919104 >> 172.21.15.49:0/2190919104 conn(0x559200a5e460 msgr2=0x559200e28850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.585+0000 7f4233fff640 0 client.18261 ms_handle_reset on v2:172.21.15.98:6838/2833694716 2024-09-21T06:47:53.592 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4261377740 1 -- 172.21.15.49:0/2190919104 shutdown_connections 2024-09-21T06:47:53.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4261377740 1 -- 172.21.15.49:0/2190919104 wait complete. 2024-09-21T06:47:53.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4261377740 20 client.18261 trim_cache size 0 max 16384 2024-09-21T06:47:53.593 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:47:53.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 -- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42400b66b0 msgr2=0x7f42400b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:53.593 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42400b66b0 0x7f42400b8bc0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f424c02f500 tx=0x7f424c005d80 comp rx=0 tx=0).stop 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 -- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541047d0 msgr2=0x7f425419a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541047d0 0x7f425419a220 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f423c00c920 tx=0x7f423c00cde0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 -- 172.21.15.49:0/167621762 shutdown_connections 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f42400b66b0 0x7f42400b8bc0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f425410dc30 0x7f425419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f4254105120 0x7f425419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 --2- 172.21.15.49:0/167621762 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f42541047d0 0x7f425419a220 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.586+0000 7f4259ba1640 1 -- 172.21.15.49:0/167621762 >> 172.21.15.49:0/167621762 conn(0x7f42540fe2d0 msgr2=0x7f4254107750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.587+0000 7f4259ba1640 1 -- 172.21.15.49:0/167621762 shutdown_connections 2024-09-21T06:47:53.594 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:53.587+0000 7f4259ba1640 1 -- 172.21.15.49:0/167621762 wait complete. 2024-09-21T06:47:53.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:53 smithi049 ceph-mon[31177]: pgmap v666: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-21T06:47:54.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:53 smithi098 ceph-mon[34704]: pgmap v666: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-21T06:47:54.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:53 smithi079 ceph-mon[34346]: pgmap v666: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 29 KiB/s wr, 13 op/s 2024-09-21T06:47:54.258 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:47:54.522 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:54.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.990+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3384039990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 msgr2=0x7f8e301098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:54.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.990+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3384039990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 0x7f8e301098d0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009900 tx=0x7f8e2402a410 comp rx=0 tx=0).stop 2024-09-21T06:47:54.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.990+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3384039990 shutdown_connections 2024-09-21T06:47:54.996 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.990+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3384039990 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e30109e10 0x7f8e30110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.990+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3384039990 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 0x7f8e301098d0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.990+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3384039990 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e30103b80 0x7f8e30103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.990+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3384039990 >> 172.21.15.49:0/3384039990 conn(0x7f8e300ff5d0 msgr2=0x7f8e30101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.990+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3384039990 shutdown_connections 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.990+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3384039990 wait complete. 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e35e7e640 1 Processor -- start 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e35e7e640 1 -- start start 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e35e7e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e30103b80 0x7f8e30075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e35e7e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 0x7f8e30075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e35e7e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e30109e10 0x7f8e30076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e35e7e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30113b20 con 0x7f8e301094c0 2024-09-21T06:47:54.997 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e35e7e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301139a0 con 0x7f8e30103b80 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e35e7e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e30113ca0 con 0x7f8e30109e10 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e2effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 0x7f8e30075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e2effd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 0x7f8e30075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36318/0 (socket says 172.21.15.49:36318) 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e2effd640 1 -- 172.21.15.49:0/3098581876 learned_addr learned my addr 172.21.15.49:0/3098581876 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e2ffff640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e30109e10 0x7f8e30076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e30103b80 0x7f8e30075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e2effd640 1 -- 172.21.15.49:0/3098581876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e30109e10 msgr2=0x7f8e30076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.991+0000 7f8e2effd640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e30109e10 0x7f8e30076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.992+0000 7f8e2effd640 1 -- 172.21.15.49:0/3098581876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e30103b80 msgr2=0x7f8e30075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.992+0000 7f8e2effd640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e30103b80 0x7f8e30075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.992+0000 7f8e2effd640 1 -- 172.21.15.49:0/3098581876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e301a8770 con 0x7f8e301094c0 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.992+0000 7f8e2effd640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 0x7f8e30075c50 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005ab0 tx=0x7f8e24003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.992+0000 7f8e2cff9640 1 -- 172.21.15.49:0/3098581876 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2403f070 con 0x7f8e301094c0 2024-09-21T06:47:54.998 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.992+0000 7f8e2cff9640 1 -- 172.21.15.49:0/3098581876 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e24031d60 con 0x7f8e301094c0 2024-09-21T06:47:54.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.992+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3098581876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e301a8a00 con 0x7f8e301094c0 2024-09-21T06:47:54.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.992+0000 7f8e2cff9640 1 -- 172.21.15.49:0/3098581876 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e24035030 con 0x7f8e301094c0 2024-09-21T06:47:54.999 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.992+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3098581876 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e301a8ee0 con 0x7f8e301094c0 2024-09-21T06:47:55.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e3c3f2740 1 Processor -- start 2024-09-21T06:47:55.003 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e3c3f2740 1 -- start start 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5608089331b0 0x560808d03800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080893b390 0x560808d03d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560808c79ea0 con 0x56080893b390 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560808c692d0 con 0x5608089331b0 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560808c6d0e0 con 0x56080895c070 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e2cff9640 1 -- 172.21.15.49:0/3098581876 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f8e24042070 con 0x7f8e301094c0 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5608089331b0 0x560808d03800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5608089331b0 0x560808d03800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.79:3300/0 says I am v2:172.21.15.49:51318/0 (socket says 172.21.15.49:51318) 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/2478135475 learned_addr learned my addr 172.21.15.49:0/2478135475 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e2ffff640 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e2effd640 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080893b390 0x560808d03d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/2478135475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 msgr2=0x560808d032c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.995+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d032c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/2478135475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080893b390 msgr2=0x560808d03d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080893b390 0x560808d03d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/2478135475 --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608089c7650 con 0x5608089331b0 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e2effd640 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080893b390 0x560808d03d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5608089331b0 0x560808d03800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000cbb0 tx=0x7f8e2000e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e7ef05745b0adea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e15ffb640 1 -- 172.21.15.49:0/2478135475 <== mon.2 v2:172.21.15.79:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20005220 con 0x5608089331b0 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e2cff9640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e180b6680 0x7f8e180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e15ffb640 1 -- 172.21.15.49:0/2478135475 <== mon.2 v2:172.21.15.79:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e20004c50 con 0x5608089331b0 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e15ffb640 1 -- 172.21.15.49:0/2478135475 <== mon.2 v2:172.21.15.79:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20010720 con 0x5608089331b0 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e2ffff640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e180b6680 0x7f8e180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.996+0000 7f8e2cff9640 1 -- 172.21.15.49:0/3098581876 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f8e24107fa0 con 0x7f8e301094c0 2024-09-21T06:47:55.005 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/2478135475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5608089331b0 msgr2=0x560808d03800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e2ffff640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e180b6680 0x7f8e180b8b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8e28005fd0 tx=0x7f8e28009600 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5608089331b0 0x560808d03800 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000cbb0 tx=0x7f8e2000e720 comp rx=0 tx=0).stop 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/2478135475 shutdown_connections 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080893b390 0x560808d03d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5608089331b0 0x560808d03800 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/2478135475 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d032c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/2478135475 >> 172.21.15.49:0/2478135475 conn(0x560808950460 msgr2=0x560808d011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/2478135475 shutdown_connections 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.997+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/2478135475 wait complete. 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e3c3f2740 1 -- start start 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e3c3f2740 1 Processor -- start 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d0e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.006 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d0edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d0f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x560808aca700 con 0x5608089331b0 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x560808c04160 con 0x56080893b390 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x560808d11aa0 con 0x56080895c070 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e3c3f2740 10 client.0 _ll_register_callbacks cb 0x560808c1d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.998+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d0e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d0e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36338/0 (socket says 172.21.15.49:36338) 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/1543306660 learned_addr learned my addr 172.21.15.49:0/1543306660 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2ffff640 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d0f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2effd640 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d0edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/1543306660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 msgr2=0x560808d0f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d0f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/1543306660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 msgr2=0x560808d0edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d0edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/1543306660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560808c31c90 con 0x5608089331b0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d0e8b0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f8e200058c0 tx=0x7f8e2000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c360d2c585db567d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e0effd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e0effd640 1 -- 172.21.15.49:0/1543306660 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20029060 con 0x5608089331b0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1543306660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e20004c50 con 0x5608089331b0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:54.999+0000 7f8e0effd640 1 -- 172.21.15.49:0/1543306660 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f8e20005010 con 0x5608089331b0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e0effd640 1 -- 172.21.15.49:0/1543306660 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8e20005210 con 0x5608089331b0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e3c3f2740 10 client.18273 fetch_fsmap learned FSMap version 28 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1543306660 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560808d1d720 con 0x5608089331b0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e0effd640 1 -- 172.21.15.49:0/1543306660 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e20004c50 con 0x5608089331b0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e0effd640 1 -- 172.21.15.49:0/1543306660 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f8e20024410 con 0x5608089331b0 2024-09-21T06:47:55.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e3c3f2740 10 client.18273 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:47:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e3c3f2740 10 client.18273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e3c3f2740 20 client.18273 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56080891a9f0 0x560808d20a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e3c3f2740 4 client.18273 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:47:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1543306660 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560808c7bdf0 con 0x56080891a9f0 2024-09-21T06:47:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.000+0000 7f8e2effd640 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56080891a9f0 0x560808d20a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.001+0000 7f8e2effd640 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56080891a9f0 0x560808d20a80 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fae53b31d39d102 server_cookie=a6794110ab5af838 in_seq=0 out_seq=0 2024-09-21T06:47:55.009 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.001+0000 7f8e0effd640 10 client.18273 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:55.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e0effd640 1 -- 172.21.15.49:0/1543306660 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560808c7bdf0 con 0x56080891a9f0 2024-09-21T06:47:55.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e0effd640 10 client.18273 handle_command_reply: tid=0 2024-09-21T06:47:55.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 client.18273 shutdown 2024-09-21T06:47:55.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1543306660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 msgr2=0x560808d0e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:55.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d0e8b0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f8e200058c0 tx=0x7f8e2000c920 comp rx=0 tx=0).stop 2024-09-21T06:47:55.010 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1543306660 shutdown_connections 2024-09-21T06:47:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x56080891a9f0 0x560808d20a80 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d0f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e0effd640 0 client.18273 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d0edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1543306660 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d0e8b0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1543306660 >> 172.21.15.49:0/1543306660 conn(0x560808950460 msgr2=0x560808d06450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1543306660 shutdown_connections 2024-09-21T06:47:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.002+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1543306660 wait complete. 2024-09-21T06:47:55.011 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.003+0000 7f8e3c3f2740 20 client.18273 trim_cache size 0 max 16384 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e3c3f2740 1 Processor -- start 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e3c3f2740 1 -- start start 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d04a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d0baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d0bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b43a0 con 0x5608089331b0 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b1c40 con 0x56080893b390 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301afab0 con 0x56080895c070 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d04a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.016+0000 7f8e2f7fe640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d04a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36348/0 (socket says 172.21.15.49:36348) 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/1735649194 learned_addr learned my addr 172.21.15.49:0/1735649194 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:55.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2ffff640 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d0bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/1735649194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 msgr2=0x560808d0bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d0bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2effd640 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d0baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/1735649194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 msgr2=0x560808d0baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d0baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2f7fe640 1 -- 172.21.15.49:0/1735649194 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560808d0cdb0 con 0x5608089331b0 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2effd640 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d0baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d04a00 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f8e2002e040 tx=0x7f8e20005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2942ef7fade826fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e157fa640 1 -- 172.21.15.49:0/1735649194 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e2001e070 con 0x5608089331b0 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e157fa640 1 -- 172.21.15.49:0/1735649194 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e20005010 con 0x5608089331b0 2024-09-21T06:47:55.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.017+0000 7f8e157fa640 1 -- 172.21.15.49:0/1735649194 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e20029070 con 0x5608089331b0 2024-09-21T06:47:55.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.018+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1735649194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 msgr2=0x560808d04a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:55.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.018+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d04a00 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f8e2002e040 tx=0x7f8e20005fd0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.018+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1735649194 shutdown_connections 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.018+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x56080895c070 0x560808d0bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.018+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d0baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.018+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/1735649194 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x5608089331b0 0x560808d04a00 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.018+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1735649194 >> 172.21.15.49:0/1735649194 conn(0x560808950460 msgr2=0x560808d042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.018+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1735649194 shutdown_connections 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.018+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/1735649194 wait complete. 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e3c3f2740 1 -- start start 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e3c3f2740 1 Processor -- start 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608089331b0 0x560808d244f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d21a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e3c3f2740 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080895c070 0x560808d221a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b0100 con 0x56080895c070 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b1570 con 0x56080893b390 2024-09-21T06:47:55.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e3c3f2740 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f8e301b07d0 con 0x5608089331b0 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e3c3f2740 10 client.0 _ll_register_callbacks cb 0x7f8e20014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080895c070 0x560808d221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e2ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080895c070 0x560808d221a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36362/0 (socket says 172.21.15.49:36362) 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e2ffff640 1 -- 172.21.15.49:0/4018898023 learned_addr learned my addr 172.21.15.49:0/4018898023 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608089331b0 0x560808d244f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.019+0000 7f8e2effd640 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d21a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e2ffff640 1 -- 172.21.15.49:0/4018898023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608089331b0 msgr2=0x560808d244f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e2ffff640 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608089331b0 0x560808d244f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e2ffff640 1 -- 172.21.15.49:0/4018898023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 msgr2=0x560808d21a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e2ffff640 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d21a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e2ffff640 1 -- 172.21.15.49:0/4018898023 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560808d8a200 con 0x56080895c070 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e2ffff640 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080895c070 0x560808d221a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f8e28011e60 tx=0x7f8e28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7a9487df723fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:55.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e0effd640 10 client.0 ms_handle_connect on v2:172.21.15.49:3300/0 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e0effd640 1 -- 172.21.15.49:0/4018898023 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e28020db0 con 0x56080895c070 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e0effd640 1 -- 172.21.15.49:0/4018898023 <== mon.0 v2:172.21.15.49:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f8e28003970 con 0x56080895c070 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/4018898023 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e20005010 con 0x56080895c070 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e0effd640 1 -- 172.21.15.49:0/4018898023 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8e28003b70 con 0x56080895c070 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e3c3f2740 10 client.18279 fetch_fsmap learned FSMap version 28 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.020+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/4018898023 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560808d8b390 con 0x56080895c070 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.021+0000 7f8e0effd640 1 -- 172.21.15.49:0/4018898023 <== mon.0 v2:172.21.15.49:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e20005010 con 0x56080895c070 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.021+0000 7f8e0effd640 1 -- 172.21.15.49:0/4018898023 <== mon.0 v2:172.21.15.49:3300/0 5 ==== fsmap(e 28) ==== 8350+0+0 (secure 0 0 0) 0x7f8e28029070 con 0x56080895c070 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.021+0000 7f8e3c3f2740 10 client.18279 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.021+0000 7f8e3c3f2740 10 client.18279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.021+0000 7f8e3c3f2740 20 client.18279 populate_metadata read hostname 'smithi049' 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.021+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5608088efda0 0x560808d8dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.021+0000 7f8e3c3f2740 4 client.18279 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:47:55.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.021+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/4018898023 --> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560808c778a0 con 0x5608088efda0 2024-09-21T06:47:55.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.021+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5608088efda0 0x560808d8dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e2f7fe640 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5608088efda0 0x560808d8dc00 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b04a636c866404e2 server_cookie=1abd9e6242dc8d0e in_seq=0 out_seq=0 2024-09-21T06:47:55.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e0effd640 10 client.18279 ms_handle_connect on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:55.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e0effd640 1 -- 172.21.15.49:0/4018898023 <== mds.0 v2:172.21.15.79:6838/1831508343 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560808c778a0 con 0x5608088efda0 2024-09-21T06:47:55.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e0effd640 10 client.18279 handle_command_reply: tid=0 2024-09-21T06:47:55.029 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 client.18279 shutdown 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/4018898023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080895c070 msgr2=0x560808d221a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080895c070 0x560808d221a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f8e28011e60 tx=0x7f8e28004a40 comp rx=0 tx=0).stop 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/4018898023 shutdown_connections 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.79:6838/1831508343,v1:172.21.15.79:6839/1831508343] conn(0x5608088efda0 0x560808d8dc00 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x56080895c070 0x560808d221a0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x56080893b390 0x560808d21a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 --2- 172.21.15.49:0/4018898023 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x5608089331b0 0x560808d244f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e0effd640 0 client.18279 ms_handle_reset on v2:172.21.15.79:6838/1831508343 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/4018898023 >> 172.21.15.49:0/4018898023 conn(0x560808950460 msgr2=0x560808d01100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:55.030 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/4018898023 shutdown_connections 2024-09-21T06:47:55.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.022+0000 7f8e3c3f2740 1 -- 172.21.15.49:0/4018898023 wait complete. 2024-09-21T06:47:55.031 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e3c3f2740 20 client.18279 trim_cache size 0 max 16384 2024-09-21T06:47:55.031 INFO:teuthology.orchestra.run.smithi049.stdout:[] 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e180b6680 msgr2=0x7f8e180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e180b6680 0x7f8e180b8b90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8e28005fd0 tx=0x7f8e28009600 comp rx=0 tx=0).stop 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 msgr2=0x7f8e30075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 0x7f8e30075c50 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f8e24005ab0 tx=0x7f8e24003cd0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3098581876 shutdown_connections 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f8e180b6680 0x7f8e180b8b90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f8e30109e10 0x7f8e30076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f8e301094c0 0x7f8e30075c50 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 --2- 172.21.15.49:0/3098581876 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f8e30103b80 0x7f8e30075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3098581876 >> 172.21.15.49:0/3098581876 conn(0x7f8e300ff5d0 msgr2=0x7f8e301019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3098581876 shutdown_connections 2024-09-21T06:47:55.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.023+0000 7f8e35e7e640 1 -- 172.21.15.49:0/3098581876 wait complete. 2024-09-21T06:47:55.697 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T06:47:55.698 INFO:tasks.fwd_scrub:done joining 2024-09-21T06:47:55.698 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T06:47:55.714 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:47:55.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.830+0000 7f10ae007640 1 -- 172.21.15.49:0/1870184355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8109d40 msgr2=0x7f10a8110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:55.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.830+0000 7f10ae007640 1 --2- 172.21.15.49:0/1870184355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8109d40 0x7f10a8110570 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009900 tx=0x7f10a002a410 comp rx=0 tx=0).stop 2024-09-21T06:47:55.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.830+0000 7f10ae007640 1 -- 172.21.15.49:0/1870184355 shutdown_connections 2024-09-21T06:47:55.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.830+0000 7f10ae007640 1 --2- 172.21.15.49:0/1870184355 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a8109d40 0x7f10a8110570 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.833 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.830+0000 7f10ae007640 1 --2- 172.21.15.49:0/1870184355 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a81093f0 0x7f10a8109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.830+0000 7f10ae007640 1 --2- 172.21.15.49:0/1870184355 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8103ac0 0x7f10a8103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.830+0000 7f10ae007640 1 -- 172.21.15.49:0/1870184355 >> 172.21.15.49:0/1870184355 conn(0x7f10a80ff540 msgr2=0x7f10a8101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:55.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.830+0000 7f10ae007640 1 -- 172.21.15.49:0/1870184355 shutdown_connections 2024-09-21T06:47:55.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.830+0000 7f10ae007640 1 -- 172.21.15.49:0/1870184355 wait complete. 2024-09-21T06:47:55.834 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10ae007640 1 Processor -- start 2024-09-21T06:47:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10ae007640 1 -- start start 2024-09-21T06:47:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10ae007640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a8103ac0 0x7f10a819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10ae007640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a81093f0 0x7f10a819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10ae007640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8109d40 0x7f10a819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10ae007640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8113a00 con 0x7f10a81093f0 2024-09-21T06:47:55.836 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10ae007640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8113880 con 0x7f10a8103ac0 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10ae007640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8113b80 con 0x7f10a8109d40 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10a6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a81093f0 0x7f10a819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10a6ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a81093f0 0x7f10a819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36392/0 (socket says 172.21.15.49:36392) 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.831+0000 7f10a6ffd640 1 -- 172.21.15.49:0/1171260971 learned_addr learned my addr 172.21.15.49:0/1171260971 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a77fe640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a8103ac0 0x7f10a819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a6ffd640 1 -- 172.21.15.49:0/1171260971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8109d40 msgr2=0x7f10a819fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a7fff640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8109d40 0x7f10a819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a6ffd640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8109d40 0x7f10a819fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a6ffd640 1 -- 172.21.15.49:0/1171260971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a8103ac0 msgr2=0x7f10a819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a6ffd640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a8103ac0 0x7f10a819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a6ffd640 1 -- 172.21.15.49:0/1171260971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a81a0260 con 0x7f10a81093f0 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a7fff640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8109d40 0x7f10a819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a6ffd640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a81093f0 0x7f10a819a960 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f109c00c8c0 tx=0x7f109c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a4ff9640 1 -- 172.21.15.49:0/1171260971 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c007bb0 con 0x7f10a81093f0 2024-09-21T06:47:55.837 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a4ff9640 1 -- 172.21.15.49:0/1171260971 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f109c007d50 con 0x7f10a81093f0 2024-09-21T06:47:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a81a0550 con 0x7f10a81093f0 2024-09-21T06:47:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10a4ff9640 1 -- 172.21.15.49:0/1171260971 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c0187c0 con 0x7f10a81093f0 2024-09-21T06:47:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.832+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a81a6d70 con 0x7f10a81093f0 2024-09-21T06:47:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.833+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a8103ed0 con 0x7f10a81093f0 2024-09-21T06:47:55.838 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.835+0000 7f10a4ff9640 1 -- 172.21.15.49:0/1171260971 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f109c00fa20 con 0x7f10a81093f0 2024-09-21T06:47:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.836+0000 7f10a4ff9640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10900b6680 0x7f10900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.836+0000 7f10a77fe640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10900b6680 0x7f10900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.836+0000 7f10a4ff9640 1 -- 172.21.15.49:0/1171260971 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f109c0e7b50 con 0x7f10a81093f0 2024-09-21T06:47:55.839 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.837+0000 7f10a77fe640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10900b6680 0x7f10900b8b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1098005fd0 tx=0x7f1098009500 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:55.841 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:55.839+0000 7f10a4ff9640 1 -- 172.21.15.49:0/1171260971 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f109c014030 con 0x7f10a81093f0 2024-09-21T06:47:55.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:55 smithi049 ceph-mon[31177]: pgmap v667: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-21T06:47:56.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.030+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10a819b4e0 con 0x7f10a81093f0 2024-09-21T06:47:56.034 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.031+0000 7f10a4ff9640 1 -- 172.21.15.49:0/1171260971 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+23212 (secure 0 0 0) 0x7f10a819b4e0 con 0x7f10a81093f0 2024-09-21T06:47:56.034 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:47:56.034 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":88,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:47:08.701913+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":87,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9},{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:47:56.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10900b6680 msgr2=0x7f10900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10900b6680 0x7f10900b8b90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1098005fd0 tx=0x7f1098009500 comp rx=0 tx=0).stop 2024-09-21T06:47:56.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a81093f0 msgr2=0x7f10a819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a81093f0 0x7f10a819a960 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f109c00c8c0 tx=0x7f109c00cd80 comp rx=0 tx=0).stop 2024-09-21T06:47:56.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 shutdown_connections 2024-09-21T06:47:56.036 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f10900b6680 0x7f10900b8b90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f10a8109d40 0x7f10a819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f10a81093f0 0x7f10a819a960 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 --2- 172.21.15.49:0/1171260971 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f10a8103ac0 0x7f10a819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.033+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 >> 172.21.15.49:0/1171260971 conn(0x7f10a80ff540 msgr2=0x7f10a8106980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:56.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.034+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 shutdown_connections 2024-09-21T06:47:56.037 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.034+0000 7f10ae007640 1 -- 172.21.15.49:0/1171260971 wait complete. 2024-09-21T06:47:56.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:55 smithi098 ceph-mon[34704]: pgmap v667: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-21T06:47:56.048 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:30:10.495246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:34:39.428290+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:34:41.517864+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 87, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:47:56.048 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:47:56.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:55 smithi079 ceph-mon[34346]: pgmap v667: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 16 op/s 2024-09-21T06:47:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 -- 172.21.15.49:0/4160572864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd448109d40 msgr2=0x7fd448110570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 --2- 172.21.15.49:0/4160572864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd448109d40 0x7fd448110570 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd440009ca0 tx=0x7fd44002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 -- 172.21.15.49:0/4160572864 shutdown_connections 2024-09-21T06:47:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 --2- 172.21.15.49:0/4160572864 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd448109d40 0x7fd448110570 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 --2- 172.21.15.49:0/4160572864 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd4481093f0 0x7fd448109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 --2- 172.21.15.49:0/4160572864 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd448103ac0 0x7fd448103ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 -- 172.21.15.49:0/4160572864 >> 172.21.15.49:0/4160572864 conn(0x7fd4480ff500 msgr2=0x7fd448101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:56.166 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 -- 172.21.15.49:0/4160572864 shutdown_connections 2024-09-21T06:47:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 -- 172.21.15.49:0/4160572864 wait complete. 2024-09-21T06:47:56.167 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.163+0000 7fd44e12b640 1 Processor -- start 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd44e12b640 1 -- start start 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd44e12b640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd448103ac0 0x7fd44819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd44e12b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4481093f0 0x7fd44819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd44e12b640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd448109d40 0x7fd44819fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd44e12b640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fd448113a00 con 0x7fd4481093f0 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd44e12b640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fd448113880 con 0x7fd448103ac0 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd44e12b640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fd448113b80 con 0x7fd448109d40 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd446ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4481093f0 0x7fd44819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd446ffd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4481093f0 0x7fd44819a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:36410/0 (socket says 172.21.15.49:36410) 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd446ffd640 1 -- 172.21.15.49:0/2310576844 learned_addr learned my addr 172.21.15.49:0/2310576844 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd447fff640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd448109d40 0x7fd44819fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd4477fe640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd448103ac0 0x7fd44819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.169 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd446ffd640 1 -- 172.21.15.49:0/2310576844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd448109d40 msgr2=0x7fd44819fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd446ffd640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd448109d40 0x7fd44819fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd446ffd640 1 -- 172.21.15.49:0/2310576844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd448103ac0 msgr2=0x7fd44819a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd446ffd640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd448103ac0 0x7fd44819a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd446ffd640 1 -- 172.21.15.49:0/2310576844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4481a02d0 con 0x7fd4481093f0 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.164+0000 7fd4477fe640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd448103ac0 0x7fd44819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.165+0000 7fd446ffd640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4481093f0 0x7fd44819a940 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d950 tx=0x7fd43c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.165+0000 7fd444ff9640 1 -- 172.21.15.49:0/2310576844 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c017070 con 0x7fd4481093f0 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.165+0000 7fd444ff9640 1 -- 172.21.15.49:0/2310576844 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd43c009c30 con 0x7fd4481093f0 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.165+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4481a05c0 con 0x7fd4481093f0 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.165+0000 7fd444ff9640 1 -- 172.21.15.49:0/2310576844 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0047a0 con 0x7fd4481093f0 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.165+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4481a6d50 con 0x7fd4481093f0 2024-09-21T06:47:56.170 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.166+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd448103ed0 con 0x7fd4481093f0 2024-09-21T06:47:56.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.167+0000 7fd444ff9640 1 -- 172.21.15.49:0/2310576844 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fd43c004020 con 0x7fd4481093f0 2024-09-21T06:47:56.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.168+0000 7fd444ff9640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd4300b6680 0x7fd4300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.168+0000 7fd4477fe640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd4300b6680 0x7fd4300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.168+0000 7fd444ff9640 1 -- 172.21.15.49:0/2310576844 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fd43c0e7950 con 0x7fd4481093f0 2024-09-21T06:47:56.171 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.169+0000 7fd4477fe640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd4300b6680 0x7fd4300b8b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd438009b40 tx=0x7fd438005e50 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:56.174 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.171+0000 7fd444ff9640 1 -- 172.21.15.49:0/2310576844 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd43c020020 con 0x7fd4481093f0 2024-09-21T06:47:56.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.360+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd44802e640 con 0x7fd4481093f0 2024-09-21T06:47:56.363 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.361+0000 7fd444ff9640 1 -- 172.21.15.49:0/2310576844 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fd43c0addf0 con 0x7fd4481093f0 2024-09-21T06:47:56.363 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 1 2024-09-21T06:47:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd4300b6680 msgr2=0x7fd4300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd4300b6680 0x7fd4300b8b90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd438009b40 tx=0x7fd438005e50 comp rx=0 tx=0).stop 2024-09-21T06:47:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4481093f0 msgr2=0x7fd44819a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4481093f0 0x7fd44819a940 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d950 tx=0x7fd43c00de10 comp rx=0 tx=0).stop 2024-09-21T06:47:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 shutdown_connections 2024-09-21T06:47:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fd4300b6680 0x7fd4300b8b90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.366 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fd448109d40 0x7fd44819fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fd4481093f0 0x7fd44819a940 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 --2- 172.21.15.49:0/2310576844 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fd448103ac0 0x7fd44819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 >> 172.21.15.49:0/2310576844 conn(0x7fd4480ff500 msgr2=0x7fd448108a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 shutdown_connections 2024-09-21T06:47:56.367 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.363+0000 7fd44e12b640 1 -- 172.21.15.49:0/2310576844 wait complete. 2024-09-21T06:47:56.377 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:47:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.491+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3110385122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 msgr2=0x7f6f0410f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.491+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3110385122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 0x7f6f0410f460 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009ca0 tx=0x7f6efc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.491+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3110385122 shutdown_connections 2024-09-21T06:47:56.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.491+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3110385122 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 0x7f6f0410f460 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.491+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3110385122 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f041082e0 0x7f6f041086f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.491+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3110385122 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f041029b0 0x7f6f04102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.491+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3110385122 >> 172.21.15.49:0/3110385122 conn(0x7f6f040fe390 msgr2=0x7f6f041007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.491+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3110385122 shutdown_connections 2024-09-21T06:47:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.491+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3110385122 wait complete. 2024-09-21T06:47:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f0a8f9640 1 Processor -- start 2024-09-21T06:47:56.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f0a8f9640 1 -- start start 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f0a8f9640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f041029b0 0x7f6f041992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f0a8f9640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f041082e0 0x7f6f04199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f0a8f9640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 0x7f6f0419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f0a8f9640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f6f041128f0 con 0x7f6f04108c30 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f0a8f9640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f6f04112770 con 0x7f6f041082e0 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f0a8f9640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f6f04112a70 con 0x7f6f041029b0 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f08e96640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 0x7f6f0419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f08e96640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 0x7f6f0419eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53758/0 (socket says 172.21.15.49:53758) 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.492+0000 7f6f08e96640 1 -- 172.21.15.49:0/3609862507 learned_addr learned my addr 172.21.15.49:0/3609862507 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f03fff640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f041029b0 0x7f6f041992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f037fe640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f041082e0 0x7f6f04199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f08e96640 1 -- 172.21.15.49:0/3609862507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f041029b0 msgr2=0x7f6f041992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f08e96640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f041029b0 0x7f6f041992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f08e96640 1 -- 172.21.15.49:0/3609862507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f041082e0 msgr2=0x7f6f04199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f08e96640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f041082e0 0x7f6f04199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f08e96640 1 -- 172.21.15.49:0/3609862507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f0419f190 con 0x7f6f04108c30 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f03fff640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f041029b0 0x7f6f041992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f037fe640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f041082e0 0x7f6f04199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f08e96640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 0x7f6f0419eb20 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0098d0 tx=0x7f6efc0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f017fa640 1 -- 172.21.15.49:0/3609862507 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc003b70 con 0x7f6f04108c30 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f017fa640 1 -- 172.21.15.49:0/3609862507 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6efc003d10 con 0x7f6f04108c30 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f0419f420 con 0x7f6f04108c30 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f017fa640 1 -- 172.21.15.49:0/3609862507 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6efc02fa20 con 0x7f6f04108c30 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.493+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f041a5ca0 con 0x7f6f04108c30 2024-09-21T06:47:56.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.494+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f04102dc0 con 0x7f6f04108c30 2024-09-21T06:47:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.496+0000 7f6f017fa640 1 -- 172.21.15.49:0/3609862507 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f6efc02fc20 con 0x7f6f04108c30 2024-09-21T06:47:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.497+0000 7f6f017fa640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eec0b6680 0x7f6eec0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.497+0000 7f6f03fff640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eec0b6680 0x7f6eec0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.497+0000 7f6f017fa640 1 -- 172.21.15.49:0/3609862507 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f6efc108ce0 con 0x7f6f04108c30 2024-09-21T06:47:56.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.497+0000 7f6f03fff640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eec0b6680 0x7f6eec0b8b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400abe0 tx=0x7f6ef400a5c0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:56.502 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.500+0000 7f6f017fa640 1 -- 172.21.15.49:0/3609862507 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6efc0cf1e0 con 0x7f6f04108c30 2024-09-21T06:47:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.688+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6f0410aa20 con 0x7f6f04108c30 2024-09-21T06:47:56.691 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.689+0000 7f6f017fa640 1 -- 172.21.15.49:0/3609862507 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f6efc0d35c0 con 0x7f6f04108c30 2024-09-21T06:47:56.692 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 32 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eec0b6680 msgr2=0x7f6eec0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eec0b6680 0x7f6eec0b8b90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400abe0 tx=0x7f6ef400a5c0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 msgr2=0x7f6f0419eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 0x7f6f0419eb20 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f6efc0098d0 tx=0x7f6efc0317b0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 shutdown_connections 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f6eec0b6680 0x7f6eec0b8b90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f6f04108c30 0x7f6f0419eb20 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f6f041082e0 0x7f6f04199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 --2- 172.21.15.49:0/3609862507 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f6f041029b0 0x7f6f041992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 >> 172.21.15.49:0/3609862507 conn(0x7f6f040fe390 msgr2=0x7f6f0406aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:56.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 shutdown_connections 2024-09-21T06:47:56.695 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.691+0000 7f6f0a8f9640 1 -- 172.21.15.49:0/3609862507 wait complete. 2024-09-21T06:47:56.706 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:47:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.820+0000 7f57dbfc6640 1 -- 172.21.15.49:0/3529939162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 msgr2=0x7f57d406c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.820+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/3529939162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 0x7f57d406c170 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f57d0009900 tx=0x7f57d002a410 comp rx=0 tx=0).stop 2024-09-21T06:47:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.820+0000 7f57dbfc6640 1 -- 172.21.15.49:0/3529939162 shutdown_connections 2024-09-21T06:47:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.820+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/3529939162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d4109d50 0x7f57d4110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.820+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/3529939162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d4109400 0x7f57d4109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.820+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/3529939162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 0x7f57d406c170 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.823 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.820+0000 7f57dbfc6640 1 -- 172.21.15.49:0/3529939162 >> 172.21.15.49:0/3529939162 conn(0x7f57d4079570 msgr2=0x7f57d4079980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.820+0000 7f57dbfc6640 1 -- 172.21.15.49:0/3529939162 shutdown_connections 2024-09-21T06:47:56.824 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.820+0000 7f57dbfc6640 1 -- 172.21.15.49:0/3529939162 wait complete. 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57dbfc6640 1 Processor -- start 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57dbfc6640 1 -- start start 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57dbfc6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 0x7f57d419a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57dbfc6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d4109400 0x7f57d419a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57dbfc6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d4109d50 0x7f57d419fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57dbfc6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f57d41139f0 con 0x7f57d406bd60 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57dbfc6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f57d4113870 con 0x7f57d4109400 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57dbfc6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f57d4113b70 con 0x7f57d4109d50 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57d9d62640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 0x7f57d419a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57d9d62640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 0x7f57d419a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53784/0 (socket says 172.21.15.49:53784) 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.821+0000 7f57d9d62640 1 -- 172.21.15.49:0/1593841833 learned_addr learned my addr 172.21.15.49:0/1593841833 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57d9561640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d4109400 0x7f57d419a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.826 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57d9d62640 1 -- 172.21.15.49:0/1593841833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d4109d50 msgr2=0x7f57d419fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57da563640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d4109d50 0x7f57d419fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57d9d62640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d4109d50 0x7f57d419fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57d9d62640 1 -- 172.21.15.49:0/1593841833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d4109400 msgr2=0x7f57d419a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57d9d62640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d4109400 0x7f57d419a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57d9d62640 1 -- 172.21.15.49:0/1593841833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d41a0300 con 0x7f57d406bd60 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57d9561640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d4109400 0x7f57d419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57d9d62640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 0x7f57d419a3d0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f57d0005940 tx=0x7f57d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57c6ffd640 1 -- 172.21.15.49:0/1593841833 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d003f030 con 0x7f57d406bd60 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57c6ffd640 1 -- 172.21.15.49:0/1593841833 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57d0003cb0 con 0x7f57d406bd60 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d41a0590 con 0x7f57d406bd60 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57c6ffd640 1 -- 172.21.15.49:0/1593841833 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d0035070 con 0x7f57d406bd60 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.822+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d41a6d80 con 0x7f57d406bd60 2024-09-21T06:47:56.827 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.823+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57d406c170 con 0x7f57d406bd60 2024-09-21T06:47:56.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.825+0000 7f57c6ffd640 1 -- 172.21.15.49:0/1593841833 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f57d0042030 con 0x7f57d406bd60 2024-09-21T06:47:56.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.825+0000 7f57c6ffd640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f57c00b6680 0x7f57c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:56.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.826+0000 7f57d9561640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f57c00b6680 0x7f57c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:56.828 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.826+0000 7f57c6ffd640 1 -- 172.21.15.49:0/1593841833 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7f57d0107cf0 con 0x7f57d406bd60 2024-09-21T06:47:56.829 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.826+0000 7f57d9561640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f57c00b6680 0x7f57c00b8b90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f57d4109020 tx=0x7f57c8005ec0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:56.832 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:56.830+0000 7f57c6ffd640 1 -- 172.21.15.49:0/1593841833 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57d010c070 con 0x7f57d406bd60 2024-09-21T06:47:56.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:56 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1171260971' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:47:56.972 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:56 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2310576844' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:47:56.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:56 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3609862507' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:47:57.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.020+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f57d410b590 con 0x7f57d406bd60 2024-09-21T06:47:57.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.021+0000 7f57c6ffd640 1 -- 172.21.15.49:0/1593841833 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f57d00ce1f0 con 0x7f57d406bd60 2024-09-21T06:47:57.023 INFO:teuthology.orchestra.run.smithi049.stdout:pg_num: 64 2024-09-21T06:47:57.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f57c00b6680 msgr2=0x7f57c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:57.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f57c00b6680 0x7f57c00b8b90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f57d4109020 tx=0x7f57c8005ec0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 msgr2=0x7f57d419a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:57.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 0x7f57d419a3d0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f57d0005940 tx=0x7f57d00042f0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 shutdown_connections 2024-09-21T06:47:57.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f57c00b6680 0x7f57c00b8b90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f57d4109d50 0x7f57d419fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f57d4109400 0x7f57d419a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 --2- 172.21.15.49:0/1593841833 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f57d406bd60 0x7f57d419a3d0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 >> 172.21.15.49:0/1593841833 conn(0x7f57d4079570 msgr2=0x7f57d4107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:57.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 shutdown_connections 2024-09-21T06:47:57.027 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.023+0000 7f57dbfc6640 1 -- 172.21.15.49:0/1593841833 wait complete. 2024-09-21T06:47:57.037 DEBUG:teuthology.orchestra.run.smithi049:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T06:47:57.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:56 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1171260971' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:47:57.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:56 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2310576844' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:47:57.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:56 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3609862507' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:47:57.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:56 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1171260971' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:47:57.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:56 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2310576844' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:47:57.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:56 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3609862507' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:47:57.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.148+0000 7fb28767e640 1 -- 172.21.15.49:0/2208039250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb280108c50 msgr2=0x7fb28010f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:57.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.148+0000 7fb28767e640 1 --2- 172.21.15.49:0/2208039250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb280108c50 0x7fb28010f480 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fb278009ca0 tx=0x7fb27802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.148+0000 7fb28767e640 1 -- 172.21.15.49:0/2208039250 shutdown_connections 2024-09-21T06:47:57.151 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.148+0000 7fb28767e640 1 --2- 172.21.15.49:0/2208039250 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb280108c50 0x7fb28010f480 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.148+0000 7fb28767e640 1 --2- 172.21.15.49:0/2208039250 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108300 0x7fb280108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.148+0000 7fb28767e640 1 --2- 172.21.15.49:0/2208039250 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb2801029d0 0x7fb280102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.148+0000 7fb28767e640 1 -- 172.21.15.49:0/2208039250 >> 172.21.15.49:0/2208039250 conn(0x7fb2800fe3b0 msgr2=0x7fb280100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:57.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.149+0000 7fb28767e640 1 -- 172.21.15.49:0/2208039250 shutdown_connections 2024-09-21T06:47:57.152 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.149+0000 7fb28767e640 1 -- 172.21.15.49:0/2208039250 wait complete. 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.149+0000 7fb28767e640 1 Processor -- start 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.149+0000 7fb28767e640 1 -- start start 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.149+0000 7fb28767e640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2801029d0 0x7fb28019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.149+0000 7fb28767e640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb280108300 0x7fb28019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.149+0000 7fb28767e640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108c50 0x7fb28019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28767e640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb280112910 con 0x7fb2801029d0 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28767e640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb280112790 con 0x7fb280108c50 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28767e640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb280112a90 con 0x7fb280108300 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28541a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2801029d0 0x7fb28019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28541a640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2801029d0 0x7fb28019b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:53806/0 (socket says 172.21.15.49:53806) 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28541a640 1 -- 172.21.15.49:0/1393101752 learned_addr learned my addr 172.21.15.49:0/1393101752 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:47:57.154 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb285c1b640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108c50 0x7fb28019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb284c19640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb280108300 0x7fb28019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28541a640 1 -- 172.21.15.49:0/1393101752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb280108300 msgr2=0x7fb28019b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28541a640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb280108300 0x7fb28019b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28541a640 1 -- 172.21.15.49:0/1393101752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108c50 msgr2=0x7fb28019bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28541a640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108c50 0x7fb28019bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28541a640 1 -- 172.21.15.49:0/1393101752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2801a6450 con 0x7fb2801029d0 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28541a640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2801029d0 0x7fb28019b140 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00e9f0 tx=0x7fb27c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb2767fc640 1 -- 172.21.15.49:0/1393101752 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00cd80 con 0x7fb2801029d0 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb2767fc640 1 -- 172.21.15.49:0/1393101752 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb27c0054d0 con 0x7fb2801029d0 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2801a6740 con 0x7fb2801029d0 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb2767fc640 1 -- 172.21.15.49:0/1393101752 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c010690 con 0x7fb2801029d0 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.150+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2801a6c40 con 0x7fb2801029d0 2024-09-21T06:47:57.155 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.151+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb280102de0 con 0x7fb2801029d0 2024-09-21T06:47:57.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.153+0000 7fb2767fc640 1 -- 172.21.15.49:0/1393101752 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fb27c004e30 con 0x7fb2801029d0 2024-09-21T06:47:57.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.154+0000 7fb2767fc640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb26c0b6680 0x7fb26c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:57.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.154+0000 7fb284c19640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb26c0b6680 0x7fb26c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:57.156 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.154+0000 7fb2767fc640 1 -- 172.21.15.49:0/1393101752 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8594+0+0 (secure 0 0 0) 0x7fb27c0e7f20 con 0x7fb2801029d0 2024-09-21T06:47:57.157 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.154+0000 7fb284c19640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb26c0b6680 0x7fb26c0b8b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb270005fd0 tx=0x7fb270005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:57.159 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.157+0000 7fb2767fc640 1 -- 172.21.15.49:0/1393101752 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb27c056710 con 0x7fb2801029d0 2024-09-21T06:47:57.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.413+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fb28006bda0 con 0x7fb2801029d0 2024-09-21T06:47:57.424 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.422+0000 7fb2767fc640 1 -- 172.21.15.49:0/1393101752 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v24) ==== 81+0+834049 (secure 0 0 0) 0x7fb27c0ae3c0 con 0x7fb2801029d0 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: "epoch": 24, 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: "active_gid": 14226, 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: "active_name": "x", 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: "active_addrs": { 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6800", 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 202634858 2024-09-21T06:47:57.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v1", 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:6801", 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 202634858 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: "active_addr": "172.21.15.49:6801/202634858", 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: "active_change": "2024-09-21T06:28:12.021044+0000", 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: "available": true, 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: "standbys": [ 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.435 INFO:teuthology.orchestra.run.smithi049.stdout: "gid": 24142, 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "z", 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "available_modules": [ 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "alerts", 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:57.436 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.437 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.438 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.439 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.440 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.441 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_destination": { 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_destination", 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.442 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_from_name": { 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_from_name", 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "Ceph", 2024-09-21T06:47:57.443 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email From: name", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_host": { 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_host", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.444 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP server", 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_password": { 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_password", 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Password to authenticate with", 2024-09-21T06:47:57.445 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_port": { 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_port", 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "465", 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP port", 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.446 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_sender": { 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_sender", 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.447 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_ssl": { 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_ssl", 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.448 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_user": { 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_user", 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "User to authenticate as", 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.449 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.450 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.451 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.451 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.451 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.451 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.451 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "balancer", 2024-09-21T06:47:57.451 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.451 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "active": { 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "active", 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.452 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.453 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:47:57.453 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.453 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.453 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.453 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.453 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_time": { 2024-09-21T06:47:57.453 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_time", 2024-09-21T06:47:57.453 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0000", 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_weekday": { 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_weekday", 2024-09-21T06:47:57.454 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_max_iterations": { 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:57.455 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "25", 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "250", 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_metrics": { 2024-09-21T06:47:57.456 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_metrics", 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_step": { 2024-09-21T06:47:57.457 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_step", 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.5", 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0.001", 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "0.999", 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.458 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "end_time": { 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_time", 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2359", 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.459 INFO:teuthology.orchestra.run.smithi049.stdout: "end_weekday": { 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_weekday", 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.460 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.461 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.462 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.463 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.464 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.465 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "min_score": { 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_score", 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.466 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "upmap", 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.467 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-compat", 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "none", 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "read", 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap", 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap-read" 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Balancer mode", 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_ids": { 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_ids", 2024-09-21T06:47:57.468 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:57.469 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.470 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_deviation": { 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_deviation", 2024-09-21T06:47:57.471 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_optimizations": { 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:47:57.472 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.473 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm", 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_down_multiplier": { 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_down_multiplier", 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.474 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_refresh_rate": { 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_refresh_rate", 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "20", 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.475 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_starting_port": { 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_starting_port", 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.476 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4721", 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_ptrace": { 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_ptrace", 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.477 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_interval": { 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_interval", 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.478 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.7", 2024-09-21T06:47:57.479 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm_log_destination": { 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm_log_destination", 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.480 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "file", 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "file,syslog", 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "syslog" 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "cgroups_split": { 2024-09-21T06:47:57.481 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cgroups_split", 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.482 INFO:teuthology.orchestra.run.smithi049.stdout: "config_checks_enabled": { 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_checks_enabled", 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "config_dashboard": { 2024-09-21T06:47:57.483 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_dashboard", 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.484 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_alertmanager": { 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_alertmanager", 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.485 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_base": { 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_base", 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_elasticsearch": { 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "elasticsearch container image", 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.487 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_grafana": { 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_grafana", 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.488 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_haproxy": { 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_haproxy", 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.489 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "HAproxy container image", 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_agent": { 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.490 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_collector": { 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.491 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_query": { 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.492 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger query container image", 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_keepalived": { 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_keepalived", 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.493 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Keepalived container image", 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_loki": { 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_loki", 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.494 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Loki container image", 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_nginx": { 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_nginx", 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.495 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Nginx container image", 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_node_exporter": { 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_node_exporter", 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:47:57.496 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_nvmeof": { 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_nvmeof", 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.497 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Nvme-of container image", 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:47:57.498 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_prometheus": { 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_prometheus", 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:47:57.499 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_promtail": { 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_promtail", 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.500 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Promtail container image", 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_samba": { 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_samba", 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.501 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_samba_metrics": { 2024-09-21T06:47:57.502 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_snmp_gateway": { 2024-09-21T06:47:57.503 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "container_init": { 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_init", 2024-09-21T06:47:57.504 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "daemon_cache_timeout": { 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.505 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.506 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "900", 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "default_registry": { 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_registry", 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.507 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io", 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "device_cache_timeout": { 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_cache_timeout", 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.508 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1800", 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "device_enhanced_scan": { 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_enhanced_scan", 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.509 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "facts_cache_timeout": { 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "facts_cache_timeout", 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.510 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "grafana_dashboards_path": { 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:47:57.511 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "host_check_interval": { 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "host_check_interval", 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:57.512 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "hw_monitoring": { 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hw_monitoring", 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.513 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "inventory_list_all": { 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "inventory_list_all", 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.514 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.515 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.516 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.517 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "log_refresh_metadata": { 2024-09-21T06:47:57.518 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_refresh_metadata", 2024-09-21T06:47:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.519 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:47:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.520 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.521 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:47:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.522 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.523 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.524 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.525 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.526 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.527 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:47:57.528 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:47:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.529 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:47:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.530 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:47:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:47:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "*", 2024-09-21T06:47:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.531 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:47:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.532 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "max_count_per_host": { 2024-09-21T06:47:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_count_per_host", 2024-09-21T06:47:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.533 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:47:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.534 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd_draining_count": { 2024-09-21T06:47:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_osd_draining_count", 2024-09-21T06:47:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.535 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:47:57.536 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.537 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.537 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.537 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.537 INFO:teuthology.orchestra.run.smithi049.stdout: "migration_current": { 2024-09-21T06:47:57.537 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "migration_current", 2024-09-21T06:47:57.537 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.538 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.538 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.538 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.538 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.538 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.538 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.538 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "internal - do not modify", 2024-09-21T06:47:57.539 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.539 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.539 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.539 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.539 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-09-21T06:47:57.539 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-09-21T06:47:57.539 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "root", 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm-package", 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "root" 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.540 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "oob_default_addr": { 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "oob_default_addr", 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "169.254.1.1", 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.541 INFO:teuthology.orchestra.run.smithi049.stdout: "prometheus_alerts_path": { 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.542 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_insecure": { 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_insecure", 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.543 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_password": { 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_password", 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.544 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_url": { 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_url", 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_username": { 2024-09-21T06:47:57.545 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_username", 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "secure_monitoring_stack": { 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:47:57.546 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "service_discovery_port": { 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "service_discovery_port", 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.547 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8765", 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.548 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_config_file": { 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_config_file", 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.549 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.550 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3", 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_keepalive_interval": { 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.551 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7", 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "use_agent": { 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_agent", 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.552 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "use_repo_digest": { 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_repo_digest", 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.553 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_failed_host_check": { 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.554 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_daemons": { 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.555 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_hosts": { 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.556 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crash", 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.557 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.558 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.559 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.560 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.561 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "retain_interval": { 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retain_interval", 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.562 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "31536000", 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.563 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_recent_interval": { 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_recent_interval", 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.564 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1209600", 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dashboard", 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.565 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.566 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.567 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.568 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.569 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.570 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.571 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.572 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.572 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:47:57.572 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:47:57.572 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.573 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.574 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.574 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:47:57.574 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:47:57.574 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.575 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.575 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.575 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.575 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.575 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.575 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.575 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.575 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.576 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.576 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.576 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:47:57.576 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:47:57.576 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.576 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.576 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.576 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.577 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.578 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.580 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:47:57.581 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:47:57.582 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:47:57.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_URL": { 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.584 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.585 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.586 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.587 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.588 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.589 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "[]", 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.590 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "{}", 2024-09-21T06:47:57.591 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.592 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.592 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.592 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.592 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.592 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.593 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.593 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.593 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:47:57.593 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:47:57.593 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:47:57.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:47:57.595 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:47:57.596 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:47:57.597 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:47:57.598 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:47:57.599 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.600 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.601 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.602 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:47:57.603 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:57.604 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8", 2024-09-21T06:47:57.605 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.606 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "45", 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.607 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-09-21T06:47:57.608 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.609 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.610 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.611 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.612 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.613 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.614 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "cross_origin_url": { 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cross_origin_url", 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.615 INFO:teuthology.orchestra.run.smithi049.stdout: "crt_file": { 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crt_file", 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "debug": { 2024-09-21T06:47:57.616 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "debug", 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "jwt_token_ttl": { 2024-09-21T06:47:57.617 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "jwt_token_ttl", 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "28800", 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-09-21T06:47:57.618 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.619 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.620 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.621 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.622 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.623 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "motd": { 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "motd", 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.624 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "The message of the day", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.625 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.626 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8080", 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.627 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.628 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.629 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl_server_port": { 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl_server_port", 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8443", 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.630 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "sso_oauth2": { 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sso_oauth2", 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-09-21T06:47:57.631 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "redirect", 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect" 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.632 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.633 INFO:teuthology.orchestra.run.smithi049.stdout: "url_prefix": { 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url_prefix", 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.634 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "devicehealth", 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_monitoring": { 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_monitoring", 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "monitor device health metrics", 2024-09-21T06:47:57.635 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.636 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.637 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.638 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.639 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "mark_out_threshold": { 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mark_out_threshold", 2024-09-21T06:47:57.640 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2419200", 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": { 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_name", 2024-09-21T06:47:57.641 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "device_health_metrics", 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "retention_period": { 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retention_period", 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.642 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15552000", 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_frequency": { 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_frequency", 2024-09-21T06:47:57.643 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "self_heal": { 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "self_heal", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.644 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.645 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.646 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_threshold": { 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_threshold", 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7257600", 2024-09-21T06:47:57.647 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "diskprediction_local", 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.648 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.649 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.650 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.651 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.652 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "predict_interval": { 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predict_interval", 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-09-21T06:47:57.653 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "predictor_model": { 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predictor_model", 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "prophetstor", 2024-09-21T06:47:57.654 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.655 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.656 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "influx", 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": false, 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "batch_size": { 2024-09-21T06:47:57.657 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "batch_size", 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5000", 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "database": { 2024-09-21T06:47:57.658 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "database", 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "ceph", 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": { 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hostname", 2024-09-21T06:47:57.659 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.660 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "30", 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "5", 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.661 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.662 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.663 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.664 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.665 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "password": { 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "password", 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:47:57.666 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "port": { 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "port", 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8086", 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server port", 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.667 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.668 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "false", 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.669 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "threads": { 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threads", 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "32", 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.670 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "username": { 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "username", 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.671 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "verify_ssl": { 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "verify_ssl", 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "true", 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.672 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "insights", 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.673 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.674 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.675 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.676 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.677 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.678 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "iostat", 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.679 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.680 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.681 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.682 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.683 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.684 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "k8sevents", 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_event_retention_days": { 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.685 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7", 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "config_check_secs": { 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_check_secs", 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.686 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "10", 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.687 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.688 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.689 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.690 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.691 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.692 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "localpool", 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.693 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "failure_domain": { 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "failure_domain", 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "host", 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:47:57.694 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.695 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.696 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.697 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.698 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": { 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_size", 2024-09-21T06:47:57.699 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "num_rep": { 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "num_rep", 2024-09-21T06:47:57.700 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3", 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": { 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_num", 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.701 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "128", 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "prefix": { 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prefix", 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.702 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.703 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "subtree": { 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "subtree", 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "rack", 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.704 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mds_autoscaler", 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.705 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.706 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.707 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.708 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.709 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.710 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirroring", 2024-09-21T06:47:57.711 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.712 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.713 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.714 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.715 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.716 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.717 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "nfs", 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.718 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.719 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.720 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.721 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.722 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.723 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "fail_fs": { 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "fail_fs", 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.724 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.725 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.726 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.727 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.728 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.729 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator": { 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm", 2024-09-21T06:47:57.730 INFO:teuthology.orchestra.run.smithi049.stdout: "rook", 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "test_orchestrator" 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Orchestrator backend", 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.731 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_perf_query", 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.732 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.733 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.734 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.735 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.736 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.737 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.738 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_support", 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.739 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.740 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.741 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.742 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.743 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.744 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_autoscaler", 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.745 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.746 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.747 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.748 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.749 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.750 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.751 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "threshold": { 2024-09-21T06:47:57.752 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threshold", 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1.0", 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "scaling threshold", 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.753 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "progress", 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_pg_recovery_event": { 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.754 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.755 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.756 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.757 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.758 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.759 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "max_completed_events": { 2024-09-21T06:47:57.760 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_completed_events", 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "50", 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.761 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.762 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.763 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus", 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "cache": { 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cache", 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.764 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "exclude_perf_counters": { 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "exclude_perf_counters", 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:47:57.765 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.766 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.767 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.768 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.770 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools": { 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools", 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "300", 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.772 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_interval": { 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_interval", 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15.0", 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.773 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.774 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "9283", 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.775 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.776 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "stale_cache_strategy": { 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stale_cache_strategy", 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "log", 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.777 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "default", 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "default", 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "error" 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.778 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.779 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_support", 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.780 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.781 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.782 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.783 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.784 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_snap_create": { 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.785 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.786 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.787 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "trash_purge_schedule": { 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "trash_purge_schedule", 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.788 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "restful", 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.789 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_auth": { 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_auth", 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.790 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.791 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.792 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.793 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.794 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.795 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "max_requests": { 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_requests", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.796 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.797 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.798 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.799 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rgw", 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.800 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.801 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.802 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.803 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.804 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.805 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.806 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.807 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rook", 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.808 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.809 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.810 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.811 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.812 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.813 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "storage_class": { 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "storage_class", 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "local", 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:47:57.814 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "selftest", 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.815 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.817 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.818 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.819 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "roption1": { 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption1", 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.820 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "roption2": { 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption2", 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "xyz", 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.821 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption1": { 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption1", 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.822 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption2": { 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption2", 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.823 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption3": { 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption3", 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption4": { 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption4", 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.825 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption5": { 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption5", 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.826 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption6": { 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption6", 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption7": { 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption7", 2024-09-21T06:47:57.827 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "42", 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.828 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "testkey": { 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testkey", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.829 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "testlkey": { 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testlkey", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.830 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "testnewline": { 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testnewline", 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.831 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smb", 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "internal_store_backend": { 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "internal_store_backend", 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.832 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.833 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.834 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.836 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.837 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.838 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "update_orchestration": { 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "update_orchestration", 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.839 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap_schedule", 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.840 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_m_granularity": { 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_m_granularity", 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "dump_on_update": { 2024-09-21T06:47:57.841 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dump_on_update", 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.842 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.843 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.844 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.845 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.846 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.847 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stats", 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.848 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.849 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.850 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.851 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.852 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.853 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "status", 2024-09-21T06:47:57.854 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.855 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.856 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.857 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.858 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.859 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.860 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telegraf", 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "address": { 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "address", 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.861 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15", 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.862 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.863 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.864 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.865 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.866 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.867 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.868 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telemetry", 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_basic": { 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_basic", 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.869 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_crash": { 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_crash", 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.870 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_device": { 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_device", 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.871 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_ident": { 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_ident", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.872 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_perf": { 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_perf", 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.873 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "contact": { 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "contact", 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.874 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "description": { 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "description", 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.875 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "device_url": { 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_url", 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.876 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.877 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "24", 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "8", 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.878 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "last_opt_revision": { 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "last_opt_revision", 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1", 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.879 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard": { 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard", 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.880 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard_description": { 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard_description", 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.881 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.882 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.883 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.884 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.885 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.886 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "organization": { 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "organization", 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.887 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "proxy": { 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "proxy", 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.888 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.889 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "url": { 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url", 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.890 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "test_orchestrator", 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.891 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.892 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.893 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.894 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.895 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.896 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.897 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "volumes", 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.898 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.899 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.900 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.901 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.902 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_clones": { 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_clones", 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4", 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.903 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "periodic_async_work": { 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "periodic_async_work", 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Periodically check for async work", 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.904 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_delay": { 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:47:57.905 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.906 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.907 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix", 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "discovery_interval": { 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "discovery_interval", 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "100", 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.908 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "identifier": { 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "identifier", 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.909 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.910 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.911 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.912 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.913 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.914 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.915 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.916 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_host": { 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_host", 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.917 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_port": { 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_port", 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10051", 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.918 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_sender": { 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_sender", 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.919 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: "gid": 24164, 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "y", 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: "available_modules": [ 2024-09-21T06:47:57.920 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "alerts", 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.921 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.922 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.923 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.924 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.925 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.926 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_destination": { 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_destination", 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.927 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_from_name": { 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_from_name", 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "Ceph", 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.928 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email From: name", 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_host": { 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_host", 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP server", 2024-09-21T06:47:57.929 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_password": { 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_password", 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Password to authenticate with", 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.930 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_port": { 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_port", 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "465", 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP port", 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.931 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_sender": { 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_sender", 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.932 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_ssl": { 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_ssl", 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.933 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_user": { 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_user", 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "User to authenticate as", 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.934 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.935 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "balancer", 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "active": { 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "active", 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.936 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_time": { 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_time", 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.937 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0000", 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_weekday": { 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_weekday", 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.938 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_max_iterations": { 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.939 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "25", 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "250", 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_metrics": { 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_metrics", 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.940 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_step": { 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_step", 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.941 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.5", 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0.001", 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "0.999", 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "end_time": { 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_time", 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.942 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2359", 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "end_weekday": { 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_weekday", 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.943 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.944 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.945 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.946 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.947 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.948 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "min_score": { 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_score", 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.949 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.950 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "upmap", 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-compat", 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "none", 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "read", 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap", 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap-read" 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Balancer mode", 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.951 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_ids": { 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_ids", 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.952 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.953 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.954 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_deviation": { 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_deviation", 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_optimizations": { 2024-09-21T06:47:57.955 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.956 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm", 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_down_multiplier": { 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_down_multiplier", 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.957 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_refresh_rate": { 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_refresh_rate", 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "20", 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.958 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_starting_port": { 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_starting_port", 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4721", 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.959 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_ptrace": { 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_ptrace", 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.960 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_interval": { 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_interval", 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:57.961 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.7", 2024-09-21T06:47:57.962 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm_log_destination": { 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm_log_destination", 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.963 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "file", 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "file,syslog", 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "syslog" 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "cgroups_split": { 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cgroups_split", 2024-09-21T06:47:57.964 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "config_checks_enabled": { 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_checks_enabled", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.965 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "config_dashboard": { 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_dashboard", 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.966 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_alertmanager": { 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_alertmanager", 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.967 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_base": { 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_base", 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.968 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_elasticsearch": { 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.969 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "elasticsearch container image", 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_grafana": { 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_grafana", 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.970 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_haproxy": { 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_haproxy", 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.971 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "HAproxy container image", 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_agent": { 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.972 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_collector": { 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:47:57.973 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_query": { 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:47:57.974 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger query container image", 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_keepalived": { 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_keepalived", 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.975 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Keepalived container image", 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_loki": { 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_loki", 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.976 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Loki container image", 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_nginx": { 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_nginx", 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.977 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Nginx container image", 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_node_exporter": { 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_node_exporter", 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.978 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_nvmeof": { 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_nvmeof", 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.979 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Nvme-of container image", 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.980 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_prometheus": { 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_prometheus", 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.981 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_promtail": { 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_promtail", 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.982 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Promtail container image", 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_samba": { 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_samba", 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.983 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_samba_metrics": { 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.984 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_snmp_gateway": { 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:47:57.985 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "container_init": { 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_init", 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:47:57.986 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "daemon_cache_timeout": { 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.987 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "900", 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.988 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "default_registry": { 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_registry", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.989 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "device_cache_timeout": { 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_cache_timeout", 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1800", 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.990 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "device_enhanced_scan": { 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_enhanced_scan", 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.991 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "facts_cache_timeout": { 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "facts_cache_timeout", 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.992 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "grafana_dashboards_path": { 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.993 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "host_check_interval": { 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "host_check_interval", 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.994 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "hw_monitoring": { 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hw_monitoring", 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.995 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "inventory_list_all": { 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "inventory_list_all", 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.996 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:57.997 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "log_refresh_metadata": { 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_refresh_metadata", 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.998 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:57.999 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.000 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.001 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.002 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.003 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "*", 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "max_count_per_host": { 2024-09-21T06:47:58.004 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_count_per_host", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd_draining_count": { 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_osd_draining_count", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.005 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "migration_current": { 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "migration_current", 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.006 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "internal - do not modify", 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.007 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "root", 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm-package", 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "root" 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "oob_default_addr": { 2024-09-21T06:47:58.008 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "oob_default_addr", 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "169.254.1.1", 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.009 INFO:teuthology.orchestra.run.smithi049.stdout: "prometheus_alerts_path": { 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_insecure": { 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_insecure", 2024-09-21T06:47:58.010 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_password": { 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_password", 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.011 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_url": { 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_url", 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.012 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_username": { 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_username", 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.013 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "secure_monitoring_stack": { 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.014 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "service_discovery_port": { 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "service_discovery_port", 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.015 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8765", 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.016 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_config_file": { 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_config_file", 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.017 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.018 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3", 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_keepalive_interval": { 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:47:58.019 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7", 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "use_agent": { 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_agent", 2024-09-21T06:47:58.020 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "use_repo_digest": { 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_repo_digest", 2024-09-21T06:47:58.021 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_failed_host_check": { 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:47:58.022 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_daemons": { 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:47:58.023 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_hosts": { 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:47:58.024 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.025 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crash", 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.026 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.027 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.028 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.029 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.030 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "retain_interval": { 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retain_interval", 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "31536000", 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.031 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.032 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_recent_interval": { 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_recent_interval", 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1209600", 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.033 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dashboard", 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.034 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.035 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.036 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.037 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.038 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.039 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.040 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.041 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.042 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.043 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:47:58.044 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.045 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.046 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.047 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.048 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.049 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_URL": { 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.050 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.051 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.052 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.053 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.054 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.055 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "[]", 2024-09-21T06:47:58.056 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "{}", 2024-09-21T06:47:58.057 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.058 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.059 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.060 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.061 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.062 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.063 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.064 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.065 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.066 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.067 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.068 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.069 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8", 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.070 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "45", 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.071 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.072 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.073 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.074 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.075 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.076 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.077 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.078 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.079 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "cross_origin_url": { 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cross_origin_url", 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.080 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "crt_file": { 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crt_file", 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.081 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "debug": { 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "debug", 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.082 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "jwt_token_ttl": { 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "jwt_token_ttl", 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "28800", 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.083 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.084 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.085 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.086 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.087 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.088 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "motd": { 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "motd", 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.089 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "The message of the day", 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.090 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.091 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.092 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8080", 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.093 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.094 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl_server_port": { 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl_server_port", 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8443", 2024-09-21T06:47:58.095 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "sso_oauth2": { 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sso_oauth2", 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.096 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.097 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "redirect", 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect" 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-09-21T06:47:58.098 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "url_prefix": { 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url_prefix", 2024-09-21T06:47:58.099 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "devicehealth", 2024-09-21T06:47:58.100 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_monitoring": { 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_monitoring", 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "monitor device health metrics", 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.101 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.102 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.103 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.104 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.105 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.106 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "mark_out_threshold": { 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mark_out_threshold", 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2419200", 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.107 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": { 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_name", 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "device_health_metrics", 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:47:58.108 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "retention_period": { 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retention_period", 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15552000", 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.109 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_frequency": { 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_frequency", 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.110 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "self_heal": { 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "self_heal", 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.111 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.112 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.113 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_threshold": { 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_threshold", 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7257600", 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.114 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "diskprediction_local", 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.115 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.116 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.117 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.118 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.119 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "predict_interval": { 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predict_interval", 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.120 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "predictor_model": { 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predictor_model", 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.121 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "prophetstor", 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:58.122 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.123 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "influx", 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": false, 2024-09-21T06:47:58.124 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "batch_size": { 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "batch_size", 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5000", 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.125 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "database": { 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "database", 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "ceph", 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.126 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": { 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hostname", 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.127 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "30", 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "5", 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.128 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.129 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.130 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.131 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.132 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "password": { 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "password", 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.133 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "port": { 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "port", 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.134 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8086", 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server port", 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.135 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-09-21T06:47:58.136 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "false", 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "threads": { 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threads", 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.137 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "32", 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "username": { 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "username", 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.138 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "verify_ssl": { 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "verify_ssl", 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.139 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "true", 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "insights", 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.140 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.141 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.142 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.143 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.144 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.145 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.146 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "iostat", 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.147 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.148 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.149 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.150 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.151 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.152 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "k8sevents", 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_event_retention_days": { 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.153 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7", 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "config_check_secs": { 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_check_secs", 2024-09-21T06:47:58.154 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "10", 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.155 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.156 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.157 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.158 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.159 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.160 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "localpool", 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.161 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "failure_domain": { 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "failure_domain", 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "host", 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:47:58.162 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.163 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.164 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.165 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.166 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.167 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": { 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_size", 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.168 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "num_rep": { 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "num_rep", 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3", 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:47:58.169 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": { 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_num", 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "128", 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.170 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "prefix": { 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prefix", 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.172 INFO:teuthology.orchestra.run.smithi049.stdout: "subtree": { 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "subtree", 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "rack", 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.173 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mds_autoscaler", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.174 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.175 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.176 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.177 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.178 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.179 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirroring", 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.180 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.181 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.182 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.183 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.184 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.185 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "nfs", 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.186 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.187 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.188 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.189 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.190 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.191 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.192 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "fail_fs": { 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "fail_fs", 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.193 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.194 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.195 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.196 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.197 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.198 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator": { 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm", 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "rook", 2024-09-21T06:47:58.199 INFO:teuthology.orchestra.run.smithi049.stdout: "test_orchestrator" 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Orchestrator backend", 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.200 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_perf_query", 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.201 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.202 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.203 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.204 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.205 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.206 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.207 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.209 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.209 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_support", 2024-09-21T06:47:58.209 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.209 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.210 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.211 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.212 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.213 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.214 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.215 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_autoscaler", 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.216 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.217 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.218 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.219 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.220 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.221 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.222 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "threshold": { 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threshold", 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1.0", 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "scaling threshold", 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:47:58.223 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "progress", 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_pg_recovery_event": { 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.224 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.225 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.226 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.227 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.228 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.229 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.230 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "max_completed_events": { 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_completed_events", 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "50", 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.231 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.232 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.233 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus", 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "cache": { 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cache", 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.234 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "exclude_perf_counters": { 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "exclude_perf_counters", 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.235 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.236 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.237 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.238 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.239 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.240 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools": { 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools", 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.241 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "300", 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.242 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_interval": { 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_interval", 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15.0", 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.243 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.244 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "9283", 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:47:58.245 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.246 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "stale_cache_strategy": { 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stale_cache_strategy", 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "log", 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.247 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "default", 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "default", 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: "error" 2024-09-21T06:47:58.248 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-09-21T06:47:58.249 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_support", 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.250 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.251 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.252 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.253 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.254 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_snap_create": { 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.255 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.256 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.257 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "trash_purge_schedule": { 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "trash_purge_schedule", 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.258 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "restful", 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_auth": { 2024-09-21T06:47:58.259 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_auth", 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-09-21T06:47:58.260 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.261 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.262 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.263 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.264 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.265 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "max_requests": { 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_requests", 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.266 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.267 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.268 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.269 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rgw", 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.270 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.271 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.272 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.273 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.274 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.275 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.276 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rook", 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.277 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.278 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.279 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.280 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.281 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.282 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.283 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "storage_class": { 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "storage_class", 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "local", 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.284 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "selftest", 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.285 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.286 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.287 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.288 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.289 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "roption1": { 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption1", 2024-09-21T06:47:58.290 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "roption2": { 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption2", 2024-09-21T06:47:58.291 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "xyz", 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption1": { 2024-09-21T06:47:58.292 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption1", 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption2": { 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption2", 2024-09-21T06:47:58.293 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption3": { 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption3", 2024-09-21T06:47:58.294 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption4": { 2024-09-21T06:47:58.295 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption4", 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption5": { 2024-09-21T06:47:58.296 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption5", 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption6": { 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption6", 2024-09-21T06:47:58.297 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption7": { 2024-09-21T06:47:58.298 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption7", 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "42", 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.299 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "testkey": { 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testkey", 2024-09-21T06:47:58.300 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "testlkey": { 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testlkey", 2024-09-21T06:47:58.301 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "testnewline": { 2024-09-21T06:47:58.302 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testnewline", 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.303 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smb", 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "internal_store_backend": { 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "internal_store_backend", 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.304 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.305 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.306 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.307 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.308 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.309 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.310 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "update_orchestration": { 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "update_orchestration", 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:47:58.311 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap_schedule", 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_m_granularity": { 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_m_granularity", 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.312 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "dump_on_update": { 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dump_on_update", 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.313 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.314 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.315 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.316 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.317 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.318 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.319 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stats", 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.320 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.321 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.322 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.323 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.324 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.325 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.326 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "status", 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.327 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.328 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.329 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.330 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.331 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.332 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telegraf", 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "address": { 2024-09-21T06:47:58.333 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "address", 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:58.334 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15", 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.335 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.336 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.337 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.338 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.339 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.340 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.341 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telemetry", 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_basic": { 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_basic", 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.342 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_crash": { 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_crash", 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.343 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_device": { 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_device", 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.344 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_ident": { 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_ident", 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.345 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_perf": { 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_perf", 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:47:58.346 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "contact": { 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "contact", 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.347 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "description": { 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "description", 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.348 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "device_url": { 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_url", 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.349 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.350 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "24", 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "8", 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.351 INFO:teuthology.orchestra.run.smithi049.stdout: "last_opt_revision": { 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "last_opt_revision", 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1", 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.352 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard": { 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard", 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.353 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard_description": { 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard_description", 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.354 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.355 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.356 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.357 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.358 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "organization": { 2024-09-21T06:47:58.359 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "organization", 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "proxy": { 2024-09-21T06:47:58.360 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "proxy", 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.361 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "url": { 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url", 2024-09-21T06:47:58.362 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.363 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "test_orchestrator", 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.364 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.365 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.366 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.367 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.368 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.369 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "volumes", 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.370 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.371 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.372 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.373 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.374 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_clones": { 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_clones", 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.375 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4", 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "periodic_async_work": { 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "periodic_async_work", 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.376 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Periodically check for async work", 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_delay": { 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.377 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.378 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.379 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix", 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.380 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "discovery_interval": { 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "discovery_interval", 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "100", 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.381 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "identifier": { 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "identifier", 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.382 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.383 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.384 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.385 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.386 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.387 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.388 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_host": { 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_host", 2024-09-21T06:47:58.389 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_port": { 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_port", 2024-09-21T06:47:58.390 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10051", 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_sender": { 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_sender", 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.391 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:58.392 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "modules": [ 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm", 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "dashboard", 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "iostat", 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "nfs", 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "restful", 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "snap_schedule" 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "available_modules": [ 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "alerts", 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.393 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.394 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.395 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.396 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.397 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.398 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.399 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_destination": { 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_destination", 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.400 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_from_name": { 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_from_name", 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "Ceph", 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Email From: name", 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.401 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_host": { 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_host", 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP server", 2024-09-21T06:47:58.402 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_password": { 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_password", 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Password to authenticate with", 2024-09-21T06:47:58.403 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_port": { 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_port", 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "465", 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP port", 2024-09-21T06:47:58.404 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_sender": { 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_sender", 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:47:58.405 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_ssl": { 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_ssl", 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:47:58.406 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "smtp_user": { 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smtp_user", 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "User to authenticate as", 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.407 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.408 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "balancer", 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "active": { 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "active", 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.409 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_time": { 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_time", 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.410 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0000", 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "begin_weekday": { 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "begin_weekday", 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.411 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_max_iterations": { 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.412 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "25", 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "250", 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_metrics": { 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_metrics", 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.413 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "crush_compat_step": { 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crush_compat_step", 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.414 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.5", 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0.001", 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "0.999", 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "end_time": { 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_time", 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.415 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2359", 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "end_weekday": { 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "end_weekday", 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.416 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "0", 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "6", 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.417 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.418 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.419 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.420 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.421 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "min_score": { 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_score", 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.422 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "upmap", 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "crush-compat", 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "none", 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "read", 2024-09-21T06:47:58.423 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap", 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap-read" 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Balancer mode", 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_ids": { 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_ids", 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.424 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.425 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.426 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_deviation": { 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_deviation", 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.427 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "upmap_max_optimizations": { 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.428 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm", 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_down_multiplier": { 2024-09-21T06:47:58.429 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_down_multiplier", 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_refresh_rate": { 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_refresh_rate", 2024-09-21T06:47:58.430 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "20", 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "agent_starting_port": { 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "agent_starting_port", 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.431 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4721", 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_ptrace": { 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_ptrace", 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.432 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_interval": { 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_interval", 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.433 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.434 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0.7", 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm_log_destination": { 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cephadm_log_destination", 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.435 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "file", 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "file,syslog", 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "syslog" 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "cgroups_split": { 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cgroups_split", 2024-09-21T06:47:58.436 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "config_checks_enabled": { 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_checks_enabled", 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.437 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "config_dashboard": { 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_dashboard", 2024-09-21T06:47:58.438 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_alertmanager": { 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_alertmanager", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.439 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_base": { 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_base", 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.440 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_elasticsearch": { 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.441 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "elasticsearch container image", 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_grafana": { 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_grafana", 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.442 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_haproxy": { 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_haproxy", 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.443 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "HAproxy container image", 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_agent": { 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.444 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_collector": { 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:47:58.445 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_jaeger_query": { 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.446 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Jaeger query container image", 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_keepalived": { 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_keepalived", 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:47:58.447 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Keepalived container image", 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_loki": { 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_loki", 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.448 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Loki container image", 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_nginx": { 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_nginx", 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.449 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Nginx container image", 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_node_exporter": { 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_node_exporter", 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.450 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_nvmeof": { 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_nvmeof", 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.451 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Nvme-of container image", 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:47:58.452 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_prometheus": { 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_prometheus", 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.453 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Prometheus container image", 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_promtail": { 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_promtail", 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.454 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Promtail container image", 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_samba": { 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_samba", 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.455 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_samba_metrics": { 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.456 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "container_image_snmp_gateway": { 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.457 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "container_init": { 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "container_init", 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.458 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "daemon_cache_timeout": { 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.459 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "900", 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.460 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "default_registry": { 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "default_registry", 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "docker.io", 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.461 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "device_cache_timeout": { 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_cache_timeout", 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1800", 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.462 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "device_enhanced_scan": { 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_enhanced_scan", 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.463 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "facts_cache_timeout": { 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "facts_cache_timeout", 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.464 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "grafana_dashboards_path": { 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:47:58.465 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "host_check_interval": { 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "host_check_interval", 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:47:58.466 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "hw_monitoring": { 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hw_monitoring", 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.467 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "inventory_list_all": { 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "inventory_list_all", 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:47:58.468 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.469 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "log_refresh_metadata": { 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_refresh_metadata", 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.470 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.471 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.472 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.473 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.474 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.475 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "*", 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.476 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "max_count_per_host": { 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_count_per_host", 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.477 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "max_osd_draining_count": { 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_osd_draining_count", 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.478 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "migration_current": { 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "migration_current", 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.479 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "internal - do not modify", 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "mode": { 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mode", 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "root", 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.480 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm-package", 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "root" 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "oob_default_addr": { 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "oob_default_addr", 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "169.254.1.1", 2024-09-21T06:47:58.481 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "prometheus_alerts_path": { 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:47:58.482 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_insecure": { 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_insecure", 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.483 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_password": { 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_password", 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.484 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_url": { 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_url", 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.485 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "registry_username": { 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "registry_username", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.486 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "secure_monitoring_stack": { 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.487 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "service_discovery_port": { 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "service_discovery_port", 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8765", 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.488 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_config_file": { 2024-09-21T06:47:58.489 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_config_file", 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:47:58.490 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3", 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "ssh_keepalive_interval": { 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:47:58.491 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7", 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "use_agent": { 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_agent", 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.492 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "use_repo_digest": { 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "use_repo_digest", 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.493 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_failed_host_check": { 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.494 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_daemons": { 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.495 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_on_stray_hosts": { 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.496 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crash", 2024-09-21T06:47:58.497 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.498 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.499 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.500 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.501 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.502 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "retain_interval": { 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retain_interval", 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "31536000", 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.503 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.504 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_recent_interval": { 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_recent_interval", 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1209600", 2024-09-21T06:47:58.505 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dashboard", 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.506 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.507 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.508 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.509 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.510 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.511 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.512 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.513 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.514 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.515 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.516 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.517 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.518 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:47:58.519 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:47:58.520 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:47:58.521 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:47:58.522 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_URL": { 2024-09-21T06:47:58.523 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.524 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.525 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.526 INFO:teuthology.orchestra.run.smithi049.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:47:58.527 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:47:58.528 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.529 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "[]", 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.530 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "{}", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.531 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.532 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.533 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.534 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.535 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.536 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.537 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.538 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.539 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.540 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.541 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.542 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.543 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "45", 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.544 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.545 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "admin", 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.546 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.547 INFO:teuthology.orchestra.run.smithi049.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:47:58.548 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.549 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.550 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:58.551 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "cross_origin_url": { 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cross_origin_url", 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.552 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "crt_file": { 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "crt_file", 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.553 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "debug": { 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "debug", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.554 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "jwt_token_ttl": { 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "jwt_token_ttl", 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "28800", 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.555 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.556 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.557 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.558 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.559 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.560 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.561 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "motd": { 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "motd", 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "The message of the day", 2024-09-21T06:47:58.562 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.563 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.564 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8080", 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.565 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.566 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.567 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl_server_port": { 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl_server_port", 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8443", 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.568 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "sso_oauth2": { 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sso_oauth2", 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.569 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "redirect", 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "redirect" 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.570 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.571 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "url_prefix": { 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url_prefix", 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.572 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "devicehealth", 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_monitoring": { 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_monitoring", 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.573 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "monitor device health metrics", 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.574 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.575 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.576 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.577 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.578 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "mark_out_threshold": { 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mark_out_threshold", 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "2419200", 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.579 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "pool_name": { 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pool_name", 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "device_health_metrics", 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.580 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "retention_period": { 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "retention_period", 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15552000", 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.581 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_frequency": { 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_frequency", 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.582 INFO:teuthology.orchestra.run.smithi049.stdout: "self_heal": { 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "self_heal", 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:58.583 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.584 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "warn_threshold": { 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "warn_threshold", 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.585 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7257600", 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "diskprediction_local", 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.586 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.587 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.588 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.589 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.590 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "predict_interval": { 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predict_interval", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.591 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "86400", 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "predictor_model": { 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "predictor_model", 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.592 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "prophetstor", 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.593 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "600", 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.594 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "influx", 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": false, 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "batch_size": { 2024-09-21T06:47:58.595 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "batch_size", 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5000", 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.596 INFO:teuthology.orchestra.run.smithi049.stdout: "database": { 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "database", 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "ceph", 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "hostname": { 2024-09-21T06:47:58.597 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "hostname", 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.598 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "30", 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "5", 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.599 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.600 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.601 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.602 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.603 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "password": { 2024-09-21T06:47:58.604 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "password", 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "port": { 2024-09-21T06:47:58.605 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "port", 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "8086", 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "InfluxDB server port", 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.606 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.607 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "ssl": { 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ssl", 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "false", 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.608 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "threads": { 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threads", 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "32", 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.609 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "username": { 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "username", 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.610 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "verify_ssl": { 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "verify_ssl", 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "true", 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.611 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "insights", 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.612 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.613 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.614 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.615 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.616 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.617 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.617 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.617 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.617 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.617 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.617 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.617 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.617 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.617 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.618 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "iostat", 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.619 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.620 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.621 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.622 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.623 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.624 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "k8sevents", 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "ceph_event_retention_days": { 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.625 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "7", 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "config_check_secs": { 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "config_check_secs", 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.626 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "10", 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.627 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.628 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.629 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.630 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.631 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.632 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "localpool", 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.633 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "failure_domain": { 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "failure_domain", 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "host", 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:47:58.634 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.635 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.636 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.637 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.638 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.639 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "min_size": { 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "min_size", 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:47:58.640 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "num_rep": { 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "num_rep", 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3", 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.641 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_num": { 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_num", 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "128", 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.642 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "prefix": { 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prefix", 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.643 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.644 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "subtree": { 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "subtree", 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "rack", 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.645 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mds_autoscaler", 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.646 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.647 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.648 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.649 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.650 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.651 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirroring", 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.652 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.653 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.654 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.655 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.656 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.657 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "nfs", 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.658 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.659 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.660 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.661 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.662 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.663 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.664 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "fail_fs": { 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "fail_fs", 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.665 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.666 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.667 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.668 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.669 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.670 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator": { 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "orchestrator", 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "cephadm", 2024-09-21T06:47:58.671 INFO:teuthology.orchestra.run.smithi049.stdout: "rook", 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "test_orchestrator" 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Orchestrator backend", 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.672 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_perf_query", 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.673 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.674 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.675 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.676 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.677 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.678 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "osd_support", 2024-09-21T06:47:58.679 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.680 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.681 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.682 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.683 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.684 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.685 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "pg_autoscaler", 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.686 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.687 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.688 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.689 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.690 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.691 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.692 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "threshold": { 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "threshold", 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "3.0", 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1.0", 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "scaling threshold", 2024-09-21T06:47:58.693 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "progress", 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_pg_recovery_event": { 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.694 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.695 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.696 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.697 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.698 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.699 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.700 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "max_completed_events": { 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_completed_events", 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "50", 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.701 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "sleep_interval": { 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sleep_interval", 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:47:58.702 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.703 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "prometheus", 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "cache": { 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "cache", 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.704 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "exclude_perf_counters": { 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "exclude_perf_counters", 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.705 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.706 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.707 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.708 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.709 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.710 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools": { 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools", 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.711 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "300", 2024-09-21T06:47:58.712 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "scrape_interval": { 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "scrape_interval", 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15.0", 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.713 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "::", 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.714 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "9283", 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.715 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.716 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "stale_cache_strategy": { 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stale_cache_strategy", 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "log", 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.717 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_behaviour": { 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_behaviour", 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "default", 2024-09-21T06:47:58.718 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "default", 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "error" 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "standby_error_status_code": { 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "standby_error_status_code", 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.719 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "400", 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "599", 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_support", 2024-09-21T06:47:58.720 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.721 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.722 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.723 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.724 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_snap_create": { 2024-09-21T06:47:58.725 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10", 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:47:58.726 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.727 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "trash_purge_schedule": { 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "trash_purge_schedule", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.728 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "restful", 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.729 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "enable_auth": { 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enable_auth", 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.730 INFO:teuthology.orchestra.run.smithi049.stdout: "key_file": { 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "key_file", 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.731 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.732 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.733 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.734 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.735 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "max_requests": { 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_requests", 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.736 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "500", 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "server_addr": { 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_addr", 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.737 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "server_port": { 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "server_port", 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.738 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.739 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rgw", 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.740 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.741 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.742 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.743 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.744 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.745 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "5", 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.746 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.747 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rook", 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.748 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.749 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.750 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.751 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.752 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "storage_class": { 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "storage_class", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.753 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "local", 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "selftest", 2024-09-21T06:47:58.754 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.755 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.756 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.757 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.758 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "roption1": { 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption1", 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.759 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "roption2": { 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "roption2", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "xyz", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.760 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption1": { 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption1", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.761 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption2": { 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption2", 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.762 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption3": { 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption3", 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "float", 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.763 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption4": { 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption4", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption5": { 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption5", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.764 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption6": { 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption6", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.765 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "rwoption7": { 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rwoption7", 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "1", 2024-09-21T06:47:58.766 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "42", 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.767 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "testkey": { 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testkey", 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.768 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "testlkey": { 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testlkey", 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.769 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "testnewline": { 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "testnewline", 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.770 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "smb", 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "internal_store_backend": { 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "internal_store_backend", 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.771 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.772 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.773 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.774 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.775 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.776 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "update_orchestration": { 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "update_orchestration", 2024-09-21T06:47:58.777 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.778 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap_schedule", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "allow_m_granularity": { 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "allow_m_granularity", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.779 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "dump_on_update": { 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "dump_on_update", 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.780 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.781 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.782 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.783 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.784 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.785 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "stats", 2024-09-21T06:47:58.786 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.787 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.788 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.789 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.790 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.791 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.792 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "status", 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.793 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.794 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.795 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.796 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.797 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.798 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telegraf", 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "address": { 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "address", 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.799 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "15", 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.800 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.801 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.802 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.803 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.804 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.805 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.806 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "telemetry", 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_basic": { 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_basic", 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.807 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_crash": { 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_crash", 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:47:58.808 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_device": { 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_device", 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.809 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_ident": { 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_ident", 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.810 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "channel_perf": { 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "channel_perf", 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.811 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "contact": { 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "contact", 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.812 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "description": { 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "description", 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.813 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "device_url": { 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "device_url", 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.814 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "enabled": { 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "enabled", 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.815 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "24", 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "8", 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "last_opt_revision": { 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "last_opt_revision", 2024-09-21T06:47:58.816 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "1", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard": { 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.817 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "leaderboard_description": { 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "leaderboard_description", 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.818 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.819 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.820 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.821 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.822 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.823 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "organization": { 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "organization", 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.824 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "proxy": { 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "proxy", 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.825 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "url": { 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "url", 2024-09-21T06:47:58.826 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.827 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "test_orchestrator", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.828 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.829 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.830 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.831 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.832 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.833 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "volumes", 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.834 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.835 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.836 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.837 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.838 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "max_concurrent_clones": { 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "max_concurrent_clones", 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "4", 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:47:58.839 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "periodic_async_work": { 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "periodic_async_work", 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Periodically check for async work", 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.840 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_delay": { 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.841 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "True", 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.842 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.843 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix", 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "can_run": true, 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "error_string": "", 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "module_options": { 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "discovery_interval": { 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "discovery_interval", 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "uint", 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "100", 2024-09-21T06:47:58.844 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "identifier": { 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "identifier", 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.845 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "interval": { 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "interval", 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "secs", 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "60", 2024-09-21T06:47:58.846 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "log_level": { 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_level", 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.847 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.848 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster": { 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster", 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.849 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_cluster_level": { 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_cluster_level", 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "info", 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [ 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "", 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "critical", 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "debug", 2024-09-21T06:47:58.850 INFO:teuthology.orchestra.run.smithi049.stdout: "error", 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "info", 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "warning" 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "log_to_file": { 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "log_to_file", 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "bool", 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.851 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "False", 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "sqlite3_killpoint": { 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "dev", 2024-09-21T06:47:58.852 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 1, 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "0", 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_host": { 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_host", 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "", 2024-09-21T06:47:58.853 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_port": { 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_port", 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "int", 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "10051", 2024-09-21T06:47:58.854 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "zabbix_sender": { 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "zabbix_sender", 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "str", 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "level": "advanced", 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "flags": 0, 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:47:58.855 INFO:teuthology.orchestra.run.smithi049.stdout: "min": "", 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "max": "", 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "enum_allowed": [], 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "desc": "", 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "long_desc": "", 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "tags": [], 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "see_also": [] 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "services": { 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "dashboard": "https://172.21.15.49:8443/" 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "always_on_modules": { 2024-09-21T06:47:58.856 INFO:teuthology.orchestra.run.smithi049.stdout: "octopus": [ 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "pacific": [ 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-09-21T06:47:58.857 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "quincy": [ 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-09-21T06:47:58.858 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "reef": [ 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-09-21T06:47:58.859 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: ], 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "squid": [ 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "balancer", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "crash", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "devicehealth", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "orchestrator", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "pg_autoscaler", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "progress", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "rbd_support", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "status", 2024-09-21T06:47:58.860 INFO:teuthology.orchestra.run.smithi049.stdout: "telemetry", 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: "volumes" 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: "last_failure_osd_epoch": 5, 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: "active_clients": [ 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "devicehealth", 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 1059228292 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.861 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "libcephsqlite", 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2993677180 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "rbd_support", 2024-09-21T06:47:58.862 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 851141113 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap_schedule", 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-09-21T06:47:58.863 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 2317753400 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "snap_schedule", 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 747832839 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.864 INFO:teuthology.orchestra.run.smithi049.stdout: "name": "volumes", 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout: "addrvec": [ 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout: { 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout: "type": "v2", 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout: "addr": "172.21.15.49:0", 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout: "nonce": 3664457037 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout: ] 2024-09-21T06:47:58.865 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:47:58.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb26c0b6680 msgr2=0x7fb26c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:58.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb26c0b6680 0x7fb26c0b8b90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb270005fd0 tx=0x7fb270005850 comp rx=0 tx=0).stop 2024-09-21T06:47:58.866 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2801029d0 msgr2=0x7fb28019b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2801029d0 0x7fb28019b140 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00e9f0 tx=0x7fb27c00edf0 comp rx=0 tx=0).stop 2024-09-21T06:47:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 shutdown_connections 2024-09-21T06:47:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb26c0b6680 0x7fb26c0b8b90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb280108c50 0x7fb28019bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb280108300 0x7fb28019b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 --2- 172.21.15.49:0/1393101752 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb2801029d0 0x7fb28019b140 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.427+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 >> 172.21.15.49:0/1393101752 conn(0x7fb2800fe3b0 msgr2=0x7fb280107870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.428+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 shutdown_connections 2024-09-21T06:47:58.867 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:47:57.428+0000 7fb28767e640 1 -- 172.21.15.49:0/1393101752 wait complete. 2024-09-21T06:47:58.915 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T06:47:58.916 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T06:47:58.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: pgmap v668: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-21T06:47:58.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1593841833' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:47:58.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:47:58.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1393101752' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:47:58.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.916 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.917 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.917 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.917 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:57 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.917 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: pgmap v668: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1593841833' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1393101752' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:57 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: pgmap v668: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 23 KiB/s wr, 15 op/s 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1593841833' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:47:58.918 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:47:58.919 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1393101752' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:47:58.919 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.919 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.919 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.919 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.919 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:58.919 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:57 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:59.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:58 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:47:59.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:58 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:47:59.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:47:58 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:59.184 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:59.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:58 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:47:59.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:58 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:47:59.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:47:58 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:59.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:58 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:47:59.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:58 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:47:59.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:47:58 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' 2024-09-21T06:47:59.688 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:47:59.688 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:47:59.688 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 4, 2024-09-21T06:47:59.688 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 4, 2024-09-21T06:47:59.688 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 2944, 2024-09-21T06:47:59.688 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 448, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.003532507, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.000046864, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.002321261, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 3, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.003987163, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.001329054 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:47:59.689 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 222, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 217, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 838016, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 133664, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.039874632, 2024-09-21T06:47:59.690 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.019829802, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.027055631, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 216, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.012766104, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000059102 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 838016, 2024-09-21T06:47:59.691 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 133664 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 1, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 165, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 109232, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.017365987, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.014190850, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.001274201, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 163, 2024-09-21T06:47:59.692 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.008718381, 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000053487 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 109232 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.693 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:47:59.694 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:47:59.695 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 30, 2024-09-21T06:47:59.696 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 968, 2024-09-21T06:47:59.697 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 2, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 223, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 806632, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 223, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T06:47:59.698 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T06:47:59.699 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 223, 2024-09-21T06:47:59.699 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 806632, 2024-09-21T06:47:59.699 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T06:47:59.699 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:47:59.699 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:47:59.699 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:47:59.699 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:59.699 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:47:59.699 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:48:00.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:00 smithi098 ceph-mon[34704]: pgmap v669: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-21T06:48:00.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:00 smithi079 ceph-mon[34346]: pgmap v669: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-21T06:48:00.334 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:00 smithi049 ceph-mon[31177]: pgmap v669: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-21T06:48:00.368 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T06:48:00.368 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T06:48:00.368 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-21T06:48:00.368 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-21T06:48:00.368 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-21T06:48:00.368 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T06:48:00.369 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T06:48:00.627 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:01.162 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:48:01.162 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:01.162 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 232, 2024-09-21T06:48:01.162 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 225, 2024-09-21T06:48:01.162 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 842656, 2024-09-21T06:48:01.162 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 137472, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.044179076, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.020621202, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.029576343, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 225, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.017139089, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000076173 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:01.163 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 842656, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 137472 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 1, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 169, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 109936, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.017552949, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.014155956, 2024-09-21T06:48:01.164 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.001403154, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 167, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.009313816, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000055771 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 109936 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.165 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 0, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 2, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 0, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.000355966, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.000267883, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:01.166 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-09-21T06:48:01.167 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:01.168 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:01.169 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 30, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:01.170 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 0, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 0, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 968, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 2, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:01.171 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 229, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 807476, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 229, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 229, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 807476, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:48:01.172 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:48:01.173 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:48:01.867 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T06:48:01.868 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T06:48:01.868 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T06:48:01.868 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:48:01.868 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:48:01.868 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T06:48:01.868 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T06:48:02.129 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:02.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:02 smithi049 ceph-mon[31177]: pgmap v670: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 KiB/s wr, 10 op/s 2024-09-21T06:48:02.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:02 smithi098 ceph-mon[34704]: pgmap v670: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 KiB/s wr, 10 op/s 2024-09-21T06:48:02.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:02 smithi079 ceph-mon[34346]: pgmap v670: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 KiB/s wr, 10 op/s 2024-09-21T06:48:02.636 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 0, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 2, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 0, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.001404767, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.000229050, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:02.637 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 5, 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 168, 2024-09-21T06:48:02.638 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 109856, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.018763731, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.013724872, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.003292615, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 167, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.012917444, 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000077349 2024-09-21T06:48:02.639 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 109856 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 223, 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 218, 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 838288, 2024-09-21T06:48:02.640 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 134304, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.041767779, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.020246801, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.028853893, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 217, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.012362329, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000056969 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.641 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 838288, 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 134304 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-09-21T06:48:02.642 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:02.643 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:02.644 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 148984, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 30, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-09-21T06:48:02.645 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 968, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 2, 2024-09-21T06:48:02.646 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 224, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 806762, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 224, 2024-09-21T06:48:02.647 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 224, 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 806762, 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:48:02.648 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:48:03.419 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T06:48:03.419 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T06:48:03.419 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T06:48:03.419 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T06:48:03.419 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T06:48:03.419 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T06:48:03.420 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T06:48:03.681 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:04.113 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:04 smithi049 ceph-mon[31177]: pgmap v671: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 KiB/s wr, 13 op/s 2024-09-21T06:48:04.237 INFO:teuthology.orchestra.run.smithi049.stdout:{ 2024-09-21T06:48:04.238 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:04.238 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 233, 2024-09-21T06:48:04.238 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 226, 2024-09-21T06:48:04.238 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 842928, 2024-09-21T06:48:04.238 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 138112, 2024-09-21T06:48:04.238 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 4, 2024-09-21T06:48:04.239 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 0, 2024-09-21T06:48:04.239 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.044701872, 2024-09-21T06:48:04.239 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.020232891, 2024-09-21T06:48:04.239 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.031315532, 2024-09-21T06:48:04.239 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:04.239 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:04.240 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 226, 2024-09-21T06:48:04.240 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.017208665, 2024-09-21T06:48:04.240 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000076144 2024-09-21T06:48:04.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.240 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:04.240 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:04.240 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:04.240 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:04.240 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.241 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 842928, 2024-09-21T06:48:04.241 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 138112 2024-09-21T06:48:04.241 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.241 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:04.241 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 1, 2024-09-21T06:48:04.241 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 170, 2024-09-21T06:48:04.242 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:48:04.242 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 110112, 2024-09-21T06:48:04.242 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 3, 2024-09-21T06:48:04.242 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 2, 2024-09-21T06:48:04.242 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.018116085, 2024-09-21T06:48:04.242 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.014488337, 2024-09-21T06:48:04.243 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.001703809, 2024-09-21T06:48:04.243 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:04.243 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:04.243 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 168, 2024-09-21T06:48:04.243 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.009835046, 2024-09-21T06:48:04.243 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000058541 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 110112 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_messages": 0, 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages": 2, 2024-09-21T06:48:04.244 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:48:04.245 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_bytes": 0, 2024-09-21T06:48:04.245 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_created_connections": 2, 2024-09-21T06:48:04.245 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_active_connections": 1, 2024-09-21T06:48:04.245 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_total_time": 0.000417712, 2024-09-21T06:48:04.245 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:48:04.245 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_recv_time": 0.000322053, 2024-09-21T06:48:04.245 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:04.245 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:04.246 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:04.246 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:04.246 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:04.246 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.246 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:04.246 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:04.246 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:04.247 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:04.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.247 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:48:04.247 INFO:teuthology.orchestra.run.smithi049.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:48:04.247 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.247 INFO:teuthology.orchestra.run.smithi049.stdout: "cct": { 2024-09-21T06:48:04.247 INFO:teuthology.orchestra.run.smithi049.stdout: "total_workers": 0, 2024-09-21T06:48:04.248 INFO:teuthology.orchestra.run.smithi049.stdout: "unhealthy_workers": 0 2024-09-21T06:48:04.248 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.248 INFO:teuthology.orchestra.run.smithi049.stdout: "mempool": { 2024-09-21T06:48:04.248 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:04.248 INFO:teuthology.orchestra.run.smithi049.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:04.248 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:04.249 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:04.249 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:04.249 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:04.249 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:04.249 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:04.249 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:04.249 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:04.250 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:04.250 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:04.250 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:04.250 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:04.250 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:04.250 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:04.251 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:04.251 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:04.251 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:04.251 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:04.251 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:04.251 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:04.251 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:04.252 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:04.252 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:04.252 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:04.252 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:04.252 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:04.252 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:04.253 INFO:teuthology.orchestra.run.smithi049.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:04.253 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:04.253 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_items": 0, 2024-09-21T06:48:04.253 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:04.253 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:04.253 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:04.254 INFO:teuthology.orchestra.run.smithi049.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:04.254 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_bytes": 149024, 2024-09-21T06:48:04.254 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_anon_items": 31, 2024-09-21T06:48:04.254 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:48:04.254 INFO:teuthology.orchestra.run.smithi049.stdout: "buffer_meta_items": 0, 2024-09-21T06:48:04.254 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_bytes": 0, 2024-09-21T06:48:04.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_items": 0, 2024-09-21T06:48:04.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:04.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:04.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:04.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:04.255 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_bytes": 0, 2024-09-21T06:48:04.256 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_items": 0, 2024-09-21T06:48:04.256 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:04.256 INFO:teuthology.orchestra.run.smithi049.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:04.256 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:04.256 INFO:teuthology.orchestra.run.smithi049.stdout: "pgmap_items": 0, 2024-09-21T06:48:04.256 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_bytes": 968, 2024-09-21T06:48:04.257 INFO:teuthology.orchestra.run.smithi049.stdout: "mds_co_items": 2, 2024-09-21T06:48:04.257 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:04.257 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_1_items": 0, 2024-09-21T06:48:04.257 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:04.257 INFO:teuthology.orchestra.run.smithi049.stdout: "unittest_2_items": 0 2024-09-21T06:48:04.257 INFO:teuthology.orchestra.run.smithi049.stdout: }, 2024-09-21T06:48:04.257 INFO:teuthology.orchestra.run.smithi049.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:04.258 INFO:teuthology.orchestra.run.smithi049.stdout: "val": 0, 2024-09-21T06:48:04.258 INFO:teuthology.orchestra.run.smithi049.stdout: "max": 104857600, 2024-09-21T06:48:04.258 INFO:teuthology.orchestra.run.smithi049.stdout: "get_started": 0, 2024-09-21T06:48:04.258 INFO:teuthology.orchestra.run.smithi049.stdout: "get": 230, 2024-09-21T06:48:04.258 INFO:teuthology.orchestra.run.smithi049.stdout: "get_sum": 807606, 2024-09-21T06:48:04.258 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:04.259 INFO:teuthology.orchestra.run.smithi049.stdout: "get_or_fail_success": 230, 2024-09-21T06:48:04.259 INFO:teuthology.orchestra.run.smithi049.stdout: "take": 0, 2024-09-21T06:48:04.259 INFO:teuthology.orchestra.run.smithi049.stdout: "take_sum": 0, 2024-09-21T06:48:04.259 INFO:teuthology.orchestra.run.smithi049.stdout: "put": 230, 2024-09-21T06:48:04.259 INFO:teuthology.orchestra.run.smithi049.stdout: "put_sum": 807606, 2024-09-21T06:48:04.259 INFO:teuthology.orchestra.run.smithi049.stdout: "wait": { 2024-09-21T06:48:04.259 INFO:teuthology.orchestra.run.smithi049.stdout: "avgcount": 0, 2024-09-21T06:48:04.260 INFO:teuthology.orchestra.run.smithi049.stdout: "sum": 0.000000000, 2024-09-21T06:48:04.260 INFO:teuthology.orchestra.run.smithi049.stdout: "avgtime": 0.000000000 2024-09-21T06:48:04.260 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:48:04.260 INFO:teuthology.orchestra.run.smithi049.stdout: } 2024-09-21T06:48:04.260 INFO:teuthology.orchestra.run.smithi049.stdout:} 2024-09-21T06:48:04.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:04 smithi098 ceph-mon[34704]: pgmap v671: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 KiB/s wr, 13 op/s 2024-09-21T06:48:04.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:04 smithi079 ceph-mon[34346]: pgmap v671: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 KiB/s wr, 13 op/s 2024-09-21T06:48:04.981 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T06:48:04.981 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T06:48:04.981 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T06:48:04.981 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:48:04.981 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:48:04.981 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T06:48:04.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T06:48:05.242 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:48:05.847 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T06:48:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 2151, 2024-09-21T06:48:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1361, 2024-09-21T06:48:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 828561, 2024-09-21T06:48:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 3462780, 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 17, 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 5, 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.280318182, 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.091704558, 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.108248723, 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.061403862, 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1360, 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.066526223, 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000048916 2024-09-21T06:48:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1959, 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000453963, 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000231 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 356064, 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 109280 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 1713, 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1009, 2024-09-21T06:48:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 1415745, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 3365307, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 234, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 8, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.303053310, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.077524344, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.175451583, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.055621111, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1008, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.098403101, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000097622 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1242, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000259452, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000208 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 1299488, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 237776 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 1231, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 1353, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 510627, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 1281818, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 14, 2024-09-21T06:48:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 6, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.145060311, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.067967491, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.072788333, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.014100433, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1351, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.506960343, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000375248 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1477, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000389094, 2024-09-21T06:48:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000263 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 386688 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1203, 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.264298517, 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000219699 2024-09-21T06:48:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2, 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000029628, 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000014814 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 186, 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 186, 2024-09-21T06:48:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 186, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.200719383, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001079136 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 0, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 262, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 28, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 6, 2024-09-21T06:48:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 22, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 0, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 20, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 2, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 3, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 4, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 2, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 309, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 302, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 0, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 265, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2024-09-21T06:48:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 1, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 2, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 1, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 2, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 203, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 4, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 234, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 6, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 203, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 135, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 17, 2024-09-21T06:48:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 118, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 68, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 2, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 18, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 14, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 6, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 28, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 11, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 1, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 25 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2024-09-21T06:48:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 3, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 1, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 1, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:48:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 17, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 1, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "uninline_started": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "uninline_succeeded": 0, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "uninline_write_failed": 0 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2024-09-21T06:48:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 280, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 262, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 262, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 18, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 2, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 52, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 51, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 51, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 1, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 1, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 1, 2024-09-21T06:48:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 6659899, 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 6772234, 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 0, 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 242, 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.498272981, 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.002058979 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 0 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2024-09-21T06:48:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 24, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 43, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 19, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 19, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 20, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 1, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 28, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 30, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 2, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 4, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 18, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 14, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 122980, 2024-09-21T06:48:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 337395712 2024-09-21T06:48:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2024-09-21T06:48:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 251, 2024-09-21T06:48:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 2, 2024-09-21T06:48:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 186, 2024-09-21T06:48:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 26, 2024-09-21T06:48:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 6, 2024-09-21T06:48:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 5, 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.003395476, 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000679095 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 121, 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.029291976, 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000242082 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2024-09-21T06:48:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2024-09-21T06:48:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2, 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000310127, 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000155063 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2024-09-21T06:48:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2024-09-21T06:48:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2024-09-21T06:48:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 12, 2024-09-21T06:48:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.001842103, 2024-09-21T06:48:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000153508 2024-09-21T06:48:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2024-09-21T06:48:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 8, 2024-09-21T06:48:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.012591290, 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001573911 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 12, 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.063576197, 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.005298016 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1, 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000325286, 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000325286 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2, 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.002133941, 2024-09-21T06:48:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.001066970 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1, 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.007991424, 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.007991424 2024-09-21T06:48:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 6, 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.028454465, 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.004742410 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 7, 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.028139823, 2024-09-21T06:48:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.004019974 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 9, 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.022667275, 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.002518586 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 2, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 3, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 1, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 2, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2024-09-21T06:48:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 29, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 14, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 680, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 344764, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 130, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 264, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 3, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 8456, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 187, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 134480, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 1164, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 1486, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 3507908, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 37, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 1486, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1486, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 17.612580190, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.011852341 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 1486, 2024-09-21T06:48:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 2052 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 1486, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 237, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 1249, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 242, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 25, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 17, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 242, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 127, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2024-09-21T06:48:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 506, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 220, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 50, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2024-09-21T06:48:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 6, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2024-09-21T06:48:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 88, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 14, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 12, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 12, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 0, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 605, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 0, 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 12 2024-09-21T06:48:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 1, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 0, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed_ops": 0, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 0, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 5091, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 2200386, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 5091, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 5091, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 2200386, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 1486, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 3507908, 2024-09-21T06:48:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 1486, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 3507908, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 1486, 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 1486, 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 1486, 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 1486, 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x55bac54f1450": { 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 60, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 280, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 2577930, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 280, 2024-09-21T06:48:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 242, 2024-09-21T06:48:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 2577870, 2024-09-21T06:48:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "trackedop": { 2024-09-21T06:48:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2024-09-21T06:48:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:05.897 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T06:48:06.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:06 smithi098 ceph-mon[34704]: pgmap v672: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-21T06:48:06.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:06 smithi079 ceph-mon[34346]: pgmap v672: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-21T06:48:06.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:06 smithi049 ceph-mon[31177]: pgmap v672: 97 pgs: 97 active+clean; 13 MiB data, 424 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 49 KiB/s wr, 28 op/s 2024-09-21T06:48:06.542 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-09-21T06:48:06.542 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-21T06:48:06.542 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T06:48:06.542 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=12 2024-09-21T06:48:06.542 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=6 2024-09-21T06:48:06.542 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T06:48:06.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T06:48:06.790 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:48:07.264 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 798, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 800, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 210662, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 253828, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 6, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.095807162, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.048943912, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.018553776, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.019806477, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 798, 2024-09-21T06:48:07.265 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.034428544, 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000043143 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 920, 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 910, 2024-09-21T06:48:07.266 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 1047768, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 353071, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 3, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.124673316, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.055549365, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.049692008, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.023352493, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 909, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.042569742, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000046831 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.267 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 883664, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 140960 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 798, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 965, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 269552, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 634414, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 3, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.142360825, 2024-09-21T06:48:07.268 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.063133127, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.032233000, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.035734464, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 964, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.062962517, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000065313 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 382240 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.269 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 3745, 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.128234434, 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000034241 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2024-09-21T06:48:07.270 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 0, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 0, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2024-09-21T06:48:07.271 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 0, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 1, 2024-09-21T06:48:07.272 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2024-09-21T06:48:07.273 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:48:07.274 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 0 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2024-09-21T06:48:07.275 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:48:07.276 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "uninline_started": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "uninline_succeeded": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "uninline_write_failed": 0 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 3, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 0, 2024-09-21T06:48:07.277 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 0, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 2, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 2, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 0, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 4194304, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 4195283, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 4194892, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 3 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.278 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 3, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 3, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 0, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 1, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 1, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 0, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 0, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 0, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 0, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 0, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 0, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 0, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 117092, 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 316428288 2024-09-21T06:48:07.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 0, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 0, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 0, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 0, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 0, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.281 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.283 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.284 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.285 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.286 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.287 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.289 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2024-09-21T06:48:07.290 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 1, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 1, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 0, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 1, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 0, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 0, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 2143, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:07.291 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:07.292 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 189383, 2024-09-21T06:48:07.293 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 50, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 8456, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 187, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:07.294 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 8672, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 13, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 2258, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 21, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 3, 2024-09-21T06:48:07.295 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 2258, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2258, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 1.184971668, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000524788 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2258, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 2259 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 2258, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 2258, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 0, 2024-09-21T06:48:07.296 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 1458, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 798, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2024-09-21T06:48:07.297 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 1, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2024-09-21T06:48:07.298 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 88, 2024-09-21T06:48:07.299 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 14, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 5, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 5, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 0, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 0, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 2, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 0 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 0, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 0, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed_ops": 0, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 0, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 2512, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 1285983, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:07.301 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 2512, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2512, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 1285983, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:07.302 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 2258, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 984, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2258, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 984, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.303 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 2258, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 2258, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2258, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 2258, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.304 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:07.305 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x559b3798f450": { 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:07.306 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: "trackedop": { 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:07.307 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T06:48:08.020 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T06:48:08.020 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T06:48:08.020 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-21T06:48:08.021 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:48:08.021 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:48:08.021 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T06:48:08.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T06:48:08.267 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:48:08.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:08 smithi079 ceph-mon[34346]: pgmap v673: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 48 KiB/s wr, 24 op/s 2024-09-21T06:48:08.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:08 smithi049 ceph-mon[31177]: pgmap v673: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 48 KiB/s wr, 24 op/s 2024-09-21T06:48:08.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:08 smithi098 ceph-mon[34704]: pgmap v673: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 48 KiB/s wr, 24 op/s 2024-09-21T06:48:08.746 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 2850, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 2852, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 10265089, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 906307, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 6, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.291332963, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.118181459, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.077035935, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.077826643, 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:08.747 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2850, 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.094755505, 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000033247 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:08.748 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 312, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 302, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 898190, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 159140, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 3, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.052220166, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.024070079, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.033687367, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.002132982, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 301, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.017871156, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000059372 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.749 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 883120, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 139680 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 6, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 172, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 3372, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 384014, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 3, 2024-09-21T06:48:08.750 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.014078167, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.009272968, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.003247227, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000023475, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 171, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.014383343, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000084113 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:48:08.751 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 383696 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 1, 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-MDSRank": { 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 5066, 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.119593567, 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000023607 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.752 INFO:teuthology.orchestra.run.smithi079.stdout: "finisher-PurgeQueue": { 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "queue_len": 0, 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "complete_latency": { 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "mds": { 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "request": 0, 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "reply": 0, 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "reply_latency": { 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.753 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_reply": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "forward": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_complete": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_fetch_keys": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_commit": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_split": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_merge": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes": 14, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_top": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_bottom": 14, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pin_tail": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_pinned": 14, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_expired": 0, 2024-09-21T06:48:08.754 INFO:teuthology.orchestra.run.smithi079.stdout: "inodes_with_caps": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "subtrees": 1, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_hit": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_forward": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_discover": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_remote_ino": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "traverse_lock": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "load_cent": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "q": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "exported": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "exported_inodes": 0, 2024-09-21T06:48:08.755 INFO:teuthology.orchestra.run.smithi079.stdout: "imported": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "imported_inodes": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_dir_fetch": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "openino_peer_discover": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rfiles": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rbytes": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "root_rsnaps": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_set_tag": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:48:08.756 INFO:teuthology.orchestra.run.smithi079.stdout: "scrub_file_inodes": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_cap_release": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "process_request_cap_release": 0 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache": { 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_update_receipt": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_try_discover": 0, 2024-09-21T06:48:08.757 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_send_discover": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "dir_handle_discover": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_delayed": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_created": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_enqueued": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_reintegrated": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "strays_migrated": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_processing": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_started": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_completed": 0, 2024-09-21T06:48:08.758 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_exportdir": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_flush": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_fragstats": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "ireq_inodestats": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "uninline_started": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "uninline_succeeded": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "uninline_write_failed": 0 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log": { 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "evlrg": 0, 2024-09-21T06:48:08.759 INFO:teuthology.orchestra.run.smithi079.stdout: "evadd": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "evex": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "evtrm": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "ev": 1997, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "evexg": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "evexd": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "segadd": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "segex": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "segtrm": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "seg": 5, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "segmjr": 2, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "segexg": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "segexd": 0, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "expos": 4194304, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "wrpos": 13673330, 2024-09-21T06:48:08.760 INFO:teuthology.orchestra.run.smithi079.stdout: "rdpos": 13670725, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "jlat": { 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "replayed": 1997 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mem": { 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "ino": 15, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "ino+": 23, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "ino-": 8, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "dir": 3, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "dir+": 11, 2024-09-21T06:48:08.761 INFO:teuthology.orchestra.run.smithi079.stdout: "dir-": 8, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "dn": 14, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "dn+": 23, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "dn-": 9, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "cap": 0, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "cap+": 0, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "cap-": 0, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "rss": 118160, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "heap": 317468672 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_server": { 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_client_request": 0, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "dispatch_server_request": 0, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_request": 0, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_client_session": 0, 2024-09-21T06:48:08.762 INFO:teuthology.orchestra.run.smithi079.stdout: "handle_peer_request": 0, 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "req_create_latency": { 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getattr_latency": { 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getfilelock_latency": { 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.763 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "req_link_latency": { 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookup_latency": { 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookuphash_latency": { 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.764 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupino_latency": { 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupname_latency": { 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupparent_latency": { 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.765 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lookupsnap_latency": { 2024-09-21T06:48:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: "req_lssnap_latency": { 2024-09-21T06:48:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.766 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mkdir_latency": { 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mknod_latency": { 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.767 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "req_mksnap_latency": { 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "req_open_latency": { 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "req_readdir_latency": { 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.768 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rename_latency": { 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "req_renamesnap_latency": { 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "req_snapdiff_latency": { 2024-09-21T06:48:08.769 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmdir_latency": { 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmsnap_latency": { 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.770 INFO:teuthology.orchestra.run.smithi079.stdout: "req_rmxattr_latency": { 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setattr_latency": { 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setdirlayout_latency": { 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setfilelock_latency": { 2024-09-21T06:48:08.771 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setlayout_latency": { 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "req_setxattr_latency": { 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "req_symlink_latency": { 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.772 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "req_unlink_latency": { 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "req_getvxattr_latency": { 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:08.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessions": { 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "session_count": 2, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "session_add": 3, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "session_remove": 1, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_open": 2, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "sessions_stale": 0, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "total_load": 0, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "average_load": 0, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "avg_session_uptime": 2146, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "mdthresh_evicted": 0 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:08.774 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:08.775 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:08.776 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 190200, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 72, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 8456, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 187, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 59856, 2024-09-21T06:48:08.777 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 600, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter": { 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "op_active": 0, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "op_laggy": 0, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send": 2912, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "op_send_bytes": 21, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "op_resend": 3, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "op_reply": 2912, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "op_latency": { 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2912, 2024-09-21T06:48:08.778 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 1.732958577, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000595109 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "op_inflight": 0, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "oplen_avg": { 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 2912, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 2913 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "op": 2912, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "op_r": 2912, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "op_w": 0, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "op_rmw": 0, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "op_pg": 0, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_stat": 1508, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_create": 0, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_read": 1402, 2024-09-21T06:48:08.779 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_write": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writefull": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_writesame": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_append": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_zero": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_truncate": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_delete": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_mapext": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_sparse_read": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_clonerange": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_getxattr": 1, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_setxattr": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_rmxattr": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_call": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_watch": 0, 2024-09-21T06:48:08.780 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_notify": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "osdop_other": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_active": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_send": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_resend": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "linger_ping": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_active": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_send": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "poolop_resend": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_active": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_send": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "poolstat_resend": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_active": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_send": 0, 2024-09-21T06:48:08.781 INFO:teuthology.orchestra.run.smithi079.stdout: "statfs_resend": 0, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "command_active": 0, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "command_send": 0, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "command_resend": 0, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "map_epoch": 88, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "map_full": 0, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "map_inc": 14, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_sessions": 5, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_open": 5, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_session_close": 0, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_laggy": 0, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_wr": 0, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_rd": 2, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_del": 0 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.782 INFO:teuthology.orchestra.run.smithi079.stdout: "oft": { 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_objs": 0, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_updates": 0, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "omap_total_removes": 0 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "purge_queue": { 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops": 0, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing": 0, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executing_high_water": 0, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed_ops": 0, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_executed": 0, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "pq_item_in_journal": 0 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.783 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 3164, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 10866076, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 3164, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 3164, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 10866076, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.784 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_bytes": { 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 2912, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 9479031, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2912, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 9479031, 2024-09-21T06:48:08.785 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-objecter_ops": { 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 1024, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:08.786 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 2912, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 2912, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 2912, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 2912, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:08.787 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-write_buf_throttle-0x556ebfa25380": { 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:08.788 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 3758096384, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:08.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:08.790 INFO:teuthology.orchestra.run.smithi079.stdout: "trackedop": { 2024-09-21T06:48:08.790 INFO:teuthology.orchestra.run.smithi079.stdout: "slow_ops_count": 0 2024-09-21T06:48:08.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:08.790 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T06:48:09.592 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T06:48:09.592 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T06:48:09.592 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2024-09-21T06:48:09.592 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:48:09.592 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:48:09.593 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T06:48:09.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T06:48:09.837 INFO:teuthology.orchestra.run.smithi079.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:48:10.202 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:10 smithi079 ceph-mon[34346]: pgmap v674: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 23 op/s 2024-09-21T06:48:10.202 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:10 smithi079 ceph-mon[34346]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T06:48:10.321 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-21T06:48:10.321 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:10.322 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 0, 2024-09-21T06:48:10.322 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 2, 2024-09-21T06:48:10.322 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:48:10.322 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 0, 2024-09-21T06:48:10.322 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 4, 2024-09-21T06:48:10.322 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 0, 2024-09-21T06:48:10.322 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.001043279, 2024-09-21T06:48:10.322 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:48:10.323 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.000239581, 2024-09-21T06:48:10.323 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:10.323 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:10.323 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:10.323 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:10.323 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:10.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.323 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 231, 2024-09-21T06:48:10.324 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 226, 2024-09-21T06:48:10.325 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 840528, 2024-09-21T06:48:10.325 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 138944, 2024-09-21T06:48:10.325 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 2, 2024-09-21T06:48:10.325 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 1, 2024-09-21T06:48:10.325 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.045363692, 2024-09-21T06:48:10.325 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.021991846, 2024-09-21T06:48:10.325 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.032007569, 2024-09-21T06:48:10.325 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:10.325 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:10.326 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 225, 2024-09-21T06:48:10.326 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.014438215, 2024-09-21T06:48:10.326 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000064169 2024-09-21T06:48:10.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.326 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:10.326 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:10.326 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:10.326 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:10.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.327 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 840528, 2024-09-21T06:48:10.327 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 138944 2024-09-21T06:48:10.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.327 INFO:teuthology.orchestra.run.smithi079.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:10.327 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_messages": 5, 2024-09-21T06:48:10.327 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages": 174, 2024-09-21T06:48:10.327 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:48:10.327 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_bytes": 110912, 2024-09-21T06:48:10.328 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_created_connections": 3, 2024-09-21T06:48:10.328 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_active_connections": 2, 2024-09-21T06:48:10.328 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_total_time": 0.017583779, 2024-09-21T06:48:10.328 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_send_time": 0.012445399, 2024-09-21T06:48:10.328 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_recv_time": 0.003035597, 2024-09-21T06:48:10.328 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:10.328 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:10.328 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 173, 2024-09-21T06:48:10.328 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.015088987, 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000087219 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: "msgr_send_encrypted_bytes": 110912 2024-09-21T06:48:10.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.330 INFO:teuthology.orchestra.run.smithi079.stdout: "cct": { 2024-09-21T06:48:10.330 INFO:teuthology.orchestra.run.smithi079.stdout: "total_workers": 0, 2024-09-21T06:48:10.330 INFO:teuthology.orchestra.run.smithi079.stdout: "unhealthy_workers": 0 2024-09-21T06:48:10.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.330 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool": { 2024-09-21T06:48:10.330 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:10.330 INFO:teuthology.orchestra.run.smithi079.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:10.330 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:10.331 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:10.332 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_items": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_anon_items": 29, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "buffer_meta_items": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bytes": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_items": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:10.333 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_bytes": 0, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_items": 0, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "pgmap_items": 0, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_bytes": 968, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_co_items": 2, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_1_items": 0, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "unittest_2_items": 0 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:10.334 INFO:teuthology.orchestra.run.smithi079.stdout: "val": 0, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "max": 104857600, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "get_started": 0, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "get": 232, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "get_sum": 807866, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "get_or_fail_success": 232, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "take": 0, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "take_sum": 0, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "put": 232, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "put_sum": 807866, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "wait": { 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "avgcount": 0, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "sum": 0.000000000, 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: "avgtime": 0.000000000 2024-09-21T06:48:10.335 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:10.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-21T06:48:10.336 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-21T06:48:10.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:10 smithi049 ceph-mon[31177]: pgmap v674: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 23 op/s 2024-09-21T06:48:10.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:10 smithi049 ceph-mon[31177]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T06:48:10.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:10 smithi098 ceph-mon[34704]: pgmap v674: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 46 KiB/s wr, 23 op/s 2024-09-21T06:48:10.546 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:10 smithi098 ceph-mon[34704]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T06:48:10.994 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T06:48:10.995 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T06:48:10.995 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-21T06:48:10.995 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-21T06:48:10.995 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-21T06:48:10.995 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T06:48:10.995 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T06:48:11.253 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:48:11.855 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-21T06:48:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:11.855 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 81, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 83, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 38844, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 92188, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 12, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.014706588, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.004358391, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.006424507, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000427993, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 81, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.018420546, 2024-09-21T06:48:11.856 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000227414 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 116, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000021488, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000185 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 317, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 339, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 904286, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 171160, 2024-09-21T06:48:11.857 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 7, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 5, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.054987038, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.025116789, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.039402028, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000555996, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 339, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.038408913, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000113300 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 59, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000011590, 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000196 2024-09-21T06:48:11.858 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 900496, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 159056 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 462, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 793, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 130674, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 1021004, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 40, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 5, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.102768902, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.047811672, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.047170541, 2024-09-21T06:48:11.859 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.005581699, 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 791, 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.041576407, 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000052561 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1030, 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000321232, 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000311 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 383440 2024-09-21T06:48:11.860 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 39, 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001394683, 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000035761 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-21T06:48:11.861 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000021692, 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000010846 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 5, 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 3, 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3, 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000781421, 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000260473 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.862 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 2, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 11, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 10, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 10, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 10, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 1, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 1, 2024-09-21T06:48:11.863 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 1, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 7, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 6, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:48:11.864 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 5, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 234, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 6, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:48:11.865 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 1, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-09-21T06:48:11.866 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:48:11.867 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "uninline_started": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "uninline_succeeded": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "uninline_write_failed": 0 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 3, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 3, 2024-09-21T06:48:11.868 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 2, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 4195283, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.003417813, 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.001708906 2024-09-21T06:48:11.869 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 13, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 13, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 0, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 11, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 12, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 1, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 10, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 10, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 0, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 1, 2024-09-21T06:48:11.870 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 1, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 117912, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 324804608 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 5, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 5, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 9, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.871 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 3, 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000781421, 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000260473 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.872 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.873 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.874 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-21T06:48:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-21T06:48:11.875 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.876 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.877 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.878 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.879 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.880 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.881 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 1, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 1, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 0, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 1, 2024-09-21T06:48:11.882 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 2, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 2, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 669, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:11.883 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:11.884 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 247159, 2024-09-21T06:48:11.885 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 85, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 88, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 1, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8576, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 190, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-21T06:48:11.886 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 51520, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 201, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 37, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 11191, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 33, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 37, 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-21T06:48:11.887 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 37, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.200997353, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.005432360 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 37, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 59 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 37, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 0, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 37, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-09-21T06:48:11.888 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 10, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 2, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 6, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 6, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 20, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:48:11.889 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-21T06:48:11.890 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 89, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 15, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 8, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 8, 2024-09-21T06:48:11.891 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 14, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 0, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 1 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-21T06:48:11.892 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 856, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 978754, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 856, 2024-09-21T06:48:11.893 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 856, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 978754, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:11.894 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 37, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 11191, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 37, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 11191, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.895 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 37, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 37, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 37, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 37, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.896 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-21T06:48:11.897 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x55ce104011e0": { 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 3, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 979, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:11.898 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 3, 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2, 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 979, 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "trackedop": { 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:11.899 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-21T06:48:12.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:12 smithi079 ceph-mon[34346]: pgmap v676: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-21T06:48:12.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:12 smithi049 ceph-mon[31177]: pgmap v676: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-21T06:48:12.545 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:12 smithi098 ceph-mon[34704]: pgmap v676: 97 pgs: 97 active+clean; 13 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 55 KiB/s wr, 26 op/s 2024-09-21T06:48:12.674 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T06:48:12.674 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T06:48:12.674 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-21T06:48:12.674 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:48:12.674 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:48:12.674 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T06:48:12.675 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T06:48:12.920 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:48:13.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:13 smithi098 ceph-mon[34704]: pgmap v677: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:48:13.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:13 smithi079 ceph-mon[34346]: pgmap v677: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:48:13.438 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-21T06:48:13.438 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:13.438 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 1771, 2024-09-21T06:48:13.438 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 1770, 2024-09-21T06:48:13.438 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 3101051, 2024-09-21T06:48:13.438 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 562046, 2024-09-21T06:48:13.438 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 6, 2024-09-21T06:48:13.438 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 2, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.231592059, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.099221047, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.055269708, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.059330537, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1769, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.079867776, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000045148 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.439 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 5, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 175, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1816, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 384954, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 5, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 4, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.013607664, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.010154680, 2024-09-21T06:48:13.440 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.001514098, 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000143261, 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 173, 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.012885762, 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000074484 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 383616 2024-09-21T06:48:13.441 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 1046, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 1036, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1079345, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 392835, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 3, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 2, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.144078686, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.067607101, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.051939342, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.026655106, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1035, 2024-09-21T06:48:13.442 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.048717702, 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000047070 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 884688, 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 141296 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.443 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 4215, 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.139727003, 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000033149 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:13.444 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 0, 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 0, 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-21T06:48:13.445 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 18, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 5, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 13, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 11, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-09-21T06:48:13.446 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 2, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-21T06:48:13.447 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 4, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 234, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 6, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:48:13.448 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 0 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 0, 2024-09-21T06:48:13.449 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:48:13.450 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "uninline_started": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "uninline_succeeded": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "uninline_write_failed": 0 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-21T06:48:13.451 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 280, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 0, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 2, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 52, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 6659899, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 6772234, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 6772174, 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-21T06:48:13.452 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 280 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 15, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 17, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 2, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 10, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 11, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 1, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 18, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 20, 2024-09-21T06:48:13.453 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 2, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 0, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 0, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 117052, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 316428288 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 0, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 0, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 0, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 0, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 0, 2024-09-21T06:48:13.454 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.455 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.456 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.457 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.458 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-21T06:48:13.458 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.458 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.458 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.458 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-21T06:48:13.458 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.458 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.458 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.459 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.463 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.464 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 2, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 3, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 1, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 2, 2024-09-21T06:48:13.465 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 2152, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:13.466 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:13.467 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 189659, 2024-09-21T06:48:13.468 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 58, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8576, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 190, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-21T06:48:13.469 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 91896, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 738, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 2561, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 26, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 4, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 2561, 2024-09-21T06:48:13.470 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2561, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.757976732, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000686441 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2561, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 2562 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 2561, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 2561, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 0, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-21T06:48:13.471 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 1589, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 969, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-21T06:48:13.472 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 2, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-21T06:48:13.473 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 89, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 15, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 5, 2024-09-21T06:48:13.474 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 5, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 0, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 2, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 0 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 0, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-21T06:48:13.475 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 0, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 0, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 0, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 2818, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 3912576, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:13.476 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 2818, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2818, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 3912576, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:13.477 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 2561, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 2577940, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2561, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 2577940, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:13.478 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 2561, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 2561, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2561, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 2561, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.479 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.480 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x5570eb469380": { 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 0, 2024-09-21T06:48:13.481 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 0, 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout: "trackedop": { 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:13.482 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-21T06:48:13.482 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:13 smithi049 ceph-mon[31177]: pgmap v677: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:48:14.183 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T06:48:14.184 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T06:48:14.184 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=6 2024-09-21T06:48:14.184 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:48:14.184 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:48:14.184 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T06:48:14.184 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T06:48:14.430 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:48:14.923 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-21T06:48:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 4669, 2024-09-21T06:48:14.923 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 7154, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 1365666, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 12270601, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 13, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 3, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.685393811, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.366486258, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.245463212, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.076449194, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 7154, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.222478351, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000031098 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.924 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 5609, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.001658551, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000295 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 507936, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 1502576 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 357, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 362, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 918277, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 224006, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 13, 2024-09-21T06:48:14.925 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 7, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.062504480, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.028549841, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.042607362, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000732016, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 360, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.045592675, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000126646 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 47, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000011198, 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000238 2024-09-21T06:48:14.926 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 907168, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 163776 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 110, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 278, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 43144, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 801920, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 38, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 8, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.035753629, 2024-09-21T06:48:14.927 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.016188592, 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.016464137, 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000662509, 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 276, 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.022807402, 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000082635 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 140, 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000026701, 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000190 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.928 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 383840 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 1, 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-MDSRank": { 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 4519, 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 1.126010350, 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000249172 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.929 INFO:teuthology.orchestra.run.smithi098.stdout: "finisher-PurgeQueue": { 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "queue_len": 0, 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "complete_latency": { 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 16, 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000306410, 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000019150 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "mds": { 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "request": 597, 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "reply": 597, 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "reply_latency": { 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 597, 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 2.699260911, 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.004521375 2024-09-21T06:48:14.930 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_reply": 0, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "forward": 0, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_complete": 0, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_fetch_keys": 0, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_commit": 11, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_split": 0, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_merge": 0, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes": 26, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_top": 0, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_bottom": 13, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pin_tail": 13, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_pinned": 25, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_expired": 3, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "inodes_with_caps": 0, 2024-09-21T06:48:14.931 INFO:teuthology.orchestra.run.smithi098.stdout: "caps": 0, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "subtrees": 3, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse": 617, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_hit": 613, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_forward": 0, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_discover": 1, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_remote_ino": 0, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "traverse_lock": 0, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "load_cent": 0, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "q": 0, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "exported": 1, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "exported_inodes": 2, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "imported": 1, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "imported_inodes": 2, 2024-09-21T06:48:14.932 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_dir_fetch": 0, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_backtrace_fetch": 28, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "openino_peer_discover": 0, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rfiles": 5, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rbytes": 234, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "root_rsnaps": 6, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_fetch": 28, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_set_tag": 0, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_inodes": 14, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_dirfrag_rstats": 14, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "scrub_file_inodes": 14, 2024-09-21T06:48:14.933 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_revoke": 630, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_grant": 611, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_trunc": 593, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps": 740, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_caps_dirty": 715, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_cap_release": 1, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "process_request_cap_release": 597 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_cache": { 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update": 0, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_update_receipt": 0, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_try_discover": 0, 2024-09-21T06:48:14.934 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_send_discover": 2, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "dir_handle_discover": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays": 1, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_delayed": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_created": 2, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_enqueued": 1, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_reintegrated": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "strays_migrated": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_processing": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_started": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "recovery_completed": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:48:14.935 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_exportdir": 1, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_flush": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_fragstats": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "ireq_inodestats": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "uninline_started": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "uninline_succeeded": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "uninline_write_failed": 0 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_log": { 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "evlrg": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "evadd": 1997, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "evex": 0, 2024-09-21T06:48:14.936 INFO:teuthology.orchestra.run.smithi098.stdout: "evtrm": 0, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "ev": 1997, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "evexg": 0, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "evexd": 0, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "segadd": 5, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "segex": 0, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "segtrm": 0, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "seg": 5, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "segmjr": 2, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "segexg": 0, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "segexd": 0, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "expos": 4194304, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "wrpos": 13673330, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "rdpos": 0, 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "jlat": { 2024-09-21T06:48:14.937 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1910, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 4.021974988, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002105746 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "replayed": 0 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_mem": { 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "ino": 30, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "ino+": 32, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "ino-": 2, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "dir": 19, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "dir+": 21, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "dir-": 2, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "dn": 28, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "dn+": 32, 2024-09-21T06:48:14.938 INFO:teuthology.orchestra.run.smithi098.stdout: "dn-": 4, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "cap": 0, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "cap+": 3, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "cap-": 3, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "rss": 123112, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "heap": 327950336 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_server": { 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_client_request": 1789, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "dispatch_server_request": 1, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_request": 597, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_client_session": 22, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "handle_peer_request": 4, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "req_create_latency": { 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.939 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getattr_latency": { 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getfilelock_latency": { 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "req_link_latency": { 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.940 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookup_latency": { 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000597873, 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000597873 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookuphash_latency": { 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupino_latency": { 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.941 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupname_latency": { 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupparent_latency": { 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lookupsnap_latency": { 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.942 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "req_lssnap_latency": { 2024-09-21T06:48:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.943 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mkdir_latency": { 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mknod_latency": { 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "req_mksnap_latency": { 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.944 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "req_open_latency": { 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "req_readdir_latency": { 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000536071, 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000536071 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rename_latency": { 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.945 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "req_renamesnap_latency": { 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "req_snapdiff_latency": { 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmdir_latency": { 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-09-21T06:48:14.946 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.007507461, 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.007507461 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmsnap_latency": { 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "req_rmxattr_latency": { 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setattr_latency": { 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 593, 2024-09-21T06:48:14.947 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 2.687974263, 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.004532840 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setdirlayout_latency": { 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setfilelock_latency": { 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setlayout_latency": { 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.948 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "req_setxattr_latency": { 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "req_symlink_latency": { 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "req_unlink_latency": { 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 1, 2024-09-21T06:48:14.949 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.002645243, 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002645243 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "req_getvxattr_latency": { 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_sessions": { 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "session_count": 2, 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "session_add": 3, 2024-09-21T06:48:14.950 INFO:teuthology.orchestra.run.smithi098.stdout: "session_remove": 1, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_open": 2, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "sessions_stale": 0, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "total_load": 89, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "average_load": 44, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "avg_session_uptime": 669, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "mdthresh_evicted": 0 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:14.951 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:14.952 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 275963, 2024-09-21T06:48:14.953 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 117, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 8576, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 190, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-21T06:48:14.954 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 123413, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 741, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "objecter": { 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "op_active": 0, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "op_laggy": 0, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send": 2628, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "op_send_bytes": 9494921, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "op_resend": 28, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "op_reply": 2628, 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "op_latency": { 2024-09-21T06:48:14.955 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2628, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 5.429927790, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.002066182 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "op_inflight": 0, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "oplen_avg": { 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 2628, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 2656 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "op": 2628, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "op_r": 29, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "op_w": 2599, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "op_rmw": 0, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "op_pg": 0, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_stat": 0, 2024-09-21T06:48:14.956 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_create": 10, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_read": 1, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_write": 1911, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writefull": 50, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_writesame": 0, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_append": 0, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_zero": 0, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_truncate": 0, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_delete": 15, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_mapext": 0, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_sparse_read": 0, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_clonerange": 0, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_getxattr": 28, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_setxattr": 20, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:48:14.957 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_rmxattr": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_call": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_watch": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_notify": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "osdop_other": 593, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_active": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_send": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_resend": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "linger_ping": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_active": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_send": 0, 2024-09-21T06:48:14.958 INFO:teuthology.orchestra.run.smithi098.stdout: "poolop_resend": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_active": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_send": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "poolstat_resend": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_active": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_send": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "statfs_resend": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "command_active": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "command_send": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "command_resend": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "map_epoch": 89, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "map_full": 0, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "map_inc": 15, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_sessions": 10, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_open": 10, 2024-09-21T06:48:14.959 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_session_close": 0, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_laggy": 0, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_wr": 24, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_rd": 0, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_del": 4 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "oft": { 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_objs": 1, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_updates": 0, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "omap_total_removes": 0 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "purge_queue": { 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops": 0, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_ops_high_water": 1, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing": 0, 2024-09-21T06:48:14.960 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executing_high_water": 1, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed_ops": 1, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_executed": 1, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "pq_item_in_journal": 0 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 5132, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 1786133, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 5132, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:14.961 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 5132, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 1786133, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_bytes": { 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-21T06:48:14.962 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 2628, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 9495070, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2628, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 9495070, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-objecter_ops": { 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 1024, 2024-09-21T06:48:14.963 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 0, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 0, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 0, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 2628, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 2628, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 2628, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 2628, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.964 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 1, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 149, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 1, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 149, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.965 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-write_buf_throttle-0x5581c3399380": { 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 3758096384, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 1997, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 9479026, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 1997, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 1910, 2024-09-21T06:48:14.966 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 9479026, 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "trackedop": { 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: "slow_ops_count": 0 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:14.967 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-21T06:48:15.641 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:15 smithi098 ceph-mon[34704]: pgmap v678: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:15.666 INFO:tasks.check_counter:Daemon mds.i mds.exported=1 2024-09-21T06:48:15.666 INFO:tasks.check_counter:Daemon mds.i mds.imported=1 2024-09-21T06:48:15.666 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T06:48:15.666 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:48:15.667 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:48:15.667 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T06:48:15.667 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T06:48:15.722 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:15 smithi049 ceph-mon[31177]: pgmap v678: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:15.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:15 smithi079 ceph-mon[34346]: pgmap v678: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:15.912 INFO:teuthology.orchestra.run.smithi098.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:48:16.456 INFO:teuthology.orchestra.run.smithi098.stdout:{ 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 234, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 229, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 841344, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 140864, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 4, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 0, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.044355071, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.019737101, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.033472843, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:16.457 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 228, 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.015554332, 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000068220 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 841344, 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 140864 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 5, 2024-09-21T06:48:16.458 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 176, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 3104, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 111264, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 3, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 2, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.016504591, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.011598572, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.002862725, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 175, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.015287235, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000087355 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.459 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 111264 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_messages": 0, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages": 2, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_bytes": 0, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_created_connections": 2, 2024-09-21T06:48:16.460 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_active_connections": 1, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_total_time": 0.000241965, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_recv_time": 0.000154095, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:16.461 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "cct": { 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "total_workers": 0, 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "unhealthy_workers": 0 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "mempool": { 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "bloom_filter_items": 0, 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:48:16.462 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_extent_items": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_blob_items": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:48:16.463 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_txc_items": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluestore_writing_items": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_bytes": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_items": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:48:16.464 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_anon_items": 29, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "buffer_meta_items": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_bytes": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_items": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_mapbl_items": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osd_pglog_items": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_bytes": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_items": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:48:16.465 INFO:teuthology.orchestra.run.smithi098.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_bytes": 0, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "pgmap_items": 0, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_bytes": 968, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "mds_co_items": 2, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_bytes": 0, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_1_items": 0, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_bytes": 0, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "unittest_2_items": 0 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: }, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "val": 0, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "max": 104857600, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "get_started": 0, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "get": 235, 2024-09-21T06:48:16.466 INFO:teuthology.orchestra.run.smithi098.stdout: "get_sum": 808256, 2024-09-21T06:48:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_fail": 0, 2024-09-21T06:48:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "get_or_fail_success": 235, 2024-09-21T06:48:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "take": 0, 2024-09-21T06:48:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "take_sum": 0, 2024-09-21T06:48:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "put": 235, 2024-09-21T06:48:16.467 INFO:teuthology.orchestra.run.smithi098.stdout: "put_sum": 808256, 2024-09-21T06:48:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "wait": { 2024-09-21T06:48:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "avgcount": 0, 2024-09-21T06:48:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "sum": 0.000000000, 2024-09-21T06:48:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: "avgtime": 0.000000000 2024-09-21T06:48:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:16.468 INFO:teuthology.orchestra.run.smithi098.stdout: } 2024-09-21T06:48:16.468 INFO:teuthology.orchestra.run.smithi098.stdout:} 2024-09-21T06:48:17.151 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T06:48:17.151 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T06:48:17.151 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-21T06:48:17.151 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-21T06:48:17.152 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-21T06:48:17.152 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T06:48:17.162 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T06:48:17.162 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:48:17.162 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:48:17.183 DEBUG:teuthology.orchestra.run.smithi049:> set -ex 2024-09-21T06:48:17.184 DEBUG:teuthology.orchestra.run.smithi049:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:48:17.245 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:48:17.554 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:17.675 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:17 smithi049 ceph-mon[31177]: pgmap v679: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:17.795 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:17 smithi098 ceph-mon[34704]: pgmap v679: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:17.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:17 smithi079 ceph-mon[34346]: pgmap v679: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:18.014 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.013+0000 7f916af69640 1 -- 172.21.15.49:0/1146967882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9164103b60 msgr2=0x7f9164103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.013+0000 7f916af69640 1 --2- 172.21.15.49:0/1146967882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9164103b60 0x7f9164103f70 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f9158009900 tx=0x7f915802a410 comp rx=0 tx=0).stop 2024-09-21T06:48:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.013+0000 7f916af69640 1 -- 172.21.15.49:0/1146967882 shutdown_connections 2024-09-21T06:48:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.013+0000 7f916af69640 1 --2- 172.21.15.49:0/1146967882 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9164109df0 0x7f9164110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.013+0000 7f916af69640 1 --2- 172.21.15.49:0/1146967882 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f91641094a0 0x7f91641098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.013+0000 7f916af69640 1 --2- 172.21.15.49:0/1146967882 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f9164103b60 0x7f9164103f70 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.013+0000 7f916af69640 1 -- 172.21.15.49:0/1146967882 >> 172.21.15.49:0/1146967882 conn(0x7f916407b850 msgr2=0x7f916407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.013+0000 7f916af69640 1 -- 172.21.15.49:0/1146967882 shutdown_connections 2024-09-21T06:48:18.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.013+0000 7f916af69640 1 -- 172.21.15.49:0/1146967882 wait complete. 2024-09-21T06:48:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f916af69640 1 Processor -- start 2024-09-21T06:48:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f916af69640 1 -- start start 2024-09-21T06:48:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f916af69640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9164103b60 0x7f916419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f916af69640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91641094a0 0x7f916419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f916af69640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9164109df0 0x7f916419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f916af69640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f9164113ab0 con 0x7f91641094a0 2024-09-21T06:48:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f916af69640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f9164113930 con 0x7f9164103b60 2024-09-21T06:48:18.017 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f916af69640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f9164113c30 con 0x7f9164109df0 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9163fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91641094a0 0x7f916419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9163fff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91641094a0 0x7f916419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59060/0 (socket says 172.21.15.49:59060) 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9163fff640 1 -- 172.21.15.49:0/1105426251 learned_addr learned my addr 172.21.15.49:0/1105426251 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9168d05640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9164103b60 0x7f916419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9169506640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9164109df0 0x7f916419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9163fff640 1 -- 172.21.15.49:0/1105426251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9164109df0 msgr2=0x7f916419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9163fff640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9164109df0 0x7f916419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9163fff640 1 -- 172.21.15.49:0/1105426251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9164103b60 msgr2=0x7f916419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9163fff640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9164103b60 0x7f916419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.014+0000 7f9163fff640 1 -- 172.21.15.49:0/1105426251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91641a0410 con 0x7f91641094a0 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.015+0000 7f9163fff640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91641094a0 0x7f916419aa40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f915000d740 tx=0x7f915000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.015+0000 7f9161ffb640 1 -- 172.21.15.49:0/1105426251 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9150017070 con 0x7f91641094a0 2024-09-21T06:48:18.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.015+0000 7f9161ffb640 1 -- 172.21.15.49:0/1105426251 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f915000de50 con 0x7f91641094a0 2024-09-21T06:48:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.015+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91641a0700 con 0x7f91641094a0 2024-09-21T06:48:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.015+0000 7f9161ffb640 1 -- 172.21.15.49:0/1105426251 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915000f620 con 0x7f91641094a0 2024-09-21T06:48:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.015+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91641a6e60 con 0x7f91641094a0 2024-09-21T06:48:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.016+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9164103f70 con 0x7f91641094a0 2024-09-21T06:48:18.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.018+0000 7f9161ffb640 1 -- 172.21.15.49:0/1105426251 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f915001a070 con 0x7f91641094a0 2024-09-21T06:48:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.019+0000 7f9161ffb640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91540b6700 0x7f91540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.019+0000 7f9168d05640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91540b6700 0x7f91540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:18.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.019+0000 7f9161ffb640 1 -- 172.21.15.49:0/1105426251 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8638+0+0 (secure 0 0 0) 0x7f91500e7050 con 0x7f91641094a0 2024-09-21T06:48:18.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.019+0000 7f9168d05640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91540b6700 0x7f91540b8c10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9158031440 tx=0x7f9158009560 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:18.023 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.022+0000 7f9161ffb640 1 -- 172.21.15.49:0/1105426251 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91500b1990 con 0x7f91641094a0 2024-09-21T06:48:18.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.220+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f916419b5d0 con 0x7f91641094a0 2024-09-21T06:48:18.223 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.221+0000 7f9161ffb640 1 -- 172.21.15.49:0/1105426251 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v89) ==== 81+0+884 (secure 0 0 0) 0x7f916419b5d0 con 0x7f91641094a0 2024-09-21T06:48:18.223 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/3036880811 2024-09-22T06:28:12.020916+0000 2024-09-21T06:48:18.223 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/913847396 2024-09-22T06:28:12.020916+0000 2024-09-21T06:48:18.223 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/679391324 2024-09-22T06:27:11.553726+0000 2024-09-21T06:48:18.223 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/679391324 2024-09-22T06:27:11.553726+0000 2024-09-21T06:48:18.223 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1476806315 2024-09-22T06:27:11.553726+0000 2024-09-21T06:48:18.223 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4148430613 2024-09-22T06:26:45.038217+0000 2024-09-21T06:48:18.223 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2496147530 2024-09-22T06:28:12.020916+0000 2024-09-21T06:48:18.224 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/1732676845 2024-09-22T06:26:45.038217+0000 2024-09-21T06:48:18.224 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/4271034131 2024-09-22T06:26:45.038217+0000 2024-09-21T06:48:18.224 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/4218148883 2024-09-22T06:28:12.020916+0000 2024-09-21T06:48:18.224 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6801/1732676845 2024-09-22T06:26:45.038217+0000 2024-09-21T06:48:18.224 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/1947753988 2024-09-22T06:27:11.553726+0000 2024-09-21T06:48:18.224 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/136334353 2024-09-22T06:27:11.553726+0000 2024-09-21T06:48:18.224 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:0/2741549070 2024-09-22T06:26:45.038217+0000 2024-09-21T06:48:18.224 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49:6800/4218148883 2024-09-22T06:28:12.020916+0000 2024-09-21T06:48:18.224 INFO:teuthology.orchestra.run.smithi049.stderr:listed 15 entries 2024-09-21T06:48:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91540b6700 msgr2=0x7f91540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91540b6700 0x7f91540b8c10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9158031440 tx=0x7f9158009560 comp rx=0 tx=0).stop 2024-09-21T06:48:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91641094a0 msgr2=0x7f916419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91641094a0 0x7f916419aa40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f915000d740 tx=0x7f915000dc00 comp rx=0 tx=0).stop 2024-09-21T06:48:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 shutdown_connections 2024-09-21T06:48:18.225 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f91540b6700 0x7f91540b8c10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f9164109df0 0x7f916419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f91641094a0 0x7f916419aa40 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 --2- 172.21.15.49:0/1105426251 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f9164103b60 0x7f916419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 >> 172.21.15.49:0/1105426251 conn(0x7f916407b850 msgr2=0x7f9164107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.223+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 shutdown_connections 2024-09-21T06:48:18.226 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:18.224+0000 7f916af69640 1 -- 172.21.15.49:0/1105426251 wait complete. 2024-09-21T06:48:18.714 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:18 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1105426251' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:48:18.796 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:18 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1105426251' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:48:18.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:18 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1105426251' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:48:18.955 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:48:18.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:48:18.955 DEBUG:teuthology.orchestra.run.smithi049:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:48:19.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:48:19.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:48:19.005 DEBUG:teuthology.orchestra.run.smithi049:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:48:19.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:48:19.038 DEBUG:teuthology.orchestra.run.smithi049:> ip netns list 2024-09-21T06:48:19.094 INFO:teuthology.orchestra.run.smithi049.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:48:19.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:48:19.095 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:48:19.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:48:19.161 DEBUG:teuthology.orchestra.run.smithi049:> sudo ip link delete ceph-brx 2024-09-21T06:48:19.251 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T06:48:19.260 INFO:tasks.cephadm:Teardown begin 2024-09-21T06:48:19.261 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:48:19.261 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:48:19.520 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:19.922 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:19 smithi049 ceph-mon[31177]: pgmap v680: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:19.923 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:19 smithi049 ceph-mon[31177]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T06:48:20.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.014+0000 7f2611ded640 1 -- 172.21.15.49:0/3334387119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 msgr2=0x7f260c1055d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:20.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.014+0000 7f2611ded640 1 --2- 172.21.15.49:0/3334387119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 0x7f260c1055d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2600009900 tx=0x7f260002a410 comp rx=0 tx=0).stop 2024-09-21T06:48:20.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.014+0000 7f2611ded640 1 -- 172.21.15.49:0/3334387119 shutdown_connections 2024-09-21T06:48:20.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.014+0000 7f2611ded640 1 --2- 172.21.15.49:0/3334387119 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f260c105b10 0x7f260c10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.014+0000 7f2611ded640 1 --2- 172.21.15.49:0/3334387119 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 0x7f260c1055d0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.014+0000 7f2611ded640 1 --2- 172.21.15.49:0/3334387119 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260c1031f0 0x7f260c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.014+0000 7f2611ded640 1 -- 172.21.15.49:0/3334387119 >> 172.21.15.49:0/3334387119 conn(0x7f260c079f90 msgr2=0x7f260c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:20.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.014+0000 7f2611ded640 1 -- 172.21.15.49:0/3334387119 shutdown_connections 2024-09-21T06:48:20.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.014+0000 7f2611ded640 1 -- 172.21.15.49:0/3334387119 wait complete. 2024-09-21T06:48:20.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f2611ded640 1 Processor -- start 2024-09-21T06:48:20.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f2611ded640 1 -- start start 2024-09-21T06:48:20.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f2611ded640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f260c1031f0 0x7f260c19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:20.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f2611ded640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 0x7f260c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:20.018 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f2611ded640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260c105b10 0x7f260c19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f2611ded640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f260c112a10 con 0x7f260c1051c0 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f2611ded640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f260c112890 con 0x7f260c105b10 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f2611ded640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f260c112b90 con 0x7f260c1031f0 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f260affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 0x7f260c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f260affd640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 0x7f260c19ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59082/0 (socket says 172.21.15.49:59082) 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.015+0000 7f260affd640 1 -- 172.21.15.49:0/4277599162 learned_addr learned my addr 172.21.15.49:0/4277599162 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f260b7fe640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f260c1031f0 0x7f260c19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f260bfff640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260c105b10 0x7f260c19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f260affd640 1 -- 172.21.15.49:0/4277599162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f260c1031f0 msgr2=0x7f260c19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f260affd640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f260c1031f0 0x7f260c19a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f260affd640 1 -- 172.21.15.49:0/4277599162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260c105b10 msgr2=0x7f260c19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f260affd640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260c105b10 0x7f260c19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f260affd640 1 -- 172.21.15.49:0/4277599162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f260c1a04a0 con 0x7f260c1051c0 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f260affd640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 0x7f260c19ab90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f260002a930 tx=0x7f2600004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:20.019 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f2608ff9640 1 -- 172.21.15.49:0/4277599162 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f260003f030 con 0x7f260c1051c0 2024-09-21T06:48:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f2608ff9640 1 -- 172.21.15.49:0/4277599162 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2600003cb0 con 0x7f260c1051c0 2024-09-21T06:48:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f260c1a0730 con 0x7f260c1051c0 2024-09-21T06:48:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f2608ff9640 1 -- 172.21.15.49:0/4277599162 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600035070 con 0x7f260c1051c0 2024-09-21T06:48:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.016+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f260c1a0c10 con 0x7f260c1051c0 2024-09-21T06:48:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.018+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f260c103600 con 0x7f260c1051c0 2024-09-21T06:48:20.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.019+0000 7f2608ff9640 1 -- 172.21.15.49:0/4277599162 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f2600042030 con 0x7f260c1051c0 2024-09-21T06:48:20.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.020+0000 7f2608ff9640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25f40b66b0 0x7f25f40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:20.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.020+0000 7f260b7fe640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25f40b66b0 0x7f25f40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:20.021 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.020+0000 7f2608ff9640 1 -- 172.21.15.49:0/4277599162 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8594+0+0 (secure 0 0 0) 0x7f2600107e70 con 0x7f260c1051c0 2024-09-21T06:48:20.022 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.020+0000 7f260b7fe640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25f40b66b0 0x7f25f40b8bc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00ba40 tx=0x7f25fc005cc0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:20.026 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.024+0000 7f2608ff9640 1 -- 172.21.15.49:0/4277599162 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26000ce370 con 0x7f260c1051c0 2024-09-21T06:48:20.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:19 smithi098 ceph-mon[34704]: pgmap v680: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:20.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:19 smithi098 ceph-mon[34704]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T06:48:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:19 smithi079 ceph-mon[34346]: pgmap v680: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:20.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:19 smithi079 ceph-mon[34346]: osdmap e90: 12 total, 12 up, 12 in 2024-09-21T06:48:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.252+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f260c10bb50 con 0x7f260c1051c0 2024-09-21T06:48:20.254 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.253+0000 7f2608ff9640 1 -- 172.21.15.49:0/4277599162 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11894 (secure 0 0 0) 0x7f26000e3e20 con 0x7f260c1051c0 2024-09-21T06:48:20.255 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:48:20.255 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"btime":"2024-09-21T06:47:50:775873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:47:50.004085+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:48:20.255 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 28 2024-09-21T06:48:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25f40b66b0 msgr2=0x7f25f40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25f40b66b0 0x7f25f40b8bc0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00ba40 tx=0x7f25fc005cc0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 msgr2=0x7f260c19ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 0x7f260c19ab90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f260002a930 tx=0x7f2600004270 comp rx=0 tx=0).stop 2024-09-21T06:48:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 shutdown_connections 2024-09-21T06:48:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f25f40b66b0 0x7f25f40b8bc0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f260c105b10 0x7f260c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f260c1051c0 0x7f260c19ab90 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.257 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 --2- 172.21.15.49:0/4277599162 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f260c1031f0 0x7f260c19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 >> 172.21.15.49:0/4277599162 conn(0x7f260c079f90 msgr2=0x7f260c106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 shutdown_connections 2024-09-21T06:48:20.258 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:20.255+0000 7f2611ded640 1 -- 172.21.15.49:0/4277599162 wait complete. 2024-09-21T06:48:20.890 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:48:21.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:20 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/4277599162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:48:21.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:20 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/4277599162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:48:21.148 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:21.222 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:20 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/4277599162' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:48:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.578+0000 7f5e3c902640 1 -- 172.21.15.49:0/3382616630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e38109df0 msgr2=0x7f5e38110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.578+0000 7f5e3c902640 1 --2- 172.21.15.49:0/3382616630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e38109df0 0x7f5e38110620 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009ca0 tx=0x7f5e3002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.578+0000 7f5e3c902640 1 -- 172.21.15.49:0/3382616630 shutdown_connections 2024-09-21T06:48:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.578+0000 7f5e3c902640 1 --2- 172.21.15.49:0/3382616630 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e38109df0 0x7f5e38110620 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.578+0000 7f5e3c902640 1 --2- 172.21.15.49:0/3382616630 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e381094a0 0x7f5e381098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.578+0000 7f5e3c902640 1 --2- 172.21.15.49:0/3382616630 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e38103b60 0x7f5e38103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.578+0000 7f5e3c902640 1 -- 172.21.15.49:0/3382616630 >> 172.21.15.49:0/3382616630 conn(0x7f5e3807b850 msgr2=0x7f5e3807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:21.581 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.578+0000 7f5e3c902640 1 -- 172.21.15.49:0/3382616630 shutdown_connections 2024-09-21T06:48:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.579+0000 7f5e3c902640 1 -- 172.21.15.49:0/3382616630 wait complete. 2024-09-21T06:48:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.579+0000 7f5e3c902640 1 Processor -- start 2024-09-21T06:48:21.582 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.579+0000 7f5e3c902640 1 -- start start 2024-09-21T06:48:21.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e3c902640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e38103b60 0x7f5e3819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:21.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e3c902640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e381094a0 0x7f5e3819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:21.583 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e3c902640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e38109df0 0x7f5e3819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e3c902640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f5e38113b30 con 0x7f5e381094a0 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e3c902640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f5e381139b0 con 0x7f5e38103b60 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e3c902640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f5e38113cb0 con 0x7f5e38109df0 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e35d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e381094a0 0x7f5e3819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e35d9b640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e381094a0 0x7f5e3819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59102/0 (socket says 172.21.15.49:59102) 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e35d9b640 1 -- 172.21.15.49:0/1269721311 learned_addr learned my addr 172.21.15.49:0/1269721311 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e36d9d640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e38109df0 0x7f5e3819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e3659c640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e38103b60 0x7f5e3819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e35d9b640 1 -- 172.21.15.49:0/1269721311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e38109df0 msgr2=0x7f5e3819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e35d9b640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e38109df0 0x7f5e3819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e35d9b640 1 -- 172.21.15.49:0/1269721311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e38103b60 msgr2=0x7f5e3819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e35d9b640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e38103b60 0x7f5e3819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.580+0000 7f5e35d9b640 1 -- 172.21.15.49:0/1269721311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e381a0450 con 0x7f5e381094a0 2024-09-21T06:48:21.584 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.581+0000 7f5e35d9b640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e381094a0 0x7f5e3819aa80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000d750 tx=0x7f5e2000db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.581+0000 7f5e2f7fe640 1 -- 172.21.15.49:0/1269721311 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20017070 con 0x7f5e381094a0 2024-09-21T06:48:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.581+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e381a0740 con 0x7f5e381094a0 2024-09-21T06:48:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.581+0000 7f5e2f7fe640 1 -- 172.21.15.49:0/1269721311 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e20009820 con 0x7f5e381094a0 2024-09-21T06:48:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.581+0000 7f5e2f7fe640 1 -- 172.21.15.49:0/1269721311 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e20004c40 con 0x7f5e381094a0 2024-09-21T06:48:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.581+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e381a6ea0 con 0x7f5e381094a0 2024-09-21T06:48:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.582+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e38103f70 con 0x7f5e381094a0 2024-09-21T06:48:21.585 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.584+0000 7f5e2f7fe640 1 -- 172.21.15.49:0/1269721311 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f5e200099d0 con 0x7f5e381094a0 2024-09-21T06:48:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.584+0000 7f5e2f7fe640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b6680 0x7f5e240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.585+0000 7f5e3659c640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b6680 0x7f5e240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:21.586 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.585+0000 7f5e2f7fe640 1 -- 172.21.15.49:0/1269721311 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8594+0+0 (secure 0 0 0) 0x7f5e200e74a0 con 0x7f5e381094a0 2024-09-21T06:48:21.587 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.585+0000 7f5e3659c640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b6680 0x7f5e240b8b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009990 tx=0x7f5e28009110 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:21.589 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.588+0000 7f5e2f7fe640 1 -- 172.21.15.49:0/1269721311 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e200ad9a0 con 0x7f5e381094a0 2024-09-21T06:48:21.814 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.813+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e3819b610 con 0x7f5e381094a0 2024-09-21T06:48:21.815 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:21 smithi049 ceph-mon[31177]: pgmap v682: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:21.815 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.813+0000 7f5e2f7fe640 1 -- 172.21.15.49:0/1269721311 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11894 (secure 0 0 0) 0x7f5e200b1d80 con 0x7f5e381094a0 2024-09-21T06:48:21.816 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:48:21.816 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":28,"btime":"2024-09-21T06:47:50:775873+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14766,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6835/3345748950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6834","nonce":3345748950},{"type":"v1","addr":"172.21.15.49:6835","nonce":3345748950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14778,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6837/3068546594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6836","nonce":3068546594},{"type":"v1","addr":"172.21.15.49:6837","nonce":3068546594}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14826,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6839/649653683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6838","nonce":649653683},{"type":"v1","addr":"172.21.15.49:6839","nonce":649653683}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14832,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.49:6841/3262402873","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6840","nonce":3262402873},{"type":"v1","addr":"172.21.15.49:6841","nonce":3262402873}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24617,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.79:6833/3655012367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":3655012367},{"type":"v1","addr":"172.21.15.79:6833","nonce":3655012367}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24622,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.98:6833/144176304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6832","nonce":144176304},{"type":"v1","addr":"172.21.15.98:6833","nonce":144176304}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":28,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:43.531339+0000","modified":"2024-09-21T06:47:50.004085+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24686,"mds_1":24685,"mds_2":24676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24638":{"gid":24638,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6835/1332274866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6834","nonce":1332274866},{"type":"v1","addr":"172.21.15.79:6835","nonce":1332274866}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.79:6837/1540546438","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6836","nonce":1540546438},{"type":"v1","addr":"172.21.15.79:6837","nonce":1540546438}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.98:6835/1874380420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6834","nonce":1874380420},{"type":"v1","addr":"172.21.15.98:6835","nonce":1874380420}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24676":{"gid":24676,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.98:6837/883661759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6836","nonce":883661759},{"type":"v1","addr":"172.21.15.98:6837","nonce":883661759}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24685":{"gid":24685,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.98:6839/2833694716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6838","nonce":2833694716},{"type":"v1","addr":"172.21.15.98:6839","nonce":2833694716}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.79:6839/1831508343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6838","nonce":1831508343},{"type":"v1","addr":"172.21.15.79:6839","nonce":1831508343}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24686,"qdb_cluster":[24676,24685,24686]},"id":1}]} 2024-09-21T06:48:21.816 INFO:teuthology.orchestra.run.smithi049.stderr:dumped fsmap epoch 28 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b6680 msgr2=0x7f5e240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b6680 0x7f5e240b8b90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5e28009990 tx=0x7f5e28009110 comp rx=0 tx=0).stop 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e381094a0 msgr2=0x7f5e3819aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e381094a0 0x7f5e3819aa80 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000d750 tx=0x7f5e2000db50 comp rx=0 tx=0).stop 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 shutdown_connections 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f5e240b6680 0x7f5e240b8b90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f5e38109df0 0x7f5e3819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f5e381094a0 0x7f5e3819aa80 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 --2- 172.21.15.49:0/1269721311 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f5e38103b60 0x7f5e3819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:21.818 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 >> 172.21.15.49:0/1269721311 conn(0x7f5e3807b850 msgr2=0x7f5e381074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:21.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 shutdown_connections 2024-09-21T06:48:21.819 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:21.816+0000 7f5e3c902640 1 -- 172.21.15.49:0/1269721311 wait complete. 2024-09-21T06:48:22.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:21 smithi098 ceph-mon[34704]: pgmap v682: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:22.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:21 smithi079 ceph-mon[34346]: pgmap v682: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:48:22.432 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:48:22.689 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:23.005 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:22 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1269721311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:48:23.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:22 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1269721311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:48:23.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:22 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1269721311' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:48:23.212 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.211+0000 7f14771bc640 1 -- 172.21.15.49:0/1561652743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 msgr2=0x7f14701087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.211+0000 7f14771bc640 1 --2- 172.21.15.49:0/1561652743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 0x7f14701087e0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f1464009900 tx=0x7f146402a410 comp rx=0 tx=0).stop 2024-09-21T06:48:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.211+0000 7f14771bc640 1 -- 172.21.15.49:0/1561652743 shutdown_connections 2024-09-21T06:48:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.211+0000 7f14771bc640 1 --2- 172.21.15.49:0/1561652743 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1470108d20 0x7f147010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.211+0000 7f14771bc640 1 --2- 172.21.15.49:0/1561652743 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 0x7f14701087e0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.211+0000 7f14771bc640 1 --2- 172.21.15.49:0/1561652743 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1470102ae0 0x7f1470102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.211+0000 7f14771bc640 1 -- 172.21.15.49:0/1561652743 >> 172.21.15.49:0/1561652743 conn(0x7f1470079760 msgr2=0x7f1470079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.211+0000 7f14771bc640 1 -- 172.21.15.49:0/1561652743 shutdown_connections 2024-09-21T06:48:23.213 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.211+0000 7f14771bc640 1 -- 172.21.15.49:0/1561652743 wait complete. 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f14771bc640 1 Processor -- start 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f14771bc640 1 -- start start 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f14771bc640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1470102ae0 0x7f1470199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f14771bc640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 0x7f1470199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f14771bc640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1470108d20 0x7f147019ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f14771bc640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f1470112990 con 0x7f14701083d0 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f14771bc640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f1470112810 con 0x7f1470102ae0 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f14771bc640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f1470112b10 con 0x7f1470108d20 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f146ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 0x7f1470199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f146ffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 0x7f1470199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59118/0 (socket says 172.21.15.49:59118) 2024-09-21T06:48:23.215 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f146ffff640 1 -- 172.21.15.49:0/1641657747 learned_addr learned my addr 172.21.15.49:0/1641657747 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.212+0000 7f1474f58640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1470102ae0 0x7f1470199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f1475759640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1470108d20 0x7f147019ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f146ffff640 1 -- 172.21.15.49:0/1641657747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1470108d20 msgr2=0x7f147019ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f146ffff640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1470108d20 0x7f147019ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f146ffff640 1 -- 172.21.15.49:0/1641657747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1470102ae0 msgr2=0x7f1470199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f146ffff640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1470102ae0 0x7f1470199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f146ffff640 1 -- 172.21.15.49:0/1641657747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147019f3f0 con 0x7f14701083d0 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f146ffff640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 0x7f1470199a20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f1464032fd0 tx=0x7f1464004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f146dffb640 1 -- 172.21.15.49:0/1641657747 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146403f030 con 0x7f14701083d0 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147019f680 con 0x7f14701083d0 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f146dffb640 1 -- 172.21.15.49:0/1641657747 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1464004490 con 0x7f14701083d0 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f146dffb640 1 -- 172.21.15.49:0/1641657747 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464035070 con 0x7f14701083d0 2024-09-21T06:48:23.216 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.213+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14701a5e40 con 0x7f14701083d0 2024-09-21T06:48:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.215+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1470103d10 con 0x7f14701083d0 2024-09-21T06:48:23.217 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.216+0000 7f146dffb640 1 -- 172.21.15.49:0/1641657747 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f1464042030 con 0x7f14701083d0 2024-09-21T06:48:23.218 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.217+0000 7f146dffb640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14580b6680 0x7f14580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:23.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.217+0000 7f1474f58640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14580b6680 0x7f14580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:23.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.217+0000 7f146dffb640 1 -- 172.21.15.49:0/1641657747 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8594+0+0 (secure 0 0 0) 0x7f1464108060 con 0x7f14701083d0 2024-09-21T06:48:23.219 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.218+0000 7f1474f58640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14580b6680 0x7f14580b8b90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f146000bbe0 tx=0x7f146000b390 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:23.222 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.220+0000 7f146dffb640 1 -- 172.21.15.49:0/1641657747 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f14640ce560 con 0x7f14701083d0 2024-09-21T06:48:23.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.410+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1470102ef0 con 0x7f14701083d0 2024-09-21T06:48:23.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.412+0000 7f146dffb640 1 -- 172.21.15.49:0/1641657747 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+23212 (secure 0 0 0) 0x7f14640d2940 con 0x7f14701083d0 2024-09-21T06:48:23.414 INFO:teuthology.orchestra.run.smithi049.stdout: 2024-09-21T06:48:23.414 INFO:teuthology.orchestra.run.smithi049.stdout:{"epoch":90,"fsid":"4a3fd104-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:26:23.438487+0000","modified":"2024-09-21T06:48:18.720358+0000","last_up_change":"2024-09-21T06:33:54.879244+0000","last_in_change":"2024-09-21T06:33:31.668533+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:30:10.495246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:39.428290+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:41.517864+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":89,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7e75c04-e943-49d1-b755-eea63952deac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6802","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6803","nonce":3210538796}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6804","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6805","nonce":3210538796}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6808","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6809","nonce":3210538796}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6806","nonce":3210538796},{"type":"v1","addr":"172.21.15.49:6807","nonce":3210538796}]},"public_addr":"172.21.15.49:6803/3210538796","cluster_addr":"172.21.15.49:6805/3210538796","heartbeat_back_addr":"172.21.15.49:6809/3210538796","heartbeat_front_addr":"172.21.15.49:6807/3210538796","state":["exists","up"]},{"osd":1,"uuid":"fda4851b-7967-4ce0-8ddc-0535145fd111","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6801","nonce":2324008814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6803","nonce":2324008814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6807","nonce":2324008814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2324008814},{"type":"v1","addr":"172.21.15.79:6805","nonce":2324008814}]},"public_addr":"172.21.15.79:6801/2324008814","cluster_addr":"172.21.15.79:6803/2324008814","heartbeat_back_addr":"172.21.15.79:6807/2324008814","heartbeat_front_addr":"172.21.15.79:6805/2324008814","state":["exists","up"]},{"osd":2,"uuid":"4f748692-8431-4e81-8762-0e92b80ede11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6800","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6801","nonce":2078306584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6802","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6803","nonce":2078306584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6806","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6807","nonce":2078306584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6804","nonce":2078306584},{"type":"v1","addr":"172.21.15.98:6805","nonce":2078306584}]},"public_addr":"172.21.15.98:6801/2078306584","cluster_addr":"172.21.15.98:6803/2078306584","heartbeat_back_addr":"172.21.15.98:6807/2078306584","heartbeat_front_addr":"172.21.15.98:6805/2078306584","state":["exists","up"]},{"osd":3,"uuid":"0e648fc9-af23-4980-8379-692e4ca5548f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6810","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6811","nonce":2305435073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6812","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6813","nonce":2305435073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6816","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6817","nonce":2305435073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6814","nonce":2305435073},{"type":"v1","addr":"172.21.15.49:6815","nonce":2305435073}]},"public_addr":"172.21.15.49:6811/2305435073","cluster_addr":"172.21.15.49:6813/2305435073","heartbeat_back_addr":"172.21.15.49:6817/2305435073","heartbeat_front_addr":"172.21.15.49:6815/2305435073","state":["exists","up"]},{"osd":4,"uuid":"55463d33-e576-4e98-ac6b-62c264d1efac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6809","nonce":302730711}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6811","nonce":302730711}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6815","nonce":302730711}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":302730711},{"type":"v1","addr":"172.21.15.79:6813","nonce":302730711}]},"public_addr":"172.21.15.79:6809/302730711","cluster_addr":"172.21.15.79:6811/302730711","heartbeat_back_addr":"172.21.15.79:6815/302730711","heartbeat_front_addr":"172.21.15.79:6813/302730711","state":["exists","up"]},{"osd":5,"uuid":"db652115-165f-4226-aec4-f0d0971e8395","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6808","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6809","nonce":497453656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6810","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6811","nonce":497453656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6814","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6815","nonce":497453656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6812","nonce":497453656},{"type":"v1","addr":"172.21.15.98:6813","nonce":497453656}]},"public_addr":"172.21.15.98:6809/497453656","cluster_addr":"172.21.15.98:6811/497453656","heartbeat_back_addr":"172.21.15.98:6815/497453656","heartbeat_front_addr":"172.21.15.98:6813/497453656","state":["exists","up"]},{"osd":6,"uuid":"889a9a6d-e3ad-4d6e-931c-b20e0e47c84e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6818","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6819","nonce":306059620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6820","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6821","nonce":306059620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6824","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6825","nonce":306059620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6822","nonce":306059620},{"type":"v1","addr":"172.21.15.49:6823","nonce":306059620}]},"public_addr":"172.21.15.49:6819/306059620","cluster_addr":"172.21.15.49:6821/306059620","heartbeat_back_addr":"172.21.15.49:6825/306059620","heartbeat_front_addr":"172.21.15.49:6823/306059620","state":["exists","up"]},{"osd":7,"uuid":"a34b10e4-7b61-4d29-aed8-1c18e98dc8ae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6817","nonce":3688302425}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6819","nonce":3688302425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6823","nonce":3688302425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":3688302425},{"type":"v1","addr":"172.21.15.79:6821","nonce":3688302425}]},"public_addr":"172.21.15.79:6817/3688302425","cluster_addr":"172.21.15.79:6819/3688302425","heartbeat_back_addr":"172.21.15.79:6823/3688302425","heartbeat_front_addr":"172.21.15.79:6821/3688302425","state":["exists","up"]},{"osd":8,"uuid":"1f6bee13-9c82-4580-824f-db812385bbbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6816","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6817","nonce":415055064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6818","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6819","nonce":415055064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6822","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6823","nonce":415055064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6820","nonce":415055064},{"type":"v1","addr":"172.21.15.98:6821","nonce":415055064}]},"public_addr":"172.21.15.98:6817/415055064","cluster_addr":"172.21.15.98:6819/415055064","heartbeat_back_addr":"172.21.15.98:6823/415055064","heartbeat_front_addr":"172.21.15.98:6821/415055064","state":["exists","up"]},{"osd":9,"uuid":"d40c6e35-9aac-4e01-bcdf-fbdf15e06099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6826","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6827","nonce":3971172806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6828","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6829","nonce":3971172806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6832","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6833","nonce":3971172806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.49:6830","nonce":3971172806},{"type":"v1","addr":"172.21.15.49:6831","nonce":3971172806}]},"public_addr":"172.21.15.49:6827/3971172806","cluster_addr":"172.21.15.49:6829/3971172806","heartbeat_back_addr":"172.21.15.49:6833/3971172806","heartbeat_front_addr":"172.21.15.49:6831/3971172806","state":["exists","up"]},{"osd":10,"uuid":"add766c1-16ba-4411-ab43-7acaf3d5c480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6825","nonce":194415108}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6827","nonce":194415108}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6831","nonce":194415108}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":194415108},{"type":"v1","addr":"172.21.15.79:6829","nonce":194415108}]},"public_addr":"172.21.15.79:6825/194415108","cluster_addr":"172.21.15.79:6827/194415108","heartbeat_back_addr":"172.21.15.79:6831/194415108","heartbeat_front_addr":"172.21.15.79:6829/194415108","state":["exists","up"]},{"osd":11,"uuid":"b2ccde96-c178-4fb1-8bb9-6c0093978251","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6824","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6825","nonce":4262170082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6826","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6827","nonce":4262170082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6830","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6831","nonce":4262170082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.98:6828","nonce":4262170082},{"type":"v1","addr":"172.21.15.98:6829","nonce":4262170082}]},"public_addr":"172.21.15.98:6825/4262170082","cluster_addr":"172.21.15.98:6827/4262170082","heartbeat_back_addr":"172.21.15.98:6831/4262170082","heartbeat_front_addr":"172.21.15.98:6829/4262170082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:18.239259+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:42.779481+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:08.773294+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:33.565872+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:59.065030+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:24.785010+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:50.338499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:15.078519+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:39.857026+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:04.666211+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:29.199601+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:52.914831+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":1}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.7","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":4,"to":7}]},{"pgid":"3.21","mappings":[{"from":4,"to":7}]},{"pgid":"3.27","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.37","mappings":[{"from":1,"to":9},{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.49:0/3036880811":"2024-09-22T06:28:12.020916+0000","172.21.15.49:0/913847396":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:6801/679391324":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/1476806315":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/4148430613":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/2496147530":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6800/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/4271034131":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6801/4218148883":"2024-09-22T06:28:12.020916+0000","172.21.15.49:6801/1732676845":"2024-09-22T06:26:45.038217+0000","172.21.15.49:0/1947753988":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/136334353":"2024-09-22T06:27:11.553726+0000","172.21.15.49:0/2741549070":"2024-09-22T06:26:45.038217+0000","172.21.15.49:6800/4218148883":"2024-09-22T06:28:12.020916+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:48:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14580b6680 msgr2=0x7f14580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14580b6680 0x7f14580b8b90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f146000bbe0 tx=0x7f146000b390 comp rx=0 tx=0).stop 2024-09-21T06:48:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 msgr2=0x7f1470199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 0x7f1470199a20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f1464032fd0 tx=0x7f1464004270 comp rx=0 tx=0).stop 2024-09-21T06:48:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 shutdown_connections 2024-09-21T06:48:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f14580b6680 0x7f14580b8b90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f1470108d20 0x7f147019ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f14701083d0 0x7f1470199a20 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:23.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 --2- 172.21.15.49:0/1641657747 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f1470102ae0 0x7f1470199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:23.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 >> 172.21.15.49:0/1641657747 conn(0x7f1470079760 msgr2=0x7f1470104500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:23.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 shutdown_connections 2024-09-21T06:48:23.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:23.414+0000 7f14771bc640 1 -- 172.21.15.49:0/1641657747 wait complete. 2024-09-21T06:48:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:23 smithi049 ceph-mon[31177]: pgmap v683: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:48:23.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:23 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1641657747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:23 smithi098 ceph-mon[34704]: pgmap v683: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:48:24.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:23 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1641657747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:48:24.050 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T06:48:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:23 smithi079 ceph-mon[34346]: pgmap v683: 97 pgs: 97 active+clean; 13 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:48:24.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:23 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1641657747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:48:24.316 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.764+0000 7fb854877640 1 -- 172.21.15.49:0/978868718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb850105300 msgr2=0x7fb85010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.764+0000 7fb854877640 1 --2- 172.21.15.49:0/978868718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb850105300 0x7fb85010d850 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fb838009900 tx=0x7fb83802a410 comp rx=0 tx=0).stop 2024-09-21T06:48:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.764+0000 7fb854877640 1 -- 172.21.15.49:0/978868718 shutdown_connections 2024-09-21T06:48:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.764+0000 7fb854877640 1 --2- 172.21.15.49:0/978868718 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb85010de10 0x7fb850110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.764+0000 7fb854877640 1 --2- 172.21.15.49:0/978868718 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb850105300 0x7fb85010d850 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.764+0000 7fb854877640 1 --2- 172.21.15.49:0/978868718 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb8501049b0 0x7fb850104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.764+0000 7fb854877640 1 -- 172.21.15.49:0/978868718 >> 172.21.15.49:0/978868718 conn(0x7fb850079730 msgr2=0x7fb850079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:24.772 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.764+0000 7fb854877640 1 -- 172.21.15.49:0/978868718 shutdown_connections 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.764+0000 7fb854877640 1 -- 172.21.15.49:0/978868718 wait complete. 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.765+0000 7fb854877640 1 Processor -- start 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.765+0000 7fb854877640 1 -- start start 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.765+0000 7fb854877640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8501049b0 0x7fb85019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.765+0000 7fb854877640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb850105300 0x7fb85019cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb854877640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb85010de10 0x7fb8501a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb854877640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fb850113a70 con 0x7fb85010de10 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb854877640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fb8501138f0 con 0x7fb8501049b0 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb854877640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fb850113bf0 con 0x7fb850105300 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb85010de10 0x7fb8501a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84ed9d640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb85010de10 0x7fb8501a1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:59136/0 (socket says 172.21.15.49:59136) 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84ed9d640 1 -- 172.21.15.49:0/1539636886 learned_addr learned my addr 172.21.15.49:0/1539636886 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84dd9b640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb850105300 0x7fb85019cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:24.773 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84e59c640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8501049b0 0x7fb85019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84ed9d640 1 -- 172.21.15.49:0/1539636886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb850105300 msgr2=0x7fb85019cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84ed9d640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb850105300 0x7fb85019cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84ed9d640 1 -- 172.21.15.49:0/1539636886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8501049b0 msgr2=0x7fb85019c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84ed9d640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8501049b0 0x7fb85019c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84ed9d640 1 -- 172.21.15.49:0/1539636886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8501a25f0 con 0x7fb85010de10 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84e59c640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8501049b0 0x7fb85019c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb84ed9d640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb85010de10 0x7fb8501a1ec0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fb84000eaa0 tx=0x7fb84000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb8477fe640 1 -- 172.21.15.49:0/1539636886 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84000cdb0 con 0x7fb85010de10 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8501a28e0 con 0x7fb85010de10 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb8477fe640 1 -- 172.21.15.49:0/1539636886 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb840005020 con 0x7fb85010de10 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.766+0000 7fb8477fe640 1 -- 172.21.15.49:0/1539636886 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8400116d0 con 0x7fb85010de10 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.767+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8501a9040 con 0x7fb85010de10 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.768+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb850104dc0 con 0x7fb85010de10 2024-09-21T06:48:24.774 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.770+0000 7fb8477fe640 1 -- 172.21.15.49:0/1539636886 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fb8400054a0 con 0x7fb85010de10 2024-09-21T06:48:24.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.771+0000 7fb8477fe640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb83c0b6680 0x7fb83c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:24.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.771+0000 7fb84e59c640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb83c0b6680 0x7fb83c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:24.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.771+0000 7fb8477fe640 1 -- 172.21.15.49:0/1539636886 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8594+0+0 (secure 0 0 0) 0x7fb8400e7d20 con 0x7fb85010de10 2024-09-21T06:48:24.775 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.772+0000 7fb84e59c640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb83c0b6680 0x7fb83c0b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb8480058c0 tx=0x7fb848005850 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:24.776 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:24.774+0000 7fb8477fe640 1 -- 172.21.15.49:0/1539636886 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb840016030 con 0x7fb85010de10 2024-09-21T06:48:25.002 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.000+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb85019d7b0 con 0x7fb85010de10 2024-09-21T06:48:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.002+0000 7fb8477fe640 1 -- 172.21.15.49:0/1539636886 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7fb85019d7b0 con 0x7fb85010de10 2024-09-21T06:48:25.004 INFO:teuthology.orchestra.run.smithi049.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:48:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb83c0b6680 msgr2=0x7fb83c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb83c0b6680 0x7fb83c0b8b90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb8480058c0 tx=0x7fb848005850 comp rx=0 tx=0).stop 2024-09-21T06:48:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb85010de10 msgr2=0x7fb8501a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb85010de10 0x7fb8501a1ec0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fb84000eaa0 tx=0x7fb84000ef60 comp rx=0 tx=0).stop 2024-09-21T06:48:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 shutdown_connections 2024-09-21T06:48:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fb83c0b6680 0x7fb83c0b8b90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:25.007 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fb85010de10 0x7fb8501a1ec0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fb850105300 0x7fb85019cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 --2- 172.21.15.49:0/1539636886 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fb8501049b0 0x7fb85019c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.005+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 >> 172.21.15.49:0/1539636886 conn(0x7fb850079730 msgr2=0x7fb850109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.006+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 shutdown_connections 2024-09-21T06:48:25.008 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:25.006+0000 7fb854877640 1 -- 172.21.15.49:0/1539636886 wait complete. 2024-09-21T06:48:25.017 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:25 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a[31173]: 2024-09-21T06:48:25.001+0000 7f94e3e60640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:48:25.546 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c[63721]: ignoring --setuser ceph since I am not root 2024-09-21T06:48:25.546 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c[63721]: ignoring --setgroup ceph since I am not root 2024-09-21T06:48:25.546 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mds[63725]: -- 172.21.15.98:0/874297080 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b3c4371c20 con 0x55b3c8519a80 2024-09-21T06:48:25.546 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c[63721]: starting mds.c at 2024-09-21T06:48:25.546 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f[63447]: ignoring --setuser ceph since I am not root 2024-09-21T06:48:25.546 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f[63447]: ignoring --setgroup ceph since I am not root 2024-09-21T06:48:25.546 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mds[63451]: -- 172.21.15.98:0/1883059779 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e318477860 con 0x55e31c61fa80 2024-09-21T06:48:25.546 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f[63447]: starting mds.f at 2024-09-21T06:48:25.547 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i[63991]: ignoring --setuser ceph since I am not root 2024-09-21T06:48:25.547 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i[63991]: ignoring --setgroup ceph since I am not root 2024-09-21T06:48:25.547 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mds[63995]: -- 172.21.15.98:0/1408120998 <== mon.0 v2:172.21.15.49:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600a7387c20 con 0x5600ab52f180 2024-09-21T06:48:25.547 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i[63991]: starting mds.i at 2024-09-21T06:48:25.568 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b[63541]: ignoring --setuser ceph since I am not root 2024-09-21T06:48:25.568 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b[63541]: ignoring --setgroup ceph since I am not root 2024-09-21T06:48:25.568 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mds[63545]: -- 172.21.15.79:0/4004620918 <== mon.1 v2:172.21.15.98:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a05743860 con 0x563a098eb180 2024-09-21T06:48:25.568 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b[63541]: starting mds.b at 2024-09-21T06:48:25.569 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e[62989]: ignoring --setuser ceph since I am not root 2024-09-21T06:48:25.569 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e[62989]: ignoring --setgroup ceph since I am not root 2024-09-21T06:48:25.569 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mds[62993]: -- 172.21.15.79:0/788403843 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a689cb860 con 0x559a6cb73180 2024-09-21T06:48:25.569 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e[62989]: starting mds.e at 2024-09-21T06:48:25.569 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h[63259]: ignoring --setuser ceph since I am not root 2024-09-21T06:48:25.569 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h[63259]: ignoring --setgroup ceph since I am not root 2024-09-21T06:48:25.569 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mds[63263]: -- 172.21.15.79:0/3792239894 <== mon.2 v2:172.21.15.79:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f17843860 con 0x555f1b9eb180 2024-09-21T06:48:25.569 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h[63259]: starting mds.h at 2024-09-21T06:48:25.668 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:48:25.935 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:26.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mon[34704]: pgmap v684: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 614 B/s wr, 7 op/s 2024-09-21T06:48:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1539636886' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:48:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mon[34704]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:48:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mon[34704]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:48:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/1539636886' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:48:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mon[34704]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T06:48:26.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:25 smithi098 ceph-mon[34704]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:48:26.055 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:25 smithi049 ceph-mon[31177]: pgmap v684: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 614 B/s wr, 7 op/s 2024-09-21T06:48:26.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:25 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1539636886' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:48:26.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:25 smithi049 ceph-mon[31177]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:48:26.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:25 smithi049 ceph-mon[31177]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:48:26.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:25 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/1539636886' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:48:26.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:25 smithi049 ceph-mon[31177]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T06:48:26.056 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:25 smithi049 ceph-mon[31177]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:48:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mon[34346]: pgmap v684: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 614 B/s wr, 7 op/s 2024-09-21T06:48:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1539636886' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:48:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mon[34346]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:48:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mon[34346]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:48:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/1539636886' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:48:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mon[34346]: osdmap e91: 12 total, 12 up, 12 in 2024-09-21T06:48:26.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:25 smithi079 ceph-mon[34346]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:48:26.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.405+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3233008820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc01083a0 msgr2=0x7fcdc01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:26.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.405+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3233008820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc01083a0 0x7fcdc01087b0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009900 tx=0x7fcdb402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:48:26.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.405+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3233008820 shutdown_connections 2024-09-21T06:48:26.407 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.405+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3233008820 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdc0108cf0 0x7fcdc010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.405+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3233008820 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc01083a0 0x7fcdc01087b0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.405+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3233008820 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdc0102a60 0x7fcdc0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.405+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3233008820 >> 172.21.15.49:0/3233008820 conn(0x7fcdc0079730 msgr2=0x7fcdc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.405+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3233008820 shutdown_connections 2024-09-21T06:48:26.408 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.405+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3233008820 wait complete. 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.406+0000 7fcdc5acb640 1 Processor -- start 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.406+0000 7fcdc5acb640 1 -- start start 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.406+0000 7fcdc5acb640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.406+0000 7fcdc5acb640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdc01083a0 0x7fcdc019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdc5acb640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdc5acb640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc0112960 con 0x7fcdc0108cf0 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdc5acb640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc01127e0 con 0x7fcdc01083a0 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdc5acb640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc0112ae0 con 0x7fcdc0102a60 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbffff640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41118/0 (socket says 172.21.15.49:41118) 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbffff640 1 -- 172.21.15.49:0/3305902831 learned_addr learned my addr 172.21.15.49:0/3305902831 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:48:26.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbf7fe640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbeffd640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdc01083a0 0x7fcdc019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbffff640 1 -- 172.21.15.49:0/3305902831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdc0102a60 msgr2=0x7fcdc019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbffff640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbffff640 1 -- 172.21.15.49:0/3305902831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdc01083a0 msgr2=0x7fcdc019a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbffff640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdc01083a0 0x7fcdc019a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbffff640 1 -- 172.21.15.49:0/3305902831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc01a02d0 con 0x7fcdc0108cf0 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbeffd640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdc01083a0 0x7fcdc019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbffff640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fc60 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800cce0 tx=0x7fcdb800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.407+0000 7fcdbcff9640 1 -- 172.21.15.49:0/3305902831 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb800f450 con 0x7fcdc0108cf0 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.408+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc01a05c0 con 0x7fcdc0108cf0 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.408+0000 7fcdbcff9640 1 -- 172.21.15.49:0/3305902831 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdb800faa0 con 0x7fcdc0108cf0 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.408+0000 7fcdbcff9640 1 -- 172.21.15.49:0/3305902831 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8018a80 con 0x7fcdc0108cf0 2024-09-21T06:48:26.411 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.408+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc01a0a80 con 0x7fcdc0108cf0 2024-09-21T06:48:26.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.409+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc0102e70 con 0x7fcdc0108cf0 2024-09-21T06:48:26.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.410+0000 7fcdbcff9640 1 -- 172.21.15.49:0/3305902831 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fcdb80213f0 con 0x7fcdc0108cf0 2024-09-21T06:48:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.411+0000 7fcdbcff9640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcda80b66b0 0x7fcda80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.411+0000 7fcdbf7fe640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcda80b66b0 0x7fcda80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.411+0000 7fcdbcff9640 1 -- 172.21.15.49:0/3305902831 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8808+0+0 (secure 0 0 0) 0x7fcdb80e7d00 con 0x7fcdc0108cf0 2024-09-21T06:48:26.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.412+0000 7fcdbf7fe640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcda80b66b0 0x7fcda80b8bc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000abe0 tx=0x7fcdb000a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:26.417 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.416+0000 7fcdbcff9640 1 -- 172.21.15.49:0/3305902831 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcdb8014030 con 0x7fcdc0108cf0 2024-09-21T06:48:26.645 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:26.643+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcdc010b540 con 0x7fcdc0108cf0 2024-09-21T06:48:27.012 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.010+0000 7fcdbcff9640 1 -- 172.21.15.49:0/3305902831 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7fcdb80ae130 con 0x7fcdc0108cf0 2024-09-21T06:48:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcda80b66b0 msgr2=0x7fcda80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcda80b66b0 0x7fcda80b8bc0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000abe0 tx=0x7fcdb000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:48:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc0108cf0 msgr2=0x7fcdc019fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fc60 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fcdb800cce0 tx=0x7fcdb800a620 comp rx=0 tx=0).stop 2024-09-21T06:48:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 shutdown_connections 2024-09-21T06:48:27.015 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fcda80b66b0 0x7fcda80b8bc0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fcdc0108cf0 0x7fcdc019fc60 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fcdc01083a0 0x7fcdc019a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 --2- 172.21.15.49:0/3305902831 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fcdc0102a60 0x7fcdc019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.012+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 >> 172.21.15.49:0/3305902831 conn(0x7fcdc0079730 msgr2=0x7fcdc006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.013+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 shutdown_connections 2024-09-21T06:48:27.016 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:27.013+0000 7fcdc5acb640 1 -- 172.21.15.49:0/3305902831 wait complete. 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.79:6836/3608373624,v1:172.21.15.79:6837/3608373624] up:boot 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.79:6834/2298146449,v1:172.21.15.79:6838/2298146449] up:boot 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.79:6835/2644288712,v1:172.21.15.79:6839/2644288712] up:boot 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.98:6834/2969305183,v1:172.21.15.98:6835/2969305183] up:boot 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.98:6836/1625617415,v1:172.21.15.98:6837/1625617415] up:boot 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: mds.? [v2:172.21.15.98:6838/3255409544,v1:172.21.15.98:6839/3255409544] up:boot 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:48:27.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:48:27.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:48:27.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:48:27.297 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:27 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3305902831' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:48:27.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.79:6836/3608373624,v1:172.21.15.79:6837/3608373624] up:boot 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.79:6834/2298146449,v1:172.21.15.79:6838/2298146449] up:boot 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.79:6835/2644288712,v1:172.21.15.79:6839/2644288712] up:boot 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.98:6834/2969305183,v1:172.21.15.98:6835/2969305183] up:boot 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.98:6836/1625617415,v1:172.21.15.98:6837/1625617415] up:boot 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: mds.? [v2:172.21.15.98:6838/3255409544,v1:172.21.15.98:6839/3255409544] up:boot 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:48:27.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:27 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3305902831' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.79:6836/3608373624,v1:172.21.15.79:6837/3608373624] up:boot 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.79:6834/2298146449,v1:172.21.15.79:6838/2298146449] up:boot 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.79:6835/2644288712,v1:172.21.15.79:6839/2644288712] up:boot 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.98:6834/2969305183,v1:172.21.15.98:6835/2969305183] up:boot 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.98:6836/1625617415,v1:172.21.15.98:6837/1625617415] up:boot 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: mds.? [v2:172.21.15.98:6838/3255409544,v1:172.21.15.98:6839/3255409544] up:boot 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:48:27.326 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: from='mgr.14226 172.21.15.49:0/3545799947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:48:27.327 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:27 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3305902831' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:48:27.732 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:48:27.990 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:28.265 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:28 smithi049 ceph-mon[31177]: pgmap v686: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-21T06:48:28.265 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:28 smithi049 ceph-mon[31177]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:48:28.265 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:28 smithi049 ceph-mon[31177]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:48:28.265 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:28 smithi049 ceph-mon[31177]: Cluster is now healthy 2024-09-21T06:48:28.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:28 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/3305902831' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:48:28.266 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:28 smithi049 ceph-mon[31177]: fsmap 12 up:standby 2024-09-21T06:48:28.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:28 smithi098 ceph-mon[34704]: pgmap v686: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-21T06:48:28.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:28 smithi098 ceph-mon[34704]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:48:28.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:28 smithi098 ceph-mon[34704]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:48:28.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:28 smithi098 ceph-mon[34704]: Cluster is now healthy 2024-09-21T06:48:28.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:28 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/3305902831' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:48:28.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:28 smithi098 ceph-mon[34704]: fsmap 12 up:standby 2024-09-21T06:48:28.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:28 smithi079 ceph-mon[34346]: pgmap v686: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 639 B/s wr, 6 op/s 2024-09-21T06:48:28.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:28 smithi079 ceph-mon[34346]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:48:28.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:28 smithi079 ceph-mon[34346]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:48:28.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:28 smithi079 ceph-mon[34346]: Cluster is now healthy 2024-09-21T06:48:28.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:28 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/3305902831' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:48:28.319 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:28 smithi079 ceph-mon[34346]: fsmap 12 up:standby 2024-09-21T06:48:28.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.491+0000 7fce27185640 1 -- 172.21.15.49:0/4168168963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce201048c0 msgr2=0x7fce20104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:28.494 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.491+0000 7fce27185640 1 --2- 172.21.15.49:0/4168168963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce201048c0 0x7fce20104cd0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fce08009900 tx=0x7fce0802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:48:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.491+0000 7fce27185640 1 -- 172.21.15.49:0/4168168963 shutdown_connections 2024-09-21T06:48:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.491+0000 7fce27185640 1 --2- 172.21.15.49:0/4168168963 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce2010de70 0x7fce20110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.491+0000 7fce27185640 1 --2- 172.21.15.49:0/4168168963 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce201052f0 0x7fce2010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.491+0000 7fce27185640 1 --2- 172.21.15.49:0/4168168963 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce201048c0 0x7fce20104cd0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.491+0000 7fce27185640 1 -- 172.21.15.49:0/4168168963 >> 172.21.15.49:0/4168168963 conn(0x7fce20079770 msgr2=0x7fce20079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.491+0000 7fce27185640 1 -- 172.21.15.49:0/4168168963 shutdown_connections 2024-09-21T06:48:28.495 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.491+0000 7fce27185640 1 -- 172.21.15.49:0/4168168963 wait complete. 2024-09-21T06:48:28.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.492+0000 7fce27185640 1 Processor -- start 2024-09-21T06:48:28.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.492+0000 7fce27185640 1 -- start start 2024-09-21T06:48:28.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.492+0000 7fce27185640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce201048c0 0x7fce201027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:28.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.492+0000 7fce27185640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce201052f0 0x7fce20102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:28.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.492+0000 7fce27185640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce2010de70 0x7fce20103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:28.497 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.492+0000 7fce27185640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7fce20113b10 con 0x7fce2010de70 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.492+0000 7fce27185640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7fce20113990 con 0x7fce201048c0 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.492+0000 7fce27185640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7fce20113c90 con 0x7fce201052f0 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce25722640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce2010de70 0x7fce20103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce25722640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce2010de70 0x7fce20103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41122/0 (socket says 172.21.15.49:41122) 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce25722640 1 -- 172.21.15.49:0/442617759 learned_addr learned my addr 172.21.15.49:0/442617759 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce1ffff640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce201052f0 0x7fce20102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce24f21640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce201048c0 0x7fce201027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce25722640 1 -- 172.21.15.49:0/442617759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce201052f0 msgr2=0x7fce20102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce25722640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce201052f0 0x7fce20102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce25722640 1 -- 172.21.15.49:0/442617759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce201048c0 msgr2=0x7fce201027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce25722640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce201048c0 0x7fce201027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:28.498 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce25722640 1 -- 172.21.15.49:0/442617759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce201a8710 con 0x7fce2010de70 2024-09-21T06:48:28.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce25722640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce2010de70 0x7fce20103250 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fce1800d750 tx=0x7fce1800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:28.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce1dffb640 1 -- 172.21.15.49:0/442617759 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18017070 con 0x7fce2010de70 2024-09-21T06:48:28.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce1dffb640 1 -- 172.21.15.49:0/442617759 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce180054d0 con 0x7fce2010de70 2024-09-21T06:48:28.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.493+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce201a8a00 con 0x7fce2010de70 2024-09-21T06:48:28.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.494+0000 7fce1dffb640 1 -- 172.21.15.49:0/442617759 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce18004c60 con 0x7fce2010de70 2024-09-21T06:48:28.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.494+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce201a8f40 con 0x7fce2010de70 2024-09-21T06:48:28.499 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.495+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce2006c200 con 0x7fce2010de70 2024-09-21T06:48:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.496+0000 7fce1dffb640 1 -- 172.21.15.49:0/442617759 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7fce18009bd0 con 0x7fce2010de70 2024-09-21T06:48:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.497+0000 7fce1dffb640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce0c0b6680 0x7fce0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.497+0000 7fce24f21640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce0c0b6680 0x7fce0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.497+0000 7fce1dffb640 1 -- 172.21.15.49:0/442617759 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8808+0+0 (secure 0 0 0) 0x7fce180e7140 con 0x7fce2010de70 2024-09-21T06:48:28.500 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.498+0000 7fce24f21640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce0c0b6680 0x7fce0c0b8b90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fce08000c00 tx=0x7fce08031400 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:28.504 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.501+0000 7fce1dffb640 1 -- 172.21.15.49:0/442617759 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce180b1950 con 0x7fce2010de70 2024-09-21T06:48:28.694 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:28.691+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fce201a9280 con 0x7fce2010de70 2024-09-21T06:48:29.020 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.017+0000 7fce1dffb640 1 -- 172.21.15.49:0/442617759 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7fce180b6890 con 0x7fce2010de70 2024-09-21T06:48:29.020 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:48:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.021+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce0c0b6680 msgr2=0x7fce0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.021+0000 7fce27185640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce0c0b6680 0x7fce0c0b8b90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fce08000c00 tx=0x7fce08031400 comp rx=0 tx=0).stop 2024-09-21T06:48:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.021+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce2010de70 msgr2=0x7fce20103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:29.024 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.021+0000 7fce27185640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce2010de70 0x7fce20103250 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fce1800d750 tx=0x7fce1800dc10 comp rx=0 tx=0).stop 2024-09-21T06:48:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.022+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 shutdown_connections 2024-09-21T06:48:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.022+0000 7fce27185640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7fce0c0b6680 0x7fce0c0b8b90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.022+0000 7fce27185640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7fce2010de70 0x7fce20103250 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.022+0000 7fce27185640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7fce201052f0 0x7fce20102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.022+0000 7fce27185640 1 --2- 172.21.15.49:0/442617759 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7fce201048c0 0x7fce201027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.022+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 >> 172.21.15.49:0/442617759 conn(0x7fce20079770 msgr2=0x7fce201079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.022+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 shutdown_connections 2024-09-21T06:48:29.025 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:29.022+0000 7fce27185640 1 -- 172.21.15.49:0/442617759 wait complete. 2024-09-21T06:48:29.281 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:29 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/442617759' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:48:29.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:29 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/442617759' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:48:29.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:29 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/442617759' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:48:29.671 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:48:29.930 INFO:teuthology.orchestra.run.smithi049.stderr:Inferring config /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:48:30.295 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:30 smithi098 ceph-mon[34704]: pgmap v687: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 531 B/s wr, 6 op/s 2024-09-21T06:48:30.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:30 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/442617759' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:48:30.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:30 smithi098 ceph-mon[34704]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T06:48:30.312 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:30 smithi049 ceph-mon[31177]: pgmap v687: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 531 B/s wr, 6 op/s 2024-09-21T06:48:30.313 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:30 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/442617759' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:48:30.313 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:30 smithi049 ceph-mon[31177]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T06:48:30.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:30 smithi079 ceph-mon[34346]: pgmap v687: 97 pgs: 97 active+clean; 13 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 531 B/s wr, 6 op/s 2024-09-21T06:48:30.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:30 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/442617759' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:48:30.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:30 smithi079 ceph-mon[34346]: osdmap e92: 12 total, 12 up, 12 in 2024-09-21T06:48:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.407+0000 7f3bda5c6640 1 -- 172.21.15.49:0/1423700137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd41094a0 msgr2=0x7f3bd41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.407+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/1423700137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd41094a0 0x7f3bd41098b0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc009900 tx=0x7f3bbc02a410 comp rx=0 tx=0).stop 2024-09-21T06:48:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.407+0000 7f3bda5c6640 1 -- 172.21.15.49:0/1423700137 shutdown_connections 2024-09-21T06:48:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.407+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/1423700137 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd4109df0 0x7f3bd4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.407+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/1423700137 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd41094a0 0x7f3bd41098b0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.407+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/1423700137 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd4103b60 0x7f3bd4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.407+0000 7f3bda5c6640 1 -- 172.21.15.49:0/1423700137 >> 172.21.15.49:0/1423700137 conn(0x7f3bd407b850 msgr2=0x7f3bd407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.407+0000 7f3bda5c6640 1 -- 172.21.15.49:0/1423700137 shutdown_connections 2024-09-21T06:48:30.410 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.407+0000 7f3bda5c6640 1 -- 172.21.15.49:0/1423700137 wait complete. 2024-09-21T06:48:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bda5c6640 1 Processor -- start 2024-09-21T06:48:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bda5c6640 1 -- start start 2024-09-21T06:48:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bda5c6640 1 --2- >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd4103b60 0x7f3bd419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bda5c6640 1 --2- >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd41094a0 0x7f3bd419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bda5c6640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4109df0 0x7f3bd419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:30.412 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bda5c6640 1 -- --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4113ab0 con 0x7f3bd4109df0 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bda5c6640 1 -- --> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4113930 con 0x7f3bd4103b60 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bda5c6640 1 -- --> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd4113c30 con 0x7f3bd41094a0 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bd8b63640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4109df0 0x7f3bd419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bd8b63640 1 --2- >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4109df0 0x7f3bd419fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.49:3300/0 says I am v2:172.21.15.49:41144/0 (socket says 172.21.15.49:41144) 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bd8b63640 1 -- 172.21.15.49:0/2037900429 learned_addr learned my addr 172.21.15.49:0/2037900429 (peer_addr_for_me v2:172.21.15.49:0/0) 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.408+0000 7f3bd3fff640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd4103b60 0x7f3bd419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bcbfff640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd41094a0 0x7f3bd419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bd8b63640 1 -- 172.21.15.49:0/2037900429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd41094a0 msgr2=0x7f3bd419ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bd8b63640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd41094a0 0x7f3bd419ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bd8b63640 1 -- 172.21.15.49:0/2037900429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd4103b60 msgr2=0x7f3bd419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bd8b63640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd4103b60 0x7f3bd419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bd8b63640 1 -- 172.21.15.49:0/2037900429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd41a0430 con 0x7f3bd4109df0 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bcbfff640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd41094a0 0x7f3bd419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bd8b63640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4109df0 0x7f3bd419fdc0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00cce0 tx=0x7f3bcc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:30.413 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bd1ffb640 1 -- 172.21.15.49:0/2037900429 <== mon.0 v2:172.21.15.49:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc00f450 con 0x7f3bd4109df0 2024-09-21T06:48:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bd1ffb640 1 -- 172.21.15.49:0/2037900429 <== mon.0 v2:172.21.15.49:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bcc00faa0 con 0x7f3bd4109df0 2024-09-21T06:48:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd41a0720 con 0x7f3bd4109df0 2024-09-21T06:48:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bd1ffb640 1 -- 172.21.15.49:0/2037900429 <== mon.0 v2:172.21.15.49:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc018b70 con 0x7f3bd4109df0 2024-09-21T06:48:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.409+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd41a0c10 con 0x7f3bd4109df0 2024-09-21T06:48:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.410+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd4103f70 con 0x7f3bd4109df0 2024-09-21T06:48:30.414 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.412+0000 7f3bd1ffb640 1 -- 172.21.15.49:0/2037900429 <== mon.0 v2:172.21.15.49:3300/0 4 ==== mgrmap(e 24) ==== 154643+0+0 (secure 0 0 0) 0x7f3bcc018d10 con 0x7f3bd4109df0 2024-09-21T06:48:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.412+0000 7f3bd1ffb640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3bc00b66b0 0x7f3bc00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:48:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.413+0000 7f3bd3fff640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3bc00b66b0 0x7f3bc00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:48:30.415 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.413+0000 7f3bd1ffb640 1 -- 172.21.15.49:0/2037900429 <== mon.0 v2:172.21.15.49:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8254+0+0 (secure 0 0 0) 0x7f3bcc0e7a70 con 0x7f3bd4109df0 2024-09-21T06:48:30.416 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.413+0000 7f3bd3fff640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3bc00b66b0 0x7f3bc00b8bc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40058c0 tx=0x7f3bc400a2d0 comp rx=0 tx=0).ready entity=mgr.14226 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:48:30.418 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.416+0000 7f3bd1ffb640 1 -- 172.21.15.49:0/2037900429 <== mon.0 v2:172.21.15.49:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3bd41a0c10 con 0x7f3bd4109df0 2024-09-21T06:48:30.607 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:30.605+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 --> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3bd419b6b0 con 0x7f3bd4109df0 2024-09-21T06:48:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.025+0000 7f3bd1ffb640 1 -- 172.21.15.49:0/2037900429 <== mon.0 v2:172.21.15.49:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7f3bd419b6b0 con 0x7f3bd4109df0 2024-09-21T06:48:31.028 INFO:teuthology.orchestra.run.smithi049.stderr:pool 'cephfs_data' removed 2024-09-21T06:48:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3bc00b66b0 msgr2=0x7f3bc00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3bc00b66b0 0x7f3bc00b8bc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40058c0 tx=0x7f3bc400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:48:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4109df0 msgr2=0x7f3bd419fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:48:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4109df0 0x7f3bd419fdc0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc00cce0 tx=0x7f3bcc00a620 comp rx=0 tx=0).stop 2024-09-21T06:48:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 shutdown_connections 2024-09-21T06:48:31.032 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:6800/202634858,v1:172.21.15.49:6801/202634858] conn(0x7f3bc00b66b0 0x7f3bc00b8bc0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.49:3300/0,v1:172.21.15.49:6789/0] conn(0x7f3bd4109df0 0x7f3bd419fdc0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.98:3300/0,v1:172.21.15.98:6789/0] conn(0x7f3bd41094a0 0x7f3bd419ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 --2- 172.21.15.49:0/2037900429 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x7f3bd4103b60 0x7f3bd419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:48:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 >> 172.21.15.49:0/2037900429 conn(0x7f3bd407b850 msgr2=0x7f3bd4105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:48:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 shutdown_connections 2024-09-21T06:48:31.033 INFO:teuthology.orchestra.run.smithi049.stderr:2024-09-21T06:48:31.029+0000 7f3bda5c6640 1 -- 172.21.15.49:0/2037900429 wait complete. 2024-09-21T06:48:31.296 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:31 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2037900429' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:48:31.318 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:31 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2037900429' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:48:31.400 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:31 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2037900429' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:48:31.728 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:48:31.758 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:48:31.790 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:48:31.823 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T06:48:31.824 DEBUG:teuthology.orchestra.run.smithi049:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:48:31.841 DEBUG:teuthology.orchestra.run.smithi079:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:48:31.859 DEBUG:teuthology.orchestra.run.smithi098:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:48:31.885 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T06:48:31.885 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T06:48:31.885 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:48:31.973 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:31 smithi049 systemd[1]: Stopping Ceph mon.a for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:32 smithi079 ceph-mon[34346]: pgmap v689: 65 pgs: 65 active+clean; 577 KiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:48:32.068 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:32 smithi079 ceph-mon[34346]: from='client.? 172.21.15.49:0/2037900429' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:48:32.069 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:32 smithi079 ceph-mon[34346]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T06:48:32.197 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:32 smithi098 ceph-mon[34704]: pgmap v689: 65 pgs: 65 active+clean; 577 KiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:48:32.197 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:32 smithi098 ceph-mon[34704]: from='client.? 172.21.15.49:0/2037900429' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:48:32.197 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:32 smithi098 ceph-mon[34704]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T06:48:32.472 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:32 smithi049 ceph-mon[31177]: pgmap v689: 65 pgs: 65 active+clean; 577 KiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:48:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:32 smithi049 ceph-mon[31177]: from='client.? 172.21.15.49:0/2037900429' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:48:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:32 smithi049 ceph-mon[31177]: osdmap e93: 12 total, 12 up, 12 in 2024-09-21T06:48:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:32 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a[31173]: 2024-09-21T06:48:32.169+0000 7f94e966b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:32 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a[31173]: 2024-09-21T06:48:32.169+0000 7f94e966b640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T06:48:32.473 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:32 smithi049 podman[107080]: 2024-09-21 06:48:32.252630676 +0000 UTC m=+0.173267517 container died df426c7319b6a9bb20c85dd01d75176914c3dbeed7b65e164a909b4eb706e71c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T06:48:32.897 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:32 smithi049 podman[107080]: 2024-09-21 06:48:32.612288501 +0000 UTC m=+0.532925341 container cleanup df426c7319b6a9bb20c85dd01d75176914c3dbeed7b65e164a909b4eb706e71c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T06:48:32.898 INFO:journalctl@ceph.mon.a.smithi049.stdout:Sep 21 06:48:32 smithi049 bash[107080]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:48:33.029 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T06:48:33.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:33.078 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T06:48:33.078 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T06:48:33.078 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.b 2024-09-21T06:48:33.408 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:33 smithi079 systemd[1]: Stopping Ceph mon.b for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:33.818 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-b[34342]: 2024-09-21T06:48:33.406+0000 7f5d0e490640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:33.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-b[34342]: 2024-09-21T06:48:33.406+0000 7f5d0e490640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:48:33.819 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:33 smithi079 podman[67509]: 2024-09-21 06:48:33.560297574 +0000 UTC m=+0.281162571 container died c1d1b9372ce3731303308a05f08545cf0db219b23addcc805e3e26076db411f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:48:34.158 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:33 smithi079 podman[67509]: 2024-09-21 06:48:33.939912441 +0000 UTC m=+0.660777438 container cleanup c1d1b9372ce3731303308a05f08545cf0db219b23addcc805e3e26076db411f0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-b, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:48:34.159 INFO:journalctl@ceph.mon.b.smithi079.stdout:Sep 21 06:48:33 smithi079 bash[67509]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-b 2024-09-21T06:48:34.302 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T06:48:34.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:34.351 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T06:48:34.351 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T06:48:34.351 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.c 2024-09-21T06:48:34.646 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:34 smithi098 systemd[1]: Stopping Ceph mon.c for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:35.045 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:34 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-c[34687]: 2024-09-21T06:48:34.643+0000 7fb4f0138640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:34 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-c[34687]: 2024-09-21T06:48:34.643+0000 7fb4f0138640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:48:35.046 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:34 smithi098 podman[67534]: 2024-09-21 06:48:34.817801869 +0000 UTC m=+0.276539106 container died 5193bec175e8cb4af24cfd05333e21f68a597a2851a948eb9527fac4748b21b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:48:35.481 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:35 smithi098 podman[67534]: 2024-09-21 06:48:35.186577677 +0000 UTC m=+0.645314899 container cleanup 5193bec175e8cb4af24cfd05333e21f68a597a2851a948eb9527fac4748b21b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T06:48:35.481 INFO:journalctl@ceph.mon.c.smithi098.stdout:Sep 21 06:48:35 smithi098 bash[67534]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mon-c 2024-09-21T06:48:35.613 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T06:48:35.656 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:35.656 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T06:48:35.656 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T06:48:35.656 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:48:35.972 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:48:35 smithi049 systemd[1]: Stopping Ceph mgr.x for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:36.310 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:48:35 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:48:35.974+0000 7f3a1cafa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:36.310 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:48:35 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x[31405]: 2024-09-21T06:48:35.974+0000 7f3a1cafa640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T06:48:36.310 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:48:36 smithi049 podman[107200]: 2024-09-21 06:48:36.01572937 +0000 UTC m=+0.161140078 container died ceece99d7dcbc188e3c0853c80abd64f471845c95b3a08da79dd6050adef62d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-21T06:48:36.653 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:48:36 smithi049 podman[107200]: 2024-09-21 06:48:36.391916404 +0000 UTC m=+0.537327110 container cleanup ceece99d7dcbc188e3c0853c80abd64f471845c95b3a08da79dd6050adef62d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T06:48:36.653 INFO:journalctl@ceph.mgr.x.smithi049.stdout:Sep 21 06:48:36 smithi049 bash[107200]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-x 2024-09-21T06:48:36.830 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T06:48:36.866 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:36.866 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T06:48:36.866 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T06:48:36.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.y 2024-09-21T06:48:37.156 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:48:36 smithi079 systemd[1]: Stopping Ceph mgr.y for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:37.497 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:48:37 smithi079 podman[67634]: 2024-09-21 06:48:37.206971901 +0000 UTC m=+0.131487798 container died 6a90bda024ddf396efd7665f94890019e881598ad0a887070c42a1c507f14920 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-y, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T06:48:37.818 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:48:37 smithi079 podman[67634]: 2024-09-21 06:48:37.585929817 +0000 UTC m=+0.510445716 container cleanup 6a90bda024ddf396efd7665f94890019e881598ad0a887070c42a1c507f14920 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:48:37.818 INFO:journalctl@ceph.mgr.y.smithi079.stdout:Sep 21 06:48:37 smithi079 bash[67634]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-y 2024-09-21T06:48:38.006 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T06:48:38.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:38.044 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T06:48:38.044 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T06:48:38.044 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.z 2024-09-21T06:48:38.372 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:48:38 smithi098 systemd[1]: Stopping Ceph mgr.z for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:38.675 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:48:38 smithi098 podman[67660]: 2024-09-21 06:48:38.370729964 +0000 UTC m=+0.135520080 container died 50c71a99bb5461907f9f39c33abba9a7df203a1965350365b5a457b8fc3d3a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T06:48:39.039 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:48:38 smithi098 podman[67660]: 2024-09-21 06:48:38.674418713 +0000 UTC m=+0.439208830 container cleanup 50c71a99bb5461907f9f39c33abba9a7df203a1965350365b5a457b8fc3d3a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-z, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T06:48:39.039 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:48:38 smithi098 bash[67660]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-z 2024-09-21T06:48:39.039 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:48:38 smithi098 podman[67672]: 2024-09-21 06:48:38.909144656 +0000 UTC m=+0.532306514 container remove 50c71a99bb5461907f9f39c33abba9a7df203a1965350365b5a457b8fc3d3a99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T06:48:39.040 INFO:journalctl@ceph.mgr.z.smithi098.stdout:Sep 21 06:48:38 smithi098 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-21T06:48:39.055 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T06:48:39.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:39.090 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T06:48:39.090 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T06:48:39.090 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.0 2024-09-21T06:48:39.373 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:39 smithi049 systemd[1]: Stopping Ceph osd.0 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:39.723 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:39 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0[48004]: 2024-09-21T06:48:39.371+0000 7f30359f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:39.723 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:39 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0[48004]: 2024-09-21T06:48:39.371+0000 7f30359f7640 -1 osd.0 93 *** Got signal Terminated *** 2024-09-21T06:48:39.723 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:39 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0[48004]: 2024-09-21T06:48:39.371+0000 7f30359f7640 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:48:45.123 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:44 smithi049 podman[107319]: 2024-09-21 06:48:44.831870906 +0000 UTC m=+5.551906081 container died 55d2959a3811243ed592baa3b3f17f1f4e799c0ccc2f0bc2126afb097fcfc6ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T06:48:45.473 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:45 smithi049 podman[107319]: 2024-09-21 06:48:45.330239712 +0000 UTC m=+6.050274884 container cleanup 55d2959a3811243ed592baa3b3f17f1f4e799c0ccc2f0bc2126afb097fcfc6ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:48:45.473 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:45 smithi049 bash[107319]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0 2024-09-21T06:48:45.884 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:45 smithi049 podman[107334]: 2024-09-21 06:48:45.557024089 +0000 UTC m=+0.722499070 container remove 55d2959a3811243ed592baa3b3f17f1f4e799c0ccc2f0bc2126afb097fcfc6ea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T06:48:46.178 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:45 smithi049 podman[107421]: 2024-09-21 06:48:45.883183491 +0000 UTC m=+0.112210093 container create 9054330676ba13462f42c6de4b6e71bab91b12a2b72abe272617d4b57ca5998c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T06:48:46.178 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:45 smithi049 podman[107421]: 2024-09-21 06:48:45.787482491 +0000 UTC m=+0.016509108 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:48:46.178 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:46 smithi049 podman[107421]: 2024-09-21 06:48:46.119219232 +0000 UTC m=+0.348245847 container init 9054330676ba13462f42c6de4b6e71bab91b12a2b72abe272617d4b57ca5998c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:48:46.178 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:46 smithi049 podman[107421]: 2024-09-21 06:48:46.122719553 +0000 UTC m=+0.351746159 container start 9054330676ba13462f42c6de4b6e71bab91b12a2b72abe272617d4b57ca5998c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:48:46.178 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:46 smithi049 podman[107421]: 2024-09-21 06:48:46.177253384 +0000 UTC m=+0.406279996 container attach 9054330676ba13462f42c6de4b6e71bab91b12a2b72abe272617d4b57ca5998c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True) 2024-09-21T06:48:46.473 INFO:journalctl@ceph.osd.0.smithi049.stdout:Sep 21 06:48:46 smithi049 podman[107421]: 2024-09-21 06:48:46.326829598 +0000 UTC m=+0.555856210 container died 9054330676ba13462f42c6de4b6e71bab91b12a2b72abe272617d4b57ca5998c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:48:47.030 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T06:48:47.074 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:47.074 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T06:48:47.074 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T06:48:47.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.1 2024-09-21T06:48:47.399 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:47 smithi079 systemd[1]: Stopping Ceph osd.1 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:47.818 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:47 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1[39087]: 2024-09-21T06:48:47.397+0000 7fef27c8b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:47.818 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:47 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1[39087]: 2024-09-21T06:48:47.397+0000 7fef27c8b640 -1 osd.1 93 *** Got signal Terminated *** 2024-09-21T06:48:47.819 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:47 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1[39087]: 2024-09-21T06:48:47.397+0000 7fef27c8b640 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:48:53.166 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:52 smithi079 podman[67768]: 2024-09-21 06:48:52.893730436 +0000 UTC m=+5.624421772 container died 21983f6b7b145c8d340ac108eed31f1af353f58c2f2d582a7f0fdb7667817a61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T06:48:53.466 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:53 smithi079 podman[67768]: 2024-09-21 06:48:53.230680047 +0000 UTC m=+5.961371390 container cleanup 21983f6b7b145c8d340ac108eed31f1af353f58c2f2d582a7f0fdb7667817a61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T06:48:53.466 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:53 smithi079 bash[67768]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1 2024-09-21T06:48:53.818 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:53 smithi079 podman[67787]: 2024-09-21 06:48:53.46527283 +0000 UTC m=+0.573452604 container remove 21983f6b7b145c8d340ac108eed31f1af353f58c2f2d582a7f0fdb7667817a61 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T06:48:54.244 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:53 smithi079 podman[67874]: 2024-09-21 06:48:53.803222012 +0000 UTC m=+0.016087027 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:48:54.245 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:53 smithi079 podman[67874]: 2024-09-21 06:48:53.991319292 +0000 UTC m=+0.204184341 container create 3e5ad6b6f2dd92fcabf71bc083d4b0547b83bdcf1e641a64adbd3b005463aa82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:48:54.245 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:54 smithi079 podman[67874]: 2024-09-21 06:48:54.243904939 +0000 UTC m=+0.456769949 container init 3e5ad6b6f2dd92fcabf71bc083d4b0547b83bdcf1e641a64adbd3b005463aa82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T06:48:54.568 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:54 smithi079 podman[67874]: 2024-09-21 06:48:54.247235634 +0000 UTC m=+0.460100639 container start 3e5ad6b6f2dd92fcabf71bc083d4b0547b83bdcf1e641a64adbd3b005463aa82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:48:54.568 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:54 smithi079 podman[67874]: 2024-09-21 06:48:54.352246689 +0000 UTC m=+0.565111690 container attach 3e5ad6b6f2dd92fcabf71bc083d4b0547b83bdcf1e641a64adbd3b005463aa82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T06:48:54.569 INFO:journalctl@ceph.osd.1.smithi079.stdout:Sep 21 06:48:54 smithi079 podman[67874]: 2024-09-21 06:48:54.43485382 +0000 UTC m=+0.647718827 container died 3e5ad6b6f2dd92fcabf71bc083d4b0547b83bdcf1e641a64adbd3b005463aa82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:48:55.051 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T06:48:55.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:55.093 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T06:48:55.093 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T06:48:55.093 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.2 2024-09-21T06:48:55.413 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:48:55 smithi098 systemd[1]: Stopping Ceph osd.2 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:55.795 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:48:55 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2[39813]: 2024-09-21T06:48:55.411+0000 7f7cea73c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:55.796 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:48:55 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2[39813]: 2024-09-21T06:48:55.411+0000 7f7cea73c640 -1 osd.2 93 *** Got signal Terminated *** 2024-09-21T06:48:55.796 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:48:55 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2[39813]: 2024-09-21T06:48:55.411+0000 7f7cea73c640 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:49:01.045 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:00 smithi098 podman[67786]: 2024-09-21 06:49:00.784560542 +0000 UTC m=+5.493327419 container died 557c85ac0c1dbe8d7de79eef714994ca680adf273b87b1b672d3e2e89bac5e9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:49:01.389 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:01 smithi098 podman[67786]: 2024-09-21 06:49:01.129068117 +0000 UTC m=+5.837834994 container cleanup 557c85ac0c1dbe8d7de79eef714994ca680adf273b87b1b672d3e2e89bac5e9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T06:49:01.390 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:01 smithi098 bash[67786]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2 2024-09-21T06:49:01.748 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:01 smithi098 podman[67803]: 2024-09-21 06:49:01.388606989 +0000 UTC m=+0.604062973 container remove 557c85ac0c1dbe8d7de79eef714994ca680adf273b87b1b672d3e2e89bac5e9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:49:02.009 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:01 smithi098 podman[67894]: 2024-09-21 06:49:01.747770845 +0000 UTC m=+0.109508248 container create 1d758b3024a6c97d117b8ab69f6d35475f82a6be88983d6956b0edcf2a6bc19f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T06:49:02.009 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:01 smithi098 podman[67894]: 2024-09-21 06:49:01.654269063 +0000 UTC m=+0.016006471 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:49:02.295 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:02 smithi098 podman[67894]: 2024-09-21 06:49:02.008708274 +0000 UTC m=+0.370445674 container init 1d758b3024a6c97d117b8ab69f6d35475f82a6be88983d6956b0edcf2a6bc19f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T06:49:02.296 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:02 smithi098 podman[67894]: 2024-09-21 06:49:02.012148033 +0000 UTC m=+0.373885443 container start 1d758b3024a6c97d117b8ab69f6d35475f82a6be88983d6956b0edcf2a6bc19f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T06:49:02.296 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:02 smithi098 podman[67894]: 2024-09-21 06:49:02.100409416 +0000 UTC m=+0.462146844 container attach 1d758b3024a6c97d117b8ab69f6d35475f82a6be88983d6956b0edcf2a6bc19f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T06:49:02.296 INFO:journalctl@ceph.osd.2.smithi098.stdout:Sep 21 06:49:02 smithi098 podman[67894]: 2024-09-21 06:49:02.200863552 +0000 UTC m=+0.562600953 container died 1d758b3024a6c97d117b8ab69f6d35475f82a6be88983d6956b0edcf2a6bc19f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:49:02.871 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T06:49:02.910 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:02.910 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T06:49:02.910 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T06:49:02.910 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.3 2024-09-21T06:49:03.222 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:02 smithi049 systemd[1]: Stopping Ceph osd.3 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:03.722 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:03 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3[54253]: 2024-09-21T06:49:03.232+0000 7f6dccf44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:03.723 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:03 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3[54253]: 2024-09-21T06:49:03.232+0000 7f6dccf44640 -1 osd.3 93 *** Got signal Terminated *** 2024-09-21T06:49:03.723 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:03 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3[54253]: 2024-09-21T06:49:03.232+0000 7f6dccf44640 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:49:05.973 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:05 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3[54253]: 2024-09-21T06:49:05.561+0000 7f6dc952f640 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:43.152823+0000 front 2024-09-21T06:48:43.152743+0000 (oldest deadline 2024-09-21T06:49:05.452839+0000) 2024-09-21T06:49:06.068 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:05 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:05.741+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:06.547 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:06 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:06.289+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:06.547 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:06 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:06.528+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:06.972 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:06 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3[54253]: 2024-09-21T06:49:06.545+0000 7f6dc952f640 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:43.152823+0000 front 2024-09-21T06:48:43.152743+0000 (oldest deadline 2024-09-21T06:49:05.452839+0000) 2024-09-21T06:49:07.068 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:06 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:06.726+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:07.723 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:07 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3[54253]: 2024-09-21T06:49:07.505+0000 7f6dc952f640 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:43.152823+0000 front 2024-09-21T06:48:43.152743+0000 (oldest deadline 2024-09-21T06:49:05.452839+0000) 2024-09-21T06:49:07.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:07 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:07.259+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:07.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:07 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:07.483+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:08.068 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:07 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:07.739+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:08.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:07 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:07.995+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:08.644 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:08 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:08.236+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:08.645 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:08 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:08.449+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:08.972 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:08 smithi049 podman[107527]: 2024-09-21 06:49:08.643720199 +0000 UTC m=+5.529983563 container died a04e3df349bf514c9b0e4e9e9826717fe28cff975539e159e6870c6ea356a2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:49:09.068 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:08 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:08.785+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:09.285 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:09 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:09.280+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:09.285 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:09 smithi049 podman[107527]: 2024-09-21 06:49:09.033107146 +0000 UTC m=+5.919370498 container cleanup a04e3df349bf514c9b0e4e9e9826717fe28cff975539e159e6870c6ea356a2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T06:49:09.286 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:09 smithi049 bash[107527]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3 2024-09-21T06:49:09.295 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:09 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:09.024+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:09.603 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:09 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:09.468+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:09.603 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:09 smithi049 podman[107546]: 2024-09-21 06:49:09.284504223 +0000 UTC m=+0.634564395 container remove a04e3df349bf514c9b0e4e9e9826717fe28cff975539e159e6870c6ea356a2d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T06:49:09.856 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:09 smithi049 podman[107635]: 2024-09-21 06:49:09.602216467 +0000 UTC m=+0.109701351 container create 9e5cdac41e084de76485c74b55760f2b2910d511bcdc6e8a05b91e951f470640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T06:49:09.856 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:09 smithi049 podman[107635]: 2024-09-21 06:49:09.508782396 +0000 UTC m=+0.016267235 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:49:09.856 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:09 smithi049 podman[107635]: 2024-09-21 06:49:09.854822223 +0000 UTC m=+0.362307060 container init 9e5cdac41e084de76485c74b55760f2b2910d511bcdc6e8a05b91e951f470640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:49:10.068 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:09 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:09.792+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:10.223 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:09 smithi049 podman[107635]: 2024-09-21 06:49:09.858551079 +0000 UTC m=+0.366035909 container start 9e5cdac41e084de76485c74b55760f2b2910d511bcdc6e8a05b91e951f470640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T06:49:10.223 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:09 smithi049 podman[107635]: 2024-09-21 06:49:09.913190882 +0000 UTC m=+0.420675722 container attach 9e5cdac41e084de76485c74b55760f2b2910d511bcdc6e8a05b91e951f470640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:49:10.223 INFO:journalctl@ceph.osd.3.smithi049.stdout:Sep 21 06:49:10 smithi049 podman[107635]: 2024-09-21 06:49:10.060116203 +0000 UTC m=+0.567601038 container died 9e5cdac41e084de76485c74b55760f2b2910d511bcdc6e8a05b91e951f470640 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:49:10.295 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:10 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:10.032+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:10.659 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:10 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:10.301+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:10.660 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:10 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:10.475+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:10.679 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T06:49:10.721 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:10.721 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T06:49:10.721 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T06:49:10.721 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.4 2024-09-21T06:49:11.050 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:10 smithi079 systemd[1]: Stopping Ceph osd.4 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:11.050 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:10 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:10.777+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:11.318 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:11 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4[45517]: 2024-09-21T06:49:11.048+0000 7f627e161640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:11.318 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:11 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4[45517]: 2024-09-21T06:49:11.048+0000 7f627e161640 -1 osd.4 93 *** Got signal Terminated *** 2024-09-21T06:49:11.318 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:11 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4[45517]: 2024-09-21T06:49:11.048+0000 7f627e161640 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:49:11.362 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:11 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:11.068+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:11.722 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:11 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:11.277+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:11.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:11 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:11.477+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:11.795 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:11 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:11.358+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:12.068 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:11 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:11.756+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:12.295 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:12 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:12.020+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:12.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:12 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:12.300+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:12.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:12 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:12.441+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:12.795 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:12 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:12.355+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:13.006 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:12 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:12.743+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:13.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:13 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:13.013+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:13.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:13 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:13.004+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:13.722 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:13 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:13.346+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:13.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:13 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:13.452+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:13.795 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:13 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:13.351+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:14.025 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:13 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:13.767+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:14.026 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:13 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:13.767+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:14.295 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:14 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:14.009+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:14.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:14 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:14.022+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:14.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:14.321+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:14.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:14.454+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:14.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:14 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:14.454+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:14.795 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:14 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:14.312+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:15.066 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:14 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4[45517]: 2024-09-21T06:49:14.823+0000 7f627a74c640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.631602+0000 front 2024-09-21T06:48:50.631629+0000 (oldest deadline 2024-09-21T06:49:14.731876+0000) 2024-09-21T06:49:15.066 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:14 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:14.808+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:15.066 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:14 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:14.808+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:15.268 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:15 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:15.013+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:15.268 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:15 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:15.013+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:15.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:15 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:15.064+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:15.545 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:15 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:15.266+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:15.545 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:15 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:15.266+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.386150+0000 front 2024-09-21T06:48:50.386118+0000 (oldest deadline 2024-09-21T06:49:14.986793+0000) 2024-09-21T06:49:15.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:15 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:15.306+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:15.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:15 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:15.306+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:15.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:15 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:15.455+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:15.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:15 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:15.455+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:16.097 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:15 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4[45517]: 2024-09-21T06:49:15.862+0000 7f627a74c640 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.631602+0000 front 2024-09-21T06:48:50.631629+0000 (oldest deadline 2024-09-21T06:49:14.731876+0000) 2024-09-21T06:49:16.097 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:15 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:15.826+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:16.097 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:15 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:15.826+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:16.295 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:16 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:16.257+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:16.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:16 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:16.257+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:16.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:16 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:16.257+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.386150+0000 front 2024-09-21T06:48:50.386118+0000 (oldest deadline 2024-09-21T06:49:14.986793+0000) 2024-09-21T06:49:16.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:16 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:16.013+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:16.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:16 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:16.013+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:16.361 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:16 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:16.095+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:16.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:16 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:16.409+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:16.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:16 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:16.409+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:16.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:16 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:16.292+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:16.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:16 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:16.292+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:16.725 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:16 smithi079 podman[67991]: 2024-09-21 06:49:16.48256703 +0000 UTC m=+5.559958823 container died c9f188b9adce017e078104d3796eb603d5baf8549d481c3b331fb5390d36c88a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T06:49:17.017 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:16 smithi079 podman[67991]: 2024-09-21 06:49:16.822873702 +0000 UTC m=+5.900265484 container cleanup c9f188b9adce017e078104d3796eb603d5baf8549d481c3b331fb5390d36c88a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:49:17.017 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:16 smithi079 bash[67991]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4 2024-09-21T06:49:17.017 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:16 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:16.844+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:17.017 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:16 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:16.844+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:17.261 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:17 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:17.211+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:17.261 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:17 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:17.211+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.386150+0000 front 2024-09-21T06:48:50.386118+0000 (oldest deadline 2024-09-21T06:49:14.986793+0000) 2024-09-21T06:49:17.261 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:17 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:17.006+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:17.261 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:17 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:17.006+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:17.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:17 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:17.079+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:17.319 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:17 smithi079 podman[68007]: 2024-09-21 06:49:17.015924174 +0000 UTC m=+0.528379608 container remove c9f188b9adce017e078104d3796eb603d5baf8549d481c3b331fb5390d36c88a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:17.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:17 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:17.259+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:17.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:17 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:17.285+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:17.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:17 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:17.285+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:17.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:17 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:17.432+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:17.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:17 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:17.432+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:17.737 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:17 smithi079 podman[68095]: 2024-09-21 06:49:17.317304328 +0000 UTC m=+0.015535848 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:49:17.737 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:17 smithi079 podman[68095]: 2024-09-21 06:49:17.417004458 +0000 UTC m=+0.115235976 container create e5875d4fe85a212b2addfae5b0f9923c1c2eda312fdff2e6ab570d52bf84f9c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:17.737 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:17 smithi079 podman[68095]: 2024-09-21 06:49:17.652877493 +0000 UTC m=+0.351109032 container init e5875d4fe85a212b2addfae5b0f9923c1c2eda312fdff2e6ab570d52bf84f9c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:49:17.737 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:17 smithi079 podman[68095]: 2024-09-21 06:49:17.656019345 +0000 UTC m=+0.354250872 container start e5875d4fe85a212b2addfae5b0f9923c1c2eda312fdff2e6ab570d52bf84f9c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T06:49:17.737 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:17 smithi079 podman[68095]: 2024-09-21 06:49:17.735812071 +0000 UTC m=+0.434043601 container attach e5875d4fe85a212b2addfae5b0f9923c1c2eda312fdff2e6ab570d52bf84f9c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-21T06:49:18.047 INFO:journalctl@ceph.osd.4.smithi079.stdout:Sep 21 06:49:17 smithi079 podman[68095]: 2024-09-21 06:49:17.845299599 +0000 UTC m=+0.543531127 container died e5875d4fe85a212b2addfae5b0f9923c1c2eda312fdff2e6ab570d52bf84f9c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T06:49:18.047 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:17 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:17.890+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:18.048 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:17 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:17.890+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:18.295 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:18 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:18.238+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:18.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:18 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:18.223+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:18.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:18 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:18.223+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.386150+0000 front 2024-09-21T06:48:50.386118+0000 (oldest deadline 2024-09-21T06:49:14.986793+0000) 2024-09-21T06:49:18.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:18 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:18.024+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:18.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:18 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:18.024+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:18.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:18 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:18.045+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:18.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T06:49:18.472 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:18.472 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T06:49:18.472 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T06:49:18.472 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.5 2024-09-21T06:49:18.722 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:18 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:18.288+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:18.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:18 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:18.288+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:18.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:18 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:18.464+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:18.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:18 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:18.464+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:18.767 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:18 smithi098 systemd[1]: Stopping Ceph osd.5 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:19.045 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:18 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:18.765+0000 7f1671495640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:19.045 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:18 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:18.765+0000 7f1671495640 -1 osd.5 93 *** Got signal Terminated *** 2024-09-21T06:49:19.046 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:18 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:18.765+0000 7f1671495640 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:49:19.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:19 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:18.999+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:19.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:18 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:18.887+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:19.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:18 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:18.887+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:19.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:19 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:19.238+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:19.546 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:19 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:19.238+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:19.546 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:19 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:19.238+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.386150+0000 front 2024-09-21T06:48:50.386118+0000 (oldest deadline 2024-09-21T06:49:14.986793+0000) 2024-09-21T06:49:19.546 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:19 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:19.049+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:19.546 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:19 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:19.049+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:19.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:19 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:19.327+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:19.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:19 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:19.327+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:19.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:19 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:19.492+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:19.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:19 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:19.492+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:20.288 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:20 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:20.208+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:20.288 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:20 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:20.020+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:20.288 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:20 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:20.020+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:20.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:20 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:20.042+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:20.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:19 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:19.918+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:20.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:19 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:19.918+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:20.546 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:20 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:20.286+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:20.546 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:20 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:20.286+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.386150+0000 front 2024-09-21T06:48:50.386118+0000 (oldest deadline 2024-09-21T06:49:14.986793+0000) 2024-09-21T06:49:20.722 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:20 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:20.278+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:20.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:20 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:20.278+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:20.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:20 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:20.489+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:20.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:20 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:20.489+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:21.295 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:21 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:21.181+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:21.295 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:21 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:21.181+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:21.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:21 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:21.019+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:21.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:21 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:21.019+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:21.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:21 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:21.264+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:21.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:21 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:21.264+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.386150+0000 front 2024-09-21T06:48:50.386118+0000 (oldest deadline 2024-09-21T06:49:14.986793+0000) 2024-09-21T06:49:21.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:21 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:21.264+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.987178+0000 front 2024-09-21T06:48:54.987149+0000 (oldest deadline 2024-09-21T06:49:20.887273+0000) 2024-09-21T06:49:21.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:21 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:21.000+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:21.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:20 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:20.915+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:21.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:20 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:20.915+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:21.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:21 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:21.511+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:21.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:21 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:21.511+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:21.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:21 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:21.285+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:21.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:21 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:21.285+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:21.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:21 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:21.285+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:22.254 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:21 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:21.990+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:22.254 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:21 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:21.990+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:22.254 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:22 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:22.194+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:22.255 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:22 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:22.194+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:22.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:22 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:22.044+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:22.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:21 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:21.881+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:22.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:21 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:21.881+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:22.545 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:22 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:22.253+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:22.545 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:22 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:22.253+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.386150+0000 front 2024-09-21T06:48:50.386118+0000 (oldest deadline 2024-09-21T06:49:14.986793+0000) 2024-09-21T06:49:22.546 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:22 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:22.253+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.987178+0000 front 2024-09-21T06:48:54.987149+0000 (oldest deadline 2024-09-21T06:49:20.887273+0000) 2024-09-21T06:49:22.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:22 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:22.507+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:22.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:22 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:22.507+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:22.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:22 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:22.265+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:22.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:22 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:22.265+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:22.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:22 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:22.265+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:23.295 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:23 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:23.195+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:23.296 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:23 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:23.195+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:23.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:22 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:22.998+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:23.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:22 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:22.998+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:23.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:23 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:23.247+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.985276+0000 front 2024-09-21T06:48:40.985220+0000 (oldest deadline 2024-09-21T06:49:10.385524+0000) 2024-09-21T06:49:23.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:23 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:23.247+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.386150+0000 front 2024-09-21T06:48:50.386118+0000 (oldest deadline 2024-09-21T06:49:14.986793+0000) 2024-09-21T06:49:23.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:23 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5[46370]: 2024-09-21T06:49:23.247+0000 7f166da80640 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.987178+0000 front 2024-09-21T06:48:54.987149+0000 (oldest deadline 2024-09-21T06:49:20.887273+0000) 2024-09-21T06:49:23.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:23 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:23.076+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:23.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:23 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:23.076+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:23.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:22 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:22.883+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:23.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:22 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:22.883+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:23.512 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:23 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:23.244+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:23.512 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:23 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:23.244+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:23.512 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:23 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:23.244+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:23.972 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:23 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:23.510+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:23.973 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:23 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:23.510+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:24.296 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:24 smithi098 podman[68008]: 2024-09-21 06:49:24.182203019 +0000 UTC m=+5.519542223 container died 8a2e2585ff2ac68435b281d24ed7de09e1315fe924685f539dd87634ba8cc133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:49:24.296 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:24 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:24.147+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:24.296 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:24 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:24.147+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:24.297 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:23 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:23.979+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:24.297 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:23 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:23.979+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:24.297 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:23 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:23.979+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:24.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:24 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:24.029+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:24.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:24 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:24.029+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:24.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:23 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:23.887+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:24.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:23 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:23.887+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:24.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:24 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:24.461+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:24.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:24 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:24.461+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:24.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:24 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:24.231+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:24.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:24 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:24.231+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:24.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:24 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:24.231+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:24.795 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:24 smithi098 podman[68008]: 2024-09-21 06:49:24.524125084 +0000 UTC m=+5.861464289 container cleanup 8a2e2585ff2ac68435b281d24ed7de09e1315fe924685f539dd87634ba8cc133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T06:49:24.796 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:24 smithi098 bash[68008]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5 2024-09-21T06:49:24.796 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:24 smithi098 podman[68025]: 2024-09-21 06:49:24.708899351 +0000 UTC m=+0.525945958 container remove 8a2e2585ff2ac68435b281d24ed7de09e1315fe924685f539dd87634ba8cc133 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T06:49:25.195 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:25 smithi098 podman[68116]: 2024-09-21 06:49:25.039025636 +0000 UTC m=+0.016198833 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:49:25.195 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:25 smithi098 podman[68116]: 2024-09-21 06:49:25.151267885 +0000 UTC m=+0.128441084 container create 7d9927ce85508a1d9080eff26804af90398d966ed31e415997fe1f2c2734a0fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T06:49:25.195 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:24 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:24.932+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:25.195 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:24 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:24.932+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:25.196 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:24 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:24.932+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:25.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:25.070+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:25.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:25.070+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:25.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:24 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:24.905+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:25.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:24 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:24.905+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:25.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:24 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:24.905+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:25.455 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:25.194+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:25.455 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:25.194+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:25.455 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:25 smithi098 podman[68116]: 2024-09-21 06:49:25.370675546 +0000 UTC m=+0.347848751 container init 7d9927ce85508a1d9080eff26804af90398d966ed31e415997fe1f2c2734a0fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T06:49:25.455 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:25 smithi098 podman[68116]: 2024-09-21 06:49:25.373900993 +0000 UTC m=+0.351074191 container start 7d9927ce85508a1d9080eff26804af90398d966ed31e415997fe1f2c2734a0fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:25.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:25 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:25.436+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:25.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:25 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:25.436+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:25.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:25 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:25.191+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:25.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:25 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:25.191+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:25.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:25 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:25.191+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:25.796 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:25 smithi098 podman[68116]: 2024-09-21 06:49:25.4539944 +0000 UTC m=+0.431167610 container attach 7d9927ce85508a1d9080eff26804af90398d966ed31e415997fe1f2c2734a0fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T06:49:25.796 INFO:journalctl@ceph.osd.5.smithi098.stdout:Sep 21 06:49:25 smithi098 podman[68116]: 2024-09-21 06:49:25.562264559 +0000 UTC m=+0.539437762 container died 7d9927ce85508a1d9080eff26804af90398d966ed31e415997fe1f2c2734a0fa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:26.125 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:25.941+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:26.126 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:25.941+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:26.126 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:25 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:25.941+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:26.146 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T06:49:26.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:26.184 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T06:49:26.184 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T06:49:26.184 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.6 2024-09-21T06:49:26.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:26 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:26.082+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:26.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:26 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:26.082+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:26.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:25.896+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:26.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:25.896+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:26.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:25 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:25.896+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:26.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:26 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:26.429+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:26.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:26 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:26.429+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:26.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:26 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:26.429+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:26.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:26 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:26.184+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:26.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:26 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:26.184+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:26.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:26 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:26.184+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:26.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:26 smithi049 systemd[1]: Stopping Ceph osd.6 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:26.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:26 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:26.162+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:26.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:26 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:26.162+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:26.972 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:26 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:26.476+0000 7f1f5e80b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:26.972 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:26 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:26.476+0000 7f1f5e80b640 -1 osd.6 93 *** Got signal Terminated *** 2024-09-21T06:49:26.973 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:26 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:26.476+0000 7f1f5e80b640 -1 osd.6 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:49:27.296 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:27 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:27.164+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:27.296 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:27 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:27.164+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:27.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:26 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:26.942+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:27.297 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:26 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:26.942+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:27.297 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:26 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:26.942+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:27.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:27 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:27.086+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:27.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:27 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:27.086+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:27.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:26 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:26.867+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:27.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:26 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:26.867+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:27.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:26 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:26.867+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:27.472 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:27 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:27.163+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:27.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:27 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:27.163+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:27.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:27 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:27.163+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:27.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:27 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:27.392+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:27.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:27 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:27.392+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:27.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:27 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:27.392+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:28.186 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:27 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:27.919+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:28.187 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:27 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:27.919+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:28.187 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:27 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:27.919+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:28.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:28 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:28.109+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:28.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:28 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:28.109+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:28.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:27 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:27.875+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:28.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:27 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:27.875+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:28.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:27 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:27.875+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:28.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:28 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:28.168+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:28.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:28 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:28.168+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:28.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:28 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:28.168+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:28.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:28 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:28.372+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:28.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:28 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:28.372+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:28.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:28 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:28.372+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:28.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:28 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:28.185+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:28.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:28 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:28.185+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:29.172 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:28 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:28.878+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:29.173 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:28 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:28.878+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:29.173 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:28 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:28.878+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:29.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:29 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:29.100+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:29.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:29 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:29.100+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:29.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:28 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:28.897+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:29.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:28 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:28.897+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:29.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:28 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:28.897+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:29.472 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:29 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:29.328+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:29.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:29 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:29.328+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:29.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:29 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:29.328+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:29.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:29 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:29.190+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:29.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:29 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:29.190+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:29.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:29 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:29.190+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:29.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:29 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:29.190+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:03.013687+0000 front 2024-09-21T06:49:03.013604+0000 (oldest deadline 2024-09-21T06:49:28.913644+0000) 2024-09-21T06:49:29.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:29 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:29.170+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:29.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:29 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:29.170+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:30.113 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:29 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:29.855+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:30.113 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:29 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:29.855+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:30.113 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:29 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:29.855+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:30.214 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:29 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:29.848+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:30.215 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:29 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:29.848+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:30.215 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:29 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:29.848+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:30.472 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:30 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:30.197+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:30.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:30 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:30.197+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:30.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:30 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:30.197+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:30.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:30 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:30.197+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:03.013687+0000 front 2024-09-21T06:49:03.013604+0000 (oldest deadline 2024-09-21T06:49:28.913644+0000) 2024-09-21T06:49:30.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:30 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:30.285+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:30.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:30 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:30.285+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:30.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:30 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:30.285+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:30.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:30 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:30.285+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:30.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:30 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:30.211+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:30.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:30 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:30.211+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:30.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:30 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:30.211+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:30.568 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:30 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:30.111+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:30.568 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:30 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:30.111+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:31.223 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:30 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:30.836+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:31.223 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:30 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:30.836+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:31.224 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:30 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:30.836+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:31.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:31 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:31.066+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:31.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:31 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:31.066+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:31.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:30 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:30.871+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:31.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:30 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:30.871+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:31.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:30 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:30.871+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:31.472 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:31 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:31.198+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:40.310420+0000 front 2024-09-21T06:48:40.310638+0000 (oldest deadline 2024-09-21T06:49:06.210432+0000) 2024-09-21T06:49:31.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:31 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:31.198+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:50.212186+0000 front 2024-09-21T06:48:50.212132+0000 (oldest deadline 2024-09-21T06:49:14.911813+0000) 2024-09-21T06:49:31.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:31 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:31.198+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:54.912318+0000 front 2024-09-21T06:48:54.912545+0000 (oldest deadline 2024-09-21T06:49:20.812300+0000) 2024-09-21T06:49:31.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:31 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6[60715]: 2024-09-21T06:49:31.198+0000 7f1f5adf6640 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:03.013687+0000 front 2024-09-21T06:49:03.013604+0000 (oldest deadline 2024-09-21T06:49:28.913644+0000) 2024-09-21T06:49:31.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:31 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:31.245+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:31.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:31 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:31.245+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:31.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:31 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:31.245+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:31.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:31 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:31.245+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:31.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:31 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:31.221+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:31.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:31 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:31.221+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:31.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:31 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:31.221+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:32.223 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:31 smithi049 podman[107736]: 2024-09-21 06:49:31.892472627 +0000 UTC m=+5.506930467 container died e3f2994bd31b1037f1ad283b97bd6c78c90d4f3a3a6945e1793c11c3e31ec3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:32.264 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:31 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:31.862+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:32.264 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:31 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:31.862+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:32.264 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:31 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:31.862+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:32.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:32 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:32.031+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:32.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:32 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:32.031+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:32.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:31 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:31.914+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:32.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:31 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:31.914+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:32.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:31 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:31.914+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:32.537 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:32 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:32.262+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:32.537 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:32 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:32.262+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:32.537 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:32 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:32.262+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:32.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:32 smithi049 podman[107736]: 2024-09-21 06:49:32.276739868 +0000 UTC m=+5.891197750 container cleanup e3f2994bd31b1037f1ad283b97bd6c78c90d4f3a3a6945e1793c11c3e31ec3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T06:49:32.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:32 smithi049 bash[107736]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6 2024-09-21T06:49:32.723 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:32 smithi049 podman[107752]: 2024-09-21 06:49:32.503095446 +0000 UTC m=+0.605069154 container remove e3f2994bd31b1037f1ad283b97bd6c78c90d4f3a3a6945e1793c11c3e31ec3aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:49:32.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:32 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:32.276+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:32.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:32 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:32.276+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:32.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:32 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:32.276+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:32.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:32 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:32.276+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:33.157 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:32 smithi049 podman[107837]: 2024-09-21 06:49:32.737048765 +0000 UTC m=+0.017211474 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:49:33.157 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:32 smithi049 podman[107837]: 2024-09-21 06:49:32.837211622 +0000 UTC m=+0.117374316 container create c689f364ae30191c4782fbea7dd293496804be8188df36a6bf46e004e62f2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:49:33.157 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:33 smithi049 podman[107837]: 2024-09-21 06:49:33.073125914 +0000 UTC m=+0.353288623 container init c689f364ae30191c4782fbea7dd293496804be8188df36a6bf46e004e62f2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T06:49:33.158 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:33 smithi049 podman[107837]: 2024-09-21 06:49:33.076638647 +0000 UTC m=+0.356801341 container start c689f364ae30191c4782fbea7dd293496804be8188df36a6bf46e004e62f2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:49:33.158 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:33 smithi049 podman[107837]: 2024-09-21 06:49:33.156436799 +0000 UTC m=+0.436599509 container attach c689f364ae30191c4782fbea7dd293496804be8188df36a6bf46e004e62f2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:49:33.290 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:32 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:32.835+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:33.290 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:32 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:32.835+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:33.290 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:32 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:32.835+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:33.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:33.004+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:33.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:33.004+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:33.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:33.004+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:08.207884+0000 front 2024-09-21T06:49:08.207974+0000 (oldest deadline 2024-09-21T06:49:32.307792+0000) 2024-09-21T06:49:33.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:32 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:32.958+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:33.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:32 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:32.958+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:33.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:32 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:32.958+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:33.473 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:33 smithi049 podman[107837]: 2024-09-21 06:49:33.271892671 +0000 UTC m=+0.552055373 container died c689f364ae30191c4782fbea7dd293496804be8188df36a6bf46e004e62f2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:49:33.474 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:33 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:33.314+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:33.474 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:33 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:33.314+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:33.474 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:33 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:33.314+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:33.474 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:33 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:33.314+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:33.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:33 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:33.287+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:33.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:33 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:33.287+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:33.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:33 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:33.287+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:33.820 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T06:49:33.845 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:33 smithi049 podman[107860]: 2024-09-21 06:49:33.785359498 +0000 UTC m=+0.507716488 container remove c689f364ae30191c4782fbea7dd293496804be8188df36a6bf46e004e62f2319 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-21T06:49:33.845 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:33 smithi049 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.6.service: Deactivated successfully. 2024-09-21T06:49:33.846 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:33 smithi049 systemd[1]: Stopped Ceph osd.6 for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:49:33.846 INFO:journalctl@ceph.osd.6.smithi049.stdout:Sep 21 06:49:33 smithi049 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.6.service: Consumed 8.787s CPU time. 2024-09-21T06:49:33.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:33.862 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T06:49:33.863 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T06:49:33.863 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.7 2024-09-21T06:49:34.175 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:33.956+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:34.175 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:33.956+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:34.176 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:33.956+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:34.176 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:33.956+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:34.176 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:33 smithi079 systemd[1]: Stopping Ceph osd.7 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:34.176 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:33.954+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:34.176 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:33.954+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:34.176 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:33 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:33.954+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:08.207884+0000 front 2024-09-21T06:49:08.207974+0000 (oldest deadline 2024-09-21T06:49:32.307792+0000) 2024-09-21T06:49:34.176 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:34 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:34.173+0000 7f1f79b02640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:34.176 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:34 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:34.173+0000 7f1f79b02640 -1 osd.7 93 *** Got signal Terminated *** 2024-09-21T06:49:34.176 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:34 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:34.173+0000 7f1f79b02640 -1 osd.7 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:49:34.243 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:33 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:33.815+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:34.243 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:33 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:33.815+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:34.243 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:33 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:33.815+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:34.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:34 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:34.241+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:34.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:34 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:34.241+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:34.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:34 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:34.241+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:34.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:34 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:34.276+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:34.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:34 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:34.276+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:34.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:34 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:34.276+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:34.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:34 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:34.276+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:35.291 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:34 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:34.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:35.291 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:34 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:34.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:35.291 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:34 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:34.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:35.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:35 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:34.999+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:35.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:35 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:34.999+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:35.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:35 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:34.999+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:08.207884+0000 front 2024-09-21T06:49:08.207974+0000 (oldest deadline 2024-09-21T06:49:32.307792+0000) 2024-09-21T06:49:35.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:34 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:34.981+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:35.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:34 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:34.981+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:35.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:34 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:34.981+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:35.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:34 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:34.981+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:35.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:35 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:35.289+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:35.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:35 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:35.289+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:35.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:35 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:35.289+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:35.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:35 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:35.320+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:35.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:35 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:35.320+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:35.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:35 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:35.320+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:35.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:35 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:35.320+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:36.281 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:35 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:35.843+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:36.281 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:35 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:35.843+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:36.281 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:35 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:35.843+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:36.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:36 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:36.025+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:36.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:36 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:36.025+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:36.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:36 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:36.025+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:08.207884+0000 front 2024-09-21T06:49:08.207974+0000 (oldest deadline 2024-09-21T06:49:32.307792+0000) 2024-09-21T06:49:36.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:36 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:36.021+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:36.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:36 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:36.021+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:36.320 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:36 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:36.021+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:36.320 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:36 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:36.021+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:36.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:36 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:36.279+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:36.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:36 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:36.279+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:36.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:36 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:36.279+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:36.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:36 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:36.368+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:36.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:36 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:36.368+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:36.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:36 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:36.368+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:36.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:36 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:36.368+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:37.252 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:36 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:36.798+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:37.252 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:36 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:36.798+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:37.253 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:36 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:36.798+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:37.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:37 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:37.005+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:37.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:37 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:37.005+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:37.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:37 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:37.005+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:37.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:37 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:37.005+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:37.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:37 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:37.057+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:37.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:37 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:37.057+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:37.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:37 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:37.057+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:08.207884+0000 front 2024-09-21T06:49:08.207974+0000 (oldest deadline 2024-09-21T06:49:32.307792+0000) 2024-09-21T06:49:37.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:37 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:37.250+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:37.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:37 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:37.250+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:37.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:37 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:37.250+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:37.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:37 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:37.359+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:37.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:37 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:37.359+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:37.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:37 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:37.359+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:37.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:37 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:37.359+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:38.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:37 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:37.754+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:38.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:37 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:37.754+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:38.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:37 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:37.754+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:38.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:37 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:37.754+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:38.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:38.009+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:38.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:38.009+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:38.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:38.009+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:08.207884+0000 front 2024-09-21T06:49:08.207974+0000 (oldest deadline 2024-09-21T06:49:32.307792+0000) 2024-09-21T06:49:38.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:38.026+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:38.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:38.026+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:38.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:38.026+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:38.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:38.026+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:38.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:38.026+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:38.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:38 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:38.250+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:38.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:38 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:38.250+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:38.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:38 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:38.250+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:38.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:38 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:38.250+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:13.858816+0000 front 2024-09-21T06:49:13.858947+0000 (oldest deadline 2024-09-21T06:49:37.259067+0000) 2024-09-21T06:49:38.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:38 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:38.396+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:38.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:38 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:38.396+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:38.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:38 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:38.396+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:38.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:38 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:38.396+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:39.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:38 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:38.728+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:39.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:38 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:38.728+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:39.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:38 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:38.728+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:39.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:38 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:38.728+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:39.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:38.979+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:47.704451+0000 front 2024-09-21T06:48:47.704433+0000 (oldest deadline 2024-09-21T06:49:13.004643+0000) 2024-09-21T06:49:39.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:38.979+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.106140+0000 front 2024-09-21T06:48:57.106227+0000 (oldest deadline 2024-09-21T06:49:22.406033+0000) 2024-09-21T06:49:39.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7[52136]: 2024-09-21T06:49:38.979+0000 7f1f720e5640 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:08.207884+0000 front 2024-09-21T06:49:08.207974+0000 (oldest deadline 2024-09-21T06:49:32.307792+0000) 2024-09-21T06:49:39.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:39 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:39.001+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:39.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:39 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:39.001+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:39.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:39 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:39.001+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:39.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:39 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:39.001+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:39.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:39 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:39.001+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:39.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:39 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:39.267+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:39.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:39 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:39.267+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:39.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:39 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:39.267+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:39.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:39 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:39.267+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:13.858816+0000 front 2024-09-21T06:49:13.858947+0000 (oldest deadline 2024-09-21T06:49:37.259067+0000) 2024-09-21T06:49:39.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:39 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:39.431+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:39.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:39 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:39.431+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:39.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:39 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:39.431+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:39.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:39 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:39.431+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:39.924 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:39 smithi079 podman[68197]: 2024-09-21 06:49:39.617264864 +0000 UTC m=+5.550995272 container died 8c0aa88e88a04bb3ec1e3eab6826a19532dfc8fe05b071c81f5e113b51aa3908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:49:40.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:39 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:39.686+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:40.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:39 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:39.686+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:40.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:39 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:39.686+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:40.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:39 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:39.686+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:40.318 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:39 smithi079 podman[68197]: 2024-09-21 06:49:39.922623294 +0000 UTC m=+5.856353701 container cleanup 8c0aa88e88a04bb3ec1e3eab6826a19532dfc8fe05b071c81f5e113b51aa3908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T06:49:40.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:39 smithi079 bash[68197]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7 2024-09-21T06:49:40.319 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:40 smithi079 podman[68225]: 2024-09-21 06:49:40.140432098 +0000 UTC m=+0.523058002 container remove 8c0aa88e88a04bb3ec1e3eab6826a19532dfc8fe05b071c81f5e113b51aa3908 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:40.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:40 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:40.029+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:40.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:40 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:40.029+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:40.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:40 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:40.029+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:40.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:40 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:40.029+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:40.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:40 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:40.029+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:40.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:40 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:40.283+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:40.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:40 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:40.283+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:40.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:40 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:40.283+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:40.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:40 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:40.283+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:13.858816+0000 front 2024-09-21T06:49:13.858947+0000 (oldest deadline 2024-09-21T06:49:37.259067+0000) 2024-09-21T06:49:40.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:40 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:40.387+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:40.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:40 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:40.387+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:40.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:40 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:40.387+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:40.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:40 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:40.387+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:40.769 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:40 smithi079 podman[68311]: 2024-09-21 06:49:40.449635276 +0000 UTC m=+0.111651450 container create e2bf259c3a1edbca78a3b5df87abfeb09970d33a98a1a14c3238165ffa8f81c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:49:40.770 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:40 smithi079 podman[68311]: 2024-09-21 06:49:40.353962935 +0000 UTC m=+0.015979124 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:49:40.770 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:40 smithi079 podman[68311]: 2024-09-21 06:49:40.693644008 +0000 UTC m=+0.355660185 container init e2bf259c3a1edbca78a3b5df87abfeb09970d33a98a1a14c3238165ffa8f81c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T06:49:40.770 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:40 smithi079 podman[68311]: 2024-09-21 06:49:40.696939702 +0000 UTC m=+0.358955878 container start e2bf259c3a1edbca78a3b5df87abfeb09970d33a98a1a14c3238165ffa8f81c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:49:40.770 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:40 smithi079 podman[68311]: 2024-09-21 06:49:40.76842761 +0000 UTC m=+0.430443809 container attach e2bf259c3a1edbca78a3b5df87abfeb09970d33a98a1a14c3238165ffa8f81c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:49:41.021 INFO:journalctl@ceph.osd.7.smithi079.stdout:Sep 21 06:49:40 smithi079 podman[68311]: 2024-09-21 06:49:40.881883242 +0000 UTC m=+0.543899432 container died e2bf259c3a1edbca78a3b5df87abfeb09970d33a98a1a14c3238165ffa8f81c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:49:41.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:40 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:40.659+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:41.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:40 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:40.659+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:41.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:40 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:40.659+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:41.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:40 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:40.659+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:41.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:41 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:41.019+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:41.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:41 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:41.019+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:41.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:41 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:41.019+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:41.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:41 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:41.019+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:41.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:41 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:41.019+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:41.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T06:49:41.484 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:41.485 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T06:49:41.485 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T06:49:41.485 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.8 2024-09-21T06:49:41.513 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:41.256+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:41.513 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:41.256+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:41.513 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:41.256+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:41.513 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:41.256+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:13.858816+0000 front 2024-09-21T06:49:13.858947+0000 (oldest deadline 2024-09-21T06:49:37.259067+0000) 2024-09-21T06:49:41.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:41 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:41.375+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:41.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:41 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:41.375+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:41.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:41 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:41.375+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:41.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:41 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:41.375+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:41.787 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:41 smithi098 systemd[1]: Stopping Ceph osd.8 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:41.787 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:41.687+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:41.787 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:41.687+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:41.787 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:41.687+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:41.787 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:41.687+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:42.045 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:41.785+0000 7f153481f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:42.045 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:41.785+0000 7f153481f640 -1 osd.8 93 *** Got signal Terminated *** 2024-09-21T06:49:42.046 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:41 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:41.785+0000 7f153481f640 -1 osd.8 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:49:42.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:42 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:42.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:42.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:42 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:42.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:42.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:42 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:42.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:42.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:42 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:42.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:42.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:42 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:42.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:42.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:42 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:42.215+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:42.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:42 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:42.215+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:42.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:42 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:42.215+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:42.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:42 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:42.215+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:13.858816+0000 front 2024-09-21T06:49:13.858947+0000 (oldest deadline 2024-09-21T06:49:37.259067+0000) 2024-09-21T06:49:42.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:42 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:42.377+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:42.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:42 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:42.377+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:42.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:42 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:42.377+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:42.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:42 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:42.377+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:43.007 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:42 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:42.666+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:43.007 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:42 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:42.666+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:43.008 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:42 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:42.666+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:43.008 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:42 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:42.666+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:43.295 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:43 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:43.206+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:43.296 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:43 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:43.206+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:43.296 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:43 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:43.206+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:43.296 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:43 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:43.206+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:13.858816+0000 front 2024-09-21T06:49:13.858947+0000 (oldest deadline 2024-09-21T06:49:37.259067+0000) 2024-09-21T06:49:43.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:43 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:43.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:43.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:43 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:43.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:43.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:43 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:43.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:43.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:43 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:43.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:43.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:43 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:43.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:43.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:43 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:43.340+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:43.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:43 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:43.340+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:43.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:43 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:43.340+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:43.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:43 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:43.340+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:44.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:43 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:43.690+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:44.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:43 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:43.690+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:44.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:43 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:43.690+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:44.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:43 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:43.690+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:44.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:44 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:44.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:44.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:44 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:44.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:44.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:44 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:44.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:44.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:44 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:44.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:44.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:44 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:44.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:44.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:44 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:44.189+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:44.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:44 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:44.189+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:44.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:44 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:44.189+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:44.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:44 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:44.189+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:13.858816+0000 front 2024-09-21T06:49:13.858947+0000 (oldest deadline 2024-09-21T06:49:37.259067+0000) 2024-09-21T06:49:44.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:44 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:44.299+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:44.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:44 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:44.299+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:44.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:44 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:44.299+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:44.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:44 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:44.299+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:45.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:44 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:44.738+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:45.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:44 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:44.738+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:45.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:44 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:44.738+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:45.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:44 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:44.738+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:45.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:45 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:45.015+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:45.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:45 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:45.015+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:45.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:45 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:45.015+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:45.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:45 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:45.015+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:45.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:45 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:45.015+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:45.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:45 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:45.216+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:45.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:45 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:45.216+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:45.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:45 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:45.216+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:45.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:45 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:45.216+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:13.858816+0000 front 2024-09-21T06:49:13.858947+0000 (oldest deadline 2024-09-21T06:49:37.259067+0000) 2024-09-21T06:49:45.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:45 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:45.277+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:45.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:45 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:45.277+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:45.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:45 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:45.277+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:45.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:45 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:45.277+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:45.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:45 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:45.277+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:46.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:45 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:45.693+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:46.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:45 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:45.693+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:46.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:45 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:45.693+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:46.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:45 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:45.693+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:46.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:45 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:45.693+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:46.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:46.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:46.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:46.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:46.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.018+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:46.545 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:46 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:46.167+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:52.156537+0000 front 2024-09-21T06:48:52.156655+0000 (oldest deadline 2024-09-21T06:49:15.656312+0000) 2024-09-21T06:49:46.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:46 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:46.167+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:55.656605+0000 front 2024-09-21T06:48:55.656712+0000 (oldest deadline 2024-09-21T06:49:20.956743+0000) 2024-09-21T06:49:46.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:46 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:46.167+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:05.657627+0000 front 2024-09-21T06:49:05.657750+0000 (oldest deadline 2024-09-21T06:49:29.757565+0000) 2024-09-21T06:49:46.546 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:46 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8[52556]: 2024-09-21T06:49:46.167+0000 7f152ce02640 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:13.858816+0000 front 2024-09-21T06:49:13.858947+0000 (oldest deadline 2024-09-21T06:49:37.259067+0000) 2024-09-21T06:49:46.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:46 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:46.296+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:46.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:46 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:46.296+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:46.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:46 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:46.296+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:46.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:46 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:46.296+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:46.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:46 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:46.296+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:47.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:46 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:46.701+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:47.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:46 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:46.701+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:47.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:46 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:46.701+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:47.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:46 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:46.701+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:47.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:46 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:46.701+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:47.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.980+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:47.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.980+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:47.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.980+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:47.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.980+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:47.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:46 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:46.980+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:47.470 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:47 smithi098 podman[68232]: 2024-09-21 06:49:47.214350392 +0000 UTC m=+5.531735307 container died b2a68c1f6a59262d80a070d31d2e03585c2d68a860d4c0481a84c4234df32ed1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T06:49:47.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:47 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:47.280+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:47.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:47 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:47.280+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:47.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:47 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:47.280+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:47.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:47 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:47.280+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:47.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:47 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:47.280+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:47.795 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:47 smithi098 podman[68232]: 2024-09-21 06:49:47.568914604 +0000 UTC m=+5.886299519 container cleanup b2a68c1f6a59262d80a070d31d2e03585c2d68a860d4c0481a84c4234df32ed1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T06:49:47.796 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:47 smithi098 bash[68232]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8 2024-09-21T06:49:47.796 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:47 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:47.700+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:47.796 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:47 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:47.701+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:47.796 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:47 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:47.701+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:47.796 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:47 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:47.701+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:47.796 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:47 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:47.701+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:48.162 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:47 smithi098 podman[68248]: 2024-09-21 06:49:47.853563452 +0000 UTC m=+0.635638670 container remove b2a68c1f6a59262d80a070d31d2e03585c2d68a860d4c0481a84c4234df32ed1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T06:49:48.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:48 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:48.013+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:48.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:48 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:48.013+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:48.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:48 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:48.013+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:48.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:48 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:48.013+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:48.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:48 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:48.013+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:48.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:48 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:48.013+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:48.467 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:48 smithi098 podman[68336]: 2024-09-21 06:49:48.06445137 +0000 UTC m=+0.015931217 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:49:48.467 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:48 smithi098 podman[68336]: 2024-09-21 06:49:48.163010183 +0000 UTC m=+0.114490072 container create d0d4cfe1cf35a5a6e84034062cefc29b464595693f1e8df38235accc47250fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T06:49:48.467 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:48 smithi098 podman[68336]: 2024-09-21 06:49:48.382032805 +0000 UTC m=+0.333512653 container init d0d4cfe1cf35a5a6e84034062cefc29b464595693f1e8df38235accc47250fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:49:48.467 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:48 smithi098 podman[68336]: 2024-09-21 06:49:48.385293461 +0000 UTC m=+0.336773319 container start d0d4cfe1cf35a5a6e84034062cefc29b464595693f1e8df38235accc47250fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T06:49:48.467 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:48 smithi098 podman[68336]: 2024-09-21 06:49:48.465352193 +0000 UTC m=+0.416832041 container attach d0d4cfe1cf35a5a6e84034062cefc29b464595693f1e8df38235accc47250fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:49:48.722 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:48 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:48.239+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:48.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:48 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:48.239+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:48.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:48 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:48.239+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:48.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:48 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:48.239+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:48.723 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:48 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:48.239+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:48.737 INFO:journalctl@ceph.osd.8.smithi098.stdout:Sep 21 06:49:48 smithi098 podman[68336]: 2024-09-21 06:49:48.58134935 +0000 UTC m=+0.532829198 container died d0d4cfe1cf35a5a6e84034062cefc29b464595693f1e8df38235accc47250fc9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-21T06:49:49.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:48 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:48.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:49.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:48 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:48.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:49.047 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:48 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:48.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:49.047 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:48 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:48.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:49.047 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:48 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:48.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:49.124 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T06:49:49.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:49.203 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T06:49:49.203 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T06:49:49.203 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.9 2024-09-21T06:49:49.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:49 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:49.049+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:49.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:49 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:49.049+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:49.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:49 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:49.049+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:49.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:49 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:49.049+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:49.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:49 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:49.049+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:49.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:49 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:49.049+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:49.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:49.210+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:49.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:49.210+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:49.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:49.210+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:49.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:49.210+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:49.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:49.210+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:49.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:49 smithi049 systemd[1]: Stopping Ceph osd.9 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:49.972 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:49.511+0000 7faddd928640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:49.973 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:49.511+0000 7faddd928640 -1 osd.9 93 *** Got signal Terminated *** 2024-09-21T06:49:49.973 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:49 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:49.511+0000 7faddd928640 -1 osd.9 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:49:50.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:49 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:49.713+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:50.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:49 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:49.713+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:50.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:49 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:49.713+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:50.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:49 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:49.713+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:50.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:49 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:49.713+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:50.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:50.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:50.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:50.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:50.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:50.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.020+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:50.474 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:50 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:50.179+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:50.474 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:50 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:50.179+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:50.474 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:50 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:50.179+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:50.474 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:50 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:50.179+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:50.474 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:50 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:50.179+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:51.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:50 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:50.719+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:51.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:50 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:50.719+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:51.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:50 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:50.719+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:51.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:50 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:50.719+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:51.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:50 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:50.719+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:51.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.978+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:51.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.978+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:51.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.978+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:51.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.978+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:51.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.978+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:51.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:50 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:50.978+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:51.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:51 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:51.130+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:51.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:51 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:51.130+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:51.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:51 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:51.130+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:51.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:51 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:51.130+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:51.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:51 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:51.130+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:52.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:51 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:51.685+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:52.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:51 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:51.685+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:52.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:51 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:51.685+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:52.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:51 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:51.685+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:52.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:51 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:51.685+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:52.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:51 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:51.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:52.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:51 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:51.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:52.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:51 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:51.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:52.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:51 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:51.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:52.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:51 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:51.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:52.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:51 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:51.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:52.472 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:52.111+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:52.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:52.111+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:52.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:52.111+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:52.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:52.111+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:52.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:52 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:52.111+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:53.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:52 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:52.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:53.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:52 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:52.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:53.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:52 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:52.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:53.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:52 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:52.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:53.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:52 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:52.735+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:53.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:52 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:52.934+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:53.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:52 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:52.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:53.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:52 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:52.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:53.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:52 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:52.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:53.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:52 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:52.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:53.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:52 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:52.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:53.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:53 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:53.134+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:53.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:53 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:53.134+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:53.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:53 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:53.134+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:53.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:53 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:53.134+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:53.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:53 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:53.134+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:53.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:53 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:53.134+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:29.487525+0000 front 2024-09-21T06:49:29.487575+0000 (oldest deadline 2024-09-21T06:49:52.987491+0000) 2024-09-21T06:49:54.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:53 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:53.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:54.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:53 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:53.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:54.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:53 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:53.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:54.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:53 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:53.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:54.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:53 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:53.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:54.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:53 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:53.950+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:54.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:53 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:53.950+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:54.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:53 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:53.950+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:54.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:53 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:53.950+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:54.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:53 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:53.950+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:54.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:53 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:53.950+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:54.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:54 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:54.109+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:41.580320+0000 front 2024-09-21T06:48:41.580606+0000 (oldest deadline 2024-09-21T06:49:06.280489+0000) 2024-09-21T06:49:54.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:54 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:54.109+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.382781+0000 front 2024-09-21T06:48:51.382809+0000 (oldest deadline 2024-09-21T06:49:14.282804+0000) 2024-09-21T06:49:54.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:54 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:54.109+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:49:00.184141+0000 front 2024-09-21T06:49:00.183980+0000 (oldest deadline 2024-09-21T06:49:26.084029+0000) 2024-09-21T06:49:54.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:54 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:54.109+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:06.084423+0000 front 2024-09-21T06:49:06.084374+0000 (oldest deadline 2024-09-21T06:49:29.584481+0000) 2024-09-21T06:49:54.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:54 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:54.109+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.686855+0000 front 2024-09-21T06:49:23.686658+0000 (oldest deadline 2024-09-21T06:49:44.786589+0000) 2024-09-21T06:49:54.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:54 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9[67364]: 2024-09-21T06:49:54.109+0000 7fadd5f0b640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:29.487525+0000 front 2024-09-21T06:49:29.487575+0000 (oldest deadline 2024-09-21T06:49:52.987491+0000) 2024-09-21T06:49:55.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:54 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:54.741+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:55.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:54 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:54.741+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:55.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:54 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:54.741+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:55.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:54 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:54.741+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:55.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:54 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:54.741+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:55.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:54 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:54.741+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:49:55.197 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:54 smithi049 podman[107950]: 2024-09-21 06:49:54.939658634 +0000 UTC m=+5.532272377 container died ec269e96a715af4395cc5432c4cf6cb2e04e0f216f83bffb1a33d952b3124e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:55.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:54 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:54.955+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:55.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:54 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:54.955+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:55.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:54 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:54.955+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:55.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:54 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:54.955+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:55.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:54 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:54.955+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:55.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:54 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:54.955+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:55.472 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:55 smithi049 podman[107950]: 2024-09-21 06:49:55.286183271 +0000 UTC m=+5.878796995 container cleanup ec269e96a715af4395cc5432c4cf6cb2e04e0f216f83bffb1a33d952b3124e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:49:55.472 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:55 smithi049 bash[107950]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9 2024-09-21T06:49:55.922 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:55 smithi049 podman[107966]: 2024-09-21 06:49:55.554136897 +0000 UTC m=+0.614233214 container remove ec269e96a715af4395cc5432c4cf6cb2e04e0f216f83bffb1a33d952b3124e1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T06:49:56.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:55 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:55.692+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:56.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:55 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:55.692+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:56.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:55 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:55.692+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:56.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:55 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:55.692+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:56.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:55 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:55.692+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:56.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:55 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:55.692+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:49:56.121 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:55 smithi049 podman[108054]: 2024-09-21 06:49:55.921687867 +0000 UTC m=+0.112164531 container create bc0fbe74cedfff129cd54a638c8edb753acaca17275ac7de560954d07ec38d44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-21T06:49:56.121 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:55 smithi049 podman[108054]: 2024-09-21 06:49:55.825915695 +0000 UTC m=+0.016392333 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:49:56.121 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:56 smithi049 podman[108054]: 2024-09-21 06:49:56.116057148 +0000 UTC m=+0.306533779 container init bc0fbe74cedfff129cd54a638c8edb753acaca17275ac7de560954d07ec38d44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T06:49:56.121 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:56 smithi049 podman[108054]: 2024-09-21 06:49:56.119333207 +0000 UTC m=+0.309809822 container start bc0fbe74cedfff129cd54a638c8edb753acaca17275ac7de560954d07ec38d44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T06:49:56.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:55 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:55.928+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:56.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:55 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:55.928+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:56.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:55 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:55.928+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:56.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:55 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:55.928+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:56.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:55 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:55.928+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:56.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:55 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:55.928+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:56.472 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:56 smithi049 podman[108054]: 2024-09-21 06:49:56.216044085 +0000 UTC m=+0.406520707 container attach bc0fbe74cedfff129cd54a638c8edb753acaca17275ac7de560954d07ec38d44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:49:56.473 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:56 smithi049 podman[108054]: 2024-09-21 06:49:56.315057637 +0000 UTC m=+0.505534261 container died bc0fbe74cedfff129cd54a638c8edb753acaca17275ac7de560954d07ec38d44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T06:49:56.865 INFO:journalctl@ceph.osd.9.smithi049.stdout:Sep 21 06:49:56 smithi049 podman[108077]: 2024-09-21 06:49:56.844502229 +0000 UTC m=+0.522546310 container remove bc0fbe74cedfff129cd54a638c8edb753acaca17275ac7de560954d07ec38d44 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T06:49:56.871 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T06:49:56.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:56.913 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T06:49:56.913 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T06:49:56.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.10 2024-09-21T06:49:57.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:56 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:56.716+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:57.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:56 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:56.716+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:57.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:56 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:56.716+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:57.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:56 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:56.716+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:57.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:56 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:56.716+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:57.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:56 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:56.716+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:49:57.208 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:56 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:56.902+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:57.208 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:56 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:56.902+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:57.208 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:56 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:56.902+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:57.208 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:56 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:56.902+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:57.208 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:56 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:56.902+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:57.208 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:56 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:56.902+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:57.208 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:56 smithi079 systemd[1]: Stopping Ceph osd.10 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:57.209 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.206+0000 7fb5819b2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:57.209 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.206+0000 7fb5819b2640 -1 osd.10 93 *** Got signal Terminated *** 2024-09-21T06:49:57.209 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.206+0000 7fb5819b2640 -1 osd.10 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:49:58.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:57 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:57.691+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:58.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:57 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:57.691+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:58.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:57 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:57.691+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:58.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:57 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:57.691+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:58.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:57 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:57.691+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:58.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:57 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:57.691+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:49:58.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:58.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:58.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:58.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:58.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:58.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:58.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:57 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:57.935+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:31.234391+0000 front 2024-09-21T06:49:31.234363+0000 (oldest deadline 2024-09-21T06:49:57.634732+0000) 2024-09-21T06:49:59.045 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:58 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:58.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:49:59.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:58 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:58.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:49:59.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:58 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:58.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:49:59.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:58 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:58.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:49:59.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:58 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:58.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:49:59.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:58 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:58.706+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:49:59.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:58 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:58.922+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:49:59.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:58 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:58.922+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:49:59.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:58 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:58.922+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:49:59.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:58 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:58.922+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:49:59.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:58 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:58.922+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:49:59.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:58 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:58.922+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:49:59.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:58 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:58.922+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:31.234391+0000 front 2024-09-21T06:49:31.234363+0000 (oldest deadline 2024-09-21T06:49:57.634732+0000) 2024-09-21T06:50:00.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:59 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:59.750+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:00.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:59 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:59.750+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:00.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:59 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:59.750+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:00.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:59 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:59.750+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:00.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:59 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:59.750+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:00.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:49:59 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:49:59.750+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:00.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:59 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:59.923+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:50:00.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:59 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:59.923+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:50:00.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:59 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:59.923+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:50:00.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:59 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:59.923+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:50:00.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:59 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:59.923+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:50:00.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:59 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:59.923+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:50:00.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:49:59 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:49:59.923+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:31.234391+0000 front 2024-09-21T06:49:31.234363+0000 (oldest deadline 2024-09-21T06:49:57.634732+0000) 2024-09-21T06:50:01.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:00 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:00.752+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:01.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:00 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:00.752+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:01.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:00 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:00.752+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:01.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:00 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:00.752+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:01.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:00 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:00.752+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:01.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:00 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:00.752+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:01.047 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:00 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:00.752+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:01.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:00 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:00.957+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:50:01.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:00 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:00.957+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:50:01.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:00 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:00.957+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:50:01.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:00 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:00.957+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:50:01.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:00 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:00.957+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:50:01.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:00 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:00.957+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:50:01.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:00 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:00.957+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:31.234391+0000 front 2024-09-21T06:49:31.234363+0000 (oldest deadline 2024-09-21T06:49:57.634732+0000) 2024-09-21T06:50:02.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:01 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:01.769+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:02.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:01 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:01.769+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:02.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:01 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:01.769+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:02.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:01 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:01.769+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:02.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:01 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:01.769+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:02.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:01 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:01.769+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:02.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:01 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:01.769+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:02.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:01 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:01.996+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:39.026224+0000 front 2024-09-21T06:48:39.026032+0000 (oldest deadline 2024-09-21T06:49:04.926033+0000) 2024-09-21T06:50:02.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:01 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:01.996+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:48.827603+0000 front 2024-09-21T06:48:48.827699+0000 (oldest deadline 2024-09-21T06:49:13.527766+0000) 2024-09-21T06:50:02.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:01 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:01.996+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:59.229794+0000 front 2024-09-21T06:48:59.229749+0000 (oldest deadline 2024-09-21T06:49:23.929592+0000) 2024-09-21T06:50:02.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:01 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:01.996+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6814 osd.3 since back 2024-09-21T06:49:07.430912+0000 front 2024-09-21T06:49:07.430724+0000 (oldest deadline 2024-09-21T06:49:33.330548+0000) 2024-09-21T06:50:02.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:01 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:01.996+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:15.631343+0000 front 2024-09-21T06:49:15.631307+0000 (oldest deadline 2024-09-21T06:49:37.331450+0000) 2024-09-21T06:50:02.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:01 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:01.996+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:23.633425+0000 front 2024-09-21T06:49:23.633465+0000 (oldest deadline 2024-09-21T06:49:47.733417+0000) 2024-09-21T06:50:02.319 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:01 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10[58506]: 2024-09-21T06:50:01.996+0000 7fb57df9d640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:31.234391+0000 front 2024-09-21T06:49:31.234363+0000 (oldest deadline 2024-09-21T06:49:57.634732+0000) 2024-09-21T06:50:02.981 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:02 smithi079 podman[68411]: 2024-09-21 06:50:02.671140446 +0000 UTC m=+5.567066361 container died 9abb33a9d61b4974e31cb64349ed2bbd522b625c2714fbeabaee7c13de116b29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T06:50:02.982 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:02 smithi079 podman[68411]: 2024-09-21 06:50:02.980465648 +0000 UTC m=+5.876391560 container cleanup 9abb33a9d61b4974e31cb64349ed2bbd522b625c2714fbeabaee7c13de116b29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T06:50:03.216 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:02 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:02.809+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:03.216 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:02 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:02.809+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:03.217 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:02 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:02.809+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:03.217 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:02 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:02.809+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:03.217 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:02 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:02.809+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:03.217 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:02 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:02.809+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:03.217 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:02 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:02.809+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:03.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:02 smithi079 bash[68411]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10 2024-09-21T06:50:03.318 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:03 smithi079 podman[68429]: 2024-09-21 06:50:03.181380335 +0000 UTC m=+0.505248692 container remove 9abb33a9d61b4974e31cb64349ed2bbd522b625c2714fbeabaee7c13de116b29 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T06:50:03.818 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:03 smithi079 podman[68516]: 2024-09-21 06:50:03.421016747 +0000 UTC m=+0.016481616 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:50:03.819 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:03 smithi079 podman[68516]: 2024-09-21 06:50:03.524321305 +0000 UTC m=+0.119786224 container create 60708fd6fb9c4d8e2562e4fecc3dc6c5167351731e9fc9c8d5cdd1012c9e80e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:50:03.819 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:03 smithi079 podman[68516]: 2024-09-21 06:50:03.75978956 +0000 UTC m=+0.355254416 container init 60708fd6fb9c4d8e2562e4fecc3dc6c5167351731e9fc9c8d5cdd1012c9e80e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T06:50:03.819 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:03 smithi079 podman[68516]: 2024-09-21 06:50:03.763201591 +0000 UTC m=+0.358666453 container start 60708fd6fb9c4d8e2562e4fecc3dc6c5167351731e9fc9c8d5cdd1012c9e80e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:50:04.164 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:03 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:03.818+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:04.164 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:03 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:03.818+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:04.164 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:03 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:03.818+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:04.164 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:03 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:03.818+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:04.164 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:03 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:03.818+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:04.164 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:03 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:03.818+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:04.164 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:03 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:03.818+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:04.246 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:03 smithi079 podman[68516]: 2024-09-21 06:50:03.843035561 +0000 UTC m=+0.438500427 container attach 60708fd6fb9c4d8e2562e4fecc3dc6c5167351731e9fc9c8d5cdd1012c9e80e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T06:50:04.246 INFO:journalctl@ceph.osd.10.smithi079.stdout:Sep 21 06:50:03 smithi079 podman[68516]: 2024-09-21 06:50:03.950923467 +0000 UTC m=+0.546388324 container died 60708fd6fb9c4d8e2562e4fecc3dc6c5167351731e9fc9c8d5cdd1012c9e80e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:50:04.542 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T06:50:04.581 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:04.582 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T06:50:04.582 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T06:50:04.582 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.11 2024-09-21T06:50:04.864 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 systemd[1]: Stopping Ceph osd.11 for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:04.865 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.814+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:04.865 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.814+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:04.865 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.814+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:04.865 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.814+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:04.865 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.814+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:04.865 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.814+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:04.865 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.814+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:05.295 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.862+0000 7f4275ba7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:05.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.862+0000 7f4275ba7640 -1 osd.11 93 *** Got signal Terminated *** 2024-09-21T06:50:05.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:04 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:04.862+0000 7f4275ba7640 -1 osd.11 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:50:06.295 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:05 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:05.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:06.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:05 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:05.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:06.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:05 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:05.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:06.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:05 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:05.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:06.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:05 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:05.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:06.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:05 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:05.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:06.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:05 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:05.819+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:07.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:06 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:06.776+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:07.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:06 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:06.776+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:07.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:06 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:06.776+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:07.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:06 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:06.776+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:07.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:06 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:06.776+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:07.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:06 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:06.776+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:07.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:06 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:06.776+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:08.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:07 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:07.803+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:08.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:07 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:07.803+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:08.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:07 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:07.803+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:08.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:07 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:07.803+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:08.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:07 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:07.803+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:08.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:07 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:07.803+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:08.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:07 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:07.803+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:09.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:08.834+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:09.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:08.834+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:09.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:08.834+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:09.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:08.834+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:09.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:08.834+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:09.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:08.834+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:09.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:08.834+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:09.296 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:08 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:08.834+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6820 osd.8 since back 2024-09-21T06:49:42.750287+0000 front 2024-09-21T06:49:42.750333+0000 (oldest deadline 2024-09-21T06:50:08.050335+0000) 2024-09-21T06:50:10.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:09 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:09.785+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6806 osd.0 since back 2024-09-21T06:48:42.041418+0000 front 2024-09-21T06:48:42.041297+0000 (oldest deadline 2024-09-21T06:49:07.341327+0000) 2024-09-21T06:50:10.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:09 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:09.785+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6804 osd.1 since back 2024-09-21T06:48:51.442859+0000 front 2024-09-21T06:48:51.442734+0000 (oldest deadline 2024-09-21T06:49:14.342607+0000) 2024-09-21T06:50:10.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:09 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:09.785+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6804 osd.2 since back 2024-09-21T06:48:57.243795+0000 front 2024-09-21T06:48:57.244003+0000 (oldest deadline 2024-09-21T06:49:23.143921+0000) 2024-09-21T06:50:10.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:09 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:09.785+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6812 osd.4 since back 2024-09-21T06:49:11.746361+0000 front 2024-09-21T06:49:11.746185+0000 (oldest deadline 2024-09-21T06:49:37.046159+0000) 2024-09-21T06:50:10.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:09 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:09.785+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6812 osd.5 since back 2024-09-21T06:49:22.947252+0000 front 2024-09-21T06:49:22.947280+0000 (oldest deadline 2024-09-21T06:49:45.147724+0000) 2024-09-21T06:50:10.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:09 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:09.785+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.49:6822 osd.6 since back 2024-09-21T06:49:28.648670+0000 front 2024-09-21T06:49:28.648823+0000 (oldest deadline 2024-09-21T06:49:54.548679+0000) 2024-09-21T06:50:10.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:09 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:09.785+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.79:6820 osd.7 since back 2024-09-21T06:49:34.549303+0000 front 2024-09-21T06:49:34.549384+0000 (oldest deadline 2024-09-21T06:50:00.449220+0000) 2024-09-21T06:50:10.046 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:09 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11[58771]: 2024-09-21T06:50:09.785+0000 7f4272192640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.98:6820 osd.8 since back 2024-09-21T06:49:42.750287+0000 front 2024-09-21T06:49:42.750333+0000 (oldest deadline 2024-09-21T06:50:08.050335+0000) 2024-09-21T06:50:10.547 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:10 smithi098 podman[68467]: 2024-09-21 06:50:10.28751225 +0000 UTC m=+5.515478321 container died 58d9df12dee5a497109389c402c65a4713ed2a70e12f273e42d8ad6f0fc330fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:50:10.916 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:10 smithi098 podman[68467]: 2024-09-21 06:50:10.654915012 +0000 UTC m=+5.882881085 container cleanup 58d9df12dee5a497109389c402c65a4713ed2a70e12f273e42d8ad6f0fc330fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T06:50:10.916 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:10 smithi098 bash[68467]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11 2024-09-21T06:50:11.257 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:10 smithi098 podman[68482]: 2024-09-21 06:50:10.914430698 +0000 UTC m=+0.618612259 container remove 58d9df12dee5a497109389c402c65a4713ed2a70e12f273e42d8ad6f0fc330fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:50:11.545 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:11 smithi098 podman[68573]: 2024-09-21 06:50:11.256882988 +0000 UTC m=+0.105036137 container create f4b0dc89e7979ba47f2bcd39e0aa396da9ade717d023036d2e1072fef7c31dc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T06:50:11.545 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:11 smithi098 podman[68573]: 2024-09-21 06:50:11.167683527 +0000 UTC m=+0.015836676 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:50:11.546 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:11 smithi098 podman[68573]: 2024-09-21 06:50:11.492472817 +0000 UTC m=+0.340625966 container init f4b0dc89e7979ba47f2bcd39e0aa396da9ade717d023036d2e1072fef7c31dc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:50:11.546 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:11 smithi098 podman[68573]: 2024-09-21 06:50:11.495669953 +0000 UTC m=+0.343823102 container start f4b0dc89e7979ba47f2bcd39e0aa396da9ade717d023036d2e1072fef7c31dc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T06:50:11.963 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:11 smithi098 podman[68573]: 2024-09-21 06:50:11.559008325 +0000 UTC m=+0.407161480 container attach f4b0dc89e7979ba47f2bcd39e0aa396da9ade717d023036d2e1072fef7c31dc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T06:50:11.963 INFO:journalctl@ceph.osd.11.smithi098.stdout:Sep 21 06:50:11 smithi098 podman[68573]: 2024-09-21 06:50:11.687931007 +0000 UTC m=+0.536084157 container died f4b0dc89e7979ba47f2bcd39e0aa396da9ade717d023036d2e1072fef7c31dc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T06:50:12.271 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T06:50:12.311 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:12.311 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T06:50:12.312 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T06:50:12.312 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.a 2024-09-21T06:50:12.623 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:50:12 smithi049 systemd[1]: Stopping Ceph mds.a for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:12.973 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:50:12 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-a[73901]: 2024-09-21T06:50:12.621+0000 7fd7393b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:12.973 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:50:12 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-a[73901]: 2024-09-21T06:50:12.621+0000 7fd7393b6640 -1 mds.a *** got signal Terminated *** 2024-09-21T06:50:15.247 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:50:14 smithi049 podman[108157]: 2024-09-21 06:50:14.987060737 +0000 UTC m=+2.478174777 container died f33742388f7331f2da33be6076db1521a828772ce883bccf642dd5dde5ea8afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:50:15.623 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:50:15 smithi049 podman[108157]: 2024-09-21 06:50:15.404354711 +0000 UTC m=+2.895468795 container cleanup f33742388f7331f2da33be6076db1521a828772ce883bccf642dd5dde5ea8afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T06:50:15.624 INFO:journalctl@ceph.mds.a.smithi049.stdout:Sep 21 06:50:15 smithi049 bash[108157]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-a 2024-09-21T06:50:15.847 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T06:50:15.885 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:15.885 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T06:50:15.885 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T06:50:15.886 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.d 2024-09-21T06:50:16.223 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:15 smithi049 systemd[1]: Stopping Ceph mds.d for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:16.723 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:16 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-d[72860]: 2024-09-21T06:50:16.243+0000 7f2a825e5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:16.723 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:16 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-d[72860]: 2024-09-21T06:50:16.243+0000 7f2a825e5640 -1 mds.d *** got signal Terminated *** 2024-09-21T06:50:20.536 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:20 smithi049 podman[108291]: 2024-09-21 06:50:20.253048144 +0000 UTC m=+4.137164952 container died abe6e30bd3f375c6b9f641d20f61d824e0631d2430e2754c12ee6cdf5ff74f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-d, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True) 2024-09-21T06:50:20.835 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:20 smithi049 podman[108291]: 2024-09-21 06:50:20.674606429 +0000 UTC m=+4.558723231 container cleanup abe6e30bd3f375c6b9f641d20f61d824e0631d2430e2754c12ee6cdf5ff74f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-d, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T06:50:20.835 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:20 smithi049 bash[108291]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-d 2024-09-21T06:50:21.066 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T06:50:21.089 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:20 smithi049 podman[108303]: 2024-09-21 06:50:20.83410863 +0000 UTC m=+0.576364362 container remove abe6e30bd3f375c6b9f641d20f61d824e0631d2430e2754c12ee6cdf5ff74f50 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-d, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T06:50:21.089 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:21 smithi049 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.d.service: Deactivated successfully. 2024-09-21T06:50:21.089 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:21 smithi049 systemd[1]: Stopped Ceph mds.d for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:50:21.089 INFO:journalctl@ceph.mds.d.smithi049.stdout:Sep 21 06:50:21 smithi049 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.d.service: Consumed 1.148s CPU time. 2024-09-21T06:50:21.101 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:21.101 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T06:50:21.101 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T06:50:21.101 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.g 2024-09-21T06:50:21.430 INFO:journalctl@ceph.mds.g.smithi049.stdout:Sep 21 06:50:21 smithi049 systemd[1]: Stopping Ceph mds.g for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:21.722 INFO:journalctl@ceph.mds.g.smithi049.stdout:Sep 21 06:50:21 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-g[73600]: 2024-09-21T06:50:21.427+0000 7f1f58ffe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:21.722 INFO:journalctl@ceph.mds.g.smithi049.stdout:Sep 21 06:50:21 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-g[73600]: 2024-09-21T06:50:21.427+0000 7f1f58ffe640 -1 mds.g *** got signal Terminated *** 2024-09-21T06:50:24.847 INFO:journalctl@ceph.mds.g.smithi049.stdout:Sep 21 06:50:24 smithi049 podman[108412]: 2024-09-21 06:50:24.583779838 +0000 UTC m=+3.257156527 container died 047847e5223ec8274ca4c66f62a029552bb584eaeb720bcd89e22be2b1b9cafa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-g, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:50:25.206 INFO:journalctl@ceph.mds.g.smithi049.stdout:Sep 21 06:50:24 smithi049 podman[108412]: 2024-09-21 06:50:24.945251454 +0000 UTC m=+3.618628131 container cleanup 047847e5223ec8274ca4c66f62a029552bb584eaeb720bcd89e22be2b1b9cafa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-g, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:50:25.206 INFO:journalctl@ceph.mds.g.smithi049.stdout:Sep 21 06:50:24 smithi049 bash[108412]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-g 2024-09-21T06:50:25.362 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T06:50:25.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:25.396 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T06:50:25.396 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T06:50:25.396 DEBUG:teuthology.orchestra.run.smithi049:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.j 2024-09-21T06:50:25.723 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:50:25 smithi049 systemd[1]: Stopping Ceph mds.j for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:26.222 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:50:25 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-j[72480]: 2024-09-21T06:50:25.722+0000 7f44165d5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:26.222 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:50:25 smithi049 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-j[72480]: 2024-09-21T06:50:25.722+0000 7f44165d5640 -1 mds.j *** got signal Terminated *** 2024-09-21T06:50:29.592 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:50:29 smithi049 podman[108532]: 2024-09-21 06:50:29.31605812 +0000 UTC m=+3.700239110 container died 7dc3a2b449959fcab176b34d955021e1fa16ba42f90b5bf3f6d73d76f307ca82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-j, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T06:50:29.934 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:50:29 smithi049 podman[108532]: 2024-09-21 06:50:29.690248373 +0000 UTC m=+4.074429362 container cleanup 7dc3a2b449959fcab176b34d955021e1fa16ba42f90b5bf3f6d73d76f307ca82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux ) 2024-09-21T06:50:29.934 INFO:journalctl@ceph.mds.j.smithi049.stdout:Sep 21 06:50:29 smithi049 bash[108532]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-j 2024-09-21T06:50:30.077 DEBUG:teuthology.orchestra.run.smithi049:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T06:50:30.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:30.110 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T06:50:30.110 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T06:50:30.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.b 2024-09-21T06:50:30.413 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:50:30 smithi079 systemd[1]: Stopping Ceph mds.b for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:30.676 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:50:30 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T06:50:30.410+0000 7fe2c8ad6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:30.677 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:50:30 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b[63541]: 2024-09-21T06:50:30.410+0000 7fe2c8ad6640 -1 mds.b *** got signal Terminated *** 2024-09-21T06:50:33.413 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:50:33 smithi079 podman[68618]: 2024-09-21 06:50:33.104822325 +0000 UTC m=+2.796649894 container died 5b485a5417c972a5ae18672e3115343c334fb0dcb4e5d5adf96d680f70b84981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:50:33.746 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:50:33 smithi079 podman[68618]: 2024-09-21 06:50:33.50228981 +0000 UTC m=+3.194117388 container cleanup 5b485a5417c972a5ae18672e3115343c334fb0dcb4e5d5adf96d680f70b84981 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:50:33.746 INFO:journalctl@ceph.mds.b.smithi079.stdout:Sep 21 06:50:33 smithi079 bash[68618]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-b 2024-09-21T06:50:33.888 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T06:50:33.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:33.924 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T06:50:33.924 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T06:50:33.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.e 2024-09-21T06:50:34.318 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:50:34 smithi079 systemd[1]: Stopping Ceph mds.e for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:34.319 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:50:34 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e[62989]: 2024-09-21T06:50:34.247+0000 7ff3b02f8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:34.319 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:50:34 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e[62989]: 2024-09-21T06:50:34.247+0000 7ff3b02f8640 -1 mds.e *** got signal Terminated *** 2024-09-21T06:50:37.390 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:50:37 smithi079 podman[68750]: 2024-09-21 06:50:37.101667318 +0000 UTC m=+2.957402649 container died 38046e04c28e0d9670024c78cd539988aa6af03508c9a83c92e5e12f3cf2f54b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:50:37.716 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:50:37 smithi079 podman[68750]: 2024-09-21 06:50:37.480539371 +0000 UTC m=+3.336274689 container cleanup 38046e04c28e0d9670024c78cd539988aa6af03508c9a83c92e5e12f3cf2f54b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:50:37.716 INFO:journalctl@ceph.mds.e.smithi079.stdout:Sep 21 06:50:37 smithi079 bash[68750]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-e 2024-09-21T06:50:37.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T06:50:37.894 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:37.895 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T06:50:37.895 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T06:50:37.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.h 2024-09-21T06:50:38.318 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:50:37 smithi079 systemd[1]: Stopping Ceph mds.h for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:38.318 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:50:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h[63259]: 2024-09-21T06:50:38.208+0000 7f25329c4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:38.318 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:50:38 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h[63259]: 2024-09-21T06:50:38.208+0000 7f25329c4640 -1 mds.h *** got signal Terminated *** 2024-09-21T06:50:41.503 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:50:41 smithi079 podman[68869]: 2024-09-21 06:50:41.09847299 +0000 UTC m=+2.990523525 container died 80337552f03dc9126469b12a270cf6e96e193f46bfbcf802de1843d315781668 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T06:50:41.811 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:50:41 smithi079 podman[68869]: 2024-09-21 06:50:41.609067513 +0000 UTC m=+3.501118002 container cleanup 80337552f03dc9126469b12a270cf6e96e193f46bfbcf802de1843d315781668 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T06:50:41.811 INFO:journalctl@ceph.mds.h.smithi079.stdout:Sep 21 06:50:41 smithi079 bash[68869]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-h 2024-09-21T06:50:41.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T06:50:41.991 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:41.991 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T06:50:41.992 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T06:50:41.992 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.k 2024-09-21T06:50:42.568 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:42 smithi079 systemd[1]: Stopping Ceph mds.k for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:42.568 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:42 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k[62706]: 2024-09-21T06:50:42.296+0000 7f0cdcd34640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:42.568 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:42 smithi079 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k[62706]: 2024-09-21T06:50:42.296+0000 7f0cdcd34640 -1 mds.k *** got signal Terminated *** 2024-09-21T06:50:46.568 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:46 smithi079 podman[68990]: 2024-09-21 06:50:46.311914173 +0000 UTC m=+4.107681793 container died 5a3ae4097bae47f8bc71dcca4f7c3773cd147e17f50bf24e3b05780231c84afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:50:47.022 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:46 smithi079 podman[68990]: 2024-09-21 06:50:46.845199294 +0000 UTC m=+4.640966905 container cleanup 5a3ae4097bae47f8bc71dcca4f7c3773cd147e17f50bf24e3b05780231c84afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T06:50:47.022 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:46 smithi079 bash[68990]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k 2024-09-21T06:50:47.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T06:50:47.285 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:47 smithi079 podman[69002]: 2024-09-21 06:50:47.021190534 +0000 UTC m=+0.711532471 container remove 5a3ae4097bae47f8bc71dcca4f7c3773cd147e17f50bf24e3b05780231c84afd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:50:47.285 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:47 smithi079 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.k.service: Deactivated successfully. 2024-09-21T06:50:47.285 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:47 smithi079 systemd[1]: Stopped Ceph mds.k for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:50:47.286 INFO:journalctl@ceph.mds.k.smithi079.stdout:Sep 21 06:50:47 smithi079 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.k.service: Consumed 1.091s CPU time. 2024-09-21T06:50:47.295 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:47.295 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T06:50:47.296 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T06:50:47.296 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.c 2024-09-21T06:50:47.597 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:50:47 smithi098 systemd[1]: Stopping Ceph mds.c for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:47.862 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:50:47 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c[63721]: 2024-09-21T06:50:47.594+0000 7f4719e49640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:47.862 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:50:47 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c[63721]: 2024-09-21T06:50:47.594+0000 7f4719e49640 -1 mds.c *** got signal Terminated *** 2024-09-21T06:50:49.506 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:50:49 smithi098 podman[68675]: 2024-09-21 06:50:49.112892923 +0000 UTC m=+1.624777066 container died 21d70cb7e6a7d0b641d3c8f52b9c8a0dbc1afef45c310d1d63adeef36d776ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T06:50:49.796 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:50:49 smithi098 podman[68675]: 2024-09-21 06:50:49.604573017 +0000 UTC m=+2.116457171 container cleanup 21d70cb7e6a7d0b641d3c8f52b9c8a0dbc1afef45c310d1d63adeef36d776ce1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T06:50:49.796 INFO:journalctl@ceph.mds.c.smithi098.stdout:Sep 21 06:50:49 smithi098 bash[68675]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-c 2024-09-21T06:50:49.967 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T06:50:50.004 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:50.004 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T06:50:50.004 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T06:50:50.004 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.f 2024-09-21T06:50:50.295 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:50:50 smithi098 systemd[1]: Stopping Ceph mds.f for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:50.795 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:50:50 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f[63447]: 2024-09-21T06:50:50.332+0000 7f05174cf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:50.795 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:50:50 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f[63447]: 2024-09-21T06:50:50.332+0000 7f05174cf640 -1 mds.f *** got signal Terminated *** 2024-09-21T06:50:53.377 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:50:53 smithi098 podman[68810]: 2024-09-21 06:50:53.110206031 +0000 UTC m=+2.888791713 container died 8dc5e4d6d215f6a4d068fda03daf07f54023f2c7efbf8ba2f2d3297c960475b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:50:53.744 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:50:53 smithi098 podman[68810]: 2024-09-21 06:50:53.475194466 +0000 UTC m=+3.253780145 container cleanup 8dc5e4d6d215f6a4d068fda03daf07f54023f2c7efbf8ba2f2d3297c960475b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:50:53.744 INFO:journalctl@ceph.mds.f.smithi098.stdout:Sep 21 06:50:53 smithi098 bash[68810]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-f 2024-09-21T06:50:53.912 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T06:50:53.944 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:53.945 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T06:50:53.945 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T06:50:53.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.i 2024-09-21T06:50:54.296 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:54 smithi098 systemd[1]: Stopping Ceph mds.i for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:54.296 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:54 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i[63991]: 2024-09-21T06:50:54.253+0000 7f987b2c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:54.296 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:54 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i[63991]: 2024-09-21T06:50:54.253+0000 7f987b2c5640 -1 mds.i *** got signal Terminated *** 2024-09-21T06:50:57.439 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:57 smithi098 podman[68929]: 2024-09-21 06:50:57.101702941 +0000 UTC m=+2.941632117 container died 4f7bf42b82f7e7953e170675500e0dcff49020f2e1cdec410b775a29641bc8f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:50:57.716 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:57 smithi098 podman[68929]: 2024-09-21 06:50:57.548008855 +0000 UTC m=+3.387938074 container cleanup 4f7bf42b82f7e7953e170675500e0dcff49020f2e1cdec410b775a29641bc8f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T06:50:57.716 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:57 smithi098 bash[68929]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i 2024-09-21T06:50:57.945 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T06:50:57.967 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:57 smithi098 podman[68940]: 2024-09-21 06:50:57.715657072 +0000 UTC m=+0.608644971 container remove 4f7bf42b82f7e7953e170675500e0dcff49020f2e1cdec410b775a29641bc8f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-i, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:50:57.968 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:57 smithi098 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.i.service: Deactivated successfully. 2024-09-21T06:50:57.968 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:57 smithi098 systemd[1]: Stopped Ceph mds.i for 4a3fd104-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:50:57.968 INFO:journalctl@ceph.mds.i.smithi098.stdout:Sep 21 06:50:57 smithi098 systemd[1]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.i.service: Consumed 6.313s CPU time. 2024-09-21T06:50:57.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:50:57.977 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T06:50:57.977 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T06:50:57.977 DEBUG:teuthology.orchestra.run.smithi098:> sudo systemctl stop ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.l 2024-09-21T06:50:58.298 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:50:58 smithi098 systemd[1]: Stopping Ceph mds.l for 4a3fd104-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:50:58.795 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:50:58 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-l[63174]: 2024-09-21T06:50:58.426+0000 7f832638d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:50:58.796 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:50:58 smithi098 ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-l[63174]: 2024-09-21T06:50:58.426+0000 7f832638d640 -1 mds.l *** got signal Terminated *** 2024-09-21T06:51:00.453 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:51:00 smithi098 podman[69049]: 2024-09-21 06:51:00.062205724 +0000 UTC m=+1.866423298 container died 1aaf4aeb560c7b9e23e2a5eb8e31f06225f5b542e41072841fe8f5ea2125d602 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-l, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T06:51:00.795 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:51:00 smithi098 podman[69049]: 2024-09-21 06:51:00.526943967 +0000 UTC m=+2.331161533 container cleanup 1aaf4aeb560c7b9e23e2a5eb8e31f06225f5b542e41072841fe8f5ea2125d602 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:51:00.796 INFO:journalctl@ceph.mds.l.smithi098.stdout:Sep 21 06:51:00 smithi098 bash[69049]: ceph-4a3fd104-77e2-11ef-baf5-efdc52797490-mds-l 2024-09-21T06:51:00.956 DEBUG:teuthology.orchestra.run.smithi098:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4a3fd104-77e2-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T06:51:00.987 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:51:00.988 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T06:51:00.988 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:51:01.200 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:51:03.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:51:03.982 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:51:06.470 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:51:06.673 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:51:09.075 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:51:09.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:51:09.143 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:51:09.171 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T06:51:09.173 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542/remote/smithi049/crash 2024-09-21T06:51:09.173 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:51:09.211 INFO:teuthology.orchestra.run.smithi049.stderr:tar: /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:51:09.211 INFO:teuthology.orchestra.run.smithi049.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:51:09.213 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542/remote/smithi079/crash 2024-09-21T06:51:09.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:51:09.336 INFO:teuthology.orchestra.run.smithi079.stderr:tar: /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:51:09.336 INFO:teuthology.orchestra.run.smithi079.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:51:09.338 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542/remote/smithi098/crash 2024-09-21T06:51:09.339 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:51:09.400 INFO:teuthology.orchestra.run.smithi098.stderr:tar: /var/lib/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:51:09.400 INFO:teuthology.orchestra.run.smithi098.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:51:09.401 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T06:51:09.401 DEBUG:teuthology.orchestra.run.smithi049:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T06:51:09.444 INFO:tasks.cephadm:Compressing logs... 2024-09-21T06:51:09.444 DEBUG:teuthology.orchestra.run.smithi049:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:51:09.487 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:51:09.489 DEBUG:teuthology.orchestra.run.smithi098:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:51:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T06:51:09.512 INFO:teuthology.orchestra.run.smithi049.stderr:: No such file or directory 2024-09-21T06:51:09.513 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T06:51:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:51:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.0.log: /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:51:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T06:51:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose --/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:51:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T06:51:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T06:51:09.517 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T06:51:09.517 INFO:teuthology.orchestra.run.smithi049.stderr: 84.3% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:51:09.518 INFO:teuthology.orchestra.run.smithi098.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:51:09.518 INFO:teuthology.orchestra.run.smithi098.stderr:: No such file or directory 2024-09-21T06:51:09.518 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:51:09.518 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T06:51:09.518 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T06:51:09.518 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:51:09.518 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T06:51:09.519 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T06:51:09.519 INFO:teuthology.orchestra.run.smithi098.stderr: 81.8% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:51:09.519 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T06:51:09.519 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:51:09.519 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T06:51:09.519 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log: 90.4% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:51:09.523 INFO:teuthology.orchestra.run.smithi098.stderr: 87.1% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:51:09.524 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T06:51:09.524 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T06:51:09.526 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mon.a.log: /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.g.log: 90.2% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:51:09.526 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:51:09.526 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T06:51:09.526 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log: 95.0% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T06:51:09.526 INFO:teuthology.orchestra.run.smithi049.stderr: 87.2% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:51:09.527 INFO:teuthology.orchestra.run.smithi049.stderr: 95.1% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T06:51:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T06:51:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T06:51:09.527 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:: No such file or directory 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.audit.log: 90.3% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:51:09.529 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T06:51:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log: 81.8% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:51:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:51:09.530 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mgr.y.log: 94.9% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T06:51:09.531 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.8.log: 94.9% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T06:51:09.531 INFO:teuthology.orchestra.run.smithi098.stderr: 90.9% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:51:09.532 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.j.log: 90.9% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:51:09.532 INFO:teuthology.orchestra.run.smithi049.stderr: 95.1% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T06:51:09.532 INFO:teuthology.orchestra.run.smithi049.stderr: 95.1% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T06:51:09.532 INFO:teuthology.orchestra.run.smithi049.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:51:09.534 INFO:teuthology.orchestra.run.smithi079.stderr: 90.9% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:51:09.534 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T06:51:09.534 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T06:51:09.534 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.h.log: 92.5% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T06:51:09.534 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T06:51:09.535 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mon.b.log: 87.2% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:51:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:51:09.537 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T06:51:09.538 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T06:51:09.539 INFO:teuthology.orchestra.run.smithi049.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:51:09.545 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.c.log: 92.7% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T06:51:09.546 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:51:09.548 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:51:09.574 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:51:09.613 INFO:teuthology.orchestra.run.smithi098.stderr: 92.9% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T06:51:09.626 INFO:teuthology.orchestra.run.smithi079.stderr: 94.3% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T06:51:09.672 INFO:teuthology.orchestra.run.smithi098.stderr: 92.7% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T06:51:09.744 INFO:teuthology.orchestra.run.smithi079.stderr: 95.2% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T06:51:09.781 INFO:teuthology.orchestra.run.smithi049.stderr: 90.3% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T06:51:09.852 INFO:teuthology.orchestra.run.smithi098.stderr: 91.7% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T06:51:09.966 INFO:teuthology.orchestra.run.smithi079.stderr: 91.7% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T06:51:10.051 INFO:teuthology.orchestra.run.smithi049.stderr: 92.9% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T06:51:10.053 INFO:teuthology.orchestra.run.smithi079.stderr: 92.5% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T06:51:10.072 INFO:teuthology.orchestra.run.smithi079.stderr: 92.1% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T06:51:10.104 INFO:teuthology.orchestra.run.smithi098.stderr: 93.0% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T06:51:10.117 INFO:teuthology.orchestra.run.smithi049.stderr: 92.6% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T06:51:10.163 INFO:teuthology.orchestra.run.smithi098.stderr: 92.7% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T06:51:10.203 INFO:teuthology.orchestra.run.smithi079.stderr: 92.7% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T06:51:10.216 INFO:teuthology.orchestra.run.smithi098.stderr: 92.7% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T06:51:10.237 INFO:teuthology.orchestra.run.smithi079.stderr: 92.9% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T06:51:10.275 INFO:teuthology.orchestra.run.smithi049.stderr: 92.8% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T06:51:10.299 INFO:teuthology.orchestra.run.smithi049.stderr: 93.0% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T06:51:10.413 INFO:teuthology.orchestra.run.smithi049.stderr: 90.4% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T06:51:10.414 INFO:teuthology.orchestra.run.smithi049.stderr: 2024-09-21T06:51:10.414 INFO:teuthology.orchestra.run.smithi049.stderr:real 0m0.914s 2024-09-21T06:51:10.415 INFO:teuthology.orchestra.run.smithi049.stderr:user 0m3.759s 2024-09-21T06:51:10.415 INFO:teuthology.orchestra.run.smithi049.stderr:sys 0m0.147s 2024-09-21T06:51:10.445 INFO:teuthology.orchestra.run.smithi079.stderr: 93.0% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T06:51:10.447 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-21T06:51:10.447 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m0.943s 2024-09-21T06:51:10.447 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m4.055s 2024-09-21T06:51:10.447 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m0.164s 2024-09-21T06:51:10.666 INFO:teuthology.orchestra.run.smithi098.stderr: 92.9% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T06:51:10.938 INFO:teuthology.orchestra.run.smithi098.stderr: 93.6% -- replaced with /var/log/ceph/4a3fd104-77e2-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T06:51:10.940 INFO:teuthology.orchestra.run.smithi098.stderr: 2024-09-21T06:51:10.940 INFO:teuthology.orchestra.run.smithi098.stderr:real 0m1.436s 2024-09-21T06:51:10.940 INFO:teuthology.orchestra.run.smithi098.stderr:user 0m4.897s 2024-09-21T06:51:10.940 INFO:teuthology.orchestra.run.smithi098.stderr:sys 0m0.200s 2024-09-21T06:51:10.940 INFO:tasks.cephadm:Archiving logs... 2024-09-21T06:51:10.941 DEBUG:teuthology.misc:Transferring archived files from smithi049:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542/remote/smithi049/log 2024-09-21T06:51:10.942 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:51:11.497 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542/remote/smithi079/log 2024-09-21T06:51:11.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:51:12.028 DEBUG:teuthology.misc:Transferring archived files from smithi098:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542/remote/smithi098/log 2024-09-21T06:51:12.029 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:51:12.690 INFO:tasks.cephadm:Removing cluster... 2024-09-21T06:51:12.690 DEBUG:teuthology.orchestra.run.smithi049:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 --force 2024-09-21T06:51:12.905 INFO:teuthology.orchestra.run.smithi049.stdout:Deleting cluster with fsid: 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:51:13.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 --force 2024-09-21T06:51:13.390 INFO:teuthology.orchestra.run.smithi079.stdout:Deleting cluster with fsid: 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:51:13.724 DEBUG:teuthology.orchestra.run.smithi098:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4a3fd104-77e2-11ef-baf5-efdc52797490 --force 2024-09-21T06:51:13.927 INFO:teuthology.orchestra.run.smithi098.stdout:Deleting cluster with fsid: 4a3fd104-77e2-11ef-baf5-efdc52797490 2024-09-21T06:51:14.202 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T06:51:14.202 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:51:14.222 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:51:14.238 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:51:14.254 INFO:tasks.cephadm:Teardown complete 2024-09-21T06:51:14.254 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T06:51:14.265 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T06:51:14.265 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:51:14.268 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:51:14.280 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:51:14.391 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T06:51:14.401 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T06:51:14.401 DEBUG:teuthology.orchestra.run.smithi049:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:51:14.404 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:51:14.406 DEBUG:teuthology.orchestra.run.smithi098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:51:14.418 INFO:teuthology.orchestra.run.smithi079.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:51:14.420 INFO:teuthology.orchestra.run.smithi049.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:51:14.421 INFO:teuthology.orchestra.run.smithi098.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:51:14.423 INFO:teuthology.orchestra.run.smithi079.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:51:14.423 INFO:teuthology.orchestra.run.smithi079.stdout:=============================================================================== 2024-09-21T06:51:14.423 INFO:teuthology.orchestra.run.smithi079.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 -43us[ -41us] +/- 40ms 2024-09-21T06:51:14.423 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 31 +18us[ +18us] +/- 66ms 2024-09-21T06:51:14.423 INFO:teuthology.orchestra.run.smithi079.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +47us[ +49us] +/- 67ms 2024-09-21T06:51:14.423 INFO:teuthology.orchestra.run.smithi079.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:51:14.424 INFO:teuthology.orchestra.run.smithi049.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:51:14.424 INFO:teuthology.orchestra.run.smithi049.stdout:=============================================================================== 2024-09-21T06:51:14.424 INFO:teuthology.orchestra.run.smithi049.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 -43us[ -41us] +/- 40ms 2024-09-21T06:51:14.425 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 27 +25us[ +25us] +/- 66ms 2024-09-21T06:51:14.425 INFO:teuthology.orchestra.run.smithi049.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 96 +46us[ +35us] +/- 66ms 2024-09-21T06:51:14.425 INFO:teuthology.orchestra.run.smithi049.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:51:14.426 INFO:teuthology.orchestra.run.smithi098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:51:14.426 INFO:teuthology.orchestra.run.smithi098.stdout:=============================================================================== 2024-09-21T06:51:14.426 INFO:teuthology.orchestra.run.smithi098.stdout:^* hv01.front.sepia.ceph.com 3 6 377 30 -43us[ -47us] +/- 40ms 2024-09-21T06:51:14.426 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 +29us[ +29us] +/- 66ms 2024-09-21T06:51:14.426 INFO:teuthology.orchestra.run.smithi098.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +48us[ +44us] +/- 67ms 2024-09-21T06:51:14.427 INFO:teuthology.orchestra.run.smithi098.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:51:14.427 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T06:51:14.437 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T06:51:14.437 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T06:51:14.447 DEBUG:teuthology.orchestra.run.smithi049:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:51:14.554 DEBUG:teuthology.orchestra.run.smithi079:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:51:14.618 DEBUG:teuthology.orchestra.run.smithi098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:51:14.684 DEBUG:teuthology.orchestra.run.smithi049:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:51:14.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:14.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:51:14.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:14.743 DEBUG:teuthology.orchestra.run.smithi098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:51:14.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:14.770 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T06:51:14.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T06:51:14.821 INFO:teuthology.task.internal:Duration was 1899.451815 seconds 2024-09-21T06:51:14.821 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T06:51:14.849 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T06:51:14.849 DEBUG:teuthology.orchestra.run.smithi049:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:51:14.852 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:51:14.854 DEBUG:teuthology.orchestra.run.smithi098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:51:14.890 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:51:14.894 INFO:teuthology.orchestra.run.smithi049.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:51:14.894 INFO:teuthology.orchestra.run.smithi098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:51:15.359 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T06:51:15.359 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi049.front.sepia.ceph.com 2024-09-21T06:51:15.359 DEBUG:teuthology.orchestra.run.smithi049:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:51:15.383 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-09-21T06:51:15.383 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:51:15.421 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi098.front.sepia.ceph.com 2024-09-21T06:51:15.421 DEBUG:teuthology.orchestra.run.smithi098:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:51:15.449 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T06:51:15.449 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:51:15.452 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:51:15.464 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:51:15.515 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T06:51:15.515 DEBUG:teuthology.orchestra.run.smithi049:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:51:15.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:51:15.530 DEBUG:teuthology.orchestra.run.smithi098:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:51:16.632 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T06:51:16.643 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T06:51:16.644 DEBUG:teuthology.orchestra.run.smithi049:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:51:16.669 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:51:16.698 DEBUG:teuthology.orchestra.run.smithi098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:51:16.726 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T06:51:16.738 DEBUG:teuthology.orchestra.run.smithi049:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:51:16.740 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:51:16.743 DEBUG:teuthology.orchestra.run.smithi098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:51:16.762 INFO:teuthology.orchestra.run.smithi049.stdout:kernel.core_pattern = core 2024-09-21T06:51:16.767 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-09-21T06:51:16.791 INFO:teuthology.orchestra.run.smithi098.stdout:kernel.core_pattern = core 2024-09-21T06:51:16.809 DEBUG:teuthology.orchestra.run.smithi049:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:51:16.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:16.830 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:51:16.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:16.846 DEBUG:teuthology.orchestra.run.smithi098:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:51:16.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:51:16.865 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T06:51:16.876 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T06:51:16.877 DEBUG:teuthology.misc:Transferring archived files from smithi049:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542/remote/smithi049 2024-09-21T06:51:16.877 DEBUG:teuthology.orchestra.run.smithi049:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:51:16.933 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542/remote/smithi079 2024-09-21T06:51:16.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:51:16.971 DEBUG:teuthology.misc:Transferring archived files from smithi098:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913542/remote/smithi098 2024-09-21T06:51:16.971 DEBUG:teuthology.orchestra.run.smithi098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:51:17.007 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T06:51:17.007 DEBUG:teuthology.orchestra.run.smithi049:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:51:17.009 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:51:17.012 DEBUG:teuthology.orchestra.run.smithi098:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:51:17.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T06:51:17.071 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T06:51:17.071 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T06:51:17.084 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T06:51:17.084 DEBUG:teuthology.orchestra.run.smithi049:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:51:17.086 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:51:17.089 DEBUG:teuthology.orchestra.run.smithi098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:51:17.099 INFO:teuthology.orchestra.run.smithi049.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:51 /home/ubuntu/cephtest 2024-09-21T06:51:17.103 INFO:teuthology.orchestra.run.smithi079.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:51 /home/ubuntu/cephtest 2024-09-21T06:51:17.112 INFO:teuthology.orchestra.run.smithi098.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:51 /home/ubuntu/cephtest 2024-09-21T06:51:17.113 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T06:51:17.125 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T06:51:17.152 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/fs/test_o_trunc}} duration: 1899.451815366745 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T06:51:17.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:51:17.226 INFO:teuthology.run:pass